2023-12-09T02:02:30.956 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-09T02:02:30.956 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628 --verbose --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --name yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628/orig.config.yaml 2023-12-09T02:02:31.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:02:31.104 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628 branch: main description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: yweinste@redhat.com first_in_suite: false job_id: '7484628' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 8320 sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 sleep_before_teardown: 0 subset: 111/120000 suite: orch suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDLGmGNt+qqtG2i30m5b9ZVtYO4pf+PODCH3Q3LztTY8SlVAkOd0CeWvl6gev6QzHc5oTapLT3Y1MSXeHEsETPQ= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJZIcCbBer9WMUzjbLfMjTcxr/tmFJMpy4poE6Cu6CzgE8eJmUq1pAU0VBWUPDzdP3sD77pN6ka2seyU8orCjI= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/yuriw/src/github.com_ceph_ceph-c_main/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-08_19:38:02 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-09T02:02:31.104 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa; will attempt to use it 2023-12-09T02:02:31.105 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks 2023-12-09T02:02:31.105 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-09T02:02:31.107 INFO:teuthology.task.internal:Checking packages... 2023-12-09T02:02:31.130 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9dcc13bb80dcc1cdea72b04d80505b4649a2b882' 2023-12-09T02:02:31.130 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-09T02:02:31.130 INFO:teuthology.packaging:ref: None 2023-12-09T02:02:31.130 INFO:teuthology.packaging:tag: None 2023-12-09T02:02:31.130 INFO:teuthology.packaging:branch: main 2023-12-09T02:02:31.130 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:02:31.131 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-12-09T02:02:31.448 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-58.ge94de282 2023-12-09T02:02:31.449 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-09T02:02:31.455 INFO:teuthology.task.internal:no buildpackages task found 2023-12-09T02:02:31.455 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-09T02:02:31.467 INFO:teuthology.task.internal:Saving configuration 2023-12-09T02:02:31.492 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-09T02:02:31.497 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-09T02:02:31.524 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-09 01:56:50.197482', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDLGmGNt+qqtG2i30m5b9ZVtYO4pf+PODCH3Q3LztTY8SlVAkOd0CeWvl6gev6QzHc5oTapLT3Y1MSXeHEsETPQ='} 2023-12-09T02:02:31.548 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-09 01:56:50.195488', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJZIcCbBer9WMUzjbLfMjTcxr/tmFJMpy4poE6Cu6CzgE8eJmUq1pAU0VBWUPDzdP3sD77pN6ka2seyU8orCjI='} 2023-12-09T02:02:31.548 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-09T02:02:31.554 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-09T02:02:31.554 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-09T02:02:31.554 INFO:teuthology.run_tasks:Running task console_log... 2023-12-09T02:02:31.633 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6cd55b30d0>, signals=[15]) 2023-12-09T02:02:31.634 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-09T02:02:31.640 INFO:teuthology.task.internal:Opening connections... 2023-12-09T02:02:31.640 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:02:31.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:02:31.710 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2023-12-09T02:02:31.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:02:31.777 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-09T02:02:31.784 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-12-09T02:02:31.807 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-12-09T02:02:31.807 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-12-09T02:02:31.870 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2023-12-09T02:02:31.870 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2023-12-09T02:02:31.870 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2023-12-09T02:02:31.870 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2023-12-09T02:02:31.870 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2023-12-09T02:02:31.871 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-12-09T02:02:31.871 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-09T02:02:31.871 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-12-09T02:02:31.871 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-09T02:02:31.871 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2023-12-09T02:02:31.871 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-09T02:02:31.872 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-09T02:02:31.872 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-09T02:02:31.873 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-12-09T02:02:31.901 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-12-09T02:02:31.924 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-12-09T02:02:31.924 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-12-09T02:02:31.985 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-12-09T02:02:31.985 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-12-09T02:02:31.985 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-12-09T02:02:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-12-09T02:02:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-12-09T02:02:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-12-09T02:02:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-09T02:02:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-12-09T02:02:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-09T02:02:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-12-09T02:02:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-09T02:02:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-09T02:02:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-09T02:02:31.987 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-12-09T02:02:32.008 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-09T02:02:32.019 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-09T02:02:32.024 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-09T02:02:32.025 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2023-12-09T02:02:32.027 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2023-12-09T02:02:32.048 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-09T02:02:32.057 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-09T02:02:32.057 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2023-12-09T02:02:32.089 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2023-12-09T02:02:32.119 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-09T02:02:32.172 INFO:teuthology.run_tasks:Running task kernel... 2023-12-09T02:02:32.187 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-09T02:02:32.187 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-09T02:02:32.187 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-09T02:02:32.188 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-09T02:02:32.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-09T02:02:32.209 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-12-09T02:02:32.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-09T02:02:32.210 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-12-09T02:02:32.271 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-489.el8.x86_64 2023-12-09T02:02:32.271 INFO:teuthology.task.kernel:Running kernel on smithi088: 4.18.0-489.el8.x86_64 2023-12-09T02:02:32.271 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2023-12-09T02:02:32.272 INFO:teuthology.orchestra.run.smithi161.stdout:4.18.0-489.el8.x86_64 2023-12-09T02:02:32.272 INFO:teuthology.task.kernel:Running kernel on smithi161: 4.18.0-489.el8.x86_64 2023-12-09T02:02:32.272 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum install -y kernel 2023-12-09T02:02:55.328 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - AppStream 1.7 MB/s | 34 MB 00:20 2023-12-09T02:03:08.717 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - BaseOS 7.7 MB/s | 55 MB 00:07 2023-12-09T02:03:16.800 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras 62 kB/s | 18 kB 00:00 2023-12-09T02:03:17.267 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 6.9 kB 00:00 2023-12-09T02:03:17.660 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-12-09T02:03:19.753 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 16 MB 00:01 2023-12-09T02:03:23.552 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 431 kB/s | 24 kB 00:00 2023-12-09T02:03:27.201 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-09T02:03:27.202 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-09T02:03:27.499 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:03:27.500 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:03:27.500 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-12-09T02:03:27.500 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:03:27.500 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:03:27.500 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-09T02:03:27.500 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-12-09T02:03:27.500 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-09T02:03:27.500 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-09T02:03:27.500 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:03:27.500 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:03:27.501 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:03:27.501 INFO:teuthology.orchestra.run.smithi088.stdout:Install 3 Packages 2023-12-09T02:03:27.501 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:03:27.501 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 90 M 2023-12-09T02:03:27.501 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 96 M 2023-12-09T02:03:27.501 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:03:29.353 INFO:teuthology.orchestra.run.smithi088.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 5.6 MB/s | 10 MB 00:01 2023-12-09T02:03:32.869 INFO:teuthology.orchestra.run.smithi088.stdout:(2/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 6.8 MB/s | 36 MB 00:05 2023-12-09T02:03:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:(3/3): kernel-core-4.18.0-526.el8.x86_64.rpm 6.7 MB/s | 43 MB 00:06 2023-12-09T02:03:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:03:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:Total 14 MB/s | 90 MB 00:06 2023-12-09T02:03:34.659 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:03:35.105 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:03:35.105 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:03:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:03:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:03:39.209 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:03:39.707 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-09T02:03:43.295 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-09T02:03:43.681 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-09T02:03:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-09T02:03:47.528 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-09T02:04:09.417 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-09T02:04:09.440 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-09T02:04:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-09T02:04:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-09T02:04:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-09T02:04:10.561 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-09T02:04:10.562 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:04:10.562 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:04:10.562 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-09T02:04:10.562 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-09T02:04:10.562 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:04:10.562 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:04:10.694 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2023-12-09T02:04:10.912 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-09T02:04:10.912 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-09T02:04:10.912 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-09T02:04:10.912 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-09T02:04:10.913 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-09T02:04:10.913 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-12-09T02:04:10.913 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2023-12-09T02:04:10.913 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2023-12-09T02:04:11.121 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-09T02:04:11.121 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-09T02:04:11.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2023-12-09T02:04:11.155 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2023-12-09T02:04:11.155 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2023-12-09T02:04:11.155 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.02 2023-12-09T02:04:11.155 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 129.el8 2023-12-09T02:04:11.155 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2023-12-09T02:04:11.155 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-09T02:04:11.155 INFO:teuthology.orchestra.run.smithi088.stdout:Group : System Environment/Base 2023-12-09T02:04:11.155 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 9265586 2023-12-09T02:04:11.155 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:Relocations : (not relocatable) 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : CentOS BuildSystem 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2023-12-09T02:04:11.156 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:04:11.157 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2023-12-09T02:04:11.157 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-09T02:04:11.157 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 4.18.0-526.el8.x86_64 2023-12-09T02:04:11.158 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-09T02:04:12.744 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-12-09T02:04:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-12-09T02:04:14.839 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-12-09T02:04:14.871 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.5G0SFtKXdZ 2023-12-09T02:04:14.872 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5G0SFtKXdZ 2023-12-09T02:04:14.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.5G0SFtKXdZ 2023-12-09T02:04:15.088 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.5G0SFtKXdZ is 6KB 2023-12-09T02:04:15.136 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.5G0SFtKXdZ 2023-12-09T02:04:15.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2023-12-09T02:04:15.226 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-09T02:04:15.226 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-09T02:04:15.226 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-09T02:04:15.227 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-09T02:04:15.227 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-09T02:04:15.392 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2023-12-09T02:04:45.395 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-09T02:04:45.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-09T02:04:45.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:05:19.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-09T02:05:28.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-09T02:05:28.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:05:31.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-09T02:05:43.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-09T02:05:43.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:06:02.338 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-09T02:06:17.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-09T02:06:17.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:06:17.667 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-12-09T02:06:17.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-09T02:06:18.000 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-526.el8.x86_64"... 2023-12-09T02:06:18.000 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-12-09T02:06:18.018 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-526.el8.x86_64 2023-12-09T02:06:18.019 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-09T02:06:18.019 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-09T02:06:18.019 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-09T02:06:19.020 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-09T02:06:19.020 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-09T02:06:19.759 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2023-12-09T02:06:19.788 DEBUG:teuthology.parallel:result is None 2023-12-09T02:06:44.388 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - AppStream 140 kB/s | 34 MB 04:09 2023-12-09T02:07:00.362 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - BaseOS 5.6 MB/s | 55 MB 00:09 2023-12-09T02:07:08.603 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - Extras 43 kB/s | 18 kB 00:00 2023-12-09T02:07:09.070 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 6.9 kB 00:00 2023-12-09T02:07:09.371 INFO:teuthology.orchestra.run.smithi161.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-12-09T02:07:11.749 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 7.2 MB/s | 16 MB 00:02 2023-12-09T02:07:15.597 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 292 kB/s | 24 kB 00:00 2023-12-09T02:07:19.238 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-09T02:07:19.239 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-09T02:07:19.549 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:07:19.549 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:07:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2023-12-09T02:07:19.549 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:07:19.550 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:07:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-09T02:07:19.550 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-12-09T02:07:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-09T02:07:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-09T02:07:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:07:19.550 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:07:19.550 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:07:19.550 INFO:teuthology.orchestra.run.smithi161.stdout:Install 3 Packages 2023-12-09T02:07:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:07:19.551 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 90 M 2023-12-09T02:07:19.551 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 96 M 2023-12-09T02:07:19.551 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:07:21.507 INFO:teuthology.orchestra.run.smithi161.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 5.3 MB/s | 10 MB 00:01 2023-12-09T02:07:41.171 INFO:teuthology.orchestra.run.smithi161.stdout:(2/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 1.7 MB/s | 36 MB 00:21 2023-12-09T02:07:51.187 INFO:teuthology.orchestra.run.smithi161.stdout:(3/3): kernel-core-4.18.0-526.el8.x86_64.rpm 1.4 MB/s | 43 MB 00:31 2023-12-09T02:07:51.187 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:07:51.187 INFO:teuthology.orchestra.run.smithi161.stdout:Total 2.8 MB/s | 90 MB 00:31 2023-12-09T02:07:51.859 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:07:52.294 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:07:52.294 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:07:53.532 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:07:53.559 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:07:56.353 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:07:56.825 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-09T02:08:00.370 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-09T02:08:00.766 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-09T02:08:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-09T02:08:04.470 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-09T02:08:26.315 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-09T02:08:26.337 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-09T02:08:26.687 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-09T02:08:26.687 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-09T02:08:26.687 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-09T02:08:27.482 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-09T02:08:27.482 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:08:27.482 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:08:27.482 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-09T02:08:27.482 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-09T02:08:27.482 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:08:27.482 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:08:27.658 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2023-12-09T02:08:27.875 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-09T02:08:27.876 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-09T02:08:27.876 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-09T02:08:27.876 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-09T02:08:27.876 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-09T02:08:27.876 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2023-12-09T02:08:27.876 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2023-12-09T02:08:27.876 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2023-12-09T02:08:28.086 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-09T02:08:28.087 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-09T02:08:28.087 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -qi grub2-tools 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:Name : grub2-tools 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:Epoch : 1 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:Version : 2.02 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:Release : 129.el8 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: x86_64 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:Group : System Environment/Base 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:Size : 9265586 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:License : GPLv3+ 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-09T02:08:28.121 INFO:teuthology.orchestra.run.smithi161.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:Relocations : (not relocatable) 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:Packager : CentOS BuildSystem 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:Vendor : CentOS 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:Summary : Support tools for GRUB. 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:Description : 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:hardware devices. 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:08:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:This subpackage provides tools for support of all platforms. 2023-12-09T02:08:28.123 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-09T02:08:28.123 INFO:teuthology.task.kernel:Updating grub on smithi161 to boot 4.18.0-526.el8.x86_64 2023-12-09T02:08:28.124 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-09T02:08:29.640 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2023-12-09T02:08:31.724 INFO:teuthology.orchestra.run.smithi161.stderr:done 2023-12-09T02:08:31.725 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2023-12-09T02:08:31.749 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.h2ruHCduiI 2023-12-09T02:08:31.749 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.h2ruHCduiI 2023-12-09T02:08:31.824 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.h2ruHCduiI 2023-12-09T02:08:31.990 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.h2ruHCduiI is 6KB 2023-12-09T02:08:32.038 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.h2ruHCduiI 2023-12-09T02:08:32.056 DEBUG:teuthology.orchestra.run.smithi161:> sudo /bin/ls /boot/loader/entries || true 2023-12-09T02:08:32.135 INFO:teuthology.orchestra.run.smithi161.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-09T02:08:32.135 INFO:teuthology.orchestra.run.smithi161.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-09T02:08:32.135 INFO:teuthology.orchestra.run.smithi161.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-09T02:08:32.135 INFO:teuthology.orchestra.run.smithi161.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-09T02:08:32.136 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-09T02:08:32.272 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2023-12-09T02:09:02.275 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-09T02:09:02.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-09T02:09:02.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:09:20.742 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-09T02:09:29.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-09T02:09:29.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:09:32.806 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-09T02:09:44.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-09T02:09:44.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:10:44.810 DEBUG:teuthology.orchestra.remote:timed out 2023-12-09T02:10:59.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-09T02:10:59.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:11:00.136 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-12-09T02:11:00.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-09T02:11:00.437 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-526.el8.x86_64"... 2023-12-09T02:11:00.437 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-12-09T02:11:00.456 INFO:teuthology.orchestra.run.smithi161.stdout:4.18.0-526.el8.x86_64 2023-12-09T02:11:00.456 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-09T02:11:00.456 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-09T02:11:00.456 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-09T02:11:01.457 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-09T02:11:01.457 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-09T02:11:01.525 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2023-12-09T02:11:01.539 DEBUG:teuthology.parallel:result is None 2023-12-09T02:11:01.540 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-09T02:11:01.545 INFO:teuthology.task.internal:Creating test directory... 2023-12-09T02:11:01.546 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-09T02:11:01.549 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-09T02:11:01.570 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-09T02:11:01.576 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-09T02:11:01.584 INFO:teuthology.task.internal:Creating archive directory... 2023-12-09T02:11:01.584 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-09T02:11:01.616 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-09T02:11:01.657 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-09T02:11:01.668 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-09T02:11:01.668 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-09T02:11:01.690 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-09T02:11:01.724 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-09T02:11:01.731 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-09T02:11:01.736 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-09T02:11:01.742 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-09T02:11:01.743 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-09T02:11:01.750 INFO:teuthology.task.internal:Configuring sudo... 2023-12-09T02:11:01.750 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-09T02:11:01.779 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-09T02:11:01.814 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-09T02:11:01.824 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-09T02:11:01.824 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-09T02:11:01.850 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-09T02:11:01.874 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-09T02:11:01.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-09T02:11:02.004 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-09T02:11:02.090 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-09T02:11:02.131 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:11:02.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-09T02:11:02.199 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-09T02:11:02.247 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-09T02:11:02.301 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-09T02:11:02.386 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-09T02:11:02.456 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:11:02.456 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-09T02:11:02.526 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2023-12-09T02:11:02.528 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2023-12-09T02:11:02.586 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-09T02:11:02.631 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-09T02:11:02.984 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-09T02:11:02.993 INFO:teuthology.task.internal:Starting timer... 2023-12-09T02:11:02.993 INFO:teuthology.run_tasks:Running task pcp... 2023-12-09T02:11:03.005 INFO:teuthology.run_tasks:Running task selinux... 2023-12-09T02:11:03.013 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-09T02:11:03.013 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2023-12-09T02:11:03.088 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2023-12-09T02:11:03.089 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2023-12-09T02:11:03.168 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2023-12-09T02:11:03.170 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-09T02:11:03.170 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2023-12-09T02:11:03.197 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2023-12-09T02:11:03.197 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2023-12-09T02:11:03.231 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2023-12-09T02:11:03.231 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi161.front.sepia.ceph.com': 'permissive'} 2023-12-09T02:11:03.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-09T02:11:03.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-09T02:11:03.265 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-09T02:11:03.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-09T02:11:03.299 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-09T02:11:03.299 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2023-12-09T02:11:03.331 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2023-12-09T02:11:03.373 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-09T02:11:03.383 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-09T02:11:03.384 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-09T02:11:03.400 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-09T02:11:03.401 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-09T02:18:36.402 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2023-12-09T02:18:36.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-09T02:18:36.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:18:36.476 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-12-09T02:18:36.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-09T02:18:36.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-09T02:18:36.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T02:18:36.612 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-12-09T02:18:36.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-09T02:18:36.685 INFO:teuthology.run_tasks:Running task clock... 2023-12-09T02:18:36.696 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-09T02:18:36.696 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-09T02:18:36.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-09T02:18:36.700 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-09T02:18:36.700 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-09T02:18:36.729 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-09T02:18:36.743 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-09T02:18:36.755 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-09T02:18:36.769 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-09T02:18:36.811 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2023-12-09T02:18:36.822 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2023-12-09T02:18:36.835 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-09T02:18:36.835 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2023-12-09T02:18:36.847 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2023-12-09T02:18:36.848 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-09T02:18:36.861 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-09T02:18:36.874 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-09T02:18:36.918 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-12-09T02:18:36.921 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-09T02:18:36.922 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-12-09T02:18:36.922 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-09T02:18:36.922 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-09T02:18:36.922 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-09T02:18:36.922 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-09T02:18:36.940 INFO:teuthology.orchestra.run.smithi161.stderr:bash: ntpq: command not found 2023-12-09T02:18:36.944 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-09T02:18:36.944 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2023-12-09T02:18:36.944 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-09T02:18:36.944 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-09T02:18:36.944 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-09T02:18:36.944 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-09T02:18:36.944 INFO:teuthology.run_tasks:Running task pexec... 2023-12-09T02:18:36.953 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-09T02:18:36.954 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:18:36.954 DEBUG:teuthology.orchestra.run.smithi088:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-09T02:18:36.954 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi161.front.sepia.ceph.com 2023-12-09T02:18:36.955 DEBUG:teuthology.orchestra.run.smithi161:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-09T02:18:37.839 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:46 ago on Sat 09 Dec 2023 02:16:51 AM UTC. 2023-12-09T02:18:37.864 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:45 ago on Sat 09 Dec 2023 02:16:52 AM UTC. 2023-12-09T02:18:39.997 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:18:39.998 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:18:39.998 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-12-09T02:18:39.998 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:18:39.998 INFO:teuthology.orchestra.run.smithi088.stdout:Resetting modules: 2023-12-09T02:18:39.998 INFO:teuthology.orchestra.run.smithi088.stdout: container-tools 2023-12-09T02:18:39.998 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:18:39.998 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:18:39.998 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:18:39.998 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:18:40.021 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:18:40.021 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:18:40.021 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2023-12-09T02:18:40.021 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:18:40.021 INFO:teuthology.orchestra.run.smithi161.stdout:Resetting modules: 2023-12-09T02:18:40.022 INFO:teuthology.orchestra.run.smithi161.stdout: container-tools 2023-12-09T02:18:40.022 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:18:40.022 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:18:40.022 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:18:40.022 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:18:40.254 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:18:40.273 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:18:41.193 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:50 ago on Sat 09 Dec 2023 02:16:51 AM UTC. 2023-12-09T02:18:41.216 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:49 ago on Sat 09 Dec 2023 02:16:52 AM UTC. 2023-12-09T02:18:43.311 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:18:43.326 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:18:43.494 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:18:43.494 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout:Installing group/module packages: 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-12-09T02:18:43.495 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout:Installing weak dependencies: 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout:Installing module profiles: 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout: container-tools/common 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling module streams: 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout: container-tools rhel8 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout:Install 13 Packages 2023-12-09T02:18:43.496 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:18:43.497 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 27 M 2023-12-09T02:18:43.497 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 89 M 2023-12-09T02:18:43.497 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:18:43.513 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:18:43.513 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-12-09T02:18:43.513 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:18:43.513 INFO:teuthology.orchestra.run.smithi161.stdout:Installing group/module packages: 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-09T02:18:43.514 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout:Installing weak dependencies: 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout:Installing module profiles: 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout: container-tools/common 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout:Enabling module streams: 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout: container-tools rhel8 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout:Install 13 Packages 2023-12-09T02:18:43.515 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:18:43.516 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 27 M 2023-12-09T02:18:43.516 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 89 M 2023-12-09T02:18:43.516 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:18:44.989 INFO:teuthology.orchestra.run.smithi161.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 524 kB/s | 750 kB 00:01 2023-12-09T02:18:45.023 INFO:teuthology.orchestra.run.smithi161.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 701 kB/s | 1.0 MB 00:01 2023-12-09T02:18:45.097 INFO:teuthology.orchestra.run.smithi088.stdout:(1/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 731 kB/s | 1.0 MB 00:01 2023-12-09T02:18:45.330 INFO:teuthology.orchestra.run.smithi088.stdout:(2/13): cockpit-podman-78-1.module_el8+712+4cd1 458 kB/s | 750 kB 00:01 2023-12-09T02:18:45.515 INFO:teuthology.orchestra.run.smithi161.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 72 kB/s | 38 kB 00:00 2023-12-09T02:18:45.647 INFO:teuthology.orchestra.run.smithi088.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 69 kB/s | 38 kB 00:00 2023-12-09T02:18:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] netavark-1.8.0-2.module_el8+712+4cd1bd69.x86_64.rpm: Status code: 503 for http://mirrors.rcs.alaska.edu/centos/8-stream/AppStream/x86_64/os/Packages/netavark-1.8.0-2.module_el8%2b712%2b4cd1bd69.x86_64.rpm (IP: 199.165.82.202) 2023-12-09T02:18:46.065 INFO:teuthology.orchestra.run.smithi161.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 231 kB/s | 241 kB 00:01 2023-12-09T02:18:46.455 INFO:teuthology.orchestra.run.smithi088.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 214 kB/s | 241 kB 00:01 2023-12-09T02:18:46.982 INFO:teuthology.orchestra.run.smithi161.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 194 kB/s | 178 kB 00:00 2023-12-09T02:18:47.090 INFO:teuthology.orchestra.run.smithi161.stdout:(6/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 2.7 MB/s | 9.6 MB 00:03 2023-12-09T02:18:47.339 INFO:teuthology.orchestra.run.smithi088.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 201 kB/s | 178 kB 00:00 2023-12-09T02:18:47.391 INFO:teuthology.orchestra.run.smithi161.stdout:(7/13): python3-pytoml-0.1.14-5.git7dea353.el8. 61 kB/s | 25 kB 00:00 2023-12-09T02:18:47.875 INFO:teuthology.orchestra.run.smithi161.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 1.7 MB/s | 3.9 MB 00:02 2023-12-09T02:18:47.900 INFO:teuthology.orchestra.run.smithi161.stdout:(9/13): python3-pyxdg-0.25-16.el8.noarch.rpm 116 kB/s | 94 kB 00:00 2023-12-09T02:18:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 42 kB/s | 25 kB 00:00 2023-12-09T02:18:48.165 INFO:teuthology.orchestra.run.smithi088.stdout:(7/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 2.1 MB/s | 9.6 MB 00:04 2023-12-09T02:18:48.425 INFO:teuthology.orchestra.run.smithi161.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 100 kB/s | 53 kB 00:00 2023-12-09T02:18:48.723 INFO:teuthology.orchestra.run.smithi088.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 118 kB/s | 94 kB 00:00 2023-12-09T02:18:48.950 INFO:teuthology.orchestra.run.smithi161.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 78 kB/s | 41 kB 00:00 2023-12-09T02:18:50.450 INFO:teuthology.orchestra.run.smithi161.stdout:(12/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 2.7 MB/s | 8.1 MB 00:03 2023-12-09T02:18:50.659 INFO:teuthology.orchestra.run.smithi161.stdout:(13/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 931 kB/s | 2.5 MB 00:02 2023-12-09T02:18:50.659 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:18:50.659 INFO:teuthology.orchestra.run.smithi161.stdout:Total 3.7 MB/s | 27 MB 00:07 2023-12-09T02:18:50.928 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:18:50.950 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:18:50.950 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:18:50.982 INFO:teuthology.orchestra.run.smithi088.stdout:(9/13): toolbox-0.0.99.4-6.module_el8+712+4cd1b 1.1 MB/s | 2.5 MB 00:02 2023-12-09T02:18:51.219 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:18:51.222 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:18:51.531 INFO:teuthology.orchestra.run.smithi088.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 96 kB/s | 53 kB 00:00 2023-12-09T02:18:51.957 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:18:52.040 INFO:teuthology.orchestra.run.smithi088.stdout:(11/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 2.1 MB/s | 8.1 MB 00:03 2023-12-09T02:18:52.065 INFO:teuthology.orchestra.run.smithi088.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 77 kB/s | 41 kB 00:00 2023-12-09T02:18:52.201 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-09T02:18:52.380 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-09T02:18:52.595 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-09T02:18:52.857 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-09T02:18:53.450 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-09T02:18:54.457 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-09T02:18:54.700 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-09T02:18:54.903 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-09T02:18:55.167 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-09T02:18:55.582 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-09T02:18:56.662 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-09T02:18:56.910 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-09T02:18:57.129 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-09T02:18:57.552 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-09T02:18:57.552 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-09T02:18:57.552 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-09T02:18:57.553 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-09T02:18:57.553 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-09T02:18:57.553 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-09T02:18:57.553 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-09T02:18:57.553 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-09T02:18:57.553 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-09T02:18:57.553 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-09T02:18:57.553 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-09T02:18:57.553 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-09T02:18:57.553 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-09T02:18:58.366 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-09T02:18:58.366 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:18:58.366 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:18:58.367 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:18:58.652 DEBUG:teuthology.parallel:result is None 2023-12-09T02:22:54.527 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] netavark-1.8.0-2.module_el8+712+4cd1bd69.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/netavark-1.8.0-2.module_el8%2b712%2b4cd1bd69.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-09T02:22:55.100 INFO:teuthology.orchestra.run.smithi088.stdout:(13/13): netavark-1.8.0-2.module_el8+712+4cd1bd 16 kB/s | 3.9 MB 04:09 2023-12-09T02:22:55.100 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:22:55.100 INFO:teuthology.orchestra.run.smithi088.stdout:Total 108 kB/s | 27 MB 04:11 2023-12-09T02:22:55.360 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:22:55.381 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:22:55.382 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:22:55.639 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:22:55.642 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:22:56.545 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-09T02:22:56.731 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-09T02:22:56.945 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-09T02:22:57.183 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-09T02:22:57.716 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-09T02:22:58.696 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-09T02:22:58.926 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-09T02:22:59.131 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-09T02:22:59.427 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-09T02:22:59.825 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-09T02:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-09T02:23:00.952 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-09T02:23:01.130 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-09T02:23:01.586 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-09T02:23:01.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-09T02:23:01.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-09T02:23:01.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-09T02:23:01.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-09T02:23:01.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-09T02:23:01.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-09T02:23:01.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-09T02:23:01.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-09T02:23:01.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-09T02:23:01.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-09T02:23:01.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-09T02:23:01.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-09T02:23:02.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-09T02:23:02.374 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-09T02:23:02.375 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:23:02.376 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:23:02.680 DEBUG:teuthology.parallel:result is None 2023-12-09T02:23:02.680 INFO:teuthology.run_tasks:Running task install... 2023-12-09T02:23:02.690 DEBUG:teuthology.task.install:project ceph 2023-12-09T02:23:02.690 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'}} 2023-12-09T02:23:02.690 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'} 2023-12-09T02:23:02.690 INFO:teuthology.task.install:Using flavor: default 2023-12-09T02:23:02.696 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-09T02:23:02.696 INFO:teuthology.task.install:extra packages: [] 2023-12-09T02:23:02.696 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882', 'tag': None, 'wait_for_package': False} 2023-12-09T02:23:02.696 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-09T02:23:02.696 INFO:teuthology.packaging:ref: None 2023-12-09T02:23:02.697 INFO:teuthology.packaging:tag: None 2023-12-09T02:23:02.697 INFO:teuthology.packaging:branch: quincy 2023-12-09T02:23:02.697 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:23:02.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-09T02:23:02.699 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882', 'tag': None, 'wait_for_package': False} 2023-12-09T02:23:02.699 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-09T02:23:02.699 INFO:teuthology.packaging:ref: None 2023-12-09T02:23:02.699 INFO:teuthology.packaging:tag: None 2023-12-09T02:23:02.699 INFO:teuthology.packaging:branch: quincy 2023-12-09T02:23:02.699 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:23:02.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-09T02:23:02.933 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/ 2023-12-09T02:23:02.934 INFO:teuthology.task.install.rpm:Package version is 17.2.7-119.ge2143d99 2023-12-09T02:23:02.978 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/ 2023-12-09T02:23:02.978 INFO:teuthology.task.install.rpm:Package version is 17.2.7-119.ge2143d99 2023-12-09T02:23:03.092 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-09T02:23:03.093 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:23:03.093 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-09T02:23:03.126 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-09T02:23:03.126 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:23:03.126 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-09T02:23:03.131 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-09T02:23:03.131 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-09T02:23:03.132 INFO:teuthology.packaging:ref: None 2023-12-09T02:23:03.132 INFO:teuthology.packaging:tag: None 2023-12-09T02:23:03.132 INFO:teuthology.packaging:branch: quincy 2023-12-09T02:23:03.132 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:23:03.132 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-09T02:23:03.155 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-09T02:23:03.155 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-09T02:23:03.155 INFO:teuthology.packaging:ref: None 2023-12-09T02:23:03.155 INFO:teuthology.packaging:tag: None 2023-12-09T02:23:03.155 INFO:teuthology.packaging:branch: quincy 2023-12-09T02:23:03.155 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:23:03.155 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-09T02:23:03.204 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-09T02:23:03.223 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-09T02:23:03.284 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-09T02:23:03.299 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-09T02:23:03.353 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2023-12-09T02:23:03.354 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2023-12-09T02:23:03.366 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2023-12-09T02:23:03.367 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2023-12-09T02:23:03.625 INFO:teuthology.orchestra.run.smithi161.stdout:76 files removed 2023-12-09T02:23:03.633 INFO:teuthology.orchestra.run.smithi088.stdout:76 files removed 2023-12-09T02:23:03.653 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw 2023-12-09T02:23:03.661 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw 2023-12-09T02:23:04.384 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 245 kB/s | 78 kB 00:00 2023-12-09T02:23:04.457 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 199 kB/s | 78 kB 00:00 2023-12-09T02:23:04.693 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 34 kB/s | 9.1 kB 00:00 2023-12-09T02:23:04.783 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 32 kB/s | 9.1 kB 00:00 2023-12-09T02:23:05.093 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 3.9 kB/s | 1.4 kB 00:00 2023-12-09T02:23:05.176 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 4.0 kB/s | 1.4 kB 00:00 2023-12-09T02:23:16.134 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - AppStream 3.1 MB/s | 34 MB 00:11 2023-12-09T02:23:16.482 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - AppStream 3.0 MB/s | 34 MB 00:11 2023-12-09T02:23:28.517 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - BaseOS 8.9 MB/s | 55 MB 00:06 2023-12-09T02:23:28.981 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - BaseOS 8.8 MB/s | 55 MB 00:06 2023-12-09T02:23:36.734 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2023-12-09T02:23:37.131 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2023-12-09T02:23:37.184 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - Extras common packages 25 kB/s | 6.9 kB 00:00 2023-12-09T02:23:37.573 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras common packages 26 kB/s | 6.9 kB 00:00 2023-12-09T02:23:37.902 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - PowerTools 12 MB/s | 6.6 MB 00:00 2023-12-09T02:23:38.466 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - PowerTools 8.9 MB/s | 6.6 MB 00:00 2023-12-09T02:23:39.420 INFO:teuthology.orchestra.run.smithi161.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-12-09T02:23:39.901 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-12-09T02:23:40.337 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2023-12-09T02:23:40.960 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-12-09T02:23:44.187 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 379 kB/s | 24 kB 00:00 2023-12-09T02:23:44.801 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 277 kB/s | 24 kB 00:00 2023-12-09T02:23:48.754 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:23:48.757 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:23:48.757 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-12-09T02:23:48.757 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:23:48.757 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:23:48.757 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:17.2.7-119.ge2143d99.el8 ceph 17 M 2023-12-09T02:23:48.757 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2023-12-09T02:23:48.757 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.5 M 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.6 M 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:17.2.7-119.ge2143d99.el8 ceph 5.2 M 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:17.2.7-119.ge2143d99.el8 ceph 23 M 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:17.2.7-119.ge2143d99.el8 ceph 24 k 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 796 k 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 506 k 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 5.6 M 2023-12-09T02:23:48.758 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 45 k 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:17.2.7-119.ge2143d99.el8 ceph 115 k 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:17.2.7-119.ge2143d99.el8 ceph 190 k 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:17.2.7-119.ge2143d99.el8 ceph 370 k 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 358 k 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:17.2.7-119.ge2143d99.el8 ceph 107 k 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:Install 21 Packages 2023-12-09T02:23:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 2 Packages 2023-12-09T02:23:48.760 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:23:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 63 M 2023-12-09T02:23:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:23:49.339 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:17.2.7-119.ge2143d99.el8 ceph 17 M 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.5 M 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.6 M 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:17.2.7-119.ge2143d99.el8 ceph 5.2 M 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:17.2.7-119.ge2143d99.el8 ceph 23 M 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:17.2.7-119.ge2143d99.el8 ceph 24 k 2023-12-09T02:23:49.342 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 796 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 506 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 5.6 M 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 45 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:17.2.7-119.ge2143d99.el8 ceph 115 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:17.2.7-119.ge2143d99.el8 ceph 190 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:17.2.7-119.ge2143d99.el8 ceph 370 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 358 k 2023-12-09T02:23:49.343 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:17.2.7-119.ge2143d99.el8 ceph 107 k 2023-12-09T02:23:49.344 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-09T02:23:49.344 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:23:49.344 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:23:49.344 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:23:49.344 INFO:teuthology.orchestra.run.smithi088.stdout:Install 21 Packages 2023-12-09T02:23:49.344 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 2 Packages 2023-12-09T02:23:49.344 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:23:49.344 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 63 M 2023-12-09T02:23:49.344 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:23:50.306 INFO:teuthology.orchestra.run.smithi161.stdout:(1/23): ceph-radosgw-17.2.7-119.ge2143d99.el8.x 15 MB/s | 17 MB 00:01 2023-12-09T02:23:50.355 INFO:teuthology.orchestra.run.smithi161.stdout:(2/23): ceph-selinux-17.2.7-119.ge2143d99.el8.x 491 kB/s | 24 kB 00:00 2023-12-09T02:23:50.464 INFO:teuthology.orchestra.run.smithi161.stdout:(3/23): libcephfs2-17.2.7-119.ge2143d99.el8.x86 7.2 MB/s | 796 kB 00:00 2023-12-09T02:23:50.573 INFO:teuthology.orchestra.run.smithi161.stdout:(4/23): libradosstriper1-17.2.7-119.ge2143d99.e 4.6 MB/s | 506 kB 00:00 2023-12-09T02:23:51.148 INFO:teuthology.orchestra.run.smithi161.stdout:(5/23): librgw2-17.2.7-119.ge2143d99.el8.x86_64 9.7 MB/s | 5.6 MB 00:00 2023-12-09T02:23:51.215 INFO:teuthology.orchestra.run.smithi161.stdout:(6/23): python3-ceph-argparse-17.2.7-119.ge2143 672 kB/s | 45 kB 00:00 2023-12-09T02:23:51.290 INFO:teuthology.orchestra.run.smithi161.stdout:(7/23): python3-ceph-common-17.2.7-119.ge2143d9 1.5 MB/s | 115 kB 00:00 2023-12-09T02:23:51.374 INFO:teuthology.orchestra.run.smithi161.stdout:(8/23): python3-cephfs-17.2.7-119.ge2143d99.el8 2.2 MB/s | 190 kB 00:00 2023-12-09T02:23:51.437 INFO:teuthology.orchestra.run.smithi088.stdout:(1/23): ceph-radosgw-17.2.7-119.ge2143d99.el8.x 10 MB/s | 17 MB 00:01 2023-12-09T02:23:51.494 INFO:teuthology.orchestra.run.smithi088.stdout:(2/23): ceph-selinux-17.2.7-119.ge2143d99.el8.x 420 kB/s | 24 kB 00:00 2023-12-09T02:23:51.594 INFO:teuthology.orchestra.run.smithi088.stdout:(3/23): libcephfs2-17.2.7-119.ge2143d99.el8.x86 7.8 MB/s | 796 kB 00:00 2023-12-09T02:23:51.716 INFO:teuthology.orchestra.run.smithi161.stdout:(9/23): python3-rados-17.2.7-119.ge2143d99.el8. 1.1 MB/s | 370 kB 00:00 2023-12-09T02:23:51.816 INFO:teuthology.orchestra.run.smithi161.stdout:(10/23): python3-rbd-17.2.7-119.ge2143d99.el8.x 3.5 MB/s | 358 kB 00:00 2023-12-09T02:23:51.878 INFO:teuthology.orchestra.run.smithi088.stdout:(4/23): ceph-base-17.2.7-119.ge2143d99.el8.x86_ 2.4 MB/s | 5.2 MB 00:02 2023-12-09T02:23:51.945 INFO:teuthology.orchestra.run.smithi088.stdout:(5/23): libradosstriper1-17.2.7-119.ge2143d99.e 1.4 MB/s | 506 kB 00:00 2023-12-09T02:23:52.053 INFO:teuthology.orchestra.run.smithi088.stdout:(6/23): python3-ceph-argparse-17.2.7-119.ge2143 414 kB/s | 45 kB 00:00 2023-12-09T02:23:52.166 INFO:teuthology.orchestra.run.smithi161.stdout:(11/23): python3-rgw-17.2.7-119.ge2143d99.el8.x 305 kB/s | 107 kB 00:00 2023-12-09T02:23:52.287 INFO:teuthology.orchestra.run.smithi088.stdout:(7/23): librgw2-17.2.7-119.ge2143d99.el8.x86_64 14 MB/s | 5.6 MB 00:00 2023-12-09T02:23:52.354 INFO:teuthology.orchestra.run.smithi088.stdout:(8/23): python3-cephfs-17.2.7-119.ge2143d99.el8 2.8 MB/s | 190 kB 00:00 2023-12-09T02:23:52.396 INFO:teuthology.orchestra.run.smithi088.stdout:(9/23): python3-ceph-common-17.2.7-119.ge2143d9 337 kB/s | 115 kB 00:00 2023-12-09T02:23:52.454 INFO:teuthology.orchestra.run.smithi088.stdout:(10/23): python3-rados-17.2.7-119.ge2143d99.el8 3.6 MB/s | 370 kB 00:00 2023-12-09T02:23:52.480 INFO:teuthology.orchestra.run.smithi088.stdout:(11/23): python3-rbd-17.2.7-119.ge2143d99.el8.x 4.2 MB/s | 358 kB 00:00 2023-12-09T02:23:52.513 INFO:teuthology.orchestra.run.smithi088.stdout:(12/23): python3-rgw-17.2.7-119.ge2143d99.el8.x 1.8 MB/s | 107 kB 00:00 2023-12-09T02:23:52.809 INFO:teuthology.orchestra.run.smithi161.stdout:(12/23): ceph-base-17.2.7-119.ge2143d99.el8.x86 1.4 MB/s | 5.2 MB 00:03 2023-12-09T02:23:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 342 kB/s | 354 kB 00:01 2023-12-09T02:23:53.389 INFO:teuthology.orchestra.run.smithi088.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 297 kB/s | 259 kB 00:00 2023-12-09T02:23:53.481 INFO:teuthology.orchestra.run.smithi088.stdout:(14/23): librdkafka-0.11.4-3.el8.x86_64.rpm 354 kB/s | 354 kB 00:01 2023-12-09T02:23:53.584 INFO:teuthology.orchestra.run.smithi161.stdout:(14/23): ceph-common-17.2.7-119.ge2143d99.el8.x 5.4 MB/s | 23 MB 00:04 2023-12-09T02:23:53.622 INFO:teuthology.orchestra.run.smithi088.stdout:(15/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 332 kB/s | 47 kB 00:00 2023-12-09T02:23:53.718 INFO:teuthology.orchestra.run.smithi161.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 85 kB/s | 44 kB 00:00 2023-12-09T02:23:53.734 INFO:teuthology.orchestra.run.smithi161.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 313 kB/s | 47 kB 00:00 2023-12-09T02:23:53.818 INFO:teuthology.orchestra.run.smithi161.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 709 kB/s | 59 kB 00:00 2023-12-09T02:23:53.865 INFO:teuthology.orchestra.run.smithi088.stdout:(16/23): ceph-common-17.2.7-119.ge2143d99.el8.x 5.7 MB/s | 23 MB 00:04 2023-12-09T02:23:53.868 INFO:teuthology.orchestra.run.smithi161.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 2.2 MB/s | 306 kB 00:00 2023-12-09T02:23:53.915 INFO:teuthology.orchestra.run.smithi088.stdout:(17/23): python3-prettytable-0.7.2-14.el8.noarc 83 kB/s | 44 kB 00:00 2023-12-09T02:23:53.919 INFO:teuthology.orchestra.run.smithi161.stdout:(19/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 234 kB/s | 259 kB 00:01 2023-12-09T02:23:53.944 INFO:teuthology.orchestra.run.smithi161.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 598 kB/s | 75 kB 00:00 2023-12-09T02:23:53.986 INFO:teuthology.orchestra.run.smithi161.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2023-12-09T02:23:54.048 INFO:teuthology.orchestra.run.smithi088.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 321 kB/s | 59 kB 00:00 2023-12-09T02:23:54.074 INFO:teuthology.orchestra.run.smithi088.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 679 kB/s | 306 kB 00:00 2023-12-09T02:23:54.099 INFO:teuthology.orchestra.run.smithi088.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 408 kB/s | 75 kB 00:00 2023-12-09T02:23:54.283 INFO:teuthology.orchestra.run.smithi088.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2023-12-09T02:23:54.446 INFO:teuthology.orchestra.run.smithi161.stdout:(22/23): librbd1-17.2.7-119.ge2143d99.el8.x86_6 7.2 MB/s | 3.6 MB 00:00 2023-12-09T02:23:54.483 INFO:teuthology.orchestra.run.smithi088.stdout:(22/23): librbd1-17.2.7-119.ge2143d99.el8.x86_6 9.3 MB/s | 3.6 MB 00:00 2023-12-09T02:23:54.541 INFO:teuthology.orchestra.run.smithi088.stdout:(23/23): librados2-17.2.7-119.ge2143d99.el8.x86 7.4 MB/s | 3.5 MB 00:00 2023-12-09T02:23:54.543 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:23:54.544 INFO:teuthology.orchestra.run.smithi088.stdout:Total 12 MB/s | 63 MB 00:05 2023-12-09T02:23:54.584 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:23:54.631 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:23:54.631 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:23:55.083 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:23:55.092 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:23:55.470 INFO:teuthology.orchestra.run.smithi161.stdout:(23/23): librados2-17.2.7-119.ge2143d99.el8.x86 2.2 MB/s | 3.5 MB 00:01 2023-12-09T02:23:55.472 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:23:55.472 INFO:teuthology.orchestra.run.smithi161.stdout:Total 9.4 MB/s | 63 MB 00:06 2023-12-09T02:23:55.513 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:23:55.558 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:23:55.558 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:23:55.947 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:23:55.950 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:23:56.229 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:23:56.454 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-09T02:23:56.635 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-09T02:23:57.002 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-09T02:23:57.045 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:23:57.202 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-09T02:23:57.269 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-09T02:23:57.309 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-09T02:23:57.474 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-09T02:23:57.566 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 4/25 2023-12-09T02:23:57.735 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-09T02:23:57.851 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-09T02:23:58.057 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-09T02:23:58.132 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-09T02:23:58.198 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-09T02:23:58.343 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-09T02:23:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 4/25 2023-12-09T02:23:58.577 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-09T02:23:58.607 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-09T02:23:58.756 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-09T02:23:58.982 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-09T02:23:59.009 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-09T02:23:59.135 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-09T02:23:59.199 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-09T02:23:59.458 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-09T02:23:59.654 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-09T02:23:59.694 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-09T02:23:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-09T02:23:59.870 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-09T02:23:59.918 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-09T02:24:00.041 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-09T02:24:00.062 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x 11/25 2023-12-09T02:24:00.262 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 12/25 2023-12-09T02:24:00.461 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 13/25 2023-12-09T02:24:00.619 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-09T02:24:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 14/25 2023-12-09T02:24:00.817 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 15/25 2023-12-09T02:24:00.824 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-09T02:24:00.883 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 15/25 2023-12-09T02:24:00.888 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-09T02:24:01.068 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x 11/25 2023-12-09T02:24:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-09T02:24:01.240 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 12/25 2023-12-09T02:24:01.259 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-09T02:24:01.467 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 13/25 2023-12-09T02:24:01.468 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-09T02:24:01.668 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86 19/25 2023-12-09T02:24:01.711 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 14/25 2023-12-09T02:24:01.890 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 15/25 2023-12-09T02:24:01.961 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 15/25 2023-12-09T02:24:02.217 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-09T02:24:02.415 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-09T02:24:02.611 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-09T02:24:02.833 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86 19/25 2023-12-09T02:24:04.324 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-09T02:24:04.609 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-09T02:24:05.216 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-09T02:24:05.501 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-09T02:24:05.526 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 21/25 2023-12-09T02:24:05.631 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 21/25 2023-12-09T02:24:05.757 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-09T02:24:05.900 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-09T02:24:06.360 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-09T02:24:06.672 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 21/25 2023-12-09T02:24:06.760 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 21/25 2023-12-09T02:24:06.965 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-09T02:24:24.398 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-09T02:24:24.398 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2023-12-09T02:24:24.398 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2023-12-09T02:24:24.398 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-12-09T02:24:24.398 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /run 2023-12-09T02:24:24.398 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2023-12-09T02:24:24.399 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2023-12-09T02:24:24.399 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2023-12-09T02:24:24.399 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2023-12-09T02:24:24.399 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-12-09T02:24:24.399 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:24:25.714 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-09T02:24:25.714 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2023-12-09T02:24:25.714 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2023-12-09T02:24:25.714 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /dev 2023-12-09T02:24:25.714 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /run 2023-12-09T02:24:25.714 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2023-12-09T02:24:25.714 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2023-12-09T02:24:25.714 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2023-12-09T02:24:25.715 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2023-12-09T02:24:25.715 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /dev 2023-12-09T02:24:25.715 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:24:26.121 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 23/25 2023-12-09T02:24:26.185 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 23/25 2023-12-09T02:24:26.186 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-09T02:24:26.381 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-09T02:24:26.381 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-09T02:24:27.096 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-09T02:24:27.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 1/25 2023-12-09T02:24:27.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 4/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 7/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x 8/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86 9/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 11/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 12/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 13/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-09T02:24:27.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-09T02:24:27.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-09T02:24:27.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-09T02:24:27.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-09T02:24:27.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-09T02:24:27.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-09T02:24:27.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-09T02:24:27.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-09T02:24:27.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 24/25 2023-12-09T02:24:27.469 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 23/25 2023-12-09T02:24:27.541 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 23/25 2023-12-09T02:24:27.541 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-09T02:24:27.789 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-09T02:24:27.789 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-09T02:24:28.244 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-09T02:24:28.244 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.245 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:24:28.246 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:24:28.519 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-test 2023-12-09T02:24:28.522 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-09T02:24:28.522 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 1/25 2023-12-09T02:24:28.522 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2/25 2023-12-09T02:24:28.522 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-09T02:24:28.522 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 4/25 2023-12-09T02:24:28.522 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-09T02:24:28.522 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-09T02:24:28.522 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 7/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x 8/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86 9/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 11/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 12/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 13/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-09T02:24:28.523 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-09T02:24:28.524 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 24/25 2023-12-09T02:24:29.373 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:45 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:24:29.783 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-09T02:24:29.783 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:24:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2023-12-09T02:24:29.783 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.783 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.784 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.785 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.785 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-09T02:24:29.785 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.785 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.785 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:29.785 INFO:teuthology.orchestra.run.smithi161.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-09T02:24:29.785 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:24:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:24:30.290 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-test 2023-12-09T02:24:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:17.2.7-119.ge2143d99.el8 ceph 52 M 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:17.2.7-119.ge2143d99.el8 ceph 174 k 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-09T02:24:31.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:24:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:24:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:24:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:Install 6 Packages 2023-12-09T02:24:31.055 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:24:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 53 M 2023-12-09T02:24:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 234 M 2023-12-09T02:24:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:24:31.151 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:47 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:24:31.376 INFO:teuthology.orchestra.run.smithi088.stdout:(1/6): libcephsqlite-17.2.7-119.ge2143d99.el8.x 624 kB/s | 174 kB 00:00 2023-12-09T02:24:32.193 INFO:teuthology.orchestra.run.smithi088.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 185 kB/s | 203 kB 00:01 2023-12-09T02:24:32.485 INFO:teuthology.orchestra.run.smithi088.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 169 kB/s | 187 kB 00:01 2023-12-09T02:24:32.826 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:24:32.827 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:24:32.827 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-12-09T02:24:32.827 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:24:32.827 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:24:32.827 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:17.2.7-119.ge2143d99.el8 ceph 52 M 2023-12-09T02:24:32.827 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-12-09T02:24:32.827 INFO:teuthology.orchestra.run.smithi161.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-09T02:24:32.827 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:17.2.7-119.ge2143d99.el8 ceph 174 k 2023-12-09T02:24:32.827 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-09T02:24:32.828 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-09T02:24:32.828 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-09T02:24:32.828 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:24:32.828 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:24:32.828 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:24:32.828 INFO:teuthology.orchestra.run.smithi161.stdout:Install 6 Packages 2023-12-09T02:24:32.828 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:24:32.828 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 53 M 2023-12-09T02:24:32.829 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 234 M 2023-12-09T02:24:32.829 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:24:33.160 INFO:teuthology.orchestra.run.smithi088.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 105 kB/s | 71 kB 00:00 2023-12-09T02:24:33.535 INFO:teuthology.orchestra.run.smithi088.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 241 kB/s | 323 kB 00:01 2023-12-09T02:24:33.622 INFO:teuthology.orchestra.run.smithi161.stdout:(1/6): libcephsqlite-17.2.7-119.ge2143d99.el8.x 291 kB/s | 174 kB 00:00 2023-12-09T02:24:34.027 INFO:teuthology.orchestra.run.smithi088.stdout:(6/6): ceph-test-17.2.7-119.ge2143d99.el8.x86_6 18 MB/s | 52 MB 00:02 2023-12-09T02:24:34.029 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:24:34.030 INFO:teuthology.orchestra.run.smithi088.stdout:Total 18 MB/s | 53 MB 00:02 2023-12-09T02:24:34.072 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:24:34.092 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:24:34.092 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:24:34.189 INFO:teuthology.orchestra.run.smithi161.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 174 kB/s | 203 kB 00:01 2023-12-09T02:24:34.377 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:24:34.380 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:24:34.531 INFO:teuthology.orchestra.run.smithi161.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 206 kB/s | 187 kB 00:00 2023-12-09T02:24:34.844 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:24:35.096 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-09T02:24:35.211 INFO:teuthology.orchestra.run.smithi161.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 104 kB/s | 71 kB 00:00 2023-12-09T02:24:35.287 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-09T02:24:35.443 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-09T02:24:35.507 INFO:teuthology.orchestra.run.smithi161.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 245 kB/s | 323 kB 00:01 2023-12-09T02:24:35.529 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-09T02:24:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-09T02:24:35.893 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 5/6 2023-12-09T02:24:36.032 INFO:teuthology.orchestra.run.smithi161.stdout:(6/6): ceph-test-17.2.7-119.ge2143d99.el8.x86_6 17 MB/s | 52 MB 00:03 2023-12-09T02:24:36.034 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:24:36.034 INFO:teuthology.orchestra.run.smithi161.stdout:Total 16 MB/s | 53 MB 00:03 2023-12-09T02:24:36.078 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:24:36.098 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:24:36.098 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:24:36.385 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:24:36.388 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:24:36.893 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:24:37.129 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-09T02:24:37.362 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-09T02:24:37.526 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-09T02:24:37.637 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-09T02:24:37.837 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-09T02:24:38.026 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 5/6 2023-12-09T02:24:40.874 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 5/6 2023-12-09T02:24:41.099 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 6/6 2023-12-09T02:24:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 6/6 2023-12-09T02:24:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 1/6 2023-12-09T02:24:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 2/6 2023-12-09T02:24:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-09T02:24:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-09T02:24:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-09T02:24:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-09T02:24:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:24:42.120 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:24:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.6-8.el8.x86_64 2023-12-09T02:24:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-09T02:24:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-09T02:24:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-09T02:24:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:24:42.120 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:24:42.345 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph 2023-12-09T02:24:43.051 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 5/6 2023-12-09T02:24:43.203 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:59 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:24:43.307 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 6/6 2023-12-09T02:24:43.593 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 6/6 2023-12-09T02:24:43.594 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 1/6 2023-12-09T02:24:43.594 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 2/6 2023-12-09T02:24:43.594 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-09T02:24:43.594 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-09T02:24:43.594 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-09T02:24:44.328 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-09T02:24:44.328 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:24:44.328 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:24:44.329 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:44.329 INFO:teuthology.orchestra.run.smithi161.stdout: jq-1.6-8.el8.x86_64 2023-12-09T02:24:44.329 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:24:44.329 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-09T02:24:44.329 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-09T02:24:44.329 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-09T02:24:44.329 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:24:44.329 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:24:44.551 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph 2023-12-09T02:24:44.872 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:24:44.876 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:24:44.876 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-12-09T02:24:44.876 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:24:44.876 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:24:44.876 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:17.2.7-119.ge2143d99.el8 ceph 6.4 k 2023-12-09T02:24:44.876 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-12-09T02:24:44.876 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:17.2.7-119.ge2143d99.el8 ceph 2.3 M 2023-12-09T02:24:44.876 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:17.2.7-119.ge2143d99.el8 ceph 1.6 M 2023-12-09T02:24:44.876 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 238 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.9 M 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 17 M 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-09T02:24:44.877 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-09T02:24:44.878 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:24:44.879 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:24:44.879 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:24:44.879 INFO:teuthology.orchestra.run.smithi088.stdout:Install 32 Packages 2023-12-09T02:24:44.879 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:24:44.879 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 28 M 2023-12-09T02:24:44.879 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 110 M 2023-12-09T02:24:44.880 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:24:45.428 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:01 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:24:45.578 INFO:teuthology.orchestra.run.smithi088.stdout:(1/32): ceph-17.2.7-119.ge2143d99.el8.x86_64.rp 53 kB/s | 6.4 kB 00:00 2023-12-09T02:24:45.770 INFO:teuthology.orchestra.run.smithi088.stdout:(2/32): ceph-mds-17.2.7-119.ge2143d99.el8.x86_6 7.3 MB/s | 2.3 MB 00:00 2023-12-09T02:24:46.187 INFO:teuthology.orchestra.run.smithi088.stdout:(3/32): ceph-mgr-17.2.7-119.ge2143d99.el8.x86_6 2.1 MB/s | 1.6 MB 00:00 2023-12-09T02:24:46.295 INFO:teuthology.orchestra.run.smithi088.stdout:(4/32): ceph-mgr-modules-core-17.2.7-119.ge2143 2.2 MB/s | 238 kB 00:00 2023-12-09T02:24:46.387 INFO:teuthology.orchestra.run.smithi088.stdout:(5/32): ceph-mon-17.2.7-119.ge2143d99.el8.x86_6 4.9 MB/s | 3.9 MB 00:00 2023-12-09T02:24:46.671 INFO:teuthology.orchestra.run.smithi088.stdout:(6/32): ceph-osd-17.2.7-119.ge2143d99.el8.x86_6 19 MB/s | 17 MB 00:00 2023-12-09T02:24:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 55 kB/s | 39 kB 00:00 2023-12-09T02:24:47.108 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:24:47.111 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:24:47.111 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-12-09T02:24:47.111 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:24:47.111 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:24:47.111 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:17.2.7-119.ge2143d99.el8 ceph 6.4 k 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:17.2.7-119.ge2143d99.el8 ceph 2.3 M 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:17.2.7-119.ge2143d99.el8 ceph 1.6 M 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 238 k 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.9 M 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 17 M 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-09T02:24:47.112 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-09T02:24:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-09T02:24:47.114 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-09T02:24:47.114 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-09T02:24:47.114 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-09T02:24:47.114 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:24:47.114 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:24:47.114 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:24:47.114 INFO:teuthology.orchestra.run.smithi161.stdout:Install 32 Packages 2023-12-09T02:24:47.114 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:24:47.115 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 28 M 2023-12-09T02:24:47.115 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 110 M 2023-12-09T02:24:47.115 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:24:47.255 INFO:teuthology.orchestra.run.smithi088.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 164 kB/s | 157 kB 00:00 2023-12-09T02:24:47.455 INFO:teuthology.orchestra.run.smithi088.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 132 kB/s | 103 kB 00:00 2023-12-09T02:24:47.647 INFO:teuthology.orchestra.run.smithi088.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2023-12-09T02:24:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:(1/32): ceph-17.2.7-119.ge2143d99.el8.x86_64.rp 31 kB/s | 6.4 kB 00:00 2023-12-09T02:24:47.755 INFO:teuthology.orchestra.run.smithi088.stdout:(11/32): python3-cryptography-3.2.1-6.el8.x86_6 5.8 MB/s | 641 kB 00:00 2023-12-09T02:24:47.823 INFO:teuthology.orchestra.run.smithi088.stdout:(12/32): python3-pytz-2017.2-11.el8.noarch.rpm 78 kB/s | 57 kB 00:00 2023-12-09T02:24:47.848 INFO:teuthology.orchestra.run.smithi088.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 1.2 MB/s | 109 kB 00:00 2023-12-09T02:24:47.884 INFO:teuthology.orchestra.run.smithi161.stdout:(2/32): ceph-mds-17.2.7-119.ge2143d99.el8.x86_6 6.2 MB/s | 2.3 MB 00:00 2023-12-09T02:24:48.082 INFO:teuthology.orchestra.run.smithi088.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 168 kB/s | 44 kB 00:00 2023-12-09T02:24:48.132 INFO:teuthology.orchestra.run.smithi088.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 653 kB/s | 185 kB 00:00 2023-12-09T02:24:48.193 INFO:teuthology.orchestra.run.smithi161.stdout:(3/32): ceph-mgr-17.2.7-119.ge2143d99.el8.x86_6 2.3 MB/s | 1.6 MB 00:00 2023-12-09T02:24:48.199 INFO:teuthology.orchestra.run.smithi088.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.4 MB/s | 173 kB 00:00 2023-12-09T02:24:48.258 INFO:teuthology.orchestra.run.smithi088.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 191 kB/s | 11 kB 00:00 2023-12-09T02:24:48.301 INFO:teuthology.orchestra.run.smithi161.stdout:(4/32): ceph-mgr-modules-core-17.2.7-119.ge2143 2.2 MB/s | 238 kB 00:00 2023-12-09T02:24:48.316 INFO:teuthology.orchestra.run.smithi088.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 302 kB/s | 18 kB 00:00 2023-12-09T02:24:48.341 INFO:teuthology.orchestra.run.smithi088.stdout:(19/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.8 MB/s | 384 kB 00:00 2023-12-09T02:24:48.375 INFO:teuthology.orchestra.run.smithi088.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 834 kB/s | 49 kB 00:00 2023-12-09T02:24:48.400 INFO:teuthology.orchestra.run.smithi088.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.0 MB/s | 59 kB 00:00 2023-12-09T02:24:48.467 INFO:teuthology.orchestra.run.smithi088.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-12-09T02:24:48.526 INFO:teuthology.orchestra.run.smithi088.stdout:(23/32): python3-simplegeneric-0.8.1-17.el8.noa 321 kB/s | 19 kB 00:00 2023-12-09T02:24:48.551 INFO:teuthology.orchestra.run.smithi088.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-12-09T02:24:48.585 INFO:teuthology.orchestra.run.smithi088.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 407 kB/s | 24 kB 00:00 2023-12-09T02:24:48.610 INFO:teuthology.orchestra.run.smithi088.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 498 kB/s | 29 kB 00:00 2023-12-09T02:24:48.644 INFO:teuthology.orchestra.run.smithi088.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 470 kB/s | 27 kB 00:00 2023-12-09T02:24:48.710 INFO:teuthology.orchestra.run.smithi161.stdout:(5/32): ceph-osd-17.2.7-119.ge2143d99.el8.x86_6 20 MB/s | 17 MB 00:00 2023-12-09T02:24:48.761 INFO:teuthology.orchestra.run.smithi088.stdout:(28/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.7 MB/s | 255 kB 00:00 2023-12-09T02:24:48.794 INFO:teuthology.orchestra.run.smithi088.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.6 MB/s | 251 kB 00:00 2023-12-09T02:24:48.845 INFO:teuthology.orchestra.run.smithi088.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.0 MB/s | 85 kB 00:00 2023-12-09T02:24:48.861 INFO:teuthology.orchestra.run.smithi088.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 343 kB/s | 23 kB 00:00 2023-12-09T02:24:49.028 INFO:teuthology.orchestra.run.smithi088.stdout:(32/32): python3-werkzeug-0.12.2-4.el8.noarch.r 258 kB/s | 457 kB 00:01 2023-12-09T02:24:49.032 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:24:49.033 INFO:teuthology.orchestra.run.smithi088.stdout:Total 6.8 MB/s | 28 MB 00:04 2023-12-09T02:24:49.117 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:24:49.154 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:24:49.155 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:24:49.235 INFO:teuthology.orchestra.run.smithi161.stdout:(6/32): ceph-mon-17.2.7-119.ge2143d99.el8.x86_6 2.6 MB/s | 3.9 MB 00:01 2023-12-09T02:24:49.260 INFO:teuthology.orchestra.run.smithi161.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 164 kB/s | 157 kB 00:00 2023-12-09T02:24:49.285 INFO:teuthology.orchestra.run.smithi161.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 67 kB/s | 39 kB 00:00 2023-12-09T02:24:49.453 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:24:49.456 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:24:49.827 INFO:teuthology.orchestra.run.smithi161.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 105 kB/s | 57 kB 00:00 2023-12-09T02:24:50.019 INFO:teuthology.orchestra.run.smithi161.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2023-12-09T02:24:50.044 INFO:teuthology.orchestra.run.smithi161.stdout:(11/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 128 kB/s | 103 kB 00:00 2023-12-09T02:24:50.128 INFO:teuthology.orchestra.run.smithi161.stdout:(12/32): python3-cryptography-3.2.1-6.el8.x86_6 5.8 MB/s | 641 kB 00:00 2023-12-09T02:24:50.220 INFO:teuthology.orchestra.run.smithi161.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 622 kB/s | 109 kB 00:00 2023-12-09T02:24:50.345 INFO:teuthology.orchestra.run.smithi161.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 201 kB/s | 44 kB 00:00 2023-12-09T02:24:50.471 INFO:teuthology.orchestra.run.smithi161.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 740 kB/s | 185 kB 00:00 2023-12-09T02:24:50.521 INFO:teuthology.orchestra.run.smithi161.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 984 kB/s | 173 kB 00:00 2023-12-09T02:24:50.543 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:24:50.588 INFO:teuthology.orchestra.run.smithi161.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 167 kB/s | 11 kB 00:00 2023-12-09T02:24:50.622 INFO:teuthology.orchestra.run.smithi161.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.5 MB/s | 384 kB 00:00 2023-12-09T02:24:50.672 INFO:teuthology.orchestra.run.smithi161.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 210 kB/s | 18 kB 00:00 2023-12-09T02:24:50.726 INFO:teuthology.orchestra.run.smithi161.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 467 kB/s | 49 kB 00:00 2023-12-09T02:24:50.764 INFO:teuthology.orchestra.run.smithi161.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 637 kB/s | 59 kB 00:00 2023-12-09T02:24:50.787 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-09T02:24:50.831 INFO:teuthology.orchestra.run.smithi161.stdout:(22/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.6 MB/s | 283 kB 00:00 2023-12-09T02:24:50.857 INFO:teuthology.orchestra.run.smithi161.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 169 kB/s | 16 kB 00:00 2023-12-09T02:24:50.924 INFO:teuthology.orchestra.run.smithi161.stdout:(24/32): python3-werkzeug-0.12.2-4.el8.noarch.r 279 kB/s | 457 kB 00:01 2023-12-09T02:24:50.965 INFO:teuthology.orchestra.run.smithi161.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 140 kB/s | 19 kB 00:00 2023-12-09T02:24:51.024 INFO:teuthology.orchestra.run.smithi161.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 143 kB/s | 24 kB 00:00 2023-12-09T02:24:51.048 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-09T02:24:51.166 INFO:teuthology.orchestra.run.smithi161.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 137 kB/s | 27 kB 00:00 2023-12-09T02:24:51.200 INFO:teuthology.orchestra.run.smithi161.stdout:(28/32): python3-tempora-1.14.1-5.el8.noarch.rp 106 kB/s | 29 kB 00:00 2023-12-09T02:24:51.314 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-09T02:24:51.316 INFO:teuthology.orchestra.run.smithi161.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 874 kB/s | 255 kB 00:00 2023-12-09T02:24:51.342 INFO:teuthology.orchestra.run.smithi161.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 602 kB/s | 85 kB 00:00 2023-12-09T02:24:51.367 INFO:teuthology.orchestra.run.smithi161.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.2 MB/s | 251 kB 00:00 2023-12-09T02:24:51.525 INFO:teuthology.orchestra.run.smithi161.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 110 kB/s | 23 kB 00:00 2023-12-09T02:24:51.528 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:24:51.528 INFO:teuthology.orchestra.run.smithi161.stdout:Total 6.4 MB/s | 28 MB 00:04 2023-12-09T02:24:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-09T02:24:51.610 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:24:51.647 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:24:51.647 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:24:51.810 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-09T02:24:51.962 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:24:51.965 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:24:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-09T02:24:52.168 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-09T02:24:52.362 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-09T02:24:52.571 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-09T02:24:52.775 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-09T02:24:53.030 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-09T02:24:53.159 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:24:53.271 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-09T02:24:53.405 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-09T02:24:53.640 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-09T02:24:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-09T02:24:53.900 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-09T02:24:53.917 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-09T02:24:54.088 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-09T02:24:54.155 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-09T02:24:54.353 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-09T02:24:54.378 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-09T02:24:54.582 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-09T02:24:54.585 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-09T02:24:54.802 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-09T02:24:54.928 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-09T02:24:55.021 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-09T02:24:55.169 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-09T02:24:55.298 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-09T02:24:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-09T02:24:55.503 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-09T02:24:55.535 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-09T02:24:55.715 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-09T02:24:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-09T02:24:55.971 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-09T02:24:56.037 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-09T02:24:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-09T02:24:56.610 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-09T02:24:56.751 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-09T02:24:56.936 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-09T02:24:57.043 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-09T02:24:57.239 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-09T02:24:57.317 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.n 27/32 2023-12-09T02:24:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-09T02:24:57.556 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 28/32 2023-12-09T02:24:57.766 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-09T02:24:58.122 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-09T02:24:58.329 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-09T02:24:58.518 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-09T02:24:58.729 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-09T02:24:58.967 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-09T02:24:59.033 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 28/32 2023-12-09T02:24:59.214 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 29/32 2023-12-09T02:24:59.215 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-09T02:24:59.493 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-09T02:24:59.606 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 29/32 2023-12-09T02:24:59.829 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-09T02:25:00.155 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-09T02:25:00.480 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 30/32 2023-12-09T02:25:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.n 27/32 2023-12-09T02:25:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 30/32 2023-12-09T02:25:00.789 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 28/32 2023-12-09T02:25:00.913 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 31/32 2023-12-09T02:25:00.931 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 31/32 2023-12-09T02:25:01.045 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:17.2.7-119.ge2143d99.el8.x86_64 32/32 2023-12-09T02:25:01.454 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-2:17.2.7-119.ge2143d99.el8.x86_64 32/32 2023-12-09T02:25:01.454 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:17.2.7-119.ge2143d99.el8.x86_64 1/32 2023-12-09T02:25:01.454 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 2/32 2023-12-09T02:25:01.454 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 3/32 2023-12-09T02:25:01.454 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 4/32 2023-12-09T02:25:01.454 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 5/32 2023-12-09T02:25:01.454 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.n 6/32 2023-12-09T02:25:01.454 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-09T02:25:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-09T02:25:01.456 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-09T02:25:01.456 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-09T02:25:01.456 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-09T02:25:01.456 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-09T02:25:01.456 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-09T02:25:01.456 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-09T02:25:01.456 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-09T02:25:01.456 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-09T02:25:01.456 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-09T02:25:02.278 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 28/32 2023-12-09T02:25:02.505 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 29/32 2023-12-09T02:25:02.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-09T02:25:02.606 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:02.606 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:25:02.606 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:02.606 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:02.606 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:02.606 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-09T02:25:02.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-2.6-1.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-09T02:25:02.608 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:02.609 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:25:02.828 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-base 2023-12-09T02:25:02.897 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 29/32 2023-12-09T02:25:03.106 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 30/32 2023-12-09T02:25:03.326 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 30/32 2023-12-09T02:25:03.548 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 31/32 2023-12-09T02:25:03.567 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 31/32 2023-12-09T02:25:03.681 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:19 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:03.705 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:17.2.7-119.ge2143d99.el8.x86_64 32/32 2023-12-09T02:25:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-2:17.2.7-119.ge2143d99.el8.x86_64 32/32 2023-12-09T02:25:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:17.2.7-119.ge2143d99.el8.x86_64 1/32 2023-12-09T02:25:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 2/32 2023-12-09T02:25:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 3/32 2023-12-09T02:25:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 4/32 2023-12-09T02:25:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 5/32 2023-12-09T02:25:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.n 6/32 2023-12-09T02:25:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-09T02:25:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-09T02:25:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-09T02:25:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-09T02:25:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-09T02:25:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-09T02:25:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-09T02:25:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-09T02:25:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-09T02:25:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-09T02:25:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-09T02:25:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-09T02:25:05.142 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:25:05.366 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:25:05.367 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-12-09T02:25:05.367 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-09T02:25:05.404 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-09T02:25:05.405 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-09T02:25:05.405 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-09T02:25:05.405 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-09T02:25:05.405 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-09T02:25:05.405 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-09T02:25:05.405 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-09T02:25:05.405 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-09T02:25:05.405 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-09T02:25:05.405 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-09T02:25:05.405 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-2.6-1.el8.noarch 2023-12-09T02:25:05.405 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:05.406 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:25:05.469 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install cephadm 2023-12-09T02:25:05.678 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-base 2023-12-09T02:25:06.319 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:22 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:06.533 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:22 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:07.993 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:25:07.994 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:07.994 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-12-09T02:25:07.994 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:07.995 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:25:07.995 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 80 k 2023-12-09T02:25:07.995 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:07.995 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:25:07.995 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:07.995 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-12-09T02:25:07.995 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:07.995 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 80 k 2023-12-09T02:25:07.995 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 364 k 2023-12-09T02:25:07.995 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:25:08.001 INFO:teuthology.orchestra.run.smithi161.stdout:Package ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:25:08.161 INFO:teuthology.orchestra.run.smithi088.stdout:cephadm-17.2.7-119.ge2143d99.el8.noarch.rpm 485 kB/s | 80 kB 00:00 2023-12-09T02:25:08.162 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:25:08.162 INFO:teuthology.orchestra.run.smithi088.stdout:Total 481 kB/s | 80 kB 00:00 2023-12-09T02:25:08.162 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:25:08.169 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:25:08.169 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:25:08.171 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:25:08.174 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:25:08.218 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:25:08.224 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:25:08.225 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-12-09T02:25:08.225 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:25:08.330 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install cephadm 2023-12-09T02:25:08.735 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-09T02:25:08.941 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-09T02:25:09.170 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-09T02:25:09.184 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:25 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:09.865 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-09T02:25:09.865 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:09.865 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:25:09.865 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:09.865 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:09.865 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:25:10.077 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-immutable-object-cache 2023-12-09T02:25:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:25:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:10.861 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-12-09T02:25:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:25:10.861 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 80 k 2023-12-09T02:25:10.861 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:25:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2023-12-09T02:25:10.862 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 80 k 2023-12-09T02:25:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 364 k 2023-12-09T02:25:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:25:10.933 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:26 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:11.024 INFO:teuthology.orchestra.run.smithi161.stdout:cephadm-17.2.7-119.ge2143d99.el8.noarch.rpm 496 kB/s | 80 kB 00:00 2023-12-09T02:25:11.025 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:25:11.025 INFO:teuthology.orchestra.run.smithi161.stdout:Total 492 kB/s | 80 kB 00:00 2023-12-09T02:25:11.025 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:25:11.033 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:25:11.033 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:25:11.035 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:25:11.037 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:25:11.083 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:25:11.621 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-09T02:25:11.874 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-09T02:25:12.106 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-09T02:25:12.601 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:25:12.602 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:12.602 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-12-09T02:25:12.602 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:12.602 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:25:12.602 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-119.ge2143d99.el8 ceph 161 k 2023-12-09T02:25:12.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:12.602 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:25:12.602 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:12.602 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-12-09T02:25:12.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:12.603 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 161 k 2023-12-09T02:25:12.603 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 490 k 2023-12-09T02:25:12.603 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:25:12.813 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-09T02:25:12.813 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:12.813 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:25:12.813 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:12.814 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:12.814 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:25:12.899 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-immutable-object-cache-17.2.7-119.ge2143d9 546 kB/s | 161 kB 00:00 2023-12-09T02:25:12.900 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:25:12.900 INFO:teuthology.orchestra.run.smithi088.stdout:Total 544 kB/s | 161 kB 00:00 2023-12-09T02:25:12.900 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:25:12.910 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:25:12.910 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:25:12.958 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:25:12.961 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:25:13.071 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:25:13.252 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-09T02:25:13.664 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-09T02:25:14.331 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-09T02:25:14.331 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:14.331 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:25:14.331 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:14.331 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:14.331 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:25:14.551 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr 2023-12-09T02:25:14.843 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-immutable-object-cache 2023-12-09T02:25:15.407 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:31 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:15.729 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:31 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:16.866 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:25:17.090 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:25:17.091 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-12-09T02:25:17.091 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:25:17.190 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-dashboard 2023-12-09T02:25:17.417 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:25:17.418 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:17.418 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2023-12-09T02:25:17.418 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:17.418 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:25:17.418 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-119.ge2143d99.el8 ceph 161 k 2023-12-09T02:25:17.418 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:17.418 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:25:17.418 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:17.418 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2023-12-09T02:25:17.419 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:17.419 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 161 k 2023-12-09T02:25:17.419 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 490 k 2023-12-09T02:25:17.419 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:25:17.722 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-immutable-object-cache-17.2.7-119.ge2143d9 533 kB/s | 161 kB 00:00 2023-12-09T02:25:17.722 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:25:17.723 INFO:teuthology.orchestra.run.smithi161.stdout:Total 531 kB/s | 161 kB 00:00 2023-12-09T02:25:17.723 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:25:17.734 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:25:17.734 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:25:17.780 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:25:17.783 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:25:17.896 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:25:18.034 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:34 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:18.129 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-09T02:25:18.571 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-09T02:25:19.260 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-09T02:25:19.260 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:19.260 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:25:19.260 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:25:19.260 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:19.261 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:25:19.523 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr 2023-12-09T02:25:19.726 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:25:19.727 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:19.727 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-12-09T02:25:19.727 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:19.727 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:25:19.727 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 1.7 M 2023-12-09T02:25:19.728 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-12-09T02:25:19.728 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 23 k 2023-12-09T02:25:19.728 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 14 k 2023-12-09T02:25:19.728 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-09T02:25:19.728 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-09T02:25:19.728 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-09T02:25:19.729 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:19.729 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:25:19.729 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:19.729 INFO:teuthology.orchestra.run.smithi088.stdout:Install 6 Packages 2023-12-09T02:25:19.729 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:19.730 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 2.0 M 2023-12-09T02:25:19.730 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 8.0 M 2023-12-09T02:25:19.730 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:25:20.013 INFO:teuthology.orchestra.run.smithi088.stdout:(1/6): ceph-grafana-dashboards-17.2.7-119.ge214 132 kB/s | 23 kB 00:00 2023-12-09T02:25:20.035 INFO:teuthology.orchestra.run.smithi088.stdout:(2/6): ceph-prometheus-alerts-17.2.7-119.ge2143 73 kB/s | 14 kB 00:00 2023-12-09T02:25:20.110 INFO:teuthology.orchestra.run.smithi088.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 448 kB/s | 34 kB 00:00 2023-12-09T02:25:20.169 INFO:teuthology.orchestra.run.smithi088.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 274 kB/s | 43 kB 00:00 2023-12-09T02:25:20.211 INFO:teuthology.orchestra.run.smithi088.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.9 MB/s | 196 kB 00:00 2023-12-09T02:25:20.386 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:36 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:20.469 INFO:teuthology.orchestra.run.smithi088.stdout:(6/6): ceph-mgr-dashboard-17.2.7-119.ge2143d99. 2.7 MB/s | 1.7 MB 00:00 2023-12-09T02:25:20.471 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:25:20.471 INFO:teuthology.orchestra.run.smithi088.stdout:Total 2.7 MB/s | 2.0 MB 00:00 2023-12-09T02:25:20.481 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:25:20.490 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:25:20.490 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:25:20.562 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:25:20.565 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:25:20.845 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:25:21.047 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-09T02:25:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-09T02:25:21.519 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-09T02:25:21.630 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.no 4/6 2023-12-09T02:25:21.848 INFO:teuthology.orchestra.run.smithi161.stdout:Package ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:25:21.968 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.n 5/6 2023-12-09T02:25:22.072 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:25:22.073 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-12-09T02:25:22.073 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:25:22.177 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-dashboard 2023-12-09T02:25:22.191 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 6/6 2023-12-09T02:25:22.462 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 6/6 2023-12-09T02:25:22.462 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.n 1/6 2023-12-09T02:25:22.462 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 2/6 2023-12-09T02:25:22.463 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.no 3/6 2023-12-09T02:25:22.463 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-09T02:25:22.463 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-09T02:25:23.029 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:39 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:23.350 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-09T02:25:23.351 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:23.351 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:25:23.351 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:23.351 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:23.351 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:23.351 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-09T02:25:23.351 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-09T02:25:23.351 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-09T02:25:23.351 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:23.351 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:25:23.471 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-09T02:25:24.316 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:40 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:24.715 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:25:24.716 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:24.716 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-12-09T02:25:24.716 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:24.716 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:25:24.716 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 1.7 M 2023-12-09T02:25:24.716 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-12-09T02:25:24.717 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 23 k 2023-12-09T02:25:24.717 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 14 k 2023-12-09T02:25:24.717 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-09T02:25:24.717 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-09T02:25:24.717 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-09T02:25:24.717 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:24.717 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:25:24.717 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:24.717 INFO:teuthology.orchestra.run.smithi161.stdout:Install 6 Packages 2023-12-09T02:25:24.717 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:24.718 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 2.0 M 2023-12-09T02:25:24.718 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 8.0 M 2023-12-09T02:25:24.718 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:25:25.068 INFO:teuthology.orchestra.run.smithi161.stdout:(1/6): ceph-grafana-dashboards-17.2.7-119.ge214 172 kB/s | 23 kB 00:00 2023-12-09T02:25:25.085 INFO:teuthology.orchestra.run.smithi161.stdout:(2/6): ceph-prometheus-alerts-17.2.7-119.ge2143 96 kB/s | 14 kB 00:00 2023-12-09T02:25:25.252 INFO:teuthology.orchestra.run.smithi161.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 202 kB/s | 34 kB 00:00 2023-12-09T02:25:25.294 INFO:teuthology.orchestra.run.smithi161.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 189 kB/s | 43 kB 00:00 2023-12-09T02:25:25.420 INFO:teuthology.orchestra.run.smithi161.stdout:(5/6): ceph-mgr-dashboard-17.2.7-119.ge2143d99. 3.5 MB/s | 1.7 MB 00:00 2023-12-09T02:25:25.445 INFO:teuthology.orchestra.run.smithi161.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.0 MB/s | 196 kB 00:00 2023-12-09T02:25:25.447 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:25:25.447 INFO:teuthology.orchestra.run.smithi161.stdout:Total 2.7 MB/s | 2.0 MB 00:00 2023-12-09T02:25:25.458 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:25:25.467 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:25:25.467 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:25:25.552 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:25:25.555 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:25:25.811 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:25:25.994 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:25:25.995 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================================ 2023-12-09T02:25:25.995 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-12-09T02:25:25.995 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================================ 2023-12-09T02:25:25.995 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:25:25.995 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 7.4 M 2023-12-09T02:25:25.995 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================================ 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout:Install 8 Packages 2023-12-09T02:25:25.996 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:25.997 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 35 M 2023-12-09T02:25:25.997 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 210 M 2023-12-09T02:25:25.997 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:25:26.008 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-09T02:25:26.278 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-09T02:25:26.513 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-09T02:25:26.658 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.no 4/6 2023-12-09T02:25:27.004 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.n 5/6 2023-12-09T02:25:27.292 INFO:teuthology.orchestra.run.smithi088.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.7-119 6.9 MB/s | 7.4 MB 00:01 2023-12-09T02:25:27.292 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 6/6 2023-12-09T02:25:27.580 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 6/6 2023-12-09T02:25:27.580 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.n 1/6 2023-12-09T02:25:27.580 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 2/6 2023-12-09T02:25:27.580 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.no 3/6 2023-12-09T02:25:27.580 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-09T02:25:27.580 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-09T02:25:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-09T02:25:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:28.278 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:25:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-09T02:25:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-09T02:25:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-09T02:25:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:28.278 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:25:28.405 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-09T02:25:29.256 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:45 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:30.934 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:25:30.935 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================================ 2023-12-09T02:25:30.935 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-12-09T02:25:30.935 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================================ 2023-12-09T02:25:30.935 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:25:30.935 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 7.4 M 2023-12-09T02:25:30.935 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-12-09T02:25:30.935 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-09T02:25:30.935 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-09T02:25:30.936 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-09T02:25:30.936 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-09T02:25:30.936 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-09T02:25:30.936 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-09T02:25:30.936 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-09T02:25:30.936 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:30.936 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:25:30.936 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================================ 2023-12-09T02:25:30.936 INFO:teuthology.orchestra.run.smithi161.stdout:Install 8 Packages 2023-12-09T02:25:30.936 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:30.937 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 35 M 2023-12-09T02:25:30.937 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 210 M 2023-12-09T02:25:30.937 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:25:31.704 INFO:teuthology.orchestra.run.smithi161.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.7-119 11 MB/s | 7.4 MB 00:00 2023-12-09T02:25:31.752 INFO:teuthology.orchestra.run.smithi088.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 899 kB/s | 4.9 MB 00:05 2023-12-09T02:25:32.244 INFO:teuthology.orchestra.run.smithi088.stdout:(3/8): openblas-0.3.15-4.el8.x86_64.rpm 804 kB/s | 4.7 MB 00:06 2023-12-09T02:25:32.444 INFO:teuthology.orchestra.run.smithi088.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 742 kB/s | 3.7 MB 00:05 2023-12-09T02:25:32.669 INFO:teuthology.orchestra.run.smithi088.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.8 MB/s | 645 kB 00:00 2023-12-09T02:25:32.745 INFO:teuthology.orchestra.run.smithi088.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 2.2 MB/s | 172 kB 00:00 2023-12-09T02:25:32.781 INFO:teuthology.orchestra.run.smithi088.stdout:(7/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 219 kB/s | 225 kB 00:01 2023-12-09T02:25:34.929 INFO:teuthology.orchestra.run.smithi161.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 1.2 MB/s | 3.7 MB 00:03 2023-12-09T02:25:36.550 INFO:teuthology.orchestra.run.smithi161.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 139 kB/s | 225 kB 00:01 2023-12-09T02:25:37.067 INFO:teuthology.orchestra.run.smithi161.stdout:(4/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 822 kB/s | 4.9 MB 00:06 2023-12-09T02:25:37.155 INFO:teuthology.orchestra.run.smithi161.stdout:(5/8): openblas-0.3.15-4.el8.x86_64.rpm 789 kB/s | 4.7 MB 00:06 2023-12-09T02:25:37.345 INFO:teuthology.orchestra.run.smithi161.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 908 kB/s | 172 kB 00:00 2023-12-09T02:25:37.380 INFO:teuthology.orchestra.run.smithi161.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.0 MB/s | 645 kB 00:00 2023-12-09T02:25:40.144 INFO:teuthology.orchestra.run.smithi088.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 1.7 MB/s | 14 MB 00:07 2023-12-09T02:25:40.145 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:25:40.145 INFO:teuthology.orchestra.run.smithi088.stdout:Total 2.5 MB/s | 35 MB 00:14 2023-12-09T02:25:40.382 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:25:40.400 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:25:40.400 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:25:40.783 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:25:40.786 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:25:41.358 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:25:41.512 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-09T02:25:41.640 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-09T02:25:41.846 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-09T02:25:42.430 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-09T02:25:42.620 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-09T02:25:43.138 INFO:teuthology.orchestra.run.smithi161.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 2.1 MB/s | 14 MB 00:06 2023-12-09T02:25:43.139 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:25:43.140 INFO:teuthology.orchestra.run.smithi161.stdout:Total 2.9 MB/s | 35 MB 00:12 2023-12-09T02:25:43.245 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-09T02:25:43.375 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:25:43.387 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-09T02:25:43.393 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:25:43.393 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:25:43.765 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:25:43.769 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:25:44.067 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-09T02:25:44.368 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:25:44.380 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-09T02:25:44.508 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-09T02:25:44.620 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-09T02:25:44.647 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-09T02:25:44.824 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-09T02:25:45.420 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-09T02:25:45.607 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-09T02:25:46.223 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-09T02:25:46.384 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-09T02:25:46.416 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-09T02:25:47.092 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-09T02:25:47.444 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-09T02:25:47.593 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-09T02:25:47.749 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-09T02:25:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 8/8 2023-12-09T02:25:48.096 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 8/8 2023-12-09T02:25:48.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 1/8 2023-12-09T02:25:48.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-09T02:25:48.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-09T02:25:48.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-09T02:25:48.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-09T02:25:48.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-09T02:25:48.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-09T02:25:48.805 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-09T02:25:48.805 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:48.805 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:25:48.805 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:48.805 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-09T02:25:48.805 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-09T02:25:48.805 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-09T02:25:48.805 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-09T02:25:48.805 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-09T02:25:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-09T02:25:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-09T02:25:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:48.806 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:25:48.965 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-rook 2023-12-09T02:25:49.511 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-09T02:25:49.825 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:05 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:50.731 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-09T02:25:50.957 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 8/8 2023-12-09T02:25:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 8/8 2023-12-09T02:25:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 1/8 2023-12-09T02:25:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-09T02:25:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-09T02:25:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-09T02:25:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-09T02:25:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-09T02:25:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-09T02:25:51.496 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:25:51.497 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-12-09T02:25:51.498 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:51.498 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:25:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 47 k 2023-12-09T02:25:51.498 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-12-09T02:25:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-09T02:25:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-09T02:25:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-09T02:25:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-09T02:25:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-09T02:25:51.498 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-09T02:25:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-09T02:25:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-09T02:25:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-09T02:25:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-09T02:25:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-09T02:25:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-09T02:25:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:51.499 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:25:51.499 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:25:51.499 INFO:teuthology.orchestra.run.smithi088.stdout:Install 13 Packages 2023-12-09T02:25:51.499 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:51.500 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 1.9 M 2023-12-09T02:25:51.500 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 25 M 2023-12-09T02:25:51.500 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:25:51.890 INFO:teuthology.orchestra.run.smithi088.stdout:(1/13): ceph-mgr-rook-17.2.7-119.ge2143d99.el8. 187 kB/s | 47 kB 00:00 2023-12-09T02:25:52.048 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-09T02:25:52.048 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:52.048 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:25:52.048 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:52.048 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-09T02:25:52.048 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-09T02:25:52.048 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-09T02:25:52.048 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-09T02:25:52.048 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-09T02:25:52.049 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-09T02:25:52.049 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-09T02:25:52.049 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:52.049 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:25:52.064 INFO:teuthology.orchestra.run.smithi088.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 47 kB/s | 20 kB 00:00 2023-12-09T02:25:52.099 INFO:teuthology.orchestra.run.smithi088.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 58 kB/s | 27 kB 00:00 2023-12-09T02:25:52.185 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-rook 2023-12-09T02:25:52.266 INFO:teuthology.orchestra.run.smithi088.stdout:(4/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 929 kB/s | 155 kB 00:00 2023-12-09T02:25:52.325 INFO:teuthology.orchestra.run.smithi088.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 731 kB/s | 43 kB 00:00 2023-12-09T02:25:52.408 INFO:teuthology.orchestra.run.smithi088.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 395 kB/s | 33 kB 00:00 2023-12-09T02:25:52.459 INFO:teuthology.orchestra.run.smithi088.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 326 kB/s | 16 kB 00:00 2023-12-09T02:25:52.517 INFO:teuthology.orchestra.run.smithi088.stdout:(8/13): python3-google-auth-1.1.1-10.el8.noarch 1.4 MB/s | 81 kB 00:00 2023-12-09T02:25:52.651 INFO:teuthology.orchestra.run.smithi088.stdout:(9/13): python3-kubernetes-11.0.0-6.el8.noarch. 8.8 MB/s | 1.2 MB 00:00 2023-12-09T02:25:52.709 INFO:teuthology.orchestra.run.smithi088.stdout:(10/13): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-12-09T02:25:52.726 INFO:teuthology.orchestra.run.smithi088.stdout:(11/13): python3-pyasn1-modules-0.3.7-6.el8.noa 166 kB/s | 110 kB 00:00 2023-12-09T02:25:52.751 INFO:teuthology.orchestra.run.smithi088.stdout:(12/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 147 kB/s | 126 kB 00:00 2023-12-09T02:25:52.776 INFO:teuthology.orchestra.run.smithi088.stdout:(13/13): python3-websocket-client-0.56.0-5.el8. 916 kB/s | 61 kB 00:00 2023-12-09T02:25:52.777 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:25:52.778 INFO:teuthology.orchestra.run.smithi088.stdout:Total 1.5 MB/s | 1.9 MB 00:01 2023-12-09T02:25:52.837 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:25:52.854 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:25:52.855 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:25:52.940 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:25:52.943 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:25:53.034 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:09 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:25:53.538 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:25:53.778 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-09T02:25:54.016 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-09T02:25:54.244 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-09T02:25:54.449 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-09T02:25:54.673 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-09T02:25:54.712 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:25:54.714 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:54.714 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-12-09T02:25:54.714 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:54.714 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 47 k 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-09T02:25:54.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-09T02:25:54.716 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-09T02:25:54.716 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-09T02:25:54.716 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:54.716 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:25:54.716 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:25:54.716 INFO:teuthology.orchestra.run.smithi161.stdout:Install 13 Packages 2023-12-09T02:25:54.716 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:25:54.716 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 1.9 M 2023-12-09T02:25:54.717 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 25 M 2023-12-09T02:25:54.717 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:25:55.024 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-09T02:25:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-09T02:25:55.385 INFO:teuthology.orchestra.run.smithi161.stdout:(1/13): ceph-mgr-rook-17.2.7-119.ge2143d99.el8. 302 kB/s | 47 kB 00:00 2023-12-09T02:25:55.564 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-09T02:25:55.653 INFO:teuthology.orchestra.run.smithi161.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 63 kB/s | 27 kB 00:00 2023-12-09T02:25:55.669 INFO:teuthology.orchestra.run.smithi161.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 45 kB/s | 20 kB 00:00 2023-12-09T02:25:55.861 INFO:teuthology.orchestra.run.smithi161.stdout:(4/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 809 kB/s | 155 kB 00:00 2023-12-09T02:25:55.912 INFO:teuthology.orchestra.run.smithi161.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 853 kB/s | 43 kB 00:00 2023-12-09T02:25:55.962 INFO:teuthology.orchestra.run.smithi161.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 663 kB/s | 33 kB 00:00 2023-12-09T02:25:55.996 INFO:teuthology.orchestra.run.smithi161.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 488 kB/s | 16 kB 00:00 2023-12-09T02:25:56.037 INFO:teuthology.orchestra.run.smithi161.stdout:(8/13): python3-google-auth-1.1.1-10.el8.noarch 1.9 MB/s | 81 kB 00:00 2023-12-09T02:25:56.140 INFO:teuthology.orchestra.run.smithi161.stdout:(9/13): python3-kubernetes-11.0.0-6.el8.noarch. 11 MB/s | 1.2 MB 00:00 2023-12-09T02:25:56.171 INFO:teuthology.orchestra.run.smithi161.stdout:(10/13): python3-rsa-4.9-2.el8.noarch.rpm 2.0 MB/s | 64 kB 00:00 2023-12-09T02:25:56.196 INFO:teuthology.orchestra.run.smithi161.stdout:(11/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 156 kB/s | 126 kB 00:00 2023-12-09T02:25:56.222 INFO:teuthology.orchestra.run.smithi161.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 1.2 MB/s | 61 kB 00:00 2023-12-09T02:25:56.322 INFO:teuthology.orchestra.run.smithi161.stdout:(13/13): python3-pyasn1-modules-0.3.7-6.el8.noa 169 kB/s | 110 kB 00:00 2023-12-09T02:25:56.322 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:25:56.323 INFO:teuthology.orchestra.run.smithi161.stdout:Total 1.2 MB/s | 1.9 MB 00:01 2023-12-09T02:25:56.383 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:25:56.399 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:25:56.399 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:25:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:25:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:25:56.596 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-09T02:25:56.856 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-09T02:25:57.073 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-09T02:25:57.143 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:25:57.300 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-09T02:25:57.400 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-09T02:25:57.475 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 13/13 2023-12-09T02:25:57.622 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-09T02:25:57.763 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 13/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 1/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-09T02:25:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-09T02:25:57.866 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-09T02:25:58.070 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-09T02:25:58.294 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-09T02:25:58.543 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-09T02:25:58.543 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:58.543 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:25:58.543 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:25:58.543 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-09T02:25:58.543 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:25:58.544 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:25:58.550 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-09T02:25:58.668 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-cephadm 2023-12-09T02:25:58.860 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-09T02:25:59.126 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-09T02:25:59.517 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:15 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:00.179 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-09T02:26:00.487 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-09T02:26:00.729 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-09T02:26:00.930 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-09T02:26:01.130 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 13/13 2023-12-09T02:26:01.229 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:01.230 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:01.230 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-12-09T02:26:01.230 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:01.230 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:26:01.230 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 121 k 2023-12-09T02:26:01.230 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-12-09T02:26:01.230 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-09T02:26:01.230 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-09T02:26:01.230 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-09T02:26:01.230 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-09T02:26:01.230 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:01.231 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:26:01.231 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:01.231 INFO:teuthology.orchestra.run.smithi088.stdout:Install 5 Packages 2023-12-09T02:26:01.231 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:01.231 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 6.0 M 2023-12-09T02:26:01.231 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 26 M 2023-12-09T02:26:01.231 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:26:01.425 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 13/13 2023-12-09T02:26:01.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 1/13 2023-12-09T02:26:01.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-09T02:26:01.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-09T02:26:01.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-09T02:26:01.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-09T02:26:01.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-09T02:26:01.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-09T02:26:01.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-09T02:26:01.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-09T02:26:01.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-09T02:26:01.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-09T02:26:01.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-09T02:26:01.950 INFO:teuthology.orchestra.run.smithi088.stdout:(1/5): ceph-mgr-cephadm-17.2.7-119.ge2143d99.el 646 kB/s | 121 kB 00:00 2023-12-09T02:26:02.176 INFO:teuthology.orchestra.run.smithi088.stdout:(2/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.1 MB/s | 476 kB 00:00 2023-12-09T02:26:02.226 INFO:teuthology.orchestra.run.smithi088.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 1.2 MB/s | 60 kB 00:00 2023-12-09T02:26:02.247 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-09T02:26:02.247 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:02.247 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:26:02.247 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:26:02.247 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-09T02:26:02.247 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-09T02:26:02.247 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-09T02:26:02.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-09T02:26:02.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-09T02:26:02.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-09T02:26:02.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-09T02:26:02.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-09T02:26:02.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-09T02:26:02.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-09T02:26:02.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-09T02:26:02.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-09T02:26:02.248 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:02.248 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:02.365 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-cephadm 2023-12-09T02:26:03.216 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:19 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:03.601 INFO:teuthology.orchestra.run.smithi088.stdout:(4/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 293 kB/s | 538 kB 00:01 2023-12-09T02:26:04.886 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:04.887 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:04.887 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-12-09T02:26:04.887 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:04.887 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:26:04.888 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 121 k 2023-12-09T02:26:04.888 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-12-09T02:26:04.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-09T02:26:04.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-09T02:26:04.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-09T02:26:04.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-09T02:26:04.888 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:04.888 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:26:04.888 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:04.888 INFO:teuthology.orchestra.run.smithi161.stdout:Install 5 Packages 2023-12-09T02:26:04.888 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:04.889 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 6.0 M 2023-12-09T02:26:04.889 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 26 M 2023-12-09T02:26:04.889 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:26:05.176 INFO:teuthology.orchestra.run.smithi161.stdout:(1/5): ceph-mgr-cephadm-17.2.7-119.ge2143d99.el 561 kB/s | 121 kB 00:00 2023-12-09T02:26:05.412 INFO:teuthology.orchestra.run.smithi161.stdout:(2/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.0 MB/s | 476 kB 00:00 2023-12-09T02:26:05.521 INFO:teuthology.orchestra.run.smithi161.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 555 kB/s | 60 kB 00:00 2023-12-09T02:26:06.638 INFO:teuthology.orchestra.run.smithi161.stdout:(4/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 320 kB/s | 538 kB 00:01 2023-12-09T02:26:07.075 INFO:teuthology.orchestra.run.smithi088.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 923 kB/s | 4.8 MB 00:05 2023-12-09T02:26:07.076 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:07.077 INFO:teuthology.orchestra.run.smithi088.stdout:Total 1.0 MB/s | 6.0 MB 00:05 2023-12-09T02:26:07.132 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:26:07.144 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:26:07.144 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:26:07.242 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:26:07.245 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:26:07.503 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:26:07.828 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-09T02:26:08.818 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-09T02:26:09.175 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-09T02:26:09.458 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-09T02:26:09.638 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 5/5 2023-12-09T02:26:09.911 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 5/5 2023-12-09T02:26:09.911 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/5 2023-12-09T02:26:09.911 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-09T02:26:09.911 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-09T02:26:09.911 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-09T02:26:10.246 INFO:teuthology.orchestra.run.smithi161.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 927 kB/s | 4.8 MB 00:05 2023-12-09T02:26:10.248 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:10.249 INFO:teuthology.orchestra.run.smithi161.stdout:Total 1.1 MB/s | 6.0 MB 00:05 2023-12-09T02:26:10.302 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:26:10.314 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:26:10.314 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:26:10.426 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:26:10.429 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:26:10.739 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:26:10.844 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-09T02:26:10.844 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:10.844 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:26:10.844 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:26:10.844 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-09T02:26:10.845 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-09T02:26:10.845 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-09T02:26:10.845 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-09T02:26:10.845 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:10.845 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:10.975 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-fuse 2023-12-09T02:26:11.068 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-09T02:26:11.824 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:27 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:12.013 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-09T02:26:12.399 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-09T02:26:12.689 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-09T02:26:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 5/5 2023-12-09T02:26:13.191 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 5/5 2023-12-09T02:26:13.191 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/5 2023-12-09T02:26:13.191 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-09T02:26:13.192 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-09T02:26:13.192 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-09T02:26:13.496 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:13.496 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:13.497 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-12-09T02:26:13.497 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:13.497 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:26:13.497 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 875 k 2023-12-09T02:26:13.497 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-12-09T02:26:13.497 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-09T02:26:13.497 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:13.497 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:26:13.497 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:13.497 INFO:teuthology.orchestra.run.smithi088.stdout:Install 2 Packages 2023-12-09T02:26:13.497 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:13.498 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 958 k 2023-12-09T02:26:13.498 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 3.0 M 2023-12-09T02:26:13.498 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:26:13.683 INFO:teuthology.orchestra.run.smithi088.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 576 kB/s | 83 kB 00:00 2023-12-09T02:26:13.893 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-09T02:26:13.893 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:13.893 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:26:13.893 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-09T02:26:13.893 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-09T02:26:13.893 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-09T02:26:13.893 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-09T02:26:13.893 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-09T02:26:13.893 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:13.893 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:13.958 INFO:teuthology.orchestra.run.smithi088.stdout:(2/2): ceph-fuse-17.2.7-119.ge2143d99.el8.x86_6 2.0 MB/s | 875 kB 00:00 2023-12-09T02:26:13.959 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:13.959 INFO:teuthology.orchestra.run.smithi088.stdout:Total 2.0 MB/s | 958 kB 00:00 2023-12-09T02:26:13.969 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:26:13.989 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:26:14.014 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:26:14.045 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-fuse 2023-12-09T02:26:14.075 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:26:14.078 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:26:14.253 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:26:14.571 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-09T02:26:14.738 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2/2 2023-12-09T02:26:14.896 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:30 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2/2 2023-12-09T02:26:15.138 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/2 2023-12-09T02:26:15.871 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-09T02:26:15.872 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:15.872 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:26:15.872 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-09T02:26:15.872 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:15.872 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:16.587 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 875 k 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout:Install 2 Packages 2023-12-09T02:26:16.588 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:16.589 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 958 k 2023-12-09T02:26:16.589 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 3.0 M 2023-12-09T02:26:16.589 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:26:16.771 INFO:teuthology.orchestra.run.smithi161.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 591 kB/s | 83 kB 00:00 2023-12-09T02:26:17.054 INFO:teuthology.orchestra.run.smithi161.stdout:(2/2): ceph-fuse-17.2.7-119.ge2143d99.el8.x86_6 2.0 MB/s | 875 kB 00:00 2023-12-09T02:26:17.055 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:17.055 INFO:teuthology.orchestra.run.smithi161.stdout:Total 2.0 MB/s | 958 kB 00:00 2023-12-09T02:26:17.065 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:26:17.086 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:26:17.086 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:26:17.173 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:26:17.176 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:26:17.222 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados-devel 2023-12-09T02:26:17.358 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:26:18.126 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:34 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:18.351 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-09T02:26:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2/2 2023-12-09T02:26:19.813 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:19.814 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:19.814 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-12-09T02:26:19.814 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:19.815 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:26:19.815 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:17.2.7-119.ge2143d99.el8 ceph 130 k 2023-12-09T02:26:19.815 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:19.815 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:26:19.815 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:19.815 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-12-09T02:26:19.816 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:19.816 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 130 k 2023-12-09T02:26:19.816 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 464 k 2023-12-09T02:26:19.816 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:26:19.959 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2/2 2023-12-09T02:26:19.959 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/2 2023-12-09T02:26:20.108 INFO:teuthology.orchestra.run.smithi088.stdout:librados-devel-17.2.7-119.ge2143d99.el8.x86_64. 443 kB/s | 130 kB 00:00 2023-12-09T02:26:20.108 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:20.109 INFO:teuthology.orchestra.run.smithi088.stdout:Total 442 kB/s | 130 kB 00:00 2023-12-09T02:26:20.109 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:26:20.114 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:26:20.114 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:26:20.164 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:26:20.166 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:26:20.313 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:26:20.602 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-09T02:26:20.631 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:20.631 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:26:20.631 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-09T02:26:20.631 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:20.631 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:20.818 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librados-devel 2023-12-09T02:26:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:21.612 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:21.613 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:21.613 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:26:21.613 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:26:21.613 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:21.613 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:21.684 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:37 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:21.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs2 2023-12-09T02:26:22.687 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:38 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:23.363 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:23.363 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:23.363 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2023-12-09T02:26:23.363 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:23.364 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:26:23.364 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:17.2.7-119.ge2143d99.el8 ceph 130 k 2023-12-09T02:26:23.364 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:23.364 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:26:23.364 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:23.364 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2023-12-09T02:26:23.364 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:23.364 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 130 k 2023-12-09T02:26:23.364 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 464 k 2023-12-09T02:26:23.365 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:26:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:librados-devel-17.2.7-119.ge2143d99.el8.x86_64. 657 kB/s | 130 kB 00:00 2023-12-09T02:26:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:Total 653 kB/s | 130 kB 00:00 2023-12-09T02:26:23.564 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:26:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:26:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:26:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:26:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:26:23.733 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:26:24.076 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:24.132 INFO:teuthology.orchestra.run.smithi088.stdout:Package libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:24.352 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:24.353 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-12-09T02:26:24.354 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:24.368 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:24.464 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs-devel 2023-12-09T02:26:25.110 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:25.110 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:25.111 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:26:25.111 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:26:25.111 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:25.111 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:25.317 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:41 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:25.589 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install libcephfs2 2023-12-09T02:26:26.468 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:42 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:26.998 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:26.998 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:26.999 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-12-09T02:26:26.999 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:26.999 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:26:26.999 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:17.2.7-119.ge2143d99.el8 ceph 25 k 2023-12-09T02:26:26.999 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:26.999 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:26:26.999 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:26.999 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-12-09T02:26:26.999 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:27.000 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 25 k 2023-12-09T02:26:27.000 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 109 k 2023-12-09T02:26:27.000 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:26:27.144 INFO:teuthology.orchestra.run.smithi088.stdout:libcephfs-devel-17.2.7-119.ge2143d99.el8.x86_64 173 kB/s | 25 kB 00:00 2023-12-09T02:26:27.145 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:27.145 INFO:teuthology.orchestra.run.smithi088.stdout:Total 171 kB/s | 25 kB 00:00 2023-12-09T02:26:27.145 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:26:27.148 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:26:27.148 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:26:27.150 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:26:27.153 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:26:27.203 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:26:27.417 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:27.664 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:27.911 INFO:teuthology.orchestra.run.smithi161.stdout:Package libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:28.136 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:28.137 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-12-09T02:26:28.137 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:28.249 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install libcephfs-devel 2023-12-09T02:26:28.305 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:28.306 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:28.306 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:26:28.306 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:26:28.306 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:28.306 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:28.417 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados2 2023-12-09T02:26:29.105 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:45 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:29.267 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:45 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:30.722 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:30.796 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:30.797 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:30.797 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2023-12-09T02:26:30.797 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:30.797 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:26:30.797 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:17.2.7-119.ge2143d99.el8 ceph 25 k 2023-12-09T02:26:30.797 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:30.797 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:26:30.797 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:30.798 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2023-12-09T02:26:30.798 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:30.798 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 25 k 2023-12-09T02:26:30.798 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 109 k 2023-12-09T02:26:30.798 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:26:30.944 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:30.945 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-12-09T02:26:30.945 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:30.952 INFO:teuthology.orchestra.run.smithi161.stdout:libcephfs-devel-17.2.7-119.ge2143d99.el8.x86_64 161 kB/s | 25 kB 00:00 2023-12-09T02:26:30.952 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:30.953 INFO:teuthology.orchestra.run.smithi161.stdout:Total 160 kB/s | 25 kB 00:00 2023-12-09T02:26:30.953 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:26:30.957 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:26:30.957 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:26:30.959 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:26:30.962 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:26:31.032 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:26:31.045 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librbd1 2023-12-09T02:26:31.241 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:31.505 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:31.899 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:47 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:32.160 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:32.161 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:32.161 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:26:32.161 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:26:32.161 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:32.161 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:32.298 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librados2 2023-12-09T02:26:33.169 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:49 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:33.342 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:33.571 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:33.572 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-12-09T02:26:33.572 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:33.704 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rados 2023-12-09T02:26:34.573 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:50 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:34.641 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:34.864 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:34.866 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-12-09T02:26:34.866 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:34.978 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librbd1 2023-12-09T02:26:35.847 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:51 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:36.032 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:36.256 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:36.257 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-12-09T02:26:36.257 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:36.393 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rgw 2023-12-09T02:26:37.245 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:53 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:37.300 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:37.528 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:37.529 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-12-09T02:26:37.529 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:37.638 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rados 2023-12-09T02:26:38.497 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:54 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:38.699 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:38.928 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:38.928 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-12-09T02:26:38.929 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:39.026 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-cephfs 2023-12-09T02:26:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:55 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:39.933 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:40.158 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:40.160 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-12-09T02:26:40.160 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:40.268 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rgw 2023-12-09T02:26:41.125 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:57 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:41.348 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:41.574 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:41.575 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-12-09T02:26:41.575 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:41.673 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rbd 2023-12-09T02:26:42.527 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:58 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:42.593 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:42.818 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:42.819 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-12-09T02:26:42.819 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:42.963 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-cephfs 2023-12-09T02:26:43.822 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:59 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:43.994 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:44.221 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:44.222 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-12-09T02:26:44.222 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:44.329 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-fuse 2023-12-09T02:26:45.183 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:01 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:45.284 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:45.508 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:45.509 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-12-09T02:26:45.510 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:45.611 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rbd 2023-12-09T02:26:46.470 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:03:02 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:46.876 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:46.877 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:46.877 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-12-09T02:26:46.877 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:46.877 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:26:46.877 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 90 k 2023-12-09T02:26:46.877 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:46.878 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:26:46.878 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:46.878 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-12-09T02:26:46.878 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:46.878 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 90 k 2023-12-09T02:26:46.878 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 264 k 2023-12-09T02:26:46.878 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:26:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-fuse-17.2.7-119.ge2143d99.el8.x86_64.rpm 531 kB/s | 90 kB 00:00 2023-12-09T02:26:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:Total 526 kB/s | 90 kB 00:00 2023-12-09T02:26:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:26:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:26:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:26:47.111 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:26:47.114 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:26:47.252 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:26:47.454 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:47.733 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:47.927 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-09T02:26:48.151 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:48.153 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-12-09T02:26:48.153 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:48.255 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-fuse 2023-12-09T02:26:48.477 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:48.477 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:48.477 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:26:48.477 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:26:48.477 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:48.477 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:48.665 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-mirror 2023-12-09T02:26:49.115 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:03:05 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:49.524 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:05 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:50.806 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:50.808 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:50.808 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2023-12-09T02:26:50.808 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:50.808 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:26:50.808 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 90 k 2023-12-09T02:26:50.808 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:50.809 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:26:50.809 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:50.809 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2023-12-09T02:26:50.809 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:50.809 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 90 k 2023-12-09T02:26:50.809 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 264 k 2023-12-09T02:26:50.809 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:26:50.981 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-fuse-17.2.7-119.ge2143d99.el8.x86_64.rpm 524 kB/s | 90 kB 00:00 2023-12-09T02:26:50.981 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:50.981 INFO:teuthology.orchestra.run.smithi161.stdout:Total 520 kB/s | 90 kB 00:00 2023-12-09T02:26:50.982 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:26:50.991 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:26:50.991 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:26:51.041 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:26:51.044 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:26:51.157 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:26:51.192 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:51.192 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:51.192 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-12-09T02:26:51.192 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:51.192 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:26:51.192 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.5 M 2023-12-09T02:26:51.192 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:51.192 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:26:51.193 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:51.193 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-12-09T02:26:51.193 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:51.193 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 3.5 M 2023-12-09T02:26:51.193 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 16 M 2023-12-09T02:26:51.193 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:26:51.480 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:51.772 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:51.801 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-mirror-17.2.7-119.ge2143d99.el8.x86_64.rpm 5.7 MB/s | 3.5 MB 00:00 2023-12-09T02:26:51.802 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:51.802 INFO:teuthology.orchestra.run.smithi088.stdout:Total 5.7 MB/s | 3.5 MB 00:00 2023-12-09T02:26:51.803 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:26:51.815 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:26:51.815 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:26:51.878 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:26:51.881 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:26:52.320 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:26:52.453 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:52.453 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:52.453 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:26:52.454 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:26:52.454 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:52.454 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:52.513 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:52.637 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-mirror 2023-12-09T02:26:52.936 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:53.503 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:03:09 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:53.628 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:26:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:26:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:53.629 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:53.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-nbd 2023-12-09T02:26:54.700 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:10 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:26:55.171 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.5 M 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 3.5 M 2023-12-09T02:26:55.172 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 16 M 2023-12-09T02:26:55.173 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:26:55.811 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-mirror-17.2.7-119.ge2143d99.el8.x86_64.rpm 5.4 MB/s | 3.5 MB 00:00 2023-12-09T02:26:55.812 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:55.812 INFO:teuthology.orchestra.run.smithi161.stdout:Total 5.4 MB/s | 3.5 MB 00:00 2023-12-09T02:26:55.813 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:26:55.824 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:26:55.824 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:26:55.888 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:26:55.891 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:26:56.329 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:26:56.373 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-12-09T02:26:56.374 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-12-09T02:26:56.374 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:56.374 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-12-09T02:26:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 173 k 2023-12-09T02:26:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:56.374 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-12-09T02:26:56.375 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-12-09T02:26:56.375 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-12-09T02:26:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:56.375 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 173 k 2023-12-09T02:26:56.375 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 552 k 2023-12-09T02:26:56.375 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-12-09T02:26:56.562 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-nbd-17.2.7-119.ge2143d99.el8.x86_64.rpm 925 kB/s | 173 kB 00:00 2023-12-09T02:26:56.563 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:26:56.563 INFO:teuthology.orchestra.run.smithi088.stdout:Total 919 kB/s | 173 kB 00:00 2023-12-09T02:26:56.563 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-12-09T02:26:56.574 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-12-09T02:26:56.574 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-12-09T02:26:56.597 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-12-09T02:26:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-12-09T02:26:56.740 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-12-09T02:26:56.935 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:57.035 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:57.209 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:57.712 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:57.713 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:57.713 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:26:57.713 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:26:57.713 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:26:57.713 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:26:57.867 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:26:57.867 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:57.867 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-12-09T02:26:57.867 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:26:57.867 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:26:57.867 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-12-09T02:26:57.971 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-nbd 2023-12-09T02:26:58.076 DEBUG:teuthology.parallel:result is None 2023-12-09T02:26:58.829 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:03:14 ago on Sat 09 Dec 2023 02:23:44 AM UTC. 2023-12-09T02:27:00.535 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-12-09T02:27:00.535 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:27:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2023-12-09T02:27:00.535 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:27:00.535 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-12-09T02:27:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 173 k 2023-12-09T02:27:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:27:00.536 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-12-09T02:27:00.536 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-12-09T02:27:00.536 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2023-12-09T02:27:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:27:00.536 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 173 k 2023-12-09T02:27:00.536 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 552 k 2023-12-09T02:27:00.536 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-12-09T02:27:00.729 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-nbd-17.2.7-119.ge2143d99.el8.x86_64.rpm 902 kB/s | 173 kB 00:00 2023-12-09T02:27:00.729 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:27:00.729 INFO:teuthology.orchestra.run.smithi161.stdout:Total 896 kB/s | 173 kB 00:00 2023-12-09T02:27:00.729 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-12-09T02:27:00.740 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-12-09T02:27:00.740 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-12-09T02:27:00.789 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-12-09T02:27:00.792 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-12-09T02:27:00.947 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-12-09T02:27:01.178 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:27:01.466 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:27:02.162 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-09T02:27:02.162 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:27:02.162 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-12-09T02:27:02.162 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-09T02:27:02.162 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:27:02.162 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-12-09T02:27:02.403 DEBUG:teuthology.parallel:result is None 2023-12-09T02:27:02.404 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-09T02:27:02.404 INFO:teuthology.packaging:ref: None 2023-12-09T02:27:02.404 INFO:teuthology.packaging:tag: None 2023-12-09T02:27:02.404 INFO:teuthology.packaging:branch: quincy 2023-12-09T02:27:02.404 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:27:02.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-09T02:27:02.737 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-09T02:27:02.764 INFO:teuthology.orchestra.run.smithi088.stdout:17.2.7-119.ge2143d99.el8 2023-12-09T02:27:02.764 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-119.ge2143d99.el8 2023-12-09T02:27:02.765 INFO:teuthology.task.install:The correct ceph version 17.2.7-119.ge2143d99 is installed. 2023-12-09T02:27:02.765 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-09T02:27:02.765 INFO:teuthology.packaging:ref: None 2023-12-09T02:27:02.765 INFO:teuthology.packaging:tag: None 2023-12-09T02:27:02.765 INFO:teuthology.packaging:branch: quincy 2023-12-09T02:27:02.765 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:27:02.765 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-09T02:27:02.993 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-09T02:27:03.017 INFO:teuthology.orchestra.run.smithi161.stdout:17.2.7-119.ge2143d99.el8 2023-12-09T02:27:03.017 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-119.ge2143d99.el8 2023-12-09T02:27:03.018 INFO:teuthology.task.install:The correct ceph version 17.2.7-119.ge2143d99 is installed. 2023-12-09T02:27:03.018 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-09T02:27:03.018 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:27:03.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-09T02:27:03.052 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:27:03.052 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-09T02:27:03.086 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-09T02:27:03.086 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:27:03.086 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2023-12-09T02:27:03.122 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-09T02:27:03.191 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:27:03.191 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2023-12-09T02:27:03.218 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-09T02:27:03.285 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-09T02:27:03.286 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:27:03.286 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-09T02:27:03.315 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-09T02:27:03.383 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:27:03.383 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-09T02:27:03.410 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-09T02:27:03.477 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-09T02:27:03.477 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:27:03.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2023-12-09T02:27:03.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-09T02:27:03.574 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:27:03.574 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2023-12-09T02:27:03.600 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-09T02:27:03.667 INFO:teuthology.run_tasks:Running task print... 2023-12-09T02:27:03.677 INFO:teuthology.task.print:**** done install task... 2023-12-09T02:27:03.677 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-09T02:27:03.806 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'} 2023-12-09T02:27:03.807 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-09T02:27:03.807 INFO:tasks.cephadm:Cluster fsid is 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:27:03.807 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-09T02:27:03.807 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-09T02:27:03.807 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi088': '172.21.15.88', 'mon.smithi161': '172.21.15.161'} 2023-12-09T02:27:03.807 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-09T02:27:03.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname $(hostname -s) 2023-12-09T02:27:03.837 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname $(hostname -s) 2023-12-09T02:27:03.864 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-09T02:27:03.864 DEBUG:teuthology.orchestra.run.smithi088:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-09T02:27:04.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 9 02:27 /home/ubuntu/cephtest/cephadm 2023-12-09T02:27:04.095 DEBUG:teuthology.orchestra.run.smithi161:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-09T02:27:04.257 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 9 02:27 /home/ubuntu/cephtest/cephadm 2023-12-09T02:27:04.258 DEBUG:teuthology.orchestra.run.smithi088:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-09T02:27:04.278 DEBUG:teuthology.orchestra.run.smithi161:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-09T02:27:04.307 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-09T02:27:04.308 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-09T02:27:04.320 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-09T02:27:05.437 INFO:teuthology.orchestra.run.smithi088.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-09T02:27:05.510 INFO:teuthology.orchestra.run.smithi161.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-09T02:27:42.960 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:27:42.961 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)", 2023-12-09T02:27:42.961 INFO:teuthology.orchestra.run.smithi088.stdout: "image_id": "f761b6e422251eea7fff74ec4b7850c096513f0210a849805d791713a829673e", 2023-12-09T02:27:42.961 INFO:teuthology.orchestra.run.smithi088.stdout: "repo_digests": [ 2023-12-09T02:27:42.961 INFO:teuthology.orchestra.run.smithi088.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:761f3c6f44623fd2c1430ebbec30d9f81f7c9c291acc5201254b0c2b1b1e9938" 2023-12-09T02:27:42.961 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-12-09T02:27:42.961 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:27:43.644 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-12-09T02:27:43.644 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)", 2023-12-09T02:27:43.644 INFO:teuthology.orchestra.run.smithi161.stdout: "image_id": "f761b6e422251eea7fff74ec4b7850c096513f0210a849805d791713a829673e", 2023-12-09T02:27:43.644 INFO:teuthology.orchestra.run.smithi161.stdout: "repo_digests": [ 2023-12-09T02:27:43.644 INFO:teuthology.orchestra.run.smithi161.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:761f3c6f44623fd2c1430ebbec30d9f81f7c9c291acc5201254b0c2b1b1e9938" 2023-12-09T02:27:43.644 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2023-12-09T02:27:43.644 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-12-09T02:27:43.663 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph 2023-12-09T02:27:43.698 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph 2023-12-09T02:27:43.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /etc/ceph 2023-12-09T02:27:43.767 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /etc/ceph 2023-12-09T02:27:43.795 INFO:tasks.cephadm:Writing seed config... 2023-12-09T02:27:43.796 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-09T02:27:43.797 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-09T02:27:43.798 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-09T02:27:43.798 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-09T02:27:43.798 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-09T02:27:43.798 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-09T02:27:43.798 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-09T02:27:43.799 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-09T02:27:43.800 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-09T02:27:43.800 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-09T02:27:43.800 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-09T02:27:43.800 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-09T02:27:43.800 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-09T02:27:43.800 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-09T02:27:43.800 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-09T02:27:43.801 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:27:43.801 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-09T02:27:43.826 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 70b26980-963a-11ee-95a3-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-09T02:27:43.826 DEBUG:teuthology.orchestra.run.smithi088:mon.smithi088> sudo journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi088.service 2023-12-09T02:27:43.868 INFO:tasks.cephadm:Bootstrapping... 2023-12-09T02:27:43.869 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 70b26980-963a-11ee-95a3-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.88 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-09T02:27:43.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:-- Logs begin at Sat 2023-12-09 02:05:57 UTC. -- 2023-12-09T02:27:44.071 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-12-09T02:27:44.071 INFO:teuthology.orchestra.run.smithi088.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '70b26980-963a-11ee-95a3-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.88', '--skip-admin-label'] 2023-12-09T02:27:44.102 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 4.6.1 2023-12-09T02:27:44.103 INFO:teuthology.orchestra.run.smithi088.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-09T02:27:44.103 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying podman|docker is present... 2023-12-09T02:27:44.138 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 4.6.1 2023-12-09T02:27:44.139 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying lvm2 is present... 2023-12-09T02:27:44.139 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying time synchronization is in place... 2023-12-09T02:27:44.146 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-09T02:27:44.146 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-09T02:27:44.151 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-09T02:27:44.152 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-12-09T02:27:44.157 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout enabled 2023-12-09T02:27:44.163 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout active 2023-12-09T02:27:44.163 INFO:teuthology.orchestra.run.smithi088.stdout:Unit chronyd.service is enabled and running 2023-12-09T02:27:44.163 INFO:teuthology.orchestra.run.smithi088.stdout:Repeating the final host check... 2023-12-09T02:27:44.194 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 4.6.1 2023-12-09T02:27:44.195 INFO:teuthology.orchestra.run.smithi088.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-09T02:27:44.195 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl is present 2023-12-09T02:27:44.195 INFO:teuthology.orchestra.run.smithi088.stdout:lvcreate is present 2023-12-09T02:27:44.200 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-09T02:27:44.201 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-09T02:27:44.206 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-09T02:27:44.206 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-12-09T02:27:44.212 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout enabled 2023-12-09T02:27:44.218 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout active 2023-12-09T02:27:44.218 INFO:teuthology.orchestra.run.smithi088.stdout:Unit chronyd.service is enabled and running 2023-12-09T02:27:44.218 INFO:teuthology.orchestra.run.smithi088.stdout:Host looks OK 2023-12-09T02:27:44.218 INFO:teuthology.orchestra.run.smithi088.stdout:Cluster fsid: 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:27:44.218 INFO:teuthology.orchestra.run.smithi088.stdout:Acquiring lock 140501085989352 on /run/cephadm/70b26980-963a-11ee-95a3-87774f69a715.lock 2023-12-09T02:27:44.218 INFO:teuthology.orchestra.run.smithi088.stdout:Lock 140501085989352 acquired on /run/cephadm/70b26980-963a-11ee-95a3-87774f69a715.lock 2023-12-09T02:27:44.218 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying IP 172.21.15.88 port 3300 ... 2023-12-09T02:27:44.219 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying IP 172.21.15.88 port 6789 ... 2023-12-09T02:27:44.219 INFO:teuthology.orchestra.run.smithi088.stdout:Base mon IP(s) is [172.21.15.88:3300, 172.21.15.88:6789], mon addrv is [v2:172.21.15.88:3300,v1:172.21.15.88:6789] 2023-12-09T02:27:44.222 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.88 metric 100 2023-12-09T02:27:44.222 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.88 metric 100 2023-12-09T02:27:44.225 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-09T02:27:44.225 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2023-12-09T02:27:44.225 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2023-12-09T02:27:44.228 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-09T02:27:44.228 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-09T02:27:44.228 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-09T02:27:44.228 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-12-09T02:27:44.228 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-12-09T02:27:44.228 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-09T02:27:44.229 INFO:teuthology.orchestra.run.smithi088.stdout:Mon IP `172.21.15.88` is in CIDR network `172.21.0.0/20` 2023-12-09T02:27:44.229 INFO:teuthology.orchestra.run.smithi088.stdout:Mon IP `172.21.15.88` is in CIDR network `172.21.0.0/20` 2023-12-09T02:27:44.229 INFO:teuthology.orchestra.run.smithi088.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-09T02:27:44.229 INFO:teuthology.orchestra.run.smithi088.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-09T02:27:44.230 INFO:teuthology.orchestra.run.smithi088.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-09T02:27:44.585 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout f761b6e422251eea7fff74ec4b7850c096513f0210a849805d791713a829673e 2023-12-09T02:27:44.585 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-09T02:27:44.586 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Getting image source signatures 2023-12-09T02:27:44.586 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying blob sha256:b758150e9e8f18a6e73c4c5d80e3aa4f29a202640b61c9860fcf5acf017f13c3 2023-12-09T02:27:44.586 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying blob sha256:d3e436ac93e4b5a6d94c7ac8024df331e66e67275836276615dc044fd3cbf83a 2023-12-09T02:27:44.586 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying config sha256:f761b6e422251eea7fff74ec4b7850c096513f0210a849805d791713a829673e 2023-12-09T02:27:44.586 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-09T02:27:45.279 INFO:teuthology.orchestra.run.smithi088.stdout:ceph: stdout ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable) 2023-12-09T02:27:45.279 INFO:teuthology.orchestra.run.smithi088.stdout:Ceph version: ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable) 2023-12-09T02:27:45.279 INFO:teuthology.orchestra.run.smithi088.stdout:Extracting ceph user uid/gid from container image... 2023-12-09T02:27:45.894 INFO:teuthology.orchestra.run.smithi088.stdout:stat: stdout 167 167 2023-12-09T02:27:45.895 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial keys... 2023-12-09T02:27:46.497 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQCi0HNlGVgWCRAABeCSaKzdWpHf6Xf6T5L1tg== 2023-12-09T02:27:47.075 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQCi0HNlCzErLBAAKtyIwgHhzOyEW/eiitsvqA== 2023-12-09T02:27:47.631 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQCj0HNlBbb2ERAAsKw0TNK23e1fzS8yKxc6lA== 2023-12-09T02:27:47.632 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial monmap... 2023-12-09T02:27:48.283 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-09T02:27:48.283 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-09T02:27:48.283 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:27:48.283 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-09T02:27:48.283 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool for smithi088 [v2:172.21.15.88:3300,v1:172.21.15.88:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-09T02:27:48.283 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = octopus 2023-12-09T02:27:48.283 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: set fsid to 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:27:48.283 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-09T02:27:48.284 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:27:48.284 INFO:teuthology.orchestra.run.smithi088.stdout:Creating mon... 2023-12-09T02:27:48.944 INFO:teuthology.orchestra.run.smithi088.stdout:create mon.smithi088 on 2023-12-09T02:27:49.039 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-09T02:27:49.125 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-09T02:27:49.217 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-70b26980-963a-11ee-95a3-87774f69a715.target → /etc/systemd/system/ceph-70b26980-963a-11ee-95a3-87774f69a715.target. 2023-12-09T02:27:49.217 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-70b26980-963a-11ee-95a3-87774f69a715.target → /etc/systemd/system/ceph-70b26980-963a-11ee-95a3-87774f69a715.target. 2023-12-09T02:27:49.342 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi088 2023-12-09T02:27:49.343 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to reset failed state of unit ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi088.service: Unit ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi088.service not loaded. 2023-12-09T02:27:49.431 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-70b26980-963a-11ee-95a3-87774f69a715.target.wants/ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi088.service → /etc/systemd/system/ceph-70b26980-963a-11ee-95a3-87774f69a715@.service. 2023-12-09T02:27:49.779 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-09T02:27:49.780 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2023-12-09T02:27:49.787 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-09T02:27:49.787 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-12-09T02:27:49.787 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2023-12-09T02:27:49.788 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to enable service . firewalld.service is not available 2023-12-09T02:27:49.788 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mon to start... 2023-12-09T02:27:49.788 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mon... 2023-12-09T02:27:50.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:49 smithi088 ceph-mon[111541]: mon.smithi088 is new leader, mons smithi088 in quorum (ranks 0) 2023-12-09T02:27:50.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout cluster: 2023-12-09T02:27:50.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout id: 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:27:50.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-09T02:27:50.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:27:50.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout services: 2023-12-09T02:27:50.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi088 (age 0.490773s) 2023-12-09T02:27:50.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-09T02:27:50.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout data: 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout pgs: 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.203+0000 7f9631597700 1 Processor -- start 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.203+0000 7f9631597700 1 -- start start 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.203+0000 7f9631597700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.203+0000 7f9631597700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c105420 con 0x7f962c070fc0 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.204+0000 7f962affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.204+0000 7f962affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38164/0 (socket says 172.21.15.88:38164) 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.204+0000 7f962affd700 1 -- 172.21.15.88:0/2550222601 learned_addr learned my addr 172.21.15.88:0/2550222601 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:50.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.204+0000 7f962affd700 1 -- 172.21.15.88:0/2550222601 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c105560 con 0x7f962c070fc0 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.204+0000 7f962affd700 1 --2- 172.21.15.88:0/2550222601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c104ee0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f96200098e0 tx=0x7f9620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e41299b1728aba server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.205+0000 7f9629ffb700 1 -- 172.21.15.88:0/2550222601 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962000b860 con 0x7f962c070fc0 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.205+0000 7f9629ffb700 1 -- 172.21.15.88:0/2550222601 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962000b9c0 con 0x7f962c070fc0 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.205+0000 7f9629ffb700 1 -- 172.21.15.88:0/2550222601 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962000bc90 con 0x7f962c070fc0 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.205+0000 7f9631597700 1 -- 172.21.15.88:0/2550222601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 msgr2=0x7f962c104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.205+0000 7f9631597700 1 --2- 172.21.15.88:0/2550222601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c104ee0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f96200098e0 tx=0x7f9620009250 comp rx=0 tx=0).stop 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.205+0000 7f9631597700 1 -- 172.21.15.88:0/2550222601 shutdown_connections 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.205+0000 7f9631597700 1 --2- 172.21.15.88:0/2550222601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c104ee0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.205+0000 7f9631597700 1 -- 172.21.15.88:0/2550222601 >> 172.21.15.88:0/2550222601 conn(0x7f962c0fc970 msgr2=0x7f962c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.205+0000 7f9631597700 1 -- 172.21.15.88:0/2550222601 shutdown_connections 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.205+0000 7f9631597700 1 -- 172.21.15.88:0/2550222601 wait complete. 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.206+0000 7f9631597700 1 Processor -- start 2023-12-09T02:27:50.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.206+0000 7f9631597700 1 -- start start 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.206+0000 7f9631597700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c110990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.206+0000 7f9631597700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c110ed0 con 0x7f962c070fc0 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.206+0000 7f962affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c110990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.206+0000 7f962affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c110990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38178/0 (socket says 172.21.15.88:38178) 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.206+0000 7f962affd700 1 -- 172.21.15.88:0/3262427431 learned_addr learned my addr 172.21.15.88:0/3262427431 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.207+0000 7f962affd700 1 -- 172.21.15.88:0/3262427431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96200094f0 con 0x7f962c070fc0 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.207+0000 7f962affd700 1 --2- 172.21.15.88:0/3262427431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c110990 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9620009290 tx=0x7f9620016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.207+0000 7f96137fe700 1 -- 172.21.15.88:0/3262427431 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962001c5c0 con 0x7f962c070fc0 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.207+0000 7f96137fe700 1 -- 172.21.15.88:0/3262427431 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962001c740 con 0x7f962c070fc0 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.207+0000 7f9631597700 1 -- 172.21.15.88:0/3262427431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c1110d0 con 0x7f962c070fc0 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.207+0000 7f96137fe700 1 -- 172.21.15.88:0/3262427431 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962001ca50 con 0x7f962c070fc0 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.207+0000 7f9631597700 1 -- 172.21.15.88:0/3262427431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c1114e0 con 0x7f962c070fc0 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.207+0000 7f96137fe700 1 -- 172.21.15.88:0/3262427431 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f962001a450 con 0x7f962c070fc0 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.207+0000 7f96137fe700 1 -- 172.21.15.88:0/3262427431 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f962002e790 con 0x7f962c070fc0 2023-12-09T02:27:50.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.208+0000 7f9631597700 1 -- 172.21.15.88:0/3262427431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c04bb80 con 0x7f962c070fc0 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.210+0000 7f96137fe700 1 -- 172.21.15.88:0/3262427431 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f962001ce30 con 0x7f962c070fc0 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.278+0000 7f9631597700 1 -- 172.21.15.88:0/3262427431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f962c10a0c0 con 0x7f962c070fc0 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.279+0000 7f96137fe700 1 -- 172.21.15.88:0/3262427431 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f962001a840 con 0x7f962c070fc0 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.279+0000 7f9631597700 1 -- 172.21.15.88:0/3262427431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 msgr2=0x7f962c110990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.279+0000 7f9631597700 1 --2- 172.21.15.88:0/3262427431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c110990 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9620009290 tx=0x7f9620016000 comp rx=0 tx=0).stop 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.279+0000 7f9631597700 1 -- 172.21.15.88:0/3262427431 shutdown_connections 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.279+0000 7f9631597700 1 --2- 172.21.15.88:0/3262427431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c070fc0 0x7f962c110990 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.279+0000 7f9631597700 1 -- 172.21.15.88:0/3262427431 >> 172.21.15.88:0/3262427431 conn(0x7f962c0fc970 msgr2=0x7f962c0fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.280+0000 7f9631597700 1 -- 172.21.15.88:0/3262427431 shutdown_connections 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:50.280+0000 7f9631597700 1 -- 172.21.15.88:0/3262427431 wait complete. 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:mon is available 2023-12-09T02:27:50.644 INFO:teuthology.orchestra.run.smithi088.stdout:Assimilating anything we can from ceph.conf... 2023-12-09T02:27:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:50 smithi088 ceph-mon[111541]: mon.smithi088 is new leader, mons smithi088 in quorum (ranks 0) 2023-12-09T02:27:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:50 smithi088 ceph-mon[111541]: monmap e1: 1 mons at {smithi088=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-09T02:27:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:50 smithi088 ceph-mon[111541]: fsmap 2023-12-09T02:27:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:50 smithi088 ceph-mon[111541]: osdmap e1: 0 total, 0 up, 0 in 2023-12-09T02:27:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:50 smithi088 ceph-mon[111541]: mgrmap e1: no daemons active 2023-12-09T02:27:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:50 smithi088 ceph-mon[111541]: from='client.? 172.21.15.88:0/3262427431' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-09T02:27:51.442 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:27:51.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [global] 2023-12-09T02:27:51.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout fsid = 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:27:51.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.88:3300,v1:172.21.15.88:6789] 2023-12-09T02:27:51.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [osd] 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-09T02:27:51.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.013+0000 7f5b2b299700 1 Processor -- start 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.013+0000 7f5b2b299700 1 -- start start 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.014+0000 7f5b2b299700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b241015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.014+0000 7f5b2b299700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24101b10 con 0x7f5b241011c0 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.014+0000 7f5b29035700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b241015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.014+0000 7f5b29035700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b241015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38184/0 (socket says 172.21.15.88:38184) 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.014+0000 7f5b29035700 1 -- 172.21.15.88:0/2629175211 learned_addr learned my addr 172.21.15.88:0/2629175211 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.014+0000 7f5b29035700 1 -- 172.21.15.88:0/2629175211 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b24101c50 con 0x7f5b241011c0 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.014+0000 7f5b29035700 1 --2- 172.21.15.88:0/2629175211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b241015d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5b140098e0 tx=0x7f5b14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368202dac90b9f84 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.014+0000 7f5b1bfff700 1 -- 172.21.15.88:0/2629175211 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b1400b860 con 0x7f5b241011c0 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.014+0000 7f5b1bfff700 1 -- 172.21.15.88:0/2629175211 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1400b9c0 con 0x7f5b241011c0 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.014+0000 7f5b1bfff700 1 -- 172.21.15.88:0/2629175211 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b1400bc90 con 0x7f5b241011c0 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.015+0000 7f5b2b299700 1 -- 172.21.15.88:0/2629175211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 msgr2=0x7f5b241015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.015+0000 7f5b2b299700 1 --2- 172.21.15.88:0/2629175211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b241015d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5b140098e0 tx=0x7f5b14009250 comp rx=0 tx=0).stop 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.015+0000 7f5b2b299700 1 -- 172.21.15.88:0/2629175211 shutdown_connections 2023-12-09T02:27:51.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.015+0000 7f5b2b299700 1 --2- 172.21.15.88:0/2629175211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b241015d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.015+0000 7f5b2b299700 1 -- 172.21.15.88:0/2629175211 >> 172.21.15.88:0/2629175211 conn(0x7f5b240fc980 msgr2=0x7f5b240fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.015+0000 7f5b2b299700 1 -- 172.21.15.88:0/2629175211 shutdown_connections 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.015+0000 7f5b2b299700 1 -- 172.21.15.88:0/2629175211 wait complete. 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.015+0000 7f5b2b299700 1 Processor -- start 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b2b299700 1 -- start start 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b2b299700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b24112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b2b299700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b241130b0 con 0x7f5b241011c0 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b29035700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b24112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b29035700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b24112b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38186/0 (socket says 172.21.15.88:38186) 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b29035700 1 -- 172.21.15.88:0/1796101558 learned_addr learned my addr 172.21.15.88:0/1796101558 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b29035700 1 -- 172.21.15.88:0/1796101558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b140094f0 con 0x7f5b241011c0 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b29035700 1 --2- 172.21.15.88:0/1796101558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b24112b70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5b14003080 tx=0x7f5b14016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b19ffb700 1 -- 172.21.15.88:0/1796101558 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b1401c5c0 con 0x7f5b241011c0 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b19ffb700 1 -- 172.21.15.88:0/1796101558 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1401c720 con 0x7f5b241011c0 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b2b299700 1 -- 172.21.15.88:0/1796101558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b241132b0 con 0x7f5b241011c0 2023-12-09T02:27:51.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.016+0000 7f5b19ffb700 1 -- 172.21.15.88:0/1796101558 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b1401ca30 con 0x7f5b241011c0 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.017+0000 7f5b2b299700 1 -- 172.21.15.88:0/1796101558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b241136c0 con 0x7f5b241011c0 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.017+0000 7f5b19ffb700 1 -- 172.21.15.88:0/1796101558 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5b1401a450 con 0x7f5b241011c0 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.017+0000 7f5b19ffb700 1 -- 172.21.15.88:0/1796101558 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5b1402e790 con 0x7f5b241011c0 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.018+0000 7f5b2b299700 1 -- 172.21.15.88:0/1796101558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2404bb80 con 0x7f5b241011c0 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.020+0000 7f5b19ffb700 1 -- 172.21.15.88:0/1796101558 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5b1401a890 con 0x7f5b241011c0 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.085+0000 7f5b2b299700 1 -- 172.21.15.88:0/1796101558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f5b2410be40 con 0x7f5b241011c0 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.089+0000 7f5b19ffb700 1 -- 172.21.15.88:0/1796101558 <== mon.0 v2:172.21.15.88:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f5b1402ee60 con 0x7f5b241011c0 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.089+0000 7f5b19ffb700 1 -- 172.21.15.88:0/1796101558 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f5b14024720 con 0x7f5b241011c0 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.090+0000 7f5b2b299700 1 -- 172.21.15.88:0/1796101558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 msgr2=0x7f5b24112b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.090+0000 7f5b2b299700 1 --2- 172.21.15.88:0/1796101558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b24112b70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5b14003080 tx=0x7f5b14016000 comp rx=0 tx=0).stop 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.090+0000 7f5b2b299700 1 -- 172.21.15.88:0/1796101558 shutdown_connections 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.090+0000 7f5b2b299700 1 --2- 172.21.15.88:0/1796101558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b241011c0 0x7f5b24112b70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.090+0000 7f5b2b299700 1 -- 172.21.15.88:0/1796101558 >> 172.21.15.88:0/1796101558 conn(0x7f5b240fc980 msgr2=0x7f5b240767f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:51.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.090+0000 7f5b2b299700 1 -- 172.21.15.88:0/1796101558 shutdown_connections 2023-12-09T02:27:51.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.090+0000 7f5b2b299700 1 -- 172.21.15.88:0/1796101558 wait complete. 2023-12-09T02:27:51.458 INFO:teuthology.orchestra.run.smithi088.stdout:Generating new minimal ceph.conf... 2023-12-09T02:27:52.127 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:51 smithi088 ceph-mon[111541]: from='client.? 172.21.15.88:0/1796101558' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-09T02:27:52.128 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:51 smithi088 ceph-mon[111541]: from='client.? 172.21.15.88:0/1796101558' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-09T02:27:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.776+0000 7fbc25919700 1 Processor -- start 2023-12-09T02:27:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.776+0000 7fbc25919700 1 -- start start 2023-12-09T02:27:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.776+0000 7fbc25919700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.776+0000 7fbc25919700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc201053e0 con 0x7fbc20076c60 2023-12-09T02:27:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.776+0000 7fbc1effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.776+0000 7fbc1effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38188/0 (socket says 172.21.15.88:38188) 2023-12-09T02:27:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.776+0000 7fbc1effd700 1 -- 172.21.15.88:0/2121280275 learned_addr learned my addr 172.21.15.88:0/2121280275 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.776+0000 7fbc1effd700 1 -- 172.21.15.88:0/2121280275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20105520 con 0x7fbc20076c60 2023-12-09T02:27:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.776+0000 7fbc1effd700 1 --2- 172.21.15.88:0/2121280275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20104ea0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbc100098e0 tx=0x7fbc10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ecc82e0ce20f72 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.776+0000 7fbc1dffb700 1 -- 172.21.15.88:0/2121280275 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc1000b860 con 0x7fbc20076c60 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.777+0000 7fbc1dffb700 1 -- 172.21.15.88:0/2121280275 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fbc1000be30 con 0x7fbc20076c60 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.777+0000 7fbc1dffb700 1 -- 172.21.15.88:0/2121280275 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc10010380 con 0x7fbc20076c60 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.777+0000 7fbc25919700 1 -- 172.21.15.88:0/2121280275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 msgr2=0x7fbc20104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.777+0000 7fbc25919700 1 --2- 172.21.15.88:0/2121280275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20104ea0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbc100098e0 tx=0x7fbc10009250 comp rx=0 tx=0).stop 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.777+0000 7fbc25919700 1 -- 172.21.15.88:0/2121280275 shutdown_connections 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.777+0000 7fbc25919700 1 --2- 172.21.15.88:0/2121280275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20104ea0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.777+0000 7fbc25919700 1 -- 172.21.15.88:0/2121280275 >> 172.21.15.88:0/2121280275 conn(0x7fbc200fc950 msgr2=0x7fbc200fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.777+0000 7fbc25919700 1 -- 172.21.15.88:0/2121280275 shutdown_connections 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.777+0000 7fbc25919700 1 -- 172.21.15.88:0/2121280275 wait complete. 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.778+0000 7fbc25919700 1 Processor -- start 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.778+0000 7fbc25919700 1 -- start start 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.778+0000 7fbc25919700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.778+0000 7fbc25919700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20111690 con 0x7fbc20076c60 2023-12-09T02:27:52.214 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.778+0000 7fbc1effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.778+0000 7fbc1effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38200/0 (socket says 172.21.15.88:38200) 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.778+0000 7fbc1effd700 1 -- 172.21.15.88:0/217519620 learned_addr learned my addr 172.21.15.88:0/217519620 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.779+0000 7fbc1effd700 1 -- 172.21.15.88:0/217519620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc100094f0 con 0x7fbc20076c60 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.779+0000 7fbc1effd700 1 --2- 172.21.15.88:0/217519620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20111150 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbc10006d40 tx=0x7fbc10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.779+0000 7fbc077fe700 1 -- 172.21.15.88:0/217519620 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc100109b0 con 0x7fbc20076c60 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.779+0000 7fbc25919700 1 -- 172.21.15.88:0/217519620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc20111890 con 0x7fbc20076c60 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.779+0000 7fbc077fe700 1 -- 172.21.15.88:0/217519620 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fbc10024440 con 0x7fbc20076c60 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.779+0000 7fbc077fe700 1 -- 172.21.15.88:0/217519620 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc1001a5f0 con 0x7fbc20076c60 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.779+0000 7fbc25919700 1 -- 172.21.15.88:0/217519620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc20111ca0 con 0x7fbc20076c60 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.779+0000 7fbc077fe700 1 -- 172.21.15.88:0/217519620 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbc1001aab0 con 0x7fbc20076c60 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.779+0000 7fbc077fe700 1 -- 172.21.15.88:0/217519620 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbc1002dbe0 con 0x7fbc20076c60 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.780+0000 7fbc25919700 1 -- 172.21.15.88:0/217519620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2004bb80 con 0x7fbc20076c60 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.782+0000 7fbc077fe700 1 -- 172.21.15.88:0/217519620 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fbc1002d3f0 con 0x7fbc20076c60 2023-12-09T02:27:52.215 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.848+0000 7fbc25919700 1 -- 172.21.15.88:0/217519620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fbc2010ab60 con 0x7fbc20076c60 2023-12-09T02:27:52.216 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.848+0000 7fbc077fe700 1 -- 172.21.15.88:0/217519620 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fbc10032030 con 0x7fbc20076c60 2023-12-09T02:27:52.216 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.849+0000 7fbc25919700 1 -- 172.21.15.88:0/217519620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 msgr2=0x7fbc20111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:52.216 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.849+0000 7fbc25919700 1 --2- 172.21.15.88:0/217519620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20111150 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbc10006d40 tx=0x7fbc10009250 comp rx=0 tx=0).stop 2023-12-09T02:27:52.216 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.849+0000 7fbc25919700 1 -- 172.21.15.88:0/217519620 shutdown_connections 2023-12-09T02:27:52.216 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.849+0000 7fbc25919700 1 --2- 172.21.15.88:0/217519620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc20076c60 0x7fbc20111150 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:52.216 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.849+0000 7fbc25919700 1 -- 172.21.15.88:0/217519620 >> 172.21.15.88:0/217519620 conn(0x7fbc200fc950 msgr2=0x7fbc200fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:52.216 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.849+0000 7fbc25919700 1 -- 172.21.15.88:0/217519620 shutdown_connections 2023-12-09T02:27:52.216 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:51.849+0000 7fbc25919700 1 -- 172.21.15.88:0/217519620 wait complete. 2023-12-09T02:27:52.216 INFO:teuthology.orchestra.run.smithi088.stdout:Restarting the monitor... 2023-12-09T02:27:52.405 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:52 smithi088 systemd[1]: Stopping Ceph mon.smithi088 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:27:52.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:52 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi088[111518]: 2023-12-09T02:27:52.401+0000 7fe33e82a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi088 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:27:52.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:52 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi088[111518]: 2023-12-09T02:27:52.401+0000 7fe33e82a700 -1 mon.smithi088@0(leader) e1 *** Got Signal Terminated *** 2023-12-09T02:27:53.315 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 bash[111867]: ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi088 2023-12-09T02:27:53.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 systemd[1]: ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi088.service: Succeeded. 2023-12-09T02:27:53.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 systemd[1]: Stopped Ceph mon.smithi088 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:27:53.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 systemd[1]: Starting Ceph mon.smithi088 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:27:53.634 INFO:teuthology.orchestra.run.smithi088.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-09T02:27:53.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: set uid:gid to 167:167 (ceph:ceph) 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable), process ceph-mon, pid 7 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: pidfile_write: ignore empty --pid-file 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: load: jerasure load: lrc 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: RocksDB version: 6.15.5 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Compile date Dec 8 2023 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: DB SUMMARY 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: DB Session ID: 9OCYER0CG2E7GVGP5RPC 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: CURRENT file: CURRENT 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: IDENTITY file: IDENTITY 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-09T02:27:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi088/store.db dir, Total Num: 1, files: 000008.sst 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi088/store.db: 000010.log size: 95334 ; 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.error_if_exists: 0 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.create_if_missing: 0 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.paranoid_checks: 1 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.env: 0x55f805738a80 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.fs: Posix File System 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.info_log: 0x55f807962780 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_file_opening_threads: 16 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.statistics: (nil) 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.use_fsync: 0 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_log_file_size: 0 2023-12-09T02:27:53.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.keep_log_file_num: 1000 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.recycle_log_file_num: 0 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.allow_fallocate: 1 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.allow_mmap_reads: 0 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.allow_mmap_writes: 0 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.use_direct_reads: 0 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.create_missing_column_families: 0 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.db_log_dir: 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi088/store.db 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-09T02:27:53.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-09T02:27:53.981 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-09T02:27:53.981 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-09T02:27:53.981 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-09T02:27:53.981 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-09T02:27:53.981 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.advise_random_on_open: 1 2023-12-09T02:27:53.981 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.db_write_buffer_size: 0 2023-12-09T02:27:53.981 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.write_buffer_manager: 0x55f8086d29f0 2023-12-09T02:27:53.981 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-09T02:27:53.981 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-09T02:27:53.981 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.rate_limiter: (nil) 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.wal_recovery_mode: 2 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.enable_thread_tracking: 0 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.enable_pipelined_write: 0 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.unordered_write: 0 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.row_cache: None 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.wal_filter: None 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-09T02:27:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.allow_ingest_behind: 0 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.preserve_deletes: 0 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.two_write_queues: 0 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.manual_wal_flush: 0 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.atomic_flush: 0 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.log_readahead_size: 0 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 bash[111990]: d21a10406297ade52afe3f9fcdbc2f456b1d9922bd6bf13a5e97e59d00431791 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.best_efforts_recovery: 0 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.allow_data_in_errors: 0 2023-12-09T02:27:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.db_host_id: __hostname__ 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_background_jobs: 2 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_background_compactions: -1 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_subcompactions: 1 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_total_wal_size: 0 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_open_files: -1 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.bytes_per_sync: 0 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-09T02:27:53.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_readahead_size: 0 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_background_flushes: -1 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Compression algorithms supported: 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: kZSTD supported: 0 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: kXpressCompression supported: 0 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: kLZ4HCCompression supported: 1 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: kZlibCompression supported: 1 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: kSnappyCompression supported: 1 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: kLZ4Compression supported: 1 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: kBZip2Compression supported: 0 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000009 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-09T02:27:53.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.merge_operator: 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_filter: None 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_filter_factory: None 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.sst_partitioner_factory: None 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f8079b2f90) 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks: 1 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_top_level_index_and_filter: 1 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_type: 0 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_index_type: 0 2023-12-09T02:27:53.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_shortening: 1 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: hash_index_allow_collision: 1 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: checksum: 1 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: no_block_cache: 0 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache: 0x55f8079e5090 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_name: BinnedLRUCache 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_options: 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: capacity : 536870912 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: num_shard_bits : 4 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: strict_capacity_limit : 0 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: high_pri_pool_ratio: 0.000 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_compressed: (nil) 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: persistent_cache: (nil) 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size: 4096 2023-12-09T02:27:53.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size_deviation: 10 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_restart_interval: 16 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_block_restart_interval: 1 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: metadata_block_size: 4096 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: partition_filters: 0 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: use_delta_encoding: 1 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: whole_key_filtering: 1 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: verify_compression: 0 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: read_amp_bytes_per_bit: 0 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: format_version: 4 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: enable_index_compression: 1 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_align: 0 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.write_buffer_size: 33554432 2023-12-09T02:27:53.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_write_buffer_number: 2 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compression: NoCompression 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.bottommost_compression: Disabled 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.prefix_extractor: nullptr 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.num_levels: 7 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-09T02:27:53.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compression_opts.level: 32767 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compression_opts.strategy: 0 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compression_opts.enabled: false 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.target_file_size_base: 67108864 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-09T02:27:53.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.arena_block_size: 4194304 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-09T02:27:53.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.disable_auto_compactions: 0 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.table_properties_collectors: 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.inplace_update_support: 0 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-09T02:27:53.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.bloom_locality: 0 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.max_successive_merges: 0 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.paranoid_file_checks: 0 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.force_consistency_checks: 1 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.report_bg_io_stats: 0 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.ttl: 2592000 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.enable_blob_files: false 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.min_blob_size: 0 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.blob_file_size: 268435456 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-09T02:27:53.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702088873628721, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702088873629719, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 90860, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 88955, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13169, "raw_average_key_size": 49, "raw_value_size": 81733, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 264, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702088873, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "175ff5bc-9f4b-4db6-ad57-367e391a4860", "db_session_id": "9OCYER0CG2E7GVGP5RPC"}} 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702088873630150, "job": 1, "event": "recovery_finished"} 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi088/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55f807979180 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: DB pointer 0x55f807a4e000 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-09T02:27:53.994 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** DB Stats ** 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: L0 2/0 90.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.3 0.00 0.00 1 0.001 0 0 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Sum 2/0 90.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.3 0.00 0.00 1 0.001 0 0 2023-12-09T02:27:53.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.3 0.00 0.00 1 0.001 0 0 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 129.3 0.00 0.00 1 0.001 0 0 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative compaction: 0.00 GB write, 21.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval compaction: 0.00 GB write, 21.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-09T02:27:53.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: L0 2/0 90.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.3 0.00 0.00 1 0.001 0 0 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Sum 2/0 90.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.3 0.00 0.00 1 0.001 0 0 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 129.3 0.00 0.00 1 0.001 0 0 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-09T02:27:53.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative compaction: 0.00 GB write, 21.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: starting mon.smithi088 rank 0 at public addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] at bind addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi088 fsid 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 systemd[1]: Started Ceph mon.smithi088 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: mon.smithi088@-1(???) e1 preinit fsid 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: mon.smithi088@-1(???).mds e1 new map 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: mon.smithi088@-1(???).mds e1 print_map 2023-12-09T02:27:53.998 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: e1 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: legacy client fscid: -1 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: No filesystems configured 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: mon.smithi088@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: mon.smithi088@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: mon.smithi088@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: mon.smithi088@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: mon.smithi088@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: mon.smithi088 is new leader, mons smithi088 in quorum (ranks 0) 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: monmap e1: 1 mons at {smithi088=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: fsmap 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: osdmap e1: 0 total, 0 up, 0 in 2023-12-09T02:27:53.999 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:53 smithi088 ceph-mon[112028]: mgrmap e1: no daemons active 2023-12-09T02:27:54.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.983+0000 7fdf64640700 1 Processor -- start 2023-12-09T02:27:54.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.983+0000 7fdf64640700 1 -- start start 2023-12-09T02:27:54.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.984+0000 7fdf64640700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c104f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:54.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.984+0000 7fdf64640700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c105440 con 0x7fdf5c070fa0 2023-12-09T02:27:54.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.984+0000 7fdf623dc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c104f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:54.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.984+0000 7fdf623dc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c104f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38206/0 (socket says 172.21.15.88:38206) 2023-12-09T02:27:54.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.984+0000 7fdf623dc700 1 -- 172.21.15.88:0/2221749292 learned_addr learned my addr 172.21.15.88:0/2221749292 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:54.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.985+0000 7fdf623dc700 1 -- 172.21.15.88:0/2221749292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c105580 con 0x7fdf5c070fa0 2023-12-09T02:27:54.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.985+0000 7fdf623dc700 1 --2- 172.21.15.88:0/2221749292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c104f00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdf580098e0 tx=0x7fdf58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26eeb39966e8221b server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:54.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.985+0000 7fdf613da700 1 -- 172.21.15.88:0/2221749292 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf5800b860 con 0x7fdf5c070fa0 2023-12-09T02:27:54.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.985+0000 7fdf613da700 1 -- 172.21.15.88:0/2221749292 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdf5800be30 con 0x7fdf5c070fa0 2023-12-09T02:27:54.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.985+0000 7fdf613da700 1 -- 172.21.15.88:0/2221749292 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf58010380 con 0x7fdf5c070fa0 2023-12-09T02:27:54.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.985+0000 7fdf64640700 1 -- 172.21.15.88:0/2221749292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 msgr2=0x7fdf5c104f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:54.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.985+0000 7fdf64640700 1 --2- 172.21.15.88:0/2221749292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c104f00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdf580098e0 tx=0x7fdf58009250 comp rx=0 tx=0).stop 2023-12-09T02:27:54.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.986+0000 7fdf64640700 1 -- 172.21.15.88:0/2221749292 shutdown_connections 2023-12-09T02:27:54.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.986+0000 7fdf64640700 1 --2- 172.21.15.88:0/2221749292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c104f00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:54.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.986+0000 7fdf64640700 1 -- 172.21.15.88:0/2221749292 >> 172.21.15.88:0/2221749292 conn(0x7fdf5c0fc970 msgr2=0x7fdf5c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:54.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.986+0000 7fdf64640700 1 -- 172.21.15.88:0/2221749292 shutdown_connections 2023-12-09T02:27:54.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.986+0000 7fdf64640700 1 -- 172.21.15.88:0/2221749292 wait complete. 2023-12-09T02:27:54.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.986+0000 7fdf64640700 1 Processor -- start 2023-12-09T02:27:54.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.986+0000 7fdf64640700 1 -- start start 2023-12-09T02:27:54.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.986+0000 7fdf64640700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:54.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf64640700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c1116c0 con 0x7fdf5c070fa0 2023-12-09T02:27:54.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf623dc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:54.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf623dc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38218/0 (socket says 172.21.15.88:38218) 2023-12-09T02:27:54.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf623dc700 1 -- 172.21.15.88:0/2902175963 learned_addr learned my addr 172.21.15.88:0/2902175963 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:54.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf623dc700 1 -- 172.21.15.88:0/2902175963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf580094f0 con 0x7fdf5c070fa0 2023-12-09T02:27:54.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf623dc700 1 --2- 172.21.15.88:0/2902175963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c111180 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdf58006d40 tx=0x7fdf58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:54.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf52ffd700 1 -- 172.21.15.88:0/2902175963 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf580109b0 con 0x7fdf5c070fa0 2023-12-09T02:27:54.414 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf64640700 1 -- 172.21.15.88:0/2902175963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c1118c0 con 0x7fdf5c070fa0 2023-12-09T02:27:54.414 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf52ffd700 1 -- 172.21.15.88:0/2902175963 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdf58024440 con 0x7fdf5c070fa0 2023-12-09T02:27:54.414 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf52ffd700 1 -- 172.21.15.88:0/2902175963 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf5801a5f0 con 0x7fdf5c070fa0 2023-12-09T02:27:54.414 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf64640700 1 -- 172.21.15.88:0/2902175963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c111cd0 con 0x7fdf5c070fa0 2023-12-09T02:27:54.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf52ffd700 1 -- 172.21.15.88:0/2902175963 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdf5801aaf0 con 0x7fdf5c070fa0 2023-12-09T02:27:54.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.987+0000 7fdf52ffd700 1 -- 172.21.15.88:0/2902175963 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdf5802da40 con 0x7fdf5c070fa0 2023-12-09T02:27:54.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.988+0000 7fdf64640700 1 -- 172.21.15.88:0/2902175963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5c04bb80 con 0x7fdf5c070fa0 2023-12-09T02:27:54.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:53.990+0000 7fdf52ffd700 1 -- 172.21.15.88:0/2902175963 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdf58006d70 con 0x7fdf5c070fa0 2023-12-09T02:27:54.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:54.058+0000 7fdf64640700 1 -- 172.21.15.88:0/2902175963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fdf5c10ab60 con 0x7fdf5c070fa0 2023-12-09T02:27:54.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:54.061+0000 7fdf52ffd700 1 -- 172.21.15.88:0/2902175963 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fdf58024970 con 0x7fdf5c070fa0 2023-12-09T02:27:54.416 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:54.062+0000 7fdf64640700 1 -- 172.21.15.88:0/2902175963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 msgr2=0x7fdf5c111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:54.416 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:54.062+0000 7fdf64640700 1 --2- 172.21.15.88:0/2902175963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c111180 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdf58006d40 tx=0x7fdf58009250 comp rx=0 tx=0).stop 2023-12-09T02:27:54.416 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:54.062+0000 7fdf64640700 1 -- 172.21.15.88:0/2902175963 shutdown_connections 2023-12-09T02:27:54.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:54.062+0000 7fdf64640700 1 --2- 172.21.15.88:0/2902175963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf5c070fa0 0x7fdf5c111180 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:54.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:54.062+0000 7fdf64640700 1 -- 172.21.15.88:0/2902175963 >> 172.21.15.88:0/2902175963 conn(0x7fdf5c0fc970 msgr2=0x7fdf5c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:54.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:54.062+0000 7fdf64640700 1 -- 172.21.15.88:0/2902175963 shutdown_connections 2023-12-09T02:27:54.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:54.062+0000 7fdf64640700 1 -- 172.21.15.88:0/2902175963 wait complete. 2023-12-09T02:27:54.417 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-09T02:27:54.417 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-09T02:27:54.417 INFO:teuthology.orchestra.run.smithi088.stdout:Creating mgr... 2023-12-09T02:27:54.417 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying port 9283 ... 2023-12-09T02:27:54.532 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-70b26980-963a-11ee-95a3-87774f69a715@mgr.smithi088.jwlofb 2023-12-09T02:27:54.533 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to reset failed state of unit ceph-70b26980-963a-11ee-95a3-87774f69a715@mgr.smithi088.jwlofb.service: Unit ceph-70b26980-963a-11ee-95a3-87774f69a715@mgr.smithi088.jwlofb.service not loaded. 2023-12-09T02:27:54.621 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-70b26980-963a-11ee-95a3-87774f69a715.target.wants/ceph-70b26980-963a-11ee-95a3-87774f69a715@mgr.smithi088.jwlofb.service → /etc/systemd/system/ceph-70b26980-963a-11ee-95a3-87774f69a715@.service. 2023-12-09T02:27:55.054 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-09T02:27:55.054 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2023-12-09T02:27:55.062 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-09T02:27:55.062 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-12-09T02:27:55.062 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2023-12-09T02:27:55.062 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to enable service . firewalld.service is not available 2023-12-09T02:27:55.071 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-09T02:27:55.071 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2023-12-09T02:27:55.078 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-09T02:27:55.078 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-12-09T02:27:55.078 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2023-12-09T02:27:55.079 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-09T02:27:55.079 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr to start... 2023-12-09T02:27:55.079 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr... 2023-12-09T02:27:55.330 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:55 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2902175963' entity='client.admin' 2023-12-09T02:27:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:27:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-12-09T02:27:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "70b26980-963a-11ee-95a3-87774f69a715", 2023-12-09T02:27:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2023-12-09T02:27:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-09T02:27:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-09T02:27:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-09T02:27:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-09T02:27:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-09T02:27:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "smithi088" 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-09T02:27:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-09T02:27:55.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-09T02:27:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:27:55.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2023-12-09T02:27:49.802657+0000", 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.449+0000 7f09e22f5700 1 Processor -- start 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.449+0000 7f09e22f5700 1 -- start start 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.449+0000 7f09e22f5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc104f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.449+0000 7f09e22f5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc105440 con 0x7f09dc070fa0 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.449+0000 7f09dbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc104f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:55.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.449+0000 7f09dbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc104f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38248/0 (socket says 172.21.15.88:38248) 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.449+0000 7f09dbfff700 1 -- 172.21.15.88:0/2694545241 learned_addr learned my addr 172.21.15.88:0/2694545241 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.450+0000 7f09dbfff700 1 -- 172.21.15.88:0/2694545241 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc105580 con 0x7f09dc070fa0 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.450+0000 7f09dbfff700 1 --2- 172.21.15.88:0/2694545241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc104f00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0098e0 tx=0x7f09cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa00e77a1ab912d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.450+0000 7f09daffd700 1 -- 172.21.15.88:0/2694545241 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09cc00b860 con 0x7f09dc070fa0 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.450+0000 7f09daffd700 1 -- 172.21.15.88:0/2694545241 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f09cc00be30 con 0x7f09dc070fa0 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.450+0000 7f09daffd700 1 -- 172.21.15.88:0/2694545241 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09cc010380 con 0x7f09dc070fa0 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.451+0000 7f09e22f5700 1 -- 172.21.15.88:0/2694545241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 msgr2=0x7f09dc104f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.451+0000 7f09e22f5700 1 --2- 172.21.15.88:0/2694545241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc104f00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0098e0 tx=0x7f09cc009250 comp rx=0 tx=0).stop 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.451+0000 7f09e22f5700 1 -- 172.21.15.88:0/2694545241 shutdown_connections 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.451+0000 7f09e22f5700 1 --2- 172.21.15.88:0/2694545241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc104f00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.451+0000 7f09e22f5700 1 -- 172.21.15.88:0/2694545241 >> 172.21.15.88:0/2694545241 conn(0x7f09dc0fc970 msgr2=0x7f09dc0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.451+0000 7f09e22f5700 1 -- 172.21.15.88:0/2694545241 shutdown_connections 2023-12-09T02:27:55.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.451+0000 7f09e22f5700 1 -- 172.21.15.88:0/2694545241 wait complete. 2023-12-09T02:27:55.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.451+0000 7f09e22f5700 1 Processor -- start 2023-12-09T02:27:55.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.452+0000 7f09e22f5700 1 -- start start 2023-12-09T02:27:55.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.452+0000 7f09e22f5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc1111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:55.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.452+0000 7f09e22f5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc1116e0 con 0x7f09dc070fa0 2023-12-09T02:27:55.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.452+0000 7f09dbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc1111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:55.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.452+0000 7f09dbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc1111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38264/0 (socket says 172.21.15.88:38264) 2023-12-09T02:27:55.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.452+0000 7f09dbfff700 1 -- 172.21.15.88:0/137746590 learned_addr learned my addr 172.21.15.88:0/137746590 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:55.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.452+0000 7f09dbfff700 1 -- 172.21.15.88:0/137746590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc0094f0 con 0x7f09dc070fa0 2023-12-09T02:27:55.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.452+0000 7f09dbfff700 1 --2- 172.21.15.88:0/137746590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc1111a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f09cc006b00 tx=0x7f09cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:55.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.453+0000 7f09d8ff9700 1 -- 172.21.15.88:0/137746590 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09cc010a80 con 0x7f09dc070fa0 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.453+0000 7f09e22f5700 1 -- 172.21.15.88:0/137746590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc1118e0 con 0x7f09dc070fa0 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.453+0000 7f09d8ff9700 1 -- 172.21.15.88:0/137746590 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f09cc01a430 con 0x7f09dc070fa0 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.453+0000 7f09d8ff9700 1 -- 172.21.15.88:0/137746590 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09cc0245b0 con 0x7f09dc070fa0 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.453+0000 7f09e22f5700 1 -- 172.21.15.88:0/137746590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc111cf0 con 0x7f09dc070fa0 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.453+0000 7f09d8ff9700 1 -- 172.21.15.88:0/137746590 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f09cc024a30 con 0x7f09dc070fa0 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.453+0000 7f09d8ff9700 1 -- 172.21.15.88:0/137746590 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f09cc02eaf0 con 0x7f09dc070fa0 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.454+0000 7f09e22f5700 1 -- 172.21.15.88:0/137746590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09dc04bb80 con 0x7f09dc070fa0 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.458+0000 7f09d8ff9700 1 -- 172.21.15.88:0/137746590 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f09cc02ed50 con 0x7f09dc070fa0 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.529+0000 7f09e22f5700 1 -- 172.21.15.88:0/137746590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f09dc10ab60 con 0x7f09dc070fa0 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.530+0000 7f09d8ff9700 1 -- 172.21.15.88:0/137746590 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f09cc01a9a0 con 0x7f09dc070fa0 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.530+0000 7f09e22f5700 1 -- 172.21.15.88:0/137746590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 msgr2=0x7f09dc1111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.530+0000 7f09e22f5700 1 --2- 172.21.15.88:0/137746590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc1111a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f09cc006b00 tx=0x7f09cc009250 comp rx=0 tx=0).stop 2023-12-09T02:27:55.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.530+0000 7f09e22f5700 1 -- 172.21.15.88:0/137746590 shutdown_connections 2023-12-09T02:27:55.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.530+0000 7f09e22f5700 1 --2- 172.21.15.88:0/137746590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09dc070fa0 0x7f09dc1111a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:55.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.530+0000 7f09e22f5700 1 -- 172.21.15.88:0/137746590 >> 172.21.15.88:0/137746590 conn(0x7f09dc0fc970 msgr2=0x7f09dc0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:55.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.531+0000 7f09e22f5700 1 -- 172.21.15.88:0/137746590 shutdown_connections 2023-12-09T02:27:55.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:55.531+0000 7f09e22f5700 1 -- 172.21.15.88:0/137746590 wait complete. 2023-12-09T02:27:55.912 INFO:teuthology.orchestra.run.smithi088.stdout:mgr not available, waiting (1/15)... 2023-12-09T02:27:56.340 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:56 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/137746590' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-09T02:27:58.523 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:27:58 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3993123755' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-09T02:27:58.709 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:27:58.709 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "70b26980-963a-11ee-95a3-87774f69a715", 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "smithi088" 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:27:58.710 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2023-12-09T02:27:58.711 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-09T02:27:58.711 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:27:58.711 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-09T02:27:58.711 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-09T02:27:58.711 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:58.711 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-09T02:27:58.711 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:27:58.711 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-09T02:27:58.711 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-09T02:27:58.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-09T02:27:58.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-09T02:27:58.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:27:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-09T02:27:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-09T02:27:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-09T02:27:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-09T02:27:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-09T02:27:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-09T02:27:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-09T02:27:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-09T02:27:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2023-12-09T02:27:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2023-12-09T02:27:49.802657+0000", 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.272+0000 7fa9ded23700 1 Processor -- start 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.273+0000 7fa9ded23700 1 -- start start 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.273+0000 7fa9ded23700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.273+0000 7fa9ded23700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d81053e0 con 0x7fa9d8071000 2023-12-09T02:27:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.273+0000 7fa9dcabf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.273+0000 7fa9dcabf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40614/0 (socket says 172.21.15.88:40614) 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.273+0000 7fa9dcabf700 1 -- 172.21.15.88:0/1675702943 learned_addr learned my addr 172.21.15.88:0/1675702943 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.273+0000 7fa9dcabf700 1 -- 172.21.15.88:0/1675702943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d8105520 con 0x7fa9d8071000 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.273+0000 7fa9dcabf700 1 --2- 172.21.15.88:0/1675702943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8104ea0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0098e0 tx=0x7fa9cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f29d018c7a8090 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.274+0000 7fa9d77fe700 1 -- 172.21.15.88:0/1675702943 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9cc00b860 con 0x7fa9d8071000 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.274+0000 7fa9d77fe700 1 -- 172.21.15.88:0/1675702943 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa9cc00be30 con 0x7fa9d8071000 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.274+0000 7fa9d77fe700 1 -- 172.21.15.88:0/1675702943 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9cc010380 con 0x7fa9d8071000 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.274+0000 7fa9ded23700 1 -- 172.21.15.88:0/1675702943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 msgr2=0x7fa9d8104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.274+0000 7fa9ded23700 1 --2- 172.21.15.88:0/1675702943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8104ea0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0098e0 tx=0x7fa9cc009250 comp rx=0 tx=0).stop 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.274+0000 7fa9ded23700 1 -- 172.21.15.88:0/1675702943 shutdown_connections 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.274+0000 7fa9ded23700 1 --2- 172.21.15.88:0/1675702943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8104ea0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.274+0000 7fa9ded23700 1 -- 172.21.15.88:0/1675702943 >> 172.21.15.88:0/1675702943 conn(0x7fa9d80fc970 msgr2=0x7fa9d80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.275+0000 7fa9ded23700 1 -- 172.21.15.88:0/1675702943 shutdown_connections 2023-12-09T02:27:58.723 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.275+0000 7fa9ded23700 1 -- 172.21.15.88:0/1675702943 wait complete. 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.275+0000 7fa9ded23700 1 Processor -- start 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.275+0000 7fa9ded23700 1 -- start start 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.275+0000 7fa9ded23700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.275+0000 7fa9ded23700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d81116a0 con 0x7fa9d8071000 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.275+0000 7fa9dcabf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.276+0000 7fa9dcabf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40616/0 (socket says 172.21.15.88:40616) 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.276+0000 7fa9dcabf700 1 -- 172.21.15.88:0/3993123755 learned_addr learned my addr 172.21.15.88:0/3993123755 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.276+0000 7fa9dcabf700 1 -- 172.21.15.88:0/3993123755 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc0094f0 con 0x7fa9d8071000 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.276+0000 7fa9dcabf700 1 --2- 172.21.15.88:0/3993123755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8111160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc006b00 tx=0x7fa9cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.276+0000 7fa9d57fa700 1 -- 172.21.15.88:0/3993123755 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9cc010a80 con 0x7fa9d8071000 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.276+0000 7fa9d57fa700 1 -- 172.21.15.88:0/3993123755 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa9cc01a430 con 0x7fa9d8071000 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.276+0000 7fa9ded23700 1 -- 172.21.15.88:0/3993123755 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d81118a0 con 0x7fa9d8071000 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.276+0000 7fa9d57fa700 1 -- 172.21.15.88:0/3993123755 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9cc0245b0 con 0x7fa9d8071000 2023-12-09T02:27:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.276+0000 7fa9ded23700 1 -- 172.21.15.88:0/3993123755 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d8111cb0 con 0x7fa9d8071000 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.276+0000 7fa9d57fa700 1 -- 172.21.15.88:0/3993123755 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa9cc024a60 con 0x7fa9d8071000 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.276+0000 7fa9d57fa700 1 -- 172.21.15.88:0/3993123755 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa9cc02eab0 con 0x7fa9d8071000 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.277+0000 7fa9ded23700 1 -- 172.21.15.88:0/3993123755 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d804bb80 con 0x7fa9d8071000 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.279+0000 7fa9d57fa700 1 -- 172.21.15.88:0/3993123755 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa9cc02ed10 con 0x7fa9d8071000 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.351+0000 7fa9ded23700 1 -- 172.21.15.88:0/3993123755 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa9d8106300 con 0x7fa9d8071000 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.351+0000 7fa9d57fa700 1 -- 172.21.15.88:0/3993123755 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fa9cc010be0 con 0x7fa9d8071000 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.352+0000 7fa9ded23700 1 -- 172.21.15.88:0/3993123755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 msgr2=0x7fa9d8111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.352+0000 7fa9ded23700 1 --2- 172.21.15.88:0/3993123755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8111160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc006b00 tx=0x7fa9cc009250 comp rx=0 tx=0).stop 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.352+0000 7fa9ded23700 1 -- 172.21.15.88:0/3993123755 shutdown_connections 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.352+0000 7fa9ded23700 1 --2- 172.21.15.88:0/3993123755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9d8071000 0x7fa9d8111160 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.352+0000 7fa9ded23700 1 -- 172.21.15.88:0/3993123755 >> 172.21.15.88:0/3993123755 conn(0x7fa9d80fc970 msgr2=0x7fa9d80fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.352+0000 7fa9ded23700 1 -- 172.21.15.88:0/3993123755 shutdown_connections 2023-12-09T02:27:58.725 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:27:58.352+0000 7fa9ded23700 1 -- 172.21.15.88:0/3993123755 wait complete. 2023-12-09T02:27:58.726 INFO:teuthology.orchestra.run.smithi088.stdout:mgr not available, waiting (2/15)... 2023-12-09T02:28:01.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:01 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/4210004276' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-09T02:28:01.525 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "70b26980-963a-11ee-95a3-87774f69a715", 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-09T02:28:01.526 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "smithi088" 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-09T02:28:01.527 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-09T02:28:01.535 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-09T02:28:01.535 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-09T02:28:01.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-09T02:28:01.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2023-12-09T02:27:49.802657+0000", 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.078+0000 7f8f12c7f700 1 Processor -- start 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.078+0000 7f8f12c7f700 1 -- start start 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.078+0000 7f8f12c7f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c104f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.078+0000 7f8f12c7f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1054c0 con 0x7f8f0c070f20 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.078+0000 7f8f10a1b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.078+0000 7f8f10a1b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c104f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40624/0 (socket says 172.21.15.88:40624) 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.078+0000 7f8f10a1b700 1 -- 172.21.15.88:0/595362783 learned_addr learned my addr 172.21.15.88:0/595362783 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.079+0000 7f8f10a1b700 1 -- 172.21.15.88:0/595362783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c105600 con 0x7f8f0c070f20 2023-12-09T02:28:01.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.079+0000 7f8f10a1b700 1 --2- 172.21.15.88:0/595362783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c104f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f000098e0 tx=0x7f8f00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7165a2ffca8b6a server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:01.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.079+0000 7f8f0b7fe700 1 -- 172.21.15.88:0/595362783 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f0000b860 con 0x7f8f0c070f20 2023-12-09T02:28:01.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.079+0000 7f8f0b7fe700 1 -- 172.21.15.88:0/595362783 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8f0000be30 con 0x7f8f0c070f20 2023-12-09T02:28:01.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.079+0000 7f8f0b7fe700 1 -- 172.21.15.88:0/595362783 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f00010380 con 0x7f8f0c070f20 2023-12-09T02:28:01.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.080+0000 7f8f12c7f700 1 -- 172.21.15.88:0/595362783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 msgr2=0x7f8f0c104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:01.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.080+0000 7f8f12c7f700 1 --2- 172.21.15.88:0/595362783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c104f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f000098e0 tx=0x7f8f00009250 comp rx=0 tx=0).stop 2023-12-09T02:28:01.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.080+0000 7f8f12c7f700 1 -- 172.21.15.88:0/595362783 shutdown_connections 2023-12-09T02:28:01.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.080+0000 7f8f12c7f700 1 --2- 172.21.15.88:0/595362783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c104f80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:01.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.080+0000 7f8f12c7f700 1 -- 172.21.15.88:0/595362783 >> 172.21.15.88:0/595362783 conn(0x7f8f0c0fc970 msgr2=0x7f8f0c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:01.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.080+0000 7f8f12c7f700 1 -- 172.21.15.88:0/595362783 shutdown_connections 2023-12-09T02:28:01.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.080+0000 7f8f12c7f700 1 -- 172.21.15.88:0/595362783 wait complete. 2023-12-09T02:28:01.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.080+0000 7f8f12c7f700 1 Processor -- start 2023-12-09T02:28:01.540 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.080+0000 7f8f12c7f700 1 -- start start 2023-12-09T02:28:01.540 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.080+0000 7f8f12c7f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:01.540 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.080+0000 7f8f12c7f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1116a0 con 0x7f8f0c070f20 2023-12-09T02:28:01.540 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f10a1b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:01.540 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f10a1b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40628/0 (socket says 172.21.15.88:40628) 2023-12-09T02:28:01.540 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f10a1b700 1 -- 172.21.15.88:0/4210004276 learned_addr learned my addr 172.21.15.88:0/4210004276 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:01.541 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f10a1b700 1 -- 172.21.15.88:0/4210004276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f000094f0 con 0x7f8f0c070f20 2023-12-09T02:28:01.541 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f10a1b700 1 --2- 172.21.15.88:0/4210004276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c111160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f00006d40 tx=0x7f8f00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:01.541 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f097fa700 1 -- 172.21.15.88:0/4210004276 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f000109b0 con 0x7f8f0c070f20 2023-12-09T02:28:01.541 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f097fa700 1 -- 172.21.15.88:0/4210004276 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8f00024440 con 0x7f8f0c070f20 2023-12-09T02:28:01.541 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f12c7f700 1 -- 172.21.15.88:0/4210004276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c1118a0 con 0x7f8f0c070f20 2023-12-09T02:28:01.541 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f097fa700 1 -- 172.21.15.88:0/4210004276 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f0001a5f0 con 0x7f8f0c070f20 2023-12-09T02:28:01.541 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f12c7f700 1 -- 172.21.15.88:0/4210004276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c111cb0 con 0x7f8f0c070f20 2023-12-09T02:28:01.541 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f097fa700 1 -- 172.21.15.88:0/4210004276 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8f0001aaf0 con 0x7f8f0c070f20 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.081+0000 7f8f097fa700 1 -- 172.21.15.88:0/4210004276 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8f0002da60 con 0x7f8f0c070f20 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.083+0000 7f8f12c7f700 1 -- 172.21.15.88:0/4210004276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c04bb80 con 0x7f8f0c070f20 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.085+0000 7f8f097fa700 1 -- 172.21.15.88:0/4210004276 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8f00024970 con 0x7f8f0c070f20 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.156+0000 7f8f12c7f700 1 -- 172.21.15.88:0/4210004276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8f0c106320 con 0x7f8f0c070f20 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.157+0000 7f8f097fa700 1 -- 172.21.15.88:0/4210004276 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f8f0c106320 con 0x7f8f0c070f20 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.157+0000 7f8f12c7f700 1 -- 172.21.15.88:0/4210004276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 msgr2=0x7f8f0c111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.157+0000 7f8f12c7f700 1 --2- 172.21.15.88:0/4210004276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c111160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f00006d40 tx=0x7f8f00009250 comp rx=0 tx=0).stop 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.158+0000 7f8f12c7f700 1 -- 172.21.15.88:0/4210004276 shutdown_connections 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.158+0000 7f8f12c7f700 1 --2- 172.21.15.88:0/4210004276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f0c070f20 0x7f8f0c111160 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.158+0000 7f8f12c7f700 1 -- 172.21.15.88:0/4210004276 >> 172.21.15.88:0/4210004276 conn(0x7f8f0c0fc970 msgr2=0x7f8f0c0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.158+0000 7f8f12c7f700 1 -- 172.21.15.88:0/4210004276 shutdown_connections 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:01.158+0000 7f8f12c7f700 1 -- 172.21.15.88:0/4210004276 wait complete. 2023-12-09T02:28:01.542 INFO:teuthology.orchestra.run.smithi088.stdout:mgr not available, waiting (3/15)... 2023-12-09T02:28:02.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: Activating manager daemon smithi088.jwlofb 2023-12-09T02:28:02.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: mgrmap e2: smithi088.jwlofb(active, starting, since 0.00285757s) 2023-12-09T02:28:02.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: from='mgr.14100 172.21.15.88:0/1088759070' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-09T02:28:02.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: from='mgr.14100 172.21.15.88:0/1088759070' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-09T02:28:02.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: from='mgr.14100 172.21.15.88:0/1088759070' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-09T02:28:02.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: from='mgr.14100 172.21.15.88:0/1088759070' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:28:02.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: from='mgr.14100 172.21.15.88:0/1088759070' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi088.jwlofb", "id": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:28:02.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: Manager daemon smithi088.jwlofb is now available 2023-12-09T02:28:02.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: from='mgr.14100 172.21.15.88:0/1088759070' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:28:02.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: from='mgr.14100 172.21.15.88:0/1088759070' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/trash_purge_schedule"}]: dispatch 2023-12-09T02:28:02.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: from='mgr.14100 172.21.15.88:0/1088759070' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:02.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: from='mgr.14100 172.21.15.88:0/1088759070' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:02.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:02 smithi088 ceph-mon[112028]: from='mgr.14100 172.21.15.88:0/1088759070' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:03.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:03 smithi088 ceph-mon[112028]: mgrmap e3: smithi088.jwlofb(active, since 1.00909s) 2023-12-09T02:28:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:05 smithi088 ceph-mon[112028]: mgrmap e4: smithi088.jwlofb(active, since 3s) 2023-12-09T02:28:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:05 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2116392269' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "70b26980-963a-11ee-95a3-87774f69a715", 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2023-12-09T02:28:08.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "smithi088" 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-09T02:28:08.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-09T02:28:08.069 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-09T02:28:08.069 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-09T02:28:08.069 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-09T02:28:08.069 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:08.069 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-09T02:28:08.069 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-09T02:28:08.069 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-09T02:28:08.069 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-09T02:28:08.069 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-09T02:28:08.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2023-12-09T02:27:49.802657+0000", 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.972+0000 7f3f45d6a700 1 Processor -- start 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.972+0000 7f3f45d6a700 1 -- start start 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.973+0000 7f3f45d6a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40102d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.973+0000 7f3f45d6a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40103270 con 0x7f3f40102920 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.973+0000 7f3f3f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.973+0000 7f3f3f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40102d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40698/0 (socket says 172.21.15.88:40698) 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.973+0000 7f3f3f7fe700 1 -- 172.21.15.88:0/3236486522 learned_addr learned my addr 172.21.15.88:0/3236486522 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.973+0000 7f3f3f7fe700 1 -- 172.21.15.88:0/3236486522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f401033b0 con 0x7f3f40102920 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.973+0000 7f3f3f7fe700 1 --2- 172.21.15.88:0/3236486522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40102d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3f300098e0 tx=0x7f3f30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4081b7ca068cc728 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.973+0000 7f3f3e7fc700 1 -- 172.21.15.88:0/3236486522 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f3000b860 con 0x7f3f40102920 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.973+0000 7f3f3e7fc700 1 -- 172.21.15.88:0/3236486522 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3f3000be30 con 0x7f3f40102920 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.973+0000 7f3f3e7fc700 1 -- 172.21.15.88:0/3236486522 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f30010380 con 0x7f3f40102920 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.974+0000 7f3f45d6a700 1 -- 172.21.15.88:0/3236486522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 msgr2=0x7f3f40102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.974+0000 7f3f45d6a700 1 --2- 172.21.15.88:0/3236486522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40102d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3f300098e0 tx=0x7f3f30009250 comp rx=0 tx=0).stop 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.974+0000 7f3f45d6a700 1 -- 172.21.15.88:0/3236486522 shutdown_connections 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.974+0000 7f3f45d6a700 1 --2- 172.21.15.88:0/3236486522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40102d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.974+0000 7f3f45d6a700 1 -- 172.21.15.88:0/3236486522 >> 172.21.15.88:0/3236486522 conn(0x7f3f400fc0b0 msgr2=0x7f3f400fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.974+0000 7f3f45d6a700 1 -- 172.21.15.88:0/3236486522 shutdown_connections 2023-12-09T02:28:08.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.974+0000 7f3f45d6a700 1 -- 172.21.15.88:0/3236486522 wait complete. 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.974+0000 7f3f45d6a700 1 Processor -- start 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.975+0000 7f3f45d6a700 1 -- start start 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.975+0000 7f3f45d6a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.975+0000 7f3f45d6a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40113860 con 0x7f3f40102920 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.975+0000 7f3f3f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.975+0000 7f3f3f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40113320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40710/0 (socket says 172.21.15.88:40710) 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.975+0000 7f3f3f7fe700 1 -- 172.21.15.88:0/2116392269 learned_addr learned my addr 172.21.15.88:0/2116392269 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.975+0000 7f3f3f7fe700 1 -- 172.21.15.88:0/2116392269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f300094f0 con 0x7f3f40102920 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.975+0000 7f3f3f7fe700 1 --2- 172.21.15.88:0/2116392269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40113320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3f30006b00 tx=0x7f3f30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.975+0000 7f3f27fff700 1 -- 172.21.15.88:0/2116392269 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f300109b0 con 0x7f3f40102920 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.976+0000 7f3f27fff700 1 -- 172.21.15.88:0/2116392269 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3f30024440 con 0x7f3f40102920 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.976+0000 7f3f45d6a700 1 -- 172.21.15.88:0/2116392269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f40113a60 con 0x7f3f40102920 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.976+0000 7f3f27fff700 1 -- 172.21.15.88:0/2116392269 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f3001a5f0 con 0x7f3f40102920 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.976+0000 7f3f45d6a700 1 -- 172.21.15.88:0/2116392269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f40113e70 con 0x7f3f40102920 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.976+0000 7f3f27fff700 1 -- 172.21.15.88:0/2116392269 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f3f3001a8b0 con 0x7f3f40102920 2023-12-09T02:28:08.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.976+0000 7f3f45d6a700 1 -- 172.21.15.88:0/2116392269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4004bb80 con 0x7f3f40102920 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.977+0000 7f3f27fff700 1 --2- 172.21.15.88:0/2116392269 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f3f280365a0 0x7f3f28038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.977+0000 7f3f27fff700 1 -- 172.21.15.88:0/2116392269 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3f3004a5a0 con 0x7f3f40102920 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.977+0000 7f3f3effd700 1 --2- 172.21.15.88:0/2116392269 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f3f280365a0 0x7f3f28038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.977+0000 7f3f3effd700 1 --2- 172.21.15.88:0/2116392269 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f3f280365a0 0x7f3f28038a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009990 tx=0x7f3f34006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:04.981+0000 7f3f27fff700 1 -- 172.21.15.88:0/2116392269 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3f3001ab60 con 0x7f3f40102920 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.239+0000 7f3f45d6a700 1 -- 172.21.15.88:0/2116392269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3f4010d160 con 0x7f3f40102920 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.240+0000 7f3f27fff700 1 -- 172.21.15.88:0/2116392269 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f3f30018b40 con 0x7f3f40102920 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.242+0000 7f3f45d6a700 1 -- 172.21.15.88:0/2116392269 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f3f280365a0 msgr2=0x7f3f28038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.242+0000 7f3f45d6a700 1 --2- 172.21.15.88:0/2116392269 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f3f280365a0 0x7f3f28038a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009990 tx=0x7f3f34006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.242+0000 7f3f45d6a700 1 -- 172.21.15.88:0/2116392269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 msgr2=0x7f3f40113320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.242+0000 7f3f45d6a700 1 --2- 172.21.15.88:0/2116392269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40113320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3f30006b00 tx=0x7f3f30009250 comp rx=0 tx=0).stop 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.242+0000 7f3f45d6a700 1 -- 172.21.15.88:0/2116392269 shutdown_connections 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.242+0000 7f3f45d6a700 1 --2- 172.21.15.88:0/2116392269 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f3f280365a0 0x7f3f28038a50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:08.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.242+0000 7f3f45d6a700 1 --2- 172.21.15.88:0/2116392269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f40102920 0x7f3f40113320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:08.075 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.242+0000 7f3f45d6a700 1 -- 172.21.15.88:0/2116392269 >> 172.21.15.88:0/2116392269 conn(0x7f3f400fc0b0 msgr2=0x7f3f400fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:08.075 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.242+0000 7f3f45d6a700 1 -- 172.21.15.88:0/2116392269 shutdown_connections 2023-12-09T02:28:08.075 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:05.242+0000 7f3f45d6a700 1 -- 172.21.15.88:0/2116392269 wait complete. 2023-12-09T02:28:08.075 INFO:teuthology.orchestra.run.smithi088.stdout:mgr is available 2023-12-09T02:28:10.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:09 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/80213430' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-09T02:28:11.675 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:28:11.675 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [global] 2023-12-09T02:28:11.675 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout fsid = 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:28:11.675 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-09T02:28:11.675 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-09T02:28:11.675 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-09T02:28:11.675 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [osd] 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.518+0000 7f2d659a4700 1 Processor -- start 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.518+0000 7f2d659a4700 1 -- start start 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.518+0000 7f2d659a4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d601015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.518+0000 7f2d659a4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60101b20 con 0x7f2d601011d0 2023-12-09T02:28:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.518+0000 7f2d5effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d601015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:11.677 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.518+0000 7f2d5effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d601015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43924/0 (socket says 172.21.15.88:43924) 2023-12-09T02:28:11.677 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.518+0000 7f2d5effd700 1 -- 172.21.15.88:0/364143397 learned_addr learned my addr 172.21.15.88:0/364143397 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:11.677 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.518+0000 7f2d5effd700 1 -- 172.21.15.88:0/364143397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d60101c60 con 0x7f2d601011d0 2023-12-09T02:28:11.677 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.518+0000 7f2d5effd700 1 --2- 172.21.15.88:0/364143397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d601015e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2d500098e0 tx=0x7f2d50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1e6775e3be09e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:11.677 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.518+0000 7f2d5dffb700 1 -- 172.21.15.88:0/364143397 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d5000b860 con 0x7f2d601011d0 2023-12-09T02:28:11.677 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.518+0000 7f2d5dffb700 1 -- 172.21.15.88:0/364143397 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f2d5000be30 con 0x7f2d601011d0 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.519+0000 7f2d5dffb700 1 -- 172.21.15.88:0/364143397 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d50010380 con 0x7f2d601011d0 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.519+0000 7f2d659a4700 1 -- 172.21.15.88:0/364143397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 msgr2=0x7f2d601015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.519+0000 7f2d659a4700 1 --2- 172.21.15.88:0/364143397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d601015e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2d500098e0 tx=0x7f2d50009250 comp rx=0 tx=0).stop 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.519+0000 7f2d659a4700 1 -- 172.21.15.88:0/364143397 shutdown_connections 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.519+0000 7f2d659a4700 1 --2- 172.21.15.88:0/364143397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d601015e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.519+0000 7f2d659a4700 1 -- 172.21.15.88:0/364143397 >> 172.21.15.88:0/364143397 conn(0x7f2d600fc950 msgr2=0x7f2d600fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.519+0000 7f2d659a4700 1 -- 172.21.15.88:0/364143397 shutdown_connections 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.519+0000 7f2d659a4700 1 -- 172.21.15.88:0/364143397 wait complete. 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.520+0000 7f2d659a4700 1 Processor -- start 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.520+0000 7f2d659a4700 1 -- start start 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.520+0000 7f2d659a4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d60110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:11.678 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.520+0000 7f2d659a4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60110580 con 0x7f2d601011d0 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.520+0000 7f2d5effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d60110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.520+0000 7f2d5effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d60110040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43930/0 (socket says 172.21.15.88:43930) 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.520+0000 7f2d5effd700 1 -- 172.21.15.88:0/80213430 learned_addr learned my addr 172.21.15.88:0/80213430 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.521+0000 7f2d5effd700 1 -- 172.21.15.88:0/80213430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500094f0 con 0x7f2d601011d0 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.521+0000 7f2d5effd700 1 --2- 172.21.15.88:0/80213430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d60110040 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2d50000c00 tx=0x7f2d50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.521+0000 7f2d577fe700 1 -- 172.21.15.88:0/80213430 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d50010a80 con 0x7f2d601011d0 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.521+0000 7f2d577fe700 1 -- 172.21.15.88:0/80213430 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f2d5001a430 con 0x7f2d601011d0 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.521+0000 7f2d659a4700 1 -- 172.21.15.88:0/80213430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d60110780 con 0x7f2d601011d0 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.521+0000 7f2d577fe700 1 -- 172.21.15.88:0/80213430 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d500245b0 con 0x7f2d601011d0 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.521+0000 7f2d659a4700 1 -- 172.21.15.88:0/80213430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d60110b90 con 0x7f2d601011d0 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.522+0000 7f2d577fe700 1 -- 172.21.15.88:0/80213430 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f2d500247a0 con 0x7f2d601011d0 2023-12-09T02:28:11.679 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.522+0000 7f2d577fe700 1 --2- 172.21.15.88:0/80213430 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f2d4c0365f0 0x7f2d4c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.522+0000 7f2d577fe700 1 -- 172.21.15.88:0/80213430 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2d5004aa90 con 0x7f2d601011d0 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.522+0000 7f2d5e7fc700 1 --2- 172.21.15.88:0/80213430 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f2d4c0365f0 0x7f2d4c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.522+0000 7f2d659a4700 1 -- 172.21.15.88:0/80213430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6004bb80 con 0x7f2d601011d0 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.522+0000 7f2d5e7fc700 1 --2- 172.21.15.88:0/80213430 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f2d4c0365f0 0x7f2d4c038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009990 tx=0x7f2d48006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.527+0000 7f2d577fe700 1 -- 172.21.15.88:0/80213430 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2d50023df0 con 0x7f2d601011d0 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.709+0000 7f2d659a4700 1 -- 172.21.15.88:0/80213430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f2d60102fe0 con 0x7f2d601011d0 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.711+0000 7f2d577fe700 1 -- 172.21.15.88:0/80213430 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f2d50048020 con 0x7f2d601011d0 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.712+0000 7f2d659a4700 1 -- 172.21.15.88:0/80213430 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f2d4c0365f0 msgr2=0x7f2d4c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.712+0000 7f2d659a4700 1 --2- 172.21.15.88:0/80213430 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f2d4c0365f0 0x7f2d4c038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009990 tx=0x7f2d48006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.712+0000 7f2d659a4700 1 -- 172.21.15.88:0/80213430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 msgr2=0x7f2d60110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.712+0000 7f2d659a4700 1 --2- 172.21.15.88:0/80213430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d60110040 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2d50000c00 tx=0x7f2d50009250 comp rx=0 tx=0).stop 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.712+0000 7f2d659a4700 1 -- 172.21.15.88:0/80213430 shutdown_connections 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.712+0000 7f2d659a4700 1 --2- 172.21.15.88:0/80213430 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f2d4c0365f0 0x7f2d4c038aa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.712+0000 7f2d659a4700 1 --2- 172.21.15.88:0/80213430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d601011d0 0x7f2d60110040 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:11.681 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.712+0000 7f2d659a4700 1 -- 172.21.15.88:0/80213430 >> 172.21.15.88:0/80213430 conn(0x7f2d600fc950 msgr2=0x7f2d600fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:11.681 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.712+0000 7f2d659a4700 1 -- 172.21.15.88:0/80213430 shutdown_connections 2023-12-09T02:28:11.681 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:09.712+0000 7f2d659a4700 1 -- 172.21.15.88:0/80213430 wait complete. 2023-12-09T02:28:11.681 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling cephadm module... 2023-12-09T02:28:13.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:12 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3130589766' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-09T02:28:13.293 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.636+0000 7f666eccf700 1 Processor -- start 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.636+0000 7f666eccf700 1 -- start start 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.636+0000 7f666eccf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.636+0000 7f666eccf700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6668105420 con 0x7f6668070fc0 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.636+0000 7f666ca6b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.636+0000 7f666ca6b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43942/0 (socket says 172.21.15.88:43942) 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.636+0000 7f666ca6b700 1 -- 172.21.15.88:0/2901630353 learned_addr learned my addr 172.21.15.88:0/2901630353 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.637+0000 7f666ca6b700 1 -- 172.21.15.88:0/2901630353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668105560 con 0x7f6668070fc0 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.637+0000 7f666ca6b700 1 --2- 172.21.15.88:0/2901630353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668104ee0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f665c0098e0 tx=0x7f665c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c10edae26b1ecd server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.637+0000 7f66677fe700 1 -- 172.21.15.88:0/2901630353 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f665c00b860 con 0x7f6668070fc0 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.637+0000 7f66677fe700 1 -- 172.21.15.88:0/2901630353 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f665c00be30 con 0x7f6668070fc0 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.637+0000 7f66677fe700 1 -- 172.21.15.88:0/2901630353 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f665c010380 con 0x7f6668070fc0 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.637+0000 7f666eccf700 1 -- 172.21.15.88:0/2901630353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 msgr2=0x7f6668104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:13.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.637+0000 7f666eccf700 1 --2- 172.21.15.88:0/2901630353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668104ee0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f665c0098e0 tx=0x7f665c009250 comp rx=0 tx=0).stop 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.637+0000 7f666eccf700 1 -- 172.21.15.88:0/2901630353 shutdown_connections 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.637+0000 7f666eccf700 1 --2- 172.21.15.88:0/2901630353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668104ee0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.637+0000 7f666eccf700 1 -- 172.21.15.88:0/2901630353 >> 172.21.15.88:0/2901630353 conn(0x7f66680fc970 msgr2=0x7f66680fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.638+0000 7f666eccf700 1 -- 172.21.15.88:0/2901630353 shutdown_connections 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.638+0000 7f666eccf700 1 -- 172.21.15.88:0/2901630353 wait complete. 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.638+0000 7f666eccf700 1 Processor -- start 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.638+0000 7f666eccf700 1 -- start start 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.638+0000 7f666eccf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.638+0000 7f666eccf700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66681116c0 con 0x7f6668070fc0 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.639+0000 7f666ca6b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.639+0000 7f666ca6b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43954/0 (socket says 172.21.15.88:43954) 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.639+0000 7f666ca6b700 1 -- 172.21.15.88:0/3130589766 learned_addr learned my addr 172.21.15.88:0/3130589766 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.639+0000 7f666ca6b700 1 -- 172.21.15.88:0/3130589766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c0094f0 con 0x7f6668070fc0 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.639+0000 7f666ca6b700 1 --2- 172.21.15.88:0/3130589766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668111180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f665c006d40 tx=0x7f665c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.639+0000 7f66657fa700 1 -- 172.21.15.88:0/3130589766 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f665c0109b0 con 0x7f6668070fc0 2023-12-09T02:28:13.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.639+0000 7f66657fa700 1 -- 172.21.15.88:0/3130589766 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f665c024440 con 0x7f6668070fc0 2023-12-09T02:28:13.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.639+0000 7f666eccf700 1 -- 172.21.15.88:0/3130589766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66681118c0 con 0x7f6668070fc0 2023-12-09T02:28:13.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.639+0000 7f66657fa700 1 -- 172.21.15.88:0/3130589766 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f665c01a5f0 con 0x7f6668070fc0 2023-12-09T02:28:13.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.639+0000 7f666eccf700 1 -- 172.21.15.88:0/3130589766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6668111cd0 con 0x7f6668070fc0 2023-12-09T02:28:13.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.640+0000 7f66657fa700 1 -- 172.21.15.88:0/3130589766 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f665c01a870 con 0x7f6668070fc0 2023-12-09T02:28:13.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.640+0000 7f66657fa700 1 --2- 172.21.15.88:0/3130589766 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f66580365a0 0x7f6658038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:13.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.640+0000 7f66657fa700 1 -- 172.21.15.88:0/3130589766 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f665c04a510 con 0x7f6668070fc0 2023-12-09T02:28:13.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.640+0000 7f666eccf700 1 -- 172.21.15.88:0/3130589766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666804bb80 con 0x7f6668070fc0 2023-12-09T02:28:13.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.640+0000 7f6667fff700 1 --2- 172.21.15.88:0/3130589766 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f66580365a0 0x7f6658038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:13.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.640+0000 7f6667fff700 1 --2- 172.21.15.88:0/3130589766 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f66580365a0 0x7f6658038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6654009990 tx=0x7f6654006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:13.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.645+0000 7f66657fa700 1 -- 172.21.15.88:0/3130589766 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f665c018db0 con 0x7f6668070fc0 2023-12-09T02:28:13.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.878+0000 7f666eccf700 1 -- 172.21.15.88:0/3130589766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f666810afa0 con 0x7f6668070fc0 2023-12-09T02:28:13.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.930+0000 7f66657fa700 1 -- 172.21.15.88:0/3130589766 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f665c024970 con 0x7f6668070fc0 2023-12-09T02:28:13.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.932+0000 7f66657fa700 1 -- 172.21.15.88:0/3130589766 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f665c023810 con 0x7f6668070fc0 2023-12-09T02:28:13.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.934+0000 7f666eccf700 1 -- 172.21.15.88:0/3130589766 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f66580365a0 msgr2=0x7f6658038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:13.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.934+0000 7f666eccf700 1 --2- 172.21.15.88:0/3130589766 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f66580365a0 0x7f6658038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6654009990 tx=0x7f6654006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:13.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.934+0000 7f666eccf700 1 -- 172.21.15.88:0/3130589766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 msgr2=0x7f6668111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:13.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.934+0000 7f666eccf700 1 --2- 172.21.15.88:0/3130589766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668111180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f665c006d40 tx=0x7f665c009250 comp rx=0 tx=0).stop 2023-12-09T02:28:13.298 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.934+0000 7f666eccf700 1 -- 172.21.15.88:0/3130589766 shutdown_connections 2023-12-09T02:28:13.298 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.934+0000 7f666eccf700 1 --2- 172.21.15.88:0/3130589766 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7f66580365a0 0x7f6658038a50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:13.298 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.934+0000 7f666eccf700 1 --2- 172.21.15.88:0/3130589766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668070fc0 0x7f6668111180 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:13.298 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.934+0000 7f666eccf700 1 -- 172.21.15.88:0/3130589766 >> 172.21.15.88:0/3130589766 conn(0x7f66680fc970 msgr2=0x7f66680fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:13.298 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.934+0000 7f666eccf700 1 -- 172.21.15.88:0/3130589766 shutdown_connections 2023-12-09T02:28:13.298 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:12.934+0000 7f666eccf700 1 -- 172.21.15.88:0/3130589766 wait complete. 2023-12-09T02:28:14.214 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:13 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3130589766' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-09T02:28:14.215 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:13 smithi088 ceph-mon[112028]: mgrmap e5: smithi088.jwlofb(active, since 11s) 2023-12-09T02:28:14.215 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:13 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3503110719' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "active_name": "smithi088.jwlofb", 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.645+0000 7fcd9aad6700 1 Processor -- start 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.645+0000 7fcd9aad6700 1 -- start start 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.645+0000 7fcd9aad6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94104f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.645+0000 7fcd9aad6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd941054c0 con 0x7fcd94070f20 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.645+0000 7fcd98872700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.645+0000 7fcd98872700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94104f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43990/0 (socket says 172.21.15.88:43990) 2023-12-09T02:28:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.645+0000 7fcd98872700 1 -- 172.21.15.88:0/397340436 learned_addr learned my addr 172.21.15.88:0/397340436 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.645+0000 7fcd98872700 1 -- 172.21.15.88:0/397340436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94105600 con 0x7fcd94070f20 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.645+0000 7fcd98872700 1 --2- 172.21.15.88:0/397340436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94104f80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd880098e0 tx=0x7fcd88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b7dbd2e4a4dccd server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.646+0000 7fcd937fe700 1 -- 172.21.15.88:0/397340436 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd8800b860 con 0x7fcd94070f20 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.646+0000 7fcd937fe700 1 -- 172.21.15.88:0/397340436 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fcd8800be30 con 0x7fcd94070f20 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.646+0000 7fcd937fe700 1 -- 172.21.15.88:0/397340436 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd88010380 con 0x7fcd94070f20 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.646+0000 7fcd9aad6700 1 -- 172.21.15.88:0/397340436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 msgr2=0x7fcd94104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.646+0000 7fcd9aad6700 1 --2- 172.21.15.88:0/397340436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94104f80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd880098e0 tx=0x7fcd88009250 comp rx=0 tx=0).stop 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.646+0000 7fcd9aad6700 1 -- 172.21.15.88:0/397340436 shutdown_connections 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.646+0000 7fcd9aad6700 1 --2- 172.21.15.88:0/397340436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94104f80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.646+0000 7fcd9aad6700 1 -- 172.21.15.88:0/397340436 >> 172.21.15.88:0/397340436 conn(0x7fcd940fc970 msgr2=0x7fcd940fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.646+0000 7fcd9aad6700 1 -- 172.21.15.88:0/397340436 shutdown_connections 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.646+0000 7fcd9aad6700 1 -- 172.21.15.88:0/397340436 wait complete. 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.647+0000 7fcd9aad6700 1 Processor -- start 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.647+0000 7fcd9aad6700 1 -- start start 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.647+0000 7fcd9aad6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.647+0000 7fcd9aad6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd941116a0 con 0x7fcd94070f20 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.647+0000 7fcd98872700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.647+0000 7fcd98872700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43998/0 (socket says 172.21.15.88:43998) 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.647+0000 7fcd98872700 1 -- 172.21.15.88:0/3503110719 learned_addr learned my addr 172.21.15.88:0/3503110719 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.648+0000 7fcd98872700 1 -- 172.21.15.88:0/3503110719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd880094f0 con 0x7fcd94070f20 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.648+0000 7fcd98872700 1 --2- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94111160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006d40 tx=0x7fcd88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.648+0000 7fcd917fa700 1 -- 172.21.15.88:0/3503110719 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd880109b0 con 0x7fcd94070f20 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.648+0000 7fcd917fa700 1 -- 172.21.15.88:0/3503110719 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fcd88024440 con 0x7fcd94070f20 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.648+0000 7fcd9aad6700 1 -- 172.21.15.88:0/3503110719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd941118a0 con 0x7fcd94070f20 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.648+0000 7fcd9aad6700 1 -- 172.21.15.88:0/3503110719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd94111cb0 con 0x7fcd94070f20 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.648+0000 7fcd917fa700 1 -- 172.21.15.88:0/3503110719 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd8801a5f0 con 0x7fcd94070f20 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.649+0000 7fcd917fa700 1 -- 172.21.15.88:0/3503110719 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fcd8801a870 con 0x7fcd94070f20 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.649+0000 7fcd917fa700 1 --2- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fcd840365f0 0x7fcd84038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.649+0000 7fcd7effd700 1 -- 172.21.15.88:0/3503110719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd740052b0 con 0x7fcd94070f20 2023-12-09T02:28:14.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.649+0000 7fcd93fff700 1 -- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fcd840365f0 msgr2=0x7fcd84038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/3992950126 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.649+0000 7fcd917fa700 1 -- 172.21.15.88:0/3503110719 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcd8804b5d0 con 0x7fcd94070f20 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.649+0000 7fcd93fff700 1 --2- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fcd840365f0 0x7fcd84038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.654+0000 7fcd917fa700 1 -- 172.21.15.88:0/3503110719 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcd88018d90 con 0x7fcd94070f20 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.850+0000 7fcd93fff700 1 -- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fcd840365f0 msgr2=0x7fcd84038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/3992950126 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.850+0000 7fcd93fff700 1 --2- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fcd840365f0 0x7fcd84038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.891+0000 7fcd7effd700 1 -- 172.21.15.88:0/3503110719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fcd74005d70 con 0x7fcd94070f20 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.891+0000 7fcd917fa700 1 -- 172.21.15.88:0/3503110719 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fcd88018350 con 0x7fcd94070f20 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.894+0000 7fcd7effd700 1 -- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fcd840365f0 msgr2=0x7fcd84038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.894+0000 7fcd7effd700 1 --2- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fcd840365f0 0x7fcd84038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.894+0000 7fcd7effd700 1 -- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 msgr2=0x7fcd94111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.894+0000 7fcd7effd700 1 --2- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94111160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006d40 tx=0x7fcd88009250 comp rx=0 tx=0).stop 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.894+0000 7fcd7effd700 1 -- 172.21.15.88:0/3503110719 shutdown_connections 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.894+0000 7fcd7effd700 1 --2- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fcd840365f0 0x7fcd84038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.894+0000 7fcd7effd700 1 --2- 172.21.15.88:0/3503110719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd94070f20 0x7fcd94111160 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.894+0000 7fcd7effd700 1 -- 172.21.15.88:0/3503110719 >> 172.21.15.88:0/3503110719 conn(0x7fcd940fc970 msgr2=0x7fcd940fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:14.272 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.894+0000 7fcd7effd700 1 -- 172.21.15.88:0/3503110719 shutdown_connections 2023-12-09T02:28:14.272 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:13.894+0000 7fcd7effd700 1 -- 172.21.15.88:0/3503110719 wait complete. 2023-12-09T02:28:14.272 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for the mgr to restart... 2023-12-09T02:28:14.272 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr epoch 5... 2023-12-09T02:28:19.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: Active manager daemon smithi088.jwlofb restarted 2023-12-09T02:28:19.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: Activating manager daemon smithi088.jwlofb 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: osdmap e2: 0 total, 0 up, 0 in 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: mgrmap e6: smithi088.jwlofb(active, starting, since 0.00306356s) 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi088.jwlofb", "id": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: Manager daemon smithi088.jwlofb is now available 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:28:19.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:19 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/trash_purge_schedule"}]: dispatch 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.663+0000 7fd9face8700 1 Processor -- start 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.663+0000 7fd9face8700 1 -- start start 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.663+0000 7fd9face8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.663+0000 7fd9face8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41053e0 con 0x7fd9f4071000 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.663+0000 7fd9f8a84700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.663+0000 7fd9f8a84700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44014/0 (socket says 172.21.15.88:44014) 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.663+0000 7fd9f8a84700 1 -- 172.21.15.88:0/2723790865 learned_addr learned my addr 172.21.15.88:0/2723790865 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.663+0000 7fd9f8a84700 1 -- 172.21.15.88:0/2723790865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4105520 con 0x7fd9f4071000 2023-12-09T02:28:20.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.663+0000 7fd9f8a84700 1 --2- 172.21.15.88:0/2723790865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4104ea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80098e0 tx=0x7fd9e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d878eaac754718 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.664+0000 7fd9f37fe700 1 -- 172.21.15.88:0/2723790865 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9e800b860 con 0x7fd9f4071000 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.664+0000 7fd9f37fe700 1 -- 172.21.15.88:0/2723790865 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd9e800be30 con 0x7fd9f4071000 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.664+0000 7fd9f37fe700 1 -- 172.21.15.88:0/2723790865 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9e8010380 con 0x7fd9f4071000 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.664+0000 7fd9face8700 1 -- 172.21.15.88:0/2723790865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 msgr2=0x7fd9f4104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.664+0000 7fd9face8700 1 --2- 172.21.15.88:0/2723790865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4104ea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80098e0 tx=0x7fd9e8009250 comp rx=0 tx=0).stop 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.664+0000 7fd9face8700 1 -- 172.21.15.88:0/2723790865 shutdown_connections 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.664+0000 7fd9face8700 1 --2- 172.21.15.88:0/2723790865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4104ea0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.664+0000 7fd9face8700 1 -- 172.21.15.88:0/2723790865 >> 172.21.15.88:0/2723790865 conn(0x7fd9f40fc970 msgr2=0x7fd9f40fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.664+0000 7fd9face8700 1 -- 172.21.15.88:0/2723790865 shutdown_connections 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.664+0000 7fd9face8700 1 -- 172.21.15.88:0/2723790865 wait complete. 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.665+0000 7fd9face8700 1 Processor -- start 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.665+0000 7fd9face8700 1 -- start start 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.665+0000 7fd9face8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:20.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.665+0000 7fd9face8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41116a0 con 0x7fd9f4071000 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.665+0000 7fd9f8a84700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.665+0000 7fd9f8a84700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44016/0 (socket says 172.21.15.88:44016) 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.665+0000 7fd9f8a84700 1 -- 172.21.15.88:0/1827457049 learned_addr learned my addr 172.21.15.88:0/1827457049 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.666+0000 7fd9f8a84700 1 -- 172.21.15.88:0/1827457049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e80094f0 con 0x7fd9f4071000 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.666+0000 7fd9f8a84700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4111160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8006b00 tx=0x7fd9e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.666+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9e8010a80 con 0x7fd9f4071000 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.666+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd9e801a430 con 0x7fd9f4071000 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.666+0000 7fd9face8700 1 -- 172.21.15.88:0/1827457049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f41118a0 con 0x7fd9f4071000 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.666+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9e80245b0 con 0x7fd9f4071000 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.666+0000 7fd9face8700 1 -- 172.21.15.88:0/1827457049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f4111cb0 con 0x7fd9f4071000 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.667+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd9e801a9a0 con 0x7fd9f4071000 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.667+0000 7fd9f17fa700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 0x7fd9e4038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.667+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 --> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9e40391b0 con 0x7fd9e40365f0 2023-12-09T02:28:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.667+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd9e804aa40 con 0x7fd9f4071000 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.667+0000 7fd9f3fff700 1 -- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 msgr2=0x7fd9e4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/3992950126 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.667+0000 7fd9f3fff700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 0x7fd9e4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.868+0000 7fd9f3fff700 1 -- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 msgr2=0x7fd9e4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/3992950126 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:14.868+0000 7fd9f3fff700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 0x7fd9e4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:15.269+0000 7fd9f3fff700 1 -- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 msgr2=0x7fd9e4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/3992950126 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:15.269+0000 7fd9f3fff700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 0x7fd9e4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:16.070+0000 7fd9f3fff700 1 -- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 msgr2=0x7fd9e4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/3992950126 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:16.070+0000 7fd9f3fff700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 0x7fd9e4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:17.671+0000 7fd9f3fff700 1 -- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 msgr2=0x7fd9e4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/3992950126 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:17.671+0000 7fd9f3fff700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 0x7fd9e4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:19.327+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7fd9e8010be0 con 0x7fd9f4071000 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:19.328+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 msgr2=0x7fd9e4038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:19.328+0000 7fd9f17fa700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 0x7fd9e4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.327+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fd9e804c340 con 0x7fd9f4071000 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.328+0000 7fd9f17fa700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fd9e4039f60 0x7fd9e403c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:20.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.328+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9e40391b0 con 0x7fd9e4039f60 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.328+0000 7fd9f3fff700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fd9e4039f60 0x7fd9e403c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.329+0000 7fd9f3fff700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fd9e4039f60 0x7fd9e403c340 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00039d0 tx=0x7fd9e0009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.329+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fd9e40391b0 con 0x7fd9e4039f60 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.335+0000 7fd9face8700 1 -- 172.21.15.88:0/1827457049 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd9f404bb80 con 0x7fd9e4039f60 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.335+0000 7fd9f17fa700 1 -- 172.21.15.88:0/1827457049 <== mgr.14120 v2:172.21.15.88:6800/2611357961 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd9f404bb80 con 0x7fd9e4039f60 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.336+0000 7fd9face8700 1 -- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fd9e4039f60 msgr2=0x7fd9e403c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.336+0000 7fd9face8700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fd9e4039f60 0x7fd9e403c340 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00039d0 tx=0x7fd9e0009350 comp rx=0 tx=0).stop 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.336+0000 7fd9face8700 1 -- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 msgr2=0x7fd9f4111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.336+0000 7fd9face8700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4111160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8006b00 tx=0x7fd9e8009250 comp rx=0 tx=0).stop 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.336+0000 7fd9face8700 1 -- 172.21.15.88:0/1827457049 shutdown_connections 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.336+0000 7fd9face8700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fd9e4039f60 0x7fd9e403c340 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.336+0000 7fd9face8700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f4071000 0x7fd9f4111160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.336+0000 7fd9face8700 1 --2- 172.21.15.88:0/1827457049 >> [v2:172.21.15.88:6800/3992950126,v1:172.21.15.88:6801/3992950126] conn(0x7fd9e40365f0 0x7fd9e4038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.336+0000 7fd9face8700 1 -- 172.21.15.88:0/1827457049 >> 172.21.15.88:0/1827457049 conn(0x7fd9f40fc970 msgr2=0x7fd9f40fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:20.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.336+0000 7fd9face8700 1 -- 172.21.15.88:0/1827457049 shutdown_connections 2023-12-09T02:28:20.645 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:20.336+0000 7fd9face8700 1 -- 172.21.15.88:0/1827457049 wait complete. 2023-12-09T02:28:20.645 INFO:teuthology.orchestra.run.smithi088.stdout:mgr epoch 5 is available 2023-12-09T02:28:20.645 INFO:teuthology.orchestra.run.smithi088.stdout:Setting orchestrator backend to cephadm... 2023-12-09T02:28:20.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:20 smithi088 ceph-mon[112028]: Found migration_current of "None". Setting to last migration. 2023-12-09T02:28:20.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:20 smithi088 ceph-mon[112028]: mgrmap e7: smithi088.jwlofb(active, since 1.005s) 2023-12-09T02:28:21.575 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.002+0000 7fa07d519700 1 Processor -- start 2023-12-09T02:28:21.575 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.003+0000 7fa07d519700 1 -- start start 2023-12-09T02:28:21.575 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.003+0000 7fa07d519700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa0781026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:21.576 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.003+0000 7fa07d519700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa078102c00 con 0x7fa0781022b0 2023-12-09T02:28:21.576 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.003+0000 7fa076ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa0781026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:21.576 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.003+0000 7fa076ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa0781026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40236/0 (socket says 172.21.15.88:40236) 2023-12-09T02:28:21.576 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.003+0000 7fa076ffd700 1 -- 172.21.15.88:0/1414313349 learned_addr learned my addr 172.21.15.88:0/1414313349 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:21.576 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.003+0000 7fa076ffd700 1 -- 172.21.15.88:0/1414313349 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078102d40 con 0x7fa0781022b0 2023-12-09T02:28:21.576 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.003+0000 7fa076ffd700 1 --2- 172.21.15.88:0/1414313349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa0781026c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0680098e0 tx=0x7fa068009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b5106bb7c0695a server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:21.576 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.004+0000 7fa075ffb700 1 -- 172.21.15.88:0/1414313349 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa06800b860 con 0x7fa0781022b0 2023-12-09T02:28:21.576 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.004+0000 7fa075ffb700 1 -- 172.21.15.88:0/1414313349 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa06800be30 con 0x7fa0781022b0 2023-12-09T02:28:21.576 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.004+0000 7fa075ffb700 1 -- 172.21.15.88:0/1414313349 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa068010380 con 0x7fa0781022b0 2023-12-09T02:28:21.576 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.004+0000 7fa07d519700 1 -- 172.21.15.88:0/1414313349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 msgr2=0x7fa0781026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:21.576 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.004+0000 7fa07d519700 1 --2- 172.21.15.88:0/1414313349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa0781026c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0680098e0 tx=0x7fa068009250 comp rx=0 tx=0).stop 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.004+0000 7fa07d519700 1 -- 172.21.15.88:0/1414313349 shutdown_connections 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.004+0000 7fa07d519700 1 --2- 172.21.15.88:0/1414313349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa0781026c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.004+0000 7fa07d519700 1 -- 172.21.15.88:0/1414313349 >> 172.21.15.88:0/1414313349 conn(0x7fa0780fda10 msgr2=0x7fa0780ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.004+0000 7fa07d519700 1 -- 172.21.15.88:0/1414313349 shutdown_connections 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.004+0000 7fa07d519700 1 -- 172.21.15.88:0/1414313349 wait complete. 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.005+0000 7fa07d519700 1 Processor -- start 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.005+0000 7fa07d519700 1 -- start start 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.005+0000 7fa07d519700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa078078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.005+0000 7fa07d519700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa078077190 con 0x7fa0781022b0 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.005+0000 7fa076ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa078078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.005+0000 7fa076ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa078078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40242/0 (socket says 172.21.15.88:40242) 2023-12-09T02:28:21.577 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.005+0000 7fa076ffd700 1 -- 172.21.15.88:0/2260253350 learned_addr learned my addr 172.21.15.88:0/2260253350 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:21.578 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.006+0000 7fa076ffd700 1 -- 172.21.15.88:0/2260253350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0680094f0 con 0x7fa0781022b0 2023-12-09T02:28:21.578 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.006+0000 7fa076ffd700 1 --2- 172.21.15.88:0/2260253350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa078078d10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa068000c00 tx=0x7fa068009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:21.578 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.006+0000 7fa05f7fe700 1 -- 172.21.15.88:0/2260253350 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa068010a80 con 0x7fa0781022b0 2023-12-09T02:28:21.578 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.006+0000 7fa05f7fe700 1 -- 172.21.15.88:0/2260253350 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa06801a430 con 0x7fa0781022b0 2023-12-09T02:28:21.578 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.006+0000 7fa07d519700 1 -- 172.21.15.88:0/2260253350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa078077390 con 0x7fa0781022b0 2023-12-09T02:28:21.578 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.006+0000 7fa05f7fe700 1 -- 172.21.15.88:0/2260253350 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0680245b0 con 0x7fa0781022b0 2023-12-09T02:28:21.578 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.006+0000 7fa07d519700 1 -- 172.21.15.88:0/2260253350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0780777a0 con 0x7fa0781022b0 2023-12-09T02:28:21.578 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.007+0000 7fa05f7fe700 1 -- 172.21.15.88:0/2260253350 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fa0680247f0 con 0x7fa0781022b0 2023-12-09T02:28:21.578 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.007+0000 7fa05f7fe700 1 --2- 172.21.15.88:0/2260253350 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fa0600364c0 0x7fa060038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:21.578 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.007+0000 7fa05f7fe700 1 -- 172.21.15.88:0/2260253350 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa06804b9c0 con 0x7fa0781022b0 2023-12-09T02:28:21.579 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.007+0000 7fa0767fc700 1 --2- 172.21.15.88:0/2260253350 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fa0600364c0 0x7fa060038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:21.579 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.007+0000 7fa07d519700 1 -- 172.21.15.88:0/2260253350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07804bb80 con 0x7fa0781022b0 2023-12-09T02:28:21.579 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.007+0000 7fa0767fc700 1 --2- 172.21.15.88:0/2260253350 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fa0600364c0 0x7fa060038970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009990 tx=0x7fa06c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:21.579 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.012+0000 7fa05f7fe700 1 -- 172.21.15.88:0/2260253350 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa068018350 con 0x7fa0781022b0 2023-12-09T02:28:21.579 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.207+0000 7fa07d519700 1 -- 172.21.15.88:0/2260253350 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fa07810ac90 con 0x7fa0600364c0 2023-12-09T02:28:21.579 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.212+0000 7fa05f7fe700 1 -- 172.21.15.88:0/2260253350 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa07810ac90 con 0x7fa0600364c0 2023-12-09T02:28:21.579 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.214+0000 7fa07d519700 1 -- 172.21.15.88:0/2260253350 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fa0600364c0 msgr2=0x7fa060038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:21.579 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.214+0000 7fa07d519700 1 --2- 172.21.15.88:0/2260253350 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fa0600364c0 0x7fa060038970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009990 tx=0x7fa06c006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:21.579 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.214+0000 7fa07d519700 1 -- 172.21.15.88:0/2260253350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 msgr2=0x7fa078078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:21.580 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.214+0000 7fa07d519700 1 --2- 172.21.15.88:0/2260253350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa078078d10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa068000c00 tx=0x7fa068009250 comp rx=0 tx=0).stop 2023-12-09T02:28:21.580 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.214+0000 7fa07d519700 1 -- 172.21.15.88:0/2260253350 shutdown_connections 2023-12-09T02:28:21.580 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.214+0000 7fa07d519700 1 --2- 172.21.15.88:0/2260253350 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fa0600364c0 0x7fa060038970 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:21.580 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.214+0000 7fa07d519700 1 --2- 172.21.15.88:0/2260253350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0781022b0 0x7fa078078d10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:21.580 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.214+0000 7fa07d519700 1 -- 172.21.15.88:0/2260253350 >> 172.21.15.88:0/2260253350 conn(0x7fa0780fda10 msgr2=0x7fa0780ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:21.580 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.214+0000 7fa07d519700 1 -- 172.21.15.88:0/2260253350 shutdown_connections 2023-12-09T02:28:21.580 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.215+0000 7fa07d519700 1 -- 172.21.15.88:0/2260253350 wait complete. 2023-12-09T02:28:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:21 smithi088 ceph-mon[112028]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-09T02:28:21.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:21 smithi088 ceph-mon[112028]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-09T02:28:21.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:21 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:21.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:21 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:28:21.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:21 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:21.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:21 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:28:22.491 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-09T02:28:22.491 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.939+0000 7f6decd6b700 1 Processor -- start 2023-12-09T02:28:22.491 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.939+0000 7f6decd6b700 1 -- start start 2023-12-09T02:28:22.491 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.939+0000 7f6decd6b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.939+0000 7f6decd6b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8101b10 con 0x7f6de81011c0 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.939+0000 7f6de659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.939+0000 7f6de659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40248/0 (socket says 172.21.15.88:40248) 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.939+0000 7f6de659c700 1 -- 172.21.15.88:0/1324600701 learned_addr learned my addr 172.21.15.88:0/1324600701 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.939+0000 7f6de659c700 1 -- 172.21.15.88:0/1324600701 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8101c50 con 0x7f6de81011c0 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.940+0000 7f6de659c700 1 --2- 172.21.15.88:0/1324600701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81015d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00bb80 tx=0x7f6ddc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5abb6d06232514f server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.940+0000 7f6de559a700 1 -- 172.21.15.88:0/1324600701 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ddc00dd00 con 0x7f6de81011c0 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.940+0000 7f6de559a700 1 -- 172.21.15.88:0/1324600701 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6ddc00de60 con 0x7f6de81011c0 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.940+0000 7f6de559a700 1 -- 172.21.15.88:0/1324600701 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ddc018840 con 0x7f6de81011c0 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.940+0000 7f6decd6b700 1 -- 172.21.15.88:0/1324600701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 msgr2=0x7f6de81015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.940+0000 7f6decd6b700 1 --2- 172.21.15.88:0/1324600701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81015d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00bb80 tx=0x7f6ddc00b4f0 comp rx=0 tx=0).stop 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.940+0000 7f6decd6b700 1 -- 172.21.15.88:0/1324600701 shutdown_connections 2023-12-09T02:28:22.492 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.940+0000 7f6decd6b700 1 --2- 172.21.15.88:0/1324600701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81015d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.940+0000 7f6decd6b700 1 -- 172.21.15.88:0/1324600701 >> 172.21.15.88:0/1324600701 conn(0x7f6de80fc980 msgr2=0x7f6de80fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.940+0000 7f6decd6b700 1 -- 172.21.15.88:0/1324600701 shutdown_connections 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.940+0000 7f6decd6b700 1 -- 172.21.15.88:0/1324600701 wait complete. 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.941+0000 7f6decd6b700 1 Processor -- start 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.941+0000 7f6decd6b700 1 -- start start 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.941+0000 7f6decd6b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81132c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.941+0000 7f6decd6b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8113800 con 0x7f6de81011c0 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.941+0000 7f6de659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.941+0000 7f6de659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40250/0 (socket says 172.21.15.88:40250) 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.941+0000 7f6de659c700 1 -- 172.21.15.88:0/3561438362 learned_addr learned my addr 172.21.15.88:0/3561438362 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.941+0000 7f6de659c700 1 -- 172.21.15.88:0/3561438362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc00b790 con 0x7f6de81011c0 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.941+0000 7f6de659c700 1 --2- 172.21.15.88:0/3561438362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81132c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc006d20 tx=0x7f6ddc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.942+0000 7f6dd6ffd700 1 -- 172.21.15.88:0/3561438362 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ddc010920 con 0x7f6de81011c0 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.942+0000 7f6dd6ffd700 1 -- 172.21.15.88:0/3561438362 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6ddc010a80 con 0x7f6de81011c0 2023-12-09T02:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.942+0000 7f6dd6ffd700 1 -- 172.21.15.88:0/3561438362 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ddc021550 con 0x7f6de81011c0 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.942+0000 7f6decd6b700 1 -- 172.21.15.88:0/3561438362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de8113a00 con 0x7f6de81011c0 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.942+0000 7f6decd6b700 1 -- 172.21.15.88:0/3561438362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de8113e10 con 0x7f6de81011c0 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.942+0000 7f6dd6ffd700 1 -- 172.21.15.88:0/3561438362 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f6ddc0223f0 con 0x7f6de81011c0 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.943+0000 7f6decd6b700 1 -- 172.21.15.88:0/3561438362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de804bb80 con 0x7f6de81011c0 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.943+0000 7f6dd6ffd700 1 --2- 172.21.15.88:0/3561438362 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dd0036510 0x7f6dd00389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.943+0000 7f6dd6ffd700 1 -- 172.21.15.88:0/3561438362 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6ddc014070 con 0x7f6de81011c0 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.943+0000 7f6de5d9b700 1 --2- 172.21.15.88:0/3561438362 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dd0036510 0x7f6dd00389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.943+0000 7f6de5d9b700 1 --2- 172.21.15.88:0/3561438362 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dd0036510 0x7f6dd00389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009990 tx=0x7f6dd8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:21.947+0000 7f6dd6ffd700 1 -- 172.21.15.88:0/3561438362 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6ddc00e540 con 0x7f6de81011c0 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.131+0000 7f6decd6b700 1 -- 172.21.15.88:0/3561438362 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f6de8108c20 con 0x7f6dd0036510 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.132+0000 7f6dd6ffd700 1 -- 172.21.15.88:0/3561438362 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f6de8108c20 con 0x7f6dd0036510 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.134+0000 7f6decd6b700 1 -- 172.21.15.88:0/3561438362 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dd0036510 msgr2=0x7f6dd00389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.134+0000 7f6decd6b700 1 --2- 172.21.15.88:0/3561438362 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dd0036510 0x7f6dd00389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009990 tx=0x7f6dd8006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.134+0000 7f6decd6b700 1 -- 172.21.15.88:0/3561438362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 msgr2=0x7f6de81132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.134+0000 7f6decd6b700 1 --2- 172.21.15.88:0/3561438362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81132c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc006d20 tx=0x7f6ddc00b4f0 comp rx=0 tx=0).stop 2023-12-09T02:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.134+0000 7f6decd6b700 1 -- 172.21.15.88:0/3561438362 shutdown_connections 2023-12-09T02:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.134+0000 7f6decd6b700 1 --2- 172.21.15.88:0/3561438362 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dd0036510 0x7f6dd00389c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.134+0000 7f6decd6b700 1 --2- 172.21.15.88:0/3561438362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de81011c0 0x7f6de81132c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.134+0000 7f6decd6b700 1 -- 172.21.15.88:0/3561438362 >> 172.21.15.88:0/3561438362 conn(0x7f6de80fc980 msgr2=0x7f6de8105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.134+0000 7f6decd6b700 1 -- 172.21.15.88:0/3561438362 shutdown_connections 2023-12-09T02:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.134+0000 7f6decd6b700 1 -- 172.21.15.88:0/3561438362 wait complete. 2023-12-09T02:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout:Generating ssh key... 2023-12-09T02:28:22.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:22 smithi088 ceph-mon[112028]: [09/Dec/2023:02:28:21] ENGINE Bus STARTING 2023-12-09T02:28:22.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:22 smithi088 ceph-mon[112028]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:22.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:22 smithi088 ceph-mon[112028]: [09/Dec/2023:02:28:21] ENGINE Serving on https://172.21.15.88:7150 2023-12-09T02:28:22.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:22 smithi088 ceph-mon[112028]: [09/Dec/2023:02:28:21] ENGINE Bus STARTED 2023-12-09T02:28:22.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:22 smithi088 ceph-mon[112028]: mgrmap e8: smithi088.jwlofb(active, since 2s) 2023-12-09T02:28:23.501 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.851+0000 7f1569b13700 1 Processor -- start 2023-12-09T02:28:23.501 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.851+0000 7f1569b13700 1 -- start start 2023-12-09T02:28:23.501 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.851+0000 7f1569b13700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:23.501 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.851+0000 7f1569b13700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1564104240 con 0x7f15641038f0 2023-12-09T02:28:23.501 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.852+0000 7f15637fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:23.501 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.852+0000 7f15637fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40252/0 (socket says 172.21.15.88:40252) 2023-12-09T02:28:23.502 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.852+0000 7f15637fe700 1 -- 172.21.15.88:0/1573311053 learned_addr learned my addr 172.21.15.88:0/1573311053 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:23.502 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.852+0000 7f15637fe700 1 -- 172.21.15.88:0/1573311053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564104380 con 0x7f15641038f0 2023-12-09T02:28:23.502 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.852+0000 7f15637fe700 1 --2- 172.21.15.88:0/1573311053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564103d00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f15540098e0 tx=0x7f1554009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87dd60818e8b055 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:23.502 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.852+0000 7f15627fc700 1 -- 172.21.15.88:0/1573311053 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f155400b860 con 0x7f15641038f0 2023-12-09T02:28:23.502 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.852+0000 7f15627fc700 1 -- 172.21.15.88:0/1573311053 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f155400be30 con 0x7f15641038f0 2023-12-09T02:28:23.502 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.852+0000 7f15627fc700 1 -- 172.21.15.88:0/1573311053 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1554010380 con 0x7f15641038f0 2023-12-09T02:28:23.503 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.853+0000 7f1569b13700 1 -- 172.21.15.88:0/1573311053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 msgr2=0x7f1564103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:23.503 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.853+0000 7f1569b13700 1 --2- 172.21.15.88:0/1573311053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564103d00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f15540098e0 tx=0x7f1554009250 comp rx=0 tx=0).stop 2023-12-09T02:28:23.503 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.853+0000 7f1569b13700 1 -- 172.21.15.88:0/1573311053 shutdown_connections 2023-12-09T02:28:23.503 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.853+0000 7f1569b13700 1 --2- 172.21.15.88:0/1573311053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564103d00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:23.503 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.853+0000 7f1569b13700 1 -- 172.21.15.88:0/1573311053 >> 172.21.15.88:0/1573311053 conn(0x7f15640fc0b0 msgr2=0x7f15640fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:23.503 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.853+0000 7f1569b13700 1 -- 172.21.15.88:0/1573311053 shutdown_connections 2023-12-09T02:28:23.504 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.853+0000 7f1569b13700 1 -- 172.21.15.88:0/1573311053 wait complete. 2023-12-09T02:28:23.504 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.853+0000 7f1569b13700 1 Processor -- start 2023-12-09T02:28:23.504 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f1569b13700 1 -- start start 2023-12-09T02:28:23.504 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f1569b13700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564111110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:23.504 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f1569b13700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1564111650 con 0x7f15641038f0 2023-12-09T02:28:23.504 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f15637fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564111110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:23.504 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f15637fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564111110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40260/0 (socket says 172.21.15.88:40260) 2023-12-09T02:28:23.504 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f15637fe700 1 -- 172.21.15.88:0/1052561653 learned_addr learned my addr 172.21.15.88:0/1052561653 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:23.505 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f15637fe700 1 -- 172.21.15.88:0/1052561653 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540094f0 con 0x7f15641038f0 2023-12-09T02:28:23.505 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f15637fe700 1 --2- 172.21.15.88:0/1052561653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564111110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1554000c00 tx=0x7f1554009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:23.505 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f155bfff700 1 -- 172.21.15.88:0/1052561653 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1554010a80 con 0x7f15641038f0 2023-12-09T02:28:23.505 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f155bfff700 1 -- 172.21.15.88:0/1052561653 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f155401a430 con 0x7f15641038f0 2023-12-09T02:28:23.505 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f1569b13700 1 -- 172.21.15.88:0/1052561653 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1564111850 con 0x7f15641038f0 2023-12-09T02:28:23.505 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f155bfff700 1 -- 172.21.15.88:0/1052561653 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15540245b0 con 0x7f15641038f0 2023-12-09T02:28:23.505 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.854+0000 7f1569b13700 1 -- 172.21.15.88:0/1052561653 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1564111c60 con 0x7f15641038f0 2023-12-09T02:28:23.505 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.855+0000 7f155bfff700 1 -- 172.21.15.88:0/1052561653 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f15540247a0 con 0x7f15641038f0 2023-12-09T02:28:23.506 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.855+0000 7f155bfff700 1 --2- 172.21.15.88:0/1052561653 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1550036640 0x7f1550038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:23.506 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.855+0000 7f155bfff700 1 -- 172.21.15.88:0/1052561653 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f155404ab90 con 0x7f15641038f0 2023-12-09T02:28:23.506 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.855+0000 7f1569b13700 1 -- 172.21.15.88:0/1052561653 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156404bb80 con 0x7f15641038f0 2023-12-09T02:28:23.506 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.855+0000 7f1562ffd700 1 --2- 172.21.15.88:0/1052561653 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1550036640 0x7f1550038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:23.506 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.856+0000 7f1562ffd700 1 --2- 172.21.15.88:0/1052561653 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1550036640 0x7f1550038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f154c009990 tx=0x7f154c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:23.506 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:22.860+0000 7f155bfff700 1 -- 172.21.15.88:0/1052561653 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1554018350 con 0x7f15641038f0 2023-12-09T02:28:23.506 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.041+0000 7f1569b13700 1 -- 172.21.15.88:0/1052561653 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f156410afd0 con 0x7f1550036640 2023-12-09T02:28:23.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.140+0000 7f155bfff700 1 -- 172.21.15.88:0/1052561653 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f156410afd0 con 0x7f1550036640 2023-12-09T02:28:23.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.142+0000 7f1569b13700 1 -- 172.21.15.88:0/1052561653 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1550036640 msgr2=0x7f1550038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:23.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.142+0000 7f1569b13700 1 --2- 172.21.15.88:0/1052561653 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1550036640 0x7f1550038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f154c009990 tx=0x7f154c006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:23.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.142+0000 7f1569b13700 1 -- 172.21.15.88:0/1052561653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 msgr2=0x7f1564111110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:23.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.142+0000 7f1569b13700 1 --2- 172.21.15.88:0/1052561653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564111110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1554000c00 tx=0x7f1554009250 comp rx=0 tx=0).stop 2023-12-09T02:28:23.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.143+0000 7f1569b13700 1 -- 172.21.15.88:0/1052561653 shutdown_connections 2023-12-09T02:28:23.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.143+0000 7f1569b13700 1 --2- 172.21.15.88:0/1052561653 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1550036640 0x7f1550038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:23.508 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.143+0000 7f1569b13700 1 --2- 172.21.15.88:0/1052561653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15641038f0 0x7f1564111110 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:23.508 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.143+0000 7f1569b13700 1 -- 172.21.15.88:0/1052561653 >> 172.21.15.88:0/1052561653 conn(0x7f15640fc0b0 msgr2=0x7f15640fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:23.508 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.143+0000 7f1569b13700 1 -- 172.21.15.88:0/1052561653 shutdown_connections 2023-12-09T02:28:23.508 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.143+0000 7f1569b13700 1 -- 172.21.15.88:0/1052561653 wait complete. 2023-12-09T02:28:23.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:23 smithi088 ceph-mon[112028]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:23.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:23 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:23.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:23 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:24.407 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCymXH063Q6rHCTwENg+H15bc59okeIF3Is3WNWv2hcu5aeL9CxYhdo/A10zmJ35o0vo90HendQ79E0wCdlVbQdIZ1TJvwrDGCa552z+vKKjFp7K4cm8PJdjWup/Qlu9kxNtV/AE6pTrkeAEKpcR/O9OogYB+czP+ipE/Lm4kW8G/TEd64dNBYvHbTeEDiqIWoGLOhd0ik23F1o+WmtfnV3LDfvbTQf/DzL13hhETxf0xX3PSN2a3j6+Hadywyizl7UL/+x564oiVpnUv7bbLq3OEUS9UVnmKogrRtHobMXShKLZgPvr5vRwT9F57vYso9WCDxg0/eadl9Fesb+lGwdbLXk3f4mdVSvN7YCQtQ6FotsFD+JR89dOhthL1iAzTzU86f2AVetMJ3Yd9qrS5d3a25hVpowg9iC1ADu2M9Yd3eD6UTIHmF7DgjkoWCWqOJ+ZQ/65vTraJD56cpaTvx/peNgIYdn6FLMhBxKDm7Sc56dM85r/Qf38tDWnM2EvYs= ceph-70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:28:24.407 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.864+0000 7f00675fd700 1 Processor -- start 2023-12-09T02:28:24.407 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.864+0000 7f00675fd700 1 -- start start 2023-12-09T02:28:24.407 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.864+0000 7f00675fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f00601026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:24.407 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.864+0000 7f00675fd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0060102c00 con 0x7f00601022b0 2023-12-09T02:28:24.407 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.865+0000 7f0065399700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f00601026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:24.407 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.865+0000 7f0065399700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f00601026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40274/0 (socket says 172.21.15.88:40274) 2023-12-09T02:28:24.407 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.865+0000 7f0065399700 1 -- 172.21.15.88:0/3452572709 learned_addr learned my addr 172.21.15.88:0/3452572709 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:24.407 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.865+0000 7f0065399700 1 -- 172.21.15.88:0/3452572709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0060102d40 con 0x7f00601022b0 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.865+0000 7f0065399700 1 --2- 172.21.15.88:0/3452572709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f00601026c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f00500098e0 tx=0x7f0050009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6851d3a386f58b03 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.865+0000 7f0057fff700 1 -- 172.21.15.88:0/3452572709 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f005000b860 con 0x7f00601022b0 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.865+0000 7f0057fff700 1 -- 172.21.15.88:0/3452572709 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f005000be30 con 0x7f00601022b0 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.865+0000 7f0057fff700 1 -- 172.21.15.88:0/3452572709 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0050010380 con 0x7f00601022b0 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.866+0000 7f00675fd700 1 -- 172.21.15.88:0/3452572709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 msgr2=0x7f00601026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.866+0000 7f00675fd700 1 --2- 172.21.15.88:0/3452572709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f00601026c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f00500098e0 tx=0x7f0050009250 comp rx=0 tx=0).stop 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.866+0000 7f00675fd700 1 -- 172.21.15.88:0/3452572709 shutdown_connections 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.866+0000 7f00675fd700 1 --2- 172.21.15.88:0/3452572709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f00601026c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.866+0000 7f00675fd700 1 -- 172.21.15.88:0/3452572709 >> 172.21.15.88:0/3452572709 conn(0x7f00600fda10 msgr2=0x7f00600ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.866+0000 7f00675fd700 1 -- 172.21.15.88:0/3452572709 shutdown_connections 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.866+0000 7f00675fd700 1 -- 172.21.15.88:0/3452572709 wait complete. 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.866+0000 7f00675fd700 1 Processor -- start 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.866+0000 7f00675fd700 1 -- start start 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.866+0000 7f00675fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f0060111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:24.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.866+0000 7f00675fd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0060111690 con 0x7f00601022b0 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.867+0000 7f0065399700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f0060111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.867+0000 7f0065399700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f0060111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40288/0 (socket says 172.21.15.88:40288) 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.867+0000 7f0065399700 1 -- 172.21.15.88:0/1973339335 learned_addr learned my addr 172.21.15.88:0/1973339335 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.867+0000 7f0065399700 1 -- 172.21.15.88:0/1973339335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00500094f0 con 0x7f00601022b0 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.867+0000 7f0065399700 1 --2- 172.21.15.88:0/1973339335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f0060111150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0050000c00 tx=0x7f0050009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.867+0000 7f0055ffb700 1 -- 172.21.15.88:0/1973339335 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0050010a80 con 0x7f00601022b0 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.867+0000 7f0055ffb700 1 -- 172.21.15.88:0/1973339335 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f005001a430 con 0x7f00601022b0 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.867+0000 7f00675fd700 1 -- 172.21.15.88:0/1973339335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0060111890 con 0x7f00601022b0 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.867+0000 7f0055ffb700 1 -- 172.21.15.88:0/1973339335 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00500245b0 con 0x7f00601022b0 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.867+0000 7f00675fd700 1 -- 172.21.15.88:0/1973339335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0060111ca0 con 0x7f00601022b0 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.868+0000 7f0055ffb700 1 -- 172.21.15.88:0/1973339335 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f00500247a0 con 0x7f00601022b0 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.868+0000 7f0055ffb700 1 --2- 172.21.15.88:0/1973339335 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f004c036640 0x7f004c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.868+0000 7f0055ffb700 1 -- 172.21.15.88:0/1973339335 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f005004abd0 con 0x7f00601022b0 2023-12-09T02:28:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.868+0000 7f00675fd700 1 -- 172.21.15.88:0/1973339335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006004bb80 con 0x7f00601022b0 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.868+0000 7f0064b98700 1 --2- 172.21.15.88:0/1973339335 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f004c036640 0x7f004c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.869+0000 7f0064b98700 1 --2- 172.21.15.88:0/1973339335 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f004c036640 0x7f004c038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f005c009990 tx=0x7f005c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:23.873+0000 7f0055ffb700 1 -- 172.21.15.88:0/1973339335 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0050018350 con 0x7f00601022b0 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.054+0000 7f00675fd700 1 -- 172.21.15.88:0/1973339335 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f006010ada0 con 0x7f004c036640 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.055+0000 7f0055ffb700 1 -- 172.21.15.88:0/1973339335 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f006010ada0 con 0x7f004c036640 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.057+0000 7f00675fd700 1 -- 172.21.15.88:0/1973339335 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f004c036640 msgr2=0x7f004c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.057+0000 7f00675fd700 1 --2- 172.21.15.88:0/1973339335 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f004c036640 0x7f004c038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f005c009990 tx=0x7f005c006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.057+0000 7f00675fd700 1 -- 172.21.15.88:0/1973339335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 msgr2=0x7f0060111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.057+0000 7f00675fd700 1 --2- 172.21.15.88:0/1973339335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f0060111150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0050000c00 tx=0x7f0050009250 comp rx=0 tx=0).stop 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.057+0000 7f00675fd700 1 -- 172.21.15.88:0/1973339335 shutdown_connections 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.057+0000 7f00675fd700 1 --2- 172.21.15.88:0/1973339335 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f004c036640 0x7f004c038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.057+0000 7f00675fd700 1 --2- 172.21.15.88:0/1973339335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00601022b0 0x7f0060111150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.057+0000 7f00675fd700 1 -- 172.21.15.88:0/1973339335 >> 172.21.15.88:0/1973339335 conn(0x7f00600fda10 msgr2=0x7f00600ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.057+0000 7f00675fd700 1 -- 172.21.15.88:0/1973339335 shutdown_connections 2023-12-09T02:28:24.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.057+0000 7f00675fd700 1 -- 172.21.15.88:0/1973339335 wait complete. 2023-12-09T02:28:24.411 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-09T02:28:24.411 INFO:teuthology.orchestra.run.smithi088.stdout:Adding key to root@localhost authorized_keys... 2023-12-09T02:28:24.411 INFO:teuthology.orchestra.run.smithi088.stdout:Adding host smithi088... 2023-12-09T02:28:24.952 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:24 smithi088 ceph-mon[112028]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:24.952 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:24 smithi088 ceph-mon[112028]: Generating ssh key... 2023-12-09T02:28:25.803 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:25 smithi088 ceph-mon[112028]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:25.803 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:25 smithi088 ceph-mon[112028]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi088", "addr": "172.21.15.88", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:26.939 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Added host 'smithi088' with addr '172.21.15.88' 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.737+0000 7f8261495700 1 Processor -- start 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.738+0000 7f8261495700 1 -- start start 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.738+0000 7f8261495700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.738+0000 7f8261495700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c101b20 con 0x7f825c1011d0 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.738+0000 7f825affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.738+0000 7f825affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c1015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40294/0 (socket says 172.21.15.88:40294) 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.738+0000 7f825affd700 1 -- 172.21.15.88:0/673992254 learned_addr learned my addr 172.21.15.88:0/673992254 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.738+0000 7f825affd700 1 -- 172.21.15.88:0/673992254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c101c60 con 0x7f825c1011d0 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.738+0000 7f825affd700 1 --2- 172.21.15.88:0/673992254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c1015e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f82440098e0 tx=0x7f8244009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589674751916ea49 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.738+0000 7f8259ffb700 1 -- 172.21.15.88:0/673992254 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f824400b860 con 0x7f825c1011d0 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.738+0000 7f8259ffb700 1 -- 172.21.15.88:0/673992254 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f824400be30 con 0x7f825c1011d0 2023-12-09T02:28:26.940 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.738+0000 7f8259ffb700 1 -- 172.21.15.88:0/673992254 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8244010380 con 0x7f825c1011d0 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.739+0000 7f8261495700 1 -- 172.21.15.88:0/673992254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 msgr2=0x7f825c1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.739+0000 7f8261495700 1 --2- 172.21.15.88:0/673992254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c1015e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f82440098e0 tx=0x7f8244009250 comp rx=0 tx=0).stop 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.739+0000 7f8261495700 1 -- 172.21.15.88:0/673992254 shutdown_connections 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.739+0000 7f8261495700 1 --2- 172.21.15.88:0/673992254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c1015e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.739+0000 7f8261495700 1 -- 172.21.15.88:0/673992254 >> 172.21.15.88:0/673992254 conn(0x7f825c0fc950 msgr2=0x7f825c0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.739+0000 7f8261495700 1 -- 172.21.15.88:0/673992254 shutdown_connections 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.739+0000 7f8261495700 1 -- 172.21.15.88:0/673992254 wait complete. 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.740+0000 7f8261495700 1 Processor -- start 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.740+0000 7f8261495700 1 -- start start 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.740+0000 7f8261495700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c113e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.740+0000 7f8261495700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c076bf0 con 0x7f825c1011d0 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.740+0000 7f825affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c113e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.740+0000 7f825affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c113e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40302/0 (socket says 172.21.15.88:40302) 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.740+0000 7f825affd700 1 -- 172.21.15.88:0/993426072 learned_addr learned my addr 172.21.15.88:0/993426072 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:26.941 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.740+0000 7f825affd700 1 -- 172.21.15.88:0/993426072 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82440094f0 con 0x7f825c1011d0 2023-12-09T02:28:26.942 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.740+0000 7f825affd700 1 --2- 172.21.15.88:0/993426072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c113e50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8244000c00 tx=0x7f8244009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:26.942 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.740+0000 7f82537fe700 1 -- 172.21.15.88:0/993426072 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8244010a80 con 0x7f825c1011d0 2023-12-09T02:28:26.942 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.740+0000 7f82537fe700 1 -- 172.21.15.88:0/993426072 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f824401a430 con 0x7f825c1011d0 2023-12-09T02:28:26.942 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.741+0000 7f82537fe700 1 -- 172.21.15.88:0/993426072 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82440245b0 con 0x7f825c1011d0 2023-12-09T02:28:26.942 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.741+0000 7f8261495700 1 -- 172.21.15.88:0/993426072 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c076df0 con 0x7f825c1011d0 2023-12-09T02:28:26.942 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.741+0000 7f8261495700 1 -- 172.21.15.88:0/993426072 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c114550 con 0x7f825c1011d0 2023-12-09T02:28:26.942 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.741+0000 7f82537fe700 1 -- 172.21.15.88:0/993426072 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f8244010be0 con 0x7f825c1011d0 2023-12-09T02:28:26.942 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.742+0000 7f8261495700 1 -- 172.21.15.88:0/993426072 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c10a050 con 0x7f825c1011d0 2023-12-09T02:28:26.942 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.742+0000 7f82537fe700 1 --2- 172.21.15.88:0/993426072 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f82480365f0 0x7f8248038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:26.942 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.742+0000 7f82537fe700 1 -- 172.21.15.88:0/993426072 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f824404ab60 con 0x7f825c1011d0 2023-12-09T02:28:26.942 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.742+0000 7f825a7fc700 1 --2- 172.21.15.88:0/993426072 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f82480365f0 0x7f8248038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.742+0000 7f825a7fc700 1 --2- 172.21.15.88:0/993426072 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f82480365f0 0x7f8248038aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f824c009990 tx=0x7f824c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.746+0000 7f82537fe700 1 -- 172.21.15.88:0/993426072 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f82440239e0 con 0x7f825c1011d0 2023-12-09T02:28:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:24.932+0000 7f8261495700 1 -- 172.21.15.88:0/993426072 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi088", "addr": "172.21.15.88", "target": ["mon-mgr", ""]}) v1 -- 0x7f825c02b220 con 0x7f82480365f0 2023-12-09T02:28:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:26.610+0000 7f82537fe700 1 -- 172.21.15.88:0/993426072 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f825c02b220 con 0x7f82480365f0 2023-12-09T02:28:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:26.613+0000 7f8261495700 1 -- 172.21.15.88:0/993426072 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f82480365f0 msgr2=0x7f8248038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:26.613+0000 7f8261495700 1 --2- 172.21.15.88:0/993426072 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f82480365f0 0x7f8248038aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f824c009990 tx=0x7f824c006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:26.613+0000 7f8261495700 1 -- 172.21.15.88:0/993426072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 msgr2=0x7f825c113e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:26.613+0000 7f8261495700 1 --2- 172.21.15.88:0/993426072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c113e50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8244000c00 tx=0x7f8244009250 comp rx=0 tx=0).stop 2023-12-09T02:28:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:26.613+0000 7f8261495700 1 -- 172.21.15.88:0/993426072 shutdown_connections 2023-12-09T02:28:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:26.613+0000 7f8261495700 1 --2- 172.21.15.88:0/993426072 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f82480365f0 0x7f8248038aa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:26.613+0000 7f8261495700 1 --2- 172.21.15.88:0/993426072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c1011d0 0x7f825c113e50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:26.944 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:26.613+0000 7f8261495700 1 -- 172.21.15.88:0/993426072 >> 172.21.15.88:0/993426072 conn(0x7f825c0fc950 msgr2=0x7f825c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:26.944 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:26.613+0000 7f8261495700 1 -- 172.21.15.88:0/993426072 shutdown_connections 2023-12-09T02:28:26.944 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:26.613+0000 7f8261495700 1 -- 172.21.15.88:0/993426072 wait complete. 2023-12-09T02:28:26.944 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying mon service with default placement... 2023-12-09T02:28:26.944 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:26 smithi088 ceph-mon[112028]: Deploying cephadm binary to smithi088 2023-12-09T02:28:26.944 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:26 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:26.944 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:26 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:28:27.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:27 smithi088 ceph-mon[112028]: Added host smithi088 2023-12-09T02:28:27.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:27 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:28.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-09T02:28:28.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.324+0000 7f2260b9b700 1 Processor -- start 2023-12-09T02:28:28.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.324+0000 7f2260b9b700 1 -- start start 2023-12-09T02:28:28.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.325+0000 7f2260b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c102be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:28.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.325+0000 7f2260b9b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c103120 con 0x7f225c1027d0 2023-12-09T02:28:28.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.325+0000 7f225a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:28.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.325+0000 7f225a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c102be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58290/0 (socket says 172.21.15.88:58290) 2023-12-09T02:28:28.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.325+0000 7f225a59c700 1 -- 172.21.15.88:0/1993775319 learned_addr learned my addr 172.21.15.88:0/1993775319 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:28.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.325+0000 7f225a59c700 1 -- 172.21.15.88:0/1993775319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c103260 con 0x7f225c1027d0 2023-12-09T02:28:28.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.325+0000 7f225a59c700 1 --2- 172.21.15.88:0/1993775319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c102be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f224c00bb80 tx=0x7f224c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc13f1ab3271be40 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.325+0000 7f225959a700 1 -- 172.21.15.88:0/1993775319 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f224c00dd00 con 0x7f225c1027d0 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.325+0000 7f225959a700 1 -- 172.21.15.88:0/1993775319 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f224c00de60 con 0x7f225c1027d0 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.326+0000 7f225959a700 1 -- 172.21.15.88:0/1993775319 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f224c018840 con 0x7f225c1027d0 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.326+0000 7f2260b9b700 1 -- 172.21.15.88:0/1993775319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 msgr2=0x7f225c102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.326+0000 7f2260b9b700 1 --2- 172.21.15.88:0/1993775319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c102be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f224c00bb80 tx=0x7f224c00b4f0 comp rx=0 tx=0).stop 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.326+0000 7f2260b9b700 1 -- 172.21.15.88:0/1993775319 shutdown_connections 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.326+0000 7f2260b9b700 1 --2- 172.21.15.88:0/1993775319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c102be0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.326+0000 7f2260b9b700 1 -- 172.21.15.88:0/1993775319 >> 172.21.15.88:0/1993775319 conn(0x7f225c0fc0b0 msgr2=0x7f225c0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.326+0000 7f2260b9b700 1 -- 172.21.15.88:0/1993775319 shutdown_connections 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.326+0000 7f2260b9b700 1 -- 172.21.15.88:0/1993775319 wait complete. 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.327+0000 7f2260b9b700 1 Processor -- start 2023-12-09T02:28:28.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.327+0000 7f2260b9b700 1 -- start start 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.327+0000 7f2260b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c10eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.327+0000 7f2260b9b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c10f410 con 0x7f225c1027d0 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.327+0000 7f225a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c10eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.327+0000 7f225a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c10eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58294/0 (socket says 172.21.15.88:58294) 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.327+0000 7f225a59c700 1 -- 172.21.15.88:0/270356844 learned_addr learned my addr 172.21.15.88:0/270356844 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.327+0000 7f225a59c700 1 -- 172.21.15.88:0/270356844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c00b790 con 0x7f225c1027d0 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.327+0000 7f225a59c700 1 --2- 172.21.15.88:0/270356844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c10eed0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f224c006d40 tx=0x7f224c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.327+0000 7f224affd700 1 -- 172.21.15.88:0/270356844 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f224c010a00 con 0x7f225c1027d0 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.327+0000 7f224affd700 1 -- 172.21.15.88:0/270356844 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f224c01d050 con 0x7f225c1027d0 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.328+0000 7f2260b9b700 1 -- 172.21.15.88:0/270356844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c10f610 con 0x7f225c1027d0 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.328+0000 7f224affd700 1 -- 172.21.15.88:0/270356844 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f224c022590 con 0x7f225c1027d0 2023-12-09T02:28:28.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.328+0000 7f2260b9b700 1 -- 172.21.15.88:0/270356844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c10fa20 con 0x7f225c1027d0 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.328+0000 7f224affd700 1 -- 172.21.15.88:0/270356844 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f224c023470 con 0x7f225c1027d0 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.328+0000 7f224affd700 1 --2- 172.21.15.88:0/270356844 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f2244036640 0x7f2244038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.328+0000 7f2260b9b700 1 -- 172.21.15.88:0/270356844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c04bb80 con 0x7f225c1027d0 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.329+0000 7f224affd700 1 -- 172.21.15.88:0/270356844 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f224c014070 con 0x7f225c1027d0 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.329+0000 7f2259d9b700 1 --2- 172.21.15.88:0/270356844 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f2244036640 0x7f2244038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.329+0000 7f2259d9b700 1 --2- 172.21.15.88:0/270356844 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f2244036640 0x7f2244038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2250009990 tx=0x7f2250006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.333+0000 7f224affd700 1 -- 172.21.15.88:0/270356844 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f224c022c60 con 0x7f225c1027d0 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.537+0000 7f2260b9b700 1 -- 172.21.15.88:0/270356844 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f225c1085c0 con 0x7f2244036640 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.541+0000 7f224affd700 1 -- 172.21.15.88:0/270356844 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f225c1085c0 con 0x7f2244036640 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.543+0000 7f2260b9b700 1 -- 172.21.15.88:0/270356844 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f2244036640 msgr2=0x7f2244038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.543+0000 7f2260b9b700 1 --2- 172.21.15.88:0/270356844 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f2244036640 0x7f2244038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2250009990 tx=0x7f2250006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.543+0000 7f2260b9b700 1 -- 172.21.15.88:0/270356844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 msgr2=0x7f225c10eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.543+0000 7f2260b9b700 1 --2- 172.21.15.88:0/270356844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c10eed0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f224c006d40 tx=0x7f224c00b4f0 comp rx=0 tx=0).stop 2023-12-09T02:28:28.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.543+0000 7f2260b9b700 1 -- 172.21.15.88:0/270356844 shutdown_connections 2023-12-09T02:28:28.197 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.543+0000 7f2260b9b700 1 --2- 172.21.15.88:0/270356844 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f2244036640 0x7f2244038af0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:28.197 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.543+0000 7f2260b9b700 1 --2- 172.21.15.88:0/270356844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f225c1027d0 0x7f225c10eed0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:28.197 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.543+0000 7f2260b9b700 1 -- 172.21.15.88:0/270356844 >> 172.21.15.88:0/270356844 conn(0x7f225c0fc0b0 msgr2=0x7f225c0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:28.197 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.544+0000 7f2260b9b700 1 -- 172.21.15.88:0/270356844 shutdown_connections 2023-12-09T02:28:28.197 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:27.544+0000 7f2260b9b700 1 -- 172.21.15.88:0/270356844 wait complete. 2023-12-09T02:28:28.197 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying mgr service with default placement... 2023-12-09T02:28:28.798 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:28 smithi088 ceph-mon[112028]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:28.798 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:28 smithi088 ceph-mon[112028]: Saving service mon spec with placement count:5 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.544+0000 7f4ffca70700 1 Processor -- start 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.544+0000 7f4ffca70700 1 -- start start 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.544+0000 7f4ffca70700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.544+0000 7f4ffca70700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff8105420 con 0x7f4ff8070fc0 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.544+0000 7f4ff659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.544+0000 7f4ff659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58298/0 (socket says 172.21.15.88:58298) 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.544+0000 7f4ff659c700 1 -- 172.21.15.88:0/2263202809 learned_addr learned my addr 172.21.15.88:0/2263202809 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.544+0000 7f4ff659c700 1 -- 172.21.15.88:0/2263202809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff8105560 con 0x7f4ff8070fc0 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.545+0000 7f4ff659c700 1 --2- 172.21.15.88:0/2263202809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8104ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0098e0 tx=0x7f4fec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad1417ad500424f server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.545+0000 7f4ff559a700 1 -- 172.21.15.88:0/2263202809 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fec00b860 con 0x7f4ff8070fc0 2023-12-09T02:28:29.139 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.545+0000 7f4ff559a700 1 -- 172.21.15.88:0/2263202809 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4fec00be30 con 0x7f4ff8070fc0 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.545+0000 7f4ff559a700 1 -- 172.21.15.88:0/2263202809 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fec010380 con 0x7f4ff8070fc0 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.545+0000 7f4ffca70700 1 -- 172.21.15.88:0/2263202809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 msgr2=0x7f4ff8104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.545+0000 7f4ffca70700 1 --2- 172.21.15.88:0/2263202809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8104ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0098e0 tx=0x7f4fec009250 comp rx=0 tx=0).stop 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.545+0000 7f4ffca70700 1 -- 172.21.15.88:0/2263202809 shutdown_connections 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.545+0000 7f4ffca70700 1 --2- 172.21.15.88:0/2263202809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8104ee0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.545+0000 7f4ffca70700 1 -- 172.21.15.88:0/2263202809 >> 172.21.15.88:0/2263202809 conn(0x7f4ff80fc970 msgr2=0x7f4ff80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.545+0000 7f4ffca70700 1 -- 172.21.15.88:0/2263202809 shutdown_connections 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.546+0000 7f4ffca70700 1 -- 172.21.15.88:0/2263202809 wait complete. 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.546+0000 7f4ffca70700 1 Processor -- start 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.546+0000 7f4ffca70700 1 -- start start 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.546+0000 7f4ffca70700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.546+0000 7f4ffca70700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81116c0 con 0x7f4ff8070fc0 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.546+0000 7f4ff659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.546+0000 7f4ff659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58314/0 (socket says 172.21.15.88:58314) 2023-12-09T02:28:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.546+0000 7f4ff659c700 1 -- 172.21.15.88:0/3001993150 learned_addr learned my addr 172.21.15.88:0/3001993150 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.547+0000 7f4ff659c700 1 -- 172.21.15.88:0/3001993150 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec0094f0 con 0x7f4ff8070fc0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.547+0000 7f4ff659c700 1 --2- 172.21.15.88:0/3001993150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8111180 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4fec006b00 tx=0x7f4fec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.547+0000 7f4fe6ffd700 1 -- 172.21.15.88:0/3001993150 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fec010a80 con 0x7f4ff8070fc0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.547+0000 7f4fe6ffd700 1 -- 172.21.15.88:0/3001993150 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4fec01a430 con 0x7f4ff8070fc0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.547+0000 7f4ffca70700 1 -- 172.21.15.88:0/3001993150 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff81118c0 con 0x7f4ff8070fc0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.547+0000 7f4fe6ffd700 1 -- 172.21.15.88:0/3001993150 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fec0245b0 con 0x7f4ff8070fc0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.547+0000 7f4ffca70700 1 -- 172.21.15.88:0/3001993150 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff8111cd0 con 0x7f4ff8070fc0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.548+0000 7f4ffca70700 1 -- 172.21.15.88:0/3001993150 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff804bb80 con 0x7f4ff8070fc0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.548+0000 7f4fe6ffd700 1 -- 172.21.15.88:0/3001993150 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f4fec010be0 con 0x7f4ff8070fc0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.548+0000 7f4fe6ffd700 1 --2- 172.21.15.88:0/3001993150 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f4fe0036640 0x7f4fe0038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.548+0000 7f4fe6ffd700 1 -- 172.21.15.88:0/3001993150 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4fec04aaf0 con 0x7f4ff8070fc0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.548+0000 7f4ff5d9b700 1 --2- 172.21.15.88:0/3001993150 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f4fe0036640 0x7f4fe0038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.549+0000 7f4ff5d9b700 1 --2- 172.21.15.88:0/3001993150 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f4fe0036640 0x7f4fe0038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009990 tx=0x7f4fe8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:29.141 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.553+0000 7f4fe6ffd700 1 -- 172.21.15.88:0/3001993150 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4fec01a5a0 con 0x7f4ff8070fc0 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.720+0000 7f4fe6ffd700 1 -- 172.21.15.88:0/3001993150 <== mon.0 v2:172.21.15.88:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4fec04ce90 con 0x7f4ff8070fc0 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.761+0000 7f4ffca70700 1 -- 172.21.15.88:0/3001993150 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ff810afb0 con 0x7f4fe0036640 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.765+0000 7f4fe6ffd700 1 -- 172.21.15.88:0/3001993150 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4ff810afb0 con 0x7f4fe0036640 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.768+0000 7f4ffca70700 1 -- 172.21.15.88:0/3001993150 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f4fe0036640 msgr2=0x7f4fe0038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.768+0000 7f4ffca70700 1 --2- 172.21.15.88:0/3001993150 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f4fe0036640 0x7f4fe0038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009990 tx=0x7f4fe8006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.768+0000 7f4ffca70700 1 -- 172.21.15.88:0/3001993150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 msgr2=0x7f4ff8111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.768+0000 7f4ffca70700 1 --2- 172.21.15.88:0/3001993150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8111180 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4fec006b00 tx=0x7f4fec009250 comp rx=0 tx=0).stop 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.768+0000 7f4ffca70700 1 -- 172.21.15.88:0/3001993150 shutdown_connections 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.768+0000 7f4ffca70700 1 --2- 172.21.15.88:0/3001993150 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f4fe0036640 0x7f4fe0038af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.768+0000 7f4ffca70700 1 --2- 172.21.15.88:0/3001993150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ff8070fc0 0x7f4ff8111180 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.768+0000 7f4ffca70700 1 -- 172.21.15.88:0/3001993150 >> 172.21.15.88:0/3001993150 conn(0x7f4ff80fc970 msgr2=0x7f4ff80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.768+0000 7f4ffca70700 1 -- 172.21.15.88:0/3001993150 shutdown_connections 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:28.768+0000 7f4ffca70700 1 -- 172.21.15.88:0/3001993150 wait complete. 2023-12-09T02:28:29.142 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying crash service with default placement... 2023-12-09T02:28:29.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:29 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:29.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:29 smithi088 ceph-mon[112028]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:29.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:29 smithi088 ceph-mon[112028]: Saving service mgr spec with placement count:2 2023-12-09T02:28:29.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:29 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:29.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:29 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:29.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:29 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:30.163 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-09T02:28:30.163 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.478+0000 7fe5de161700 1 Processor -- start 2023-12-09T02:28:30.163 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.478+0000 7fe5de161700 1 -- start start 2023-12-09T02:28:30.163 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.479+0000 7fe5de161700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d80771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:30.163 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.479+0000 7fe5de161700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80790f0 con 0x7fe5d8078ce0 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.479+0000 7fe5d77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d80771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.479+0000 7fe5d77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d80771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58328/0 (socket says 172.21.15.88:58328) 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.479+0000 7fe5d77fe700 1 -- 172.21.15.88:0/207282914 learned_addr learned my addr 172.21.15.88:0/207282914 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.479+0000 7fe5d77fe700 1 -- 172.21.15.88:0/207282914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d8077730 con 0x7fe5d8078ce0 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.479+0000 7fe5d77fe700 1 --2- 172.21.15.88:0/207282914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d80771f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80098e0 tx=0x7fe5c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a02022b0bb30af2 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.479+0000 7fe5d67fc700 1 -- 172.21.15.88:0/207282914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5c800b860 con 0x7fe5d8078ce0 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.480+0000 7fe5d67fc700 1 -- 172.21.15.88:0/207282914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5c800be70 con 0x7fe5d8078ce0 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.480+0000 7fe5d67fc700 1 -- 172.21.15.88:0/207282914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5c8010380 con 0x7fe5d8078ce0 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.480+0000 7fe5de161700 1 -- 172.21.15.88:0/207282914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 msgr2=0x7fe5d80771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.480+0000 7fe5de161700 1 --2- 172.21.15.88:0/207282914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d80771f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80098e0 tx=0x7fe5c8009250 comp rx=0 tx=0).stop 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.480+0000 7fe5de161700 1 -- 172.21.15.88:0/207282914 shutdown_connections 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.480+0000 7fe5de161700 1 --2- 172.21.15.88:0/207282914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d80771f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.480+0000 7fe5de161700 1 -- 172.21.15.88:0/207282914 >> 172.21.15.88:0/207282914 conn(0x7fe5d80fda10 msgr2=0x7fe5d80ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.480+0000 7fe5de161700 1 -- 172.21.15.88:0/207282914 shutdown_connections 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.480+0000 7fe5de161700 1 -- 172.21.15.88:0/207282914 wait complete. 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.481+0000 7fe5de161700 1 Processor -- start 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.481+0000 7fe5de161700 1 -- start start 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.481+0000 7fe5de161700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d8113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.481+0000 7fe5de161700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d8113870 con 0x7fe5d8078ce0 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.481+0000 7fe5d77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d8113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.481+0000 7fe5d77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d8113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58334/0 (socket says 172.21.15.88:58334) 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.481+0000 7fe5d77fe700 1 -- 172.21.15.88:0/420104022 learned_addr learned my addr 172.21.15.88:0/420104022 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.482+0000 7fe5d77fe700 1 -- 172.21.15.88:0/420104022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80094f0 con 0x7fe5d8078ce0 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.482+0000 7fe5d77fe700 1 --2- 172.21.15.88:0/420104022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d8113330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80094c0 tx=0x7fe5c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.482+0000 7fe5bffff700 1 -- 172.21.15.88:0/420104022 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5c8010850 con 0x7fe5d8078ce0 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.482+0000 7fe5bffff700 1 -- 172.21.15.88:0/420104022 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5c8010e60 con 0x7fe5d8078ce0 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.482+0000 7fe5de161700 1 -- 172.21.15.88:0/420104022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d8113a70 con 0x7fe5d8078ce0 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.482+0000 7fe5bffff700 1 -- 172.21.15.88:0/420104022 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5c80243f0 con 0x7fe5d8078ce0 2023-12-09T02:28:30.165 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.482+0000 7fe5de161700 1 -- 172.21.15.88:0/420104022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d8113e80 con 0x7fe5d8078ce0 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.483+0000 7fe5de161700 1 -- 172.21.15.88:0/420104022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d804bb80 con 0x7fe5d8078ce0 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.483+0000 7fe5bffff700 1 -- 172.21.15.88:0/420104022 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fe5c8024660 con 0x7fe5d8078ce0 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.483+0000 7fe5bffff700 1 --2- 172.21.15.88:0/420104022 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fe5c0036640 0x7fe5c0038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.483+0000 7fe5bffff700 1 -- 172.21.15.88:0/420104022 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe5c804a5a0 con 0x7fe5d8078ce0 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.483+0000 7fe5d6ffd700 1 --2- 172.21.15.88:0/420104022 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fe5c0036640 0x7fe5c0038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.484+0000 7fe5d6ffd700 1 --2- 172.21.15.88:0/420104022 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fe5c0036640 0x7fe5c0038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009990 tx=0x7fe5cc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.488+0000 7fe5bffff700 1 -- 172.21.15.88:0/420104022 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe5c8018d90 con 0x7fe5d8078ce0 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.702+0000 7fe5de161700 1 -- 172.21.15.88:0/420104022 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5d810d1d0 con 0x7fe5c0036640 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.706+0000 7fe5bffff700 1 -- 172.21.15.88:0/420104022 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fe5d810d1d0 con 0x7fe5c0036640 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.708+0000 7fe5de161700 1 -- 172.21.15.88:0/420104022 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fe5c0036640 msgr2=0x7fe5c0038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.708+0000 7fe5de161700 1 --2- 172.21.15.88:0/420104022 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fe5c0036640 0x7fe5c0038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009990 tx=0x7fe5cc006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.708+0000 7fe5de161700 1 -- 172.21.15.88:0/420104022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 msgr2=0x7fe5d8113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.708+0000 7fe5de161700 1 --2- 172.21.15.88:0/420104022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d8113330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80094c0 tx=0x7fe5c8009250 comp rx=0 tx=0).stop 2023-12-09T02:28:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.708+0000 7fe5de161700 1 -- 172.21.15.88:0/420104022 shutdown_connections 2023-12-09T02:28:30.167 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.708+0000 7fe5de161700 1 --2- 172.21.15.88:0/420104022 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fe5c0036640 0x7fe5c0038af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:30.167 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.708+0000 7fe5de161700 1 --2- 172.21.15.88:0/420104022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5d8078ce0 0x7fe5d8113330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:30.167 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.708+0000 7fe5de161700 1 -- 172.21.15.88:0/420104022 >> 172.21.15.88:0/420104022 conn(0x7fe5d80fda10 msgr2=0x7fe5d80ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:30.167 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.708+0000 7fe5de161700 1 -- 172.21.15.88:0/420104022 shutdown_connections 2023-12-09T02:28:30.167 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:29.708+0000 7fe5de161700 1 -- 172.21.15.88:0/420104022 wait complete. 2023-12-09T02:28:30.167 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying prometheus service with default placement... 2023-12-09T02:28:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:30 smithi088 ceph-mon[112028]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:30 smithi088 ceph-mon[112028]: Saving service crash spec with placement * 2023-12-09T02:28:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:30 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:31.130 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-09T02:28:31.130 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.554+0000 7f6e1c5fb700 1 Processor -- start 2023-12-09T02:28:31.130 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.554+0000 7f6e1c5fb700 1 -- start start 2023-12-09T02:28:31.130 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.554+0000 7f6e1c5fb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e141015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:31.130 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.554+0000 7f6e1c5fb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e14101b20 con 0x7f6e141011d0 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.555+0000 7f6e1a397700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e141015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.555+0000 7f6e1a397700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e141015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58340/0 (socket says 172.21.15.88:58340) 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.555+0000 7f6e1a397700 1 -- 172.21.15.88:0/3388868087 learned_addr learned my addr 172.21.15.88:0/3388868087 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.555+0000 7f6e1a397700 1 -- 172.21.15.88:0/3388868087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14101c60 con 0x7f6e141011d0 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.555+0000 7f6e1a397700 1 --2- 172.21.15.88:0/3388868087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e141015e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00bb80 tx=0x7f6e0c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3b3a0eedd53564 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.555+0000 7f6e19395700 1 -- 172.21.15.88:0/3388868087 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e0c00dd00 con 0x7f6e141011d0 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.555+0000 7f6e19395700 1 -- 172.21.15.88:0/3388868087 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e0c00de60 con 0x7f6e141011d0 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.555+0000 7f6e19395700 1 -- 172.21.15.88:0/3388868087 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e0c0188d0 con 0x7f6e141011d0 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.556+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/3388868087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 msgr2=0x7f6e141015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.556+0000 7f6e1c5fb700 1 --2- 172.21.15.88:0/3388868087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e141015e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00bb80 tx=0x7f6e0c00b4f0 comp rx=0 tx=0).stop 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.556+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/3388868087 shutdown_connections 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.556+0000 7f6e1c5fb700 1 --2- 172.21.15.88:0/3388868087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e141015e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:31.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.556+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/3388868087 >> 172.21.15.88:0/3388868087 conn(0x7f6e140fc970 msgr2=0x7f6e140fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:31.132 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.556+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/3388868087 shutdown_connections 2023-12-09T02:28:31.132 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.556+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/3388868087 wait complete. 2023-12-09T02:28:31.132 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e1c5fb700 1 Processor -- start 2023-12-09T02:28:31.132 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e1c5fb700 1 -- start start 2023-12-09T02:28:31.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e1c5fb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e14113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:31.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e1c5fb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e141138b0 con 0x7f6e141011d0 2023-12-09T02:28:31.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e1a397700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e14113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:31.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e1a397700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e14113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58344/0 (socket says 172.21.15.88:58344) 2023-12-09T02:28:31.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e1a397700 1 -- 172.21.15.88:0/4273276392 learned_addr learned my addr 172.21.15.88:0/4273276392 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:31.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e1a397700 1 -- 172.21.15.88:0/4273276392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c00b790 con 0x7f6e141011d0 2023-12-09T02:28:31.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e1a397700 1 --2- 172.21.15.88:0/4273276392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e14113370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c006b00 tx=0x7f6e0c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:31.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e12ffd700 1 -- 172.21.15.88:0/4273276392 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e0c018e40 con 0x7f6e141011d0 2023-12-09T02:28:31.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e12ffd700 1 -- 172.21.15.88:0/4273276392 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e0c010c00 con 0x7f6e141011d0 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/4273276392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e14113ab0 con 0x7f6e141011d0 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.557+0000 7f6e12ffd700 1 -- 172.21.15.88:0/4273276392 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e0c021550 con 0x7f6e141011d0 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.558+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/4273276392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e14113ec0 con 0x7f6e141011d0 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.559+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/4273276392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1404bb80 con 0x7f6e141011d0 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.559+0000 7f6e12ffd700 1 -- 172.21.15.88:0/4273276392 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f6e0c0217c0 con 0x7f6e141011d0 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.559+0000 7f6e12ffd700 1 --2- 172.21.15.88:0/4273276392 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dfc036640 0x7f6dfc038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.559+0000 7f6e12ffd700 1 -- 172.21.15.88:0/4273276392 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6e0c014070 con 0x7f6e141011d0 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.560+0000 7f6e19b96700 1 --2- 172.21.15.88:0/4273276392 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dfc036640 0x7f6dfc038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.560+0000 7f6e19b96700 1 --2- 172.21.15.88:0/4273276392 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dfc036640 0x7f6dfc038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009990 tx=0x7f6e08006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.564+0000 7f6e12ffd700 1 -- 172.21.15.88:0/4273276392 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6e0c0223f0 con 0x7f6e141011d0 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.771+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/4273276392 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e14108c30 con 0x7f6dfc036640 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.779+0000 7f6e12ffd700 1 -- 172.21.15.88:0/4273276392 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f6e14108c30 con 0x7f6dfc036640 2023-12-09T02:28:31.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.782+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/4273276392 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dfc036640 msgr2=0x7f6dfc038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:31.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.782+0000 7f6e1c5fb700 1 --2- 172.21.15.88:0/4273276392 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dfc036640 0x7f6dfc038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009990 tx=0x7f6e08006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:31.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.782+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/4273276392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 msgr2=0x7f6e14113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:31.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.782+0000 7f6e1c5fb700 1 --2- 172.21.15.88:0/4273276392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e14113370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c006b00 tx=0x7f6e0c00b4f0 comp rx=0 tx=0).stop 2023-12-09T02:28:31.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.782+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/4273276392 shutdown_connections 2023-12-09T02:28:31.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.782+0000 7f6e1c5fb700 1 --2- 172.21.15.88:0/4273276392 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f6dfc036640 0x7f6dfc038af0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:31.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.782+0000 7f6e1c5fb700 1 --2- 172.21.15.88:0/4273276392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e141011d0 0x7f6e14113370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:31.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.782+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/4273276392 >> 172.21.15.88:0/4273276392 conn(0x7f6e140fc970 msgr2=0x7f6e14105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:31.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.782+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/4273276392 shutdown_connections 2023-12-09T02:28:31.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:30.782+0000 7f6e1c5fb700 1 -- 172.21.15.88:0/4273276392 wait complete. 2023-12-09T02:28:31.135 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying grafana service with default placement... 2023-12-09T02:28:32.085 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:31 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:32.086 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:31 smithi088 ceph-mon[112028]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:32.086 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:31 smithi088 ceph-mon[112028]: Saving service prometheus spec with placement count:1 2023-12-09T02:28:32.086 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:31 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:32.086 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:31 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:32.155 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-09T02:28:32.155 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.486+0000 7fc8839f2700 1 Processor -- start 2023-12-09T02:28:32.155 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.486+0000 7fc8839f2700 1 -- start start 2023-12-09T02:28:32.155 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.487+0000 7fc8839f2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c104ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:32.155 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.487+0000 7fc8839f2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c105400 con 0x7fc87c070fe0 2023-12-09T02:28:32.155 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.487+0000 7fc88178e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c104ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:32.155 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.487+0000 7fc88178e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c104ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58356/0 (socket says 172.21.15.88:58356) 2023-12-09T02:28:32.155 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.487+0000 7fc88178e700 1 -- 172.21.15.88:0/1451637927 learned_addr learned my addr 172.21.15.88:0/1451637927 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:32.155 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.487+0000 7fc88178e700 1 -- 172.21.15.88:0/1451637927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c105540 con 0x7fc87c070fe0 2023-12-09T02:28:32.155 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.487+0000 7fc88178e700 1 --2- 172.21.15.88:0/1451637927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c104ec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8780098e0 tx=0x7fc878009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100833a5d4cd3215 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.488+0000 7fc873fff700 1 -- 172.21.15.88:0/1451637927 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc87800b860 con 0x7fc87c070fe0 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.488+0000 7fc873fff700 1 -- 172.21.15.88:0/1451637927 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc87800be70 con 0x7fc87c070fe0 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.488+0000 7fc873fff700 1 -- 172.21.15.88:0/1451637927 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc878010380 con 0x7fc87c070fe0 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.488+0000 7fc8839f2700 1 -- 172.21.15.88:0/1451637927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 msgr2=0x7fc87c104ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.488+0000 7fc8839f2700 1 --2- 172.21.15.88:0/1451637927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c104ec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8780098e0 tx=0x7fc878009250 comp rx=0 tx=0).stop 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.488+0000 7fc8839f2700 1 -- 172.21.15.88:0/1451637927 shutdown_connections 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.488+0000 7fc8839f2700 1 --2- 172.21.15.88:0/1451637927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c104ec0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.488+0000 7fc8839f2700 1 -- 172.21.15.88:0/1451637927 >> 172.21.15.88:0/1451637927 conn(0x7fc87c0fc970 msgr2=0x7fc87c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.488+0000 7fc8839f2700 1 -- 172.21.15.88:0/1451637927 shutdown_connections 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.488+0000 7fc8839f2700 1 -- 172.21.15.88:0/1451637927 wait complete. 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.489+0000 7fc8839f2700 1 Processor -- start 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.489+0000 7fc8839f2700 1 -- start start 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.489+0000 7fc8839f2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c1111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.489+0000 7fc8839f2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c1116e0 con 0x7fc87c070fe0 2023-12-09T02:28:32.156 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.489+0000 7fc88178e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c1111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.489+0000 7fc88178e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c1111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58358/0 (socket says 172.21.15.88:58358) 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.489+0000 7fc88178e700 1 -- 172.21.15.88:0/2067791855 learned_addr learned my addr 172.21.15.88:0/2067791855 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.489+0000 7fc88178e700 1 -- 172.21.15.88:0/2067791855 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780094f0 con 0x7fc87c070fe0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.489+0000 7fc88178e700 1 --2- 172.21.15.88:0/2067791855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c1111a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8780094c0 tx=0x7fc878009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.489+0000 7fc871ffb700 1 -- 172.21.15.88:0/2067791855 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc878010850 con 0x7fc87c070fe0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.490+0000 7fc871ffb700 1 -- 172.21.15.88:0/2067791855 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc878010e60 con 0x7fc87c070fe0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.490+0000 7fc871ffb700 1 -- 172.21.15.88:0/2067791855 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc87801a430 con 0x7fc87c070fe0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.490+0000 7fc8839f2700 1 -- 172.21.15.88:0/2067791855 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c1118e0 con 0x7fc87c070fe0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.490+0000 7fc8839f2700 1 -- 172.21.15.88:0/2067791855 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87c111cf0 con 0x7fc87c070fe0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.490+0000 7fc871ffb700 1 -- 172.21.15.88:0/2067791855 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc8780247b0 con 0x7fc87c070fe0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.491+0000 7fc871ffb700 1 --2- 172.21.15.88:0/2067791855 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fc868036640 0x7fc868038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.491+0000 7fc871ffb700 1 -- 172.21.15.88:0/2067791855 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc87804a4b0 con 0x7fc87c070fe0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.491+0000 7fc880f8d700 1 --2- 172.21.15.88:0/2067791855 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fc868036640 0x7fc868038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.491+0000 7fc8839f2700 1 -- 172.21.15.88:0/2067791855 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87c04bb80 con 0x7fc87c070fe0 2023-12-09T02:28:32.157 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.491+0000 7fc880f8d700 1 --2- 172.21.15.88:0/2067791855 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fc868036640 0x7fc868038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc86c009990 tx=0x7fc86c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.496+0000 7fc871ffb700 1 -- 172.21.15.88:0/2067791855 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc878022520 con 0x7fc87c070fe0 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.694+0000 7fc8839f2700 1 -- 172.21.15.88:0/2067791855 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fc87c10ad10 con 0x7fc868036640 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.698+0000 7fc871ffb700 1 -- 172.21.15.88:0/2067791855 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fc87c10ad10 con 0x7fc868036640 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.700+0000 7fc8839f2700 1 -- 172.21.15.88:0/2067791855 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fc868036640 msgr2=0x7fc868038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.700+0000 7fc8839f2700 1 --2- 172.21.15.88:0/2067791855 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fc868036640 0x7fc868038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc86c009990 tx=0x7fc86c006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.700+0000 7fc8839f2700 1 -- 172.21.15.88:0/2067791855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 msgr2=0x7fc87c1111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.700+0000 7fc8839f2700 1 --2- 172.21.15.88:0/2067791855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c1111a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8780094c0 tx=0x7fc878009250 comp rx=0 tx=0).stop 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.701+0000 7fc8839f2700 1 -- 172.21.15.88:0/2067791855 shutdown_connections 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.701+0000 7fc8839f2700 1 --2- 172.21.15.88:0/2067791855 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fc868036640 0x7fc868038af0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.701+0000 7fc8839f2700 1 --2- 172.21.15.88:0/2067791855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc87c070fe0 0x7fc87c1111a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.701+0000 7fc8839f2700 1 -- 172.21.15.88:0/2067791855 >> 172.21.15.88:0/2067791855 conn(0x7fc87c0fc970 msgr2=0x7fc87c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.701+0000 7fc8839f2700 1 -- 172.21.15.88:0/2067791855 shutdown_connections 2023-12-09T02:28:32.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:31.701+0000 7fc8839f2700 1 -- 172.21.15.88:0/2067791855 wait complete. 2023-12-09T02:28:32.159 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying node-exporter service with default placement... 2023-12-09T02:28:32.968 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:32 smithi088 ceph-mon[112028]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:32.969 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:32 smithi088 ceph-mon[112028]: Saving service grafana spec with placement count:1 2023-12-09T02:28:32.969 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:32 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:33.054 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.484+0000 7f3d94203700 1 Processor -- start 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.484+0000 7f3d94203700 1 -- start start 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.484+0000 7f3d94203700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c0771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.484+0000 7f3d94203700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c077710 con 0x7f3d8c078dc0 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.485+0000 7f3d91f9f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c0771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.485+0000 7f3d91f9f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c0771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58370/0 (socket says 172.21.15.88:58370) 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.485+0000 7f3d91f9f700 1 -- 172.21.15.88:0/3741861079 learned_addr learned my addr 172.21.15.88:0/3741861079 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.485+0000 7f3d91f9f700 1 -- 172.21.15.88:0/3741861079 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c077850 con 0x7f3d8c078dc0 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.485+0000 7f3d91f9f700 1 --2- 172.21.15.88:0/3741861079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c0771d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0098e0 tx=0x7f3d7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27e4011934a2d6d server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.485+0000 7f3d90f9d700 1 -- 172.21.15.88:0/3741861079 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d7c00b860 con 0x7f3d8c078dc0 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.485+0000 7f3d90f9d700 1 -- 172.21.15.88:0/3741861079 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d7c00be70 con 0x7f3d8c078dc0 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.485+0000 7f3d90f9d700 1 -- 172.21.15.88:0/3741861079 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d7c010380 con 0x7f3d8c078dc0 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.486+0000 7f3d94203700 1 -- 172.21.15.88:0/3741861079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 msgr2=0x7f3d8c0771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:33.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.486+0000 7f3d94203700 1 --2- 172.21.15.88:0/3741861079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c0771d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0098e0 tx=0x7f3d7c009250 comp rx=0 tx=0).stop 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.486+0000 7f3d94203700 1 -- 172.21.15.88:0/3741861079 shutdown_connections 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.486+0000 7f3d94203700 1 --2- 172.21.15.88:0/3741861079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c0771d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.486+0000 7f3d94203700 1 -- 172.21.15.88:0/3741861079 >> 172.21.15.88:0/3741861079 conn(0x7f3d8c0fda40 msgr2=0x7f3d8c0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.486+0000 7f3d94203700 1 -- 172.21.15.88:0/3741861079 shutdown_connections 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.486+0000 7f3d94203700 1 -- 172.21.15.88:0/3741861079 wait complete. 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.486+0000 7f3d94203700 1 Processor -- start 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.486+0000 7f3d94203700 1 -- start start 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d94203700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d94203700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c1138b0 con 0x7f3d8c078dc0 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d91f9f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d91f9f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58376/0 (socket says 172.21.15.88:58376) 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d91f9f700 1 -- 172.21.15.88:0/1349425414 learned_addr learned my addr 172.21.15.88:0/1349425414 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d91f9f700 1 -- 172.21.15.88:0/1349425414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c0094f0 con 0x7f3d8c078dc0 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d91f9f700 1 --2- 172.21.15.88:0/1349425414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c113370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00ba70 tx=0x7f3d7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:33.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d827fc700 1 -- 172.21.15.88:0/1349425414 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d7c010960 con 0x7f3d8c078dc0 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d827fc700 1 -- 172.21.15.88:0/1349425414 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d7c024430 con 0x7f3d8c078dc0 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d827fc700 1 -- 172.21.15.88:0/1349425414 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d7c01a5f0 con 0x7f3d8c078dc0 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d94203700 1 -- 172.21.15.88:0/1349425414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c113ab0 con 0x7f3d8c078dc0 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.487+0000 7f3d94203700 1 -- 172.21.15.88:0/1349425414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c113ec0 con 0x7f3d8c078dc0 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.488+0000 7f3d827fc700 1 -- 172.21.15.88:0/1349425414 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f3d7c01a860 con 0x7f3d8c078dc0 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.488+0000 7f3d827fc700 1 --2- 172.21.15.88:0/1349425414 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f3d78036640 0x7f3d78038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.488+0000 7f3d827fc700 1 -- 172.21.15.88:0/1349425414 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3d7c04a260 con 0x7f3d8c078dc0 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.488+0000 7f3d9179e700 1 --2- 172.21.15.88:0/1349425414 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f3d78036640 0x7f3d78038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.488+0000 7f3d94203700 1 -- 172.21.15.88:0/1349425414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c108620 con 0x7f3d8c078dc0 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.489+0000 7f3d9179e700 1 --2- 172.21.15.88:0/1349425414 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f3d78036640 0x7f3d78038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009990 tx=0x7f3d88006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.493+0000 7f3d827fc700 1 -- 172.21.15.88:0/1349425414 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3d7c018b40 con 0x7f3d8c078dc0 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.684+0000 7f3d94203700 1 -- 172.21.15.88:0/1349425414 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d8c10cf90 con 0x7f3d78036640 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.688+0000 7f3d827fc700 1 -- 172.21.15.88:0/1349425414 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f3d8c10cf90 con 0x7f3d78036640 2023-12-09T02:28:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.690+0000 7f3d94203700 1 -- 172.21.15.88:0/1349425414 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f3d78036640 msgr2=0x7f3d78038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:33.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.690+0000 7f3d94203700 1 --2- 172.21.15.88:0/1349425414 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f3d78036640 0x7f3d78038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009990 tx=0x7f3d88006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:33.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.690+0000 7f3d94203700 1 -- 172.21.15.88:0/1349425414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 msgr2=0x7f3d8c113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:33.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.690+0000 7f3d94203700 1 --2- 172.21.15.88:0/1349425414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c113370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00ba70 tx=0x7f3d7c009250 comp rx=0 tx=0).stop 2023-12-09T02:28:33.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.690+0000 7f3d94203700 1 -- 172.21.15.88:0/1349425414 shutdown_connections 2023-12-09T02:28:33.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.690+0000 7f3d94203700 1 --2- 172.21.15.88:0/1349425414 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f3d78036640 0x7f3d78038af0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:33.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.690+0000 7f3d94203700 1 --2- 172.21.15.88:0/1349425414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c078dc0 0x7f3d8c113370 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:33.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.690+0000 7f3d94203700 1 -- 172.21.15.88:0/1349425414 >> 172.21.15.88:0/1349425414 conn(0x7f3d8c0fda40 msgr2=0x7f3d8c0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:33.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.690+0000 7f3d94203700 1 -- 172.21.15.88:0/1349425414 shutdown_connections 2023-12-09T02:28:33.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:32.690+0000 7f3d94203700 1 -- 172.21.15.88:0/1349425414 wait complete. 2023-12-09T02:28:33.058 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying alertmanager service with default placement... 2023-12-09T02:28:33.919 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:33 smithi088 ceph-mon[112028]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:33.919 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:33 smithi088 ceph-mon[112028]: Saving service node-exporter spec with placement * 2023-12-09T02:28:33.919 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:33 smithi088 ceph-mon[112028]: from='mgr.14120 172.21.15.88:0/3853826017' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:33.974 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-09T02:28:33.974 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.405+0000 7f0197811700 1 Processor -- start 2023-12-09T02:28:33.974 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.405+0000 7f0197811700 1 -- start start 2023-12-09T02:28:33.974 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.405+0000 7f0197811700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f0190104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:33.974 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.405+0000 7f0197811700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01901053e0 con 0x7f0190071000 2023-12-09T02:28:33.974 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.406+0000 7f01955ad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f0190104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:33.975 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.406+0000 7f01955ad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f0190104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58378/0 (socket says 172.21.15.88:58378) 2023-12-09T02:28:33.975 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.406+0000 7f01955ad700 1 -- 172.21.15.88:0/3519257363 learned_addr learned my addr 172.21.15.88:0/3519257363 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:33.975 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.406+0000 7f01955ad700 1 -- 172.21.15.88:0/3519257363 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190105520 con 0x7f0190071000 2023-12-09T02:28:33.975 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.406+0000 7f01955ad700 1 --2- 172.21.15.88:0/3519257363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f0190104ea0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01800098e0 tx=0x7f0180009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89978c0b527a74db server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:33.975 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.406+0000 7f0187fff700 1 -- 172.21.15.88:0/3519257363 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f018000b860 con 0x7f0190071000 2023-12-09T02:28:33.975 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.406+0000 7f0187fff700 1 -- 172.21.15.88:0/3519257363 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f018000be70 con 0x7f0190071000 2023-12-09T02:28:33.975 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.406+0000 7f0187fff700 1 -- 172.21.15.88:0/3519257363 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0180010380 con 0x7f0190071000 2023-12-09T02:28:33.975 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.407+0000 7f0197811700 1 -- 172.21.15.88:0/3519257363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 msgr2=0x7f0190104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:33.975 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.407+0000 7f0197811700 1 --2- 172.21.15.88:0/3519257363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f0190104ea0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01800098e0 tx=0x7f0180009250 comp rx=0 tx=0).stop 2023-12-09T02:28:33.975 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.407+0000 7f0197811700 1 -- 172.21.15.88:0/3519257363 shutdown_connections 2023-12-09T02:28:33.976 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.407+0000 7f0197811700 1 --2- 172.21.15.88:0/3519257363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f0190104ea0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:33.976 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.407+0000 7f0197811700 1 -- 172.21.15.88:0/3519257363 >> 172.21.15.88:0/3519257363 conn(0x7f01900fc970 msgr2=0x7f01900fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:33.976 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.407+0000 7f0197811700 1 -- 172.21.15.88:0/3519257363 shutdown_connections 2023-12-09T02:28:33.976 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.407+0000 7f0197811700 1 -- 172.21.15.88:0/3519257363 wait complete. 2023-12-09T02:28:33.976 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.407+0000 7f0197811700 1 Processor -- start 2023-12-09T02:28:33.976 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.407+0000 7f0197811700 1 -- start start 2023-12-09T02:28:33.976 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.407+0000 7f0197811700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f01901111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:33.976 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.407+0000 7f0197811700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01901116e0 con 0x7f0190071000 2023-12-09T02:28:33.977 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.408+0000 7f01955ad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f01901111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:33.977 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.408+0000 7f01955ad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f01901111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58382/0 (socket says 172.21.15.88:58382) 2023-12-09T02:28:33.977 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.408+0000 7f01955ad700 1 -- 172.21.15.88:0/3509926126 learned_addr learned my addr 172.21.15.88:0/3509926126 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:33.977 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.408+0000 7f01955ad700 1 -- 172.21.15.88:0/3509926126 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800094f0 con 0x7f0190071000 2023-12-09T02:28:33.977 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.408+0000 7f01955ad700 1 --2- 172.21.15.88:0/3509926126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f01901111a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0180006d40 tx=0x7f0180009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:33.977 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.408+0000 7f0185ffb700 1 -- 172.21.15.88:0/3509926126 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0180010960 con 0x7f0190071000 2023-12-09T02:28:33.977 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.408+0000 7f0185ffb700 1 -- 172.21.15.88:0/3509926126 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f018001a430 con 0x7f0190071000 2023-12-09T02:28:33.977 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.408+0000 7f0197811700 1 -- 172.21.15.88:0/3509926126 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01901118e0 con 0x7f0190071000 2023-12-09T02:28:33.977 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.408+0000 7f0185ffb700 1 -- 172.21.15.88:0/3509926126 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01800245b0 con 0x7f0190071000 2023-12-09T02:28:33.977 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.408+0000 7f0197811700 1 -- 172.21.15.88:0/3509926126 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0190111cf0 con 0x7f0190071000 2023-12-09T02:28:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.409+0000 7f0185ffb700 1 -- 172.21.15.88:0/3509926126 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f018002d3f0 con 0x7f0190071000 2023-12-09T02:28:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.409+0000 7f0185ffb700 1 --2- 172.21.15.88:0/3509926126 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f017c036640 0x7f017c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.409+0000 7f0185ffb700 1 -- 172.21.15.88:0/3509926126 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f018004a240 con 0x7f0190071000 2023-12-09T02:28:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.409+0000 7f0197811700 1 -- 172.21.15.88:0/3509926126 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019004bb80 con 0x7f0190071000 2023-12-09T02:28:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.409+0000 7f0194dac700 1 --2- 172.21.15.88:0/3509926126 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f017c036640 0x7f017c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.410+0000 7f0194dac700 1 --2- 172.21.15.88:0/3509926126 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f017c036640 0x7f017c038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f018c009990 tx=0x7f018c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.414+0000 7f0185ffb700 1 -- 172.21.15.88:0/3509926126 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f018002b8e0 con 0x7f0190071000 2023-12-09T02:28:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.607+0000 7f0197811700 1 -- 172.21.15.88:0/3509926126 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f019010b070 con 0x7f017c036640 2023-12-09T02:28:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.611+0000 7f0185ffb700 1 -- 172.21.15.88:0/3509926126 <== mgr.14120 v2:172.21.15.88:6800/2611357961 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f019010b070 con 0x7f017c036640 2023-12-09T02:28:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.613+0000 7f0197811700 1 -- 172.21.15.88:0/3509926126 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f017c036640 msgr2=0x7f017c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.613+0000 7f0197811700 1 --2- 172.21.15.88:0/3509926126 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f017c036640 0x7f017c038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f018c009990 tx=0x7f018c006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.613+0000 7f0197811700 1 -- 172.21.15.88:0/3509926126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 msgr2=0x7f01901111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.613+0000 7f0197811700 1 --2- 172.21.15.88:0/3509926126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f01901111a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0180006d40 tx=0x7f0180009250 comp rx=0 tx=0).stop 2023-12-09T02:28:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.613+0000 7f0197811700 1 -- 172.21.15.88:0/3509926126 shutdown_connections 2023-12-09T02:28:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.613+0000 7f0197811700 1 --2- 172.21.15.88:0/3509926126 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f017c036640 0x7f017c038af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.613+0000 7f0197811700 1 --2- 172.21.15.88:0/3509926126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0190071000 0x7f01901111a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.613+0000 7f0197811700 1 -- 172.21.15.88:0/3509926126 >> 172.21.15.88:0/3509926126 conn(0x7f01900fc970 msgr2=0x7f01900fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.613+0000 7f0197811700 1 -- 172.21.15.88:0/3509926126 shutdown_connections 2023-12-09T02:28:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:33.613+0000 7f0197811700 1 -- 172.21.15.88:0/3509926126 wait complete. 2023-12-09T02:28:34.785 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:34 smithi088 ceph-mon[112028]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:34.785 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:34 smithi088 ceph-mon[112028]: Saving service alertmanager spec with placement count:1 2023-12-09T02:28:34.785 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:34 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1537551155' entity='client.admin' 2023-12-09T02:28:34.887 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.315+0000 7ff63ba71700 1 Processor -- start 2023-12-09T02:28:34.887 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.315+0000 7ff63ba71700 1 -- start start 2023-12-09T02:28:34.887 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.315+0000 7ff63ba71700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff634104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:34.887 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.315+0000 7ff63ba71700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6341053e0 con 0x7ff634071000 2023-12-09T02:28:34.887 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.315+0000 7ff63980d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff634104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:34.887 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.315+0000 7ff63980d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff634104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58394/0 (socket says 172.21.15.88:58394) 2023-12-09T02:28:34.887 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.315+0000 7ff63980d700 1 -- 172.21.15.88:0/2225681164 learned_addr learned my addr 172.21.15.88:0/2225681164 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:34.887 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.316+0000 7ff63980d700 1 -- 172.21.15.88:0/2225681164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff634105520 con 0x7ff634071000 2023-12-09T02:28:34.887 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.316+0000 7ff63980d700 1 --2- 172.21.15.88:0/2225681164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff634104ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6300098e0 tx=0x7ff630009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feba77470cf3e898 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:34.887 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.316+0000 7ff63880b700 1 -- 172.21.15.88:0/2225681164 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff63000b860 con 0x7ff634071000 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.316+0000 7ff63880b700 1 -- 172.21.15.88:0/2225681164 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff63000be70 con 0x7ff634071000 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.316+0000 7ff63880b700 1 -- 172.21.15.88:0/2225681164 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff630010380 con 0x7ff634071000 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.316+0000 7ff63ba71700 1 -- 172.21.15.88:0/2225681164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 msgr2=0x7ff634104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.316+0000 7ff63ba71700 1 --2- 172.21.15.88:0/2225681164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff634104ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6300098e0 tx=0x7ff630009250 comp rx=0 tx=0).stop 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.316+0000 7ff63ba71700 1 -- 172.21.15.88:0/2225681164 shutdown_connections 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.316+0000 7ff63ba71700 1 --2- 172.21.15.88:0/2225681164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff634104ea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.316+0000 7ff63ba71700 1 -- 172.21.15.88:0/2225681164 >> 172.21.15.88:0/2225681164 conn(0x7ff6340fc970 msgr2=0x7ff6340fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.316+0000 7ff63ba71700 1 -- 172.21.15.88:0/2225681164 shutdown_connections 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.317+0000 7ff63ba71700 1 -- 172.21.15.88:0/2225681164 wait complete. 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.317+0000 7ff63ba71700 1 Processor -- start 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.317+0000 7ff63ba71700 1 -- start start 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.317+0000 7ff63ba71700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff6341111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:34.888 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.317+0000 7ff63ba71700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634111700 con 0x7ff634071000 2023-12-09T02:28:34.889 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.317+0000 7ff63980d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff6341111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:34.889 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.317+0000 7ff63980d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff6341111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58400/0 (socket says 172.21.15.88:58400) 2023-12-09T02:28:34.889 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.317+0000 7ff63980d700 1 -- 172.21.15.88:0/1537551155 learned_addr learned my addr 172.21.15.88:0/1537551155 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:34.889 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.317+0000 7ff63980d700 1 -- 172.21.15.88:0/1537551155 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6300094f0 con 0x7ff634071000 2023-12-09T02:28:34.889 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.318+0000 7ff63980d700 1 --2- 172.21.15.88:0/1537551155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff6341111c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6300094c0 tx=0x7ff630009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:34.889 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.318+0000 7ff62a7fc700 1 -- 172.21.15.88:0/1537551155 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff630010850 con 0x7ff634071000 2023-12-09T02:28:34.889 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.318+0000 7ff62a7fc700 1 -- 172.21.15.88:0/1537551155 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff630010e60 con 0x7ff634071000 2023-12-09T02:28:34.889 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.318+0000 7ff63ba71700 1 -- 172.21.15.88:0/1537551155 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff634111900 con 0x7ff634071000 2023-12-09T02:28:34.889 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.318+0000 7ff62a7fc700 1 -- 172.21.15.88:0/1537551155 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff63001a430 con 0x7ff634071000 2023-12-09T02:28:34.889 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.318+0000 7ff63ba71700 1 -- 172.21.15.88:0/1537551155 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff634111d10 con 0x7ff634071000 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.319+0000 7ff62a7fc700 1 -- 172.21.15.88:0/1537551155 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7ff6300109b0 con 0x7ff634071000 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.319+0000 7ff63ba71700 1 -- 172.21.15.88:0/1537551155 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63404bb80 con 0x7ff634071000 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.319+0000 7ff62a7fc700 1 --2- 172.21.15.88:0/1537551155 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7ff620036640 0x7ff620038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.319+0000 7ff62a7fc700 1 -- 172.21.15.88:0/1537551155 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff63004a3f0 con 0x7ff634071000 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.319+0000 7ff63900c700 1 --2- 172.21.15.88:0/1537551155 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7ff620036640 0x7ff620038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.319+0000 7ff63900c700 1 --2- 172.21.15.88:0/1537551155 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7ff620036640 0x7ff620038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff624009990 tx=0x7ff624006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.324+0000 7ff62a7fc700 1 -- 172.21.15.88:0/1537551155 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff630010c60 con 0x7ff634071000 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.503+0000 7ff63ba71700 1 -- 172.21.15.88:0/1537551155 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7ff634106300 con 0x7ff634071000 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.506+0000 7ff62a7fc700 1 -- 172.21.15.88:0/1537551155 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7ff63002ce20 con 0x7ff634071000 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.508+0000 7ff63ba71700 1 -- 172.21.15.88:0/1537551155 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7ff620036640 msgr2=0x7ff620038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.508+0000 7ff63ba71700 1 --2- 172.21.15.88:0/1537551155 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7ff620036640 0x7ff620038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff624009990 tx=0x7ff624006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.508+0000 7ff63ba71700 1 -- 172.21.15.88:0/1537551155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 msgr2=0x7ff6341111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.508+0000 7ff63ba71700 1 --2- 172.21.15.88:0/1537551155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff6341111c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6300094c0 tx=0x7ff630009250 comp rx=0 tx=0).stop 2023-12-09T02:28:34.890 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.508+0000 7ff63ba71700 1 -- 172.21.15.88:0/1537551155 shutdown_connections 2023-12-09T02:28:34.891 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.508+0000 7ff63ba71700 1 --2- 172.21.15.88:0/1537551155 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7ff620036640 0x7ff620038af0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:34.891 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.508+0000 7ff63ba71700 1 --2- 172.21.15.88:0/1537551155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff634071000 0x7ff6341111c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:34.891 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.508+0000 7ff63ba71700 1 -- 172.21.15.88:0/1537551155 >> 172.21.15.88:0/1537551155 conn(0x7ff6340fc970 msgr2=0x7ff6340fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:34.891 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.509+0000 7ff63ba71700 1 -- 172.21.15.88:0/1537551155 shutdown_connections 2023-12-09T02:28:34.891 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:34.509+0000 7ff63ba71700 1 -- 172.21.15.88:0/1537551155 wait complete. 2023-12-09T02:28:35.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.230+0000 7f1b8fe21700 1 Processor -- start 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.231+0000 7f1b8fe21700 1 -- start start 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.231+0000 7f1b8fe21700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b88107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.231+0000 7f1b8fe21700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88102d10 con 0x7f1b88070f80 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.231+0000 7f1b8dbbd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b88107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.231+0000 7f1b8dbbd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b88107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58412/0 (socket says 172.21.15.88:58412) 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.231+0000 7f1b8dbbd700 1 -- 172.21.15.88:0/53514907 learned_addr learned my addr 172.21.15.88:0/53514907 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.231+0000 7f1b8dbbd700 1 -- 172.21.15.88:0/53514907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b88107860 con 0x7f1b88070f80 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.231+0000 7f1b8dbbd700 1 --2- 172.21.15.88:0/53514907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b88107320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b780098e0 tx=0x7f1b78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e370e4b983b0c58e server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.232+0000 7f1b8cbbb700 1 -- 172.21.15.88:0/53514907 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b7800b860 con 0x7f1b88070f80 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.232+0000 7f1b8cbbb700 1 -- 172.21.15.88:0/53514907 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b7800be70 con 0x7f1b88070f80 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.232+0000 7f1b8cbbb700 1 -- 172.21.15.88:0/53514907 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b78010380 con 0x7f1b88070f80 2023-12-09T02:28:35.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.232+0000 7f1b8fe21700 1 -- 172.21.15.88:0/53514907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 msgr2=0x7f1b88107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.232+0000 7f1b8fe21700 1 --2- 172.21.15.88:0/53514907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b88107320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b780098e0 tx=0x7f1b78009250 comp rx=0 tx=0).stop 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.232+0000 7f1b8fe21700 1 -- 172.21.15.88:0/53514907 shutdown_connections 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.232+0000 7f1b8fe21700 1 --2- 172.21.15.88:0/53514907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b88107320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.232+0000 7f1b8fe21700 1 -- 172.21.15.88:0/53514907 >> 172.21.15.88:0/53514907 conn(0x7f1b880fc970 msgr2=0x7f1b880fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.232+0000 7f1b8fe21700 1 -- 172.21.15.88:0/53514907 shutdown_connections 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.232+0000 7f1b8fe21700 1 -- 172.21.15.88:0/53514907 wait complete. 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b8fe21700 1 Processor -- start 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b8fe21700 1 -- start start 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b8fe21700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b881133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b8fe21700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88113900 con 0x7f1b88070f80 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b8dbbd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b881133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b8dbbd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b881133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58424/0 (socket says 172.21.15.88:58424) 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b8dbbd700 1 -- 172.21.15.88:0/26500610 learned_addr learned my addr 172.21.15.88:0/26500610 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:35.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b8dbbd700 1 -- 172.21.15.88:0/26500610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b780094f0 con 0x7f1b88070f80 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b8dbbd700 1 --2- 172.21.15.88:0/26500610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b881133c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1b78006d40 tx=0x7f1b78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b7e7fc700 1 -- 172.21.15.88:0/26500610 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b78010960 con 0x7f1b88070f80 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b7e7fc700 1 -- 172.21.15.88:0/26500610 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b7801a430 con 0x7f1b88070f80 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b8fe21700 1 -- 172.21.15.88:0/26500610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b88113b00 con 0x7f1b88070f80 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.233+0000 7f1b7e7fc700 1 -- 172.21.15.88:0/26500610 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b780245b0 con 0x7f1b88070f80 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.234+0000 7f1b8fe21700 1 -- 172.21.15.88:0/26500610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b88113f10 con 0x7f1b88070f80 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.234+0000 7f1b7e7fc700 1 -- 172.21.15.88:0/26500610 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f1b7801a9f0 con 0x7f1b88070f80 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.234+0000 7f1b8fe21700 1 -- 172.21.15.88:0/26500610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8804bb80 con 0x7f1b88070f80 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.234+0000 7f1b7e7fc700 1 --2- 172.21.15.88:0/26500610 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1b74036640 0x7f1b74038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.235+0000 7f1b7e7fc700 1 -- 172.21.15.88:0/26500610 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1b7804a090 con 0x7f1b88070f80 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.235+0000 7f1b8d3bc700 1 --2- 172.21.15.88:0/26500610 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1b74036640 0x7f1b74038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.235+0000 7f1b8d3bc700 1 --2- 172.21.15.88:0/26500610 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1b74036640 0x7f1b74038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009990 tx=0x7f1b84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.239+0000 7f1b7e7fc700 1 -- 172.21.15.88:0/26500610 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1b7807ba00 con 0x7f1b88070f80 2023-12-09T02:28:35.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.422+0000 7f1b8fe21700 1 -- 172.21.15.88:0/26500610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f1b881084c0 con 0x7f1b88070f80 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.425+0000 7f1b7e7fc700 1 -- 172.21.15.88:0/26500610 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f1b7802b4d0 con 0x7f1b88070f80 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.427+0000 7f1b8fe21700 1 -- 172.21.15.88:0/26500610 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1b74036640 msgr2=0x7f1b74038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.427+0000 7f1b8fe21700 1 --2- 172.21.15.88:0/26500610 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1b74036640 0x7f1b74038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009990 tx=0x7f1b84006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.427+0000 7f1b8fe21700 1 -- 172.21.15.88:0/26500610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 msgr2=0x7f1b881133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.427+0000 7f1b8fe21700 1 --2- 172.21.15.88:0/26500610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b881133c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1b78006d40 tx=0x7f1b78009250 comp rx=0 tx=0).stop 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.427+0000 7f1b8fe21700 1 -- 172.21.15.88:0/26500610 shutdown_connections 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.427+0000 7f1b8fe21700 1 --2- 172.21.15.88:0/26500610 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f1b74036640 0x7f1b74038af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.427+0000 7f1b8fe21700 1 --2- 172.21.15.88:0/26500610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b88070f80 0x7f1b881133c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.427+0000 7f1b8fe21700 1 -- 172.21.15.88:0/26500610 >> 172.21.15.88:0/26500610 conn(0x7f1b880fc970 msgr2=0x7f1b880fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.427+0000 7f1b8fe21700 1 -- 172.21.15.88:0/26500610 shutdown_connections 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:35.427+0000 7f1b8fe21700 1 -- 172.21.15.88:0/26500610 wait complete. 2023-12-09T02:28:35.792 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling the dashboard module... 2023-12-09T02:28:36.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:36 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/26500610' entity='client.admin' 2023-12-09T02:28:36.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:36 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3898306658' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-09T02:28:36.836 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.154+0000 7fde7d50e700 1 Processor -- start 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.155+0000 7fde7d50e700 1 -- start start 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.155+0000 7fde7d50e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78102be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.155+0000 7fde7d50e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78103120 con 0x7fde781027d0 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.155+0000 7fde76ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.155+0000 7fde76ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78102be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58436/0 (socket says 172.21.15.88:58436) 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.155+0000 7fde76ffd700 1 -- 172.21.15.88:0/1657161190 learned_addr learned my addr 172.21.15.88:0/1657161190 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.155+0000 7fde76ffd700 1 -- 172.21.15.88:0/1657161190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78103260 con 0x7fde781027d0 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.155+0000 7fde76ffd700 1 --2- 172.21.15.88:0/1657161190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78102be0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde680098e0 tx=0x7fde68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3a429d56ef424e server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.155+0000 7fde75ffb700 1 -- 172.21.15.88:0/1657161190 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde6800b860 con 0x7fde781027d0 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.155+0000 7fde75ffb700 1 -- 172.21.15.88:0/1657161190 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fde6800be70 con 0x7fde781027d0 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.155+0000 7fde75ffb700 1 -- 172.21.15.88:0/1657161190 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde68010380 con 0x7fde781027d0 2023-12-09T02:28:36.837 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.156+0000 7fde7d50e700 1 -- 172.21.15.88:0/1657161190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 msgr2=0x7fde78102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.156+0000 7fde7d50e700 1 --2- 172.21.15.88:0/1657161190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78102be0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde680098e0 tx=0x7fde68009250 comp rx=0 tx=0).stop 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.156+0000 7fde7d50e700 1 -- 172.21.15.88:0/1657161190 shutdown_connections 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.156+0000 7fde7d50e700 1 --2- 172.21.15.88:0/1657161190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78102be0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.156+0000 7fde7d50e700 1 -- 172.21.15.88:0/1657161190 >> 172.21.15.88:0/1657161190 conn(0x7fde780fc0b0 msgr2=0x7fde780fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.156+0000 7fde7d50e700 1 -- 172.21.15.88:0/1657161190 shutdown_connections 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.156+0000 7fde7d50e700 1 -- 172.21.15.88:0/1657161190 wait complete. 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde7d50e700 1 Processor -- start 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde7d50e700 1 -- start start 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde7d50e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde7d50e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde781116a0 con 0x7fde781027d0 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde76ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde76ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58446/0 (socket says 172.21.15.88:58446) 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde76ffd700 1 -- 172.21.15.88:0/3898306658 learned_addr learned my addr 172.21.15.88:0/3898306658 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:36.838 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde76ffd700 1 -- 172.21.15.88:0/3898306658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680094f0 con 0x7fde781027d0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde76ffd700 1 --2- 172.21.15.88:0/3898306658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78111160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde68011b60 tx=0x7fde68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde5f7fe700 1 -- 172.21.15.88:0/3898306658 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde68010850 con 0x7fde781027d0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde5f7fe700 1 -- 172.21.15.88:0/3898306658 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fde68010e60 con 0x7fde781027d0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde7d50e700 1 -- 172.21.15.88:0/3898306658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde781118a0 con 0x7fde781027d0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.157+0000 7fde5f7fe700 1 -- 172.21.15.88:0/3898306658 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde6801ae20 con 0x7fde781027d0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.158+0000 7fde7d50e700 1 -- 172.21.15.88:0/3898306658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde78111cb0 con 0x7fde781027d0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.158+0000 7fde5f7fe700 1 -- 172.21.15.88:0/3898306658 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fde6802d3f0 con 0x7fde781027d0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.158+0000 7fde5f7fe700 1 --2- 172.21.15.88:0/3898306658 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fde60036640 0x7fde60038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.158+0000 7fde5f7fe700 1 -- 172.21.15.88:0/3898306658 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fde6804a1b0 con 0x7fde781027d0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.159+0000 7fde767fc700 1 --2- 172.21.15.88:0/3898306658 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fde60036640 0x7fde60038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.159+0000 7fde7d50e700 1 -- 172.21.15.88:0/3898306658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7804bb80 con 0x7fde781027d0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.159+0000 7fde767fc700 1 --2- 172.21.15.88:0/3898306658 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fde60036640 0x7fde60038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009990 tx=0x7fde6c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.163+0000 7fde5f7fe700 1 -- 172.21.15.88:0/3898306658 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fde6802b8e0 con 0x7fde781027d0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.395+0000 7fde7d50e700 1 -- 172.21.15.88:0/3898306658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fde78112640 con 0x7fde781027d0 2023-12-09T02:28:36.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.425+0000 7fde5f7fe700 1 -- 172.21.15.88:0/3898306658 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fde680193c0 con 0x7fde781027d0 2023-12-09T02:28:36.840 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.426+0000 7fde5f7fe700 1 -- 172.21.15.88:0/3898306658 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fde68016620 con 0x7fde781027d0 2023-12-09T02:28:36.840 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.428+0000 7fde7d50e700 1 -- 172.21.15.88:0/3898306658 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fde60036640 msgr2=0x7fde60038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:36.840 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.428+0000 7fde7d50e700 1 --2- 172.21.15.88:0/3898306658 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fde60036640 0x7fde60038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009990 tx=0x7fde6c006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:36.840 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.428+0000 7fde7d50e700 1 -- 172.21.15.88:0/3898306658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 msgr2=0x7fde78111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:36.840 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.428+0000 7fde7d50e700 1 --2- 172.21.15.88:0/3898306658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78111160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde68011b60 tx=0x7fde68009250 comp rx=0 tx=0).stop 2023-12-09T02:28:36.840 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.428+0000 7fde7d50e700 1 -- 172.21.15.88:0/3898306658 shutdown_connections 2023-12-09T02:28:36.840 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.428+0000 7fde7d50e700 1 --2- 172.21.15.88:0/3898306658 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fde60036640 0x7fde60038af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:36.840 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.428+0000 7fde7d50e700 1 --2- 172.21.15.88:0/3898306658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde781027d0 0x7fde78111160 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:36.840 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.428+0000 7fde7d50e700 1 -- 172.21.15.88:0/3898306658 >> 172.21.15.88:0/3898306658 conn(0x7fde780fc0b0 msgr2=0x7fde78100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:36.840 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.429+0000 7fde7d50e700 1 -- 172.21.15.88:0/3898306658 shutdown_connections 2023-12-09T02:28:36.841 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:36.429+0000 7fde7d50e700 1 -- 172.21.15.88:0/3898306658 wait complete. 2023-12-09T02:28:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:37 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3898306658' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-09T02:28:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:37 smithi088 ceph-mon[112028]: mgrmap e9: smithi088.jwlofb(active, since 17s) 2023-12-09T02:28:37.820 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-12-09T02:28:37.820 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "active_name": "smithi088.jwlofb", 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.255+0000 7f7800e48700 1 Processor -- start 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.255+0000 7f7800e48700 1 -- start start 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.255+0000 7f7800e48700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc104f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.255+0000 7f7800e48700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc1054c0 con 0x7f77fc070f20 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.255+0000 7f77fa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.255+0000 7f77fa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc104f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50656/0 (socket says 172.21.15.88:50656) 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.255+0000 7f77fa59c700 1 -- 172.21.15.88:0/3412917117 learned_addr learned my addr 172.21.15.88:0/3412917117 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.256+0000 7f77fa59c700 1 -- 172.21.15.88:0/3412917117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc105600 con 0x7f77fc070f20 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.256+0000 7f77fa59c700 1 --2- 172.21.15.88:0/3412917117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc104f80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0098e0 tx=0x7f77ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb199680ad9410f server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.256+0000 7f77f959a700 1 -- 172.21.15.88:0/3412917117 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77ec00b860 con 0x7f77fc070f20 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.256+0000 7f77f959a700 1 -- 172.21.15.88:0/3412917117 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f77ec00be70 con 0x7f77fc070f20 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.256+0000 7f77f959a700 1 -- 172.21.15.88:0/3412917117 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77ec010380 con 0x7f77fc070f20 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.257+0000 7f7800e48700 1 -- 172.21.15.88:0/3412917117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 msgr2=0x7f77fc104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.257+0000 7f7800e48700 1 --2- 172.21.15.88:0/3412917117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc104f80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0098e0 tx=0x7f77ec009250 comp rx=0 tx=0).stop 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.257+0000 7f7800e48700 1 -- 172.21.15.88:0/3412917117 shutdown_connections 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.257+0000 7f7800e48700 1 --2- 172.21.15.88:0/3412917117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc104f80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.257+0000 7f7800e48700 1 -- 172.21.15.88:0/3412917117 >> 172.21.15.88:0/3412917117 conn(0x7f77fc0fc970 msgr2=0x7f77fc0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.257+0000 7f7800e48700 1 -- 172.21.15.88:0/3412917117 shutdown_connections 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.257+0000 7f7800e48700 1 -- 172.21.15.88:0/3412917117 wait complete. 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.258+0000 7f7800e48700 1 Processor -- start 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.258+0000 7f7800e48700 1 -- start start 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.258+0000 7f7800e48700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc1111d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.258+0000 7f7800e48700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc111710 con 0x7f77fc070f20 2023-12-09T02:28:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.258+0000 7f77fa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc1111d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.258+0000 7f77fa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc1111d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50660/0 (socket says 172.21.15.88:50660) 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.258+0000 7f77fa59c700 1 -- 172.21.15.88:0/3229966532 learned_addr learned my addr 172.21.15.88:0/3229966532 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.258+0000 7f77fa59c700 1 -- 172.21.15.88:0/3229966532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec0094f0 con 0x7f77fc070f20 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.259+0000 7f77fa59c700 1 --2- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc1111d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0094c0 tx=0x7f77ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.259+0000 7f77eaffd700 1 -- 172.21.15.88:0/3229966532 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77ec010850 con 0x7f77fc070f20 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.259+0000 7f77eaffd700 1 -- 172.21.15.88:0/3229966532 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f77ec010e60 con 0x7f77fc070f20 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.259+0000 7f7800e48700 1 -- 172.21.15.88:0/3229966532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc111910 con 0x7f77fc070f20 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.259+0000 7f77eaffd700 1 -- 172.21.15.88:0/3229966532 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77ec0243f0 con 0x7f77fc070f20 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.259+0000 7f7800e48700 1 -- 172.21.15.88:0/3229966532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc111d20 con 0x7f77fc070f20 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.260+0000 7f7800e48700 1 -- 172.21.15.88:0/3229966532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77fc04bb80 con 0x7f77fc070f20 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.260+0000 7f77eaffd700 1 -- 172.21.15.88:0/3229966532 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f77ec01a7a0 con 0x7f77fc070f20 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.260+0000 7f77eaffd700 1 --2- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f77e4036640 0x7f77e4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.260+0000 7f77eaffd700 1 -- 172.21.15.88:0/3229966532 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f77ec04a850 con 0x7f77fc070f20 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.260+0000 7f77f9d9b700 1 -- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f77e4036640 msgr2=0x7f77e4038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2611357961 2023-12-09T02:28:37.823 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.260+0000 7f77f9d9b700 1 --2- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f77e4036640 0x7f77e4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.264+0000 7f77eaffd700 1 -- 172.21.15.88:0/3229966532 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f77ec02c930 con 0x7f77fc070f20 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.461+0000 7f77f9d9b700 1 -- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f77e4036640 msgr2=0x7f77e4038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2611357961 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.461+0000 7f77f9d9b700 1 --2- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f77e4036640 0x7f77e4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.506+0000 7f7800e48700 1 -- 172.21.15.88:0/3229966532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f77fc10afb0 con 0x7f77fc070f20 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.506+0000 7f77eaffd700 1 -- 172.21.15.88:0/3229966532 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f77ec02c340 con 0x7f77fc070f20 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.508+0000 7f7800e48700 1 -- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f77e4036640 msgr2=0x7f77e4038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.508+0000 7f7800e48700 1 --2- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f77e4036640 0x7f77e4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.508+0000 7f7800e48700 1 -- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 msgr2=0x7f77fc1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.508+0000 7f7800e48700 1 --2- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc1111d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0094c0 tx=0x7f77ec009250 comp rx=0 tx=0).stop 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.509+0000 7f7800e48700 1 -- 172.21.15.88:0/3229966532 shutdown_connections 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.509+0000 7f7800e48700 1 --2- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7f77e4036640 0x7f77e4038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.509+0000 7f7800e48700 1 --2- 172.21.15.88:0/3229966532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77fc070f20 0x7f77fc1111d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.509+0000 7f7800e48700 1 -- 172.21.15.88:0/3229966532 >> 172.21.15.88:0/3229966532 conn(0x7f77fc0fc970 msgr2=0x7f77fc0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.509+0000 7f7800e48700 1 -- 172.21.15.88:0/3229966532 shutdown_connections 2023-12-09T02:28:37.824 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:37.509+0000 7f7800e48700 1 -- 172.21.15.88:0/3229966532 wait complete. 2023-12-09T02:28:37.825 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for the mgr to restart... 2023-12-09T02:28:37.825 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr epoch 9... 2023-12-09T02:28:38.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:38 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3229966532' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-09T02:28:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: Active manager daemon smithi088.jwlofb restarted 2023-12-09T02:28:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: Activating manager daemon smithi088.jwlofb 2023-12-09T02:28:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: osdmap e3: 0 total, 0 up, 0 in 2023-12-09T02:28:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: mgrmap e10: smithi088.jwlofb(active, starting, since 0.00304351s) 2023-12-09T02:28:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:28:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi088.jwlofb", "id": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:28:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-09T02:28:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-09T02:28:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-09T02:28:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: Manager daemon smithi088.jwlofb is now available 2023-12-09T02:28:43.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:28:43.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:42 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:28:44.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:43 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:28:44.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:43 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/trash_purge_schedule"}]: dispatch 2023-12-09T02:28:44.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:43 smithi088 ceph-mon[112028]: [09/Dec/2023:02:28:43] ENGINE Bus STARTING 2023-12-09T02:28:44.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:43 smithi088 ceph-mon[112028]: [09/Dec/2023:02:28:43] ENGINE Serving on https://172.21.15.88:7150 2023-12-09T02:28:44.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:43 smithi088 ceph-mon[112028]: [09/Dec/2023:02:28:43] ENGINE Bus STARTED 2023-12-09T02:28:44.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:43 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:44.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:43 smithi088 ceph-mon[112028]: mgrmap e11: smithi088.jwlofb(active, since 1.00806s) 2023-12-09T02:28:44.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-12-09T02:28:44.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-09T02:28:44.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-09T02:28:44.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-12-09T02:28:44.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.194+0000 7fcd4e772700 1 Processor -- start 2023-12-09T02:28:44.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.194+0000 7fcd4e772700 1 -- start start 2023-12-09T02:28:44.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.194+0000 7fcd4e772700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:44.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.194+0000 7fcd4e772700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd481053d0 con 0x7fcd48076c60 2023-12-09T02:28:44.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.194+0000 7fcd47fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:44.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.194+0000 7fcd47fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50668/0 (socket says 172.21.15.88:50668) 2023-12-09T02:28:44.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.194+0000 7fcd47fff700 1 -- 172.21.15.88:0/1829626764 learned_addr learned my addr 172.21.15.88:0/1829626764 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:44.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.194+0000 7fcd47fff700 1 -- 172.21.15.88:0/1829626764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd48105510 con 0x7fcd48076c60 2023-12-09T02:28:44.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.195+0000 7fcd47fff700 1 --2- 172.21.15.88:0/1829626764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48104e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd380098e0 tx=0x7fcd38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39924b6f80e49b15 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:44.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.195+0000 7fcd46ffd700 1 -- 172.21.15.88:0/1829626764 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd3800b860 con 0x7fcd48076c60 2023-12-09T02:28:44.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.195+0000 7fcd46ffd700 1 -- 172.21.15.88:0/1829626764 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd3800be70 con 0x7fcd48076c60 2023-12-09T02:28:44.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.195+0000 7fcd46ffd700 1 -- 172.21.15.88:0/1829626764 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd38010380 con 0x7fcd48076c60 2023-12-09T02:28:44.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.195+0000 7fcd4e772700 1 -- 172.21.15.88:0/1829626764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 msgr2=0x7fcd48104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:44.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.195+0000 7fcd4e772700 1 --2- 172.21.15.88:0/1829626764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48104e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd380098e0 tx=0x7fcd38009250 comp rx=0 tx=0).stop 2023-12-09T02:28:44.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.195+0000 7fcd4e772700 1 -- 172.21.15.88:0/1829626764 shutdown_connections 2023-12-09T02:28:44.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.195+0000 7fcd4e772700 1 --2- 172.21.15.88:0/1829626764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48104e90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:44.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.195+0000 7fcd4e772700 1 -- 172.21.15.88:0/1829626764 >> 172.21.15.88:0/1829626764 conn(0x7fcd480fc980 msgr2=0x7fcd480fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:44.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.195+0000 7fcd4e772700 1 -- 172.21.15.88:0/1829626764 shutdown_connections 2023-12-09T02:28:44.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.196+0000 7fcd4e772700 1 -- 172.21.15.88:0/1829626764 wait complete. 2023-12-09T02:28:44.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.196+0000 7fcd4e772700 1 Processor -- start 2023-12-09T02:28:44.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.196+0000 7fcd4e772700 1 -- start start 2023-12-09T02:28:44.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.196+0000 7fcd4e772700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.196+0000 7fcd4e772700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd48100d90 con 0x7fcd48076c60 2023-12-09T02:28:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.196+0000 7fcd47fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.196+0000 7fcd47fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48102910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50674/0 (socket says 172.21.15.88:50674) 2023-12-09T02:28:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.196+0000 7fcd47fff700 1 -- 172.21.15.88:0/1569487161 learned_addr learned my addr 172.21.15.88:0/1569487161 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.197+0000 7fcd47fff700 1 -- 172.21.15.88:0/1569487161 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd380094f0 con 0x7fcd48076c60 2023-12-09T02:28:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.197+0000 7fcd47fff700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48102910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd380094c0 tx=0x7fcd38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.197+0000 7fcd44ff9700 1 -- 172.21.15.88:0/1569487161 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd38010850 con 0x7fcd48076c60 2023-12-09T02:28:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.197+0000 7fcd4e772700 1 -- 172.21.15.88:0/1569487161 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd48100f90 con 0x7fcd48076c60 2023-12-09T02:28:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.197+0000 7fcd44ff9700 1 -- 172.21.15.88:0/1569487161 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd38010e60 con 0x7fcd48076c60 2023-12-09T02:28:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.197+0000 7fcd44ff9700 1 -- 172.21.15.88:0/1569487161 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd3801a430 con 0x7fcd48076c60 2023-12-09T02:28:44.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.197+0000 7fcd4e772700 1 -- 172.21.15.88:0/1569487161 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd481013a0 con 0x7fcd48076c60 2023-12-09T02:28:44.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.198+0000 7fcd44ff9700 1 -- 172.21.15.88:0/1569487161 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fcd3801a6b0 con 0x7fcd48076c60 2023-12-09T02:28:44.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.198+0000 7fcd44ff9700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 0x7fcd30038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:44.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.198+0000 7fcd4e772700 1 -- 172.21.15.88:0/1569487161 --> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd4805f270 con 0x7fcd30036640 2023-12-09T02:28:44.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.198+0000 7fcd44ff9700 1 -- 172.21.15.88:0/1569487161 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcd3804b3e0 con 0x7fcd48076c60 2023-12-09T02:28:44.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.198+0000 7fcd477fe700 1 -- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 msgr2=0x7fcd30038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2611357961 2023-12-09T02:28:44.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.198+0000 7fcd477fe700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 0x7fcd30038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-09T02:28:44.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.399+0000 7fcd477fe700 1 -- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 msgr2=0x7fcd30038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2611357961 2023-12-09T02:28:44.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.399+0000 7fcd477fe700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 0x7fcd30038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-09T02:28:44.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.800+0000 7fcd477fe700 1 -- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 msgr2=0x7fcd30038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2611357961 2023-12-09T02:28:44.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:38.800+0000 7fcd477fe700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 0x7fcd30038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-09T02:28:44.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:39.601+0000 7fcd477fe700 1 -- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 msgr2=0x7fcd30038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2611357961 2023-12-09T02:28:44.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:39.601+0000 7fcd477fe700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 0x7fcd30038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-09T02:28:44.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:41.202+0000 7fcd477fe700 1 -- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 msgr2=0x7fcd30038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2611357961 2023-12-09T02:28:44.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:41.202+0000 7fcd477fe700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 0x7fcd30038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-09T02:28:44.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:42.919+0000 7fcd44ff9700 1 -- 172.21.15.88:0/1569487161 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7fcd380247b0 con 0x7fcd48076c60 2023-12-09T02:28:44.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:42.919+0000 7fcd44ff9700 1 -- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 msgr2=0x7fcd30038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-09T02:28:44.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:42.919+0000 7fcd44ff9700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 0x7fcd30038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:44.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.923+0000 7fcd44ff9700 1 -- 172.21.15.88:0/1569487161 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7fcd38019ca0 con 0x7fcd48076c60 2023-12-09T02:28:44.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.923+0000 7fcd44ff9700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fcd30039f40 0x7fcd3003c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:44.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.923+0000 7fcd44ff9700 1 -- 172.21.15.88:0/1569487161 --> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd4805f270 con 0x7fcd30039f40 2023-12-09T02:28:44.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.923+0000 7fcd477fe700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fcd30039f40 0x7fcd3003c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:44.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.924+0000 7fcd477fe700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fcd30039f40 0x7fcd3003c320 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0039d0 tx=0x7fcd3c0092f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:44.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.924+0000 7fcd44ff9700 1 -- 172.21.15.88:0/1569487161 <== mgr.14162 v2:172.21.15.88:6800/2389651586 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fcd4805f270 con 0x7fcd30039f40 2023-12-09T02:28:44.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.930+0000 7fcd4e772700 1 -- 172.21.15.88:0/1569487161 --> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fcd4804bb80 con 0x7fcd30039f40 2023-12-09T02:28:44.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.930+0000 7fcd44ff9700 1 -- 172.21.15.88:0/1569487161 <== mgr.14162 v2:172.21.15.88:6800/2389651586 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fcd4804bb80 con 0x7fcd30039f40 2023-12-09T02:28:44.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.931+0000 7fcd4e772700 1 -- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fcd30039f40 msgr2=0x7fcd3003c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:44.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.931+0000 7fcd4e772700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fcd30039f40 0x7fcd3003c320 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0039d0 tx=0x7fcd3c0092f0 comp rx=0 tx=0).stop 2023-12-09T02:28:44.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.931+0000 7fcd4e772700 1 -- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 msgr2=0x7fcd48102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:44.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.931+0000 7fcd4e772700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48102910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd380094c0 tx=0x7fcd38009250 comp rx=0 tx=0).stop 2023-12-09T02:28:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.931+0000 7fcd4e772700 1 -- 172.21.15.88:0/1569487161 shutdown_connections 2023-12-09T02:28:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.931+0000 7fcd4e772700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fcd30039f40 0x7fcd3003c320 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.931+0000 7fcd4e772700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48076c60 0x7fcd48102910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.931+0000 7fcd4e772700 1 --2- 172.21.15.88:0/1569487161 >> [v2:172.21.15.88:6800/2611357961,v1:172.21.15.88:6801/2611357961] conn(0x7fcd30036640 0x7fcd30038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.931+0000 7fcd4e772700 1 -- 172.21.15.88:0/1569487161 >> 172.21.15.88:0/1569487161 conn(0x7fcd480fc980 msgr2=0x7fcd480fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.931+0000 7fcd4e772700 1 -- 172.21.15.88:0/1569487161 shutdown_connections 2023-12-09T02:28:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:43.931+0000 7fcd4e772700 1 -- 172.21.15.88:0/1569487161 wait complete. 2023-12-09T02:28:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:mgr epoch 9 is available 2023-12-09T02:28:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:Generating a dashboard self-signed certificate... 2023-12-09T02:28:45.591 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:45 smithi088 ceph-mon[112028]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-09T02:28:45.591 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:45 smithi088 ceph-mon[112028]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-09T02:28:45.591 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:45 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:45.592 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:45 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:45.592 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:45 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:45.592 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:45 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.964+0000 7ffb2b900700 1 Processor -- start 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.965+0000 7ffb2b900700 1 -- start start 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.965+0000 7ffb2b900700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb24107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.965+0000 7ffb2b900700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb24102d10 con 0x7ffb24070f80 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.965+0000 7ffb2969c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb24107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.965+0000 7ffb2969c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb24107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50756/0 (socket says 172.21.15.88:50756) 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.965+0000 7ffb2969c700 1 -- 172.21.15.88:0/2110885558 learned_addr learned my addr 172.21.15.88:0/2110885558 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.965+0000 7ffb2969c700 1 -- 172.21.15.88:0/2110885558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24107860 con 0x7ffb24070f80 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.965+0000 7ffb2969c700 1 --2- 172.21.15.88:0/2110885558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb24107320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb200098e0 tx=0x7ffb20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9141ba00a1ecfe server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.966+0000 7ffb1bfff700 1 -- 172.21.15.88:0/2110885558 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb2000b860 con 0x7ffb24070f80 2023-12-09T02:28:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.966+0000 7ffb1bfff700 1 -- 172.21.15.88:0/2110885558 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb2000be70 con 0x7ffb24070f80 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.966+0000 7ffb1bfff700 1 -- 172.21.15.88:0/2110885558 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb20010380 con 0x7ffb24070f80 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.966+0000 7ffb2b900700 1 -- 172.21.15.88:0/2110885558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 msgr2=0x7ffb24107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.966+0000 7ffb2b900700 1 --2- 172.21.15.88:0/2110885558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb24107320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb200098e0 tx=0x7ffb20009250 comp rx=0 tx=0).stop 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.966+0000 7ffb2b900700 1 -- 172.21.15.88:0/2110885558 shutdown_connections 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.966+0000 7ffb2b900700 1 --2- 172.21.15.88:0/2110885558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb24107320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.966+0000 7ffb2b900700 1 -- 172.21.15.88:0/2110885558 >> 172.21.15.88:0/2110885558 conn(0x7ffb240fc970 msgr2=0x7ffb240fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.966+0000 7ffb2b900700 1 -- 172.21.15.88:0/2110885558 shutdown_connections 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.966+0000 7ffb2b900700 1 -- 172.21.15.88:0/2110885558 wait complete. 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.967+0000 7ffb2b900700 1 Processor -- start 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.967+0000 7ffb2b900700 1 -- start start 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.967+0000 7ffb2b900700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb241133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.967+0000 7ffb2b900700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb24113900 con 0x7ffb24070f80 2023-12-09T02:28:45.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.967+0000 7ffb2969c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb241133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.967+0000 7ffb2969c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb241133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50770/0 (socket says 172.21.15.88:50770) 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.967+0000 7ffb2969c700 1 -- 172.21.15.88:0/1890204901 learned_addr learned my addr 172.21.15.88:0/1890204901 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.967+0000 7ffb2969c700 1 -- 172.21.15.88:0/1890204901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb200094f0 con 0x7ffb24070f80 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.968+0000 7ffb2969c700 1 --2- 172.21.15.88:0/1890204901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb241133c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb200094c0 tx=0x7ffb20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.968+0000 7ffb19ffb700 1 -- 172.21.15.88:0/1890204901 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb20010850 con 0x7ffb24070f80 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.968+0000 7ffb19ffb700 1 -- 172.21.15.88:0/1890204901 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb20010e60 con 0x7ffb24070f80 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.968+0000 7ffb2b900700 1 -- 172.21.15.88:0/1890204901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb24113b00 con 0x7ffb24070f80 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.968+0000 7ffb19ffb700 1 -- 172.21.15.88:0/1890204901 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb2001a430 con 0x7ffb24070f80 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.968+0000 7ffb2b900700 1 -- 172.21.15.88:0/1890204901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb24113f10 con 0x7ffb24070f80 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.969+0000 7ffb19ffb700 1 -- 172.21.15.88:0/1890204901 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7ffb2001a6b0 con 0x7ffb24070f80 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.969+0000 7ffb19ffb700 1 --2- 172.21.15.88:0/1890204901 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ffb10036510 0x7ffb100389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:45.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.969+0000 7ffb19ffb700 1 -- 172.21.15.88:0/1890204901 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ffb2004a610 con 0x7ffb24070f80 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.969+0000 7ffb2b900700 1 -- 172.21.15.88:0/1890204901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2404bb80 con 0x7ffb24070f80 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.969+0000 7ffb28e9b700 1 --2- 172.21.15.88:0/1890204901 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ffb10036510 0x7ffb100389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.969+0000 7ffb28e9b700 1 --2- 172.21.15.88:0/1890204901 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ffb10036510 0x7ffb100389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009990 tx=0x7ffb14006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:44.974+0000 7ffb19ffb700 1 -- 172.21.15.88:0/1890204901 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ffb20018d90 con 0x7ffb24070f80 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.181+0000 7ffb2b900700 1 -- 172.21.15.88:0/1890204901 --> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb2410d1f0 con 0x7ffb10036510 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.253+0000 7ffb19ffb700 1 -- 172.21.15.88:0/1890204901 <== mgr.14162 v2:172.21.15.88:6800/2389651586 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7ffb2410d1f0 con 0x7ffb10036510 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.255+0000 7ffb2b900700 1 -- 172.21.15.88:0/1890204901 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ffb10036510 msgr2=0x7ffb100389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.255+0000 7ffb2b900700 1 --2- 172.21.15.88:0/1890204901 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ffb10036510 0x7ffb100389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009990 tx=0x7ffb14006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.255+0000 7ffb2b900700 1 -- 172.21.15.88:0/1890204901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 msgr2=0x7ffb241133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.255+0000 7ffb2b900700 1 --2- 172.21.15.88:0/1890204901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb241133c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb200094c0 tx=0x7ffb20009250 comp rx=0 tx=0).stop 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.255+0000 7ffb2b900700 1 -- 172.21.15.88:0/1890204901 shutdown_connections 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.255+0000 7ffb2b900700 1 --2- 172.21.15.88:0/1890204901 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ffb10036510 0x7ffb100389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.255+0000 7ffb2b900700 1 --2- 172.21.15.88:0/1890204901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb24070f80 0x7ffb241133c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:45.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.255+0000 7ffb2b900700 1 -- 172.21.15.88:0/1890204901 >> 172.21.15.88:0/1890204901 conn(0x7ffb240fc970 msgr2=0x7ffb240fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:45.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.255+0000 7ffb2b900700 1 -- 172.21.15.88:0/1890204901 shutdown_connections 2023-12-09T02:28:45.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.255+0000 7ffb2b900700 1 -- 172.21.15.88:0/1890204901 wait complete. 2023-12-09T02:28:45.608 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial admin user... 2023-12-09T02:28:46.702 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:46 smithi088 ceph-mon[112028]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:46.702 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:46 smithi088 ceph-mon[112028]: mgrmap e12: smithi088.jwlofb(active, since 2s) 2023-12-09T02:28:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$YuZSEgNVZCIodu7vpivOXu.xDJd8QBTydNEJJjEHwHWZz2yyzeOSq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702088926, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-09T02:28:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.989+0000 7f197a018700 1 Processor -- start 2023-12-09T02:28:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.989+0000 7f197a018700 1 -- start start 2023-12-09T02:28:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.990+0000 7f197a018700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f1974104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.990+0000 7f197a018700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1974105420 con 0x7f1974070fc0 2023-12-09T02:28:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.990+0000 7f19737fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f1974104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.990+0000 7f19737fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f1974104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50774/0 (socket says 172.21.15.88:50774) 2023-12-09T02:28:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.990+0000 7f19737fe700 1 -- 172.21.15.88:0/1487003817 learned_addr learned my addr 172.21.15.88:0/1487003817 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.990+0000 7f19737fe700 1 -- 172.21.15.88:0/1487003817 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974105560 con 0x7f1974070fc0 2023-12-09T02:28:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.990+0000 7f19737fe700 1 --2- 172.21.15.88:0/1487003817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f1974104ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f19680098e0 tx=0x7f1968009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c49bb1448130de server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.990+0000 7f19727fc700 1 -- 172.21.15.88:0/1487003817 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f196800b860 con 0x7f1974070fc0 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.990+0000 7f19727fc700 1 -- 172.21.15.88:0/1487003817 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f196800be70 con 0x7f1974070fc0 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.990+0000 7f19727fc700 1 -- 172.21.15.88:0/1487003817 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1968010380 con 0x7f1974070fc0 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.991+0000 7f197a018700 1 -- 172.21.15.88:0/1487003817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 msgr2=0x7f1974104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.991+0000 7f197a018700 1 --2- 172.21.15.88:0/1487003817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f1974104ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f19680098e0 tx=0x7f1968009250 comp rx=0 tx=0).stop 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.991+0000 7f197a018700 1 -- 172.21.15.88:0/1487003817 shutdown_connections 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.991+0000 7f197a018700 1 --2- 172.21.15.88:0/1487003817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f1974104ee0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.991+0000 7f197a018700 1 -- 172.21.15.88:0/1487003817 >> 172.21.15.88:0/1487003817 conn(0x7f19740fc970 msgr2=0x7f19740fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.991+0000 7f197a018700 1 -- 172.21.15.88:0/1487003817 shutdown_connections 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.991+0000 7f197a018700 1 -- 172.21.15.88:0/1487003817 wait complete. 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.992+0000 7f197a018700 1 Processor -- start 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.992+0000 7f197a018700 1 -- start start 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.992+0000 7f197a018700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f19741111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.992+0000 7f197a018700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19741116e0 con 0x7f1974070fc0 2023-12-09T02:28:46.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.992+0000 7f19737fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f19741111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.992+0000 7f19737fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f19741111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50776/0 (socket says 172.21.15.88:50776) 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.992+0000 7f19737fe700 1 -- 172.21.15.88:0/3733010742 learned_addr learned my addr 172.21.15.88:0/3733010742 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.992+0000 7f19737fe700 1 -- 172.21.15.88:0/3733010742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19680094f0 con 0x7f1974070fc0 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.992+0000 7f19737fe700 1 --2- 172.21.15.88:0/3733010742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f19741111a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f19680094c0 tx=0x7f1968009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.993+0000 7f195bfff700 1 -- 172.21.15.88:0/3733010742 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1968010850 con 0x7f1974070fc0 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.993+0000 7f195bfff700 1 -- 172.21.15.88:0/3733010742 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1968010e60 con 0x7f1974070fc0 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.993+0000 7f197a018700 1 -- 172.21.15.88:0/3733010742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19741118e0 con 0x7f1974070fc0 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.993+0000 7f195bfff700 1 -- 172.21.15.88:0/3733010742 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f196801a430 con 0x7f1974070fc0 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.993+0000 7f197a018700 1 -- 172.21.15.88:0/3733010742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1974111cf0 con 0x7f1974070fc0 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.993+0000 7f195bfff700 1 -- 172.21.15.88:0/3733010742 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f196801a6b0 con 0x7f1974070fc0 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.994+0000 7f195bfff700 1 --2- 172.21.15.88:0/3733010742 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f195c036640 0x7f195c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.994+0000 7f195bfff700 1 -- 172.21.15.88:0/3733010742 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f196804a500 con 0x7f1974070fc0 2023-12-09T02:28:46.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.994+0000 7f1972ffd700 1 --2- 172.21.15.88:0/3733010742 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f195c036640 0x7f195c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:46.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.994+0000 7f197a018700 1 -- 172.21.15.88:0/3733010742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197404bb80 con 0x7f1974070fc0 2023-12-09T02:28:46.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.994+0000 7f1972ffd700 1 --2- 172.21.15.88:0/3733010742 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f195c036640 0x7f195c038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1964009990 tx=0x7f1964006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:46.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:45.999+0000 7f195bfff700 1 -- 172.21.15.88:0/3733010742 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f19680189a0 con 0x7f1974070fc0 2023-12-09T02:28:46.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.203+0000 7f197a018700 1 -- 172.21.15.88:0/3733010742 --> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f19741062e0 con 0x7f195c036640 2023-12-09T02:28:46.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.428+0000 7f195bfff700 1 -- 172.21.15.88:0/3733010742 <== mgr.14162 v2:172.21.15.88:6800/2389651586 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f19741062e0 con 0x7f195c036640 2023-12-09T02:28:46.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.430+0000 7f197a018700 1 -- 172.21.15.88:0/3733010742 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f195c036640 msgr2=0x7f195c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:46.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.430+0000 7f197a018700 1 --2- 172.21.15.88:0/3733010742 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f195c036640 0x7f195c038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1964009990 tx=0x7f1964006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:46.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.430+0000 7f197a018700 1 -- 172.21.15.88:0/3733010742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 msgr2=0x7f19741111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:46.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.430+0000 7f197a018700 1 --2- 172.21.15.88:0/3733010742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f19741111a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f19680094c0 tx=0x7f1968009250 comp rx=0 tx=0).stop 2023-12-09T02:28:46.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.430+0000 7f197a018700 1 -- 172.21.15.88:0/3733010742 shutdown_connections 2023-12-09T02:28:46.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.430+0000 7f197a018700 1 --2- 172.21.15.88:0/3733010742 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f195c036640 0x7f195c038af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:46.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.430+0000 7f197a018700 1 --2- 172.21.15.88:0/3733010742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1974070fc0 0x7f19741111a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:46.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.430+0000 7f197a018700 1 -- 172.21.15.88:0/3733010742 >> 172.21.15.88:0/3733010742 conn(0x7f19740fc970 msgr2=0x7f19740fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:46.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.430+0000 7f197a018700 1 -- 172.21.15.88:0/3733010742 shutdown_connections 2023-12-09T02:28:46.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:46.430+0000 7f197a018700 1 -- 172.21.15.88:0/3733010742 wait complete. 2023-12-09T02:28:46.789 INFO:teuthology.orchestra.run.smithi088.stdout:Fetching dashboard port number... 2023-12-09T02:28:47.657 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:47 smithi088 ceph-mon[112028]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:47.657 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:47 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:47.657 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:47 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1354892983' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-09T02:28:47.718 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 8443 2023-12-09T02:28:47.718 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.124+0000 7f0421788700 1 Processor -- start 2023-12-09T02:28:47.718 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.124+0000 7f0421788700 1 -- start start 2023-12-09T02:28:47.718 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.124+0000 7f0421788700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:47.718 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.124+0000 7f0421788700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c102c20 con 0x7f041c1022d0 2023-12-09T02:28:47.718 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.125+0000 7f041affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:47.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.125+0000 7f041affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36928/0 (socket says 172.21.15.88:36928) 2023-12-09T02:28:47.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.125+0000 7f041affd700 1 -- 172.21.15.88:0/3302405205 learned_addr learned my addr 172.21.15.88:0/3302405205 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:47.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.125+0000 7f041affd700 1 -- 172.21.15.88:0/3302405205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c102d60 con 0x7f041c1022d0 2023-12-09T02:28:47.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.125+0000 7f041affd700 1 --2- 172.21.15.88:0/3302405205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c1026e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f04100098e0 tx=0x7f0410009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7508e7e9637ab79 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:47.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.125+0000 7f0419ffb700 1 -- 172.21.15.88:0/3302405205 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f041000b860 con 0x7f041c1022d0 2023-12-09T02:28:47.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.125+0000 7f0419ffb700 1 -- 172.21.15.88:0/3302405205 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f041000be70 con 0x7f041c1022d0 2023-12-09T02:28:47.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.125+0000 7f0419ffb700 1 -- 172.21.15.88:0/3302405205 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0410010380 con 0x7f041c1022d0 2023-12-09T02:28:47.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.126+0000 7f0421788700 1 -- 172.21.15.88:0/3302405205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 msgr2=0x7f041c1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:47.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.126+0000 7f0421788700 1 --2- 172.21.15.88:0/3302405205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c1026e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f04100098e0 tx=0x7f0410009250 comp rx=0 tx=0).stop 2023-12-09T02:28:47.719 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.126+0000 7f0421788700 1 -- 172.21.15.88:0/3302405205 shutdown_connections 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.126+0000 7f0421788700 1 --2- 172.21.15.88:0/3302405205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c1026e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.126+0000 7f0421788700 1 -- 172.21.15.88:0/3302405205 >> 172.21.15.88:0/3302405205 conn(0x7f041c0fda50 msgr2=0x7f041c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.126+0000 7f0421788700 1 -- 172.21.15.88:0/3302405205 shutdown_connections 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.126+0000 7f0421788700 1 -- 172.21.15.88:0/3302405205 wait complete. 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.126+0000 7f0421788700 1 Processor -- start 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.126+0000 7f0421788700 1 -- start start 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f0421788700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f0421788700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c076080 con 0x7f041c1022d0 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f041affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f041affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36934/0 (socket says 172.21.15.88:36934) 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f041affd700 1 -- 172.21.15.88:0/1354892983 learned_addr learned my addr 172.21.15.88:0/1354892983 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f041affd700 1 -- 172.21.15.88:0/1354892983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100094f0 con 0x7f041c1022d0 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f041affd700 1 --2- 172.21.15.88:0/1354892983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c077c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f041000c010 tx=0x7f0410009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f04037fe700 1 -- 172.21.15.88:0/1354892983 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0410010960 con 0x7f041c1022d0 2023-12-09T02:28:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f04037fe700 1 -- 172.21.15.88:0/1354892983 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f041001a430 con 0x7f041c1022d0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f0421788700 1 -- 172.21.15.88:0/1354892983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c076280 con 0x7f041c1022d0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f04037fe700 1 -- 172.21.15.88:0/1354892983 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0410019580 con 0x7f041c1022d0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.127+0000 7f0421788700 1 -- 172.21.15.88:0/1354892983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c076690 con 0x7f041c1022d0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.128+0000 7f0421788700 1 -- 172.21.15.88:0/1354892983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c04bb80 con 0x7f041c1022d0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.128+0000 7f04037fe700 1 -- 172.21.15.88:0/1354892983 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f041001a980 con 0x7f041c1022d0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.129+0000 7f04037fe700 1 --2- 172.21.15.88:0/1354892983 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f0404036640 0x7f0404038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.129+0000 7f04037fe700 1 -- 172.21.15.88:0/1354892983 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f041004a570 con 0x7f041c1022d0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.129+0000 7f041a7fc700 1 --2- 172.21.15.88:0/1354892983 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f0404036640 0x7f0404038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.129+0000 7f041a7fc700 1 --2- 172.21.15.88:0/1354892983 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f0404036640 0x7f0404038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f040c009990 tx=0x7f040c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.133+0000 7f04037fe700 1 -- 172.21.15.88:0/1354892983 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f041002bb30 con 0x7f041c1022d0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.317+0000 7f0421788700 1 -- 172.21.15.88:0/1354892983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f041c1040b0 con 0x7f041c1022d0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.318+0000 7f04037fe700 1 -- 172.21.15.88:0/1354892983 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f041002b300 con 0x7f041c1022d0 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.320+0000 7f0421788700 1 -- 172.21.15.88:0/1354892983 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f0404036640 msgr2=0x7f0404038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.320+0000 7f0421788700 1 --2- 172.21.15.88:0/1354892983 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f0404036640 0x7f0404038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f040c009990 tx=0x7f040c006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:47.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.320+0000 7f0421788700 1 -- 172.21.15.88:0/1354892983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 msgr2=0x7f041c077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:47.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.320+0000 7f0421788700 1 --2- 172.21.15.88:0/1354892983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c077c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f041000c010 tx=0x7f0410009250 comp rx=0 tx=0).stop 2023-12-09T02:28:47.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.320+0000 7f0421788700 1 -- 172.21.15.88:0/1354892983 shutdown_connections 2023-12-09T02:28:47.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.320+0000 7f0421788700 1 --2- 172.21.15.88:0/1354892983 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f0404036640 0x7f0404038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:47.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.320+0000 7f0421788700 1 --2- 172.21.15.88:0/1354892983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c1022d0 0x7f041c077c00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:47.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.320+0000 7f0421788700 1 -- 172.21.15.88:0/1354892983 >> 172.21.15.88:0/1354892983 conn(0x7f041c0fda50 msgr2=0x7f041c0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:47.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.320+0000 7f0421788700 1 -- 172.21.15.88:0/1354892983 shutdown_connections 2023-12-09T02:28:47.722 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:47.320+0000 7f0421788700 1 -- 172.21.15.88:0/1354892983 wait complete. 2023-12-09T02:28:47.725 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-09T02:28:47.725 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2023-12-09T02:28:47.732 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-09T02:28:47.733 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-12-09T02:28:47.733 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2023-12-09T02:28:47.733 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-09T02:28:47.735 INFO:teuthology.orchestra.run.smithi088.stdout:Ceph Dashboard is now available at: 2023-12-09T02:28:47.735 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:28:47.735 INFO:teuthology.orchestra.run.smithi088.stdout: URL: https://smithi088.front.sepia.ceph.com:8443/ 2023-12-09T02:28:47.735 INFO:teuthology.orchestra.run.smithi088.stdout: User: admin 2023-12-09T02:28:47.735 INFO:teuthology.orchestra.run.smithi088.stdout: Password: z9f86m1pjf 2023-12-09T02:28:47.735 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:28:47.735 INFO:teuthology.orchestra.run.smithi088.stdout:Saving cluster configuration to /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config directory 2023-12-09T02:28:47.736 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling autotune for osd_memory_target 2023-12-09T02:28:48.626 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.073+0000 7f1a51984700 1 Processor -- start 2023-12-09T02:28:48.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.073+0000 7f1a51984700 1 -- start start 2023-12-09T02:28:48.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.073+0000 7f1a51984700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:48.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.073+0000 7f1a51984700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c1053e0 con 0x7f1a4c071000 2023-12-09T02:28:48.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.073+0000 7f1a4affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:48.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.073+0000 7f1a4affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36942/0 (socket says 172.21.15.88:36942) 2023-12-09T02:28:48.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.073+0000 7f1a4affd700 1 -- 172.21.15.88:0/396042885 learned_addr learned my addr 172.21.15.88:0/396042885 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:48.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.074+0000 7f1a4affd700 1 -- 172.21.15.88:0/396042885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c105520 con 0x7f1a4c071000 2023-12-09T02:28:48.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.074+0000 7f1a4affd700 1 --2- 172.21.15.88:0/396042885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c104ea0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0098e0 tx=0x7f1a3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7fb1e33ef3f7e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:48.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.074+0000 7f1a49ffb700 1 -- 172.21.15.88:0/396042885 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a3c00b860 con 0x7f1a4c071000 2023-12-09T02:28:48.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.074+0000 7f1a49ffb700 1 -- 172.21.15.88:0/396042885 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a3c00be70 con 0x7f1a4c071000 2023-12-09T02:28:48.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.074+0000 7f1a49ffb700 1 -- 172.21.15.88:0/396042885 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a3c010380 con 0x7f1a4c071000 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.074+0000 7f1a51984700 1 -- 172.21.15.88:0/396042885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 msgr2=0x7f1a4c104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.074+0000 7f1a51984700 1 --2- 172.21.15.88:0/396042885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c104ea0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0098e0 tx=0x7f1a3c009250 comp rx=0 tx=0).stop 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.074+0000 7f1a51984700 1 -- 172.21.15.88:0/396042885 shutdown_connections 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.074+0000 7f1a51984700 1 --2- 172.21.15.88:0/396042885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c104ea0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.074+0000 7f1a51984700 1 -- 172.21.15.88:0/396042885 >> 172.21.15.88:0/396042885 conn(0x7f1a4c0fc970 msgr2=0x7f1a4c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.074+0000 7f1a51984700 1 -- 172.21.15.88:0/396042885 shutdown_connections 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.075+0000 7f1a51984700 1 -- 172.21.15.88:0/396042885 wait complete. 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.075+0000 7f1a51984700 1 Processor -- start 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.075+0000 7f1a51984700 1 -- start start 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.075+0000 7f1a51984700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c1111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.075+0000 7f1a51984700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c111700 con 0x7f1a4c071000 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.075+0000 7f1a4affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c1111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.075+0000 7f1a4affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c1111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36958/0 (socket says 172.21.15.88:36958) 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.075+0000 7f1a4affd700 1 -- 172.21.15.88:0/4081520972 learned_addr learned my addr 172.21.15.88:0/4081520972 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:48.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.076+0000 7f1a4affd700 1 -- 172.21.15.88:0/4081520972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c0094f0 con 0x7f1a4c071000 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.076+0000 7f1a4affd700 1 --2- 172.21.15.88:0/4081520972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c1111c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c006d40 tx=0x7f1a3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.076+0000 7f1a337fe700 1 -- 172.21.15.88:0/4081520972 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a3c010960 con 0x7f1a4c071000 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.076+0000 7f1a337fe700 1 -- 172.21.15.88:0/4081520972 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a3c01a430 con 0x7f1a4c071000 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.076+0000 7f1a337fe700 1 -- 172.21.15.88:0/4081520972 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a3c0245b0 con 0x7f1a4c071000 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.076+0000 7f1a51984700 1 -- 172.21.15.88:0/4081520972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c111900 con 0x7f1a4c071000 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.076+0000 7f1a51984700 1 -- 172.21.15.88:0/4081520972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c111d10 con 0x7f1a4c071000 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.077+0000 7f1a337fe700 1 -- 172.21.15.88:0/4081520972 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f1a3c02d3f0 con 0x7f1a4c071000 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.077+0000 7f1a51984700 1 -- 172.21.15.88:0/4081520972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4c04bb80 con 0x7f1a4c071000 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.077+0000 7f1a337fe700 1 --2- 172.21.15.88:0/4081520972 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f1a34036690 0x7f1a34038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.077+0000 7f1a337fe700 1 -- 172.21.15.88:0/4081520972 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1a3c04a200 con 0x7f1a4c071000 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.077+0000 7f1a4a7fc700 1 --2- 172.21.15.88:0/4081520972 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f1a34036690 0x7f1a34038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.078+0000 7f1a4a7fc700 1 --2- 172.21.15.88:0/4081520972 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f1a34036690 0x7f1a34038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009990 tx=0x7f1a40006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.082+0000 7f1a337fe700 1 -- 172.21.15.88:0/4081520972 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1a3c02b8e0 con 0x7f1a4c071000 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.267+0000 7f1a51984700 1 -- 172.21.15.88:0/4081520972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f1a4c106300 con 0x7f1a4c071000 2023-12-09T02:28:48.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.267+0000 7f1a337fe700 1 -- 172.21.15.88:0/4081520972 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f1a3c02b2f0 con 0x7f1a4c071000 2023-12-09T02:28:48.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.269+0000 7f1a51984700 1 -- 172.21.15.88:0/4081520972 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f1a34036690 msgr2=0x7f1a34038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:48.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.269+0000 7f1a51984700 1 --2- 172.21.15.88:0/4081520972 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f1a34036690 0x7f1a34038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009990 tx=0x7f1a40006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:48.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.269+0000 7f1a51984700 1 -- 172.21.15.88:0/4081520972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 msgr2=0x7f1a4c1111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:48.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.269+0000 7f1a51984700 1 --2- 172.21.15.88:0/4081520972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c1111c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c006d40 tx=0x7f1a3c009250 comp rx=0 tx=0).stop 2023-12-09T02:28:48.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.269+0000 7f1a51984700 1 -- 172.21.15.88:0/4081520972 shutdown_connections 2023-12-09T02:28:48.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.269+0000 7f1a51984700 1 --2- 172.21.15.88:0/4081520972 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f1a34036690 0x7f1a34038b40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:48.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.269+0000 7f1a51984700 1 --2- 172.21.15.88:0/4081520972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a4c071000 0x7f1a4c1111c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:48.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.269+0000 7f1a51984700 1 -- 172.21.15.88:0/4081520972 >> 172.21.15.88:0/4081520972 conn(0x7f1a4c0fc970 msgr2=0x7f1a4c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:48.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.269+0000 7f1a51984700 1 -- 172.21.15.88:0/4081520972 shutdown_connections 2023-12-09T02:28:48.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.269+0000 7f1a51984700 1 -- 172.21.15.88:0/4081520972 wait complete. 2023-12-09T02:28:49.635 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.957+0000 7fee0f323700 1 Processor -- start 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.958+0000 7fee0f323700 1 -- start start 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.958+0000 7fee0f323700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee08104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.958+0000 7fee0f323700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee08105420 con 0x7fee08070fc0 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.958+0000 7fee0d0bf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee08104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.958+0000 7fee0d0bf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee08104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36962/0 (socket says 172.21.15.88:36962) 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.958+0000 7fee0d0bf700 1 -- 172.21.15.88:0/1763582818 learned_addr learned my addr 172.21.15.88:0/1763582818 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.958+0000 7fee0d0bf700 1 -- 172.21.15.88:0/1763582818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee08105560 con 0x7fee08070fc0 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.958+0000 7fee0d0bf700 1 --2- 172.21.15.88:0/1763582818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee08104ee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fedf80098e0 tx=0x7fedf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4c184e7e70870d server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.959+0000 7fedfffff700 1 -- 172.21.15.88:0/1763582818 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedf800b860 con 0x7fee08070fc0 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.959+0000 7fedfffff700 1 -- 172.21.15.88:0/1763582818 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fedf800be70 con 0x7fee08070fc0 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.959+0000 7fedfffff700 1 -- 172.21.15.88:0/1763582818 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedf8010380 con 0x7fee08070fc0 2023-12-09T02:28:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.959+0000 7fee0f323700 1 -- 172.21.15.88:0/1763582818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 msgr2=0x7fee08104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:49.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.959+0000 7fee0f323700 1 --2- 172.21.15.88:0/1763582818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee08104ee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fedf80098e0 tx=0x7fedf8009250 comp rx=0 tx=0).stop 2023-12-09T02:28:49.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.959+0000 7fee0f323700 1 -- 172.21.15.88:0/1763582818 shutdown_connections 2023-12-09T02:28:49.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.959+0000 7fee0f323700 1 --2- 172.21.15.88:0/1763582818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee08104ee0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:49.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.959+0000 7fee0f323700 1 -- 172.21.15.88:0/1763582818 >> 172.21.15.88:0/1763582818 conn(0x7fee080fc970 msgr2=0x7fee080fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:49.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.959+0000 7fee0f323700 1 -- 172.21.15.88:0/1763582818 shutdown_connections 2023-12-09T02:28:49.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.959+0000 7fee0f323700 1 -- 172.21.15.88:0/1763582818 wait complete. 2023-12-09T02:28:49.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fee0f323700 1 Processor -- start 2023-12-09T02:28:49.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fee0f323700 1 -- start start 2023-12-09T02:28:49.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fee0f323700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee081111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:49.637 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fee0f323700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee08111700 con 0x7fee08070fc0 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fee0d0bf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee081111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fee0d0bf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee081111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36968/0 (socket says 172.21.15.88:36968) 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fee0d0bf700 1 -- 172.21.15.88:0/2364070487 learned_addr learned my addr 172.21.15.88:0/2364070487 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fee0d0bf700 1 -- 172.21.15.88:0/2364070487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf80094f0 con 0x7fee08070fc0 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fee0d0bf700 1 --2- 172.21.15.88:0/2364070487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee081111c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fedf80094c0 tx=0x7fedf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fedfdffb700 1 -- 172.21.15.88:0/2364070487 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedf8010850 con 0x7fee08070fc0 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fedfdffb700 1 -- 172.21.15.88:0/2364070487 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fedf8010e60 con 0x7fee08070fc0 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fedfdffb700 1 -- 172.21.15.88:0/2364070487 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedf801a430 con 0x7fee08070fc0 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.960+0000 7fee0f323700 1 -- 172.21.15.88:0/2364070487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee08111900 con 0x7fee08070fc0 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.961+0000 7fee0f323700 1 -- 172.21.15.88:0/2364070487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee08111d10 con 0x7fee08070fc0 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.961+0000 7fedfdffb700 1 -- 172.21.15.88:0/2364070487 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fedf80247b0 con 0x7fee08070fc0 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.962+0000 7fedfdffb700 1 --2- 172.21.15.88:0/2364070487 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fedf4036690 0x7fedf4038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.962+0000 7fedfdffb700 1 -- 172.21.15.88:0/2364070487 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fedf804a530 con 0x7fee08070fc0 2023-12-09T02:28:49.638 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.962+0000 7fee0f323700 1 -- 172.21.15.88:0/2364070487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0804bb80 con 0x7fee08070fc0 2023-12-09T02:28:49.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.962+0000 7fee0c8be700 1 --2- 172.21.15.88:0/2364070487 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fedf4036690 0x7fedf4038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:49.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.962+0000 7fee0c8be700 1 --2- 172.21.15.88:0/2364070487 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fedf4036690 0x7fedf4038b40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee04009990 tx=0x7fee04006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:49.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:48.966+0000 7fedfdffb700 1 -- 172.21.15.88:0/2364070487 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fedf8024440 con 0x7fee08070fc0 2023-12-09T02:28:49.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.254+0000 7fee0f323700 1 -- 172.21.15.88:0/2364070487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fee081063f0 con 0x7fee08070fc0 2023-12-09T02:28:49.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.256+0000 7fedfdffb700 1 -- 172.21.15.88:0/2364070487 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fedf8048030 con 0x7fee08070fc0 2023-12-09T02:28:49.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.258+0000 7fee0f323700 1 -- 172.21.15.88:0/2364070487 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fedf4036690 msgr2=0x7fedf4038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:49.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.258+0000 7fee0f323700 1 --2- 172.21.15.88:0/2364070487 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fedf4036690 0x7fedf4038b40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee04009990 tx=0x7fee04006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:49.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.258+0000 7fee0f323700 1 -- 172.21.15.88:0/2364070487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 msgr2=0x7fee081111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:49.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.258+0000 7fee0f323700 1 --2- 172.21.15.88:0/2364070487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee081111c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fedf80094c0 tx=0x7fedf8009250 comp rx=0 tx=0).stop 2023-12-09T02:28:49.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.258+0000 7fee0f323700 1 -- 172.21.15.88:0/2364070487 shutdown_connections 2023-12-09T02:28:49.639 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.259+0000 7fee0f323700 1 --2- 172.21.15.88:0/2364070487 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fedf4036690 0x7fedf4038b40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.259+0000 7fee0f323700 1 --2- 172.21.15.88:0/2364070487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee08070fc0 0x7fee081111c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.259+0000 7fee0f323700 1 -- 172.21.15.88:0/2364070487 >> 172.21.15.88:0/2364070487 conn(0x7fee080fc970 msgr2=0x7fee080fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.259+0000 7fee0f323700 1 -- 172.21.15.88:0/2364070487 shutdown_connections 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-12-09T02:28:49.259+0000 7fee0f323700 1 -- 172.21.15.88:0/2364070487 wait complete. 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout:Or, if you are only running a single cluster on this host: 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:28:49.640 INFO:teuthology.orchestra.run.smithi088.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-09T02:28:49.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:28:49.641 INFO:teuthology.orchestra.run.smithi088.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-09T02:28:49.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:28:49.641 INFO:teuthology.orchestra.run.smithi088.stdout: ceph telemetry on 2023-12-09T02:28:49.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:28:49.641 INFO:teuthology.orchestra.run.smithi088.stdout:For more information see: 2023-12-09T02:28:49.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:28:49.641 INFO:teuthology.orchestra.run.smithi088.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-09T02:28:49.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:28:49.641 INFO:teuthology.orchestra.run.smithi088.stdout:Bootstrap complete. 2023-12-09T02:28:49.665 INFO:tasks.cephadm:Fetching config... 2023-12-09T02:28:49.665 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:28:49.665 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-09T02:28:49.723 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-09T02:28:49.723 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:28:49.723 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-09T02:28:49.781 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-09T02:28:49.781 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:28:49.782 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/keyring of=/dev/stdout 2023-12-09T02:28:49.853 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-09T02:28:49.853 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:28:49.853 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-09T02:28:49.910 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-09T02:28:49.911 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCymXH063Q6rHCTwENg+H15bc59okeIF3Is3WNWv2hcu5aeL9CxYhdo/A10zmJ35o0vo90HendQ79E0wCdlVbQdIZ1TJvwrDGCa552z+vKKjFp7K4cm8PJdjWup/Qlu9kxNtV/AE6pTrkeAEKpcR/O9OogYB+czP+ipE/Lm4kW8G/TEd64dNBYvHbTeEDiqIWoGLOhd0ik23F1o+WmtfnV3LDfvbTQf/DzL13hhETxf0xX3PSN2a3j6+Hadywyizl7UL/+x564oiVpnUv7bbLq3OEUS9UVnmKogrRtHobMXShKLZgPvr5vRwT9F57vYso9WCDxg0/eadl9Fesb+lGwdbLXk3f4mdVSvN7YCQtQ6FotsFD+JR89dOhthL1iAzTzU86f2AVetMJ3Yd9qrS5d3a25hVpowg9iC1ADu2M9Yd3eD6UTIHmF7DgjkoWCWqOJ+ZQ/65vTraJD56cpaTvx/peNgIYdn6FLMhBxKDm7Sc56dM85r/Qf38tDWnM2EvYs= ceph-70b26980-963a-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-09T02:28:49.988 INFO:teuthology.orchestra.run.smithi088.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCymXH063Q6rHCTwENg+H15bc59okeIF3Is3WNWv2hcu5aeL9CxYhdo/A10zmJ35o0vo90HendQ79E0wCdlVbQdIZ1TJvwrDGCa552z+vKKjFp7K4cm8PJdjWup/Qlu9kxNtV/AE6pTrkeAEKpcR/O9OogYB+czP+ipE/Lm4kW8G/TEd64dNBYvHbTeEDiqIWoGLOhd0ik23F1o+WmtfnV3LDfvbTQf/DzL13hhETxf0xX3PSN2a3j6+Hadywyizl7UL/+x564oiVpnUv7bbLq3OEUS9UVnmKogrRtHobMXShKLZgPvr5vRwT9F57vYso9WCDxg0/eadl9Fesb+lGwdbLXk3f4mdVSvN7YCQtQ6FotsFD+JR89dOhthL1iAzTzU86f2AVetMJ3Yd9qrS5d3a25hVpowg9iC1ADu2M9Yd3eD6UTIHmF7DgjkoWCWqOJ+ZQ/65vTraJD56cpaTvx/peNgIYdn6FLMhBxKDm7Sc56dM85r/Qf38tDWnM2EvYs= ceph-70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:28:49.999 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCymXH063Q6rHCTwENg+H15bc59okeIF3Is3WNWv2hcu5aeL9CxYhdo/A10zmJ35o0vo90HendQ79E0wCdlVbQdIZ1TJvwrDGCa552z+vKKjFp7K4cm8PJdjWup/Qlu9kxNtV/AE6pTrkeAEKpcR/O9OogYB+czP+ipE/Lm4kW8G/TEd64dNBYvHbTeEDiqIWoGLOhd0ik23F1o+WmtfnV3LDfvbTQf/DzL13hhETxf0xX3PSN2a3j6+Hadywyizl7UL/+x564oiVpnUv7bbLq3OEUS9UVnmKogrRtHobMXShKLZgPvr5vRwT9F57vYso9WCDxg0/eadl9Fesb+lGwdbLXk3f4mdVSvN7YCQtQ6FotsFD+JR89dOhthL1iAzTzU86f2AVetMJ3Yd9qrS5d3a25hVpowg9iC1ADu2M9Yd3eD6UTIHmF7DgjkoWCWqOJ+ZQ/65vTraJD56cpaTvx/peNgIYdn6FLMhBxKDm7Sc56dM85r/Qf38tDWnM2EvYs= ceph-70b26980-963a-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-09T02:28:50.043 INFO:teuthology.orchestra.run.smithi161.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCymXH063Q6rHCTwENg+H15bc59okeIF3Is3WNWv2hcu5aeL9CxYhdo/A10zmJ35o0vo90HendQ79E0wCdlVbQdIZ1TJvwrDGCa552z+vKKjFp7K4cm8PJdjWup/Qlu9kxNtV/AE6pTrkeAEKpcR/O9OogYB+czP+ipE/Lm4kW8G/TEd64dNBYvHbTeEDiqIWoGLOhd0ik23F1o+WmtfnV3LDfvbTQf/DzL13hhETxf0xX3PSN2a3j6+Hadywyizl7UL/+x564oiVpnUv7bbLq3OEUS9UVnmKogrRtHobMXShKLZgPvr5vRwT9F57vYso9WCDxg0/eadl9Fesb+lGwdbLXk3f4mdVSvN7YCQtQ6FotsFD+JR89dOhthL1iAzTzU86f2AVetMJ3Yd9qrS5d3a25hVpowg9iC1ADu2M9Yd3eD6UTIHmF7DgjkoWCWqOJ+ZQ/65vTraJD56cpaTvx/peNgIYdn6FLMhBxKDm7Sc56dM85r/Qf38tDWnM2EvYs= ceph-70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:28:50.056 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-09T02:28:50.315 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:28:50.620 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:50 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2364070487' entity='client.admin' 2023-12-09T02:28:50.620 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:50 smithi088 ceph-mon[112028]: mgrmap e13: smithi088.jwlofb(active, since 6s) 2023-12-09T02:28:51.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.413+0000 7f270eb14700 1 -- 172.21.15.88:0/1712568992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2708065aa0 msgr2=0x7f27080ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.413+0000 7f270eb14700 1 --2- 172.21.15.88:0/1712568992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2708065aa0 0x7f27080ff430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0048c0 tx=0x7f26fc009e30 comp rx=0 tx=0).stop 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270eb14700 1 -- 172.21.15.88:0/1712568992 shutdown_connections 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270eb14700 1 --2- 172.21.15.88:0/1712568992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2708065aa0 0x7f27080ff430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270eb14700 1 -- 172.21.15.88:0/1712568992 >> 172.21.15.88:0/1712568992 conn(0x7f27080f6e40 msgr2=0x7f27080f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270eb14700 1 -- 172.21.15.88:0/1712568992 shutdown_connections 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270eb14700 1 -- 172.21.15.88:0/1712568992 wait complete. 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270eb14700 1 Processor -- start 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270eb14700 1 -- start start 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270eb14700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2708065aa0 0x7f270810ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270eb14700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270810cfa0 con 0x7f2708065aa0 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270c8b0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2708065aa0 0x7f270810ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270c8b0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2708065aa0 0x7f270810ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36982/0 (socket says 172.21.15.88:36982) 2023-12-09T02:28:51.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.414+0000 7f270c8b0700 1 -- 172.21.15.88:0/3585706572 learned_addr learned my addr 172.21.15.88:0/3585706572 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:51.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.415+0000 7f270c8b0700 1 -- 172.21.15.88:0/3585706572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc005040 con 0x7f2708065aa0 2023-12-09T02:28:51.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.415+0000 7f270c8b0700 1 --2- 172.21.15.88:0/3585706572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2708065aa0 0x7f270810ca60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00b690 tx=0x7f26fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:51.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.415+0000 7f27057fa700 1 -- 172.21.15.88:0/3585706572 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26fc009650 con 0x7f2708065aa0 2023-12-09T02:28:51.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.415+0000 7f27057fa700 1 -- 172.21.15.88:0/3585706572 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f26fc0097b0 con 0x7f2708065aa0 2023-12-09T02:28:51.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.415+0000 7f270eb14700 1 -- 172.21.15.88:0/3585706572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270810d1a0 con 0x7f2708065aa0 2023-12-09T02:28:51.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.415+0000 7f27057fa700 1 -- 172.21.15.88:0/3585706572 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26fc01c5b0 con 0x7f2708065aa0 2023-12-09T02:28:51.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.415+0000 7f270eb14700 1 -- 172.21.15.88:0/3585706572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270810de40 con 0x7f2708065aa0 2023-12-09T02:28:51.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.416+0000 7f27057fa700 1 -- 172.21.15.88:0/3585706572 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f26fc01c820 con 0x7f2708065aa0 2023-12-09T02:28:51.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.416+0000 7f27057fa700 1 --2- 172.21.15.88:0/3585706572 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f26f8036720 0x7f26f8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:51.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.416+0000 7f27057fa700 1 -- 172.21.15.88:0/3585706572 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f26fc049850 con 0x7f2708065aa0 2023-12-09T02:28:51.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.416+0000 7f270eb14700 1 -- 172.21.15.88:0/3585706572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270805f270 con 0x7f2708065aa0 2023-12-09T02:28:51.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.416+0000 7f2707fff700 1 --2- 172.21.15.88:0/3585706572 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f26f8036720 0x7f26f8038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:51.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.416+0000 7f2707fff700 1 --2- 172.21.15.88:0/3585706572 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f26f8036720 0x7f26f8038bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009990 tx=0x7f26f4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:51.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.420+0000 7f27057fa700 1 -- 172.21.15.88:0/3585706572 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f26fc023300 con 0x7f2708065aa0 2023-12-09T02:28:51.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.612+0000 7f270eb14700 1 -- 172.21.15.88:0/3585706572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f270804bb80 con 0x7f2708065aa0 2023-12-09T02:28:51.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.614+0000 7f27057fa700 1 -- 172.21.15.88:0/3585706572 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f26fc0340c0 con 0x7f2708065aa0 2023-12-09T02:28:51.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.617+0000 7f270eb14700 1 -- 172.21.15.88:0/3585706572 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f26f8036720 msgr2=0x7f26f8038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:51.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.617+0000 7f270eb14700 1 --2- 172.21.15.88:0/3585706572 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f26f8036720 0x7f26f8038bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009990 tx=0x7f26f4006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:51.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.617+0000 7f270eb14700 1 -- 172.21.15.88:0/3585706572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2708065aa0 msgr2=0x7f270810ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:51.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.617+0000 7f270eb14700 1 --2- 172.21.15.88:0/3585706572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2708065aa0 0x7f270810ca60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00b690 tx=0x7f26fc009e30 comp rx=0 tx=0).stop 2023-12-09T02:28:51.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.617+0000 7f270eb14700 1 -- 172.21.15.88:0/3585706572 shutdown_connections 2023-12-09T02:28:51.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.617+0000 7f270eb14700 1 --2- 172.21.15.88:0/3585706572 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f26f8036720 0x7f26f8038bd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:51.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.617+0000 7f270eb14700 1 --2- 172.21.15.88:0/3585706572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2708065aa0 0x7f270810ca60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:51.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.617+0000 7f270eb14700 1 -- 172.21.15.88:0/3585706572 >> 172.21.15.88:0/3585706572 conn(0x7f27080f6e40 msgr2=0x7f27080f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:51.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.617+0000 7f270eb14700 1 -- 172.21.15.88:0/3585706572 shutdown_connections 2023-12-09T02:28:51.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:51.617+0000 7f270eb14700 1 -- 172.21.15.88:0/3585706572 wait complete. 2023-12-09T02:28:51.991 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-09T02:28:51.991 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-09T02:28:52.288 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:28:52.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:52 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3585706572' entity='client.admin' 2023-12-09T02:28:53.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.381+0000 7f58a5134700 1 -- 172.21.15.88:0/3011612694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58a00fb780 msgr2=0x7f58a00fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:53.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.381+0000 7f58a5134700 1 --2- 172.21.15.88:0/3011612694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58a00fb780 0x7f58a00fbb90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58940048c0 tx=0x7f5894009e30 comp rx=0 tx=0).stop 2023-12-09T02:28:53.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.381+0000 7f58a5134700 1 -- 172.21.15.88:0/3011612694 shutdown_connections 2023-12-09T02:28:53.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.381+0000 7f58a5134700 1 --2- 172.21.15.88:0/3011612694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58a00fb780 0x7f58a00fbb90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:53.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.381+0000 7f58a5134700 1 -- 172.21.15.88:0/3011612694 >> 172.21.15.88:0/3011612694 conn(0x7f58a00f6e40 msgr2=0x7f58a00f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:53.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.381+0000 7f58a5134700 1 -- 172.21.15.88:0/3011612694 shutdown_connections 2023-12-09T02:28:53.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.381+0000 7f58a5134700 1 -- 172.21.15.88:0/3011612694 wait complete. 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.381+0000 7f58a5134700 1 Processor -- start 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.381+0000 7f58a5134700 1 -- start start 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f58a5134700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58a00fb780 0x7f58a010f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f58a5134700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0065a10 con 0x7f58a00fb780 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f589ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58a00fb780 0x7f58a010f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f589ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58a00fb780 0x7f58a010f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37006/0 (socket says 172.21.15.88:37006) 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f589ed9d700 1 -- 172.21.15.88:0/3050433498 learned_addr learned my addr 172.21.15.88:0/3050433498 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f589ed9d700 1 -- 172.21.15.88:0/3050433498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5894005040 con 0x7f58a00fb780 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f589ed9d700 1 --2- 172.21.15.88:0/3050433498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58a00fb780 0x7f58a010f7e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5894009330 tx=0x7f5894009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f58877fe700 1 -- 172.21.15.88:0/3050433498 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58940096b0 con 0x7f58a00fb780 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f58877fe700 1 -- 172.21.15.88:0/3050433498 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5894009810 con 0x7f58a00fb780 2023-12-09T02:28:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f58877fe700 1 -- 172.21.15.88:0/3050433498 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f589401c5b0 con 0x7f58a00fb780 2023-12-09T02:28:53.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f58a5134700 1 -- 172.21.15.88:0/3050433498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a0065c10 con 0x7f58a00fb780 2023-12-09T02:28:53.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.382+0000 7f58a5134700 1 -- 172.21.15.88:0/3050433498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a010ff60 con 0x7f58a00fb780 2023-12-09T02:28:53.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.383+0000 7f58877fe700 1 -- 172.21.15.88:0/3050433498 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f589401c820 con 0x7f58a00fb780 2023-12-09T02:28:53.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.383+0000 7f58877fe700 1 --2- 172.21.15.88:0/3050433498 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5888036720 0x7f5888038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:53.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.383+0000 7f58877fe700 1 -- 172.21.15.88:0/3050433498 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5894049a20 con 0x7f58a00fb780 2023-12-09T02:28:53.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.383+0000 7f58a5134700 1 -- 172.21.15.88:0/3050433498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a0105410 con 0x7f58a00fb780 2023-12-09T02:28:53.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.383+0000 7f589e59c700 1 --2- 172.21.15.88:0/3050433498 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5888036720 0x7f5888038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:53.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.384+0000 7f589e59c700 1 --2- 172.21.15.88:0/3050433498 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5888036720 0x7f5888038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5890009990 tx=0x7f5890006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:53.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.388+0000 7f58877fe700 1 -- 172.21.15.88:0/3050433498 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5894011dd0 con 0x7f58a00fb780 2023-12-09T02:28:53.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.589+0000 7f58a5134700 1 -- 172.21.15.88:0/3050433498 --> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f58a002b250 con 0x7f5888036720 2023-12-09T02:28:53.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.592+0000 7f58877fe700 1 -- 172.21.15.88:0/3050433498 <== mgr.14162 v2:172.21.15.88:6800/2389651586 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f58a002b250 con 0x7f5888036720 2023-12-09T02:28:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.594+0000 7f58a5134700 1 -- 172.21.15.88:0/3050433498 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5888036720 msgr2=0x7f5888038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.594+0000 7f58a5134700 1 --2- 172.21.15.88:0/3050433498 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5888036720 0x7f5888038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5890009990 tx=0x7f5890006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.595+0000 7f58a5134700 1 -- 172.21.15.88:0/3050433498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58a00fb780 msgr2=0x7f58a010f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.595+0000 7f58a5134700 1 --2- 172.21.15.88:0/3050433498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58a00fb780 0x7f58a010f7e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5894009330 tx=0x7f5894009e30 comp rx=0 tx=0).stop 2023-12-09T02:28:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.595+0000 7f58a5134700 1 -- 172.21.15.88:0/3050433498 shutdown_connections 2023-12-09T02:28:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.595+0000 7f58a5134700 1 --2- 172.21.15.88:0/3050433498 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5888036720 0x7f5888038bd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.595+0000 7f58a5134700 1 --2- 172.21.15.88:0/3050433498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58a00fb780 0x7f58a010f7e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.595+0000 7f58a5134700 1 -- 172.21.15.88:0/3050433498 >> 172.21.15.88:0/3050433498 conn(0x7f58a00f6e40 msgr2=0x7f58a00f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.595+0000 7f58a5134700 1 -- 172.21.15.88:0/3050433498 shutdown_connections 2023-12-09T02:28:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:53.595+0000 7f58a5134700 1 -- 172.21.15.88:0/3050433498 wait complete. 2023-12-09T02:28:54.103 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:54 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:54.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:54 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:54.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:54 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:28:54.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:54 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:54.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:54 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:28:54.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:54 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-09T02:28:54.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:54 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:28:54.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:54 smithi088 ceph-mon[112028]: Deploying daemon crash.smithi088 on smithi088 2023-12-09T02:28:54.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:54 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:54.236 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi161 2023-12-09T02:28:54.236 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:28:54.237 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.conf 2023-12-09T02:28:54.259 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:28:54.259 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:28:54.319 INFO:tasks.cephadm:Adding host smithi161 to orchestrator... 2023-12-09T02:28:54.319 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph orch host add smithi161 2023-12-09T02:28:54.692 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:28:55.305 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:55 smithi088 ceph-mon[112028]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:55.306 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:55 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:55.306 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:55 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:55.306 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:55 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:55.306 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:55 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.737+0000 7fc218d9d700 1 -- 172.21.15.88:0/3163899504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214071bc0 msgr2=0x7fc214070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.737+0000 7fc218d9d700 1 --2- 172.21.15.88:0/3163899504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214071bc0 0x7fc214070030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2080048c0 tx=0x7fc208009e30 comp rx=0 tx=0).stop 2023-12-09T02:28:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.737+0000 7fc218d9d700 1 -- 172.21.15.88:0/3163899504 shutdown_connections 2023-12-09T02:28:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.737+0000 7fc218d9d700 1 --2- 172.21.15.88:0/3163899504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214071bc0 0x7fc214070030 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.737+0000 7fc218d9d700 1 -- 172.21.15.88:0/3163899504 >> 172.21.15.88:0/3163899504 conn(0x7fc2140f7f20 msgr2=0x7fc2140fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.737+0000 7fc218d9d700 1 -- 172.21.15.88:0/3163899504 shutdown_connections 2023-12-09T02:28:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.737+0000 7fc218d9d700 1 -- 172.21.15.88:0/3163899504 wait complete. 2023-12-09T02:28:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.738+0000 7fc218d9d700 1 Processor -- start 2023-12-09T02:28:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.738+0000 7fc218d9d700 1 -- start start 2023-12-09T02:28:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.738+0000 7fc218d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214071bc0 0x7fc214113090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.738+0000 7fc218d9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2141135d0 con 0x7fc214071bc0 2023-12-09T02:28:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.738+0000 7fc21259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214071bc0 0x7fc214113090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.738+0000 7fc21259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214071bc0 0x7fc214113090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37028/0 (socket says 172.21.15.88:37028) 2023-12-09T02:28:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.738+0000 7fc21259c700 1 -- 172.21.15.88:0/1768213486 learned_addr learned my addr 172.21.15.88:0/1768213486 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.738+0000 7fc21259c700 1 -- 172.21.15.88:0/1768213486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208005040 con 0x7fc214071bc0 2023-12-09T02:28:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.739+0000 7fc21259c700 1 --2- 172.21.15.88:0/1768213486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214071bc0 0x7fc214113090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc20800b690 tx=0x7fc208009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.739+0000 7fc202ffd700 1 -- 172.21.15.88:0/1768213486 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc208009650 con 0x7fc214071bc0 2023-12-09T02:28:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.739+0000 7fc218d9d700 1 -- 172.21.15.88:0/1768213486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2141137d0 con 0x7fc214071bc0 2023-12-09T02:28:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.739+0000 7fc202ffd700 1 -- 172.21.15.88:0/1768213486 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc2080097b0 con 0x7fc214071bc0 2023-12-09T02:28:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.739+0000 7fc202ffd700 1 -- 172.21.15.88:0/1768213486 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc20801c5b0 con 0x7fc214071bc0 2023-12-09T02:28:55.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.739+0000 7fc218d9d700 1 -- 172.21.15.88:0/1768213486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc214114470 con 0x7fc214071bc0 2023-12-09T02:28:55.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.740+0000 7fc202ffd700 1 -- 172.21.15.88:0/1768213486 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fc208013a60 con 0x7fc214071bc0 2023-12-09T02:28:55.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.740+0000 7fc218d9d700 1 -- 172.21.15.88:0/1768213486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21405f270 con 0x7fc214071bc0 2023-12-09T02:28:55.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.740+0000 7fc202ffd700 1 --2- 172.21.15.88:0/1768213486 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fc1fc0366d0 0x7fc1fc038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:55.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.740+0000 7fc202ffd700 1 -- 172.21.15.88:0/1768213486 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc208049850 con 0x7fc214071bc0 2023-12-09T02:28:55.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.740+0000 7fc211d9b700 1 --2- 172.21.15.88:0/1768213486 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fc1fc0366d0 0x7fc1fc038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:55.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.741+0000 7fc211d9b700 1 --2- 172.21.15.88:0/1768213486 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fc1fc0366d0 0x7fc1fc038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc204009990 tx=0x7fc204006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:55.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.745+0000 7fc202ffd700 1 -- 172.21.15.88:0/1768213486 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc208011550 con 0x7fc214071bc0 2023-12-09T02:28:55.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:55.948+0000 7fc218d9d700 1 -- 172.21.15.88:0/1768213486 --> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}) v1 -- 0x7fc214115050 con 0x7fc1fc0366d0 2023-12-09T02:28:56.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:56 smithi088 ceph-mon[112028]: Deploying daemon node-exporter.smithi088 on smithi088 2023-12-09T02:28:57.307 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:57 smithi088 ceph-mon[112028]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:28:57.308 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:57 smithi088 ceph-mon[112028]: Deploying cephadm binary to smithi161 2023-12-09T02:28:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:57.636+0000 7fc202ffd700 1 -- 172.21.15.88:0/1768213486 <== mgr.14162 v2:172.21.15.88:6800/2389651586 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fc214115050 con 0x7fc1fc0366d0 2023-12-09T02:28:57.639 INFO:teuthology.orchestra.run.smithi088.stdout:Added host 'smithi161' with addr '172.21.15.161' 2023-12-09T02:28:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:57.638+0000 7fc218d9d700 1 -- 172.21.15.88:0/1768213486 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fc1fc0366d0 msgr2=0x7fc1fc038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:57.638+0000 7fc218d9d700 1 --2- 172.21.15.88:0/1768213486 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fc1fc0366d0 0x7fc1fc038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc204009990 tx=0x7fc204006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:57.638+0000 7fc218d9d700 1 -- 172.21.15.88:0/1768213486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214071bc0 msgr2=0x7fc214113090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:57.638+0000 7fc218d9d700 1 --2- 172.21.15.88:0/1768213486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214071bc0 0x7fc214113090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc20800b690 tx=0x7fc208009e30 comp rx=0 tx=0).stop 2023-12-09T02:28:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:57.638+0000 7fc218d9d700 1 -- 172.21.15.88:0/1768213486 shutdown_connections 2023-12-09T02:28:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:57.638+0000 7fc218d9d700 1 --2- 172.21.15.88:0/1768213486 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fc1fc0366d0 0x7fc1fc038b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:57.638+0000 7fc218d9d700 1 --2- 172.21.15.88:0/1768213486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214071bc0 0x7fc214113090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:57.638+0000 7fc218d9d700 1 -- 172.21.15.88:0/1768213486 >> 172.21.15.88:0/1768213486 conn(0x7fc2140f7f20 msgr2=0x7fc2140f8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:57.639+0000 7fc218d9d700 1 -- 172.21.15.88:0/1768213486 shutdown_connections 2023-12-09T02:28:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:57.639+0000 7fc218d9d700 1 -- 172.21.15.88:0/1768213486 wait complete. 2023-12-09T02:28:58.077 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph orch host ls --format=json 2023-12-09T02:28:58.340 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:28:58.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:58 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:58.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:58 smithi088 ceph-mon[112028]: Added host smithi161 2023-12-09T02:28:58.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:58 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:58.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:58 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:58.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:58 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:58.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:58 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:58.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:58 smithi088 ceph-mon[112028]: Deploying daemon alertmanager.smithi088 on smithi088 2023-12-09T02:28:58.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:28:58 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:28:59.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.297+0000 7fb5c463f700 1 -- 172.21.15.88:0/4250527107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5bc0fb780 msgr2=0x7fb5bc0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:59.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.297+0000 7fb5c463f700 1 --2- 172.21.15.88:0/4250527107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5bc0fb780 0x7fb5bc0fbb90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0048c0 tx=0x7fb5ac009e30 comp rx=0 tx=0).stop 2023-12-09T02:28:59.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.297+0000 7fb5c463f700 1 -- 172.21.15.88:0/4250527107 shutdown_connections 2023-12-09T02:28:59.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.297+0000 7fb5c463f700 1 --2- 172.21.15.88:0/4250527107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5bc0fb780 0x7fb5bc0fbb90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:59.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.297+0000 7fb5c463f700 1 -- 172.21.15.88:0/4250527107 >> 172.21.15.88:0/4250527107 conn(0x7fb5bc0f6e40 msgr2=0x7fb5bc0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:59.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.297+0000 7fb5c463f700 1 -- 172.21.15.88:0/4250527107 shutdown_connections 2023-12-09T02:28:59.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.297+0000 7fb5c463f700 1 -- 172.21.15.88:0/4250527107 wait complete. 2023-12-09T02:28:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.297+0000 7fb5c463f700 1 Processor -- start 2023-12-09T02:28:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.297+0000 7fb5c463f700 1 -- start start 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5c463f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5bc0fb780 0x7fb5bc10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5c463f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc10f290 con 0x7fb5bc0fb780 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5c23db700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5bc0fb780 0x7fb5bc10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5c23db700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5bc0fb780 0x7fb5bc10ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49100/0 (socket says 172.21.15.88:49100) 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5c23db700 1 -- 172.21.15.88:0/4067806951 learned_addr learned my addr 172.21.15.88:0/4067806951 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5c23db700 1 -- 172.21.15.88:0/4067806951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac005040 con 0x7fb5bc0fb780 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5c23db700 1 --2- 172.21.15.88:0/4067806951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5bc0fb780 0x7fb5bc10ed50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac009330 tx=0x7fb5ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5b2ffd700 1 -- 172.21.15.88:0/4067806951 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5ac0096b0 con 0x7fb5bc0fb780 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5b2ffd700 1 -- 172.21.15.88:0/4067806951 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5ac009810 con 0x7fb5bc0fb780 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5c463f700 1 -- 172.21.15.88:0/4067806951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc10f490 con 0x7fb5bc0fb780 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5b2ffd700 1 -- 172.21.15.88:0/4067806951 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5ac01c5b0 con 0x7fb5bc0fb780 2023-12-09T02:28:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.298+0000 7fb5c463f700 1 -- 172.21.15.88:0/4067806951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc10fff0 con 0x7fb5bc0fb780 2023-12-09T02:28:59.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.299+0000 7fb5b2ffd700 1 -- 172.21.15.88:0/4067806951 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fb5ac01c870 con 0x7fb5bc0fb780 2023-12-09T02:28:59.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.299+0000 7fb5c463f700 1 -- 172.21.15.88:0/4067806951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc04bb80 con 0x7fb5bc0fb780 2023-12-09T02:28:59.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.299+0000 7fb5b2ffd700 1 --2- 172.21.15.88:0/4067806951 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb5a80366d0 0x7fb5a8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:28:59.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.299+0000 7fb5b2ffd700 1 -- 172.21.15.88:0/4067806951 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb5ac049a10 con 0x7fb5bc0fb780 2023-12-09T02:28:59.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.299+0000 7fb5c1bda700 1 --2- 172.21.15.88:0/4067806951 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb5a80366d0 0x7fb5a8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:28:59.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.300+0000 7fb5c1bda700 1 --2- 172.21.15.88:0/4067806951 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb5a80366d0 0x7fb5a8038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009990 tx=0x7fb5b8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:28:59.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.304+0000 7fb5b2ffd700 1 -- 172.21.15.88:0/4067806951 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb5ac011dd0 con 0x7fb5bc0fb780 2023-12-09T02:28:59.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.514+0000 7fb5c463f700 1 -- 172.21.15.88:0/4067806951 --> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5bc110180 con 0x7fb5a80366d0 2023-12-09T02:28:59.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.515+0000 7fb5b2ffd700 1 -- 172.21.15.88:0/4067806951 <== mgr.14162 v2:172.21.15.88:6800/2389651586 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fb5bc110180 con 0x7fb5a80366d0 2023-12-09T02:28:59.517 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:28:59.517 INFO:teuthology.orchestra.run.smithi088.stdout:[{"addr": "172.21.15.88", "hostname": "smithi088", "labels": [], "status": ""}, {"addr": "172.21.15.161", "hostname": "smithi161", "labels": [], "status": ""}] 2023-12-09T02:28:59.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.517+0000 7fb5c463f700 1 -- 172.21.15.88:0/4067806951 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb5a80366d0 msgr2=0x7fb5a8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:59.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.517+0000 7fb5c463f700 1 --2- 172.21.15.88:0/4067806951 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb5a80366d0 0x7fb5a8038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009990 tx=0x7fb5b8006e40 comp rx=0 tx=0).stop 2023-12-09T02:28:59.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.517+0000 7fb5c463f700 1 -- 172.21.15.88:0/4067806951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5bc0fb780 msgr2=0x7fb5bc10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:28:59.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.517+0000 7fb5c463f700 1 --2- 172.21.15.88:0/4067806951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5bc0fb780 0x7fb5bc10ed50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac009330 tx=0x7fb5ac009e30 comp rx=0 tx=0).stop 2023-12-09T02:28:59.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.517+0000 7fb5c463f700 1 -- 172.21.15.88:0/4067806951 shutdown_connections 2023-12-09T02:28:59.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.517+0000 7fb5c463f700 1 --2- 172.21.15.88:0/4067806951 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb5a80366d0 0x7fb5a8038b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:59.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.517+0000 7fb5c463f700 1 --2- 172.21.15.88:0/4067806951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5bc0fb780 0x7fb5bc10ed50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:28:59.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.517+0000 7fb5c463f700 1 -- 172.21.15.88:0/4067806951 >> 172.21.15.88:0/4067806951 conn(0x7fb5bc0f6e40 msgr2=0x7fb5bc065670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:28:59.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.517+0000 7fb5c463f700 1 -- 172.21.15.88:0/4067806951 shutdown_connections 2023-12-09T02:28:59.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:28:59.518+0000 7fb5c463f700 1 -- 172.21.15.88:0/4067806951 wait complete. 2023-12-09T02:29:00.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:00 smithi088 ceph-mon[112028]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-09T02:29:01.157 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-09T02:29:01.158 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd crush tunables default 2023-12-09T02:29:01.543 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:29:03.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.389+0000 7f511252a700 1 -- 172.21.15.88:0/2106371289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f510c0fb770 msgr2=0x7f510c0fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:03.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.389+0000 7f511252a700 1 --2- 172.21.15.88:0/2106371289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f510c0fb770 0x7f510c0fbb80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0048c0 tx=0x7f50fc009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:03.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.389+0000 7f511252a700 1 -- 172.21.15.88:0/2106371289 shutdown_connections 2023-12-09T02:29:03.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.389+0000 7f511252a700 1 --2- 172.21.15.88:0/2106371289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f510c0fb770 0x7f510c0fbb80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.389+0000 7f511252a700 1 -- 172.21.15.88:0/2106371289 >> 172.21.15.88:0/2106371289 conn(0x7f510c0f6e50 msgr2=0x7f510c0f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.389+0000 7f511252a700 1 -- 172.21.15.88:0/2106371289 shutdown_connections 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.389+0000 7f511252a700 1 -- 172.21.15.88:0/2106371289 wait complete. 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.390+0000 7f511252a700 1 Processor -- start 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.390+0000 7f511252a700 1 -- start start 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.390+0000 7f511252a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f510c0fb770 0x7f510c111ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.390+0000 7f511252a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c10d590 con 0x7f510c0fb770 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.390+0000 7f510bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f510c0fb770 0x7f510c111ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.390+0000 7f510bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f510c0fb770 0x7f510c111ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49130/0 (socket says 172.21.15.88:49130) 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.391+0000 7f510bfff700 1 -- 172.21.15.88:0/2620781499 learned_addr learned my addr 172.21.15.88:0/2620781499 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.391+0000 7f510bfff700 1 -- 172.21.15.88:0/2620781499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc005040 con 0x7f510c0fb770 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.391+0000 7f510bfff700 1 --2- 172.21.15.88:0/2620781499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f510c0fb770 0x7f510c111ba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009330 tx=0x7f50fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.391+0000 7f5108ff9700 1 -- 172.21.15.88:0/2620781499 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50fc0096b0 con 0x7f510c0fb770 2023-12-09T02:29:03.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.391+0000 7f5108ff9700 1 -- 172.21.15.88:0/2620781499 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f50fc009810 con 0x7f510c0fb770 2023-12-09T02:29:03.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.391+0000 7f511252a700 1 -- 172.21.15.88:0/2620781499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c0662a0 con 0x7f510c0fb770 2023-12-09T02:29:03.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.391+0000 7f5108ff9700 1 -- 172.21.15.88:0/2620781499 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50fc01c5b0 con 0x7f510c0fb770 2023-12-09T02:29:03.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.391+0000 7f511252a700 1 -- 172.21.15.88:0/2620781499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c1120e0 con 0x7f510c0fb770 2023-12-09T02:29:03.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.392+0000 7f5108ff9700 1 -- 172.21.15.88:0/2620781499 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f50fc01c870 con 0x7f510c0fb770 2023-12-09T02:29:03.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.392+0000 7f5108ff9700 1 --2- 172.21.15.88:0/2620781499 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f50f4036720 0x7f50f4038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:03.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.392+0000 7f5108ff9700 1 -- 172.21.15.88:0/2620781499 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f50fc04a8f0 con 0x7f510c0fb770 2023-12-09T02:29:03.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.392+0000 7f511252a700 1 -- 172.21.15.88:0/2620781499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510c105400 con 0x7f510c0fb770 2023-12-09T02:29:03.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.392+0000 7f510b7fe700 1 --2- 172.21.15.88:0/2620781499 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f50f4036720 0x7f50f4038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:03.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.393+0000 7f510b7fe700 1 --2- 172.21.15.88:0/2620781499 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f50f4036720 0x7f50f4038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5100009990 tx=0x7f5100006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:03.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.398+0000 7f5108ff9700 1 -- 172.21.15.88:0/2620781499 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f50fc011dd0 con 0x7f510c0fb770 2023-12-09T02:29:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.599+0000 7f511252a700 1 -- 172.21.15.88:0/2620781499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f510c04bb80 con 0x7f510c0fb770 2023-12-09T02:29:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.928+0000 7f5108ff9700 1 -- 172.21.15.88:0/2620781499 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f510c04bb80 con 0x7f510c0fb770 2023-12-09T02:29:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.930+0000 7f511252a700 1 -- 172.21.15.88:0/2620781499 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f50f4036720 msgr2=0x7f50f4038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.930+0000 7f511252a700 1 --2- 172.21.15.88:0/2620781499 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f50f4036720 0x7f50f4038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5100009990 tx=0x7f5100006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:03.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.930+0000 7f511252a700 1 -- 172.21.15.88:0/2620781499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f510c0fb770 msgr2=0x7f510c111ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:03.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.930+0000 7f511252a700 1 --2- 172.21.15.88:0/2620781499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f510c0fb770 0x7f510c111ba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009330 tx=0x7f50fc009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:03.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.930+0000 7f511252a700 1 -- 172.21.15.88:0/2620781499 shutdown_connections 2023-12-09T02:29:03.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.930+0000 7f511252a700 1 --2- 172.21.15.88:0/2620781499 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f50f4036720 0x7f50f4038bd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:03.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.930+0000 7f511252a700 1 --2- 172.21.15.88:0/2620781499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f510c0fb770 0x7f510c111ba0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:03.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.930+0000 7f511252a700 1 -- 172.21.15.88:0/2620781499 >> 172.21.15.88:0/2620781499 conn(0x7f510c0f6e50 msgr2=0x7f510c0f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:03.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.930+0000 7f511252a700 1 -- 172.21.15.88:0/2620781499 shutdown_connections 2023-12-09T02:29:03.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:03.930+0000 7f511252a700 1 -- 172.21.15.88:0/2620781499 wait complete. 2023-12-09T02:29:03.932 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2023-12-09T02:29:04.142 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:03 smithi088 ceph-mon[112028]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:04.143 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:03 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2620781499' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-09T02:29:04.143 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:03 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:04.143 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:03 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:04.143 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:03 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:04.143 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:03 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:04.298 INFO:tasks.cephadm:Adding mon.smithi088 on smithi088 2023-12-09T02:29:04.298 INFO:tasks.cephadm:Adding mon.smithi161 on smithi161 2023-12-09T02:29:04.298 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph orch apply mon '2;smithi088:172.21.15.88=smithi088;smithi161:172.21.15.161=smithi161' 2023-12-09T02:29:04.581 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:04.642 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:04 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2620781499' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-09T02:29:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:04 smithi088 ceph-mon[112028]: osdmap e4: 0 total, 0 up, 0 in 2023-12-09T02:29:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:04 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:04 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:04 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-09T02:29:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:04 smithi088 ceph-mon[112028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-09T02:29:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:04 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:04 smithi088 ceph-mon[112028]: Deploying daemon grafana.smithi088 on smithi088 2023-12-09T02:29:05.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.891+0000 7ff8b5b23700 1 -- 172.21.15.161:0/1409851925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b00fb770 msgr2=0x7ff8b00fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:05.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.891+0000 7ff8b5b23700 1 --2- 172.21.15.161:0/1409851925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b00fb770 0x7ff8b00fbb80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40048c0 tx=0x7ff8a4009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:05.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.891+0000 7ff8b5b23700 1 -- 172.21.15.161:0/1409851925 shutdown_connections 2023-12-09T02:29:05.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.891+0000 7ff8b5b23700 1 --2- 172.21.15.161:0/1409851925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b00fb770 0x7ff8b00fbb80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:05.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.891+0000 7ff8b5b23700 1 -- 172.21.15.161:0/1409851925 >> 172.21.15.161:0/1409851925 conn(0x7ff8b00f6e50 msgr2=0x7ff8b00f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.891+0000 7ff8b5b23700 1 -- 172.21.15.161:0/1409851925 shutdown_connections 2023-12-09T02:29:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.891+0000 7ff8b5b23700 1 -- 172.21.15.161:0/1409851925 wait complete. 2023-12-09T02:29:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.892+0000 7ff8b5b23700 1 Processor -- start 2023-12-09T02:29:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.892+0000 7ff8b5b23700 1 -- start start 2023-12-09T02:29:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.892+0000 7ff8b5b23700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b00fb770 0x7ff8b010f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.892+0000 7ff8b5b23700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00662c0 con 0x7ff8b00fb770 2023-12-09T02:29:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.892+0000 7ff8af7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b00fb770 0x7ff8b010f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.892+0000 7ff8af7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b00fb770 0x7ff8b010f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:43806/0 (socket says 172.21.15.161:43806) 2023-12-09T02:29:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.892+0000 7ff8af7fe700 1 -- 172.21.15.161:0/3276420478 learned_addr learned my addr 172.21.15.161:0/3276420478 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.892+0000 7ff8af7fe700 1 -- 172.21.15.161:0/3276420478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a4005040 con 0x7ff8b00fb770 2023-12-09T02:29:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.893+0000 7ff8af7fe700 1 --2- 172.21.15.161:0/3276420478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b00fb770 0x7ff8b010f780 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400b690 tx=0x7ff8a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:05.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.893+0000 7ff897fff700 1 -- 172.21.15.161:0/3276420478 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8a4009650 con 0x7ff8b00fb770 2023-12-09T02:29:05.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.893+0000 7ff897fff700 1 -- 172.21.15.161:0/3276420478 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff8a40097b0 con 0x7ff8b00fb770 2023-12-09T02:29:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.893+0000 7ff8b5b23700 1 -- 172.21.15.161:0/3276420478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b00664c0 con 0x7ff8b00fb770 2023-12-09T02:29:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.893+0000 7ff897fff700 1 -- 172.21.15.161:0/3276420478 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8a401c5d0 con 0x7ff8b00fb770 2023-12-09T02:29:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.893+0000 7ff8b5b23700 1 -- 172.21.15.161:0/3276420478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b010ff00 con 0x7ff8b00fb770 2023-12-09T02:29:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.894+0000 7ff897fff700 1 -- 172.21.15.161:0/3276420478 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7ff8a401c730 con 0x7ff8b00fb770 2023-12-09T02:29:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.894+0000 7ff897fff700 1 --2- 172.21.15.161:0/3276420478 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ff898036720 0x7ff898038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.894+0000 7ff897fff700 1 -- 172.21.15.161:0/3276420478 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff8a4049a40 con 0x7ff8b00fb770 2023-12-09T02:29:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.894+0000 7ff8b5b23700 1 -- 172.21.15.161:0/3276420478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b0105400 con 0x7ff8b00fb770 2023-12-09T02:29:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.894+0000 7ff8aeffd700 1 --2- 172.21.15.161:0/3276420478 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ff898036720 0x7ff898038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.894+0000 7ff8aeffd700 1 --2- 172.21.15.161:0/3276420478 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ff898036720 0x7ff898038bd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009990 tx=0x7ff8a0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:05.900+0000 7ff897fff700 1 -- 172.21.15.161:0/3276420478 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff8a40123c0 con 0x7ff8b00fb770 2023-12-09T02:29:06.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.089+0000 7ff8b5b23700 1 -- 172.21.15.161:0/3276420478 --> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi088:172.21.15.88=smithi088;smithi161:172.21.15.161=smithi161", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8b002b2a0 con 0x7ff898036720 2023-12-09T02:29:06.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.097+0000 7ff897fff700 1 -- 172.21.15.161:0/3276420478 <== mgr.14162 v2:172.21.15.88:6800/2389651586 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff8b002b2a0 con 0x7ff898036720 2023-12-09T02:29:06.099 INFO:teuthology.orchestra.run.smithi161.stdout:Scheduled mon update... 2023-12-09T02:29:06.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.098+0000 7ff8b5b23700 1 -- 172.21.15.161:0/3276420478 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ff898036720 msgr2=0x7ff898038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:06.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.098+0000 7ff8b5b23700 1 --2- 172.21.15.161:0/3276420478 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ff898036720 0x7ff898038bd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009990 tx=0x7ff8a0006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:06.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.098+0000 7ff8b5b23700 1 -- 172.21.15.161:0/3276420478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b00fb770 msgr2=0x7ff8b010f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:06.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.098+0000 7ff8b5b23700 1 --2- 172.21.15.161:0/3276420478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b00fb770 0x7ff8b010f780 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400b690 tx=0x7ff8a4009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:06.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.098+0000 7ff8b5b23700 1 -- 172.21.15.161:0/3276420478 shutdown_connections 2023-12-09T02:29:06.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.098+0000 7ff8b5b23700 1 --2- 172.21.15.161:0/3276420478 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7ff898036720 0x7ff898038bd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:06.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.098+0000 7ff8b5b23700 1 --2- 172.21.15.161:0/3276420478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b00fb770 0x7ff8b010f780 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:06.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.098+0000 7ff8b5b23700 1 -- 172.21.15.161:0/3276420478 >> 172.21.15.161:0/3276420478 conn(0x7ff8b00f6e50 msgr2=0x7ff8b00f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:06.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.099+0000 7ff8b5b23700 1 -- 172.21.15.161:0/3276420478 shutdown_connections 2023-12-09T02:29:06.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:06.099+0000 7ff8b5b23700 1 -- 172.21.15.161:0/3276420478 wait complete. 2023-12-09T02:29:06.476 DEBUG:teuthology.orchestra.run.smithi161:mon.smithi161> sudo journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi161.service 2023-12-09T02:29:06.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:06 smithi088 ceph-mon[112028]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:06.481 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:06.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:06.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:-- Logs begin at Sat 2023-12-09 02:10:06 UTC. -- 2023-12-09T02:29:06.793 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:06.848 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:07.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:07 smithi088 ceph-mon[112028]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi088:172.21.15.88=smithi088;smithi161:172.21.15.161=smithi161", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:29:07.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:07 smithi088 ceph-mon[112028]: Saving service mon spec with placement smithi088:172.21.15.88=smithi088;smithi161:172.21.15.161=smithi161;count:2 2023-12-09T02:29:07.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:07 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:07.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.931+0000 7fb9c6b18700 1 -- 172.21.15.161:0/122414213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c00fb770 msgr2=0x7fb9c00fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:07.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.931+0000 7fb9c6b18700 1 --2- 172.21.15.161:0/122414213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c00fb770 0x7fb9c00fbb80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40048c0 tx=0x7fb9b4009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:07.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.931+0000 7fb9c6b18700 1 -- 172.21.15.161:0/122414213 shutdown_connections 2023-12-09T02:29:07.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.931+0000 7fb9c6b18700 1 --2- 172.21.15.161:0/122414213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c00fb770 0x7fb9c00fbb80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:07.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.931+0000 7fb9c6b18700 1 -- 172.21.15.161:0/122414213 >> 172.21.15.161:0/122414213 conn(0x7fb9c00f6e50 msgr2=0x7fb9c00f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:07.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.931+0000 7fb9c6b18700 1 -- 172.21.15.161:0/122414213 shutdown_connections 2023-12-09T02:29:07.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.931+0000 7fb9c6b18700 1 -- 172.21.15.161:0/122414213 wait complete. 2023-12-09T02:29:07.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.931+0000 7fb9c6b18700 1 Processor -- start 2023-12-09T02:29:07.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.931+0000 7fb9c6b18700 1 -- start start 2023-12-09T02:29:07.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9c6b18700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c00fb770 0x7fb9c010ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:07.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9c6b18700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c010cfd0 con 0x7fb9c00fb770 2023-12-09T02:29:07.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9c48b4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c00fb770 0x7fb9c010ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:07.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9c48b4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c00fb770 0x7fb9c010ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:43820/0 (socket says 172.21.15.161:43820) 2023-12-09T02:29:07.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9c48b4700 1 -- 172.21.15.161:0/2789716996 learned_addr learned my addr 172.21.15.161:0/2789716996 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:07.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9c48b4700 1 -- 172.21.15.161:0/2789716996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b4005040 con 0x7fb9c00fb770 2023-12-09T02:29:07.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9c48b4700 1 --2- 172.21.15.161:0/2789716996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c00fb770 0x7fb9c010ca90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009330 tx=0x7fb9b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:07.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9bd7fa700 1 -- 172.21.15.161:0/2789716996 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9b40096b0 con 0x7fb9c00fb770 2023-12-09T02:29:07.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9bd7fa700 1 -- 172.21.15.161:0/2789716996 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb9b4009810 con 0x7fb9c00fb770 2023-12-09T02:29:07.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9c6b18700 1 -- 172.21.15.161:0/2789716996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c010d1d0 con 0x7fb9c00fb770 2023-12-09T02:29:07.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9bd7fa700 1 -- 172.21.15.161:0/2789716996 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9b401c5b0 con 0x7fb9c00fb770 2023-12-09T02:29:07.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.932+0000 7fb9c6b18700 1 -- 172.21.15.161:0/2789716996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c010de70 con 0x7fb9c00fb770 2023-12-09T02:29:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.933+0000 7fb9bd7fa700 1 -- 172.21.15.161:0/2789716996 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fb9b4013420 con 0x7fb9c00fb770 2023-12-09T02:29:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.933+0000 7fb9c6b18700 1 -- 172.21.15.161:0/2789716996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c005f270 con 0x7fb9c00fb770 2023-12-09T02:29:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.933+0000 7fb9bd7fa700 1 --2- 172.21.15.161:0/2789716996 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb9b00366d0 0x7fb9b0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.933+0000 7fb9bd7fa700 1 -- 172.21.15.161:0/2789716996 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb9b4049ad0 con 0x7fb9c00fb770 2023-12-09T02:29:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.934+0000 7fb9bffff700 1 --2- 172.21.15.161:0/2789716996 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb9b00366d0 0x7fb9b0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.934+0000 7fb9bffff700 1 --2- 172.21.15.161:0/2789716996 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb9b00366d0 0x7fb9b0038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009990 tx=0x7fb9ac006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:07.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:07.938+0000 7fb9bd7fa700 1 -- 172.21.15.161:0/2789716996 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb9b40119c0 con 0x7fb9c00fb770 2023-12-09T02:29:08.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.189+0000 7fb9c6b18700 1 -- 172.21.15.161:0/2789716996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb9c010e1f0 con 0x7fb9c00fb770 2023-12-09T02:29:08.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.189+0000 7fb9bd7fa700 1 -- 172.21.15.161:0/2789716996 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb9b4011370 con 0x7fb9c00fb770 2023-12-09T02:29:08.192 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:08.192 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:08.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.191+0000 7fb9c6b18700 1 -- 172.21.15.161:0/2789716996 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb9b00366d0 msgr2=0x7fb9b0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:08.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.191+0000 7fb9c6b18700 1 --2- 172.21.15.161:0/2789716996 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb9b00366d0 0x7fb9b0038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009990 tx=0x7fb9ac006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.191+0000 7fb9c6b18700 1 -- 172.21.15.161:0/2789716996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c00fb770 msgr2=0x7fb9c010ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.191+0000 7fb9c6b18700 1 --2- 172.21.15.161:0/2789716996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c00fb770 0x7fb9c010ca90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009330 tx=0x7fb9b4009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.191+0000 7fb9c6b18700 1 -- 172.21.15.161:0/2789716996 shutdown_connections 2023-12-09T02:29:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.191+0000 7fb9c6b18700 1 --2- 172.21.15.161:0/2789716996 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fb9b00366d0 0x7fb9b0038b80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.191+0000 7fb9c6b18700 1 --2- 172.21.15.161:0/2789716996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c00fb770 0x7fb9c010ca90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.192+0000 7fb9c6b18700 1 -- 172.21.15.161:0/2789716996 >> 172.21.15.161:0/2789716996 conn(0x7fb9c00f6e50 msgr2=0x7fb9c00f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.192+0000 7fb9c6b18700 1 -- 172.21.15.161:0/2789716996 shutdown_connections 2023-12-09T02:29:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:08.192+0000 7fb9c6b18700 1 -- 172.21.15.161:0/2789716996 wait complete. 2023-12-09T02:29:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:08 smithi088 ceph-mon[112028]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:08 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:09.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:09 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/2789716996' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:09.617 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:09.617 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:09.906 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:09.963 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:10.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:10 smithi088 ceph-mon[112028]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:11.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.017+0000 7f99a9bf8700 1 -- 172.21.15.161:0/3228628174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4066330 msgr2=0x7f99a40ff420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:11.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.017+0000 7f99a9bf8700 1 --2- 172.21.15.161:0/3228628174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4066330 0x7f99a40ff420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f99980048c0 tx=0x7f9998009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:11.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.017+0000 7f99a9bf8700 1 -- 172.21.15.161:0/3228628174 shutdown_connections 2023-12-09T02:29:11.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.017+0000 7f99a9bf8700 1 --2- 172.21.15.161:0/3228628174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4066330 0x7f99a40ff420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:11.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.017+0000 7f99a9bf8700 1 -- 172.21.15.161:0/3228628174 >> 172.21.15.161:0/3228628174 conn(0x7f99a40f6e50 msgr2=0x7f99a40f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:11.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.017+0000 7f99a9bf8700 1 -- 172.21.15.161:0/3228628174 shutdown_connections 2023-12-09T02:29:11.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.017+0000 7f99a9bf8700 1 -- 172.21.15.161:0/3228628174 wait complete. 2023-12-09T02:29:11.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.017+0000 7f99a9bf8700 1 Processor -- start 2023-12-09T02:29:11.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.018+0000 7f99a9bf8700 1 -- start start 2023-12-09T02:29:11.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.018+0000 7f99a9bf8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4066330 0x7f99a410ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:11.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.018+0000 7f99a9bf8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a410cfb0 con 0x7f99a4066330 2023-12-09T02:29:11.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.018+0000 7f99a37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4066330 0x7f99a410ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:11.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.018+0000 7f99a37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4066330 0x7f99a410ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:43850/0 (socket says 172.21.15.161:43850) 2023-12-09T02:29:11.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.018+0000 7f99a37fe700 1 -- 172.21.15.161:0/1376130096 learned_addr learned my addr 172.21.15.161:0/1376130096 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:11.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.018+0000 7f99a37fe700 1 -- 172.21.15.161:0/1376130096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998005040 con 0x7f99a4066330 2023-12-09T02:29:11.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.018+0000 7f99a37fe700 1 --2- 172.21.15.161:0/1376130096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4066330 0x7f99a410ca70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f999800b690 tx=0x7f9998009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:11.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.018+0000 7f998bfff700 1 -- 172.21.15.161:0/1376130096 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9998009650 con 0x7f99a4066330 2023-12-09T02:29:11.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.019+0000 7f998bfff700 1 -- 172.21.15.161:0/1376130096 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99980097b0 con 0x7f99a4066330 2023-12-09T02:29:11.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.019+0000 7f99a9bf8700 1 -- 172.21.15.161:0/1376130096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a410d1b0 con 0x7f99a4066330 2023-12-09T02:29:11.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.019+0000 7f998bfff700 1 -- 172.21.15.161:0/1376130096 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f999801c5b0 con 0x7f99a4066330 2023-12-09T02:29:11.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.019+0000 7f99a9bf8700 1 -- 172.21.15.161:0/1376130096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a410de50 con 0x7f99a4066330 2023-12-09T02:29:11.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.020+0000 7f998bfff700 1 -- 172.21.15.161:0/1376130096 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f999801c870 con 0x7f99a4066330 2023-12-09T02:29:11.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.020+0000 7f99a9bf8700 1 -- 172.21.15.161:0/1376130096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a405f270 con 0x7f99a4066330 2023-12-09T02:29:11.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.020+0000 7f998bfff700 1 --2- 172.21.15.161:0/1376130096 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f998c0366d0 0x7f998c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:11.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.020+0000 7f998bfff700 1 -- 172.21.15.161:0/1376130096 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9998049870 con 0x7f99a4066330 2023-12-09T02:29:11.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.020+0000 7f99a2ffd700 1 --2- 172.21.15.161:0/1376130096 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f998c0366d0 0x7f998c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:11.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.020+0000 7f99a2ffd700 1 --2- 172.21.15.161:0/1376130096 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f998c0366d0 0x7f998c038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9994009990 tx=0x7f9994006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:11.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.028+0000 7f998bfff700 1 -- 172.21.15.161:0/1376130096 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9998011550 con 0x7f99a4066330 2023-12-09T02:29:11.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.281+0000 7f99a9bf8700 1 -- 172.21.15.161:0/1376130096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f99a410e9a0 con 0x7f99a4066330 2023-12-09T02:29:11.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.282+0000 7f998bfff700 1 -- 172.21.15.161:0/1376130096 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9998011370 con 0x7f99a4066330 2023-12-09T02:29:11.284 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:11.284 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.284+0000 7f99a9bf8700 1 -- 172.21.15.161:0/1376130096 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f998c0366d0 msgr2=0x7f998c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.284+0000 7f99a9bf8700 1 --2- 172.21.15.161:0/1376130096 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f998c0366d0 0x7f998c038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9994009990 tx=0x7f9994006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.284+0000 7f99a9bf8700 1 -- 172.21.15.161:0/1376130096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4066330 msgr2=0x7f99a410ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.284+0000 7f99a9bf8700 1 --2- 172.21.15.161:0/1376130096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4066330 0x7f99a410ca70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f999800b690 tx=0x7f9998009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.284+0000 7f99a9bf8700 1 -- 172.21.15.161:0/1376130096 shutdown_connections 2023-12-09T02:29:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.284+0000 7f99a9bf8700 1 --2- 172.21.15.161:0/1376130096 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f998c0366d0 0x7f998c038b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.284+0000 7f99a9bf8700 1 --2- 172.21.15.161:0/1376130096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4066330 0x7f99a410ca70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.284+0000 7f99a9bf8700 1 -- 172.21.15.161:0/1376130096 >> 172.21.15.161:0/1376130096 conn(0x7f99a40f6e50 msgr2=0x7f99a40f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.284+0000 7f99a9bf8700 1 -- 172.21.15.161:0/1376130096 shutdown_connections 2023-12-09T02:29:11.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:11.284+0000 7f99a9bf8700 1 -- 172.21.15.161:0/1376130096 wait complete. 2023-12-09T02:29:11.287 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:12.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:12 smithi088 ceph-mon[112028]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:12.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:12 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/1376130096' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:12.717 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:12.718 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:13.000 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:13.058 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:14.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.091+0000 7f54d94e9700 1 -- 172.21.15.161:0/2688360025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54d40fb790 msgr2=0x7f54d40fbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:14.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.091+0000 7f54d94e9700 1 --2- 172.21.15.161:0/2688360025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54d40fb790 0x7f54d40fbba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54c40048c0 tx=0x7f54c4009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:14.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.091+0000 7f54d94e9700 1 -- 172.21.15.161:0/2688360025 shutdown_connections 2023-12-09T02:29:14.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.091+0000 7f54d94e9700 1 --2- 172.21.15.161:0/2688360025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54d40fb790 0x7f54d40fbba0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:14.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.091+0000 7f54d94e9700 1 -- 172.21.15.161:0/2688360025 >> 172.21.15.161:0/2688360025 conn(0x7f54d40f6e50 msgr2=0x7f54d40f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:14.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.092+0000 7f54d94e9700 1 -- 172.21.15.161:0/2688360025 shutdown_connections 2023-12-09T02:29:14.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.092+0000 7f54d94e9700 1 -- 172.21.15.161:0/2688360025 wait complete. 2023-12-09T02:29:14.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.092+0000 7f54d94e9700 1 Processor -- start 2023-12-09T02:29:14.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.092+0000 7f54d94e9700 1 -- start start 2023-12-09T02:29:14.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.092+0000 7f54d94e9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54d40fb790 0x7f54d40f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:14.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.092+0000 7f54d94e9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d40f73d0 con 0x7f54d40fb790 2023-12-09T02:29:14.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.093+0000 7f54d2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54d40fb790 0x7f54d40f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.093+0000 7f54d2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54d40fb790 0x7f54d40f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:43872/0 (socket says 172.21.15.161:43872) 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.093+0000 7f54d2ffd700 1 -- 172.21.15.161:0/666405764 learned_addr learned my addr 172.21.15.161:0/666405764 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.093+0000 7f54d2ffd700 1 -- 172.21.15.161:0/666405764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4005040 con 0x7f54d40fb790 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.093+0000 7f54d2ffd700 1 --2- 172.21.15.161:0/666405764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54d40fb790 0x7f54d40f8f50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f54c400b690 tx=0x7f54c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.093+0000 7f54cb7fe700 1 -- 172.21.15.161:0/666405764 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54c4009650 con 0x7f54d40fb790 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.093+0000 7f54cb7fe700 1 -- 172.21.15.161:0/666405764 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54c40097b0 con 0x7f54d40fb790 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.093+0000 7f54d94e9700 1 -- 172.21.15.161:0/666405764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d40f75d0 con 0x7f54d40fb790 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.093+0000 7f54cb7fe700 1 -- 172.21.15.161:0/666405764 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54c401c5d0 con 0x7f54d40fb790 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.093+0000 7f54d94e9700 1 -- 172.21.15.161:0/666405764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d40f7ac0 con 0x7f54d40fb790 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.094+0000 7f54cb7fe700 1 -- 172.21.15.161:0/666405764 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f54c401c840 con 0x7f54d40fb790 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.094+0000 7f54d94e9700 1 -- 172.21.15.161:0/666405764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d4106430 con 0x7f54d40fb790 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.094+0000 7f54cb7fe700 1 --2- 172.21.15.161:0/666405764 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f54c00366d0 0x7f54c0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.094+0000 7f54cb7fe700 1 -- 172.21.15.161:0/666405764 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f54c4049a00 con 0x7f54d40fb790 2023-12-09T02:29:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.094+0000 7f54d27fc700 1 --2- 172.21.15.161:0/666405764 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f54c00366d0 0x7f54c0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:14.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.095+0000 7f54d27fc700 1 --2- 172.21.15.161:0/666405764 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f54c00366d0 0x7f54c0038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009990 tx=0x7f54bc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:14.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.099+0000 7f54cb7fe700 1 -- 172.21.15.161:0/666405764 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f54c4023950 con 0x7f54d40fb790 2023-12-09T02:29:14.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.354+0000 7f54d94e9700 1 -- 172.21.15.161:0/666405764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f54d404bb80 con 0x7f54d40fb790 2023-12-09T02:29:14.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.355+0000 7f54cb7fe700 1 -- 172.21.15.161:0/666405764 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f54c4023300 con 0x7f54d40fb790 2023-12-09T02:29:14.359 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:14.359 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:14.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.357+0000 7f54d94e9700 1 -- 172.21.15.161:0/666405764 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f54c00366d0 msgr2=0x7f54c0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:14.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.357+0000 7f54d94e9700 1 --2- 172.21.15.161:0/666405764 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f54c00366d0 0x7f54c0038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009990 tx=0x7f54bc006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:14.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.357+0000 7f54d94e9700 1 -- 172.21.15.161:0/666405764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54d40fb790 msgr2=0x7f54d40f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:14.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.357+0000 7f54d94e9700 1 --2- 172.21.15.161:0/666405764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54d40fb790 0x7f54d40f8f50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f54c400b690 tx=0x7f54c4009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:14.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.357+0000 7f54d94e9700 1 -- 172.21.15.161:0/666405764 shutdown_connections 2023-12-09T02:29:14.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.357+0000 7f54d94e9700 1 --2- 172.21.15.161:0/666405764 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f54c00366d0 0x7f54c0038b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:14.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.357+0000 7f54d94e9700 1 --2- 172.21.15.161:0/666405764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54d40fb790 0x7f54d40f8f50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:14.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.357+0000 7f54d94e9700 1 -- 172.21.15.161:0/666405764 >> 172.21.15.161:0/666405764 conn(0x7f54d40f6e50 msgr2=0x7f54d4066100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:14.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.357+0000 7f54d94e9700 1 -- 172.21.15.161:0/666405764 shutdown_connections 2023-12-09T02:29:14.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:14.357+0000 7f54d94e9700 1 -- 172.21.15.161:0/666405764 wait complete. 2023-12-09T02:29:14.362 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:14.365 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:14 smithi088 ceph-mon[112028]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:15.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:15 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/666405764' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:15.778 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:15.779 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:16.066 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:16.126 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:16.216 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:16 smithi088 ceph-mon[112028]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:16.216 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:16 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:16.216 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:16 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:16.216 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:16 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:16.216 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:16 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:16.216 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:16 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:16.216 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:16 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.209+0000 7fef146b2700 1 -- 172.21.15.161:0/2318024445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef0c0fab30 msgr2=0x7fef0c0faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.209+0000 7fef146b2700 1 --2- 172.21.15.161:0/2318024445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef0c0fab30 0x7fef0c0faf40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feefc0048c0 tx=0x7feefc009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.209+0000 7fef146b2700 1 -- 172.21.15.161:0/2318024445 shutdown_connections 2023-12-09T02:29:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.209+0000 7fef146b2700 1 --2- 172.21.15.161:0/2318024445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef0c0fab30 0x7fef0c0faf40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.209+0000 7fef146b2700 1 -- 172.21.15.161:0/2318024445 >> 172.21.15.161:0/2318024445 conn(0x7fef0c0f65d0 msgr2=0x7fef0c0f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.209+0000 7fef146b2700 1 -- 172.21.15.161:0/2318024445 shutdown_connections 2023-12-09T02:29:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.209+0000 7fef146b2700 1 -- 172.21.15.161:0/2318024445 wait complete. 2023-12-09T02:29:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.210+0000 7fef146b2700 1 Processor -- start 2023-12-09T02:29:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.210+0000 7fef146b2700 1 -- start start 2023-12-09T02:29:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.210+0000 7fef146b2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef0c0fab30 0x7fef0c0fd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.210+0000 7fef146b2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0fbad0 con 0x7fef0c0fab30 2023-12-09T02:29:17.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.210+0000 7fef1244e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef0c0fab30 0x7fef0c0fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:17.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.210+0000 7fef1244e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef0c0fab30 0x7fef0c0fd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:43136/0 (socket says 172.21.15.161:43136) 2023-12-09T02:29:17.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.210+0000 7fef1244e700 1 -- 172.21.15.161:0/137728565 learned_addr learned my addr 172.21.15.161:0/137728565 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:17.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.211+0000 7fef1244e700 1 -- 172.21.15.161:0/137728565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc005040 con 0x7fef0c0fab30 2023-12-09T02:29:17.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.211+0000 7fef1244e700 1 --2- 172.21.15.161:0/137728565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef0c0fab30 0x7fef0c0fd650 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feefc009040 tx=0x7feefc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:17.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.211+0000 7fef02ffd700 1 -- 172.21.15.161:0/137728565 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feefc009650 con 0x7fef0c0fab30 2023-12-09T02:29:17.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.211+0000 7fef146b2700 1 -- 172.21.15.161:0/137728565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0c0fbcd0 con 0x7fef0c0fab30 2023-12-09T02:29:17.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.211+0000 7fef02ffd700 1 -- 172.21.15.161:0/137728565 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feefc0097b0 con 0x7fef0c0fab30 2023-12-09T02:29:17.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.211+0000 7fef02ffd700 1 -- 172.21.15.161:0/137728565 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feefc01c5b0 con 0x7fef0c0fab30 2023-12-09T02:29:17.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.211+0000 7fef146b2700 1 -- 172.21.15.161:0/137728565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c0fc1c0 con 0x7fef0c0fab30 2023-12-09T02:29:17.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.212+0000 7fef02ffd700 1 -- 172.21.15.161:0/137728565 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7feefc01c870 con 0x7fef0c0fab30 2023-12-09T02:29:17.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.212+0000 7fef146b2700 1 -- 172.21.15.161:0/137728565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0c1064a0 con 0x7fef0c0fab30 2023-12-09T02:29:17.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.212+0000 7fef02ffd700 1 --2- 172.21.15.161:0/137728565 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7feef80366d0 0x7feef8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:17.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.212+0000 7fef02ffd700 1 -- 172.21.15.161:0/137728565 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7feefc0499b0 con 0x7fef0c0fab30 2023-12-09T02:29:17.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.212+0000 7fef11c4d700 1 --2- 172.21.15.161:0/137728565 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7feef80366d0 0x7feef8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:17.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.213+0000 7fef11c4d700 1 --2- 172.21.15.161:0/137728565 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7feef80366d0 0x7feef8038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fef08009990 tx=0x7fef08006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:17.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.217+0000 7fef02ffd700 1 -- 172.21.15.161:0/137728565 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7feefc011db0 con 0x7fef0c0fab30 2023-12-09T02:29:17.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.472+0000 7fef146b2700 1 -- 172.21.15.161:0/137728565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fef0c04bb80 con 0x7fef0c0fab30 2023-12-09T02:29:17.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.472+0000 7fef02ffd700 1 -- 172.21.15.161:0/137728565 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7feefc023990 con 0x7fef0c0fab30 2023-12-09T02:29:17.474 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:17.474 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:17.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:17 smithi088 ceph-mon[112028]: Deploying daemon prometheus.smithi088 on smithi088 2023-12-09T02:29:17.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.474+0000 7fef146b2700 1 -- 172.21.15.161:0/137728565 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7feef80366d0 msgr2=0x7feef8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:17.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.474+0000 7fef146b2700 1 --2- 172.21.15.161:0/137728565 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7feef80366d0 0x7feef8038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fef08009990 tx=0x7fef08006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:17.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.474+0000 7fef146b2700 1 -- 172.21.15.161:0/137728565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef0c0fab30 msgr2=0x7fef0c0fd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:17.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.474+0000 7fef146b2700 1 --2- 172.21.15.161:0/137728565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef0c0fab30 0x7fef0c0fd650 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feefc009040 tx=0x7feefc009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:17.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.474+0000 7fef146b2700 1 -- 172.21.15.161:0/137728565 shutdown_connections 2023-12-09T02:29:17.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.474+0000 7fef146b2700 1 --2- 172.21.15.161:0/137728565 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7feef80366d0 0x7feef8038b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:17.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.474+0000 7fef146b2700 1 --2- 172.21.15.161:0/137728565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef0c0fab30 0x7fef0c0fd650 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:17.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.474+0000 7fef146b2700 1 -- 172.21.15.161:0/137728565 >> 172.21.15.161:0/137728565 conn(0x7fef0c0f65d0 msgr2=0x7fef0c0f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:17.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.474+0000 7fef146b2700 1 -- 172.21.15.161:0/137728565 shutdown_connections 2023-12-09T02:29:17.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:17.474+0000 7fef146b2700 1 -- 172.21.15.161:0/137728565 wait complete. 2023-12-09T02:29:17.478 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:18.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:18 smithi088 ceph-mon[112028]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:18.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:18 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/137728565' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:18.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:18 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:18.921 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:18.921 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:19.209 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:19.269 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:19.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:19 smithi088 ceph-mon[112028]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:20.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.368+0000 7fa901379700 1 -- 172.21.15.161:0/1363312871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8fc0fab50 msgr2=0x7fa8fc0faf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:20.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.368+0000 7fa901379700 1 --2- 172.21.15.161:0/1363312871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8fc0fab50 0x7fa8fc0faf60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0048c0 tx=0x7fa8ec009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:20.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.368+0000 7fa901379700 1 -- 172.21.15.161:0/1363312871 shutdown_connections 2023-12-09T02:29:20.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.368+0000 7fa901379700 1 --2- 172.21.15.161:0/1363312871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8fc0fab50 0x7fa8fc0faf60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:20.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.368+0000 7fa901379700 1 -- 172.21.15.161:0/1363312871 >> 172.21.15.161:0/1363312871 conn(0x7fa8fc0f65d0 msgr2=0x7fa8fc0f8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:20.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.368+0000 7fa901379700 1 -- 172.21.15.161:0/1363312871 shutdown_connections 2023-12-09T02:29:20.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.368+0000 7fa901379700 1 -- 172.21.15.161:0/1363312871 wait complete. 2023-12-09T02:29:20.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.369+0000 7fa901379700 1 Processor -- start 2023-12-09T02:29:20.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.369+0000 7fa901379700 1 -- start start 2023-12-09T02:29:20.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.369+0000 7fa901379700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8fc0fab50 0x7fa8fc0fd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:20.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.369+0000 7fa901379700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc0fbaf0 con 0x7fa8fc0fab50 2023-12-09T02:29:20.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.369+0000 7fa8faffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8fc0fab50 0x7fa8fc0fd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:20.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.369+0000 7fa8faffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8fc0fab50 0x7fa8fc0fd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:43158/0 (socket says 172.21.15.161:43158) 2023-12-09T02:29:20.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.369+0000 7fa8faffd700 1 -- 172.21.15.161:0/3459507772 learned_addr learned my addr 172.21.15.161:0/3459507772 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:20.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.370+0000 7fa8faffd700 1 -- 172.21.15.161:0/3459507772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec005040 con 0x7fa8fc0fab50 2023-12-09T02:29:20.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.370+0000 7fa8faffd700 1 --2- 172.21.15.161:0/3459507772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8fc0fab50 0x7fa8fc0fd670 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009330 tx=0x7fa8ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.370+0000 7fa8e37fe700 1 -- 172.21.15.161:0/3459507772 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8ec004e60 con 0x7fa8fc0fab50 2023-12-09T02:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.370+0000 7fa901379700 1 -- 172.21.15.161:0/3459507772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8fc0fbcf0 con 0x7fa8fc0fab50 2023-12-09T02:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.370+0000 7fa8e37fe700 1 -- 172.21.15.161:0/3459507772 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8ec009670 con 0x7fa8fc0fab50 2023-12-09T02:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.370+0000 7fa8e37fe700 1 -- 172.21.15.161:0/3459507772 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8ec01c3f0 con 0x7fa8fc0fab50 2023-12-09T02:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.370+0000 7fa901379700 1 -- 172.21.15.161:0/3459507772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8fc0fc1e0 con 0x7fa8fc0fab50 2023-12-09T02:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.371+0000 7fa8e37fe700 1 -- 172.21.15.161:0/3459507772 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fa8ec01c6b0 con 0x7fa8fc0fab50 2023-12-09T02:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.371+0000 7fa901379700 1 -- 172.21.15.161:0/3459507772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8fc1064c0 con 0x7fa8fc0fab50 2023-12-09T02:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.371+0000 7fa8e37fe700 1 --2- 172.21.15.161:0/3459507772 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fa8e40366d0 0x7fa8e4038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.371+0000 7fa8e37fe700 1 -- 172.21.15.161:0/3459507772 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa8ec049aa0 con 0x7fa8fc0fab50 2023-12-09T02:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.371+0000 7fa8fa7fc700 1 --2- 172.21.15.161:0/3459507772 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fa8e40366d0 0x7fa8e4038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.372+0000 7fa8fa7fc700 1 --2- 172.21.15.161:0/3459507772 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fa8e40366d0 0x7fa8e4038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009990 tx=0x7fa8f0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:20.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.376+0000 7fa8e37fe700 1 -- 172.21.15.161:0/3459507772 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa8ec025400 con 0x7fa8fc0fab50 2023-12-09T02:29:20.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.629+0000 7fa901379700 1 -- 172.21.15.161:0/3459507772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa8fc04bb80 con 0x7fa8fc0fab50 2023-12-09T02:29:20.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.630+0000 7fa8e37fe700 1 -- 172.21.15.161:0/3459507772 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa8ec011b60 con 0x7fa8fc0fab50 2023-12-09T02:29:20.632 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:20.632 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:20.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.632+0000 7fa901379700 1 -- 172.21.15.161:0/3459507772 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fa8e40366d0 msgr2=0x7fa8e4038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:20.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.632+0000 7fa901379700 1 --2- 172.21.15.161:0/3459507772 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fa8e40366d0 0x7fa8e4038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009990 tx=0x7fa8f0006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:20.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.632+0000 7fa901379700 1 -- 172.21.15.161:0/3459507772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8fc0fab50 msgr2=0x7fa8fc0fd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:20.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.632+0000 7fa901379700 1 --2- 172.21.15.161:0/3459507772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8fc0fab50 0x7fa8fc0fd670 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009330 tx=0x7fa8ec009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:20.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.632+0000 7fa901379700 1 -- 172.21.15.161:0/3459507772 shutdown_connections 2023-12-09T02:29:20.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.632+0000 7fa901379700 1 --2- 172.21.15.161:0/3459507772 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7fa8e40366d0 0x7fa8e4038b80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:20.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.632+0000 7fa901379700 1 --2- 172.21.15.161:0/3459507772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8fc0fab50 0x7fa8fc0fd670 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:20.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.632+0000 7fa901379700 1 -- 172.21.15.161:0/3459507772 >> 172.21.15.161:0/3459507772 conn(0x7fa8fc0f65d0 msgr2=0x7fa8fc0f7400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:20.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.632+0000 7fa901379700 1 -- 172.21.15.161:0/3459507772 shutdown_connections 2023-12-09T02:29:20.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:20.632+0000 7fa901379700 1 -- 172.21.15.161:0/3459507772 wait complete. 2023-12-09T02:29:20.635 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:20.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:20 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/3459507772' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:21 smithi088 ceph-mon[112028]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:22.022 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:22.023 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:22.315 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:22.376 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.486+0000 7f5f802b4700 1 -- 172.21.15.161:0/662937904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f780fb780 msgr2=0x7f5f780fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.486+0000 7f5f802b4700 1 --2- 172.21.15.161:0/662937904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f780fb780 0x7f5f780fbb90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5f680048c0 tx=0x7f5f68009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.486+0000 7f5f802b4700 1 -- 172.21.15.161:0/662937904 shutdown_connections 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.486+0000 7f5f802b4700 1 --2- 172.21.15.161:0/662937904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f780fb780 0x7f5f780fbb90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.486+0000 7f5f802b4700 1 -- 172.21.15.161:0/662937904 >> 172.21.15.161:0/662937904 conn(0x7f5f780f6e40 msgr2=0x7f5f780f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.486+0000 7f5f802b4700 1 -- 172.21.15.161:0/662937904 shutdown_connections 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.486+0000 7f5f802b4700 1 -- 172.21.15.161:0/662937904 wait complete. 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.486+0000 7f5f802b4700 1 Processor -- start 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.486+0000 7f5f802b4700 1 -- start start 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.486+0000 7f5f802b4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f780fb780 0x7f5f7810ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.486+0000 7f5f802b4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7810cfc0 con 0x7f5f780fb780 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.487+0000 7f5f7e050700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f780fb780 0x7f5f7810ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.487+0000 7f5f7e050700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f780fb780 0x7f5f7810ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:43190/0 (socket says 172.21.15.161:43190) 2023-12-09T02:29:23.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.487+0000 7f5f7e050700 1 -- 172.21.15.161:0/3847463241 learned_addr learned my addr 172.21.15.161:0/3847463241 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:23.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.487+0000 7f5f7e050700 1 -- 172.21.15.161:0/3847463241 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68005040 con 0x7f5f780fb780 2023-12-09T02:29:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.487+0000 7f5f7e050700 1 --2- 172.21.15.161:0/3847463241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f780fb780 0x7f5f7810ca80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800b690 tx=0x7f5f68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.487+0000 7f5f6effd700 1 -- 172.21.15.161:0/3847463241 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f68009650 con 0x7f5f780fb780 2023-12-09T02:29:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.487+0000 7f5f6effd700 1 -- 172.21.15.161:0/3847463241 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f680097b0 con 0x7f5f780fb780 2023-12-09T02:29:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.487+0000 7f5f802b4700 1 -- 172.21.15.161:0/3847463241 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7810d1c0 con 0x7f5f780fb780 2023-12-09T02:29:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.487+0000 7f5f6effd700 1 -- 172.21.15.161:0/3847463241 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f6801c5d0 con 0x7f5f780fb780 2023-12-09T02:29:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.487+0000 7f5f802b4700 1 -- 172.21.15.161:0/3847463241 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7810de60 con 0x7f5f780fb780 2023-12-09T02:29:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.488+0000 7f5f6effd700 1 -- 172.21.15.161:0/3847463241 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f5f68013420 con 0x7f5f780fb780 2023-12-09T02:29:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.488+0000 7f5f802b4700 1 -- 172.21.15.161:0/3847463241 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7805f270 con 0x7f5f780fb780 2023-12-09T02:29:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.488+0000 7f5f6effd700 1 --2- 172.21.15.161:0/3847463241 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5f640366d0 0x7f5f64038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.488+0000 7f5f6effd700 1 -- 172.21.15.161:0/3847463241 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5f68049a10 con 0x7f5f780fb780 2023-12-09T02:29:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.489+0000 7f5f7d84f700 1 --2- 172.21.15.161:0/3847463241 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5f640366d0 0x7f5f64038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:23.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.489+0000 7f5f7d84f700 1 --2- 172.21.15.161:0/3847463241 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5f640366d0 0x7f5f64038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009990 tx=0x7f5f74006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:23.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.494+0000 7f5f6effd700 1 -- 172.21.15.161:0/3847463241 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5f68025400 con 0x7f5f780fb780 2023-12-09T02:29:23.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.747+0000 7f5f802b4700 1 -- 172.21.15.161:0/3847463241 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5f7810e9b0 con 0x7f5f780fb780 2023-12-09T02:29:23.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.748+0000 7f5f6effd700 1 -- 172.21.15.161:0/3847463241 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5f68011370 con 0x7f5f780fb780 2023-12-09T02:29:23.750 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:23.751 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:23.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.750+0000 7f5f802b4700 1 -- 172.21.15.161:0/3847463241 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5f640366d0 msgr2=0x7f5f64038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:23.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.750+0000 7f5f802b4700 1 --2- 172.21.15.161:0/3847463241 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5f640366d0 0x7f5f64038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009990 tx=0x7f5f74006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:23.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.750+0000 7f5f802b4700 1 -- 172.21.15.161:0/3847463241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f780fb780 msgr2=0x7f5f7810ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:23.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.750+0000 7f5f802b4700 1 --2- 172.21.15.161:0/3847463241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f780fb780 0x7f5f7810ca80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800b690 tx=0x7f5f68009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:23.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.750+0000 7f5f802b4700 1 -- 172.21.15.161:0/3847463241 shutdown_connections 2023-12-09T02:29:23.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.751+0000 7f5f802b4700 1 --2- 172.21.15.161:0/3847463241 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f5f640366d0 0x7f5f64038b80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:23.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.751+0000 7f5f802b4700 1 --2- 172.21.15.161:0/3847463241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f780fb780 0x7f5f7810ca80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:23.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.751+0000 7f5f802b4700 1 -- 172.21.15.161:0/3847463241 >> 172.21.15.161:0/3847463241 conn(0x7f5f780f6e40 msgr2=0x7f5f78065610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:23.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.751+0000 7f5f802b4700 1 -- 172.21.15.161:0/3847463241 shutdown_connections 2023-12-09T02:29:23.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:23.751+0000 7f5f802b4700 1 -- 172.21.15.161:0/3847463241 wait complete. 2023-12-09T02:29:23.753 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:23 smithi088 ceph-mon[112028]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:23 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/3847463241' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:25.157 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:25.157 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:25.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:24 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:25.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:24 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:25.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:24 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:25.368 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:24 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-09T02:29:25.438 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:25.500 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:26.331 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:26 smithi088 ceph-mon[112028]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-09T02:29:26.331 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:26 smithi088 ceph-mon[112028]: mgrmap e14: smithi088.jwlofb(active, since 42s) 2023-12-09T02:29:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.549+0000 7f31b3f29700 1 -- 172.21.15.161:0/2444906769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31ac065a60 msgr2=0x7f31ac0ff3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.549+0000 7f31b3f29700 1 --2- 172.21.15.161:0/2444906769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31ac065a60 0x7f31ac0ff3f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f319c0048c0 tx=0x7f319c009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.549+0000 7f31b3f29700 1 -- 172.21.15.161:0/2444906769 shutdown_connections 2023-12-09T02:29:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.549+0000 7f31b3f29700 1 --2- 172.21.15.161:0/2444906769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31ac065a60 0x7f31ac0ff3f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.549+0000 7f31b3f29700 1 -- 172.21.15.161:0/2444906769 >> 172.21.15.161:0/2444906769 conn(0x7f31ac0f6e80 msgr2=0x7f31ac0f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.549+0000 7f31b3f29700 1 -- 172.21.15.161:0/2444906769 shutdown_connections 2023-12-09T02:29:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.549+0000 7f31b3f29700 1 -- 172.21.15.161:0/2444906769 wait complete. 2023-12-09T02:29:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.550+0000 7f31b3f29700 1 Processor -- start 2023-12-09T02:29:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.550+0000 7f31b3f29700 1 -- start start 2023-12-09T02:29:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.550+0000 7f31b3f29700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31ac065a60 0x7f31ac10ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.550+0000 7f31b3f29700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac10cf60 con 0x7f31ac065a60 2023-12-09T02:29:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.550+0000 7f31b1cc5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31ac065a60 0x7f31ac10ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.550+0000 7f31b1cc5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31ac065a60 0x7f31ac10ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:48226/0 (socket says 172.21.15.161:48226) 2023-12-09T02:29:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.550+0000 7f31b1cc5700 1 -- 172.21.15.161:0/2944220383 learned_addr learned my addr 172.21.15.161:0/2944220383 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.550+0000 7f31b1cc5700 1 -- 172.21.15.161:0/2944220383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c005040 con 0x7f31ac065a60 2023-12-09T02:29:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.550+0000 7f31b1cc5700 1 --2- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31ac065a60 0x7f31ac10ca20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f319c009330 tx=0x7f319c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.550+0000 7f31a27fc700 1 -- 172.21.15.161:0/2944220383 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f319c0096b0 con 0x7f31ac065a60 2023-12-09T02:29:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.551+0000 7f31b3f29700 1 -- 172.21.15.161:0/2944220383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac10d160 con 0x7f31ac065a60 2023-12-09T02:29:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.551+0000 7f31a27fc700 1 -- 172.21.15.161:0/2944220383 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f319c009810 con 0x7f31ac065a60 2023-12-09T02:29:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.551+0000 7f31a27fc700 1 -- 172.21.15.161:0/2944220383 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f319c01c5b0 con 0x7f31ac065a60 2023-12-09T02:29:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.551+0000 7f31b3f29700 1 -- 172.21.15.161:0/2944220383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ac10de00 con 0x7f31ac065a60 2023-12-09T02:29:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.551+0000 7f31a27fc700 1 -- 172.21.15.161:0/2944220383 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f319c01c870 con 0x7f31ac065a60 2023-12-09T02:29:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.552+0000 7f31a27fc700 1 --2- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f3198036730 0x7f3198038be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:26.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.552+0000 7f31b3f29700 1 -- 172.21.15.161:0/2944220383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ac05f270 con 0x7f31ac065a60 2023-12-09T02:29:26.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.552+0000 7f31a27fc700 1 -- 172.21.15.161:0/2944220383 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f319c049c20 con 0x7f31ac065a60 2023-12-09T02:29:26.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.552+0000 7f31b14c4700 1 -- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f3198036730 msgr2=0x7f3198038be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2389651586 2023-12-09T02:29:26.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.552+0000 7f31b14c4700 1 --2- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f3198036730 0x7f3198038be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-09T02:29:26.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.560+0000 7f31a27fc700 1 -- 172.21.15.161:0/2944220383 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f319c0117e0 con 0x7f31ac065a60 2023-12-09T02:29:26.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.753+0000 7f31b14c4700 1 -- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f3198036730 msgr2=0x7f3198038be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2389651586 2023-12-09T02:29:26.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.753+0000 7f31b14c4700 1 --2- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f3198036730 0x7f3198038be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-09T02:29:26.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.814+0000 7f31b3f29700 1 -- 172.21.15.161:0/2944220383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f31ac10e920 con 0x7f31ac065a60 2023-12-09T02:29:26.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.814+0000 7f31a27fc700 1 -- 172.21.15.161:0/2944220383 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f319c0117e0 con 0x7f31ac065a60 2023-12-09T02:29:26.817 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:26.817 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:26.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.816+0000 7f31b3f29700 1 -- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f3198036730 msgr2=0x7f3198038be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-09T02:29:26.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.816+0000 7f31b3f29700 1 --2- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f3198036730 0x7f3198038be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:26.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.816+0000 7f31b3f29700 1 -- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31ac065a60 msgr2=0x7f31ac10ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:26.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.816+0000 7f31b3f29700 1 --2- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31ac065a60 0x7f31ac10ca20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f319c009330 tx=0x7f319c009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:26.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.816+0000 7f31b3f29700 1 -- 172.21.15.161:0/2944220383 shutdown_connections 2023-12-09T02:29:26.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.816+0000 7f31b3f29700 1 --2- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f3198036730 0x7f3198038be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:26.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.816+0000 7f31b3f29700 1 --2- 172.21.15.161:0/2944220383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31ac065a60 0x7f31ac10ca20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:26.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.816+0000 7f31b3f29700 1 -- 172.21.15.161:0/2944220383 >> 172.21.15.161:0/2944220383 conn(0x7f31ac0f6e80 msgr2=0x7f31ac0f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:26.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.816+0000 7f31b3f29700 1 -- 172.21.15.161:0/2944220383 shutdown_connections 2023-12-09T02:29:26.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:26.817+0000 7f31b3f29700 1 -- 172.21.15.161:0/2944220383 wait complete. 2023-12-09T02:29:26.819 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:27.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:27 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/2944220383' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:28.210 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:28.211 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:28.498 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:28.559 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:29.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.624+0000 7f831b366700 1 -- 172.21.15.161:0/1681653753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140fb780 msgr2=0x7f83140fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:29.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.624+0000 7f831b366700 1 --2- 172.21.15.161:0/1681653753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140fb780 0x7f83140fbb90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f83040048c0 tx=0x7f8304009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:29.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.624+0000 7f831b366700 1 -- 172.21.15.161:0/1681653753 shutdown_connections 2023-12-09T02:29:29.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.624+0000 7f831b366700 1 --2- 172.21.15.161:0/1681653753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140fb780 0x7f83140fbb90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:29.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.624+0000 7f831b366700 1 -- 172.21.15.161:0/1681653753 >> 172.21.15.161:0/1681653753 conn(0x7f83140f6e40 msgr2=0x7f83140f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:29.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.624+0000 7f831b366700 1 -- 172.21.15.161:0/1681653753 shutdown_connections 2023-12-09T02:29:29.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.624+0000 7f831b366700 1 -- 172.21.15.161:0/1681653753 wait complete. 2023-12-09T02:29:29.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.625+0000 7f831b366700 1 Processor -- start 2023-12-09T02:29:29.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.625+0000 7f831b366700 1 -- start start 2023-12-09T02:29:29.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.625+0000 7f831b366700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140fb780 0x7f831410b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:29.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.625+0000 7f831b366700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831410bee0 con 0x7f83140fb780 2023-12-09T02:29:29.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.625+0000 7f8319102700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140fb780 0x7f831410b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:29.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.625+0000 7f8319102700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140fb780 0x7f831410b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:48244/0 (socket says 172.21.15.161:48244) 2023-12-09T02:29:29.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.625+0000 7f8319102700 1 -- 172.21.15.161:0/1169075680 learned_addr learned my addr 172.21.15.161:0/1169075680 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:29.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.625+0000 7f8319102700 1 -- 172.21.15.161:0/1169075680 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8304005040 con 0x7f83140fb780 2023-12-09T02:29:29.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.625+0000 7f8319102700 1 --2- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140fb780 0x7f831410b9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8304009330 tx=0x7f8304009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:29.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.626+0000 7f8309ffb700 1 -- 172.21.15.161:0/1169075680 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83040096b0 con 0x7f83140fb780 2023-12-09T02:29:29.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.626+0000 7f831b366700 1 -- 172.21.15.161:0/1169075680 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831410c0e0 con 0x7f83140fb780 2023-12-09T02:29:29.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.626+0000 7f8309ffb700 1 -- 172.21.15.161:0/1169075680 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8304009810 con 0x7f83140fb780 2023-12-09T02:29:29.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.626+0000 7f831b366700 1 -- 172.21.15.161:0/1169075680 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831410cd80 con 0x7f83140fb780 2023-12-09T02:29:29.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.626+0000 7f8309ffb700 1 -- 172.21.15.161:0/1169075680 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8304025560 con 0x7f83140fb780 2023-12-09T02:29:29.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.627+0000 7f8309ffb700 1 -- 172.21.15.161:0/1169075680 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f83040256c0 con 0x7f83140fb780 2023-12-09T02:29:29.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.627+0000 7f8309ffb700 1 --2- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f8300036720 0x7f8300038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:29.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.627+0000 7f8309ffb700 1 -- 172.21.15.161:0/1169075680 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8304049b70 con 0x7f83140fb780 2023-12-09T02:29:29.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.627+0000 7f831b366700 1 -- 172.21.15.161:0/1169075680 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831405f270 con 0x7f83140fb780 2023-12-09T02:29:29.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.627+0000 7f8318901700 1 -- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f8300036720 msgr2=0x7f8300038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2389651586 2023-12-09T02:29:29.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.627+0000 7f8318901700 1 --2- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f8300036720 0x7f8300038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-09T02:29:29.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.636+0000 7f8309ffb700 1 -- 172.21.15.161:0/1169075680 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f830401c3f0 con 0x7f83140fb780 2023-12-09T02:29:29.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.828+0000 7f8318901700 1 -- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f8300036720 msgr2=0x7f8300038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2389651586 2023-12-09T02:29:29.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.828+0000 7f8318901700 1 --2- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f8300036720 0x7f8300038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-09T02:29:29.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.888+0000 7f831b366700 1 -- 172.21.15.161:0/1169075680 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f831404bb80 con 0x7f83140fb780 2023-12-09T02:29:29.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.889+0000 7f8309ffb700 1 -- 172.21.15.161:0/1169075680 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8304011b60 con 0x7f83140fb780 2023-12-09T02:29:29.892 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:29.892 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:29.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.891+0000 7f831b366700 1 -- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f8300036720 msgr2=0x7f8300038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-09T02:29:29.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.891+0000 7f831b366700 1 --2- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f8300036720 0x7f8300038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:29.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.891+0000 7f831b366700 1 -- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140fb780 msgr2=0x7f831410b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:29.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.891+0000 7f831b366700 1 --2- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140fb780 0x7f831410b9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8304009330 tx=0x7f8304009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:29.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.891+0000 7f831b366700 1 -- 172.21.15.161:0/1169075680 shutdown_connections 2023-12-09T02:29:29.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.891+0000 7f831b366700 1 --2- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:6800/2389651586,v1:172.21.15.88:6801/2389651586] conn(0x7f8300036720 0x7f8300038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:29.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.891+0000 7f831b366700 1 --2- 172.21.15.161:0/1169075680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140fb780 0x7f831410b9a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:29.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.891+0000 7f831b366700 1 -- 172.21.15.161:0/1169075680 >> 172.21.15.161:0/1169075680 conn(0x7f83140f6e40 msgr2=0x7f83140f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:29.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.891+0000 7f831b366700 1 -- 172.21.15.161:0/1169075680 shutdown_connections 2023-12-09T02:29:29.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:29.891+0000 7f831b366700 1 -- 172.21.15.161:0/1169075680 wait complete. 2023-12-09T02:29:29.895 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:30.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:29 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/1169075680' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:31.324 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:31.325 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:31.622 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:31.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: Active manager daemon smithi088.jwlofb restarted 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: Activating manager daemon smithi088.jwlofb 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: osdmap e5: 0 total, 0 up, 0 in 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: mgrmap e15: smithi088.jwlofb(active, starting, since 0.00454196s) 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi088.jwlofb", "id": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: Manager daemon smithi088.jwlofb is now available 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:31.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:29:31.699 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:32.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.770+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/464259476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4b40fb1b0 msgr2=0x7fd4b40fd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:32.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.770+0000 7fd4bb5e8700 1 --2- 172.21.15.161:0/464259476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4b40fb1b0 0x7fd4b40fd5d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00048c0 tx=0x7fd4b0009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:32.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.770+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/464259476 shutdown_connections 2023-12-09T02:29:32.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.770+0000 7fd4bb5e8700 1 --2- 172.21.15.161:0/464259476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4b40fb1b0 0x7fd4b40fd5d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:32.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.770+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/464259476 >> 172.21.15.161:0/464259476 conn(0x7fd4b40f6e40 msgr2=0x7fd4b40f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:32.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.770+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/464259476 shutdown_connections 2023-12-09T02:29:32.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.770+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/464259476 wait complete. 2023-12-09T02:29:32.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.770+0000 7fd4bb5e8700 1 Processor -- start 2023-12-09T02:29:32.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.770+0000 7fd4bb5e8700 1 -- start start 2023-12-09T02:29:32.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.771+0000 7fd4bb5e8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4b40fb1b0 0x7fd4b4113070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:32.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.771+0000 7fd4bb5e8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b41135b0 con 0x7fd4b40fb1b0 2023-12-09T02:29:32.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.771+0000 7fd4b9384700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4b40fb1b0 0x7fd4b4113070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:32.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.771+0000 7fd4b9384700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4b40fb1b0 0x7fd4b4113070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:48254/0 (socket says 172.21.15.161:48254) 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.771+0000 7fd4b9384700 1 -- 172.21.15.161:0/2506222268 learned_addr learned my addr 172.21.15.161:0/2506222268 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.771+0000 7fd4b9384700 1 -- 172.21.15.161:0/2506222268 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b0005040 con 0x7fd4b40fb1b0 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.771+0000 7fd4b9384700 1 --2- 172.21.15.161:0/2506222268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4b40fb1b0 0x7fd4b4113070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000b690 tx=0x7fd4b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.771+0000 7fd4a9ffb700 1 -- 172.21.15.161:0/2506222268 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b0009650 con 0x7fd4b40fb1b0 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.771+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/2506222268 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b41137b0 con 0x7fd4b40fb1b0 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.772+0000 7fd4a9ffb700 1 -- 172.21.15.161:0/2506222268 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd4b00097b0 con 0x7fd4b40fb1b0 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.772+0000 7fd4a9ffb700 1 -- 172.21.15.161:0/2506222268 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b001c5b0 con 0x7fd4b40fb1b0 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.772+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/2506222268 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b4114450 con 0x7fd4b40fb1b0 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.773+0000 7fd4a9ffb700 1 -- 172.21.15.161:0/2506222268 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 16) v1 ==== 43202+0+0 (secure 0 0 0) 0x7fd4b0013420 con 0x7fd4b40fb1b0 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.773+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/2506222268 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b405f270 con 0x7fd4b40fb1b0 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.773+0000 7fd4a9ffb700 1 --2- 172.21.15.161:0/2506222268 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd4a0036560 0x7fd4a0038a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:32.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.773+0000 7fd4a9ffb700 1 -- 172.21.15.161:0/2506222268 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd4b0049780 con 0x7fd4b40fb1b0 2023-12-09T02:29:32.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.773+0000 7fd4b8b83700 1 --2- 172.21.15.161:0/2506222268 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd4a0036560 0x7fd4a0038a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:32.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.774+0000 7fd4b8b83700 1 --2- 172.21.15.161:0/2506222268 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd4a0036560 0x7fd4a0038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009990 tx=0x7fd4a4006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:32.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:32.778+0000 7fd4a9ffb700 1 -- 172.21.15.161:0/2506222268 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd4b00116f0 con 0x7fd4b40fb1b0 2023-12-09T02:29:32.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:32 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:29:32.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:32 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/trash_purge_schedule"}]: dispatch 2023-12-09T02:29:32.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:32 smithi088 ceph-mon[112028]: [09/Dec/2023:02:29:31] ENGINE Bus STARTING 2023-12-09T02:29:32.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:32 smithi088 ceph-mon[112028]: [09/Dec/2023:02:29:31] ENGINE Serving on https://172.21.15.88:7150 2023-12-09T02:29:32.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:32 smithi088 ceph-mon[112028]: [09/Dec/2023:02:29:31] ENGINE Bus STARTED 2023-12-09T02:29:32.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:32 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:32.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:32 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:32.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:32 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:32.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:32 smithi088 ceph-mon[112028]: mgrmap e16: smithi088.jwlofb(active, since 1.00645s) 2023-12-09T02:29:33.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.054+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/2506222268 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd4b4114fa0 con 0x7fd4b40fb1b0 2023-12-09T02:29:33.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.055+0000 7fd4a9ffb700 1 -- 172.21.15.161:0/2506222268 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd4b0011900 con 0x7fd4b40fb1b0 2023-12-09T02:29:33.057 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:33.057 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:33.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.057+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/2506222268 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd4a0036560 msgr2=0x7fd4a0038a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:33.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.057+0000 7fd4bb5e8700 1 --2- 172.21.15.161:0/2506222268 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd4a0036560 0x7fd4a0038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009990 tx=0x7fd4a4006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.057+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/2506222268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4b40fb1b0 msgr2=0x7fd4b4113070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.057+0000 7fd4bb5e8700 1 --2- 172.21.15.161:0/2506222268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4b40fb1b0 0x7fd4b4113070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000b690 tx=0x7fd4b0009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.057+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/2506222268 shutdown_connections 2023-12-09T02:29:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.057+0000 7fd4bb5e8700 1 --2- 172.21.15.161:0/2506222268 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd4a0036560 0x7fd4a0038a10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.057+0000 7fd4bb5e8700 1 --2- 172.21.15.161:0/2506222268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4b40fb1b0 0x7fd4b4113070 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.057+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/2506222268 >> 172.21.15.161:0/2506222268 conn(0x7fd4b40f6e40 msgr2=0x7fd4b40f7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.058+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/2506222268 shutdown_connections 2023-12-09T02:29:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:33.058+0000 7fd4bb5e8700 1 -- 172.21.15.161:0/2506222268 wait complete. 2023-12-09T02:29:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:33.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:33 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/2506222268' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:33.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:33 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:34.415 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:34.415 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:34.890 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:34.939 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-09T02:29:35.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:35 smithi088 ceph-mon[112028]: mgrmap e17: smithi088.jwlofb(active, since 2s) 2023-12-09T02:29:35.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:35 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:35.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:35 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:36.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.354+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1622665543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0ec0fb780 msgr2=0x7fb0ec0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:36.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.354+0000 7fb0f0ee6700 1 --2- 172.21.15.161:0/1622665543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0ec0fb780 0x7fb0ec0fbb90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00048c0 tx=0x7fb0e0009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:36.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.355+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1622665543 shutdown_connections 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.355+0000 7fb0f0ee6700 1 --2- 172.21.15.161:0/1622665543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0ec0fb780 0x7fb0ec0fbb90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.355+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1622665543 >> 172.21.15.161:0/1622665543 conn(0x7fb0ec0f6e40 msgr2=0x7fb0ec0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.355+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1622665543 shutdown_connections 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.355+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1622665543 wait complete. 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.355+0000 7fb0f0ee6700 1 Processor -- start 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.355+0000 7fb0f0ee6700 1 -- start start 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.355+0000 7fb0f0ee6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0ec0fb780 0x7fb0ec10f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.355+0000 7fb0f0ee6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec065a30 con 0x7fb0ec0fb780 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.356+0000 7fb0ea59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0ec0fb780 0x7fb0ec10f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.356+0000 7fb0ea59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0ec0fb780 0x7fb0ec10f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:57782/0 (socket says 172.21.15.161:57782) 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.356+0000 7fb0ea59c700 1 -- 172.21.15.161:0/1980157957 learned_addr learned my addr 172.21.15.161:0/1980157957 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:36.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.356+0000 7fb0ea59c700 1 -- 172.21.15.161:0/1980157957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e0005040 con 0x7fb0ec0fb780 2023-12-09T02:29:36.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.356+0000 7fb0ea59c700 1 --2- 172.21.15.161:0/1980157957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0ec0fb780 0x7fb0ec10f7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000b690 tx=0x7fb0e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:36.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.356+0000 7fb0daffd700 1 -- 172.21.15.161:0/1980157957 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0e0009650 con 0x7fb0ec0fb780 2023-12-09T02:29:36.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.356+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1980157957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec065c30 con 0x7fb0ec0fb780 2023-12-09T02:29:36.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.356+0000 7fb0daffd700 1 -- 172.21.15.161:0/1980157957 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0e00097b0 con 0x7fb0ec0fb780 2023-12-09T02:29:36.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.356+0000 7fb0daffd700 1 -- 172.21.15.161:0/1980157957 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0e001c5d0 con 0x7fb0ec0fb780 2023-12-09T02:29:36.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.356+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1980157957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ec10ff20 con 0x7fb0ec0fb780 2023-12-09T02:29:36.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.357+0000 7fb0daffd700 1 -- 172.21.15.161:0/1980157957 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fb0e001c840 con 0x7fb0ec0fb780 2023-12-09T02:29:36.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.357+0000 7fb0daffd700 1 --2- 172.21.15.161:0/1980157957 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb0d40367c0 0x7fb0d4038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:36.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.357+0000 7fb0daffd700 1 -- 172.21.15.161:0/1980157957 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fb0e0049c60 con 0x7fb0ec0fb780 2023-12-09T02:29:36.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.357+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1980157957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ec105410 con 0x7fb0ec0fb780 2023-12-09T02:29:36.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.357+0000 7fb0e9d9b700 1 --2- 172.21.15.161:0/1980157957 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb0d40367c0 0x7fb0d4038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:36.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.358+0000 7fb0e9d9b700 1 --2- 172.21.15.161:0/1980157957 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb0d40367c0 0x7fb0d4038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009990 tx=0x7fb0dc006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:36.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.363+0000 7fb0daffd700 1 -- 172.21.15.161:0/1980157957 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb0e0023300 con 0x7fb0ec0fb780 2023-12-09T02:29:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.645+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1980157957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb0ec04bb80 con 0x7fb0ec0fb780 2023-12-09T02:29:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.645+0000 7fb0daffd700 1 -- 172.21.15.161:0/1980157957 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb0e0034090 con 0x7fb0ec0fb780 2023-12-09T02:29:36.647 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:36.648 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.647+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1980157957 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb0d40367c0 msgr2=0x7fb0d4038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.647+0000 7fb0f0ee6700 1 --2- 172.21.15.161:0/1980157957 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb0d40367c0 0x7fb0d4038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009990 tx=0x7fb0dc006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:36.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.647+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1980157957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0ec0fb780 msgr2=0x7fb0ec10f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:36.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.647+0000 7fb0f0ee6700 1 --2- 172.21.15.161:0/1980157957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0ec0fb780 0x7fb0ec10f7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000b690 tx=0x7fb0e0009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:36.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.647+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1980157957 shutdown_connections 2023-12-09T02:29:36.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.647+0000 7fb0f0ee6700 1 --2- 172.21.15.161:0/1980157957 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb0d40367c0 0x7fb0d4038c70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:36.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.647+0000 7fb0f0ee6700 1 --2- 172.21.15.161:0/1980157957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0ec0fb780 0x7fb0ec10f7a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:36.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.647+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1980157957 >> 172.21.15.161:0/1980157957 conn(0x7fb0ec0f6e40 msgr2=0x7fb0ec0f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:36.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.647+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1980157957 shutdown_connections 2023-12-09T02:29:36.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:36.647+0000 7fb0f0ee6700 1 -- 172.21.15.161:0/1980157957 wait complete. 2023-12-09T02:29:36.650 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:37.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:37.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:37.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:29:37.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:37.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:37.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:37.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:37.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:29:37.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:37.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:29:37.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/1980157957' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:37.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:37.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:38.070 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:38.070 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:38.370 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:29:38.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: Updating smithi088:/etc/ceph/ceph.conf 2023-12-09T02:29:38.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: Updating smithi161:/etc/ceph/ceph.conf 2023-12-09T02:29:38.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:29:38.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:29:38.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:29:38.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:29:38.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:29:38.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:29:38.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:38.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:38.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:38.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:29:38.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-09T02:29:38.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:38 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:39.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:39 smithi088 ceph-mon[112028]: Deploying daemon crash.smithi161 on smithi161 2023-12-09T02:29:39.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.814+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/3628134985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a441017d0 msgr2=0x7f5a44101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:39.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.814+0000 7f5a4a7c3700 1 --2- 172.21.15.161:0/3628134985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a441017d0 0x7f5a44101ba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0048c0 tx=0x7f5a2c009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:39.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.814+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/3628134985 shutdown_connections 2023-12-09T02:29:39.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.814+0000 7f5a4a7c3700 1 --2- 172.21.15.161:0/3628134985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a441017d0 0x7f5a44101ba0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:39.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.814+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/3628134985 >> 172.21.15.161:0/3628134985 conn(0x7f5a440f7310 msgr2=0x7f5a440f9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:39.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.814+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/3628134985 shutdown_connections 2023-12-09T02:29:39.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.814+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/3628134985 wait complete. 2023-12-09T02:29:39.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.815+0000 7f5a4a7c3700 1 Processor -- start 2023-12-09T02:29:39.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.815+0000 7f5a4a7c3700 1 -- start start 2023-12-09T02:29:39.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.815+0000 7f5a4a7c3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a441017d0 0x7f5a4410dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:39.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.815+0000 7f5a4a7c3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4410e150 con 0x7f5a441017d0 2023-12-09T02:29:39.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.816+0000 7f5a43fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a441017d0 0x7f5a4410dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:39.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.816+0000 7f5a43fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a441017d0 0x7f5a4410dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:57796/0 (socket says 172.21.15.161:57796) 2023-12-09T02:29:39.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.816+0000 7f5a43fff700 1 -- 172.21.15.161:0/1662936428 learned_addr learned my addr 172.21.15.161:0/1662936428 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:39.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.816+0000 7f5a43fff700 1 -- 172.21.15.161:0/1662936428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c005040 con 0x7f5a441017d0 2023-12-09T02:29:39.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.816+0000 7f5a43fff700 1 --2- 172.21.15.161:0/1662936428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a441017d0 0x7f5a4410dc10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009300 tx=0x7f5a2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:39.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.816+0000 7f5a40ff9700 1 -- 172.21.15.161:0/1662936428 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a2c004e60 con 0x7f5a441017d0 2023-12-09T02:29:39.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.817+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/1662936428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4410e350 con 0x7f5a441017d0 2023-12-09T02:29:39.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.817+0000 7f5a40ff9700 1 -- 172.21.15.161:0/1662936428 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5a2c013420 con 0x7f5a441017d0 2023-12-09T02:29:39.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.817+0000 7f5a40ff9700 1 -- 172.21.15.161:0/1662936428 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a2c01c5b0 con 0x7f5a441017d0 2023-12-09T02:29:39.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.817+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/1662936428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4410e840 con 0x7f5a441017d0 2023-12-09T02:29:39.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.817+0000 7f5a40ff9700 1 -- 172.21.15.161:0/1662936428 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f5a2c01c7f0 con 0x7f5a441017d0 2023-12-09T02:29:39.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.817+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/1662936428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a44100a40 con 0x7f5a441017d0 2023-12-09T02:29:39.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.818+0000 7f5a40ff9700 1 --2- 172.21.15.161:0/1662936428 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5a300367c0 0x7f5a30038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:39.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.818+0000 7f5a40ff9700 1 -- 172.21.15.161:0/1662936428 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5a2c049a20 con 0x7f5a441017d0 2023-12-09T02:29:39.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.818+0000 7f5a437fe700 1 --2- 172.21.15.161:0/1662936428 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5a300367c0 0x7f5a30038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:39.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.818+0000 7f5a437fe700 1 --2- 172.21.15.161:0/1662936428 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5a300367c0 0x7f5a30038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009990 tx=0x7f5a34006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:39.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:39.823+0000 7f5a40ff9700 1 -- 172.21.15.161:0/1662936428 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5a2c023300 con 0x7f5a441017d0 2023-12-09T02:29:40.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.103+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/1662936428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5a4404bb80 con 0x7f5a441017d0 2023-12-09T02:29:40.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.104+0000 7f5a40ff9700 1 -- 172.21.15.161:0/1662936428 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5a2c011b60 con 0x7f5a441017d0 2023-12-09T02:29:40.106 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:40.106 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:40.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.107+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/1662936428 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5a300367c0 msgr2=0x7f5a30038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:40.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.107+0000 7f5a4a7c3700 1 --2- 172.21.15.161:0/1662936428 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5a300367c0 0x7f5a30038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009990 tx=0x7f5a34006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:40.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.107+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/1662936428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a441017d0 msgr2=0x7f5a4410dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:40.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.107+0000 7f5a4a7c3700 1 --2- 172.21.15.161:0/1662936428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a441017d0 0x7f5a4410dc10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009300 tx=0x7f5a2c009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:40.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.107+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/1662936428 shutdown_connections 2023-12-09T02:29:40.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.107+0000 7f5a4a7c3700 1 --2- 172.21.15.161:0/1662936428 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5a300367c0 0x7f5a30038c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:40.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.107+0000 7f5a4a7c3700 1 --2- 172.21.15.161:0/1662936428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a441017d0 0x7f5a4410dc10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:40.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.107+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/1662936428 >> 172.21.15.161:0/1662936428 conn(0x7f5a440f7310 msgr2=0x7f5a440f92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:40.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.107+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/1662936428 shutdown_connections 2023-12-09T02:29:40.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:40.107+0000 7f5a4a7c3700 1 -- 172.21.15.161:0/1662936428 wait complete. 2023-12-09T02:29:40.110 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:40.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:40.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:40.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:40.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:40.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:40 smithi088 ceph-mon[112028]: Deploying daemon node-exporter.smithi161 on smithi161 2023-12-09T02:29:40.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:40 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/1662936428' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:41.506 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:41.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:42.178 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:29:42.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:42 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:43.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.631+0000 7f4a91aa1700 1 -- 172.21.15.161:0/1898575382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a8c1017e0 msgr2=0x7f4a8c101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:43.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.631+0000 7f4a91aa1700 1 --2- 172.21.15.161:0/1898575382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a8c1017e0 0x7f4a8c101bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009c60 tx=0x7f4a84004d10 comp rx=0 tx=0).stop 2023-12-09T02:29:43.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.631+0000 7f4a91aa1700 1 -- 172.21.15.161:0/1898575382 shutdown_connections 2023-12-09T02:29:43.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.631+0000 7f4a91aa1700 1 --2- 172.21.15.161:0/1898575382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a8c1017e0 0x7f4a8c101bb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:43.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.631+0000 7f4a91aa1700 1 -- 172.21.15.161:0/1898575382 >> 172.21.15.161:0/1898575382 conn(0x7f4a8c0715e0 msgr2=0x7f4a8c0719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:43.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.631+0000 7f4a91aa1700 1 -- 172.21.15.161:0/1898575382 shutdown_connections 2023-12-09T02:29:43.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.631+0000 7f4a91aa1700 1 -- 172.21.15.161:0/1898575382 wait complete. 2023-12-09T02:29:43.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.632+0000 7f4a91aa1700 1 Processor -- start 2023-12-09T02:29:43.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.632+0000 7f4a91aa1700 1 -- start start 2023-12-09T02:29:43.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.632+0000 7f4a91aa1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a8c1017e0 0x7f4a8c112d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:43.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.632+0000 7f4a91aa1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c113290 con 0x7f4a8c1017e0 2023-12-09T02:29:43.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.632+0000 7f4a8b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a8c1017e0 0x7f4a8c112d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:43.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.632+0000 7f4a8b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a8c1017e0 0x7f4a8c112d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:57816/0 (socket says 172.21.15.161:57816) 2023-12-09T02:29:43.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.632+0000 7f4a8b7fe700 1 -- 172.21.15.161:0/775069335 learned_addr learned my addr 172.21.15.161:0/775069335 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:43.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.633+0000 7f4a8b7fe700 1 -- 172.21.15.161:0/775069335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a84009940 con 0x7f4a8c1017e0 2023-12-09T02:29:43.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.633+0000 7f4a8b7fe700 1 --2- 172.21.15.161:0/775069335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a8c1017e0 0x7f4a8c112d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009fd0 tx=0x7f4a84004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:43.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.633+0000 7f4a73fff700 1 -- 172.21.15.161:0/775069335 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a8400be40 con 0x7f4a8c1017e0 2023-12-09T02:29:43.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.633+0000 7f4a73fff700 1 -- 172.21.15.161:0/775069335 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a8401d8f0 con 0x7f4a8c1017e0 2023-12-09T02:29:43.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.633+0000 7f4a91aa1700 1 -- 172.21.15.161:0/775069335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8c113490 con 0x7f4a8c1017e0 2023-12-09T02:29:43.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.633+0000 7f4a73fff700 1 -- 172.21.15.161:0/775069335 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a84012800 con 0x7f4a8c1017e0 2023-12-09T02:29:43.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.633+0000 7f4a91aa1700 1 -- 172.21.15.161:0/775069335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8c113900 con 0x7f4a8c1017e0 2023-12-09T02:29:43.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.634+0000 7f4a73fff700 1 -- 172.21.15.161:0/775069335 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f4a84019040 con 0x7f4a8c1017e0 2023-12-09T02:29:43.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.634+0000 7f4a73fff700 1 --2- 172.21.15.161:0/775069335 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f4a740367c0 0x7f4a74038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:43.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.634+0000 7f4a73fff700 1 -- 172.21.15.161:0/775069335 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4a8404a300 con 0x7f4a8c1017e0 2023-12-09T02:29:43.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.634+0000 7f4a8affd700 1 --2- 172.21.15.161:0/775069335 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f4a740367c0 0x7f4a74038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:43.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.634+0000 7f4a91aa1700 1 -- 172.21.15.161:0/775069335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8c05f270 con 0x7f4a8c1017e0 2023-12-09T02:29:43.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.635+0000 7f4a8affd700 1 --2- 172.21.15.161:0/775069335 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f4a740367c0 0x7f4a74038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009990 tx=0x7f4a80006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:43.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.639+0000 7f4a73fff700 1 -- 172.21.15.161:0/775069335 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4a84021020 con 0x7f4a8c1017e0 2023-12-09T02:29:43.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.907+0000 7f4a91aa1700 1 -- 172.21.15.161:0/775069335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4a8c10e360 con 0x7f4a8c1017e0 2023-12-09T02:29:43.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.908+0000 7f4a73fff700 1 -- 172.21.15.161:0/775069335 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4a84017070 con 0x7f4a8c1017e0 2023-12-09T02:29:43.910 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:43.911 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:43.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.910+0000 7f4a91aa1700 1 -- 172.21.15.161:0/775069335 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f4a740367c0 msgr2=0x7f4a74038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:43.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.910+0000 7f4a91aa1700 1 --2- 172.21.15.161:0/775069335 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f4a740367c0 0x7f4a74038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009990 tx=0x7f4a80006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:43.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.910+0000 7f4a91aa1700 1 -- 172.21.15.161:0/775069335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a8c1017e0 msgr2=0x7f4a8c112d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:43.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.910+0000 7f4a91aa1700 1 --2- 172.21.15.161:0/775069335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a8c1017e0 0x7f4a8c112d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009fd0 tx=0x7f4a84004d10 comp rx=0 tx=0).stop 2023-12-09T02:29:43.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.910+0000 7f4a91aa1700 1 -- 172.21.15.161:0/775069335 shutdown_connections 2023-12-09T02:29:43.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.910+0000 7f4a91aa1700 1 --2- 172.21.15.161:0/775069335 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f4a740367c0 0x7f4a74038c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:43.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.910+0000 7f4a91aa1700 1 --2- 172.21.15.161:0/775069335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a8c1017e0 0x7f4a8c112d50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:43.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.910+0000 7f4a91aa1700 1 -- 172.21.15.161:0/775069335 >> 172.21.15.161:0/775069335 conn(0x7f4a8c0715e0 msgr2=0x7f4a8c065610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:43.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.910+0000 7f4a91aa1700 1 -- 172.21.15.161:0/775069335 shutdown_connections 2023-12-09T02:29:43.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:43.910+0000 7f4a91aa1700 1 -- 172.21.15.161:0/775069335 wait complete. 2023-12-09T02:29:43.913 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:29:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-09T02:29:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:29:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:44 smithi088 ceph-mon[112028]: Deploying daemon mgr.smithi161.qmxtmg on smithi161 2023-12-09T02:29:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:44 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/775069335' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:45.370 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:45.371 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:45.655 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:29:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:29:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:46 smithi088 ceph-mon[112028]: Deploying daemon mon.smithi161 on smithi161 2023-12-09T02:29:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:29:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:47.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.076+0000 7fd63a00a700 1 -- 172.21.15.161:0/3615717779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6341028d0 msgr2=0x7fd634102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.076+0000 7fd63a00a700 1 --2- 172.21.15.161:0/3615717779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6341028d0 0x7fd634102ca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd6240048c0 tx=0x7fd624009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.076+0000 7fd63a00a700 1 -- 172.21.15.161:0/3615717779 shutdown_connections 2023-12-09T02:29:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.076+0000 7fd63a00a700 1 --2- 172.21.15.161:0/3615717779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6341028d0 0x7fd634102ca0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.076+0000 7fd63a00a700 1 -- 172.21.15.161:0/3615717779 >> 172.21.15.161:0/3615717779 conn(0x7fd6340f8410 msgr2=0x7fd6340fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.076+0000 7fd63a00a700 1 -- 172.21.15.161:0/3615717779 shutdown_connections 2023-12-09T02:29:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.076+0000 7fd63a00a700 1 -- 172.21.15.161:0/3615717779 wait complete. 2023-12-09T02:29:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.076+0000 7fd63a00a700 1 Processor -- start 2023-12-09T02:29:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.077+0000 7fd63a00a700 1 -- start start 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.077+0000 7fd63a00a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6341028d0 0x7fd634112b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.077+0000 7fd63a00a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6341130a0 con 0x7fd6341028d0 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.077+0000 7fd6337fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6341028d0 0x7fd634112b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.077+0000 7fd6337fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6341028d0 0x7fd634112b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:59810/0 (socket says 172.21.15.161:59810) 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.077+0000 7fd6337fe700 1 -- 172.21.15.161:0/3984910179 learned_addr learned my addr 172.21.15.161:0/3984910179 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.077+0000 7fd6337fe700 1 -- 172.21.15.161:0/3984910179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624005040 con 0x7fd6341028d0 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.078+0000 7fd6337fe700 1 --2- 172.21.15.161:0/3984910179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6341028d0 0x7fd634112b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd624009300 tx=0x7fd624009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.078+0000 7fd61bfff700 1 -- 172.21.15.161:0/3984910179 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd624004e60 con 0x7fd6341028d0 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.078+0000 7fd63a00a700 1 -- 172.21.15.161:0/3984910179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6341132a0 con 0x7fd6341028d0 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.078+0000 7fd61bfff700 1 -- 172.21.15.161:0/3984910179 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd624013420 con 0x7fd6341028d0 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.078+0000 7fd61bfff700 1 -- 172.21.15.161:0/3984910179 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd62401c5b0 con 0x7fd6341028d0 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.078+0000 7fd63a00a700 1 -- 172.21.15.161:0/3984910179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63410ca20 con 0x7fd6341028d0 2023-12-09T02:29:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.079+0000 7fd61bfff700 1 -- 172.21.15.161:0/3984910179 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fd62401c7a0 con 0x7fd6341028d0 2023-12-09T02:29:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.079+0000 7fd61bfff700 1 --2- 172.21.15.161:0/3984910179 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd61c036810 0x7fd61c038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.079+0000 7fd61bfff700 1 -- 172.21.15.161:0/3984910179 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd62404a990 con 0x7fd6341028d0 2023-12-09T02:29:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.079+0000 7fd63a00a700 1 -- 172.21.15.161:0/3984910179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63405f270 con 0x7fd6341028d0 2023-12-09T02:29:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.079+0000 7fd632ffd700 1 --2- 172.21.15.161:0/3984910179 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd61c036810 0x7fd61c038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.079+0000 7fd632ffd700 1 --2- 172.21.15.161:0/3984910179 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd61c036810 0x7fd61c038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd628009990 tx=0x7fd628006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.084+0000 7fd61bfff700 1 -- 172.21.15.161:0/3984910179 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd624011db0 con 0x7fd6341028d0 2023-12-09T02:29:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.367+0000 7fd63a00a700 1 -- 172.21.15.161:0/3984910179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd63410e140 con 0x7fd6341028d0 2023-12-09T02:29:47.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.368+0000 7fd61bfff700 1 -- 172.21.15.161:0/3984910179 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd624023a00 con 0x7fd6341028d0 2023-12-09T02:29:47.370 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:47.370 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:27:47.898978Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-09T02:29:47.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.370+0000 7fd63a00a700 1 -- 172.21.15.161:0/3984910179 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd61c036810 msgr2=0x7fd61c038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:47.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.370+0000 7fd63a00a700 1 --2- 172.21.15.161:0/3984910179 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd61c036810 0x7fd61c038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd628009990 tx=0x7fd628006e40 comp rx=0 tx=0).stop 2023-12-09T02:29:47.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.370+0000 7fd63a00a700 1 -- 172.21.15.161:0/3984910179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6341028d0 msgr2=0x7fd634112b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:47.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.370+0000 7fd63a00a700 1 --2- 172.21.15.161:0/3984910179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6341028d0 0x7fd634112b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd624009300 tx=0x7fd624009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:47.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.370+0000 7fd63a00a700 1 -- 172.21.15.161:0/3984910179 shutdown_connections 2023-12-09T02:29:47.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.370+0000 7fd63a00a700 1 --2- 172.21.15.161:0/3984910179 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd61c036810 0x7fd61c038cc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:47.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.370+0000 7fd63a00a700 1 --2- 172.21.15.161:0/3984910179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6341028d0 0x7fd634112b60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:47.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.370+0000 7fd63a00a700 1 -- 172.21.15.161:0/3984910179 >> 172.21.15.161:0/3984910179 conn(0x7fd6340f8410 msgr2=0x7fd6340fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:47.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.370+0000 7fd63a00a700 1 -- 172.21.15.161:0/3984910179 shutdown_connections 2023-12-09T02:29:47.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:47.370+0000 7fd63a00a700 1 -- 172.21.15.161:0/3984910179 wait complete. 2023-12-09T02:29:47.373 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-12-09T02:29:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:47 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/3984910179' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 systemd[1]: Starting Ceph mon.smithi161 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:29:48.927 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-09T02:29:48.927 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-09T02:29:48.942 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: set uid:gid to 167:167 (ceph:ceph) 2023-12-09T02:29:48.942 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable), process ceph-mon, pid 7 2023-12-09T02:29:48.942 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: pidfile_write: ignore empty --pid-file 2023-12-09T02:29:48.942 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: load: jerasure load: lrc 2023-12-09T02:29:48.942 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: RocksDB version: 6.15.5 2023-12-09T02:29:48.942 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Compile date Dec 8 2023 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: DB SUMMARY 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: DB Session ID: XT5WEF4GIFUWMPWGRLC1 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: CURRENT file: CURRENT 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: IDENTITY file: IDENTITY 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi161/store.db dir, Total Num: 0, files: 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi161/store.db: 000004.log size: 511 ; 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.error_if_exists: 0 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.create_if_missing: 0 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.paranoid_checks: 1 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.env: 0x56178e7e7a80 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.fs: Posix File System 2023-12-09T02:29:48.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.info_log: 0x56178f7d2780 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_file_opening_threads: 16 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.statistics: (nil) 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.use_fsync: 0 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_log_file_size: 0 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.keep_log_file_num: 1000 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.recycle_log_file_num: 0 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.allow_fallocate: 1 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.allow_mmap_reads: 0 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.allow_mmap_writes: 0 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.use_direct_reads: 0 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-09T02:29:48.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.create_missing_column_families: 0 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.db_log_dir: 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi161/store.db 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.advise_random_on_open: 1 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.db_write_buffer_size: 0 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.write_buffer_manager: 0x5617905429f0 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-09T02:29:48.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-09T02:29:48.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-09T02:29:48.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-09T02:29:48.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.rate_limiter: (nil) 2023-12-09T02:29:48.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-09T02:29:48.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.wal_recovery_mode: 2 2023-12-09T02:29:48.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.enable_thread_tracking: 0 2023-12-09T02:29:48.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.enable_pipelined_write: 0 2023-12-09T02:29:48.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.unordered_write: 0 2023-12-09T02:29:48.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-09T02:29:48.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-09T02:29:48.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.row_cache: None 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.wal_filter: None 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.allow_ingest_behind: 0 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.preserve_deletes: 0 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.two_write_queues: 0 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.manual_wal_flush: 0 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.atomic_flush: 0 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.log_readahead_size: 0 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-09T02:29:48.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.best_efforts_recovery: 0 2023-12-09T02:29:48.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-09T02:29:48.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-09T02:29:48.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.allow_data_in_errors: 0 2023-12-09T02:29:48.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.db_host_id: __hostname__ 2023-12-09T02:29:48.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_background_jobs: 2 2023-12-09T02:29:48.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_background_compactions: -1 2023-12-09T02:29:48.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_subcompactions: 1 2023-12-09T02:29:48.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-09T02:29:48.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-09T02:29:48.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-09T02:29:48.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_total_wal_size: 0 2023-12-09T02:29:48.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-09T02:29:48.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-09T02:29:48.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-09T02:29:48.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_open_files: -1 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.bytes_per_sync: 0 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_readahead_size: 0 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_background_flushes: -1 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Compression algorithms supported: 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: kZSTD supported: 0 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: kXpressCompression supported: 0 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: kLZ4HCCompression supported: 1 2023-12-09T02:29:48.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: kZlibCompression supported: 1 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: kSnappyCompression supported: 1 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: kLZ4Compression supported: 1 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: kBZip2Compression supported: 0 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi161/store.db/MANIFEST-000003 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.merge_operator: 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_filter: None 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_filter_factory: None 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.sst_partitioner_factory: None 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 bash[121129]: d6b9d92654508f7e761efc7eaeb63d8118e3b80796e4af3639e56ee83b1d4777 2023-12-09T02:29:48.952 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56178f822f90) 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: cache_index_and_filter_blocks: 1 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: pin_top_level_index_and_filter: 1 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_type: 0 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: data_block_index_type: 0 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_shortening: 1 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: hash_index_allow_collision: 1 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: checksum: 1 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: no_block_cache: 0 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache: 0x56178f855090 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_name: BinnedLRUCache 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_options: 2023-12-09T02:29:48.953 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: capacity : 536870912 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: num_shard_bits : 4 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: strict_capacity_limit : 0 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: high_pri_pool_ratio: 0.000 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_compressed: (nil) 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: persistent_cache: (nil) 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_size: 4096 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_size_deviation: 10 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_restart_interval: 16 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_block_restart_interval: 1 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: metadata_block_size: 4096 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: partition_filters: 0 2023-12-09T02:29:48.954 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: use_delta_encoding: 1 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: whole_key_filtering: 1 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: verify_compression: 0 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: read_amp_bytes_per_bit: 0 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: format_version: 4 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: enable_index_compression: 1 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_align: 0 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.write_buffer_size: 33554432 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_write_buffer_number: 2 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compression: NoCompression 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.bottommost_compression: Disabled 2023-12-09T02:29:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.prefix_extractor: nullptr 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.num_levels: 7 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-09T02:29:48.956 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-09T02:29:48.957 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compression_opts.level: 32767 2023-12-09T02:29:48.957 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compression_opts.strategy: 0 2023-12-09T02:29:48.957 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-09T02:29:48.957 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-09T02:29:48.957 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-09T02:29:48.957 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compression_opts.enabled: false 2023-12-09T02:29:48.957 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-09T02:29:48.957 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-09T02:29:48.957 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-09T02:29:48.957 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.target_file_size_base: 67108864 2023-12-09T02:29:48.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-09T02:29:48.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-09T02:29:48.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-09T02:29:48.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-09T02:29:48.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-09T02:29:48.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-09T02:29:48.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-09T02:29:48.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-09T02:29:48.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-09T02:29:48.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-09T02:29:48.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.arena_block_size: 4194304 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.disable_auto_compactions: 0 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-09T02:29:48.959 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-09T02:29:48.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-09T02:29:48.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-09T02:29:48.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-09T02:29:48.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-09T02:29:48.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.table_properties_collectors: 2023-12-09T02:29:48.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.inplace_update_support: 0 2023-12-09T02:29:48.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-09T02:29:48.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-09T02:29:48.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-09T02:29:48.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-09T02:29:48.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.bloom_locality: 0 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.max_successive_merges: 0 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.paranoid_file_checks: 0 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.force_consistency_checks: 1 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.report_bg_io_stats: 0 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.ttl: 2592000 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.enable_blob_files: false 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.min_blob_size: 0 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.blob_file_size: 268435456 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-09T02:29:48.961 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi161/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702088988802116, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702088988802496, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702088988, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "07e67916-ee8c-4724-882b-a6ae6d2ef1af", "db_session_id": "XT5WEF4GIFUWMPWGRLC1"}} 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702088988802920, "job": 1, "event": "recovery_finished"} 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi161/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x56178f7e9180 2023-12-09T02:29:48.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: DB pointer 0x56178f8be000 2023-12-09T02:29:48.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-09T02:29:48.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-09T02:29:48.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** DB Stats ** 2023-12-09T02:29:48.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-09T02:29:48.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-09T02:29:48.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-09T02:29:48.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-09T02:29:48.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-09T02:29:48.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-09T02:29:48.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-09T02:29:48.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 2023-12-09T02:29:48.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:29:48.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-09T02:29:48.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161 does not exist in monmap, will attempt to join an existing cluster 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: using public_addr v2:172.21.15.161:0/0 -> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: starting mon.smithi161 rank -1 at public addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] at bind addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi161 fsid 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(???) e0 preinit fsid 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:29:48.967 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 systemd[1]: Started Ceph mon.smithi161 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).mds e1 new map 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).mds e1 print_map 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: e1 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: legacy client fscid: -1 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: No filesystems configured 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-09T02:29:48.968 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-09T02:29:48.969 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-09T02:29:48.969 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-09T02:29:48.969 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-09T02:29:48.969 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:48.969 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.969 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/2789716996' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.969 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:48.969 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:48.969 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/1376130096' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.969 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/666405764' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Deploying daemon prometheus.smithi088 on smithi088 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/137728565' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.970 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/3459507772' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/3847463241' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14162 172.21.15.88:0/2154360130' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mgrmap e14: smithi088.jwlofb(active, since 42s) 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/2944220383' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.971 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/1169075680' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.972 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Active manager daemon smithi088.jwlofb restarted 2023-12-09T02:29:48.972 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Activating manager daemon smithi088.jwlofb 2023-12-09T02:29:48.972 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: osdmap e5: 0 total, 0 up, 0 in 2023-12-09T02:29:48.972 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mgrmap e15: smithi088.jwlofb(active, starting, since 0.00454196s) 2023-12-09T02:29:48.972 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:29:48.972 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi088.jwlofb", "id": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:29:48.972 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-09T02:29:48.972 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-09T02:29:48.972 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-09T02:29:48.972 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Manager daemon smithi088.jwlofb is now available 2023-12-09T02:29:48.972 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/trash_purge_schedule"}]: dispatch 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: [09/Dec/2023:02:29:31] ENGINE Bus STARTING 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: [09/Dec/2023:02:29:31] ENGINE Serving on https://172.21.15.88:7150 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: [09/Dec/2023:02:29:31] ENGINE Bus STARTED 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mgrmap e16: smithi088.jwlofb(active, since 1.00645s) 2023-12-09T02:29:48.973 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/2506222268' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mgrmap e17: smithi088.jwlofb(active, since 2s) 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:29:48.974 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/1980157957' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Updating smithi088:/etc/ceph/ceph.conf 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Updating smithi161:/etc/ceph/ceph.conf 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-09T02:29:48.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Deploying daemon crash.smithi161 on smithi161 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Deploying daemon node-exporter.smithi161 on smithi161 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/1662936428' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-09T02:29:48.976 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Deploying daemon mgr.smithi161.qmxtmg on smithi161 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/775069335' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: Deploying daemon mon.smithi161 on smithi161 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/3984910179' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-09T02:29:48.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:48 smithi161 ceph-mon[121170]: mon.smithi161@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-09T02:29:49.194 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi161/config 2023-12-09T02:29:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.906+0000 7f1fd00cc700 1 -- 172.21.15.161:0/412842443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb4003580 msgr2=0x7f1fb4005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.906+0000 7f1fd00cc700 1 --2- 172.21.15.161:0/412842443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb4003580 0x7f1fb4005a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8073770 tx=0x7f1fc400b040 comp rx=0 tx=0).stop 2023-12-09T02:29:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.906+0000 7f1fd00cc700 1 -- 172.21.15.161:0/412842443 shutdown_connections 2023-12-09T02:29:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.906+0000 7f1fd00cc700 1 --2- 172.21.15.161:0/412842443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb4003580 0x7f1fb4005a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.906+0000 7f1fd00cc700 1 -- 172.21.15.161:0/412842443 >> 172.21.15.161:0/412842443 conn(0x7f1fc8071760 msgr2=0x7f1fc8071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.906+0000 7f1fd00cc700 1 -- 172.21.15.161:0/412842443 shutdown_connections 2023-12-09T02:29:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.906+0000 7f1fd00cc700 1 -- 172.21.15.161:0/412842443 wait complete. 2023-12-09T02:29:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fd00cc700 1 Processor -- start 2023-12-09T02:29:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fd00cc700 1 -- start start 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fd00cc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb4003580 0x7f1fc8112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fd00cc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc8113160 0x7f1fc810cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fd00cc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8113770 con 0x7f1fb4003580 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fd00cc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc81138e0 con 0x7f1fc8113160 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fcd667700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc8113160 0x7f1fc810cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fcde68700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb4003580 0x7f1fc8112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fcde68700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb4003580 0x7f1fc8112c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.161:59902/0 (socket says 172.21.15.161:59902) 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fcd667700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc8113160 0x7f1fc810cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48784/0 (socket says 172.21.15.161:48784) 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fcde68700 1 -- 172.21.15.161:0/3538170439 learned_addr learned my addr 172.21.15.161:0/3538170439 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fcd667700 1 -- 172.21.15.161:0/3538170439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc8113160 msgr2=0x7f1fc810cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fcd667700 1 -- 172.21.15.161:0/3538170439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc8113160 msgr2=0x7f1fc810cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fcd667700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc8113160 0x7f1fc810cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.907+0000 7f1fcd667700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc8113160 0x7f1fc810cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-09T02:29:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.908+0000 7f1fcde68700 1 -- 172.21.15.161:0/3538170439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc8113160 msgr2=0x7f1fc810cb00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-09T02:29:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.908+0000 7f1fcde68700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc8113160 0x7f1fc810cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.908+0000 7f1fcde68700 1 -- 172.21.15.161:0/3538170439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4005040 con 0x7f1fb4003580 2023-12-09T02:29:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.908+0000 7f1fcde68700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb4003580 0x7f1fc8112c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4004190 tx=0x7f1fc400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:53.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.909+0000 7f1fbe7fc700 1 -- 172.21.15.161:0/3538170439 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc4009460 con 0x7f1fb4003580 2023-12-09T02:29:53.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.909+0000 7f1fd00cc700 1 -- 172.21.15.161:0/3538170439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc810d100 con 0x7f1fb4003580 2023-12-09T02:29:53.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.909+0000 7f1fbe7fc700 1 -- 172.21.15.161:0/3538170439 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1fc402b470 con 0x7f1fb4003580 2023-12-09T02:29:53.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.909+0000 7f1fbe7fc700 1 -- 172.21.15.161:0/3538170439 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc40216a0 con 0x7f1fb4003580 2023-12-09T02:29:53.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.909+0000 7f1fd00cc700 1 -- 172.21.15.161:0/3538170439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc810d6c0 con 0x7f1fb4003580 2023-12-09T02:29:53.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.910+0000 7f1fbe7fc700 1 -- 172.21.15.161:0/3538170439 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f1fc4028070 con 0x7f1fb4003580 2023-12-09T02:29:53.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.910+0000 7f1fd00cc700 1 -- 172.21.15.161:0/3538170439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc805f270 con 0x7f1fb4003580 2023-12-09T02:29:53.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.910+0000 7f1fbe7fc700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1fac036950 0x7f1fac038e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:53.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.910+0000 7f1fbe7fc700 1 -- 172.21.15.161:0/3538170439 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1fc404bc20 con 0x7f1fb4003580 2023-12-09T02:29:53.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.911+0000 7f1fcd667700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1fac036950 0x7f1fac038e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:53.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.911+0000 7f1fcd667700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1fac036950 0x7f1fac038e00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8006f30 tx=0x7f1fb8008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.915+0000 7f1fbe7fc700 1 -- 172.21.15.161:0/3538170439 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1fc402a9c0 con 0x7f1fb4003580 2023-12-09T02:29:53.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:53.953+0000 7f1fbe7fc700 1 -- 172.21.15.161:0/3538170439 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f1fc4022440 con 0x7f1fb4003580 2023-12-09T02:29:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.194+0000 7f1fd00cc700 1 -- 172.21.15.161:0/3538170439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1fc810e200 con 0x7f1fb4003580 2023-12-09T02:29:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.195+0000 7f1fbe7fc700 1 -- 172.21.15.161:0/3538170439 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f1fc401b090 con 0x7f1fb4003580 2023-12-09T02:29:54.197 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-09T02:29:54.197 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":2,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","modified":"2023-12-09T02:29:48.839875Z","created":"2023-12-09T02:27:47.898978Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi161","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-09T02:29:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.197+0000 7f1fd00cc700 1 -- 172.21.15.161:0/3538170439 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1fac036950 msgr2=0x7f1fac038e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.197+0000 7f1fd00cc700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1fac036950 0x7f1fac038e00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8006f30 tx=0x7f1fb8008040 comp rx=0 tx=0).stop 2023-12-09T02:29:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.197+0000 7f1fd00cc700 1 -- 172.21.15.161:0/3538170439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb4003580 msgr2=0x7f1fc8112c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.197+0000 7f1fd00cc700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb4003580 0x7f1fc8112c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4004190 tx=0x7f1fc400b040 comp rx=0 tx=0).stop 2023-12-09T02:29:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.197+0000 7f1fd00cc700 1 -- 172.21.15.161:0/3538170439 shutdown_connections 2023-12-09T02:29:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.197+0000 7f1fd00cc700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1fac036950 0x7f1fac038e00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.197+0000 7f1fd00cc700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb4003580 0x7f1fc8112c20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.197+0000 7f1fd00cc700 1 --2- 172.21.15.161:0/3538170439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc8113160 0x7f1fc810cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.197+0000 7f1fd00cc700 1 -- 172.21.15.161:0/3538170439 >> 172.21.15.161:0/3538170439 conn(0x7f1fc8071760 msgr2=0x7f1fc8105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.197+0000 7f1fd00cc700 1 -- 172.21.15.161:0/3538170439 shutdown_connections 2023-12-09T02:29:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:29:54.197+0000 7f1fd00cc700 1 -- 172.21.15.161:0/3538170439 wait complete. 2023-12-09T02:29:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 2 2023-12-09T02:29:54.222 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:29:54.222 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: mon.smithi088 calling monitor election 2023-12-09T02:29:54.222 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.222 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.222 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.222 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: mon.smithi161 calling monitor election 2023-12-09T02:29:54.222 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:54.222 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.222 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/880351065' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/crt"}]: dispatch 2023-12-09T02:29:54.222 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: mon.smithi088 is new leader, mons smithi088,smithi161 in quorum (ranks 0,1) 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: monmap e2: 2 mons at {smithi088=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: fsmap 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: osdmap e5: 0 total, 0 up, 0 in 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: mgrmap e17: smithi088.jwlofb(active, since 22s) 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: Standby manager daemon smithi161.qmxtmg started 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/880351065' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: overall HEALTH_OK 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/880351065' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/key"}]: dispatch 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/880351065' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:54.223 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:29:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: mon.smithi088 calling monitor election 2023-12-09T02:29:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: mon.smithi161 calling monitor election 2023-12-09T02:29:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/880351065' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/crt"}]: dispatch 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: mon.smithi088 is new leader, mons smithi088,smithi161 in quorum (ranks 0,1) 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: monmap e2: 2 mons at {smithi088=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: fsmap 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: osdmap e5: 0 total, 0 up, 0 in 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: mgrmap e17: smithi088.jwlofb(active, since 22s) 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: Standby manager daemon smithi161.qmxtmg started 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/880351065' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: overall HEALTH_OK 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/880351065' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/key"}]: dispatch 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/880351065' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:54.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:54.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:54.674 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-09T02:29:54.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph config generate-minimal-conf 2023-12-09T02:29:54.943 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:29:54.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:54 smithi088 ceph-mon[112028]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:54.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:54 smithi088 ceph-mon[112028]: mgrmap e18: smithi088.jwlofb(active, since 22s), standbys: smithi161.qmxtmg 2023-12-09T02:29:54.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:54 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi161.qmxtmg", "id": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:29:54.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:54 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:29:54.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:54 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/3538170439' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:54.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:54 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:55.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:54 smithi161 ceph-mon[121170]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:55.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:54 smithi161 ceph-mon[121170]: mgrmap e18: smithi088.jwlofb(active, since 22s), standbys: smithi161.qmxtmg 2023-12-09T02:29:55.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:54 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi161.qmxtmg", "id": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:29:55.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:54 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:29:55.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:54 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/3538170439' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-09T02:29:55.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:54 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:29:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.927+0000 7f091b2d7700 1 -- 172.21.15.88:0/2291184370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09141017e0 msgr2=0x7f0914101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.927+0000 7f091b2d7700 1 --2- 172.21.15.88:0/2291184370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09141017e0 0x7f0914101bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f09100048c0 tx=0x7f0910009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.927+0000 7f091b2d7700 1 -- 172.21.15.88:0/2291184370 shutdown_connections 2023-12-09T02:29:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.927+0000 7f091b2d7700 1 --2- 172.21.15.88:0/2291184370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09141017e0 0x7f0914101bb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.927+0000 7f091b2d7700 1 -- 172.21.15.88:0/2291184370 >> 172.21.15.88:0/2291184370 conn(0x7f09140715e0 msgr2=0x7f09140719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.927+0000 7f091b2d7700 1 -- 172.21.15.88:0/2291184370 shutdown_connections 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.927+0000 7f091b2d7700 1 -- 172.21.15.88:0/2291184370 wait complete. 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.927+0000 7f091b2d7700 1 Processor -- start 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.927+0000 7f091b2d7700 1 -- start start 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f091b2d7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09141017e0 0x7f0914112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f091b2d7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09141131b0 0x7f091410cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f091b2d7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914113770 con 0x7f09141131b0 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f091b2d7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091410d070 con 0x7f09141017e0 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0918872700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09141131b0 0x7f091410cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0918872700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09141131b0 0x7f091410cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51376/0 (socket says 172.21.15.88:51376) 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0918872700 1 -- 172.21.15.88:0/3271905468 learned_addr learned my addr 172.21.15.88:0/3271905468 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0919073700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09141017e0 0x7f0914112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0919073700 1 -- 172.21.15.88:0/3271905468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09141017e0 msgr2=0x7f0914112c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0919073700 1 -- 172.21.15.88:0/3271905468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09141017e0 msgr2=0x7f0914112c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-09T02:29:55.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0919073700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09141017e0 0x7f0914112c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-09T02:29:55.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0918872700 1 -- 172.21.15.88:0/3271905468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09141017e0 msgr2=0x7f0914112c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:55.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0919073700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09141017e0 0x7f0914112c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-09T02:29:55.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0918872700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09141017e0 0x7f0914112c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:55.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0918872700 1 -- 172.21.15.88:0/3271905468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910005040 con 0x7f09141131b0 2023-12-09T02:29:55.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.928+0000 7f0918872700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09141131b0 0x7f091410cb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f090400b790 tx=0x7f0904009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:55.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.929+0000 7f0909ffb700 1 -- 172.21.15.88:0/3271905468 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0904010870 con 0x7f09141131b0 2023-12-09T02:29:55.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.929+0000 7f0909ffb700 1 -- 172.21.15.88:0/3271905468 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0904010e80 con 0x7f09141131b0 2023-12-09T02:29:55.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.929+0000 7f091b2d7700 1 -- 172.21.15.88:0/3271905468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091410d350 con 0x7f09141131b0 2023-12-09T02:29:55.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.929+0000 7f0909ffb700 1 -- 172.21.15.88:0/3271905468 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f090400d3b0 con 0x7f09141131b0 2023-12-09T02:29:55.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.929+0000 7f091b2d7700 1 -- 172.21.15.88:0/3271905468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091410d910 con 0x7f09141131b0 2023-12-09T02:29:55.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.930+0000 7f0909ffb700 1 -- 172.21.15.88:0/3271905468 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f090400d5e0 con 0x7f09141131b0 2023-12-09T02:29:55.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.930+0000 7f0909ffb700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0900069040 0x7f090006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:29:55.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.930+0000 7f0909ffb700 1 -- 172.21.15.88:0/3271905468 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0904086280 con 0x7f09141131b0 2023-12-09T02:29:55.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.930+0000 7f091b2d7700 1 -- 172.21.15.88:0/3271905468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091405f270 con 0x7f09141131b0 2023-12-09T02:29:55.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.931+0000 7f0919073700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0900069040 0x7f090006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:29:55.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.931+0000 7f0919073700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0900069040 0x7f090006b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f091000b3b0 tx=0x7f0910009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:29:55.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:55.935+0000 7f0909ffb700 1 -- 172.21.15.88:0/3271905468 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0904057260 con 0x7f09141131b0 2023-12-09T02:29:56.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.179+0000 7f091b2d7700 1 -- 172.21.15.88:0/3271905468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f091404bbb0 con 0x7f09141131b0 2023-12-09T02:29:56.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.180+0000 7f0909ffb700 1 -- 172.21.15.88:0/3271905468 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f0904014020 con 0x7f09141131b0 2023-12-09T02:29:56.181 INFO:teuthology.orchestra.run.smithi088.stdout:# minimal ceph.conf for 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:29:56.182 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2023-12-09T02:29:56.182 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:29:56.182 INFO:teuthology.orchestra.run.smithi088.stdout: mon_host = [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] 2023-12-09T02:29:56.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.182+0000 7f091b2d7700 1 -- 172.21.15.88:0/3271905468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0900069040 msgr2=0x7f090006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:56.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.182+0000 7f091b2d7700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0900069040 0x7f090006b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f091000b3b0 tx=0x7f0910009e30 comp rx=0 tx=0).stop 2023-12-09T02:29:56.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.182+0000 7f091b2d7700 1 -- 172.21.15.88:0/3271905468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09141131b0 msgr2=0x7f091410cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:29:56.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.182+0000 7f091b2d7700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09141131b0 0x7f091410cb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f090400b790 tx=0x7f0904009250 comp rx=0 tx=0).stop 2023-12-09T02:29:56.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.182+0000 7f091b2d7700 1 -- 172.21.15.88:0/3271905468 shutdown_connections 2023-12-09T02:29:56.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.182+0000 7f091b2d7700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09141017e0 0x7f0914112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:56.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.182+0000 7f091b2d7700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0900069040 0x7f090006b4f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:56.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.182+0000 7f091b2d7700 1 --2- 172.21.15.88:0/3271905468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09141131b0 0x7f091410cb30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:29:56.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.182+0000 7f091b2d7700 1 -- 172.21.15.88:0/3271905468 >> 172.21.15.88:0/3271905468 conn(0x7f09140715e0 msgr2=0x7f0914064d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:29:56.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.182+0000 7f091b2d7700 1 -- 172.21.15.88:0/3271905468 shutdown_connections 2023-12-09T02:29:56.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:29:56.182+0000 7f091b2d7700 1 -- 172.21.15.88:0/3271905468 wait complete. 2023-12-09T02:29:56.562 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-09T02:29:56.563 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:29:56.563 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.conf 2023-12-09T02:29:56.591 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:29:56.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:29:56.658 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:29:56.658 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.conf 2023-12-09T02:29:56.688 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:29:56.688 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:29:56.756 INFO:tasks.cephadm:Deploying OSDs... 2023-12-09T02:29:56.757 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:29:56.757 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2023-12-09T02:29:56.775 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-09T02:29:56.775 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2023-12-09T02:29:56.834 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-09T02:29:56.834 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-09T02:29:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 396583 Links: 1 2023-12-09T02:29:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-09T02:29:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-12-09T02:29:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-12-09 02:29:23.518702460 +0000 2023-12-09T02:29:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-12-09 02:17:53.733806305 +0000 2023-12-09T02:29:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-12-09 02:17:53.733806305 +0000 2023-12-09T02:29:56.835 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-12-09T02:29:56.835 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-09T02:29:56.905 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-12-09T02:29:56.905 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-12-09T02:29:56.905 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000205983 s, 2.5 MB/s 2023-12-09T02:29:56.906 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-09T02:29:56.966 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2023-12-09T02:29:57.024 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-09T02:29:57.024 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-09T02:29:57.024 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 390786 Links: 1 2023-12-09T02:29:57.024 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-09T02:29:57.024 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-12-09T02:29:57.024 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-12-09 02:29:23.518702460 +0000 2023-12-09T02:29:57.024 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-12-09 02:17:54.227796293 +0000 2023-12-09T02:29:57.024 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-12-09 02:17:54.227796293 +0000 2023-12-09T02:29:57.024 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-12-09T02:29:57.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-09T02:29:57.074 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:57.074 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.074 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.075 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:57.075 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:29:57.075 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: Updating smithi088:/etc/ceph/ceph.conf 2023-12-09T02:29:57.075 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: Updating smithi161:/etc/ceph/ceph.conf 2023-12-09T02:29:57.075 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:29:57.075 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:29:57.075 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3271905468' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:57.075 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.075 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.075 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.076 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.076 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.076 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:29:57.076 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:29:57.076 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:57.076 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.090 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-12-09T02:29:57.091 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-12-09T02:29:57.091 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000197214 s, 2.6 MB/s 2023-12-09T02:29:57.092 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-09T02:29:57.151 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2023-12-09T02:29:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: Updating smithi088:/etc/ceph/ceph.conf 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: Updating smithi161:/etc/ceph/ceph.conf 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3271905468' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:29:57.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:57.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:57.209 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-09T02:29:57.209 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-09T02:29:57.209 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 390846 Links: 1 2023-12-09T02:29:57.209 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-09T02:29:57.209 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-12-09T02:29:57.209 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-12-09 02:29:23.518702460 +0000 2023-12-09T02:29:57.209 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-12-09 02:17:54.733786037 +0000 2023-12-09T02:29:57.209 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-12-09 02:17:54.733786037 +0000 2023-12-09T02:29:57.210 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-12-09T02:29:57.210 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-09T02:29:57.275 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-12-09T02:29:57.275 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-12-09T02:29:57.275 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000214021 s, 2.4 MB/s 2023-12-09T02:29:57.276 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-09T02:29:57.335 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2023-12-09T02:29:57.393 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-09T02:29:57.393 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-09T02:29:57.393 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 390988 Links: 1 2023-12-09T02:29:57.393 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-09T02:29:57.393 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-12-09T02:29:57.393 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-12-09 02:29:23.518702460 +0000 2023-12-09T02:29:57.393 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-12-09 02:17:55.250775558 +0000 2023-12-09T02:29:57.393 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-12-09 02:17:55.250775558 +0000 2023-12-09T02:29:57.393 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-12-09T02:29:57.394 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-09T02:29:57.458 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-12-09T02:29:57.459 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-12-09T02:29:57.459 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000209595 s, 2.4 MB/s 2023-12-09T02:29:57.460 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-09T02:29:57.519 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:29:57.519 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2023-12-09T02:29:57.541 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-09T02:29:57.542 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2023-12-09T02:29:57.602 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-09T02:29:57.603 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-09T02:29:57.603 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 393654 Links: 1 2023-12-09T02:29:57.603 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-09T02:29:57.603 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-12-09T02:29:57.603 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-12-09 02:29:48.335571348 +0000 2023-12-09T02:29:57.603 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-12-09 02:17:56.034922079 +0000 2023-12-09T02:29:57.603 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-12-09 02:17:56.034922079 +0000 2023-12-09T02:29:57.603 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-12-09T02:29:57.603 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-09T02:29:57.672 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-12-09T02:29:57.672 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-12-09T02:29:57.672 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000239946 s, 2.1 MB/s 2023-12-09T02:29:57.673 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-09T02:29:57.736 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2023-12-09T02:29:57.796 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-09T02:29:57.796 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-09T02:29:57.797 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 396196 Links: 1 2023-12-09T02:29:57.797 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-09T02:29:57.797 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-12-09T02:29:57.797 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-12-09 02:29:48.335571348 +0000 2023-12-09T02:29:57.797 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-12-09 02:17:56.550911615 +0000 2023-12-09T02:29:57.797 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-12-09 02:17:56.550911615 +0000 2023-12-09T02:29:57.797 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-12-09T02:29:57.797 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-09T02:29:57.865 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-12-09T02:29:57.865 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-12-09T02:29:57.865 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000226616 s, 2.3 MB/s 2023-12-09T02:29:57.866 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-09T02:29:57.927 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2023-12-09T02:29:57.986 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-09T02:29:57.986 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-09T02:29:57.986 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 390943 Links: 1 2023-12-09T02:29:57.987 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-09T02:29:57.987 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-12-09T02:29:57.987 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-12-09 02:29:48.335571348 +0000 2023-12-09T02:29:57.987 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-12-09 02:17:57.075900969 +0000 2023-12-09T02:29:57.987 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-12-09 02:17:57.075900969 +0000 2023-12-09T02:29:57.987 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-12-09T02:29:57.987 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-09T02:29:58.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:57 smithi161 ceph-mon[121170]: Reconfiguring mon.smithi088 (unknown last config time)... 2023-12-09T02:29:58.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:57 smithi161 ceph-mon[121170]: Reconfiguring daemon mon.smithi088 on smithi088 2023-12-09T02:29:58.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:57 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:58.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:57 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:58.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:57 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.jwlofb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:29:58.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:57 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:29:58.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:57 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:58.053 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-12-09T02:29:58.053 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-12-09T02:29:58.053 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000213696 s, 2.4 MB/s 2023-12-09T02:29:58.054 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-09T02:29:58.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:57 smithi088 ceph-mon[112028]: Reconfiguring mon.smithi088 (unknown last config time)... 2023-12-09T02:29:58.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:57 smithi088 ceph-mon[112028]: Reconfiguring daemon mon.smithi088 on smithi088 2023-12-09T02:29:58.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:57 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:58.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:57 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:58.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:57 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.jwlofb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:29:58.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:57 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:29:58.106 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:57 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:58.114 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2023-12-09T02:29:58.173 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-09T02:29:58.173 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-09T02:29:58.173 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 391715 Links: 1 2023-12-09T02:29:58.174 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-09T02:29:58.174 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-12-09T02:29:58.174 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-12-09 02:29:48.335571348 +0000 2023-12-09T02:29:58.174 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-12-09 02:17:57.596890400 +0000 2023-12-09T02:29:58.174 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-12-09 02:17:57.596890400 +0000 2023-12-09T02:29:58.174 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-12-09T02:29:58.174 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-09T02:29:58.240 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-12-09T02:29:58.240 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-12-09T02:29:58.240 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.00022863 s, 2.2 MB/s 2023-12-09T02:29:58.241 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-09T02:29:58.301 INFO:tasks.cephadm:Deploying osd.0 on smithi088 with /dev/vg_nvme/lv_4... 2023-12-09T02:29:58.301 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-09T02:29:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:29:58.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:58 smithi088 ceph-mon[112028]: Reconfiguring mgr.smithi088.jwlofb (unknown last config time)... 2023-12-09T02:29:58.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:58 smithi088 ceph-mon[112028]: Reconfiguring daemon mgr.smithi088.jwlofb on smithi088 2023-12-09T02:29:58.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:58 smithi088 ceph-mon[112028]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:58.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:58.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:58.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:29:58.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:29:59.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:58 smithi161 ceph-mon[121170]: Reconfiguring mgr.smithi088.jwlofb (unknown last config time)... 2023-12-09T02:29:59.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:58 smithi161 ceph-mon[121170]: Reconfiguring daemon mgr.smithi088.jwlofb on smithi088 2023-12-09T02:29:59.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:58 smithi161 ceph-mon[121170]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:29:59.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:59.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:29:59.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:29:59.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:00.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:59 smithi088 ceph-mon[112028]: Reconfiguring crash.smithi088 (monmap changed)... 2023-12-09T02:30:00.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:59 smithi088 ceph-mon[112028]: Reconfiguring daemon crash.smithi088 on smithi088 2023-12-09T02:30:00.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:59 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:00.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:29:59 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:00.113 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-09T02:30:00.113 INFO:teuthology.orchestra.run.smithi088.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-09T02:30:00.113 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10+0 records in 2023-12-09T02:30:00.114 INFO:teuthology.orchestra.run.smithi088.stderr:10+0 records out 2023-12-09T02:30:00.114 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0129624 s, 809 MB/s 2023-12-09T02:30:00.114 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping successful for: 2023-12-09T02:30:00.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:59 smithi161 ceph-mon[121170]: Reconfiguring crash.smithi088 (monmap changed)... 2023-12-09T02:30:00.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:59 smithi161 ceph-mon[121170]: Reconfiguring daemon crash.smithi088 on smithi088 2023-12-09T02:30:00.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:59 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:00.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:29:59 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:00.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi088:vg_nvme/lv_4 2023-12-09T02:30:00.965 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:00 smithi088 ceph-mon[112028]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:00.965 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:00 smithi088 ceph-mon[112028]: Reconfiguring alertmanager.smithi088 (dependencies changed)... 2023-12-09T02:30:00.965 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:00 smithi088 ceph-mon[112028]: Reconfiguring daemon alertmanager.smithi088 on smithi088 2023-12-09T02:30:00.966 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:00 smithi088 ceph-mon[112028]: overall HEALTH_OK 2023-12-09T02:30:01.169 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:00 smithi161 ceph-mon[121170]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:01.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:00 smithi161 ceph-mon[121170]: Reconfiguring alertmanager.smithi088 (dependencies changed)... 2023-12-09T02:30:01.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:00 smithi161 ceph-mon[121170]: Reconfiguring daemon alertmanager.smithi088 on smithi088 2023-12-09T02:30:01.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:00 smithi161 ceph-mon[121170]: overall HEALTH_OK 2023-12-09T02:30:01.452 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:30:02.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:30:02.171 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:30:02.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.588+0000 7f5375e3d700 1 -- 172.21.15.88:0/2568172144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5370100050 msgr2=0x7f5370102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:30:02.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.588+0000 7f5375e3d700 1 --2- 172.21.15.88:0/2568172144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5370100050 0x7f5370102430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5364004940 tx=0x7f5364009e30 comp rx=0 tx=0).stop 2023-12-09T02:30:02.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.588+0000 7f5375e3d700 1 -- 172.21.15.88:0/2568172144 shutdown_connections 2023-12-09T02:30:02.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.588+0000 7f5375e3d700 1 --2- 172.21.15.88:0/2568172144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5370100050 0x7f5370102430 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:02.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.588+0000 7f5375e3d700 1 --2- 172.21.15.88:0/2568172144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53700fd730 0x7f53700ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:02.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.588+0000 7f5375e3d700 1 -- 172.21.15.88:0/2568172144 >> 172.21.15.88:0/2568172144 conn(0x7f53700f71b0 msgr2=0x7f53700f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:30:02.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.588+0000 7f5375e3d700 1 -- 172.21.15.88:0/2568172144 shutdown_connections 2023-12-09T02:30:02.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.588+0000 7f5375e3d700 1 -- 172.21.15.88:0/2568172144 wait complete. 2023-12-09T02:30:02.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.589+0000 7f5375e3d700 1 Processor -- start 2023-12-09T02:30:02.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.589+0000 7f5375e3d700 1 -- start start 2023-12-09T02:30:02.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.589+0000 7f5375e3d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53700fd730 0x7f537010f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:30:02.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.589+0000 7f5375e3d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5370100050 0x7f537010fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:30:02.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f5375e3d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5370110260 con 0x7f53700fd730 2023-12-09T02:30:02.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f5375e3d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5370110b00 con 0x7f5370100050 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f536f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53700fd730 0x7f537010f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f536f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53700fd730 0x7f537010f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50466/0 (socket says 172.21.15.88:50466) 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f536f7fe700 1 -- 172.21.15.88:0/1687486940 learned_addr learned my addr 172.21.15.88:0/1687486940 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f536effd700 1 --2- 172.21.15.88:0/1687486940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5370100050 0x7f537010fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f536f7fe700 1 -- 172.21.15.88:0/1687486940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5370100050 msgr2=0x7f537010fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f536f7fe700 1 --2- 172.21.15.88:0/1687486940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5370100050 0x7f537010fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f536f7fe700 1 -- 172.21.15.88:0/1687486940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5364005040 con 0x7f53700fd730 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f536f7fe700 1 --2- 172.21.15.88:0/1687486940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53700fd730 0x7f537010f720 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f536000c8c0 tx=0x7f53600044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f5357fff700 1 -- 172.21.15.88:0/1687486940 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f536000a980 con 0x7f53700fd730 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f5375e3d700 1 -- 172.21.15.88:0/1687486940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5370110de0 con 0x7f53700fd730 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f5375e3d700 1 -- 172.21.15.88:0/1687486940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5370111320 con 0x7f53700fd730 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f5357fff700 1 -- 172.21.15.88:0/1687486940 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f536000ce60 con 0x7f53700fd730 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.590+0000 7f5357fff700 1 -- 172.21.15.88:0/1687486940 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5360012400 con 0x7f53700fd730 2023-12-09T02:30:02.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.591+0000 7f5375e3d700 1 -- 172.21.15.88:0/1687486940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c0052e0 con 0x7f53700fd730 2023-12-09T02:30:02.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.592+0000 7f5357fff700 1 -- 172.21.15.88:0/1687486940 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f536001b790 con 0x7f53700fd730 2023-12-09T02:30:02.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.592+0000 7f5357fff700 1 --2- 172.21.15.88:0/1687486940 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5358068ed0 0x7f535806b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:30:02.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.592+0000 7f5357fff700 1 -- 172.21.15.88:0/1687486940 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5360085d10 con 0x7f53700fd730 2023-12-09T02:30:02.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.592+0000 7f536effd700 1 --2- 172.21.15.88:0/1687486940 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5358068ed0 0x7f535806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:30:02.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.593+0000 7f536effd700 1 --2- 172.21.15.88:0/1687486940 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5358068ed0 0x7f535806b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f536400b3b0 tx=0x7f5364009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:30:02.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.597+0000 7f5357fff700 1 -- 172.21.15.88:0/1687486940 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5360056d50 con 0x7f53700fd730 2023-12-09T02:30:02.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:02.804+0000 7f5375e3d700 1 -- 172.21.15.88:0/1687486940 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f535c000bf0 con 0x7f5358068ed0 2023-12-09T02:30:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:02 smithi088 ceph-mon[112028]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:02 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:30:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:02 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:30:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:02 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:03.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:02 smithi161 ceph-mon[121170]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:03.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:02 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:30:03.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:02 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:30:03.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:02 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:04 smithi161 ceph-mon[121170]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:30:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:04 smithi161 ceph-mon[121170]: Reconfiguring grafana.smithi088 (dependencies changed)... 2023-12-09T02:30:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:04 smithi161 ceph-mon[121170]: Reconfiguring daemon grafana.smithi088 on smithi088 2023-12-09T02:30:04.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:04 smithi088 ceph-mon[112028]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:30:04.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:04.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:04.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:04 smithi088 ceph-mon[112028]: Reconfiguring grafana.smithi088 (dependencies changed)... 2023-12-09T02:30:04.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:04 smithi088 ceph-mon[112028]: Reconfiguring daemon grafana.smithi088 on smithi088 2023-12-09T02:30:05.356 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:05 smithi088 ceph-mon[112028]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:05.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:05 smithi161 ceph-mon[121170]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:07.357 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:07 smithi088 ceph-mon[112028]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:07.357 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:07 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:07.357 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:07 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:07.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:07 smithi161 ceph-mon[121170]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:07.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:07 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:07.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:07 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:08 smithi161 ceph-mon[121170]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2023-12-09T02:30:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:08 smithi161 ceph-mon[121170]: Reconfiguring daemon prometheus.smithi088 on smithi088 2023-12-09T02:30:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:08 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2322421346' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94c4c8ad-f87e-4abd-aff2-ea13d8630f13"}]: dispatch 2023-12-09T02:30:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:08 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2322421346' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94c4c8ad-f87e-4abd-aff2-ea13d8630f13"}]': finished 2023-12-09T02:30:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:08 smithi161 ceph-mon[121170]: osdmap e6: 1 total, 0 up, 1 in 2023-12-09T02:30:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:08 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:30:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:08 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/772252015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:30:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:08 smithi088 ceph-mon[112028]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2023-12-09T02:30:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:08 smithi088 ceph-mon[112028]: Reconfiguring daemon prometheus.smithi088 on smithi088 2023-12-09T02:30:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:08 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2322421346' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94c4c8ad-f87e-4abd-aff2-ea13d8630f13"}]: dispatch 2023-12-09T02:30:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:08 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2322421346' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94c4c8ad-f87e-4abd-aff2-ea13d8630f13"}]': finished 2023-12-09T02:30:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:08 smithi088 ceph-mon[112028]: osdmap e6: 1 total, 0 up, 1 in 2023-12-09T02:30:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:08 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:30:08.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:08 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/772252015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:30:09.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:09 smithi161 ceph-mon[121170]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:09.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:09 smithi088 ceph-mon[112028]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:10.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:10 smithi161 ceph-mon[121170]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:10.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:10 smithi088 ceph-mon[112028]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:12.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:12 smithi161 ceph-mon[121170]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:12.933 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:12 smithi088 ceph-mon[112028]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:14.855 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:14 smithi088 ceph-mon[112028]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:14.855 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:14 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:14.855 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:14 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:14.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:14 smithi161 ceph-mon[121170]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:14.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:14 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:14.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:14 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:15 smithi161 ceph-mon[121170]: Reconfiguring crash.smithi161 (monmap changed)... 2023-12-09T02:30:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:15 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:30:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:15 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:15 smithi161 ceph-mon[121170]: Reconfiguring daemon crash.smithi161 on smithi161 2023-12-09T02:30:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:15 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-09T02:30:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:15 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:15 smithi088 ceph-mon[112028]: Reconfiguring crash.smithi161 (monmap changed)... 2023-12-09T02:30:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:15 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:30:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:15 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:15 smithi088 ceph-mon[112028]: Reconfiguring daemon crash.smithi161 on smithi161 2023-12-09T02:30:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:15 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-09T02:30:15.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:15 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:16.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:16.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: Deploying daemon osd.0 on smithi088 2023-12-09T02:30:16.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:16.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:16.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: Reconfiguring mgr.smithi161.qmxtmg (monmap changed)... 2023-12-09T02:30:16.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:30:16.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:30:16.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:16.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: Reconfiguring daemon mgr.smithi161.qmxtmg on smithi161 2023-12-09T02:30:16.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:30:16.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:16.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:16.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:30:16.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:30:16.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:17.091 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:17.091 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: Deploying daemon osd.0 on smithi088 2023-12-09T02:30:17.091 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:17.091 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:17.091 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: Reconfiguring mgr.smithi161.qmxtmg (monmap changed)... 2023-12-09T02:30:17.091 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:30:17.092 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:30:17.092 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:17.092 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: Reconfiguring daemon mgr.smithi161.qmxtmg on smithi161 2023-12-09T02:30:17.092 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:30:17.092 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:17.092 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:17.092 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:30:17.092 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:30:17.092 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:17.866 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:17 smithi088 ceph-mon[112028]: Reconfiguring mon.smithi161 (monmap changed)... 2023-12-09T02:30:17.866 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:17 smithi088 ceph-mon[112028]: Reconfiguring daemon mon.smithi161 on smithi161 2023-12-09T02:30:17.866 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:17 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:17.866 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:17 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:17.866 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:17 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-09T02:30:17.866 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:17 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2023-12-09T02:30:17.866 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:17 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:17.867 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:17 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-09T02:30:17.867 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:17 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2023-12-09T02:30:17.867 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:17 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:18.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:17 smithi161 ceph-mon[121170]: Reconfiguring mon.smithi161 (monmap changed)... 2023-12-09T02:30:18.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:17 smithi161 ceph-mon[121170]: Reconfiguring daemon mon.smithi161 on smithi161 2023-12-09T02:30:18.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:17 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:18.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:17 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:18.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:17 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-09T02:30:18.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:17 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2023-12-09T02:30:18.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:17 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:18.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:17 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-09T02:30:18.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:17 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2023-12-09T02:30:18.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:17 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:19.134 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:18 smithi088 ceph-mon[112028]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:19.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:18 smithi088 ceph-mon[112028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-09T02:30:19.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:18 smithi088 ceph-mon[112028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2023-12-09T02:30:19.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:18 smithi088 ceph-mon[112028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-09T02:30:19.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:18 smithi088 ceph-mon[112028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2023-12-09T02:30:19.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:18 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:30:19.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:18 smithi088 ceph-mon[112028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:30:19.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:18 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2023-12-09T02:30:19.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:18 smithi088 ceph-mon[112028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2023-12-09T02:30:19.136 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:18 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:19.136 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:18 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:30:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:18 smithi161 ceph-mon[121170]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:18 smithi161 ceph-mon[121170]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-09T02:30:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:18 smithi161 ceph-mon[121170]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2023-12-09T02:30:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:18 smithi161 ceph-mon[121170]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-09T02:30:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:18 smithi161 ceph-mon[121170]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2023-12-09T02:30:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:18 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:30:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:18 smithi161 ceph-mon[121170]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:30:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:18 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2023-12-09T02:30:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:18 smithi161 ceph-mon[121170]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2023-12-09T02:30:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:18 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:19.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:18 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:30:20.187 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:19 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:20.188 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:19 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:20.188 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:19 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:20.188 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:19 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:20.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:19 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:20.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:19 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:20.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:19 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:20.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:19 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:20 smithi088 ceph-mon[112028]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:20 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:20 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:20 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:20 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:30:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:20 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:21.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:20 smithi161 ceph-mon[121170]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:21.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:20 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:21.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:20 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:21.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:20 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:21.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:20 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:30:21.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:21 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:22.183 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:22 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:30:22.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:22 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:30:22.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.568+0000 7f5357fff700 1 -- 172.21.15.88:0/1687486940 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f535c000bf0 con 0x7f5358068ed0 2023-12-09T02:30:22.571 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 0 on host 'smithi088' 2023-12-09T02:30:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.571+0000 7f5375e3d700 1 -- 172.21.15.88:0/1687486940 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5358068ed0 msgr2=0x7f535806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:30:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.571+0000 7f5375e3d700 1 --2- 172.21.15.88:0/1687486940 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5358068ed0 0x7f535806b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f536400b3b0 tx=0x7f5364009e30 comp rx=0 tx=0).stop 2023-12-09T02:30:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.571+0000 7f5375e3d700 1 -- 172.21.15.88:0/1687486940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53700fd730 msgr2=0x7f537010f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:30:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.571+0000 7f5375e3d700 1 --2- 172.21.15.88:0/1687486940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53700fd730 0x7f537010f720 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f536000c8c0 tx=0x7f53600044c0 comp rx=0 tx=0).stop 2023-12-09T02:30:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.571+0000 7f5375e3d700 1 -- 172.21.15.88:0/1687486940 shutdown_connections 2023-12-09T02:30:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.571+0000 7f5375e3d700 1 --2- 172.21.15.88:0/1687486940 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f5358068ed0 0x7f535806b380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.571+0000 7f5375e3d700 1 --2- 172.21.15.88:0/1687486940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53700fd730 0x7f537010f720 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.571+0000 7f5375e3d700 1 --2- 172.21.15.88:0/1687486940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5370100050 0x7f537010fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.571+0000 7f5375e3d700 1 -- 172.21.15.88:0/1687486940 >> 172.21.15.88:0/1687486940 conn(0x7f53700f71b0 msgr2=0x7f53700fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:30:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.571+0000 7f5375e3d700 1 -- 172.21.15.88:0/1687486940 shutdown_connections 2023-12-09T02:30:22.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:22.571+0000 7f5375e3d700 1 -- 172.21.15.88:0/1687486940 wait complete. 2023-12-09T02:30:23.086 DEBUG:teuthology.orchestra.run.smithi088:osd.0> sudo journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.0.service 2023-12-09T02:30:23.088 INFO:tasks.cephadm:Deploying osd.1 on smithi088 with /dev/vg_nvme/lv_3... 2023-12-09T02:30:23.088 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-09T02:30:23.112 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:23 smithi088 ceph-mon[112028]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:23.112 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:23 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:23.112 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:23 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:23.112 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:23 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:23.113 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:23 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:23.118 INFO:journalctl@ceph.osd.0.smithi088.stdout:-- Logs begin at Sat 2023-12-09 02:05:57 UTC. -- 2023-12-09T02:30:23.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:23 smithi161 ceph-mon[121170]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:23.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:23 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:23.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:23 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:23.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:23 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:23.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:23 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:23.528 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:30:23.976 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:30:23 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[135678]: 2023-12-09T02:30:23.679+0000 7fa9f184d540 -1 osd.0 0 log_to_monitors true 2023-12-09T02:30:24.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:24 smithi161 ceph-mon[121170]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:24.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:24 smithi161 ceph-mon[121170]: from='osd.0 [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-09T02:30:24.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:24 smithi088 ceph-mon[112028]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:24.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:24 smithi088 ceph-mon[112028]: from='osd.0 [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-09T02:30:25.023 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-09T02:30:25.023 INFO:teuthology.orchestra.run.smithi088.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-09T02:30:25.024 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10+0 records in 2023-12-09T02:30:25.024 INFO:teuthology.orchestra.run.smithi088.stderr:10+0 records out 2023-12-09T02:30:25.024 INFO:teuthology.orchestra.run.smithi088.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0138341 s, 758 MB/s 2023-12-09T02:30:25.024 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping successful for: 2023-12-09T02:30:25.739 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi088:vg_nvme/lv_3 2023-12-09T02:30:25.925 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:30:25 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[135678]: 2023-12-09T02:30:25.673+0000 7fa9e8032700 -1 osd.0 0 waiting for initial osdmap 2023-12-09T02:30:25.925 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:30:25 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[135678]: 2023-12-09T02:30:25.679+0000 7fa9e362e700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:30:25.925 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:25 smithi088 ceph-mon[112028]: from='osd.0 [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-09T02:30:25.925 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:25 smithi088 ceph-mon[112028]: osdmap e7: 1 total, 0 up, 1 in 2023-12-09T02:30:25.925 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:25 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:30:25.925 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:25 smithi088 ceph-mon[112028]: from='osd.0 [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:30:25.925 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:25 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:25.925 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:25 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:26.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:25 smithi161 ceph-mon[121170]: from='osd.0 [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-09T02:30:26.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:25 smithi161 ceph-mon[121170]: osdmap e7: 1 total, 0 up, 1 in 2023-12-09T02:30:26.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:25 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:30:26.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:25 smithi161 ceph-mon[121170]: from='osd.0 [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:30:26.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:25 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:26.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:25 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:26.203 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:30:26.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:26 smithi088 ceph-mon[112028]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:26.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:26 smithi088 ceph-mon[112028]: from='osd.0 [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-12-09T02:30:26.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:26 smithi088 ceph-mon[112028]: osdmap e8: 1 total, 0 up, 1 in 2023-12-09T02:30:26.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:26 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:30:26.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:26 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:30:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:26 smithi161 ceph-mon[121170]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:26 smithi161 ceph-mon[121170]: from='osd.0 [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-12-09T02:30:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:26 smithi161 ceph-mon[121170]: osdmap e8: 1 total, 0 up, 1 in 2023-12-09T02:30:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:26 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:30:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:26 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:30:27.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.231+0000 7f0551cbe700 1 -- 172.21.15.88:0/3385451272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f054c0fbaf0 msgr2=0x7f054c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.231+0000 7f0551cbe700 1 --2- 172.21.15.88:0/3385451272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f054c0fbaf0 0x7f054c0fbf00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f053c004940 tx=0x7f053c009e30 comp rx=0 tx=0).stop 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.231+0000 7f0551cbe700 1 -- 172.21.15.88:0/3385451272 shutdown_connections 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.231+0000 7f0551cbe700 1 --2- 172.21.15.88:0/3385451272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f054c0fcd00 0x7f054c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.231+0000 7f0551cbe700 1 --2- 172.21.15.88:0/3385451272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f054c0fbaf0 0x7f054c0fbf00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.231+0000 7f0551cbe700 1 -- 172.21.15.88:0/3385451272 >> 172.21.15.88:0/3385451272 conn(0x7f054c0f7190 msgr2=0x7f054c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.231+0000 7f0551cbe700 1 -- 172.21.15.88:0/3385451272 shutdown_connections 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.231+0000 7f0551cbe700 1 -- 172.21.15.88:0/3385451272 wait complete. 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.232+0000 7f0551cbe700 1 Processor -- start 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.232+0000 7f0551cbe700 1 -- start start 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.232+0000 7f0551cbe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f054c0fbaf0 0x7f054c0ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.232+0000 7f0551cbe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f054c0fcd00 0x7f054c0fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.232+0000 7f0551cbe700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c0fe640 con 0x7f054c0fbaf0 2023-12-09T02:30:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.232+0000 7f0551cbe700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c0fe7b0 con 0x7f054c0fcd00 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.232+0000 7f054b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f054c0fbaf0 0x7f054c0ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.232+0000 7f054b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f054c0fbaf0 0x7f054c0ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33882/0 (socket says 172.21.15.88:33882) 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f054b7fe700 1 -- 172.21.15.88:0/4007006532 learned_addr learned my addr 172.21.15.88:0/4007006532 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f054affd700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f054c0fcd00 0x7f054c0fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f054b7fe700 1 -- 172.21.15.88:0/4007006532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f054c0fcd00 msgr2=0x7f054c0fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f054b7fe700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f054c0fcd00 0x7f054c0fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f054b7fe700 1 -- 172.21.15.88:0/4007006532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c005040 con 0x7f054c0fbaf0 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f054affd700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f054c0fcd00 0x7f054c0fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f054b7fe700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f054c0fbaf0 0x7f054c0ffbc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f053c004f90 tx=0x7f053c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f0533fff700 1 -- 172.21.15.88:0/4007006532 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053c00e040 con 0x7f054c0fbaf0 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f0533fff700 1 -- 172.21.15.88:0/4007006532 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f053c00bcd0 con 0x7f054c0fbaf0 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f0551cbe700 1 -- 172.21.15.88:0/4007006532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054c0fea30 con 0x7f054c0fbaf0 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f0533fff700 1 -- 172.21.15.88:0/4007006532 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053c01c630 con 0x7f054c0fbaf0 2023-12-09T02:30:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.233+0000 7f0551cbe700 1 -- 172.21.15.88:0/4007006532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054c1155b0 con 0x7f054c0fbaf0 2023-12-09T02:30:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.234+0000 7f0551cbe700 1 -- 172.21.15.88:0/4007006532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054c04bb80 con 0x7f054c0fbaf0 2023-12-09T02:30:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.234+0000 7f0533fff700 1 -- 172.21.15.88:0/4007006532 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f053c013960 con 0x7f054c0fbaf0 2023-12-09T02:30:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.235+0000 7f0533fff700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0534068ed0 0x7f053406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:30:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.235+0000 7f0533fff700 1 -- 172.21.15.88:0/4007006532 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f053c087380 con 0x7f054c0fbaf0 2023-12-09T02:30:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.235+0000 7f054affd700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0534068ed0 0x7f053406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:30:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.235+0000 7f054affd700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0534068ed0 0x7f053406b380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f05400041d0 tx=0x7f0540009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:30:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.239+0000 7f0533fff700 1 -- 172.21.15.88:0/4007006532 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f053c058160 con 0x7f054c0fbaf0 2023-12-09T02:30:27.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:27.437+0000 7f0551cbe700 1 -- 172.21.15.88:0/4007006532 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f054c065a80 con 0x7f0534068ed0 2023-12-09T02:30:27.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: purged_snaps scrub starts 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: purged_snaps scrub ok 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: osd.0 [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891] boot 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: osdmap e9: 1 total, 1 up, 1 in 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:30:27.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:28.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: purged_snaps scrub starts 2023-12-09T02:30:28.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: purged_snaps scrub ok 2023-12-09T02:30:28.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: osd.0 [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891] boot 2023-12-09T02:30:28.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: osdmap e9: 1 total, 1 up, 1 in 2023-12-09T02:30:28.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:30:28.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:30:28.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:30:28.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:28.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:28.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:28.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:30:28.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:28.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:28.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:30:28.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:28.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:28 smithi088 ceph-mon[112028]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:30:28.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:28 smithi088 ceph-mon[112028]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:28.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:28 smithi088 ceph-mon[112028]: Detected new or changed devices on smithi088 2023-12-09T02:30:28.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:28 smithi088 ceph-mon[112028]: Adjusting osd_memory_target on smithi088 to 12898M 2023-12-09T02:30:28.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:28 smithi088 ceph-mon[112028]: osdmap e10: 1 total, 1 up, 1 in 2023-12-09T02:30:28.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:28 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:30:29.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:28 smithi161 ceph-mon[121170]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:30:29.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:28 smithi161 ceph-mon[121170]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-09T02:30:29.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:28 smithi161 ceph-mon[121170]: Detected new or changed devices on smithi088 2023-12-09T02:30:29.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:28 smithi161 ceph-mon[121170]: Adjusting osd_memory_target on smithi088 to 12898M 2023-12-09T02:30:29.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:28 smithi161 ceph-mon[121170]: osdmap e10: 1 total, 1 up, 1 in 2023-12-09T02:30:29.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:28 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:30:30.355 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:30 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:30.355 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:30 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:30.355 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:30 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1145567811' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b6c3137-e616-4979-a9cb-89665a8a2919"}]: dispatch 2023-12-09T02:30:30.355 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:30 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1145567811' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b6c3137-e616-4979-a9cb-89665a8a2919"}]': finished 2023-12-09T02:30:30.355 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:30 smithi088 ceph-mon[112028]: osdmap e11: 2 total, 1 up, 2 in 2023-12-09T02:30:30.355 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:30 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:30.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:30 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:30.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:30 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:30.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:30 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/1145567811' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b6c3137-e616-4979-a9cb-89665a8a2919"}]: dispatch 2023-12-09T02:30:30.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:30 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/1145567811' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b6c3137-e616-4979-a9cb-89665a8a2919"}]': finished 2023-12-09T02:30:30.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:30 smithi161 ceph-mon[121170]: osdmap e11: 2 total, 1 up, 2 in 2023-12-09T02:30:30.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:30 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:31.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:31 smithi161 ceph-mon[121170]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:31.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:31 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3099101948' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:30:31.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:31 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:31.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:31 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:31.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:31 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:31.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:31 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:30:31.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:31 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:31.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:31 smithi088 ceph-mon[112028]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:31.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:31 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3099101948' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:30:31.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:31.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:31.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:31.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:30:31.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:32.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:32 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:30:32.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:32 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:30:33.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:33 smithi161 ceph-mon[121170]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:33.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:33 smithi088 ceph-mon[112028]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:35.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:35 smithi088 ceph-mon[112028]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:35.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:35 smithi161 ceph-mon[121170]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:36.290 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:36 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-09T02:30:36.290 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:36 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:36.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:36 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-09T02:30:36.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:36 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:37.405 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:37 smithi088 ceph-mon[112028]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:37.405 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:37 smithi088 ceph-mon[112028]: Deploying daemon osd.1 on smithi088 2023-12-09T02:30:37.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:37 smithi161 ceph-mon[121170]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:37.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:37 smithi161 ceph-mon[121170]: Deploying daemon osd.1 on smithi088 2023-12-09T02:30:39.318 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:39 smithi088 ceph-mon[112028]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:39.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:39 smithi161 ceph-mon[121170]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:40.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:40.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:40.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:30:40.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:40 smithi088 ceph-mon[112028]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:40.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:40 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:40.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:40 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:40.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:40 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:30:40.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:40 smithi161 ceph-mon[121170]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:42.191 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 1 on host 'smithi088' 2023-12-09T02:30:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.190+0000 7f0533fff700 1 -- 172.21.15.88:0/4007006532 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f054c065a80 con 0x7f0534068ed0 2023-12-09T02:30:42.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.192+0000 7f0551cbe700 1 -- 172.21.15.88:0/4007006532 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0534068ed0 msgr2=0x7f053406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:30:42.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.192+0000 7f0551cbe700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0534068ed0 0x7f053406b380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f05400041d0 tx=0x7f0540009040 comp rx=0 tx=0).stop 2023-12-09T02:30:42.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.192+0000 7f0551cbe700 1 -- 172.21.15.88:0/4007006532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f054c0fbaf0 msgr2=0x7f054c0ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:30:42.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.192+0000 7f0551cbe700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f054c0fbaf0 0x7f054c0ffbc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f053c004f90 tx=0x7f053c009e30 comp rx=0 tx=0).stop 2023-12-09T02:30:42.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.192+0000 7f0551cbe700 1 -- 172.21.15.88:0/4007006532 shutdown_connections 2023-12-09T02:30:42.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.192+0000 7f0551cbe700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0534068ed0 0x7f053406b380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:42.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.192+0000 7f0551cbe700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f054c0fbaf0 0x7f054c0ffbc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:42.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.192+0000 7f0551cbe700 1 --2- 172.21.15.88:0/4007006532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f054c0fcd00 0x7f054c0fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:42.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.192+0000 7f0551cbe700 1 -- 172.21.15.88:0/4007006532 >> 172.21.15.88:0/4007006532 conn(0x7f054c0f7190 msgr2=0x7f054c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:30:42.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.192+0000 7f0551cbe700 1 -- 172.21.15.88:0/4007006532 shutdown_connections 2023-12-09T02:30:42.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:42.192+0000 7f0551cbe700 1 -- 172.21.15.88:0/4007006532 wait complete. 2023-12-09T02:30:42.762 DEBUG:teuthology.orchestra.run.smithi088:osd.1> sudo journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.1.service 2023-12-09T02:30:42.764 INFO:tasks.cephadm:Deploying osd.2 on smithi088 with /dev/vg_nvme/lv_2... 2023-12-09T02:30:42.764 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-09T02:30:42.797 INFO:journalctl@ceph.osd.1.smithi088.stdout:-- Logs begin at Sat 2023-12-09 02:05:57 UTC. -- 2023-12-09T02:30:42.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:42 smithi088 ceph-mon[112028]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:42.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:42 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:42.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:42 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:42.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:42 smithi161 ceph-mon[121170]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:42.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:42 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:42.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:42 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:43.171 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:30:43.661 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:30:43 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[145573]: 2023-12-09T02:30:43.434+0000 7f9b74e88540 -1 osd.1 0 log_to_monitors true 2023-12-09T02:30:44.280 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:44.280 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:44.280 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:44 smithi088 ceph-mon[112028]: from='osd.1 [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-09T02:30:44.280 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:44 smithi088 ceph-mon[112028]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:44.511 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-09T02:30:44.511 INFO:teuthology.orchestra.run.smithi088.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-09T02:30:44.511 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10+0 records in 2023-12-09T02:30:44.511 INFO:teuthology.orchestra.run.smithi088.stderr:10+0 records out 2023-12-09T02:30:44.512 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108556 s, 966 MB/s 2023-12-09T02:30:44.512 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping successful for: 2023-12-09T02:30:44.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:44 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:44.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:44 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:44.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:44 smithi161 ceph-mon[121170]: from='osd.1 [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-09T02:30:44.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:44 smithi161 ceph-mon[121170]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:45.192 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi088:vg_nvme/lv_2 2023-12-09T02:30:45.465 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:30:45.609 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:45 smithi088 ceph-mon[112028]: from='osd.1 [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-09T02:30:45.609 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:45 smithi088 ceph-mon[112028]: osdmap e12: 2 total, 1 up, 2 in 2023-12-09T02:30:45.609 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:45 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:45.609 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:45 smithi088 ceph-mon[112028]: from='osd.1 [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:30:45.609 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:30:45 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[145573]: 2023-12-09T02:30:45.239+0000 7f9b6b66d700 -1 osd.1 0 waiting for initial osdmap 2023-12-09T02:30:45.609 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:30:45 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[145573]: 2023-12-09T02:30:45.246+0000 7f9b6746a700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:30:45.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:45 smithi161 ceph-mon[121170]: from='osd.1 [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-09T02:30:45.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:45 smithi161 ceph-mon[121170]: osdmap e12: 2 total, 1 up, 2 in 2023-12-09T02:30:45.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:45 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:45.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:45 smithi161 ceph-mon[121170]: from='osd.1 [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:30:46.530 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:46 smithi088 ceph-mon[112028]: from='osd.1 [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-12-09T02:30:46.530 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:46 smithi088 ceph-mon[112028]: osdmap e13: 2 total, 1 up, 2 in 2023-12-09T02:30:46.531 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:46.531 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:46.531 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:46 smithi088 ceph-mon[112028]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:46.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:46 smithi161 ceph-mon[121170]: from='osd.1 [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-12-09T02:30:46.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:46 smithi161 ceph-mon[121170]: osdmap e13: 2 total, 1 up, 2 in 2023-12-09T02:30:46.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:46 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:46.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:46 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:46.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:46 smithi161 ceph-mon[121170]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-09T02:30:46.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.707+0000 7fdecc73a700 1 -- 172.21.15.88:0/4248785349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec40668c0 msgr2=0x7fdec40ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:30:46.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.707+0000 7fdecc73a700 1 --2- 172.21.15.88:0/4248785349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec40668c0 0x7fdec40ff800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdec0004940 tx=0x7fdec0009e30 comp rx=0 tx=0).stop 2023-12-09T02:30:46.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.707+0000 7fdecc73a700 1 -- 172.21.15.88:0/4248785349 shutdown_connections 2023-12-09T02:30:46.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.707+0000 7fdecc73a700 1 --2- 172.21.15.88:0/4248785349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdec40ffdd0 0x7fdec41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:46.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.707+0000 7fdecc73a700 1 --2- 172.21.15.88:0/4248785349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec40668c0 0x7fdec40ff800 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:46.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.707+0000 7fdecc73a700 1 -- 172.21.15.88:0/4248785349 >> 172.21.15.88:0/4248785349 conn(0x7fdec40f71b0 msgr2=0x7fdec40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:30:46.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.707+0000 7fdecc73a700 1 -- 172.21.15.88:0/4248785349 shutdown_connections 2023-12-09T02:30:46.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.707+0000 7fdecc73a700 1 -- 172.21.15.88:0/4248785349 wait complete. 2023-12-09T02:30:46.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdecc73a700 1 Processor -- start 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdecc73a700 1 -- start start 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdecc73a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec40668c0 0x7fdec410d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdecc73a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdec40ffdd0 0x7fdec410dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdecc73a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec410e0b0 con 0x7fdec40668c0 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdecc73a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec410e950 con 0x7fdec40ffdd0 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdeca4d6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec40668c0 0x7fdec410d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdeca4d6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec40668c0 0x7fdec410d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35342/0 (socket says 172.21.15.88:35342) 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdeca4d6700 1 -- 172.21.15.88:0/503803679 learned_addr learned my addr 172.21.15.88:0/503803679 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdeca4d6700 1 -- 172.21.15.88:0/503803679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdec40ffdd0 msgr2=0x7fdec410dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdeca4d6700 1 --2- 172.21.15.88:0/503803679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdec40ffdd0 0x7fdec410dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdeca4d6700 1 -- 172.21.15.88:0/503803679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec0005040 con 0x7fdec40668c0 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.708+0000 7fdeca4d6700 1 --2- 172.21.15.88:0/503803679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec40668c0 0x7fdec410d570 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009360 tx=0x7fdec0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.709+0000 7fdebaffd700 1 -- 172.21.15.88:0/503803679 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec000e040 con 0x7fdec40668c0 2023-12-09T02:30:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.709+0000 7fdecc73a700 1 -- 172.21.15.88:0/503803679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec410ebd0 con 0x7fdec40668c0 2023-12-09T02:30:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.709+0000 7fdebaffd700 1 -- 172.21.15.88:0/503803679 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdec000bcd0 con 0x7fdec40668c0 2023-12-09T02:30:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.709+0000 7fdebaffd700 1 -- 172.21.15.88:0/503803679 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec001c630 con 0x7fdec40668c0 2023-12-09T02:30:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.709+0000 7fdecc73a700 1 -- 172.21.15.88:0/503803679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec410f110 con 0x7fdec40668c0 2023-12-09T02:30:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.710+0000 7fdecc73a700 1 -- 172.21.15.88:0/503803679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec41075e0 con 0x7fdec40668c0 2023-12-09T02:30:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.711+0000 7fdebaffd700 1 -- 172.21.15.88:0/503803679 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7fdec0013960 con 0x7fdec40668c0 2023-12-09T02:30:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.711+0000 7fdebaffd700 1 --2- 172.21.15.88:0/503803679 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeb0068ed0 0x7fdeb006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:30:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.711+0000 7fdebaffd700 1 -- 172.21.15.88:0/503803679 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2410+0+0 (secure 0 0 0) 0x7fdec0087fc0 con 0x7fdec40668c0 2023-12-09T02:30:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.711+0000 7fdec9cd5700 1 --2- 172.21.15.88:0/503803679 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeb0068ed0 0x7fdeb006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:30:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.712+0000 7fdec9cd5700 1 --2- 172.21.15.88:0/503803679 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeb0068ed0 0x7fdeb006b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdec4066600 tx=0x7fdeb4007d40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:30:46.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.715+0000 7fdebaffd700 1 -- 172.21.15.88:0/503803679 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdec0058c90 con 0x7fdec40668c0 2023-12-09T02:30:46.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:30:46.915+0000 7fdecc73a700 1 -- 172.21.15.88:0/503803679 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdec402b260 con 0x7fdeb0068ed0 2023-12-09T02:30:47.510 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: purged_snaps scrub starts 2023-12-09T02:30:47.510 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: purged_snaps scrub ok 2023-12-09T02:30:47.510 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:47.510 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: osd.1 [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781] boot 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: osdmap e14: 2 total, 2 up, 2 in 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: Detected new or changed devices on smithi088 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: Adjusting osd_memory_target on smithi088 to 6449M 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:47.511 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:30:47.512 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:30:47.512 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:30:47.512 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:30:47.512 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:30:47.512 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:47.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: purged_snaps scrub starts 2023-12-09T02:30:47.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: purged_snaps scrub ok 2023-12-09T02:30:47.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:47.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: osd.1 [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781] boot 2023-12-09T02:30:47.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: osdmap e14: 2 total, 2 up, 2 in 2023-12-09T02:30:47.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:30:47.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: Detected new or changed devices on smithi088 2023-12-09T02:30:47.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:47.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:47.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: Adjusting osd_memory_target on smithi088 to 6449M 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:30:47.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:48.291 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:48 smithi088 ceph-mon[112028]: osdmap e15: 2 total, 2 up, 2 in 2023-12-09T02:30:48.291 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:48 smithi088 ceph-mon[112028]: pgmap v41: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:30:48.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:48 smithi161 ceph-mon[121170]: osdmap e15: 2 total, 2 up, 2 in 2023-12-09T02:30:48.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:48 smithi161 ceph-mon[121170]: pgmap v41: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:30:49.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:49 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2074848501' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5d0b176-113f-450a-8737-2dcf542f1f32"}]: dispatch 2023-12-09T02:30:49.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:49 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2074848501' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5d0b176-113f-450a-8737-2dcf542f1f32"}]': finished 2023-12-09T02:30:49.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:49 smithi088 ceph-mon[112028]: osdmap e16: 3 total, 2 up, 3 in 2023-12-09T02:30:49.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:49 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:30:50.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:49 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2074848501' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5d0b176-113f-450a-8737-2dcf542f1f32"}]: dispatch 2023-12-09T02:30:50.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:49 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2074848501' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5d0b176-113f-450a-8737-2dcf542f1f32"}]': finished 2023-12-09T02:30:50.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:49 smithi161 ceph-mon[121170]: osdmap e16: 3 total, 2 up, 3 in 2023-12-09T02:30:50.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:49 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:30:51.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:50 smithi161 ceph-mon[121170]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:30:51.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:51.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:51.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:51.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:30:51.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:51.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:50 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3850829277' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:30:51.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:50 smithi088 ceph-mon[112028]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:30:51.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:51.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:51.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:51.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:30:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:30:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:50 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3850829277' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:30:53.157 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:52 smithi088 ceph-mon[112028]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:30:53.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:52 smithi161 ceph-mon[121170]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:30:54.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:54 smithi088 ceph-mon[112028]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:30:55.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:54 smithi161 ceph-mon[121170]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:30:56.025 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:55 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-09T02:30:56.025 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:55 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:56.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:55 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-09T02:30:56.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:55 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:30:56.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:56 smithi088 ceph-mon[112028]: Deploying daemon osd.2 on smithi088 2023-12-09T02:30:56.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:56 smithi088 ceph-mon[112028]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:30:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:56 smithi161 ceph-mon[121170]: Deploying daemon osd.2 on smithi088 2023-12-09T02:30:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:56 smithi161 ceph-mon[121170]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:30:59.041 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:30:58 smithi088 ceph-mon[112028]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:30:59.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:30:58 smithi161 ceph-mon[121170]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:31:00.145 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:00 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:00.145 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:00 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:00.145 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:00 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:00.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:00 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:00.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:00 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:00.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:00 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:01.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:01 smithi088 ceph-mon[112028]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:31:01.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:01 smithi161 ceph-mon[121170]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:31:01.567 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 2 on host 'smithi088' 2023-12-09T02:31:01.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.564+0000 7fdebaffd700 1 -- 172.21.15.88:0/503803679 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdec402b260 con 0x7fdeb0068ed0 2023-12-09T02:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.566+0000 7fdecc73a700 1 -- 172.21.15.88:0/503803679 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeb0068ed0 msgr2=0x7fdeb006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.566+0000 7fdecc73a700 1 --2- 172.21.15.88:0/503803679 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeb0068ed0 0x7fdeb006b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdec4066600 tx=0x7fdeb4007d40 comp rx=0 tx=0).stop 2023-12-09T02:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.566+0000 7fdecc73a700 1 -- 172.21.15.88:0/503803679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec40668c0 msgr2=0x7fdec410d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.567+0000 7fdecc73a700 1 --2- 172.21.15.88:0/503803679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec40668c0 0x7fdec410d570 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009360 tx=0x7fdec0009e30 comp rx=0 tx=0).stop 2023-12-09T02:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.567+0000 7fdecc73a700 1 -- 172.21.15.88:0/503803679 shutdown_connections 2023-12-09T02:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.567+0000 7fdecc73a700 1 --2- 172.21.15.88:0/503803679 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeb0068ed0 0x7fdeb006b380 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.567+0000 7fdecc73a700 1 --2- 172.21.15.88:0/503803679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec40668c0 0x7fdec410d570 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.567+0000 7fdecc73a700 1 --2- 172.21.15.88:0/503803679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdec40ffdd0 0x7fdec410dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.567+0000 7fdecc73a700 1 -- 172.21.15.88:0/503803679 >> 172.21.15.88:0/503803679 conn(0x7fdec40f71b0 msgr2=0x7fdec40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.567+0000 7fdecc73a700 1 -- 172.21.15.88:0/503803679 shutdown_connections 2023-12-09T02:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:31:01.567+0000 7fdecc73a700 1 -- 172.21.15.88:0/503803679 wait complete. 2023-12-09T02:31:02.073 DEBUG:teuthology.orchestra.run.smithi088:osd.2> sudo journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.2.service 2023-12-09T02:31:02.075 INFO:tasks.cephadm:Deploying osd.3 on smithi161 with /dev/vg_nvme/lv_4... 2023-12-09T02:31:02.075 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-09T02:31:02.109 INFO:journalctl@ceph.osd.2.smithi088.stdout:-- Logs begin at Sat 2023-12-09 02:05:57 UTC. -- 2023-12-09T02:31:02.341 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi161/config 2023-12-09T02:31:02.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:02 smithi088 ceph-mon[112028]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:31:02.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:02 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:02.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:02 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:02.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:02 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:31:02.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:02 smithi161 ceph-mon[121170]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:31:02.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:02 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:02.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:02 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:02.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:02 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:31:03.438 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:31:03 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[155282]: 2023-12-09T02:31:03.057+0000 7fe27ff45540 -1 osd.2 0 log_to_monitors true 2023-12-09T02:31:03.631 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-09T02:31:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-09T02:31:03.632 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2023-12-09T02:31:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2023-12-09T02:31:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109219 s, 960 MB/s 2023-12-09T02:31:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2023-12-09T02:31:04.033 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi161:vg_nvme/lv_4 2023-12-09T02:31:04.148 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:04.148 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:04.148 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:04 smithi088 ceph-mon[112028]: from='osd.2 [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-09T02:31:04.291 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi161/config 2023-12-09T02:31:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:04 smithi161 ceph-mon[121170]: from='osd.2 [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-09T02:31:05.163 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:05 smithi161 ceph-mon[121170]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:31:05.163 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:05 smithi161 ceph-mon[121170]: from='osd.2 [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-09T02:31:05.163 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:05 smithi161 ceph-mon[121170]: osdmap e17: 3 total, 2 up, 3 in 2023-12-09T02:31:05.163 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:05 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:31:05.163 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:05 smithi161 ceph-mon[121170]: from='osd.2 [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:31:05.327 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:05 smithi088 ceph-mon[112028]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:31:05.327 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:05 smithi088 ceph-mon[112028]: from='osd.2 [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-09T02:31:05.327 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:05 smithi088 ceph-mon[112028]: osdmap e17: 3 total, 2 up, 3 in 2023-12-09T02:31:05.327 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:05 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:31:05.327 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:05 smithi088 ceph-mon[112028]: from='osd.2 [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:31:05.327 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:31:05 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[155282]: 2023-12-09T02:31:05.057+0000 7fe27672a700 -1 osd.2 0 waiting for initial osdmap 2023-12-09T02:31:05.328 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:31:05 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[155282]: 2023-12-09T02:31:05.062+0000 7fe271525700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:31:05.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.373+0000 7fcf91c7b700 1 -- 172.21.15.161:0/376654713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c0fde00 msgr2=0x7fcf8c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:05.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.373+0000 7fcf91c7b700 1 --2- 172.21.15.161:0/376654713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c0fde00 0x7fcf8c0fe250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcf80004940 tx=0x7fcf80009e30 comp rx=0 tx=0).stop 2023-12-09T02:31:05.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.373+0000 7fcf91c7b700 1 -- 172.21.15.161:0/376654713 shutdown_connections 2023-12-09T02:31:05.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.373+0000 7fcf91c7b700 1 --2- 172.21.15.161:0/376654713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c0fde00 0x7fcf8c0fe250 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:05.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.373+0000 7fcf91c7b700 1 --2- 172.21.15.161:0/376654713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf8c0fcbf0 0x7fcf8c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:05.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.373+0000 7fcf91c7b700 1 -- 172.21.15.161:0/376654713 >> 172.21.15.161:0/376654713 conn(0x7fcf8c0f82d0 msgr2=0x7fcf8c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:31:05.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.373+0000 7fcf91c7b700 1 -- 172.21.15.161:0/376654713 shutdown_connections 2023-12-09T02:31:05.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.373+0000 7fcf91c7b700 1 -- 172.21.15.161:0/376654713 wait complete. 2023-12-09T02:31:05.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.373+0000 7fcf91c7b700 1 Processor -- start 2023-12-09T02:31:05.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.373+0000 7fcf91c7b700 1 -- start start 2023-12-09T02:31:05.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf91c7b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c0fcbf0 0x7fcf8c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:31:05.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf91c7b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf8c0fde00 0x7fcf8c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:31:05.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf91c7b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c10e010 con 0x7fcf8c0fcbf0 2023-12-09T02:31:05.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf91c7b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c10e8b0 con 0x7fcf8c0fde00 2023-12-09T02:31:05.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf8affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf8c0fde00 0x7fcf8c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:31:05.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf8affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf8c0fde00 0x7fcf8c10da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47358/0 (socket says 172.21.15.161:47358) 2023-12-09T02:31:05.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf8b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c0fcbf0 0x7fcf8c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:31:05.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf8affd700 1 -- 172.21.15.161:0/2708904877 learned_addr learned my addr 172.21.15.161:0/2708904877 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:31:05.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf8affd700 1 -- 172.21.15.161:0/2708904877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c0fcbf0 msgr2=0x7fcf8c10d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:05.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf8affd700 1 --2- 172.21.15.161:0/2708904877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c0fcbf0 0x7fcf8c10d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:05.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf8affd700 1 -- 172.21.15.161:0/2708904877 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c005040 con 0x7fcf8c0fde00 2023-12-09T02:31:05.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf8affd700 1 --2- 172.21.15.161:0/2708904877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf8c0fde00 0x7fcf8c10da10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcf80008f90 tx=0x7fcf80009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:31:05.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf73fff700 1 -- 172.21.15.161:0/2708904877 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf80021070 con 0x7fcf8c0fde00 2023-12-09T02:31:05.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf73fff700 1 -- 172.21.15.161:0/2708904877 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf8001c400 con 0x7fcf8c0fde00 2023-12-09T02:31:05.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf91c7b700 1 -- 172.21.15.161:0/2708904877 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf80005040 con 0x7fcf8c0fde00 2023-12-09T02:31:05.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf73fff700 1 -- 172.21.15.161:0/2708904877 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf8000e030 con 0x7fcf8c0fde00 2023-12-09T02:31:05.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.374+0000 7fcf91c7b700 1 -- 172.21.15.161:0/2708904877 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c10eee0 con 0x7fcf8c0fde00 2023-12-09T02:31:05.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.375+0000 7fcf91c7b700 1 -- 172.21.15.161:0/2708904877 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8c04bb80 con 0x7fcf8c0fde00 2023-12-09T02:31:05.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.376+0000 7fcf73fff700 1 -- 172.21.15.161:0/2708904877 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7fcf80013a30 con 0x7fcf8c0fde00 2023-12-09T02:31:05.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.376+0000 7fcf73fff700 1 --2- 172.21.15.161:0/2708904877 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcf74068ed0 0x7fcf7406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:31:05.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.376+0000 7fcf73fff700 1 -- 172.21.15.161:0/2708904877 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2562+0+0 (secure 0 0 0) 0x7fcf80087450 con 0x7fcf8c0fde00 2023-12-09T02:31:05.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.376+0000 7fcf8b7fe700 1 --2- 172.21.15.161:0/2708904877 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcf74068ed0 0x7fcf7406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:31:05.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.377+0000 7fcf8b7fe700 1 --2- 172.21.15.161:0/2708904877 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcf74068ed0 0x7fcf7406b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0fdc60 tx=0x7fcf7c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:31:05.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.381+0000 7fcf73fff700 1 -- 172.21.15.161:0/2708904877 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcf80057fe0 con 0x7fcf8c0fde00 2023-12-09T02:31:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:05.576+0000 7fcf91c7b700 1 -- 172.21.15.161:0/2708904877 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf8c10f330 con 0x7fcf74068ed0 2023-12-09T02:31:06.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: purged_snaps scrub starts 2023-12-09T02:31:06.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: purged_snaps scrub ok 2023-12-09T02:31:06.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='osd.2 [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-12-09T02:31:06.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: osdmap e18: 3 total, 2 up, 3 in 2023-12-09T02:31:06.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:31:06.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:31:06.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:06.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:06.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:06.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:06.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:06 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:31:06.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: purged_snaps scrub starts 2023-12-09T02:31:06.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: purged_snaps scrub ok 2023-12-09T02:31:06.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='osd.2 [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-12-09T02:31:06.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: osdmap e18: 3 total, 2 up, 3 in 2023-12-09T02:31:06.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:31:06.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:31:06.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:06.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:06.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:06.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:06.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:06.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:06.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:06.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:06.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:06.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:06.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:06.479 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:06.479 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:06.479 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:31:06.479 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:31:06.479 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:06.479 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:06 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:31:07.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:07 smithi161 ceph-mon[121170]: Detected new or changed devices on smithi088 2023-12-09T02:31:07.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:07 smithi161 ceph-mon[121170]: Adjusting osd_memory_target on smithi088 to 4299M 2023-12-09T02:31:07.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:07 smithi161 ceph-mon[121170]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:31:07.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:07 smithi161 ceph-mon[121170]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:31:07.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:07 smithi161 ceph-mon[121170]: osd.2 [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803] boot 2023-12-09T02:31:07.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:07 smithi161 ceph-mon[121170]: osdmap e19: 3 total, 3 up, 3 in 2023-12-09T02:31:07.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:07 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:31:07.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:07 smithi088 ceph-mon[112028]: Detected new or changed devices on smithi088 2023-12-09T02:31:07.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:07 smithi088 ceph-mon[112028]: Adjusting osd_memory_target on smithi088 to 4299M 2023-12-09T02:31:07.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:07 smithi088 ceph-mon[112028]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-09T02:31:07.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:07 smithi088 ceph-mon[112028]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:31:07.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:07 smithi088 ceph-mon[112028]: osd.2 [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803] boot 2023-12-09T02:31:07.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:07 smithi088 ceph-mon[112028]: osdmap e19: 3 total, 3 up, 3 in 2023-12-09T02:31:07.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:07 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:31:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:08 smithi161 ceph-mon[121170]: osdmap e20: 3 total, 3 up, 3 in 2023-12-09T02:31:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:08 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/3333745740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6584d86c-84e6-4f9e-a481-d297f6892df8"}]: dispatch 2023-12-09T02:31:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:08 smithi161 ceph-mon[121170]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6584d86c-84e6-4f9e-a481-d297f6892df8"}]: dispatch 2023-12-09T02:31:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:08 smithi161 ceph-mon[121170]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6584d86c-84e6-4f9e-a481-d297f6892df8"}]': finished 2023-12-09T02:31:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:08 smithi161 ceph-mon[121170]: osdmap e21: 4 total, 3 up, 4 in 2023-12-09T02:31:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:08 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:08 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-09T02:31:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:08 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/2078907983' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:31:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:08 smithi088 ceph-mon[112028]: osdmap e20: 3 total, 3 up, 3 in 2023-12-09T02:31:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:08 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/3333745740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6584d86c-84e6-4f9e-a481-d297f6892df8"}]: dispatch 2023-12-09T02:31:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:08 smithi088 ceph-mon[112028]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6584d86c-84e6-4f9e-a481-d297f6892df8"}]: dispatch 2023-12-09T02:31:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:08 smithi088 ceph-mon[112028]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6584d86c-84e6-4f9e-a481-d297f6892df8"}]': finished 2023-12-09T02:31:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:08 smithi088 ceph-mon[112028]: osdmap e21: 4 total, 3 up, 4 in 2023-12-09T02:31:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:08 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:08.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:08 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-09T02:31:08.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:08 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/2078907983' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:31:09.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:09 smithi161 ceph-mon[121170]: pgmap v57: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-09T02:31:09.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:09 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-09T02:31:09.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:09 smithi161 ceph-mon[121170]: osdmap e22: 4 total, 3 up, 4 in 2023-12-09T02:31:09.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:09 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:09.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:09 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-09T02:31:09.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:09 smithi088 ceph-mon[112028]: pgmap v57: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-09T02:31:09.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:09 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-09T02:31:09.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:09 smithi088 ceph-mon[112028]: osdmap e22: 4 total, 3 up, 4 in 2023-12-09T02:31:09.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:09 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:09.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:09 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-09T02:31:10.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:10 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-09T02:31:10.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:10 smithi088 ceph-mon[112028]: osdmap e23: 4 total, 3 up, 4 in 2023-12-09T02:31:10.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:10 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:10.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:10 smithi088 ceph-mon[112028]: pgmap v60: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-09T02:31:10.638 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161208]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-09T02:31:10.638 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161208]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-09T02:31:10.638 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161208]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-09T02:31:10.638 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161208]: pam_unix(sudo:session): session closed for user root 2023-12-09T02:31:10.899 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161211]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-09T02:31:10.900 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161211]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-09T02:31:10.900 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161211]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-09T02:31:10.900 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161211]: pam_unix(sudo:session): session closed for user root 2023-12-09T02:31:10.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:10 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-09T02:31:10.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:10 smithi161 ceph-mon[121170]: osdmap e23: 4 total, 3 up, 4 in 2023-12-09T02:31:10.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:10 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:10.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:10 smithi161 ceph-mon[121170]: pgmap v60: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-09T02:31:11.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161214]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-09T02:31:11.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161214]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-09T02:31:11.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161214]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-09T02:31:11.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:31:10 smithi088 sudo[161214]: pam_unix(sudo:session): session closed for user root 2023-12-09T02:31:11.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161217]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-09T02:31:11.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161217]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-09T02:31:11.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161217]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-09T02:31:11.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161217]: pam_unix(sudo:session): session closed for user root 2023-12-09T02:31:11.633 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:11 smithi088 ceph-mon[112028]: osdmap e24: 4 total, 3 up, 4 in 2023-12-09T02:31:11.633 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:11 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:11.633 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:11 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:11.633 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161220]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-09T02:31:11.633 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161220]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-09T02:31:11.633 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161220]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-09T02:31:11.634 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161220]: pam_unix(sudo:session): session closed for user root 2023-12-09T02:31:11.640 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:11 smithi161 ceph-mon[121170]: osdmap e24: 4 total, 3 up, 4 in 2023-12-09T02:31:11.640 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:11 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:11.640 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:11 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:11.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161226]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-09T02:31:11.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161226]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-09T02:31:11.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161226]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-09T02:31:11.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161226]: pam_unix(sudo:session): session closed for user root 2023-12-09T02:31:11.885 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161223]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-09T02:31:11.885 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161223]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-09T02:31:11.885 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161223]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-09T02:31:11.885 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:31:11 smithi088 sudo[161223]: pam_unix(sudo:session): session closed for user root 2023-12-09T02:31:12.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:12 smithi088 sudo[161229]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-09T02:31:12.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:12 smithi088 sudo[161229]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-09T02:31:12.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:12 smithi088 sudo[161229]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-09T02:31:12.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:12 smithi088 sudo[161229]: pam_unix(sudo:session): session closed for user root 2023-12-09T02:31:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 sudo[126762]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-09T02:31:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 sudo[126762]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-09T02:31:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 sudo[126762]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-09T02:31:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 sudo[126762]: pam_unix(sudo:session): session closed for user root 2023-12-09T02:31:12.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:12.626+0000 7fcf73fff700 1 -- 172.21.15.161:0/2708904877 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcf8001ca00 con 0x7fcf8c0fde00 2023-12-09T02:31:12.869 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 sudo[126784]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-09T02:31:12.869 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 sudo[126784]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-09T02:31:12.869 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 sudo[126784]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-09T02:31:12.869 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 sudo[126784]: pam_unix(sudo:session): session closed for user root 2023-12-09T02:31:12.869 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 ceph-mon[121170]: pgmap v62: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-09T02:31:12.870 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 ceph-mon[121170]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-09T02:31:12.870 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 ceph-mon[121170]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-09T02:31:12.870 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:31:12.870 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:31:12.870 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:31:12.870 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:12 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:31:12.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:12 smithi088 ceph-mon[112028]: pgmap v62: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-09T02:31:12.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:12 smithi088 ceph-mon[112028]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-09T02:31:12.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:12 smithi088 ceph-mon[112028]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-09T02:31:12.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:12 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:31:12.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:12 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:31:12.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:12 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:31:12.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:12 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:31:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:13 smithi161 ceph-mon[121170]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-09T02:31:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:13 smithi161 ceph-mon[121170]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-09T02:31:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:13 smithi161 ceph-mon[121170]: mgrmap e19: smithi088.jwlofb(active, since 101s), standbys: smithi161.qmxtmg 2023-12-09T02:31:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:13 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:13 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-09T02:31:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:13 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:13.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:13 smithi088 ceph-mon[112028]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-09T02:31:13.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:13 smithi088 ceph-mon[112028]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-09T02:31:13.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:13 smithi088 ceph-mon[112028]: mgrmap e19: smithi088.jwlofb(active, since 101s), standbys: smithi161.qmxtmg 2023-12-09T02:31:13.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:13 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:13.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:13 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-09T02:31:13.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:13 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:14 smithi088 ceph-mon[112028]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-09T02:31:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:14 smithi088 ceph-mon[112028]: Deploying daemon osd.3 on smithi161 2023-12-09T02:31:15.160 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:14 smithi161 ceph-mon[121170]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-09T02:31:15.160 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:14 smithi161 ceph-mon[121170]: Deploying daemon osd.3 on smithi161 2023-12-09T02:31:16.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:16 smithi161 ceph-mon[121170]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-09T02:31:16.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:31:16.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:16 smithi088 ceph-mon[112028]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-09T02:31:16.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:31:18.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:18 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:18.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:18 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:18.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:18 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:18.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:18 smithi161 ceph-mon[121170]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-12-09T02:31:18.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:18 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:18.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:18 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:18.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:18 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:18.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:18 smithi088 ceph-mon[112028]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-12-09T02:31:19.830 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 3 on host 'smithi161' 2023-12-09T02:31:19.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.827+0000 7fcf73fff700 1 -- 172.21.15.161:0/2708904877 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcf8c10f330 con 0x7fcf74068ed0 2023-12-09T02:31:19.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.830+0000 7fcf91c7b700 1 -- 172.21.15.161:0/2708904877 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcf74068ed0 msgr2=0x7fcf7406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:19.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.830+0000 7fcf91c7b700 1 --2- 172.21.15.161:0/2708904877 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcf74068ed0 0x7fcf7406b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0fdc60 tx=0x7fcf7c00b040 comp rx=0 tx=0).stop 2023-12-09T02:31:19.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.830+0000 7fcf91c7b700 1 -- 172.21.15.161:0/2708904877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf8c0fde00 msgr2=0x7fcf8c10da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:19.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.830+0000 7fcf91c7b700 1 --2- 172.21.15.161:0/2708904877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf8c0fde00 0x7fcf8c10da10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcf80008f90 tx=0x7fcf80009e30 comp rx=0 tx=0).stop 2023-12-09T02:31:19.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.830+0000 7fcf91c7b700 1 -- 172.21.15.161:0/2708904877 shutdown_connections 2023-12-09T02:31:19.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.830+0000 7fcf91c7b700 1 --2- 172.21.15.161:0/2708904877 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcf74068ed0 0x7fcf7406b380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:19.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.830+0000 7fcf91c7b700 1 --2- 172.21.15.161:0/2708904877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c0fcbf0 0x7fcf8c10d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:19.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.830+0000 7fcf91c7b700 1 --2- 172.21.15.161:0/2708904877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf8c0fde00 0x7fcf8c10da10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:19.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.830+0000 7fcf91c7b700 1 -- 172.21.15.161:0/2708904877 >> 172.21.15.161:0/2708904877 conn(0x7fcf8c0f82d0 msgr2=0x7fcf8c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:31:19.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.830+0000 7fcf91c7b700 1 -- 172.21.15.161:0/2708904877 shutdown_connections 2023-12-09T02:31:19.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:19.830+0000 7fcf91c7b700 1 -- 172.21.15.161:0/2708904877 wait complete. 2023-12-09T02:31:20.223 DEBUG:teuthology.orchestra.run.smithi161:osd.3> sudo journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.3.service 2023-12-09T02:31:20.225 INFO:tasks.cephadm:Deploying osd.4 on smithi161 with /dev/vg_nvme/lv_3... 2023-12-09T02:31:20.226 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-09T02:31:20.258 INFO:journalctl@ceph.osd.3.smithi161.stdout:-- Logs begin at Sat 2023-12-09 02:10:06 UTC. -- 2023-12-09T02:31:20.782 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi161/config 2023-12-09T02:31:20.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:20 smithi161 ceph-mon[121170]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-09T02:31:20.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:20 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:20.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:20 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:20.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:20 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:20.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:20 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:20 smithi088 ceph-mon[112028]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-09T02:31:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:20 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:20 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:20 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:20 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:21.260 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:31:21 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[127528]: 2023-12-09T02:31:21.243+0000 7f7ceb43d540 -1 osd.3 0 log_to_monitors true 2023-12-09T02:31:21.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:21 smithi161 ceph-mon[121170]: from='osd.3 [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-09T02:31:21.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:21 smithi161 ceph-mon[121170]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-09T02:31:22.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:21 smithi088 ceph-mon[112028]: from='osd.3 [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-09T02:31:22.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:21 smithi088 ceph-mon[112028]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-09T02:31:22.474 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-09T02:31:22.474 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-09T02:31:22.474 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2023-12-09T02:31:22.475 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2023-12-09T02:31:22.475 INFO:teuthology.orchestra.run.smithi161.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010927 s, 960 MB/s 2023-12-09T02:31:22.475 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2023-12-09T02:31:22.920 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[127528]: 2023-12-09T02:31:22.793+0000 7f7ce1c22700 -1 osd.3 0 waiting for initial osdmap 2023-12-09T02:31:22.920 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[127528]: 2023-12-09T02:31:22.799+0000 7f7cdd21e700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:31:22.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-09T02:31:22.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-09T02:31:22.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: osdmap e25: 4 total, 3 up, 4 in 2023-12-09T02:31:22.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:22.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: from='osd.3 [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:31:22.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:31:22.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:22.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:22.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:22.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:22.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:22.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:22.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:22 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:23.048 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi161:vg_nvme/lv_3 2023-12-09T02:31:23.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-09T02:31:23.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-09T02:31:23.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: osdmap e25: 4 total, 3 up, 4 in 2023-12-09T02:31:23.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:23.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: from='osd.3 [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:31:23.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:31:23.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:23.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:23.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:23.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:23.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:23.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:23.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:22 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:23.308 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi161/config 2023-12-09T02:31:24.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: Detected new or changed devices on smithi161 2023-12-09T02:31:24.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: Adjusting osd_memory_target on smithi161 to 15970M 2023-12-09T02:31:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-12-09T02:31:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: osdmap e26: 4 total, 3 up, 4 in 2023-12-09T02:31:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: osd.3 [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356] boot 2023-12-09T02:31:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: osdmap e27: 4 total, 4 up, 4 in 2023-12-09T02:31:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:23 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: Detected new or changed devices on smithi161 2023-12-09T02:31:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: Adjusting osd_memory_target on smithi161 to 15970M 2023-12-09T02:31:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-12-09T02:31:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: osdmap e26: 4 total, 3 up, 4 in 2023-12-09T02:31:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: osd.3 [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356] boot 2023-12-09T02:31:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: osdmap e27: 4 total, 4 up, 4 in 2023-12-09T02:31:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:23 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:31:24.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.358+0000 7fcb668e4700 1 -- 172.21.15.161:0/2698701133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb600fcd00 msgr2=0x7fcb600fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:24.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.358+0000 7fcb668e4700 1 --2- 172.21.15.161:0/2698701133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb600fcd00 0x7fcb600fd150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcb50004940 tx=0x7fcb50009e30 comp rx=0 tx=0).stop 2023-12-09T02:31:24.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.358+0000 7fcb668e4700 1 -- 172.21.15.161:0/2698701133 shutdown_connections 2023-12-09T02:31:24.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.358+0000 7fcb668e4700 1 --2- 172.21.15.161:0/2698701133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb600fcd00 0x7fcb600fd150 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:24.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.358+0000 7fcb668e4700 1 --2- 172.21.15.161:0/2698701133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb600fbaf0 0x7fcb600fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:24.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.358+0000 7fcb668e4700 1 -- 172.21.15.161:0/2698701133 >> 172.21.15.161:0/2698701133 conn(0x7fcb600f7190 msgr2=0x7fcb600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:31:24.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.358+0000 7fcb668e4700 1 -- 172.21.15.161:0/2698701133 shutdown_connections 2023-12-09T02:31:24.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.358+0000 7fcb668e4700 1 -- 172.21.15.161:0/2698701133 wait complete. 2023-12-09T02:31:24.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.359+0000 7fcb668e4700 1 Processor -- start 2023-12-09T02:31:24.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.359+0000 7fcb668e4700 1 -- start start 2023-12-09T02:31:24.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.359+0000 7fcb668e4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb600fbaf0 0x7fcb600ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:31:24.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.359+0000 7fcb668e4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb600fcd00 0x7fcb600fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:31:24.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.359+0000 7fcb668e4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600fe6d0 con 0x7fcb600fcd00 2023-12-09T02:31:24.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.359+0000 7fcb668e4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600fe840 con 0x7fcb600fbaf0 2023-12-09T02:31:24.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.359+0000 7fcb5ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb600fbaf0 0x7fcb600ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:31:24.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.359+0000 7fcb5ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb600fbaf0 0x7fcb600ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56062/0 (socket says 172.21.15.161:56062) 2023-12-09T02:31:24.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.359+0000 7fcb5ffff700 1 -- 172.21.15.161:0/184994831 learned_addr learned my addr 172.21.15.161:0/184994831 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:31:24.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.360+0000 7fcb5f7fe700 1 --2- 172.21.15.161:0/184994831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb600fcd00 0x7fcb600fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:31:24.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.360+0000 7fcb5ffff700 1 -- 172.21.15.161:0/184994831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb600fcd00 msgr2=0x7fcb600fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:24.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.360+0000 7fcb5ffff700 1 --2- 172.21.15.161:0/184994831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb600fcd00 0x7fcb600fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:24.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.360+0000 7fcb5ffff700 1 -- 172.21.15.161:0/184994831 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50005040 con 0x7fcb600fbaf0 2023-12-09T02:31:24.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.360+0000 7fcb5ffff700 1 --2- 172.21.15.161:0/184994831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb600fbaf0 0x7fcb600ffbc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400b790 tx=0x7fcb54009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:31:24.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.360+0000 7fcb5cff9700 1 -- 172.21.15.161:0/184994831 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5400f6f0 con 0x7fcb600fbaf0 2023-12-09T02:31:24.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.360+0000 7fcb668e4700 1 -- 172.21.15.161:0/184994831 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb600feb20 con 0x7fcb600fbaf0 2023-12-09T02:31:24.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.360+0000 7fcb5cff9700 1 -- 172.21.15.161:0/184994831 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb5400fd00 con 0x7fcb600fbaf0 2023-12-09T02:31:24.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.360+0000 7fcb5cff9700 1 -- 172.21.15.161:0/184994831 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb540103a0 con 0x7fcb600fbaf0 2023-12-09T02:31:24.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.360+0000 7fcb668e4700 1 -- 172.21.15.161:0/184994831 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb600feea0 con 0x7fcb600fbaf0 2023-12-09T02:31:24.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.361+0000 7fcb668e4700 1 -- 172.21.15.161:0/184994831 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6004bb80 con 0x7fcb600fbaf0 2023-12-09T02:31:24.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.362+0000 7fcb5cff9700 1 -- 172.21.15.161:0/184994831 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcb5400f850 con 0x7fcb600fbaf0 2023-12-09T02:31:24.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.362+0000 7fcb5cff9700 1 --2- 172.21.15.161:0/184994831 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb48068f60 0x7fcb4806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:31:24.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.362+0000 7fcb5cff9700 1 -- 172.21.15.161:0/184994831 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3803+0+0 (secure 0 0 0) 0x7fcb54086550 con 0x7fcb600fbaf0 2023-12-09T02:31:24.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.362+0000 7fcb5f7fe700 1 --2- 172.21.15.161:0/184994831 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb48068f60 0x7fcb4806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:31:24.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.363+0000 7fcb5f7fe700 1 --2- 172.21.15.161:0/184994831 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb48068f60 0x7fcb4806b410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcb50004560 tx=0x7fcb50009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:31:24.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.367+0000 7fcb5cff9700 1 -- 172.21.15.161:0/184994831 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcb54056ab0 con 0x7fcb600fbaf0 2023-12-09T02:31:24.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:24.557+0000 7fcb668e4700 1 -- 172.21.15.161:0/184994831 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb60065a80 con 0x7fcb48068f60 2023-12-09T02:31:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:24 smithi161 ceph-mon[121170]: purged_snaps scrub starts 2023-12-09T02:31:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:24 smithi161 ceph-mon[121170]: purged_snaps scrub ok 2023-12-09T02:31:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:24 smithi161 ceph-mon[121170]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-09T02:31:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:24 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:31:25.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:24 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:31:25.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:24 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:25.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:24 smithi161 ceph-mon[121170]: osdmap e28: 4 total, 4 up, 4 in 2023-12-09T02:31:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:24 smithi088 ceph-mon[112028]: purged_snaps scrub starts 2023-12-09T02:31:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:24 smithi088 ceph-mon[112028]: purged_snaps scrub ok 2023-12-09T02:31:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:24 smithi088 ceph-mon[112028]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-09T02:31:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:24 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:31:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:24 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:31:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:24 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:24 smithi088 ceph-mon[112028]: osdmap e28: 4 total, 4 up, 4 in 2023-12-09T02:31:26.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:25 smithi161 ceph-mon[121170]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:31:26.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:25 smithi161 ceph-mon[121170]: osdmap e29: 4 total, 4 up, 4 in 2023-12-09T02:31:26.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:25 smithi088 ceph-mon[112028]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:31:26.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:25 smithi088 ceph-mon[112028]: osdmap e29: 4 total, 4 up, 4 in 2023-12-09T02:31:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:26 smithi161 ceph-mon[121170]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-09T02:31:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:26 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/4213099968' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "729b6d7a-8045-40d4-b07d-aa8d8912a357"}]: dispatch 2023-12-09T02:31:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:26 smithi161 ceph-mon[121170]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "729b6d7a-8045-40d4-b07d-aa8d8912a357"}]: dispatch 2023-12-09T02:31:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:26 smithi161 ceph-mon[121170]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "729b6d7a-8045-40d4-b07d-aa8d8912a357"}]': finished 2023-12-09T02:31:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:26 smithi161 ceph-mon[121170]: osdmap e30: 5 total, 4 up, 5 in 2023-12-09T02:31:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:26 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:27.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:26 smithi088 ceph-mon[112028]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-09T02:31:27.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:26 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/4213099968' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "729b6d7a-8045-40d4-b07d-aa8d8912a357"}]: dispatch 2023-12-09T02:31:27.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:26 smithi088 ceph-mon[112028]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "729b6d7a-8045-40d4-b07d-aa8d8912a357"}]: dispatch 2023-12-09T02:31:27.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:26 smithi088 ceph-mon[112028]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "729b6d7a-8045-40d4-b07d-aa8d8912a357"}]': finished 2023-12-09T02:31:27.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:26 smithi088 ceph-mon[112028]: osdmap e30: 5 total, 4 up, 5 in 2023-12-09T02:31:27.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:26 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:28.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:27 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/3839685751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:31:28.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:27 smithi161 ceph-mon[121170]: osdmap e31: 5 total, 4 up, 5 in 2023-12-09T02:31:28.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:27 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:28.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:27 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/3839685751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:31:28.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:27 smithi088 ceph-mon[112028]: osdmap e31: 5 total, 4 up, 5 in 2023-12-09T02:31:28.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:27 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:29.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:28 smithi161 ceph-mon[121170]: pgmap v77: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 150 KiB/s, 0 objects/s recovering 2023-12-09T02:31:29.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:28 smithi088 ceph-mon[112028]: pgmap v77: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 150 KiB/s, 0 objects/s recovering 2023-12-09T02:31:31.147 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:30 smithi161 ceph-mon[121170]: pgmap v78: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 119 KiB/s, 0 objects/s recovering 2023-12-09T02:31:31.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:30 smithi088 ceph-mon[112028]: pgmap v78: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 119 KiB/s, 0 objects/s recovering 2023-12-09T02:31:32.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:31 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:31:32.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:31:33.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:32 smithi161 ceph-mon[121170]: pgmap v79: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-09T02:31:33.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:32 smithi088 ceph-mon[112028]: pgmap v79: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-09T02:31:34.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:33 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-09T02:31:34.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:33 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:34.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:33 smithi161 ceph-mon[121170]: Deploying daemon osd.4 on smithi161 2023-12-09T02:31:34.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:33 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-09T02:31:34.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:33 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:34.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:33 smithi088 ceph-mon[112028]: Deploying daemon osd.4 on smithi161 2023-12-09T02:31:35.088 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:34 smithi161 ceph-mon[121170]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-12-09T02:31:35.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:34 smithi088 ceph-mon[112028]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-12-09T02:31:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:36 smithi161 ceph-mon[121170]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-12-09T02:31:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:36 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:36 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:36 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:36 smithi088 ceph-mon[112028]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-12-09T02:31:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:36 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:36 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:36 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:39.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:38 smithi161 ceph-mon[121170]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-09T02:31:39.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:38 smithi088 ceph-mon[112028]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-09T02:31:39.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.411+0000 7fcb5cff9700 1 -- 172.21.15.161:0/184994831 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcb60065a80 con 0x7fcb48068f60 2023-12-09T02:31:39.414 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 4 on host 'smithi161' 2023-12-09T02:31:39.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.413+0000 7fcb668e4700 1 -- 172.21.15.161:0/184994831 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb48068f60 msgr2=0x7fcb4806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:39.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.413+0000 7fcb668e4700 1 --2- 172.21.15.161:0/184994831 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb48068f60 0x7fcb4806b410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcb50004560 tx=0x7fcb50009e30 comp rx=0 tx=0).stop 2023-12-09T02:31:39.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.414+0000 7fcb668e4700 1 -- 172.21.15.161:0/184994831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb600fbaf0 msgr2=0x7fcb600ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.414+0000 7fcb668e4700 1 --2- 172.21.15.161:0/184994831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb600fbaf0 0x7fcb600ffbc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400b790 tx=0x7fcb54009220 comp rx=0 tx=0).stop 2023-12-09T02:31:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.414+0000 7fcb668e4700 1 -- 172.21.15.161:0/184994831 shutdown_connections 2023-12-09T02:31:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.414+0000 7fcb668e4700 1 --2- 172.21.15.161:0/184994831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb600fbaf0 0x7fcb600ffbc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.414+0000 7fcb668e4700 1 --2- 172.21.15.161:0/184994831 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb48068f60 0x7fcb4806b410 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.414+0000 7fcb668e4700 1 --2- 172.21.15.161:0/184994831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb600fcd00 0x7fcb600fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.414+0000 7fcb668e4700 1 -- 172.21.15.161:0/184994831 >> 172.21.15.161:0/184994831 conn(0x7fcb600f7190 msgr2=0x7fcb60065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:31:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.414+0000 7fcb668e4700 1 -- 172.21.15.161:0/184994831 shutdown_connections 2023-12-09T02:31:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:39.414+0000 7fcb668e4700 1 -- 172.21.15.161:0/184994831 wait complete. 2023-12-09T02:31:39.807 DEBUG:teuthology.orchestra.run.smithi161:osd.4> sudo journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.4.service 2023-12-09T02:31:39.809 INFO:tasks.cephadm:Deploying osd.5 on smithi161 with /dev/vg_nvme/lv_2... 2023-12-09T02:31:39.809 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-09T02:31:39.843 INFO:journalctl@ceph.osd.4.smithi161.stdout:-- Logs begin at Sat 2023-12-09 02:10:06 UTC. -- 2023-12-09T02:31:40.309 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi161/config 2023-12-09T02:31:40.353 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:40.353 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:40.353 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:40.353 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:40.353 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:40.354 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:40.354 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:40.354 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:40 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:40.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:40 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:40.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:40 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:40.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:40 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:40.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:40 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:40.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:40 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:40.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:40 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:40.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:40 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:40.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:40 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:40.729 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:31:40 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[136283]: 2023-12-09T02:31:40.702+0000 7f970e33f540 -1 osd.4 0 log_to_monitors true 2023-12-09T02:31:41.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:41 smithi161 ceph-mon[121170]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-09T02:31:41.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:41 smithi161 ceph-mon[121170]: from='osd.4 [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-09T02:31:41.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:41 smithi161 ceph-mon[121170]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-09T02:31:41.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:41 smithi088 ceph-mon[112028]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-09T02:31:41.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:41 smithi088 ceph-mon[112028]: from='osd.4 [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-09T02:31:41.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:41 smithi088 ceph-mon[112028]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-09T02:31:41.987 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-09T02:31:41.987 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-09T02:31:41.987 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2023-12-09T02:31:41.987 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2023-12-09T02:31:41.987 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0150665 s, 696 MB/s 2023-12-09T02:31:41.987 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2023-12-09T02:31:42.438 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi161:vg_nvme/lv_2 2023-12-09T02:31:42.661 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:31:42 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[136283]: 2023-12-09T02:31:42.382+0000 7f9704b24700 -1 osd.4 0 waiting for initial osdmap 2023-12-09T02:31:42.661 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:31:42 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[136283]: 2023-12-09T02:31:42.389+0000 7f96ff91f700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:31:42.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:42 smithi161 ceph-mon[121170]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-09T02:31:42.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:42 smithi161 ceph-mon[121170]: osdmap e32: 5 total, 4 up, 5 in 2023-12-09T02:31:42.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:42 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:42.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:42 smithi161 ceph-mon[121170]: from='osd.4 [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:31:42.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:42 smithi161 ceph-mon[121170]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:31:42.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:42 smithi161 ceph-mon[121170]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-09T02:31:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:42 smithi088 ceph-mon[112028]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-09T02:31:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:42 smithi088 ceph-mon[112028]: osdmap e32: 5 total, 4 up, 5 in 2023-12-09T02:31:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:42 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:42 smithi088 ceph-mon[112028]: from='osd.4 [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:31:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:42 smithi088 ceph-mon[112028]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:31:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:42 smithi088 ceph-mon[112028]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-09T02:31:42.753 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi161/config 2023-12-09T02:31:43.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-12-09T02:31:43.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: osdmap e33: 5 total, 4 up, 5 in 2023-12-09T02:31:43.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:43.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:43.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:43.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:43.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:43.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:43.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:43.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:43.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:43.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:43.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: osd.4 [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150] boot 2023-12-09T02:31:43.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: osdmap e34: 5 total, 5 up, 5 in 2023-12-09T02:31:43.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:43 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:43.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-12-09T02:31:43.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: osdmap e33: 5 total, 4 up, 5 in 2023-12-09T02:31:43.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: osd.4 [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150] boot 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: osdmap e34: 5 total, 5 up, 5 in 2023-12-09T02:31:43.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:43 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:31:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 -- 172.21.15.161:0/107109381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d80fbaf0 msgr2=0x7f08d80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 --2- 172.21.15.161:0/107109381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d80fbaf0 0x7f08d80fbf00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f08c8004940 tx=0x7f08c8009e30 comp rx=0 tx=0).stop 2023-12-09T02:31:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 -- 172.21.15.161:0/107109381 shutdown_connections 2023-12-09T02:31:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 --2- 172.21.15.161:0/107109381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08d80fcd00 0x7f08d80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 --2- 172.21.15.161:0/107109381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d80fbaf0 0x7f08d80fbf00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 -- 172.21.15.161:0/107109381 >> 172.21.15.161:0/107109381 conn(0x7f08d80f7190 msgr2=0x7f08d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:31:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 -- 172.21.15.161:0/107109381 shutdown_connections 2023-12-09T02:31:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 -- 172.21.15.161:0/107109381 wait complete. 2023-12-09T02:31:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 Processor -- start 2023-12-09T02:31:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 -- start start 2023-12-09T02:31:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08d80fbaf0 0x7f08d810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:31:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d80fcd00 0x7f08d810db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:31:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d810e130 con 0x7f08d80fbaf0 2023-12-09T02:31:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.798+0000 7f08e0077700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d810e9d0 con 0x7f08d80fcd00 2023-12-09T02:31:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08dd612700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d80fcd00 0x7f08d810db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08dd612700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d80fcd00 0x7f08d810db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47904/0 (socket says 172.21.15.161:47904) 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08dd612700 1 -- 172.21.15.161:0/3784169124 learned_addr learned my addr 172.21.15.161:0/3784169124 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08dde13700 1 --2- 172.21.15.161:0/3784169124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08d80fbaf0 0x7f08d810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08dd612700 1 -- 172.21.15.161:0/3784169124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08d80fbaf0 msgr2=0x7f08d810d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08dd612700 1 --2- 172.21.15.161:0/3784169124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08d80fbaf0 0x7f08d810d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08dd612700 1 -- 172.21.15.161:0/3784169124 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c8005040 con 0x7f08d80fcd00 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08dd612700 1 --2- 172.21.15.161:0/3784169124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d80fcd00 0x7f08d810db30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f08d4002a50 tx=0x7f08d40046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08ce7fc700 1 -- 172.21.15.161:0/3784169124 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d4007cc0 con 0x7f08d80fcd00 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08ce7fc700 1 -- 172.21.15.161:0/3784169124 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f08d400f040 con 0x7f08d80fcd00 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08e0077700 1 -- 172.21.15.161:0/3784169124 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d810ecb0 con 0x7f08d80fcd00 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08ce7fc700 1 -- 172.21.15.161:0/3784169124 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d400d9c0 con 0x7f08d80fcd00 2023-12-09T02:31:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.799+0000 7f08e0077700 1 -- 172.21.15.161:0/3784169124 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d810f1f0 con 0x7f08d80fcd00 2023-12-09T02:31:43.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.800+0000 7f08e0077700 1 -- 172.21.15.161:0/3784169124 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d804bb80 con 0x7f08d80fcd00 2023-12-09T02:31:43.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.800+0000 7f08ce7fc700 1 -- 172.21.15.161:0/3784169124 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f08d400db60 con 0x7f08d80fcd00 2023-12-09T02:31:43.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.801+0000 7f08ce7fc700 1 --2- 172.21.15.161:0/3784169124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f08c4068f60 0x7f08c406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:31:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.801+0000 7f08ce7fc700 1 -- 172.21.15.161:0/3784169124 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f08d4085f30 con 0x7f08d80fcd00 2023-12-09T02:31:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.801+0000 7f08dde13700 1 --2- 172.21.15.161:0/3784169124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f08c4068f60 0x7f08c406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:31:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.802+0000 7f08dde13700 1 --2- 172.21.15.161:0/3784169124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f08c4068f60 0x7f08c406b410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08c8004890 tx=0x7f08c8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:31:43.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.805+0000 7f08ce7fc700 1 -- 172.21.15.161:0/3784169124 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f08d404ca00 con 0x7f08d80fcd00 2023-12-09T02:31:44.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:43.998+0000 7f08e0077700 1 -- 172.21.15.161:0/3784169124 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f08d810f600 con 0x7f08c4068f60 2023-12-09T02:31:44.941 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:44 smithi161 ceph-mon[121170]: purged_snaps scrub starts 2023-12-09T02:31:44.941 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:44 smithi161 ceph-mon[121170]: purged_snaps scrub ok 2023-12-09T02:31:44.941 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:44 smithi161 ceph-mon[121170]: Detected new or changed devices on smithi161 2023-12-09T02:31:44.941 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:44 smithi161 ceph-mon[121170]: Adjusting osd_memory_target on smithi161 to 7985M 2023-12-09T02:31:44.941 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:44 smithi161 ceph-mon[121170]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:44.942 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:44 smithi161 ceph-mon[121170]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:31:44.942 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:44 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:31:44.942 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:44 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:31:44.942 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:44 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:44.942 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:44 smithi161 ceph-mon[121170]: osdmap e35: 5 total, 5 up, 5 in 2023-12-09T02:31:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:44 smithi088 ceph-mon[112028]: purged_snaps scrub starts 2023-12-09T02:31:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:44 smithi088 ceph-mon[112028]: purged_snaps scrub ok 2023-12-09T02:31:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:44 smithi088 ceph-mon[112028]: Detected new or changed devices on smithi161 2023-12-09T02:31:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:44 smithi088 ceph-mon[112028]: Adjusting osd_memory_target on smithi161 to 7985M 2023-12-09T02:31:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:44 smithi088 ceph-mon[112028]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:44 smithi088 ceph-mon[112028]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:31:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-09T02:31:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-09T02:31:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:44 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:44 smithi088 ceph-mon[112028]: osdmap e35: 5 total, 5 up, 5 in 2023-12-09T02:31:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:46 smithi088 ceph-mon[112028]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:46 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/2351092776' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "973d7656-a340-4dc0-a2df-7cd3c96df604"}]: dispatch 2023-12-09T02:31:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:46 smithi088 ceph-mon[112028]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "973d7656-a340-4dc0-a2df-7cd3c96df604"}]: dispatch 2023-12-09T02:31:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:46 smithi088 ceph-mon[112028]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "973d7656-a340-4dc0-a2df-7cd3c96df604"}]': finished 2023-12-09T02:31:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:46 smithi088 ceph-mon[112028]: osdmap e36: 6 total, 5 up, 6 in 2023-12-09T02:31:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:31:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:46 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/3510561646' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:31:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:31:47.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:46 smithi161 ceph-mon[121170]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:47.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:46 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/2351092776' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "973d7656-a340-4dc0-a2df-7cd3c96df604"}]: dispatch 2023-12-09T02:31:47.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:46 smithi161 ceph-mon[121170]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "973d7656-a340-4dc0-a2df-7cd3c96df604"}]: dispatch 2023-12-09T02:31:47.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:46 smithi161 ceph-mon[121170]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "973d7656-a340-4dc0-a2df-7cd3c96df604"}]': finished 2023-12-09T02:31:47.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:46 smithi161 ceph-mon[121170]: osdmap e36: 6 total, 5 up, 6 in 2023-12-09T02:31:47.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:46 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:31:47.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:46 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/3510561646' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-09T02:31:47.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:46 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:31:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:48 smithi088 ceph-mon[112028]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:49.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:48 smithi161 ceph-mon[121170]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:50 smithi161 ceph-mon[121170]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:50 smithi088 ceph-mon[112028]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:52.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:52 smithi161 ceph-mon[121170]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:52.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:52 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-09T02:31:52.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:52 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:52.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:52 smithi088 ceph-mon[112028]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:52.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:52 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-09T02:31:52.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:52 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:53.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:53 smithi088 ceph-mon[112028]: Deploying daemon osd.5 on smithi161 2023-12-09T02:31:54.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:53 smithi161 ceph-mon[121170]: Deploying daemon osd.5 on smithi161 2023-12-09T02:31:54.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:54 smithi088 ceph-mon[112028]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:55.148 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:54 smithi161 ceph-mon[121170]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:56 smithi161 ceph-mon[121170]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:57.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:56 smithi088 ceph-mon[112028]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:57.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:57.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:57.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:58.861 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 5 on host 'smithi161' 2023-12-09T02:31:58.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.858+0000 7f08ce7fc700 1 -- 172.21.15.161:0/3784169124 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f08d810f600 con 0x7f08c4068f60 2023-12-09T02:31:58.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.861+0000 7f08e0077700 1 -- 172.21.15.161:0/3784169124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f08c4068f60 msgr2=0x7f08c406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:58.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.861+0000 7f08e0077700 1 --2- 172.21.15.161:0/3784169124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f08c4068f60 0x7f08c406b410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08c8004890 tx=0x7f08c8009e30 comp rx=0 tx=0).stop 2023-12-09T02:31:58.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.861+0000 7f08e0077700 1 -- 172.21.15.161:0/3784169124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d80fcd00 msgr2=0x7f08d810db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:31:58.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.861+0000 7f08e0077700 1 --2- 172.21.15.161:0/3784169124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d80fcd00 0x7f08d810db30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f08d4002a50 tx=0x7f08d40046b0 comp rx=0 tx=0).stop 2023-12-09T02:31:58.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.861+0000 7f08e0077700 1 -- 172.21.15.161:0/3784169124 shutdown_connections 2023-12-09T02:31:58.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.861+0000 7f08e0077700 1 --2- 172.21.15.161:0/3784169124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f08c4068f60 0x7f08c406b410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:58.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.861+0000 7f08e0077700 1 --2- 172.21.15.161:0/3784169124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08d80fbaf0 0x7f08d810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:58.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.861+0000 7f08e0077700 1 --2- 172.21.15.161:0/3784169124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d80fcd00 0x7f08d810db30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:31:58.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.861+0000 7f08e0077700 1 -- 172.21.15.161:0/3784169124 >> 172.21.15.161:0/3784169124 conn(0x7f08d80f7190 msgr2=0x7f08d8065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:31:58.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.861+0000 7f08e0077700 1 -- 172.21.15.161:0/3784169124 shutdown_connections 2023-12-09T02:31:58.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:31:58.861+0000 7f08e0077700 1 -- 172.21.15.161:0/3784169124 wait complete. 2023-12-09T02:31:59.079 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:58 smithi161 ceph-mon[121170]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:59.079 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:59.079 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:59.079 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:59.079 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:59.079 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:59.079 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:59.079 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:59.079 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:59.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:58 smithi088 ceph-mon[112028]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:31:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:31:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:31:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:31:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:31:59.273 DEBUG:teuthology.orchestra.run.smithi161:osd.5> sudo journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.5.service 2023-12-09T02:31:59.276 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-09T02:31:59.276 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd stat -f json 2023-12-09T02:31:59.306 INFO:journalctl@ceph.osd.5.smithi161.stdout:-- Logs begin at Sat 2023-12-09 02:10:06 UTC. -- 2023-12-09T02:31:59.542 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:00.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:59 smithi161 ceph-mon[121170]: from='osd.5 [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-09T02:32:00.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:31:59 smithi161 ceph-mon[121170]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-09T02:32:00.171 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:31:59 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[144877]: 2023-12-09T02:31:59.900+0000 7fb3ffc5f540 -1 osd.5 0 log_to_monitors true 2023-12-09T02:32:00.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:59 smithi088 ceph-mon[112028]: from='osd.5 [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-09T02:32:00.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:31:59 smithi088 ceph-mon[112028]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-09T02:32:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.522+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/2006159144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c40fbaf0 msgr2=0x7fe3c40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.522+0000 7fe3c8cc5700 1 --2- 172.21.15.88:0/2006159144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c40fbaf0 0x7fe3c40fbf00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4004940 tx=0x7fe3b4009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.522+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/2006159144 shutdown_connections 2023-12-09T02:32:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c8cc5700 1 --2- 172.21.15.88:0/2006159144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40fcd00 0x7fe3c40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c8cc5700 1 --2- 172.21.15.88:0/2006159144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c40fbaf0 0x7fe3c40fbf00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/2006159144 >> 172.21.15.88:0/2006159144 conn(0x7fe3c40f7190 msgr2=0x7fe3c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/2006159144 shutdown_connections 2023-12-09T02:32:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/2006159144 wait complete. 2023-12-09T02:32:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c8cc5700 1 Processor -- start 2023-12-09T02:32:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c8cc5700 1 -- start start 2023-12-09T02:32:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c8cc5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c40fbaf0 0x7fe3c41102e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c8cc5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40fcd00 0x7fe3c4112830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c8cc5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40661c0 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c8cc5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4066300 con 0x7fe3c40fcd00 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c40fbaf0 0x7fe3c41102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c40fbaf0 0x7fe3c41102e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54648/0 (socket says 172.21.15.88:54648) 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c259c700 1 -- 172.21.15.88:0/1810328990 learned_addr learned my addr 172.21.15.88:0/1810328990 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.523+0000 7fe3c1d9b700 1 --2- 172.21.15.88:0/1810328990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40fcd00 0x7fe3c4112830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.524+0000 7fe3c259c700 1 -- 172.21.15.88:0/1810328990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40fcd00 msgr2=0x7fe3c4112830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.524+0000 7fe3c259c700 1 --2- 172.21.15.88:0/1810328990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40fcd00 0x7fe3c4112830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.524+0000 7fe3c259c700 1 -- 172.21.15.88:0/1810328990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4005040 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.524+0000 7fe3c259c700 1 --2- 172.21.15.88:0/1810328990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c40fbaf0 0x7fe3c41102e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400b3b0 tx=0x7fe3b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.524+0000 7fe3b2ffd700 1 -- 172.21.15.88:0/1810328990 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b400e040 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.524+0000 7fe3b2ffd700 1 -- 172.21.15.88:0/1810328990 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe3b400bc50 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.524+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/1810328990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c4112e80 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.524+0000 7fe3b2ffd700 1 -- 172.21.15.88:0/1810328990 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b401c630 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.524+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/1810328990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c4113330 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.525+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/1810328990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c404bb80 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.525+0000 7fe3b2ffd700 1 -- 172.21.15.88:0/1810328990 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe3b4013420 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.526+0000 7fe3b2ffd700 1 --2- 172.21.15.88:0/1810328990 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe3ac068f60 0x7fe3ac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:00.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.526+0000 7fe3b2ffd700 1 -- 172.21.15.88:0/1810328990 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4338+0+0 (secure 0 0 0) 0x7fe3b4087c00 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.526+0000 7fe3c1d9b700 1 --2- 172.21.15.88:0/1810328990 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe3ac068f60 0x7fe3ac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:00.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.526+0000 7fe3c1d9b700 1 --2- 172.21.15.88:0/1810328990 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe3ac068f60 0x7fe3ac06b410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009bf0 tx=0x7fe3b80091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:00.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.530+0000 7fe3b2ffd700 1 -- 172.21.15.88:0/1810328990 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe3b408d020 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.716+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/1810328990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fe3c4104510 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.716+0000 7fe3b2ffd700 1 -- 172.21.15.88:0/1810328990 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7fe3b40545d0 con 0x7fe3c40fbaf0 2023-12-09T02:32:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:00.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.718+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/1810328990 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe3ac068f60 msgr2=0x7fe3ac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:00.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.718+0000 7fe3c8cc5700 1 --2- 172.21.15.88:0/1810328990 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe3ac068f60 0x7fe3ac06b410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009bf0 tx=0x7fe3b80091a0 comp rx=0 tx=0).stop 2023-12-09T02:32:00.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.718+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/1810328990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c40fbaf0 msgr2=0x7fe3c41102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:00.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.718+0000 7fe3c8cc5700 1 --2- 172.21.15.88:0/1810328990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c40fbaf0 0x7fe3c41102e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400b3b0 tx=0x7fe3b4009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:00.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.718+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/1810328990 shutdown_connections 2023-12-09T02:32:00.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.718+0000 7fe3c8cc5700 1 --2- 172.21.15.88:0/1810328990 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe3ac068f60 0x7fe3ac06b410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:00.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.718+0000 7fe3c8cc5700 1 --2- 172.21.15.88:0/1810328990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c40fbaf0 0x7fe3c41102e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:00.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.718+0000 7fe3c8cc5700 1 --2- 172.21.15.88:0/1810328990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40fcd00 0x7fe3c4112830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:00.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.718+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/1810328990 >> 172.21.15.88:0/1810328990 conn(0x7fe3c40f7190 msgr2=0x7fe3c40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:00.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.718+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/1810328990 shutdown_connections 2023-12-09T02:32:00.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:00.718+0000 7fe3c8cc5700 1 -- 172.21.15.88:0/1810328990 wait complete. 2023-12-09T02:32:01.088 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:00 smithi088 ceph-mon[112028]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:32:01.088 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:00 smithi088 ceph-mon[112028]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-09T02:32:01.088 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:00 smithi088 ceph-mon[112028]: osdmap e37: 6 total, 5 up, 6 in 2023-12-09T02:32:01.088 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:00 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:32:01.088 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:00 smithi088 ceph-mon[112028]: from='osd.5 [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:32:01.088 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:00 smithi088 ceph-mon[112028]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:32:01.088 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:00 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1810328990' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-09T02:32:01.089 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1702089103,"num_in_osds":6,"osd_in_since":1702089105,"num_remapped_pgs":0} 2023-12-09T02:32:01.370 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:32:00 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[144877]: 2023-12-09T02:32:00.966+0000 7fb3f6444700 -1 osd.5 0 waiting for initial osdmap 2023-12-09T02:32:01.371 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:32:00 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[144877]: 2023-12-09T02:32:00.974+0000 7fb3f1a40700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:32:01.371 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:00 smithi161 ceph-mon[121170]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:32:01.371 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:00 smithi161 ceph-mon[121170]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-09T02:32:01.371 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:00 smithi161 ceph-mon[121170]: osdmap e37: 6 total, 5 up, 6 in 2023-12-09T02:32:01.371 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:00 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:32:01.371 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:00 smithi161 ceph-mon[121170]: from='osd.5 [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:32:01.371 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:00 smithi161 ceph-mon[121170]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:32:01.371 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:00 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/1810328990' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-09T02:32:02.093 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd stat -f json 2023-12-09T02:32:02.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-12-09T02:32:02.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: osdmap e38: 6 total, 5 up, 6 in 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:32:02.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:02.361 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-12-09T02:32:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: osdmap e38: 6 total, 5 up, 6 in 2023-12-09T02:32:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:32:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:32:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:32:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:02.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:32:02.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:32:02.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:32:02.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:02.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:02.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:32:02.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:03.110 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:02 smithi088 ceph-mon[112028]: purged_snaps scrub starts 2023-12-09T02:32:03.110 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:02 smithi088 ceph-mon[112028]: purged_snaps scrub ok 2023-12-09T02:32:03.110 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:02 smithi088 ceph-mon[112028]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:32:03.110 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:02 smithi088 ceph-mon[112028]: Detected new or changed devices on smithi161 2023-12-09T02:32:03.110 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:02 smithi088 ceph-mon[112028]: Adjusting osd_memory_target on smithi161 to 5323M 2023-12-09T02:32:03.110 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:02 smithi088 ceph-mon[112028]: osd.5 [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517] boot 2023-12-09T02:32:03.111 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:02 smithi088 ceph-mon[112028]: osdmap e39: 6 total, 6 up, 6 in 2023-12-09T02:32:03.111 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:02 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:32:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.301+0000 7fc09a596700 1 -- 172.21.15.88:0/286273798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc094066030 msgr2=0x7fc0940ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.301+0000 7fc09a596700 1 --2- 172.21.15.88:0/286273798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc094066030 0x7fc0940ff800 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc07c004940 tx=0x7fc07c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.301+0000 7fc09a596700 1 -- 172.21.15.88:0/286273798 shutdown_connections 2023-12-09T02:32:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.301+0000 7fc09a596700 1 --2- 172.21.15.88:0/286273798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0940ffdd0 0x7fc0941021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.301+0000 7fc09a596700 1 --2- 172.21.15.88:0/286273798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc094066030 0x7fc0940ff800 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.301+0000 7fc09a596700 1 -- 172.21.15.88:0/286273798 >> 172.21.15.88:0/286273798 conn(0x7fc0940f7190 msgr2=0x7fc0940f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.301+0000 7fc09a596700 1 -- 172.21.15.88:0/286273798 shutdown_connections 2023-12-09T02:32:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.301+0000 7fc09a596700 1 -- 172.21.15.88:0/286273798 wait complete. 2023-12-09T02:32:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.301+0000 7fc09a596700 1 Processor -- start 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc09a596700 1 -- start start 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc09a596700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc094066030 0x7fc0940fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc09a596700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0940ffdd0 0x7fc0940fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc09a596700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940fbd00 con 0x7fc0940ffdd0 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc09a596700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940fbe70 con 0x7fc094066030 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0940ffdd0 0x7fc0940fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0940ffdd0 0x7fc0940fb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54670/0 (socket says 172.21.15.88:54670) 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc0937fe700 1 -- 172.21.15.88:0/3378717550 learned_addr learned my addr 172.21.15.88:0/3378717550 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc093fff700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc094066030 0x7fc0940fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc0937fe700 1 -- 172.21.15.88:0/3378717550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc094066030 msgr2=0x7fc0940fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc0937fe700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc094066030 0x7fc0940fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc0937fe700 1 -- 172.21.15.88:0/3378717550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c005040 con 0x7fc0940ffdd0 2023-12-09T02:32:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc093fff700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc094066030 0x7fc0940fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:32:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.302+0000 7fc0937fe700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0940ffdd0 0x7fc0940fb700 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc084002a80 tx=0x7fc084004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.303+0000 7fc090ff9700 1 -- 172.21.15.88:0/3378717550 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc084007cc0 con 0x7fc0940ffdd0 2023-12-09T02:32:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.303+0000 7fc090ff9700 1 -- 172.21.15.88:0/3378717550 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc08400f040 con 0x7fc0940ffdd0 2023-12-09T02:32:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.303+0000 7fc09a596700 1 -- 172.21.15.88:0/3378717550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0940fc150 con 0x7fc0940ffdd0 2023-12-09T02:32:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.303+0000 7fc090ff9700 1 -- 172.21.15.88:0/3378717550 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc08400da40 con 0x7fc0940ffdd0 2023-12-09T02:32:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.303+0000 7fc09a596700 1 -- 172.21.15.88:0/3378717550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0941155a0 con 0x7fc0940ffdd0 2023-12-09T02:32:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.304+0000 7fc09a596700 1 -- 172.21.15.88:0/3378717550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc094107600 con 0x7fc0940ffdd0 2023-12-09T02:32:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.304+0000 7fc090ff9700 1 -- 172.21.15.88:0/3378717550 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc08400dbe0 con 0x7fc0940ffdd0 2023-12-09T02:32:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.304+0000 7fc090ff9700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc080068f60 0x7fc08006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.304+0000 7fc090ff9700 1 -- 172.21.15.88:0/3378717550 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc084086150 con 0x7fc0940ffdd0 2023-12-09T02:32:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.304+0000 7fc093fff700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc080068f60 0x7fc08006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.305+0000 7fc093fff700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc080068f60 0x7fc08006b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00b3b0 tx=0x7fc07c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.309+0000 7fc090ff9700 1 -- 172.21.15.88:0/3378717550 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc08404ca00 con 0x7fc0940ffdd0 2023-12-09T02:32:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:02 smithi161 ceph-mon[121170]: purged_snaps scrub starts 2023-12-09T02:32:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:02 smithi161 ceph-mon[121170]: purged_snaps scrub ok 2023-12-09T02:32:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:02 smithi161 ceph-mon[121170]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-09T02:32:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:02 smithi161 ceph-mon[121170]: Detected new or changed devices on smithi161 2023-12-09T02:32:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:02 smithi161 ceph-mon[121170]: Adjusting osd_memory_target on smithi161 to 5323M 2023-12-09T02:32:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:02 smithi161 ceph-mon[121170]: osd.5 [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517] boot 2023-12-09T02:32:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:02 smithi161 ceph-mon[121170]: osdmap e39: 6 total, 6 up, 6 in 2023-12-09T02:32:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:02 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:32:03.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.492+0000 7fc09a596700 1 -- 172.21.15.88:0/3378717550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc09402b0e0 con 0x7fc0940ffdd0 2023-12-09T02:32:03.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.492+0000 7fc090ff9700 1 -- 172.21.15.88:0/3378717550 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7fc084056370 con 0x7fc0940ffdd0 2023-12-09T02:32:03.495 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:03.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.494+0000 7fc09a596700 1 -- 172.21.15.88:0/3378717550 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc080068f60 msgr2=0x7fc08006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.494+0000 7fc09a596700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc080068f60 0x7fc08006b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00b3b0 tx=0x7fc07c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.494+0000 7fc09a596700 1 -- 172.21.15.88:0/3378717550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0940ffdd0 msgr2=0x7fc0940fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.494+0000 7fc09a596700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0940ffdd0 0x7fc0940fb700 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc084002a80 tx=0x7fc084004630 comp rx=0 tx=0).stop 2023-12-09T02:32:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.494+0000 7fc09a596700 1 -- 172.21.15.88:0/3378717550 shutdown_connections 2023-12-09T02:32:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.494+0000 7fc09a596700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc094066030 0x7fc0940fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.494+0000 7fc09a596700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc080068f60 0x7fc08006b410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.494+0000 7fc09a596700 1 --2- 172.21.15.88:0/3378717550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0940ffdd0 0x7fc0940fb700 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.494+0000 7fc09a596700 1 -- 172.21.15.88:0/3378717550 >> 172.21.15.88:0/3378717550 conn(0x7fc0940f7190 msgr2=0x7fc0940f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.494+0000 7fc09a596700 1 -- 172.21.15.88:0/3378717550 shutdown_connections 2023-12-09T02:32:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:03.494+0000 7fc09a596700 1 -- 172.21.15.88:0/3378717550 wait complete. 2023-12-09T02:32:03.872 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1702089121,"num_in_osds":6,"osd_in_since":1702089105,"num_remapped_pgs":0} 2023-12-09T02:32:03.873 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-09T02:32:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:04.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:03 smithi088 ceph-mon[112028]: osdmap e40: 6 total, 6 up, 6 in 2023-12-09T02:32:04.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:03 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3378717550' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-09T02:32:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:03 smithi161 ceph-mon[121170]: osdmap e40: 6 total, 6 up, 6 in 2023-12-09T02:32:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:03 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3378717550' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-09T02:32:05.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.100+0000 7fef17110700 1 -- 172.21.15.88:0/2429112432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef101035a0 msgr2=0x7fef100fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:05.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.100+0000 7fef17110700 1 --2- 172.21.15.88:0/2429112432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef101035a0 0x7fef100fcc10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7feefc004940 tx=0x7feefc009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:05.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.100+0000 7fef17110700 1 -- 172.21.15.88:0/2429112432 shutdown_connections 2023-12-09T02:32:05.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.100+0000 7fef17110700 1 --2- 172.21.15.88:0/2429112432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef101035a0 0x7fef100fcc10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.100+0000 7fef17110700 1 --2- 172.21.15.88:0/2429112432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef10102c00 0x7fef10102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.100+0000 7fef17110700 1 -- 172.21.15.88:0/2429112432 >> 172.21.15.88:0/2429112432 conn(0x7fef100f8790 msgr2=0x7fef100faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.100+0000 7fef17110700 1 -- 172.21.15.88:0/2429112432 shutdown_connections 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.100+0000 7fef17110700 1 -- 172.21.15.88:0/2429112432 wait complete. 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef17110700 1 Processor -- start 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef17110700 1 -- start start 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef17110700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef10102c00 0x7fef1006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef17110700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef101035a0 0x7fef100704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef17110700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef10070af0 con 0x7fef10102c00 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef17110700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef10070c60 con 0x7fef101035a0 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef14eac700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef10102c00 0x7fef1006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:05.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef14eac700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef10102c00 0x7fef1006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54686/0 (socket says 172.21.15.88:54686) 2023-12-09T02:32:05.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef14eac700 1 -- 172.21.15.88:0/634986889 learned_addr learned my addr 172.21.15.88:0/634986889 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:05.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef0ffff700 1 --2- 172.21.15.88:0/634986889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef101035a0 0x7fef100704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:05.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef14eac700 1 -- 172.21.15.88:0/634986889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef101035a0 msgr2=0x7fef100704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:05.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.101+0000 7fef14eac700 1 --2- 172.21.15.88:0/634986889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef101035a0 0x7fef100704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:05.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.102+0000 7fef14eac700 1 -- 172.21.15.88:0/634986889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc005040 con 0x7fef10102c00 2023-12-09T02:32:05.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.102+0000 7fef14eac700 1 --2- 172.21.15.88:0/634986889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef10102c00 0x7fef1006ff40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fef0400c830 tx=0x7fef04004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:05.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.102+0000 7fef0d7fa700 1 -- 172.21.15.88:0/634986889 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef0400a760 con 0x7fef10102c00 2023-12-09T02:32:05.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.102+0000 7fef17110700 1 -- 172.21.15.88:0/634986889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef10119880 con 0x7fef10102c00 2023-12-09T02:32:05.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.102+0000 7fef0d7fa700 1 -- 172.21.15.88:0/634986889 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef0400ad70 con 0x7fef10102c00 2023-12-09T02:32:05.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.102+0000 7fef0d7fa700 1 -- 172.21.15.88:0/634986889 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef040113a0 con 0x7fef10102c00 2023-12-09T02:32:05.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.102+0000 7fef17110700 1 -- 172.21.15.88:0/634986889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef10119dc0 con 0x7fef10102c00 2023-12-09T02:32:05.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.103+0000 7fef17110700 1 -- 172.21.15.88:0/634986889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef101050d0 con 0x7fef10102c00 2023-12-09T02:32:05.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.103+0000 7fef0d7fa700 1 -- 172.21.15.88:0/634986889 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fef04012400 con 0x7fef10102c00 2023-12-09T02:32:05.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.103+0000 7fef0d7fa700 1 --2- 172.21.15.88:0/634986889 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fef00068f60 0x7fef0006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:05.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.104+0000 7fef0ffff700 1 --2- 172.21.15.88:0/634986889 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fef00068f60 0x7fef0006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:05.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.104+0000 7fef0d7fa700 1 -- 172.21.15.88:0/634986889 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fef04086b50 con 0x7fef10102c00 2023-12-09T02:32:05.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.104+0000 7fef0ffff700 1 --2- 172.21.15.88:0/634986889 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fef00068f60 0x7fef0006b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feefc00b3b0 tx=0x7feefc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:05.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.108+0000 7fef0d7fa700 1 -- 172.21.15.88:0/634986889 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fef040532c0 con 0x7fef10102c00 2023-12-09T02:32:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:04 smithi088 ceph-mon[112028]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:05.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.291+0000 7fef17110700 1 -- 172.21.15.88:0/634986889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef100fc390 con 0x7fef10102c00 2023-12-09T02:32:05.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.291+0000 7fef0d7fa700 1 -- 172.21.15.88:0/634986889 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11096 (secure 0 0 0) 0x7fef040568e0 con 0x7fef10102c00 2023-12-09T02:32:05.294 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:05.294 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":40,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","created":"2023-12-09T02:27:49.802100+0000","modified":"2023-12-09T02:32:02.969269+0000","last_up_change":"2023-12-09T02:32:01.964039+0000","last_in_change":"2023-12-09T02:31:45.877281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-09T02:31:07.797033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"94c4c8ad-f87e-4abd-aff2-ea13d8630f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6803","nonce":4163243891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6805","nonce":4163243891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6809","nonce":4163243891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6807","nonce":4163243891}]},"public_addr":"172.21.15.88:6803/4163243891","cluster_addr":"172.21.15.88:6805/4163243891","heartbeat_back_addr":"172.21.15.88:6809/4163243891","heartbeat_front_addr":"172.21.15.88:6807/4163243891","state":["exists","up"]},{"osd":1,"uuid":"1b6c3137-e616-4979-a9cb-89665a8a2919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6811","nonce":1049229781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6813","nonce":1049229781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6817","nonce":1049229781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6815","nonce":1049229781}]},"public_addr":"172.21.15.88:6811/1049229781","cluster_addr":"172.21.15.88:6813/1049229781","heartbeat_back_addr":"172.21.15.88:6817/1049229781","heartbeat_front_addr":"172.21.15.88:6815/1049229781","state":["exists","up"]},{"osd":2,"uuid":"c5d0b176-113f-450a-8737-2dcf542f1f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6819","nonce":2614314803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6821","nonce":2614314803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6825","nonce":2614314803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6823","nonce":2614314803}]},"public_addr":"172.21.15.88:6819/2614314803","cluster_addr":"172.21.15.88:6821/2614314803","heartbeat_back_addr":"172.21.15.88:6825/2614314803","heartbeat_front_addr":"172.21.15.88:6823/2614314803","state":["exists","up"]},{"osd":3,"uuid":"6584d86c-84e6-4f9e-a481-d297f6892df8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6801","nonce":1856287356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6803","nonce":1856287356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6807","nonce":1856287356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6805","nonce":1856287356}]},"public_addr":"172.21.15.161:6801/1856287356","cluster_addr":"172.21.15.161:6803/1856287356","heartbeat_back_addr":"172.21.15.161:6807/1856287356","heartbeat_front_addr":"172.21.15.161:6805/1856287356","state":["exists","up"]},{"osd":4,"uuid":"729b6d7a-8045-40d4-b07d-aa8d8912a357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6809","nonce":1385340150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6811","nonce":1385340150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6815","nonce":1385340150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6813","nonce":1385340150}]},"public_addr":"172.21.15.161:6809/1385340150","cluster_addr":"172.21.15.161:6811/1385340150","heartbeat_back_addr":"172.21.15.161:6815/1385340150","heartbeat_front_addr":"172.21.15.161:6813/1385340150","state":["exists","up"]},{"osd":5,"uuid":"973d7656-a340-4dc0-a2df-7cd3c96df604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6817","nonce":2958715517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6819","nonce":2958715517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6823","nonce":2958715517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6821","nonce":2958715517}]},"public_addr":"172.21.15.161:6817/2958715517","cluster_addr":"172.21.15.161:6819/2958715517","heartbeat_back_addr":"172.21.15.161:6823/2958715517","heartbeat_front_addr":"172.21.15.161:6821/2958715517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:24.723561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:44.412595+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:04.087324+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:22.198894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:41.741094+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:32:00.865763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6801/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.88:6800/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/3372513144":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/2622749836":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/2387855456":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/1114065717":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/2588418845":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/2169163782":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6800/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.88:6800/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6801/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/2691791328":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/1442782127":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6801/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/712942340":"2023-12-10T02:28:42.918100+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-09T02:32:05.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.293+0000 7fef17110700 1 -- 172.21.15.88:0/634986889 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fef00068f60 msgr2=0x7fef0006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:05.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.293+0000 7fef17110700 1 --2- 172.21.15.88:0/634986889 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fef00068f60 0x7fef0006b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feefc00b3b0 tx=0x7feefc009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:05.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.293+0000 7fef17110700 1 -- 172.21.15.88:0/634986889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef10102c00 msgr2=0x7fef1006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:05.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.293+0000 7fef17110700 1 --2- 172.21.15.88:0/634986889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef10102c00 0x7fef1006ff40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fef0400c830 tx=0x7fef04004470 comp rx=0 tx=0).stop 2023-12-09T02:32:05.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.294+0000 7fef17110700 1 -- 172.21.15.88:0/634986889 shutdown_connections 2023-12-09T02:32:05.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.294+0000 7fef17110700 1 --2- 172.21.15.88:0/634986889 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fef00068f60 0x7fef0006b410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:05.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.294+0000 7fef17110700 1 --2- 172.21.15.88:0/634986889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef10102c00 0x7fef1006ff40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:05.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.294+0000 7fef17110700 1 --2- 172.21.15.88:0/634986889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef101035a0 0x7fef100704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:05.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.294+0000 7fef17110700 1 -- 172.21.15.88:0/634986889 >> 172.21.15.88:0/634986889 conn(0x7fef100f8790 msgr2=0x7fef100fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:05.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.294+0000 7fef17110700 1 -- 172.21.15.88:0/634986889 shutdown_connections 2023-12-09T02:32:05.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:05.294+0000 7fef17110700 1 -- 172.21.15.88:0/634986889 wait complete. 2023-12-09T02:32:05.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:04 smithi161 ceph-mon[121170]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:05.672 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-09T02:31:07.797033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-09T02:32:05.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-09T02:32:05.934 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:06.343 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:05 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/634986889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:32:06.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:05 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/634986889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:32:06.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.873+0000 7ff92d3df700 1 -- 172.21.15.88:0/3969512814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff928101b10 msgr2=0x7ff928101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:06.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.873+0000 7ff92d3df700 1 --2- 172.21.15.88:0/3969512814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff928101b10 0x7ff928101ee0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff91c004940 tx=0x7ff91c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:06.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.873+0000 7ff92d3df700 1 -- 172.21.15.88:0/3969512814 shutdown_connections 2023-12-09T02:32:06.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.873+0000 7ff92d3df700 1 --2- 172.21.15.88:0/3969512814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9281024b0 0x7ff9280fc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:06.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.873+0000 7ff92d3df700 1 --2- 172.21.15.88:0/3969512814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff928101b10 0x7ff928101ee0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:06.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.873+0000 7ff92d3df700 1 -- 172.21.15.88:0/3969512814 >> 172.21.15.88:0/3969512814 conn(0x7ff9280711b0 msgr2=0x7ff9280715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:06.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.874+0000 7ff92d3df700 1 -- 172.21.15.88:0/3969512814 shutdown_connections 2023-12-09T02:32:06.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.874+0000 7ff92d3df700 1 -- 172.21.15.88:0/3969512814 wait complete. 2023-12-09T02:32:06.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.874+0000 7ff92d3df700 1 Processor -- start 2023-12-09T02:32:06.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.874+0000 7ff92d3df700 1 -- start start 2023-12-09T02:32:06.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.874+0000 7ff92d3df700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff928101b10 0x7ff92810e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:06.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.874+0000 7ff92d3df700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9281024b0 0x7ff92810ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:06.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.874+0000 7ff92d3df700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92810f310 con 0x7ff9281024b0 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.874+0000 7ff92d3df700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92810f480 con 0x7ff928101b10 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff9267fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9281024b0 0x7ff92810ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff9267fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9281024b0 0x7ff92810ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33750/0 (socket says 172.21.15.88:33750) 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff9267fc700 1 -- 172.21.15.88:0/1530123202 learned_addr learned my addr 172.21.15.88:0/1530123202 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff926ffd700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff928101b10 0x7ff92810e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff9267fc700 1 -- 172.21.15.88:0/1530123202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff928101b10 msgr2=0x7ff92810e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff9267fc700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff928101b10 0x7ff92810e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff9267fc700 1 -- 172.21.15.88:0/1530123202 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c005040 con 0x7ff9281024b0 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff926ffd700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff928101b10 0x7ff92810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff9267fc700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9281024b0 0x7ff92810ecc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c8c0 tx=0x7ff9180044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff90f7fe700 1 -- 172.21.15.88:0/1530123202 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff91800a940 con 0x7ff9281024b0 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff90f7fe700 1 -- 172.21.15.88:0/1530123202 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff91800ce60 con 0x7ff9281024b0 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff92d3df700 1 -- 172.21.15.88:0/1530123202 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff928117750 con 0x7ff9281024b0 2023-12-09T02:32:06.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff90f7fe700 1 -- 172.21.15.88:0/1530123202 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9180113a0 con 0x7ff9281024b0 2023-12-09T02:32:06.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.875+0000 7ff92d3df700 1 -- 172.21.15.88:0/1530123202 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff928117c90 con 0x7ff9281024b0 2023-12-09T02:32:06.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.876+0000 7ff92d3df700 1 -- 172.21.15.88:0/1530123202 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9280fee20 con 0x7ff9281024b0 2023-12-09T02:32:06.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.876+0000 7ff90f7fe700 1 -- 172.21.15.88:0/1530123202 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff918012400 con 0x7ff9281024b0 2023-12-09T02:32:06.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.877+0000 7ff90f7fe700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff910068f60 0x7ff91006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:06.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.877+0000 7ff926ffd700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff910068f60 0x7ff91006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:06.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.877+0000 7ff90f7fe700 1 -- 172.21.15.88:0/1530123202 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff918086a40 con 0x7ff9281024b0 2023-12-09T02:32:06.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.877+0000 7ff926ffd700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff910068f60 0x7ff91006b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff91c004560 tx=0x7ff91c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:06.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:06.881+0000 7ff90f7fe700 1 -- 172.21.15.88:0/1530123202 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff9180532f0 con 0x7ff9281024b0 2023-12-09T02:32:07.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.065+0000 7ff92d3df700 1 -- 172.21.15.88:0/1530123202 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff92804bb80 con 0x7ff9281024b0 2023-12-09T02:32:07.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.066+0000 7ff90f7fe700 1 -- 172.21.15.88:0/1530123202 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff918056910 con 0x7ff9281024b0 2023-12-09T02:32:07.069 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-09T02:32:07.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.067+0000 7ff92d3df700 1 -- 172.21.15.88:0/1530123202 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff910068f60 msgr2=0x7ff91006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:07.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.068+0000 7ff92d3df700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff910068f60 0x7ff91006b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff91c004560 tx=0x7ff91c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:07.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.068+0000 7ff92d3df700 1 -- 172.21.15.88:0/1530123202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9281024b0 msgr2=0x7ff92810ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:07.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.068+0000 7ff92d3df700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9281024b0 0x7ff92810ecc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c8c0 tx=0x7ff9180044c0 comp rx=0 tx=0).stop 2023-12-09T02:32:07.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.068+0000 7ff92d3df700 1 -- 172.21.15.88:0/1530123202 shutdown_connections 2023-12-09T02:32:07.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.068+0000 7ff92d3df700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff928101b10 0x7ff92810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:07.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.068+0000 7ff92d3df700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff910068f60 0x7ff91006b410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:07.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.068+0000 7ff92d3df700 1 --2- 172.21.15.88:0/1530123202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9281024b0 0x7ff92810ecc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:07.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.068+0000 7ff92d3df700 1 -- 172.21.15.88:0/1530123202 >> 172.21.15.88:0/1530123202 conn(0x7ff9280711b0 msgr2=0x7ff9280fa270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:07.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.068+0000 7ff92d3df700 1 -- 172.21.15.88:0/1530123202 shutdown_connections 2023-12-09T02:32:07.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:07.068+0000 7ff92d3df700 1 -- 172.21.15.88:0/1530123202 wait complete. 2023-12-09T02:32:07.242 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:06 smithi088 ceph-mon[112028]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:07.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:06 smithi161 ceph-mon[121170]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:07.463 INFO:tasks.cephadm:Setting up client nodes... 2023-12-09T02:32:07.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-09T02:32:07.725 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:08.150 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:07 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1530123202' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-09T02:32:08.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:07 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/1530123202' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-09T02:32:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.678+0000 7f72110ee700 1 -- 172.21.15.88:0/1655749206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f720c066090 msgr2=0x7f720c0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.678+0000 7f72110ee700 1 --2- 172.21.15.88:0/1655749206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f720c066090 0x7f720c0ff7a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009ce0 tx=0x7f71fc004d10 comp rx=0 tx=0).stop 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.678+0000 7f72110ee700 1 -- 172.21.15.88:0/1655749206 shutdown_connections 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.678+0000 7f72110ee700 1 --2- 172.21.15.88:0/1655749206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f720c0ffd70 0x7f720c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.678+0000 7f72110ee700 1 --2- 172.21.15.88:0/1655749206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f720c066090 0x7f720c0ff7a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.678+0000 7f72110ee700 1 -- 172.21.15.88:0/1655749206 >> 172.21.15.88:0/1655749206 conn(0x7f720c0f7190 msgr2=0x7f720c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.679+0000 7f72110ee700 1 -- 172.21.15.88:0/1655749206 shutdown_connections 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.679+0000 7f72110ee700 1 -- 172.21.15.88:0/1655749206 wait complete. 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.679+0000 7f72110ee700 1 Processor -- start 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.679+0000 7f72110ee700 1 -- start start 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.679+0000 7f72110ee700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f720c066090 0x7f720c10f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.679+0000 7f72110ee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f720c0ffd70 0x7f720c10fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.679+0000 7f72110ee700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c110440 con 0x7f720c0ffd70 2023-12-09T02:32:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.679+0000 7f72110ee700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c110ce0 con 0x7f720c066090 2023-12-09T02:32:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.679+0000 7f720a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f720c0ffd70 0x7f720c10fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.679+0000 7f720a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f720c0ffd70 0x7f720c10fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33766/0 (socket says 172.21.15.88:33766) 2023-12-09T02:32:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.679+0000 7f720a59c700 1 -- 172.21.15.88:0/1637649124 learned_addr learned my addr 172.21.15.88:0/1637649124 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.680+0000 7f720ad9d700 1 --2- 172.21.15.88:0/1637649124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f720c066090 0x7f720c10f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.680+0000 7f720a59c700 1 -- 172.21.15.88:0/1637649124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f720c066090 msgr2=0x7f720c10f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.680+0000 7f720a59c700 1 --2- 172.21.15.88:0/1637649124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f720c066090 0x7f720c10f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.680+0000 7f720a59c700 1 -- 172.21.15.88:0/1637649124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc009940 con 0x7f720c0ffd70 2023-12-09T02:32:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.680+0000 7f720a59c700 1 --2- 172.21.15.88:0/1637649124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f720c0ffd70 0x7f720c10fe40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71f4002a50 tx=0x7f71f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.680+0000 7f72037fe700 1 -- 172.21.15.88:0/1637649124 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71f4007cc0 con 0x7f720c0ffd70 2023-12-09T02:32:08.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.680+0000 7f72037fe700 1 -- 172.21.15.88:0/1637649124 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71f400f040 con 0x7f720c0ffd70 2023-12-09T02:32:08.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.680+0000 7f72110ee700 1 -- 172.21.15.88:0/1637649124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c110fc0 con 0x7f720c0ffd70 2023-12-09T02:32:08.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.680+0000 7f72037fe700 1 -- 172.21.15.88:0/1637649124 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71f400d920 con 0x7f720c0ffd70 2023-12-09T02:32:08.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.680+0000 7f72110ee700 1 -- 172.21.15.88:0/1637649124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720c111500 con 0x7f720c0ffd70 2023-12-09T02:32:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.681+0000 7f72110ee700 1 -- 172.21.15.88:0/1637649124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720c0f8d30 con 0x7f720c0ffd70 2023-12-09T02:32:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.681+0000 7f72037fe700 1 -- 172.21.15.88:0/1637649124 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f71f4009680 con 0x7f720c0ffd70 2023-12-09T02:32:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.682+0000 7f72037fe700 1 --2- 172.21.15.88:0/1637649124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f71f8068f60 0x7f71f806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.682+0000 7f72037fe700 1 -- 172.21.15.88:0/1637649124 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f71f40867f0 con 0x7f720c0ffd70 2023-12-09T02:32:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.682+0000 7f720ad9d700 1 --2- 172.21.15.88:0/1637649124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f71f8068f60 0x7f71f806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.682+0000 7f720ad9d700 1 --2- 172.21.15.88:0/1637649124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f71f8068f60 0x7f71f806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71fc003400 tx=0x7f71fc004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:08.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.686+0000 7f72037fe700 1 -- 172.21.15.88:0/1637649124 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f71f4056a10 con 0x7f720c0ffd70 2023-12-09T02:32:08.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.941+0000 7f72110ee700 1 -- 172.21.15.88:0/1637649124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f720c04bb80 con 0x7f720c0ffd70 2023-12-09T02:32:08.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.947+0000 7f72037fe700 1 -- 172.21.15.88:0/1637649124 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f71f40565a0 con 0x7f720c0ffd70 2023-12-09T02:32:08.950 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-12-09T02:32:08.950 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCo0XNl0mo1OBAAniT1nFlplrVXHXzpcTx/PQ== 2023-12-09T02:32:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.949+0000 7f72110ee700 1 -- 172.21.15.88:0/1637649124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f71f8068f60 msgr2=0x7f71f806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.949+0000 7f72110ee700 1 --2- 172.21.15.88:0/1637649124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f71f8068f60 0x7f71f806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71fc003400 tx=0x7f71fc004d10 comp rx=0 tx=0).stop 2023-12-09T02:32:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.949+0000 7f72110ee700 1 -- 172.21.15.88:0/1637649124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f720c0ffd70 msgr2=0x7f720c10fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.949+0000 7f72110ee700 1 --2- 172.21.15.88:0/1637649124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f720c0ffd70 0x7f720c10fe40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71f4002a50 tx=0x7f71f4004600 comp rx=0 tx=0).stop 2023-12-09T02:32:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.949+0000 7f72110ee700 1 -- 172.21.15.88:0/1637649124 shutdown_connections 2023-12-09T02:32:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.949+0000 7f72110ee700 1 --2- 172.21.15.88:0/1637649124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f720c066090 0x7f720c10f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.949+0000 7f72110ee700 1 --2- 172.21.15.88:0/1637649124 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f71f8068f60 0x7f71f806b410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.949+0000 7f72110ee700 1 --2- 172.21.15.88:0/1637649124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f720c0ffd70 0x7f720c10fe40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.949+0000 7f72110ee700 1 -- 172.21.15.88:0/1637649124 >> 172.21.15.88:0/1637649124 conn(0x7f720c0f7190 msgr2=0x7f720c100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.949+0000 7f72110ee700 1 -- 172.21.15.88:0/1637649124 shutdown_connections 2023-12-09T02:32:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:08.949+0000 7f72110ee700 1 -- 172.21.15.88:0/1637649124 wait complete. 2023-12-09T02:32:09.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:08 smithi088 ceph-mon[112028]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:09.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:08 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1637649124' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-09T02:32:09.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:08 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1637649124' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-09T02:32:09.312 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:32:09.312 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-09T02:32:09.312 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-09T02:32:09.352 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-09T02:32:09.385 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:08 smithi161 ceph-mon[121170]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:09.386 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:08 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/1637649124' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-09T02:32:09.386 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:08 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/1637649124' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-09T02:32:09.627 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi161/config 2023-12-09T02:32:10.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.815+0000 7fad1eee3700 1 -- 172.21.15.161:0/656848224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad180fbaf0 msgr2=0x7fad180fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:10.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.815+0000 7fad1eee3700 1 --2- 172.21.15.161:0/656848224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad180fbaf0 0x7fad180fbf00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad0c004940 tx=0x7fad0c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:10.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.815+0000 7fad1eee3700 1 -- 172.21.15.161:0/656848224 shutdown_connections 2023-12-09T02:32:10.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.815+0000 7fad1eee3700 1 --2- 172.21.15.161:0/656848224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad180fcd00 0x7fad180fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:10.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.815+0000 7fad1eee3700 1 --2- 172.21.15.161:0/656848224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad180fbaf0 0x7fad180fbf00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:10.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.815+0000 7fad1eee3700 1 -- 172.21.15.161:0/656848224 >> 172.21.15.161:0/656848224 conn(0x7fad180f71d0 msgr2=0x7fad180f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:10.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.815+0000 7fad1eee3700 1 -- 172.21.15.161:0/656848224 shutdown_connections 2023-12-09T02:32:10.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.815+0000 7fad1eee3700 1 -- 172.21.15.161:0/656848224 wait complete. 2023-12-09T02:32:10.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.815+0000 7fad1eee3700 1 Processor -- start 2023-12-09T02:32:10.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.815+0000 7fad1eee3700 1 -- start start 2023-12-09T02:32:10.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad1eee3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad180fbaf0 0x7fad18110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:10.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad1eee3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad180fcd00 0x7fad181127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:10.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad1eee3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad18066a30 con 0x7fad180fcd00 2023-12-09T02:32:10.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad1eee3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad18066b70 con 0x7fad180fbaf0 2023-12-09T02:32:10.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad1cc7f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad180fbaf0 0x7fad18110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:10.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad1cc7f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad180fbaf0 0x7fad18110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36708/0 (socket says 172.21.15.161:36708) 2023-12-09T02:32:10.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad1cc7f700 1 -- 172.21.15.161:0/2947855394 learned_addr learned my addr 172.21.15.161:0/2947855394 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-12-09T02:32:10.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad17fff700 1 --2- 172.21.15.161:0/2947855394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad180fcd00 0x7fad181127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:10.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad1cc7f700 1 -- 172.21.15.161:0/2947855394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad180fcd00 msgr2=0x7fad181127e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:10.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad1cc7f700 1 --2- 172.21.15.161:0/2947855394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad180fcd00 0x7fad181127e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:10.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad1cc7f700 1 -- 172.21.15.161:0/2947855394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c005040 con 0x7fad180fbaf0 2023-12-09T02:32:10.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad1cc7f700 1 --2- 172.21.15.161:0/2947855394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad180fbaf0 0x7fad18110290 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009360 tx=0x7fad0c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:10.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.816+0000 7fad157fa700 1 -- 172.21.15.161:0/2947855394 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0c00e040 con 0x7fad180fbaf0 2023-12-09T02:32:10.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.817+0000 7fad1eee3700 1 -- 172.21.15.161:0/2947855394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad18112e10 con 0x7fad180fbaf0 2023-12-09T02:32:10.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.817+0000 7fad1eee3700 1 -- 172.21.15.161:0/2947855394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad18113260 con 0x7fad180fbaf0 2023-12-09T02:32:10.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.817+0000 7fad157fa700 1 -- 172.21.15.161:0/2947855394 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad0c004290 con 0x7fad180fbaf0 2023-12-09T02:32:10.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.817+0000 7fad157fa700 1 -- 172.21.15.161:0/2947855394 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0c01c630 con 0x7fad180fbaf0 2023-12-09T02:32:10.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.818+0000 7fad1eee3700 1 -- 172.21.15.161:0/2947855394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1804bb80 con 0x7fad180fbaf0 2023-12-09T02:32:10.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.818+0000 7fad157fa700 1 -- 172.21.15.161:0/2947855394 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fad0c013960 con 0x7fad180fbaf0 2023-12-09T02:32:10.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.818+0000 7fad157fa700 1 --2- 172.21.15.161:0/2947855394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad08068f70 0x7fad0806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:10.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.818+0000 7fad157fa700 1 -- 172.21.15.161:0/2947855394 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fad0c087d50 con 0x7fad180fbaf0 2023-12-09T02:32:10.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.819+0000 7fad17fff700 1 --2- 172.21.15.161:0/2947855394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad08068f70 0x7fad0806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:10.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.819+0000 7fad17fff700 1 --2- 172.21.15.161:0/2947855394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad08068f70 0x7fad0806b420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad04006fd0 tx=0x7fad04008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:10.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:10.823+0000 7fad157fa700 1 -- 172.21.15.161:0/2947855394 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fad0c054600 con 0x7fad180fbaf0 2023-12-09T02:32:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.077+0000 7fad1eee3700 1 -- 172.21.15.161:0/2947855394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fad18104510 con 0x7fad180fbaf0 2023-12-09T02:32:11.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.084+0000 7fad157fa700 1 -- 172.21.15.161:0/2947855394 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fad0c057c20 con 0x7fad180fbaf0 2023-12-09T02:32:11.086 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2023-12-09T02:32:11.086 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCr0XNlVJO9BBAAZogE3NDGg1SUUDWziexYmg== 2023-12-09T02:32:11.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.086+0000 7fad1eee3700 1 -- 172.21.15.161:0/2947855394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad08068f70 msgr2=0x7fad0806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:11.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.086+0000 7fad1eee3700 1 --2- 172.21.15.161:0/2947855394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad08068f70 0x7fad0806b420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad04006fd0 tx=0x7fad04008040 comp rx=0 tx=0).stop 2023-12-09T02:32:11.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.086+0000 7fad1eee3700 1 -- 172.21.15.161:0/2947855394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad180fbaf0 msgr2=0x7fad18110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:11.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.086+0000 7fad1eee3700 1 --2- 172.21.15.161:0/2947855394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad180fbaf0 0x7fad18110290 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009360 tx=0x7fad0c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:11.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.086+0000 7fad1eee3700 1 -- 172.21.15.161:0/2947855394 shutdown_connections 2023-12-09T02:32:11.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.086+0000 7fad1eee3700 1 --2- 172.21.15.161:0/2947855394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad180fbaf0 0x7fad18110290 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:11.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.086+0000 7fad1eee3700 1 --2- 172.21.15.161:0/2947855394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad08068f70 0x7fad0806b420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:11.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.086+0000 7fad1eee3700 1 --2- 172.21.15.161:0/2947855394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad180fcd00 0x7fad181127e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:11.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.086+0000 7fad1eee3700 1 -- 172.21.15.161:0/2947855394 >> 172.21.15.161:0/2947855394 conn(0x7fad180f71d0 msgr2=0x7fad180fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:11.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.086+0000 7fad1eee3700 1 -- 172.21.15.161:0/2947855394 shutdown_connections 2023-12-09T02:32:11.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-12-09T02:32:11.086+0000 7fad1eee3700 1 -- 172.21.15.161:0/2947855394 wait complete. 2023-12-09T02:32:11.356 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:11 smithi161 ceph-mon[121170]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:11.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:10 smithi088 ceph-mon[112028]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:11.542 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:32:11.542 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-09T02:32:11.542 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-09T02:32:11.622 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-09T02:32:11.623 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-09T02:32:11.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph mgr dump --format=json 2023-12-09T02:32:11.892 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:12.308 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:12 smithi088 ceph-mon[112028]: from='client.? 172.21.15.161:0/2947855394' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-09T02:32:12.308 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:12 smithi088 ceph-mon[112028]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-09T02:32:12.308 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:12 smithi088 ceph-mon[112028]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-09T02:32:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:12 smithi161 ceph-mon[121170]: from='client.? 172.21.15.161:0/2947855394' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-09T02:32:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:12 smithi161 ceph-mon[121170]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-09T02:32:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:12 smithi161 ceph-mon[121170]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-09T02:32:12.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.815+0000 7fab20d10700 1 -- 172.21.15.88:0/1416207022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab1c0fbb40 msgr2=0x7fab1c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.815+0000 7fab20d10700 1 --2- 172.21.15.88:0/1416207022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab1c0fbb40 0x7fab1c0fbfb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fab10004940 tx=0x7fab10009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 -- 172.21.15.88:0/1416207022 shutdown_connections 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 --2- 172.21.15.88:0/1416207022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab1c0fbb40 0x7fab1c0fbfb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 --2- 172.21.15.88:0/1416207022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c101b00 0x7fab1c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 -- 172.21.15.88:0/1416207022 >> 172.21.15.88:0/1416207022 conn(0x7fab1c0719b0 msgr2=0x7fab1c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 -- 172.21.15.88:0/1416207022 shutdown_connections 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 -- 172.21.15.88:0/1416207022 wait complete. 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 Processor -- start 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 -- start start 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab1c0fbb40 0x7fab1c113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c101b00 0x7fab1c113c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:12.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c114370 con 0x7fab1c0fbb40 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.816+0000 7fab20d10700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c10d610 con 0x7fab1c101b00 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab1a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab1c0fbb40 0x7fab1c113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab1a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab1c0fbb40 0x7fab1c113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33776/0 (socket says 172.21.15.88:33776) 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab1a59c700 1 -- 172.21.15.88:0/757483231 learned_addr learned my addr 172.21.15.88:0/757483231 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab19d9b700 1 --2- 172.21.15.88:0/757483231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c101b00 0x7fab1c113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab1a59c700 1 -- 172.21.15.88:0/757483231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c101b00 msgr2=0x7fab1c113c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab1a59c700 1 --2- 172.21.15.88:0/757483231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c101b00 0x7fab1c113c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab1a59c700 1 -- 172.21.15.88:0/757483231 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab10005040 con 0x7fab1c0fbb40 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab1a59c700 1 --2- 172.21.15.88:0/757483231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab1c0fbb40 0x7fab1c113750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fab0c00b790 tx=0x7fab0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab0affd700 1 -- 172.21.15.88:0/757483231 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab0c00f770 con 0x7fab1c0fbb40 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab0affd700 1 -- 172.21.15.88:0/757483231 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab0c00fd80 con 0x7fab1c0fbb40 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab20d10700 1 -- 172.21.15.88:0/757483231 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c10d8f0 con 0x7fab1c0fbb40 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab0affd700 1 -- 172.21.15.88:0/757483231 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab0c00d310 con 0x7fab1c0fbb40 2023-12-09T02:32:12.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.817+0000 7fab20d10700 1 -- 172.21.15.88:0/757483231 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c10de30 con 0x7fab1c0fbb40 2023-12-09T02:32:12.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.818+0000 7fab20d10700 1 -- 172.21.15.88:0/757483231 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1c0734d0 con 0x7fab1c0fbb40 2023-12-09T02:32:12.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.819+0000 7fab0affd700 1 -- 172.21.15.88:0/757483231 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fab0c010420 con 0x7fab1c0fbb40 2023-12-09T02:32:12.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.819+0000 7fab0affd700 1 --2- 172.21.15.88:0/757483231 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab04068f60 0x7fab0406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:12.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.819+0000 7fab0affd700 1 -- 172.21.15.88:0/757483231 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fab0c086a40 con 0x7fab1c0fbb40 2023-12-09T02:32:12.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.819+0000 7fab19d9b700 1 --2- 172.21.15.88:0/757483231 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab04068f60 0x7fab0406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:12.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.819+0000 7fab19d9b700 1 --2- 172.21.15.88:0/757483231 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab04068f60 0x7fab0406b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fab10009fd0 tx=0x7fab10009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:12.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:12.823+0000 7fab0affd700 1 -- 172.21.15.88:0/757483231 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fab0c056ce0 con 0x7fab1c0fbb40 2023-12-09T02:32:13.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.059+0000 7fab20d10700 1 -- 172.21.15.88:0/757483231 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fab1c10ed30 con 0x7fab1c0fbb40 2023-12-09T02:32:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.062+0000 7fab0affd700 1 -- 172.21.15.88:0/757483231 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166773 (secure 0 0 0) 0x7fab0c056870 con 0x7fab1c0fbb40 2023-12-09T02:32:13.066 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:13.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.064+0000 7fab20d10700 1 -- 172.21.15.88:0/757483231 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab04068f60 msgr2=0x7fab0406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:13.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.064+0000 7fab20d10700 1 --2- 172.21.15.88:0/757483231 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab04068f60 0x7fab0406b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fab10009fd0 tx=0x7fab10009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.064+0000 7fab20d10700 1 -- 172.21.15.88:0/757483231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab1c0fbb40 msgr2=0x7fab1c113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.064+0000 7fab20d10700 1 --2- 172.21.15.88:0/757483231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab1c0fbb40 0x7fab1c113750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fab0c00b790 tx=0x7fab0c009250 comp rx=0 tx=0).stop 2023-12-09T02:32:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.064+0000 7fab20d10700 1 -- 172.21.15.88:0/757483231 shutdown_connections 2023-12-09T02:32:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.064+0000 7fab20d10700 1 --2- 172.21.15.88:0/757483231 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab04068f60 0x7fab0406b410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.064+0000 7fab20d10700 1 --2- 172.21.15.88:0/757483231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab1c0fbb40 0x7fab1c113750 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.064+0000 7fab20d10700 1 --2- 172.21.15.88:0/757483231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c101b00 0x7fab1c113c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.064+0000 7fab20d10700 1 -- 172.21.15.88:0/757483231 >> 172.21.15.88:0/757483231 conn(0x7fab1c0719b0 msgr2=0x7fab1c0653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.064+0000 7fab20d10700 1 -- 172.21.15.88:0/757483231 shutdown_connections 2023-12-09T02:32:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:13.064+0000 7fab20d10700 1 -- 172.21.15.88:0/757483231 wait complete. 2023-12-09T02:32:13.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:13 smithi161 ceph-mon[121170]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:13.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:13 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/757483231' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-09T02:32:13.435 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:13 smithi088 ceph-mon[112028]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:13.435 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:13 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/757483231' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-09T02:32:13.437 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"active_gid":14208,"active_name":"smithi088.jwlofb","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":563213166},{"type":"v1","addr":"172.21.15.88:6801","nonce":563213166}]},"active_addr":"172.21.15.88:6801/563213166","active_change":"2023-12-09T02:29:31.504612+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14228,"name":"smithi161.qmxtmg","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.88:8443/","prometheus":"http://172.21.15.88:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":1149962254}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":521564869}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":2723285069}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":3827350097}]}]} 2023-12-09T02:32:13.440 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-09T02:32:13.440 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-09T02:32:13.441 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-09T02:32:13.706 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:14.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.732+0000 7f15fb1d3700 1 -- 172.21.15.88:0/1687720078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15f40fc300 msgr2=0x7f15f4109060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:14.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.732+0000 7f15fb1d3700 1 --2- 172.21.15.88:0/1687720078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15f40fc300 0x7f15f4109060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f15e0004940 tx=0x7f15e0009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:14.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.732+0000 7f15fb1d3700 1 -- 172.21.15.88:0/1687720078 shutdown_connections 2023-12-09T02:32:14.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.732+0000 7f15fb1d3700 1 --2- 172.21.15.88:0/1687720078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15f40fc300 0x7f15f4109060 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.732+0000 7f15fb1d3700 1 --2- 172.21.15.88:0/1687720078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f40fb9f0 0x7f15f40fbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.732+0000 7f15fb1d3700 1 -- 172.21.15.88:0/1687720078 >> 172.21.15.88:0/1687720078 conn(0x7f15f40f76c0 msgr2=0x7f15f40f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.732+0000 7f15fb1d3700 1 -- 172.21.15.88:0/1687720078 shutdown_connections 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.732+0000 7f15fb1d3700 1 -- 172.21.15.88:0/1687720078 wait complete. 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.733+0000 7f15fb1d3700 1 Processor -- start 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.733+0000 7f15fb1d3700 1 -- start start 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.733+0000 7f15fb1d3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f40fb9f0 0x7f15f41158a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.733+0000 7f15fb1d3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15f40fc300 0x7f15f4115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.733+0000 7f15fb1d3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f41164c0 con 0x7f15f40fc300 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.733+0000 7f15fb1d3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f410f760 con 0x7f15f40fb9f0 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.733+0000 7f15f3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15f40fc300 0x7f15f4115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.733+0000 7f15f3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15f40fc300 0x7f15f4115de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33796/0 (socket says 172.21.15.88:33796) 2023-12-09T02:32:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.733+0000 7f15f3fff700 1 -- 172.21.15.88:0/3819481510 learned_addr learned my addr 172.21.15.88:0/3819481510 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.733+0000 7f15f8f6f700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f40fb9f0 0x7f15f41158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.734+0000 7f15f3fff700 1 -- 172.21.15.88:0/3819481510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f40fb9f0 msgr2=0x7f15f41158a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.734+0000 7f15f3fff700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f40fb9f0 0x7f15f41158a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.734+0000 7f15f3fff700 1 -- 172.21.15.88:0/3819481510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e0005040 con 0x7f15f40fc300 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.734+0000 7f15f8f6f700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f40fb9f0 0x7f15f41158a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.734+0000 7f15f3fff700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15f40fc300 0x7f15f4115de0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009150 tx=0x7f15e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.734+0000 7f15f17fa700 1 -- 172.21.15.88:0/3819481510 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15e000e040 con 0x7f15f40fc300 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.734+0000 7f15fb1d3700 1 -- 172.21.15.88:0/3819481510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f410f9e0 con 0x7f15f40fc300 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.734+0000 7f15f17fa700 1 -- 172.21.15.88:0/3819481510 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15e0013420 con 0x7f15f40fc300 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.734+0000 7f15f17fa700 1 -- 172.21.15.88:0/3819481510 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15e001c630 con 0x7f15f40fc300 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.734+0000 7f15fb1d3700 1 -- 172.21.15.88:0/3819481510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f410ff20 con 0x7f15f40fc300 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.735+0000 7f15fb1d3700 1 -- 172.21.15.88:0/3819481510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f4106790 con 0x7f15f40fc300 2023-12-09T02:32:14.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.735+0000 7f15f17fa700 1 -- 172.21.15.88:0/3819481510 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f15e001c8f0 con 0x7f15f40fc300 2023-12-09T02:32:14.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.735+0000 7f15f17fa700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f15e4068f60 0x7f15e406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:14.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.736+0000 7f15f17fa700 1 -- 172.21.15.88:0/3819481510 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f15e0087d10 con 0x7f15f40fc300 2023-12-09T02:32:14.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.736+0000 7f15f8f6f700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f15e4068f60 0x7f15e406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:14.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.736+0000 7f15f8f6f700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f15e4068f60 0x7f15e406b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f15e8006fd0 tx=0x7f15e8008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:14.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.740+0000 7f15f17fa700 1 -- 172.21.15.88:0/3819481510 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f15e0058020 con 0x7f15f40fc300 2023-12-09T02:32:14.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.922+0000 7f15fb1d3700 1 -- 172.21.15.88:0/3819481510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15f404bb80 con 0x7f15f40fc300 2023-12-09T02:32:14.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.922+0000 7f15f17fa700 1 -- 172.21.15.88:0/3819481510 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11096 (secure 0 0 0) 0x7f15e005d070 con 0x7f15f40fc300 2023-12-09T02:32:14.925 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:14.925 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":40,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","created":"2023-12-09T02:27:49.802100+0000","modified":"2023-12-09T02:32:02.969269+0000","last_up_change":"2023-12-09T02:32:01.964039+0000","last_in_change":"2023-12-09T02:31:45.877281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-09T02:31:07.797033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"94c4c8ad-f87e-4abd-aff2-ea13d8630f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6803","nonce":4163243891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6805","nonce":4163243891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6809","nonce":4163243891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6807","nonce":4163243891}]},"public_addr":"172.21.15.88:6803/4163243891","cluster_addr":"172.21.15.88:6805/4163243891","heartbeat_back_addr":"172.21.15.88:6809/4163243891","heartbeat_front_addr":"172.21.15.88:6807/4163243891","state":["exists","up"]},{"osd":1,"uuid":"1b6c3137-e616-4979-a9cb-89665a8a2919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6811","nonce":1049229781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6813","nonce":1049229781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6817","nonce":1049229781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6815","nonce":1049229781}]},"public_addr":"172.21.15.88:6811/1049229781","cluster_addr":"172.21.15.88:6813/1049229781","heartbeat_back_addr":"172.21.15.88:6817/1049229781","heartbeat_front_addr":"172.21.15.88:6815/1049229781","state":["exists","up"]},{"osd":2,"uuid":"c5d0b176-113f-450a-8737-2dcf542f1f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6819","nonce":2614314803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6821","nonce":2614314803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6825","nonce":2614314803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6823","nonce":2614314803}]},"public_addr":"172.21.15.88:6819/2614314803","cluster_addr":"172.21.15.88:6821/2614314803","heartbeat_back_addr":"172.21.15.88:6825/2614314803","heartbeat_front_addr":"172.21.15.88:6823/2614314803","state":["exists","up"]},{"osd":3,"uuid":"6584d86c-84e6-4f9e-a481-d297f6892df8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6801","nonce":1856287356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6803","nonce":1856287356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6807","nonce":1856287356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6805","nonce":1856287356}]},"public_addr":"172.21.15.161:6801/1856287356","cluster_addr":"172.21.15.161:6803/1856287356","heartbeat_back_addr":"172.21.15.161:6807/1856287356","heartbeat_front_addr":"172.21.15.161:6805/1856287356","state":["exists","up"]},{"osd":4,"uuid":"729b6d7a-8045-40d4-b07d-aa8d8912a357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6809","nonce":1385340150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6811","nonce":1385340150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6815","nonce":1385340150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6813","nonce":1385340150}]},"public_addr":"172.21.15.161:6809/1385340150","cluster_addr":"172.21.15.161:6811/1385340150","heartbeat_back_addr":"172.21.15.161:6815/1385340150","heartbeat_front_addr":"172.21.15.161:6813/1385340150","state":["exists","up"]},{"osd":5,"uuid":"973d7656-a340-4dc0-a2df-7cd3c96df604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6817","nonce":2958715517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6819","nonce":2958715517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6823","nonce":2958715517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6821","nonce":2958715517}]},"public_addr":"172.21.15.161:6817/2958715517","cluster_addr":"172.21.15.161:6819/2958715517","heartbeat_back_addr":"172.21.15.161:6823/2958715517","heartbeat_front_addr":"172.21.15.161:6821/2958715517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:24.723561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:44.412595+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:04.087324+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:22.198894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:41.741094+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:32:00.865763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6801/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.88:6800/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/3372513144":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/2622749836":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/2387855456":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/1114065717":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/2588418845":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/2169163782":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6800/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.88:6800/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6801/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/2691791328":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/1442782127":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6801/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/712942340":"2023-12-10T02:28:42.918100+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-09T02:32:14.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.924+0000 7f15fb1d3700 1 -- 172.21.15.88:0/3819481510 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f15e4068f60 msgr2=0x7f15e406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:14.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.924+0000 7f15fb1d3700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f15e4068f60 0x7f15e406b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f15e8006fd0 tx=0x7f15e8008040 comp rx=0 tx=0).stop 2023-12-09T02:32:14.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.924+0000 7f15fb1d3700 1 -- 172.21.15.88:0/3819481510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15f40fc300 msgr2=0x7f15f4115de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:14.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.924+0000 7f15fb1d3700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15f40fc300 0x7f15f4115de0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009150 tx=0x7f15e0009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:14.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.925+0000 7f15fb1d3700 1 -- 172.21.15.88:0/3819481510 shutdown_connections 2023-12-09T02:32:14.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.925+0000 7f15fb1d3700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f40fb9f0 0x7f15f41158a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:14.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.925+0000 7f15fb1d3700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f15e4068f60 0x7f15e406b410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:14.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.925+0000 7f15fb1d3700 1 --2- 172.21.15.88:0/3819481510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15f40fc300 0x7f15f4115de0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:14.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.925+0000 7f15fb1d3700 1 -- 172.21.15.88:0/3819481510 >> 172.21.15.88:0/3819481510 conn(0x7f15f40f76c0 msgr2=0x7f15f40f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:14.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.925+0000 7f15fb1d3700 1 -- 172.21.15.88:0/3819481510 shutdown_connections 2023-12-09T02:32:14.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:14.925+0000 7f15fb1d3700 1 -- 172.21.15.88:0/3819481510 wait complete. 2023-12-09T02:32:15.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:15 smithi088 ceph-mon[112028]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:15.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:15 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3819481510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:32:15.302 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-09T02:32:15.302 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-09T02:32:15.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:15 smithi161 ceph-mon[121170]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:15.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:15 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3819481510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:32:15.562 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:16.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.515+0000 7fabac3f5700 1 -- 172.21.15.88:0/3599270448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faba40fbb40 msgr2=0x7faba40fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:16.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.515+0000 7fabac3f5700 1 --2- 172.21.15.88:0/3599270448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faba40fbb40 0x7faba40fbfb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faba0004940 tx=0x7faba0009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.515+0000 7fabac3f5700 1 -- 172.21.15.88:0/3599270448 shutdown_connections 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.515+0000 7fabac3f5700 1 --2- 172.21.15.88:0/3599270448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faba40fbb40 0x7faba40fbfb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.515+0000 7fabac3f5700 1 --2- 172.21.15.88:0/3599270448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faba4101b00 0x7faba4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.515+0000 7fabac3f5700 1 -- 172.21.15.88:0/3599270448 >> 172.21.15.88:0/3599270448 conn(0x7faba40719b0 msgr2=0x7faba4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.515+0000 7fabac3f5700 1 -- 172.21.15.88:0/3599270448 shutdown_connections 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.515+0000 7fabac3f5700 1 -- 172.21.15.88:0/3599270448 wait complete. 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7fabac3f5700 1 Processor -- start 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7fabac3f5700 1 -- start start 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7fabac3f5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faba40fbb40 0x7faba40fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7fabac3f5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faba4101b00 0x7faba40fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7fabac3f5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40fe260 con 0x7faba4101b00 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7fabac3f5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40fe3d0 con 0x7faba40fbb40 2023-12-09T02:32:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7faba9990700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faba4101b00 0x7faba40fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7faba9990700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faba4101b00 0x7faba40fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58490/0 (socket says 172.21.15.88:58490) 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7faba9990700 1 -- 172.21.15.88:0/561106599 learned_addr learned my addr 172.21.15.88:0/561106599 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7fabaa191700 1 --2- 172.21.15.88:0/561106599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faba40fbb40 0x7faba40fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7faba9990700 1 -- 172.21.15.88:0/561106599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faba40fbb40 msgr2=0x7faba40fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7faba9990700 1 --2- 172.21.15.88:0/561106599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faba40fbb40 0x7faba40fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.516+0000 7faba9990700 1 -- 172.21.15.88:0/561106599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0005040 con 0x7faba4101b00 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.517+0000 7faba9990700 1 --2- 172.21.15.88:0/561106599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faba4101b00 0x7faba40fdc60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faba0009fd0 tx=0x7faba0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.517+0000 7fab9affd700 1 -- 172.21.15.88:0/561106599 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faba000e040 con 0x7faba4101b00 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.517+0000 7fab9affd700 1 -- 172.21.15.88:0/561106599 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faba0013420 con 0x7faba4101b00 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.517+0000 7fabac3f5700 1 -- 172.21.15.88:0/561106599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba41198d0 con 0x7faba4101b00 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.517+0000 7fab9affd700 1 -- 172.21.15.88:0/561106599 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faba001c630 con 0x7faba4101b00 2023-12-09T02:32:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.517+0000 7fabac3f5700 1 -- 172.21.15.88:0/561106599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba4119d30 con 0x7faba4101b00 2023-12-09T02:32:16.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.518+0000 7fabac3f5700 1 -- 172.21.15.88:0/561106599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba40734d0 con 0x7faba4101b00 2023-12-09T02:32:16.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.518+0000 7fab9affd700 1 -- 172.21.15.88:0/561106599 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7faba0013590 con 0x7faba4101b00 2023-12-09T02:32:16.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.519+0000 7fab9affd700 1 --2- 172.21.15.88:0/561106599 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab90068f70 0x7fab9006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:16.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.519+0000 7fab9affd700 1 -- 172.21.15.88:0/561106599 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faba0088750 con 0x7faba4101b00 2023-12-09T02:32:16.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.519+0000 7fabaa191700 1 --2- 172.21.15.88:0/561106599 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab90068f70 0x7fab9006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:16.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.519+0000 7fabaa191700 1 --2- 172.21.15.88:0/561106599 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab90068f70 0x7fab9006b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab94004f40 tx=0x7fab9400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:16.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.523+0000 7fab9affd700 1 -- 172.21.15.88:0/561106599 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faba0055000 con 0x7faba4101b00 2023-12-09T02:32:16.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.709+0000 7fabac3f5700 1 -- 172.21.15.88:0/561106599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faba4108ab0 con 0x7faba4101b00 2023-12-09T02:32:16.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.710+0000 7fab9affd700 1 -- 172.21.15.88:0/561106599 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11096 (secure 0 0 0) 0x7faba0024360 con 0x7faba4101b00 2023-12-09T02:32:16.712 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:16.712 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":40,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","created":"2023-12-09T02:27:49.802100+0000","modified":"2023-12-09T02:32:02.969269+0000","last_up_change":"2023-12-09T02:32:01.964039+0000","last_in_change":"2023-12-09T02:31:45.877281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-09T02:31:07.797033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"94c4c8ad-f87e-4abd-aff2-ea13d8630f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6803","nonce":4163243891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6805","nonce":4163243891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6809","nonce":4163243891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6807","nonce":4163243891}]},"public_addr":"172.21.15.88:6803/4163243891","cluster_addr":"172.21.15.88:6805/4163243891","heartbeat_back_addr":"172.21.15.88:6809/4163243891","heartbeat_front_addr":"172.21.15.88:6807/4163243891","state":["exists","up"]},{"osd":1,"uuid":"1b6c3137-e616-4979-a9cb-89665a8a2919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6811","nonce":1049229781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6813","nonce":1049229781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6817","nonce":1049229781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6815","nonce":1049229781}]},"public_addr":"172.21.15.88:6811/1049229781","cluster_addr":"172.21.15.88:6813/1049229781","heartbeat_back_addr":"172.21.15.88:6817/1049229781","heartbeat_front_addr":"172.21.15.88:6815/1049229781","state":["exists","up"]},{"osd":2,"uuid":"c5d0b176-113f-450a-8737-2dcf542f1f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6819","nonce":2614314803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6821","nonce":2614314803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6825","nonce":2614314803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6823","nonce":2614314803}]},"public_addr":"172.21.15.88:6819/2614314803","cluster_addr":"172.21.15.88:6821/2614314803","heartbeat_back_addr":"172.21.15.88:6825/2614314803","heartbeat_front_addr":"172.21.15.88:6823/2614314803","state":["exists","up"]},{"osd":3,"uuid":"6584d86c-84e6-4f9e-a481-d297f6892df8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6801","nonce":1856287356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6803","nonce":1856287356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6807","nonce":1856287356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6805","nonce":1856287356}]},"public_addr":"172.21.15.161:6801/1856287356","cluster_addr":"172.21.15.161:6803/1856287356","heartbeat_back_addr":"172.21.15.161:6807/1856287356","heartbeat_front_addr":"172.21.15.161:6805/1856287356","state":["exists","up"]},{"osd":4,"uuid":"729b6d7a-8045-40d4-b07d-aa8d8912a357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6809","nonce":1385340150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6811","nonce":1385340150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6815","nonce":1385340150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6813","nonce":1385340150}]},"public_addr":"172.21.15.161:6809/1385340150","cluster_addr":"172.21.15.161:6811/1385340150","heartbeat_back_addr":"172.21.15.161:6815/1385340150","heartbeat_front_addr":"172.21.15.161:6813/1385340150","state":["exists","up"]},{"osd":5,"uuid":"973d7656-a340-4dc0-a2df-7cd3c96df604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6817","nonce":2958715517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6819","nonce":2958715517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6823","nonce":2958715517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6821","nonce":2958715517}]},"public_addr":"172.21.15.161:6817/2958715517","cluster_addr":"172.21.15.161:6819/2958715517","heartbeat_back_addr":"172.21.15.161:6823/2958715517","heartbeat_front_addr":"172.21.15.161:6821/2958715517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:24.723561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:44.412595+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:04.087324+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:22.198894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:41.741094+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:32:00.865763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6801/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.88:6800/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/3372513144":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/2622749836":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/2387855456":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/1114065717":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/2588418845":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/2169163782":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6800/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.88:6800/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6801/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/2691791328":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/1442782127":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6801/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/712942340":"2023-12-10T02:28:42.918100+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-09T02:32:16.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.712+0000 7fabac3f5700 1 -- 172.21.15.88:0/561106599 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab90068f70 msgr2=0x7fab9006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:16.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.712+0000 7fabac3f5700 1 --2- 172.21.15.88:0/561106599 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab90068f70 0x7fab9006b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab94004f40 tx=0x7fab9400b040 comp rx=0 tx=0).stop 2023-12-09T02:32:16.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.712+0000 7fabac3f5700 1 -- 172.21.15.88:0/561106599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faba4101b00 msgr2=0x7faba40fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:16.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.712+0000 7fabac3f5700 1 --2- 172.21.15.88:0/561106599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faba4101b00 0x7faba40fdc60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faba0009fd0 tx=0x7faba0009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:16.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.712+0000 7fabac3f5700 1 -- 172.21.15.88:0/561106599 shutdown_connections 2023-12-09T02:32:16.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.712+0000 7fabac3f5700 1 --2- 172.21.15.88:0/561106599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faba40fbb40 0x7faba40fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:16.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.712+0000 7fabac3f5700 1 --2- 172.21.15.88:0/561106599 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fab90068f70 0x7fab9006b420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:16.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.712+0000 7fabac3f5700 1 --2- 172.21.15.88:0/561106599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faba4101b00 0x7faba40fdc60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:16.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.712+0000 7fabac3f5700 1 -- 172.21.15.88:0/561106599 >> 172.21.15.88:0/561106599 conn(0x7faba40719b0 msgr2=0x7faba40654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:16.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.712+0000 7fabac3f5700 1 -- 172.21.15.88:0/561106599 shutdown_connections 2023-12-09T02:32:16.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:16.712+0000 7fabac3f5700 1 -- 172.21.15.88:0/561106599 wait complete. 2023-12-09T02:32:17.078 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-09T02:32:17.079 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-09T02:32:17.079 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-09T02:32:17.080 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-09T02:32:17.080 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-09T02:32:17.080 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-09T02:32:17.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:17 smithi161 ceph-mon[121170]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:17.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:17 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:32:17.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:17 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/561106599' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:32:17.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:17 smithi088 ceph-mon[112028]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:17.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:17 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:32:17.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:17 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/561106599' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:32:17.524 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:17.568 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:17.983 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:18.236 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:18.643 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:19.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:19 smithi088 ceph-mon[112028]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:19.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:19 smithi161 ceph-mon[121170]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:19.484 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.699+0000 7f0f85687700 1 -- 172.21.15.88:0/172804177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f80065390 msgr2=0x7f0f80065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.699+0000 7f0f85687700 1 --2- 172.21.15.88:0/172804177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f80065390 0x7f0f80065800 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f74004940 tx=0x7f0f74009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.699+0000 7f0f85687700 1 -- 172.21.15.88:0/172804177 shutdown_connections 2023-12-09T02:32:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.699+0000 7f0f85687700 1 --2- 172.21.15.88:0/172804177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f80065390 0x7f0f80065800 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.699+0000 7f0f85687700 1 --2- 172.21.15.88:0/172804177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f80102c20 0x7f0f80102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.699+0000 7f0f85687700 1 -- 172.21.15.88:0/172804177 >> 172.21.15.88:0/172804177 conn(0x7f0f800719b0 msgr2=0x7f0f80071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.699+0000 7f0f85687700 1 -- 172.21.15.88:0/172804177 shutdown_connections 2023-12-09T02:32:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.699+0000 7f0f85687700 1 -- 172.21.15.88:0/172804177 wait complete. 2023-12-09T02:32:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.699+0000 7f0f85687700 1 Processor -- start 2023-12-09T02:32:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.699+0000 7f0f85687700 1 -- start start 2023-12-09T02:32:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f85687700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f80065390 0x7f0f801136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f85687700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f80102c20 0x7f0f80113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f85687700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8010d570 con 0x7f0f80102c20 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f85687700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8010d6e0 con 0x7f0f80065390 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f7e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f80102c20 0x7f0f80113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f7e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f80102c20 0x7f0f80113c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58516/0 (socket says 172.21.15.88:58516) 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f7e7fc700 1 -- 172.21.15.88:0/1131882819 learned_addr learned my addr 172.21.15.88:0/1131882819 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f7effd700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f80065390 0x7f0f801136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f7e7fc700 1 -- 172.21.15.88:0/1131882819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f80065390 msgr2=0x7f0f801136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f7e7fc700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f80065390 0x7f0f801136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f7e7fc700 1 -- 172.21.15.88:0/1131882819 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74005040 con 0x7f0f80102c20 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f7e7fc700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f80102c20 0x7f0f80113c30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400b3b0 tx=0x7f0f74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f677fe700 1 -- 172.21.15.88:0/1131882819 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f7400e040 con 0x7f0f80102c20 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f85687700 1 -- 172.21.15.88:0/1131882819 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8010d960 con 0x7f0f80102c20 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f677fe700 1 -- 172.21.15.88:0/1131882819 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f7400bc50 con 0x7f0f80102c20 2023-12-09T02:32:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.700+0000 7f0f677fe700 1 -- 172.21.15.88:0/1131882819 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f74013420 con 0x7f0f80102c20 2023-12-09T02:32:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.701+0000 7f0f85687700 1 -- 172.21.15.88:0/1131882819 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8010dea0 con 0x7f0f80102c20 2023-12-09T02:32:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.701+0000 7f0f85687700 1 -- 172.21.15.88:0/1131882819 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f8010e340 con 0x7f0f80102c20 2023-12-09T02:32:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.702+0000 7f0f677fe700 1 -- 172.21.15.88:0/1131882819 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0f7401c430 con 0x7f0f80102c20 2023-12-09T02:32:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.702+0000 7f0f677fe700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0f6806d3c0 0x7f0f6806f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.702+0000 7f0f677fe700 1 -- 172.21.15.88:0/1131882819 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0f740883f0 con 0x7f0f80102c20 2023-12-09T02:32:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.702+0000 7f0f7effd700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0f6806d3c0 0x7f0f6806f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.702+0000 7f0f677fe700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803] conn(0x7f0f68073090 0x7f0f680754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.702+0000 7f0f677fe700 1 -- 172.21.15.88:0/1131882819 --> [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f68075b50 con 0x7f0f68073090 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.702+0000 7f0f677fe700 1 -- 172.21.15.88:0/1131882819 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f74088720 con 0x7f0f80102c20 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.703+0000 7f0f7f7fe700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803] conn(0x7f0f68073090 0x7f0f680754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.703+0000 7f0f7effd700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0f6806d3c0 0x7f0f6806f870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f70006fd0 tx=0x7f0f70008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.703+0000 7f0f7f7fe700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803] conn(0x7f0f68073090 0x7f0f680754a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.703+0000 7f0f677fe700 1 -- 172.21.15.88:0/1131882819 <== osd.2 v2:172.21.15.88:6818/2614314803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0f68075b50 con 0x7f0f68073090 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.719+0000 7f0f85687700 1 -- 172.21.15.88:0/1131882819 --> [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f8005e2c0 con 0x7f0f68073090 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.720+0000 7f0f677fe700 1 -- 172.21.15.88:0/1131882819 <== osd.2 v2:172.21.15.88:6818/2614314803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f8005e2c0 con 0x7f0f68073090 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 -- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803] conn(0x7f0f68073090 msgr2=0x7f0f680754a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803] conn(0x7f0f68073090 0x7f0f680754a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 -- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0f6806d3c0 msgr2=0x7f0f6806f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0f6806d3c0 0x7f0f6806f870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f70006fd0 tx=0x7f0f70008040 comp rx=0 tx=0).stop 2023-12-09T02:32:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 -- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f80102c20 msgr2=0x7f0f80113c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f80102c20 0x7f0f80113c30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400b3b0 tx=0x7f0f74009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 -- 172.21.15.88:0/1131882819 shutdown_connections 2023-12-09T02:32:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6818/2614314803,v1:172.21.15.88:6819/2614314803] conn(0x7f0f68073090 0x7f0f680754a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f80065390 0x7f0f801136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0f6806d3c0 0x7f0f6806f870 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f70006fd0 tx=0x7f0f70008040 comp rx=0 tx=0).stop 2023-12-09T02:32:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 --2- 172.21.15.88:0/1131882819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f80102c20 0x7f0f80113c30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.721+0000 7f0f85687700 1 -- 172.21.15.88:0/1131882819 >> 172.21.15.88:0/1131882819 conn(0x7f0f800719b0 msgr2=0x7f0f800fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.722+0000 7f0f85687700 1 -- 172.21.15.88:0/1131882819 shutdown_connections 2023-12-09T02:32:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.722+0000 7f0f85687700 1 -- 172.21.15.88:0/1131882819 wait complete. 2023-12-09T02:32:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:81604378642 2023-12-09T02:32:20.713 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-09T02:32:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.751+0000 7f9696854700 1 -- 172.21.15.88:0/3697696619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9690070890 msgr2=0x7f9690108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.751+0000 7f9696854700 1 --2- 172.21.15.88:0/3697696619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9690070890 0x7f9690108f70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9684004970 tx=0x7f9684009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.751+0000 7f9696854700 1 -- 172.21.15.88:0/3697696619 shutdown_connections 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.751+0000 7f9696854700 1 --2- 172.21.15.88:0/3697696619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9690070890 0x7f9690108f70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.751+0000 7f9696854700 1 --2- 172.21.15.88:0/3697696619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f969006ff80 0x7f9690070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.751+0000 7f9696854700 1 -- 172.21.15.88:0/3697696619 >> 172.21.15.88:0/3697696619 conn(0x7f96900f8790 msgr2=0x7f96900faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.751+0000 7f9696854700 1 -- 172.21.15.88:0/3697696619 shutdown_connections 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.751+0000 7f9696854700 1 -- 172.21.15.88:0/3697696619 wait complete. 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.752+0000 7f9696854700 1 Processor -- start 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.752+0000 7f9696854700 1 -- start start 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.752+0000 7f9696854700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f969006ff80 0x7f9690115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.752+0000 7f9696854700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9690070890 0x7f9690115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.752+0000 7f9696854700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96901163b0 con 0x7f969006ff80 2023-12-09T02:32:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.752+0000 7f9696854700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969010f6e0 con 0x7f9690070890 2023-12-09T02:32:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f969006ff80 0x7f9690115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f969006ff80 0x7f9690115820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58554/0 (socket says 172.21.15.88:58554) 2023-12-09T02:32:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968ffff700 1 -- 172.21.15.88:0/1862558703 learned_addr learned my addr 172.21.15.88:0/1862558703 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968f7fe700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9690070890 0x7f9690115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968ffff700 1 -- 172.21.15.88:0/1862558703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9690070890 msgr2=0x7f9690115d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968ffff700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9690070890 0x7f9690115d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968ffff700 1 -- 172.21.15.88:0/1862558703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684005040 con 0x7f969006ff80 2023-12-09T02:32:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968f7fe700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9690070890 0x7f9690115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:32:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968ffff700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f969006ff80 0x7f9690115820 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9680002a50 tx=0x7f96800046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968cff9700 1 -- 172.21.15.88:0/1862558703 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9680007cc0 con 0x7f969006ff80 2023-12-09T02:32:20.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968cff9700 1 -- 172.21.15.88:0/1862558703 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f968000f040 con 0x7f969006ff80 2023-12-09T02:32:20.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f9696854700 1 -- 172.21.15.88:0/1862558703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969010f9c0 con 0x7f969006ff80 2023-12-09T02:32:20.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f968cff9700 1 -- 172.21.15.88:0/1862558703 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9680009540 con 0x7f969006ff80 2023-12-09T02:32:20.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.753+0000 7f9696854700 1 -- 172.21.15.88:0/1862558703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969010fed0 con 0x7f969006ff80 2023-12-09T02:32:20.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.754+0000 7f9696854700 1 -- 172.21.15.88:0/1862558703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9690110300 con 0x7f969006ff80 2023-12-09T02:32:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.755+0000 7f968cff9700 1 -- 172.21.15.88:0/1862558703 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f96800096a0 con 0x7f969006ff80 2023-12-09T02:32:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.755+0000 7f968cff9700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9678068f60 0x7f967806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.755+0000 7f968cff9700 1 -- 172.21.15.88:0/1862558703 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f96800872f0 con 0x7f969006ff80 2023-12-09T02:32:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.755+0000 7f968f7fe700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9678068f60 0x7f967806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.755+0000 7f968cff9700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517] conn(0x7f967806ec30 0x7f9678071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.755+0000 7f968cff9700 1 -- 172.21.15.88:0/1862558703 --> [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96780716f0 con 0x7f967806ec30 2023-12-09T02:32:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.755+0000 7f968cff9700 1 -- 172.21.15.88:0/1862558703 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96800876d0 con 0x7f969006ff80 2023-12-09T02:32:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.756+0000 7f968f7fe700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9678068f60 0x7f967806b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9684004f50 tx=0x7f9684009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.756+0000 7f9694df1700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517] conn(0x7f967806ec30 0x7f9678071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.756+0000 7f9694df1700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517] conn(0x7f967806ec30 0x7f9678071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.757+0000 7f968cff9700 1 -- 172.21.15.88:0/1862558703 <== osd.5 v2:172.21.15.161:6816/2958715517 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f96780716f0 con 0x7f967806ec30 2023-12-09T02:32:20.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.772+0000 7f9696854700 1 -- 172.21.15.88:0/1862558703 --> [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f96900fc390 con 0x7f967806ec30 2023-12-09T02:32:20.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.772+0000 7f968cff9700 1 -- 172.21.15.88:0/1862558703 <== osd.5 v2:172.21.15.161:6816/2958715517 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f96900fc390 con 0x7f967806ec30 2023-12-09T02:32:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 -- 172.21.15.88:0/1862558703 >> [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517] conn(0x7f967806ec30 msgr2=0x7f9678071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517] conn(0x7f967806ec30 0x7f9678071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 -- 172.21.15.88:0/1862558703 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9678068f60 msgr2=0x7f967806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9678068f60 0x7f967806b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9684004f50 tx=0x7f9684009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 -- 172.21.15.88:0/1862558703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f969006ff80 msgr2=0x7f9690115820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f969006ff80 0x7f9690115820 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9680002a50 tx=0x7f96800046b0 comp rx=0 tx=0).stop 2023-12-09T02:32:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 -- 172.21.15.88:0/1862558703 shutdown_connections 2023-12-09T02:32:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.161:6816/2958715517,v1:172.21.15.161:6817/2958715517] conn(0x7f967806ec30 0x7f9678071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9678068f60 0x7f967806b410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f969006ff80 0x7f9690115820 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 --2- 172.21.15.88:0/1862558703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9690070890 0x7f9690115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 -- 172.21.15.88:0/1862558703 >> 172.21.15.88:0/1862558703 conn(0x7f96900f8790 msgr2=0x7f96901037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 -- 172.21.15.88:0/1862558703 shutdown_connections 2023-12-09T02:32:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:20.773+0000 7f9696854700 1 -- 172.21.15.88:0/1862558703 wait complete. 2023-12-09T02:32:21.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.708+0000 7fcb77237700 1 -- 172.21.15.88:0/1006965341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb700fdc50 msgr2=0x7fcb700fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:21.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.708+0000 7fcb77237700 1 --2- 172.21.15.88:0/1006965341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb700fdc50 0x7fcb700fe020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcb64004940 tx=0x7fcb64009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.708+0000 7fcb77237700 1 -- 172.21.15.88:0/1006965341 shutdown_connections 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.708+0000 7fcb77237700 1 --2- 172.21.15.88:0/1006965341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb700fe5f0 0x7fcb70106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.708+0000 7fcb77237700 1 --2- 172.21.15.88:0/1006965341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb700fdc50 0x7fcb700fe020 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.708+0000 7fcb77237700 1 -- 172.21.15.88:0/1006965341 >> 172.21.15.88:0/1006965341 conn(0x7fcb700f7680 msgr2=0x7fcb700f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.708+0000 7fcb77237700 1 -- 172.21.15.88:0/1006965341 shutdown_connections 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.709+0000 7fcb77237700 1 -- 172.21.15.88:0/1006965341 wait complete. 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.709+0000 7fcb77237700 1 Processor -- start 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.709+0000 7fcb77237700 1 -- start start 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.709+0000 7fcb77237700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb700fdc50 0x7fcb70113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.709+0000 7fcb77237700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb700fe5f0 0x7fcb70113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.709+0000 7fcb77237700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb70114230 con 0x7fcb700fe5f0 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.709+0000 7fcb77237700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7010d520 con 0x7fcb700fdc50 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb6ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb700fe5f0 0x7fcb70113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb6ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb700fe5f0 0x7fcb70113be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58536/0 (socket says 172.21.15.88:58536) 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb6ffff700 1 -- 172.21.15.88:0/2367960026 learned_addr learned my addr 172.21.15.88:0/2367960026 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb74fd3700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb700fdc50 0x7fcb70113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb6ffff700 1 -- 172.21.15.88:0/2367960026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb700fdc50 msgr2=0x7fcb70113660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb6ffff700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb700fdc50 0x7fcb70113660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb6ffff700 1 -- 172.21.15.88:0/2367960026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb64005040 con 0x7fcb700fe5f0 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb6ffff700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb700fe5f0 0x7fcb70113be0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00c8c0 tx=0x7fcb5c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb6d7fa700 1 -- 172.21.15.88:0/2367960026 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5c00a980 con 0x7fcb700fe5f0 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb77237700 1 -- 172.21.15.88:0/2367960026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7010d7b0 con 0x7fcb700fe5f0 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb6d7fa700 1 -- 172.21.15.88:0/2367960026 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb5c00ce60 con 0x7fcb700fe5f0 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb6d7fa700 1 -- 172.21.15.88:0/2367960026 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5c0113a0 con 0x7fcb700fe5f0 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.710+0000 7fcb77237700 1 -- 172.21.15.88:0/2367960026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7010dcf0 con 0x7fcb700fe5f0 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.711+0000 7fcb77237700 1 -- 172.21.15.88:0/2367960026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb7010e1f0 con 0x7fcb700fe5f0 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.712+0000 7fcb6d7fa700 1 -- 172.21.15.88:0/2367960026 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcb5c012400 con 0x7fcb700fe5f0 2023-12-09T02:32:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.712+0000 7fcb6d7fa700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb60068f60 0x7fcb6006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.712+0000 7fcb6d7fa700 1 -- 172.21.15.88:0/2367960026 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcb5c086ba0 con 0x7fcb700fe5f0 2023-12-09T02:32:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.712+0000 7fcb74fd3700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb60068f60 0x7fcb6006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.712+0000 7fcb6d7fa700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356] conn(0x7fcb6006ec30 0x7fcb60071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.712+0000 7fcb6d7fa700 1 -- 172.21.15.88:0/2367960026 --> [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb600716f0 con 0x7fcb6006ec30 2023-12-09T02:32:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.712+0000 7fcb6d7fa700 1 -- 172.21.15.88:0/2367960026 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb5c08c200 con 0x7fcb700fe5f0 2023-12-09T02:32:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.712+0000 7fcb74fd3700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb60068f60 0x7fcb6006b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400b3b0 tx=0x7fcb64009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.712+0000 7fcb757d4700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356] conn(0x7fcb6006ec30 0x7fcb60071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.713+0000 7fcb757d4700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356] conn(0x7fcb6006ec30 0x7fcb60071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.714+0000 7fcb6d7fa700 1 -- 172.21.15.88:0/2367960026 <== osd.3 v2:172.21.15.161:6800/1856287356 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcb600716f0 con 0x7fcb6006ec30 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.729+0000 7fcb77237700 1 -- 172.21.15.88:0/2367960026 --> [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb700fb280 con 0x7fcb6006ec30 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb6d7fa700 1 -- 172.21.15.88:0/2367960026 <== osd.3 v2:172.21.15.161:6800/1856287356 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fcb700fb280 con 0x7fcb6006ec30 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 -- 172.21.15.88:0/2367960026 >> [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356] conn(0x7fcb6006ec30 msgr2=0x7fcb60071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356] conn(0x7fcb6006ec30 0x7fcb60071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 -- 172.21.15.88:0/2367960026 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb60068f60 msgr2=0x7fcb6006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb60068f60 0x7fcb6006b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400b3b0 tx=0x7fcb64009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 -- 172.21.15.88:0/2367960026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb700fe5f0 msgr2=0x7fcb70113be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb700fe5f0 0x7fcb70113be0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00c8c0 tx=0x7fcb5c0044c0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 -- 172.21.15.88:0/2367960026 shutdown_connections 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.161:6800/1856287356,v1:172.21.15.161:6801/1856287356] conn(0x7fcb6006ec30 0x7fcb60071040 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb700fdc50 0x7fcb70113660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcb60068f60 0x7fcb6006b410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 --2- 172.21.15.88:0/2367960026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb700fe5f0 0x7fcb70113be0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 -- 172.21.15.88:0/2367960026 >> 172.21.15.88:0/2367960026 conn(0x7fcb700f7680 msgr2=0x7fcb701013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 -- 172.21.15.88:0/2367960026 shutdown_connections 2023-12-09T02:32:21.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:19.730+0000 7fcb77237700 1 -- 172.21.15.88:0/2367960026 wait complete. 2023-12-09T02:32:21.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:21 smithi161 ceph-mon[121170]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:21.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:21 smithi088 ceph-mon[112028]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:21.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.490+0000 7f348a027700 1 -- 172.21.15.88:0/1656605574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34840fbb40 msgr2=0x7f34840fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:21.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.490+0000 7f348a027700 1 --2- 172.21.15.88:0/1656605574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34840fbb40 0x7f34840fbfb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3474004940 tx=0x7f3474009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:21.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.490+0000 7f348a027700 1 -- 172.21.15.88:0/1656605574 shutdown_connections 2023-12-09T02:32:21.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.490+0000 7f348a027700 1 --2- 172.21.15.88:0/1656605574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34840fbb40 0x7f34840fbfb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.490+0000 7f348a027700 1 --2- 172.21.15.88:0/1656605574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3484101b00 0x7f3484101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.490+0000 7f348a027700 1 -- 172.21.15.88:0/1656605574 >> 172.21.15.88:0/1656605574 conn(0x7f34840719b0 msgr2=0x7f3484071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:21.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.490+0000 7f348a027700 1 -- 172.21.15.88:0/1656605574 shutdown_connections 2023-12-09T02:32:21.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.490+0000 7f348a027700 1 -- 172.21.15.88:0/1656605574 wait complete. 2023-12-09T02:32:21.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.491+0000 7f348a027700 1 Processor -- start 2023-12-09T02:32:21.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.491+0000 7f348a027700 1 -- start start 2023-12-09T02:32:21.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.491+0000 7f348a027700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34840fbb40 0x7f3484112560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:21.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.491+0000 7f348a027700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3484101b00 0x7f3484112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:21.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.491+0000 7f348a027700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3484113180 con 0x7f34840fbb40 2023-12-09T02:32:21.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.491+0000 7f348a027700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348410c420 con 0x7f3484101b00 2023-12-09T02:32:21.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.491+0000 7f34837fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34840fbb40 0x7f3484112560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:21.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.491+0000 7f34837fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34840fbb40 0x7f3484112560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58570/0 (socket says 172.21.15.88:58570) 2023-12-09T02:32:21.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.491+0000 7f34837fe700 1 -- 172.21.15.88:0/4254481468 learned_addr learned my addr 172.21.15.88:0/4254481468 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:21.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.491+0000 7f3482ffd700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3484101b00 0x7f3484112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:21.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.492+0000 7f34837fe700 1 -- 172.21.15.88:0/4254481468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3484101b00 msgr2=0x7f3484112aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:21.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.492+0000 7f34837fe700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3484101b00 0x7f3484112aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.492+0000 7f34837fe700 1 -- 172.21.15.88:0/4254481468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3474005040 con 0x7f34840fbb40 2023-12-09T02:32:21.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.492+0000 7f34837fe700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34840fbb40 0x7f3484112560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f346c009f50 tx=0x7f346c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:21.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.492+0000 7f347bfff700 1 -- 172.21.15.88:0/4254481468 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f346c012b60 con 0x7f34840fbb40 2023-12-09T02:32:21.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.492+0000 7f348a027700 1 -- 172.21.15.88:0/4254481468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348410c6a0 con 0x7f34840fbb40 2023-12-09T02:32:21.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.492+0000 7f347bfff700 1 -- 172.21.15.88:0/4254481468 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f346c012cc0 con 0x7f34840fbb40 2023-12-09T02:32:21.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.492+0000 7f347bfff700 1 -- 172.21.15.88:0/4254481468 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f346c01a5f0 con 0x7f34840fbb40 2023-12-09T02:32:21.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.492+0000 7f348a027700 1 -- 172.21.15.88:0/4254481468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348410cbb0 con 0x7f34840fbb40 2023-12-09T02:32:21.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.493+0000 7f348a027700 1 -- 172.21.15.88:0/4254481468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f348410d130 con 0x7f34840fbb40 2023-12-09T02:32:21.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.493+0000 7f347bfff700 1 -- 172.21.15.88:0/4254481468 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f346c01a820 con 0x7f34840fbb40 2023-12-09T02:32:21.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.494+0000 7f347bfff700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3470068f60 0x7f347006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:21.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.494+0000 7f347bfff700 1 -- 172.21.15.88:0/4254481468 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f346c08a7d0 con 0x7f34840fbb40 2023-12-09T02:32:21.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.494+0000 7f3482ffd700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3470068f60 0x7f347006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:21.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.494+0000 7f347bfff700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891] conn(0x7f347006ec30 0x7f3470071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:21.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.494+0000 7f347bfff700 1 -- 172.21.15.88:0/4254481468 --> [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34700716f0 con 0x7f347006ec30 2023-12-09T02:32:21.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.494+0000 7f347bfff700 1 -- 172.21.15.88:0/4254481468 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f346c08f220 con 0x7f34840fbb40 2023-12-09T02:32:21.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.494+0000 7f3483fff700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891] conn(0x7f347006ec30 0x7f3470071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:21.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.494+0000 7f3482ffd700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3470068f60 0x7f347006b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f348410d750 tx=0x7f3474009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:21.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.494+0000 7f3483fff700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891] conn(0x7f347006ec30 0x7f3470071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:21.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.495+0000 7f347bfff700 1 -- 172.21.15.88:0/4254481468 <== osd.0 v2:172.21.15.88:6802/4163243891 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f34700716f0 con 0x7f347006ec30 2023-12-09T02:32:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.510+0000 7f348a027700 1 -- 172.21.15.88:0/4254481468 --> [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3484065630 con 0x7f347006ec30 2023-12-09T02:32:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f347bfff700 1 -- 172.21.15.88:0/4254481468 <== osd.0 v2:172.21.15.88:6802/4163243891 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3484065630 con 0x7f347006ec30 2023-12-09T02:32:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 -- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891] conn(0x7f347006ec30 msgr2=0x7f3470071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891] conn(0x7f347006ec30 0x7f3470071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 -- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3470068f60 msgr2=0x7f347006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3470068f60 0x7f347006b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f348410d750 tx=0x7f3474009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 -- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34840fbb40 msgr2=0x7f3484112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34840fbb40 0x7f3484112560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f346c009f50 tx=0x7f346c009250 comp rx=0 tx=0).stop 2023-12-09T02:32:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 -- 172.21.15.88:0/4254481468 shutdown_connections 2023-12-09T02:32:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6802/4163243891,v1:172.21.15.88:6803/4163243891] conn(0x7f347006ec30 0x7f3470071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3470068f60 0x7f347006b410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34840fbb40 0x7f3484112560 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 --2- 172.21.15.88:0/4254481468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3484101b00 0x7f3484112aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:21.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 -- 172.21.15.88:0/4254481468 >> 172.21.15.88:0/4254481468 conn(0x7f34840719b0 msgr2=0x7f34840faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:21.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 -- 172.21.15.88:0/4254481468 shutdown_connections 2023-12-09T02:32:21.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:21.511+0000 7f348a027700 1 -- 172.21.15.88:0/4254481468 wait complete. 2023-12-09T02:32:22.120 INFO:teuthology.orchestra.run.smithi088.stdout:167503724551 2023-12-09T02:32:22.120 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-09T02:32:22.202 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:22.254 INFO:teuthology.orchestra.run.smithi088.stdout:115964117006 2023-12-09T02:32:22.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-09T02:32:22.354 INFO:teuthology.orchestra.run.smithi088.stdout:38654705690 2023-12-09T02:32:22.355 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-09T02:32:22.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.377+0000 7fd5c16fb700 1 -- 172.21.15.88:0/3836296886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5bc0fbb30 msgr2=0x7fd5bc0fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:22.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.377+0000 7fd5c16fb700 1 --2- 172.21.15.88:0/3836296886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5bc0fbb30 0x7fd5bc0fbfa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0004940 tx=0x7fd5b0009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:22.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.377+0000 7fd5c16fb700 1 -- 172.21.15.88:0/3836296886 shutdown_connections 2023-12-09T02:32:22.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.377+0000 7fd5c16fb700 1 --2- 172.21.15.88:0/3836296886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5bc0fbb30 0x7fd5bc0fbfa0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.377+0000 7fd5c16fb700 1 --2- 172.21.15.88:0/3836296886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc101af0 0x7fd5bc101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.377+0000 7fd5c16fb700 1 -- 172.21.15.88:0/3836296886 >> 172.21.15.88:0/3836296886 conn(0x7fd5bc0f7690 msgr2=0x7fd5bc0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:22.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.378+0000 7fd5c16fb700 1 -- 172.21.15.88:0/3836296886 shutdown_connections 2023-12-09T02:32:22.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.378+0000 7fd5c16fb700 1 -- 172.21.15.88:0/3836296886 wait complete. 2023-12-09T02:32:22.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.378+0000 7fd5c16fb700 1 Processor -- start 2023-12-09T02:32:22.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.378+0000 7fd5c16fb700 1 -- start start 2023-12-09T02:32:22.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5c16fb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc0fbb30 0x7fd5bc1135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:22.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5c16fb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5bc101af0 0x7fd5bc113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:22.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5c16fb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc114150 con 0x7fd5bc101af0 2023-12-09T02:32:22.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5c16fb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc10d480 con 0x7fd5bc0fbb30 2023-12-09T02:32:22.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5ba7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5bc101af0 0x7fd5bc113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:22.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5baffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc0fbb30 0x7fd5bc1135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:22.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5ba7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5bc101af0 0x7fd5bc113b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58592/0 (socket says 172.21.15.88:58592) 2023-12-09T02:32:22.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5ba7fc700 1 -- 172.21.15.88:0/532045138 learned_addr learned my addr 172.21.15.88:0/532045138 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5ba7fc700 1 -- 172.21.15.88:0/532045138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc0fbb30 msgr2=0x7fd5bc1135c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5ba7fc700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc0fbb30 0x7fd5bc1135c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5ba7fc700 1 -- 172.21.15.88:0/532045138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b0005040 con 0x7fd5bc101af0 2023-12-09T02:32:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.379+0000 7fd5ba7fc700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5bc101af0 0x7fd5bc113b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0008d80 tx=0x7fd5b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.380+0000 7fd5a37fe700 1 -- 172.21.15.88:0/532045138 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5b000e030 con 0x7fd5bc101af0 2023-12-09T02:32:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.380+0000 7fd5a37fe700 1 -- 172.21.15.88:0/532045138 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5b0004290 con 0x7fd5bc101af0 2023-12-09T02:32:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.380+0000 7fd5a37fe700 1 -- 172.21.15.88:0/532045138 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5b001cda0 con 0x7fd5bc101af0 2023-12-09T02:32:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.380+0000 7fd5c16fb700 1 -- 172.21.15.88:0/532045138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5bc10d700 con 0x7fd5bc101af0 2023-12-09T02:32:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.380+0000 7fd5c16fb700 1 -- 172.21.15.88:0/532045138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5bc10dc40 con 0x7fd5bc101af0 2023-12-09T02:32:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.381+0000 7fd5c16fb700 1 -- 172.21.15.88:0/532045138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5bc10e270 con 0x7fd5bc101af0 2023-12-09T02:32:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.382+0000 7fd5a37fe700 1 -- 172.21.15.88:0/532045138 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd5b001c600 con 0x7fd5bc101af0 2023-12-09T02:32:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.382+0000 7fd5a37fe700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd5a4069100 0x7fd5a406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.382+0000 7fd5a37fe700 1 -- 172.21.15.88:0/532045138 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd5b00883f0 con 0x7fd5bc101af0 2023-12-09T02:32:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.382+0000 7fd5a37fe700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150] conn(0x7fd5a406edd0 0x7fd5a40711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.382+0000 7fd5a37fe700 1 -- 172.21.15.88:0/532045138 --> [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5a4071890 con 0x7fd5a406edd0 2023-12-09T02:32:22.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.383+0000 7fd5a37fe700 1 -- 172.21.15.88:0/532045138 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5b0058670 con 0x7fd5bc101af0 2023-12-09T02:32:22.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.383+0000 7fd5bb7fe700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150] conn(0x7fd5a406edd0 0x7fd5a40711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:22.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.383+0000 7fd5baffd700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd5a4069100 0x7fd5a406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:22.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.383+0000 7fd5bb7fe700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150] conn(0x7fd5a406edd0 0x7fd5a40711e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:22.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.383+0000 7fd5baffd700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd5a4069100 0x7fd5a406b5b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009b80 tx=0x7fd5ac00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:22.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.384+0000 7fd5a37fe700 1 -- 172.21.15.88:0/532045138 <== osd.4 v2:172.21.15.161:6808/1385340150 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd5a4071890 con 0x7fd5a406edd0 2023-12-09T02:32:22.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.415+0000 7fd5c16fb700 1 -- 172.21.15.88:0/532045138 --> [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd5bc05e2c0 con 0x7fd5a406edd0 2023-12-09T02:32:22.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5a37fe700 1 -- 172.21.15.88:0/532045138 <== osd.4 v2:172.21.15.161:6808/1385340150 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd5bc05e2c0 con 0x7fd5a406edd0 2023-12-09T02:32:22.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 -- 172.21.15.88:0/532045138 >> [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150] conn(0x7fd5a406edd0 msgr2=0x7fd5a40711e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:22.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150] conn(0x7fd5a406edd0 0x7fd5a40711e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 -- 172.21.15.88:0/532045138 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd5a4069100 msgr2=0x7fd5a406b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd5a4069100 0x7fd5a406b5b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009b80 tx=0x7fd5ac00b040 comp rx=0 tx=0).stop 2023-12-09T02:32:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 -- 172.21.15.88:0/532045138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5bc101af0 msgr2=0x7fd5bc113b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5bc101af0 0x7fd5bc113b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0008d80 tx=0x7fd5b0009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 -- 172.21.15.88:0/532045138 shutdown_connections 2023-12-09T02:32:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.161:6808/1385340150,v1:172.21.15.161:6809/1385340150] conn(0x7fd5a406edd0 0x7fd5a40711e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc0fbb30 0x7fd5bc1135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd5a4069100 0x7fd5a406b5b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 --2- 172.21.15.88:0/532045138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5bc101af0 0x7fd5bc113b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.416+0000 7fd5c16fb700 1 -- 172.21.15.88:0/532045138 >> 172.21.15.88:0/532045138 conn(0x7fd5bc0f7690 msgr2=0x7fd5bc0f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.417+0000 7fd5c16fb700 1 -- 172.21.15.88:0/532045138 shutdown_connections 2023-12-09T02:32:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.417+0000 7fd5c16fb700 1 -- 172.21.15.88:0/532045138 wait complete. 2023-12-09T02:32:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.854+0000 7f8e1826c700 1 -- 172.21.15.88:0/3776148576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e100fbb00 msgr2=0x7f8e100fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.854+0000 7f8e1826c700 1 --2- 172.21.15.88:0/3776148576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e100fbb00 0x7f8e100fbf70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8e04004940 tx=0x7f8e04009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.854+0000 7f8e1826c700 1 -- 172.21.15.88:0/3776148576 shutdown_connections 2023-12-09T02:32:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.854+0000 7f8e1826c700 1 --2- 172.21.15.88:0/3776148576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e100fbb00 0x7f8e100fbf70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.854+0000 7f8e1826c700 1 --2- 172.21.15.88:0/3776148576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e10101b60 0x7f8e10101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.854+0000 7f8e1826c700 1 -- 172.21.15.88:0/3776148576 >> 172.21.15.88:0/3776148576 conn(0x7f8e100f7680 msgr2=0x7f8e100f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.854+0000 7f8e1826c700 1 -- 172.21.15.88:0/3776148576 shutdown_connections 2023-12-09T02:32:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.854+0000 7f8e1826c700 1 -- 172.21.15.88:0/3776148576 wait complete. 2023-12-09T02:32:22.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e1826c700 1 Processor -- start 2023-12-09T02:32:22.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e1826c700 1 -- start start 2023-12-09T02:32:22.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e1826c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e100fbb00 0x7f8e1010e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:22.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e1826c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e10101b60 0x7f8e1010ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:22.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e1826c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1010f210 con 0x7f8e100fbb00 2023-12-09T02:32:22.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e1826c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1010f350 con 0x7f8e10101b60 2023-12-09T02:32:22.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e16008700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e100fbb00 0x7f8e1010e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:22.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e16008700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e100fbb00 0x7f8e1010e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58604/0 (socket says 172.21.15.88:58604) 2023-12-09T02:32:22.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e16008700 1 -- 172.21.15.88:0/291110015 learned_addr learned my addr 172.21.15.88:0/291110015 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:22.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e15807700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e10101b60 0x7f8e1010ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:22.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e16008700 1 -- 172.21.15.88:0/291110015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e10101b60 msgr2=0x7f8e1010ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:22.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e16008700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e10101b60 0x7f8e1010ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e16008700 1 -- 172.21.15.88:0/291110015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e04005040 con 0x7f8e100fbb00 2023-12-09T02:32:22.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.855+0000 7f8e16008700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e100fbb00 0x7f8e1010e6b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000bbe0 tx=0x7f8e00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:22.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.856+0000 7f8e0effd700 1 -- 172.21.15.88:0/291110015 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e000092e0 con 0x7f8e100fbb00 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.856+0000 7f8e0effd700 1 -- 172.21.15.88:0/291110015 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e0000cb00 con 0x7f8e100fbb00 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.856+0000 7f8e0effd700 1 -- 172.21.15.88:0/291110015 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e00015d00 con 0x7f8e100fbb00 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.856+0000 7f8e1826c700 1 -- 172.21.15.88:0/291110015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e10117680 con 0x7f8e100fbb00 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.856+0000 7f8e1826c700 1 -- 172.21.15.88:0/291110015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e10117bc0 con 0x7f8e100fbb00 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.857+0000 7f8e1826c700 1 -- 172.21.15.88:0/291110015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e1005e380 con 0x7f8e100fbb00 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.857+0000 7f8e0effd700 1 -- 172.21.15.88:0/291110015 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8e00012070 con 0x7f8e100fbb00 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.858+0000 7f8e0effd700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8df8068f60 0x7f8df806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.858+0000 7f8e0effd700 1 -- 172.21.15.88:0/291110015 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8e00086510 con 0x7f8e100fbb00 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.858+0000 7f8e15807700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8df8068f60 0x7f8df806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.858+0000 7f8e0effd700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781] conn(0x7f8df806ec30 0x7f8df8071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.858+0000 7f8e0effd700 1 -- 172.21.15.88:0/291110015 --> [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8df80716f0 con 0x7f8df806ec30 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.858+0000 7f8e0effd700 1 -- 172.21.15.88:0/291110015 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e00088b00 con 0x7f8e100fbb00 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.858+0000 7f8e16809700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781] conn(0x7f8df806ec30 0x7f8df8071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:22.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.858+0000 7f8e15807700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8df8068f60 0x7f8df806b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8e10066700 tx=0x7f8e04009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:22.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.858+0000 7f8e16809700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781] conn(0x7f8df806ec30 0x7f8df8071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:22.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.859+0000 7f8e0effd700 1 -- 172.21.15.88:0/291110015 <== osd.1 v2:172.21.15.88:6810/1049229781 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8df80716f0 con 0x7f8df806ec30 2023-12-09T02:32:22.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 -- 172.21.15.88:0/291110015 --> [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e1005e7b0 con 0x7f8df806ec30 2023-12-09T02:32:22.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e0effd700 1 -- 172.21.15.88:0/291110015 <== osd.1 v2:172.21.15.88:6810/1049229781 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8e1005e7b0 con 0x7f8df806ec30 2023-12-09T02:32:22.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 -- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781] conn(0x7f8df806ec30 msgr2=0x7f8df8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:22.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781] conn(0x7f8df806ec30 0x7f8df8071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 -- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8df8068f60 msgr2=0x7f8df806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:22.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8df8068f60 0x7f8df806b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8e10066700 tx=0x7f8e04009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:22.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 -- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e100fbb00 msgr2=0x7f8e1010e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:22.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e100fbb00 0x7f8e1010e6b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000bbe0 tx=0x7f8e00009840 comp rx=0 tx=0).stop 2023-12-09T02:32:22.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 -- 172.21.15.88:0/291110015 shutdown_connections 2023-12-09T02:32:22.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8df8068f60 0x7f8df806b410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e100fbb00 0x7f8e1010e6b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.88:6810/1049229781,v1:172.21.15.88:6811/1049229781] conn(0x7f8df806ec30 0x7f8df8071040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 --2- 172.21.15.88:0/291110015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e10101b60 0x7f8e1010ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:22.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 -- 172.21.15.88:0/291110015 >> 172.21.15.88:0/291110015 conn(0x7f8e100f7680 msgr2=0x7f8e100f8170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:22.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 -- 172.21.15.88:0/291110015 shutdown_connections 2023-12-09T02:32:22.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:22.874+0000 7f8e1826c700 1 -- 172.21.15.88:0/291110015 wait complete. 2023-12-09T02:32:22.943 INFO:teuthology.orchestra.run.smithi088.stdout:146028888074 2023-12-09T02:32:22.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-09T02:32:23.052 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:23.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:23 smithi088 ceph-mon[112028]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:23.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:23 smithi161 ceph-mon[121170]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:24.179 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:24.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.216+0000 7f006d577700 1 -- 172.21.15.88:0/2262436250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00680fbb40 msgr2=0x7f00680fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:24.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.216+0000 7f006d577700 1 --2- 172.21.15.88:0/2262436250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00680fbb40 0x7f00680fbfb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f005c004940 tx=0x7f005c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:24.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.216+0000 7f006d577700 1 -- 172.21.15.88:0/2262436250 shutdown_connections 2023-12-09T02:32:24.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.216+0000 7f006d577700 1 --2- 172.21.15.88:0/2262436250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00680fbb40 0x7f00680fbfb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.216+0000 7f006d577700 1 --2- 172.21.15.88:0/2262436250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0068101b00 0x7f0068101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.216+0000 7f006d577700 1 -- 172.21.15.88:0/2262436250 >> 172.21.15.88:0/2262436250 conn(0x7f00680719b0 msgr2=0x7f0068071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:24.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.216+0000 7f006d577700 1 -- 172.21.15.88:0/2262436250 shutdown_connections 2023-12-09T02:32:24.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.216+0000 7f006d577700 1 -- 172.21.15.88:0/2262436250 wait complete. 2023-12-09T02:32:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.217+0000 7f006d577700 1 Processor -- start 2023-12-09T02:32:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.217+0000 7f006d577700 1 -- start start 2023-12-09T02:32:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f006d577700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00680fbb40 0x7f0068112560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f006d577700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0068101b00 0x7f0068112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f006d577700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0068113180 con 0x7f00680fbb40 2023-12-09T02:32:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f006d577700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006810c420 con 0x7f0068101b00 2023-12-09T02:32:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f0066ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00680fbb40 0x7f0068112560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f0066ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00680fbb40 0x7f0068112560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58626/0 (socket says 172.21.15.88:58626) 2023-12-09T02:32:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f0066ffd700 1 -- 172.21.15.88:0/2299782173 learned_addr learned my addr 172.21.15.88:0/2299782173 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f00667fc700 1 --2- 172.21.15.88:0/2299782173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0068101b00 0x7f0068112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f0066ffd700 1 -- 172.21.15.88:0/2299782173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0068101b00 msgr2=0x7f0068112aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f0066ffd700 1 --2- 172.21.15.88:0/2299782173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0068101b00 0x7f0068112aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f0066ffd700 1 -- 172.21.15.88:0/2299782173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c005040 con 0x7f00680fbb40 2023-12-09T02:32:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f0066ffd700 1 --2- 172.21.15.88:0/2299782173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00680fbb40 0x7f0068112560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f005800daf0 tx=0x7f005800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f004f7fe700 1 -- 172.21.15.88:0/2299782173 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f005800ed80 con 0x7f00680fbb40 2023-12-09T02:32:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f004f7fe700 1 -- 172.21.15.88:0/2299782173 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0058017920 con 0x7f00680fbb40 2023-12-09T02:32:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f004f7fe700 1 -- 172.21.15.88:0/2299782173 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0058016950 con 0x7f00680fbb40 2023-12-09T02:32:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f006d577700 1 -- 172.21.15.88:0/2299782173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006810c6a0 con 0x7f00680fbb40 2023-12-09T02:32:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.218+0000 7f006d577700 1 -- 172.21.15.88:0/2299782173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006810cbe0 con 0x7f00680fbb40 2023-12-09T02:32:24.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.219+0000 7f006d577700 1 -- 172.21.15.88:0/2299782173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00680734d0 con 0x7f00680fbb40 2023-12-09T02:32:24.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.220+0000 7f004f7fe700 1 -- 172.21.15.88:0/2299782173 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0058014070 con 0x7f00680fbb40 2023-12-09T02:32:24.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.220+0000 7f004f7fe700 1 --2- 172.21.15.88:0/2299782173 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0050068f70 0x7f005006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:24.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.220+0000 7f004f7fe700 1 -- 172.21.15.88:0/2299782173 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0058088c90 con 0x7f00680fbb40 2023-12-09T02:32:24.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.220+0000 7f00667fc700 1 --2- 172.21.15.88:0/2299782173 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0050068f70 0x7f005006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:24.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.221+0000 7f00667fc700 1 --2- 172.21.15.88:0/2299782173 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0050068f70 0x7f005006b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f006810de00 tx=0x7f005c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:24.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.225+0000 7f004f7fe700 1 -- 172.21.15.88:0/2299782173 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0058058f30 con 0x7f00680fbb40 2023-12-09T02:32:24.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.419+0000 7f006d577700 1 -- 172.21.15.88:0/2299782173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f006810dc20 con 0x7f00680fbb40 2023-12-09T02:32:24.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.420+0000 7f004f7fe700 1 -- 172.21.15.88:0/2299782173 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0058058ac0 con 0x7f00680fbb40 2023-12-09T02:32:24.422 INFO:teuthology.orchestra.run.smithi088.stdout:81604378643 2023-12-09T02:32:24.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.422+0000 7f006d577700 1 -- 172.21.15.88:0/2299782173 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0050068f70 msgr2=0x7f005006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:24.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.422+0000 7f006d577700 1 --2- 172.21.15.88:0/2299782173 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0050068f70 0x7f005006b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f006810de00 tx=0x7f005c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:24.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.422+0000 7f006d577700 1 -- 172.21.15.88:0/2299782173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00680fbb40 msgr2=0x7f0068112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:24.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.422+0000 7f006d577700 1 --2- 172.21.15.88:0/2299782173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00680fbb40 0x7f0068112560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f005800daf0 tx=0x7f005800b4f0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.422+0000 7f006d577700 1 -- 172.21.15.88:0/2299782173 shutdown_connections 2023-12-09T02:32:24.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.422+0000 7f006d577700 1 --2- 172.21.15.88:0/2299782173 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0050068f70 0x7f005006b420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.422+0000 7f006d577700 1 --2- 172.21.15.88:0/2299782173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00680fbb40 0x7f0068112560 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.422+0000 7f006d577700 1 --2- 172.21.15.88:0/2299782173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0068101b00 0x7f0068112aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.422+0000 7f006d577700 1 -- 172.21.15.88:0/2299782173 >> 172.21.15.88:0/2299782173 conn(0x7f00680719b0 msgr2=0x7f00680faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:24.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.422+0000 7f006d577700 1 -- 172.21.15.88:0/2299782173 shutdown_connections 2023-12-09T02:32:24.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.422+0000 7f006d577700 1 -- 172.21.15.88:0/2299782173 wait complete. 2023-12-09T02:32:24.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.501+0000 7ff1a19e6700 1 -- 172.21.15.88:0/119739039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c065390 msgr2=0x7ff19c065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:24.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.501+0000 7ff1a19e6700 1 --2- 172.21.15.88:0/119739039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c065390 0x7ff19c065800 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff18c004940 tx=0x7ff18c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:24.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.502+0000 7ff1a19e6700 1 -- 172.21.15.88:0/119739039 shutdown_connections 2023-12-09T02:32:24.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.502+0000 7ff1a19e6700 1 --2- 172.21.15.88:0/119739039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c065390 0x7ff19c065800 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.502+0000 7ff1a19e6700 1 --2- 172.21.15.88:0/119739039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff19c102c20 0x7ff19c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.502+0000 7ff1a19e6700 1 -- 172.21.15.88:0/119739039 >> 172.21.15.88:0/119739039 conn(0x7ff19c0719b0 msgr2=0x7ff19c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:24.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.502+0000 7ff1a19e6700 1 -- 172.21.15.88:0/119739039 shutdown_connections 2023-12-09T02:32:24.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.502+0000 7ff1a19e6700 1 -- 172.21.15.88:0/119739039 wait complete. 2023-12-09T02:32:24.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.502+0000 7ff1a19e6700 1 Processor -- start 2023-12-09T02:32:24.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.502+0000 7ff1a19e6700 1 -- start start 2023-12-09T02:32:24.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff1a19e6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c065390 0x7ff19c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:24.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff1a19e6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff19c102c20 0x7ff19c113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:24.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff1a19e6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c1142c0 con 0x7ff19c065390 2023-12-09T02:32:24.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff1a19e6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c10d5f0 con 0x7ff19c102c20 2023-12-09T02:32:24.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff19affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c065390 0x7ff19c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:24.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff19affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c065390 0x7ff19c113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58636/0 (socket says 172.21.15.88:58636) 2023-12-09T02:32:24.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff19affd700 1 -- 172.21.15.88:0/2882933991 learned_addr learned my addr 172.21.15.88:0/2882933991 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:24.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff19affd700 1 -- 172.21.15.88:0/2882933991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff19c102c20 msgr2=0x7ff19c113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:24.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff19affd700 1 --2- 172.21.15.88:0/2882933991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff19c102c20 0x7ff19c113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff19affd700 1 -- 172.21.15.88:0/2882933991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c005040 con 0x7ff19c065390 2023-12-09T02:32:24.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff19affd700 1 --2- 172.21.15.88:0/2882933991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c065390 0x7ff19c113730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff19000c8c0 tx=0x7ff1900044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:24.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff1837fe700 1 -- 172.21.15.88:0/2882933991 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff19000a980 con 0x7ff19c065390 2023-12-09T02:32:24.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff1837fe700 1 -- 172.21.15.88:0/2882933991 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff19000ce60 con 0x7ff19c065390 2023-12-09T02:32:24.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff1a19e6700 1 -- 172.21.15.88:0/2882933991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c10d8d0 con 0x7ff19c065390 2023-12-09T02:32:24.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff1837fe700 1 -- 172.21.15.88:0/2882933991 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1900113a0 con 0x7ff19c065390 2023-12-09T02:32:24.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.503+0000 7ff1a19e6700 1 -- 172.21.15.88:0/2882933991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c10de10 con 0x7ff19c065390 2023-12-09T02:32:24.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.504+0000 7ff1a19e6700 1 -- 172.21.15.88:0/2882933991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c0fff40 con 0x7ff19c065390 2023-12-09T02:32:24.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.505+0000 7ff1837fe700 1 -- 172.21.15.88:0/2882933991 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff190012400 con 0x7ff19c065390 2023-12-09T02:32:24.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.505+0000 7ff1837fe700 1 --2- 172.21.15.88:0/2882933991 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff184069030 0x7ff18406b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:24.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.505+0000 7ff1837fe700 1 -- 172.21.15.88:0/2882933991 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff190086b30 con 0x7ff19c065390 2023-12-09T02:32:24.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.506+0000 7ff19a7fc700 1 --2- 172.21.15.88:0/2882933991 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff184069030 0x7ff18406b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:24.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.506+0000 7ff19a7fc700 1 --2- 172.21.15.88:0/2882933991 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff184069030 0x7ff18406b4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff18c004f90 tx=0x7ff18c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:24.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.510+0000 7ff1837fe700 1 -- 172.21.15.88:0/2882933991 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff190056db0 con 0x7ff19c065390 2023-12-09T02:32:24.708 INFO:teuthology.orchestra.run.smithi088.stdout:60129542167 2023-12-09T02:32:24.709 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-09T02:32:24.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.721+0000 7ff1a19e6700 1 -- 172.21.15.88:0/2882933991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff19c04bbb0 con 0x7ff19c065390 2023-12-09T02:32:24.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.721+0000 7ff1837fe700 1 -- 172.21.15.88:0/2882933991 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff190056940 con 0x7ff19c065390 2023-12-09T02:32:24.723 INFO:teuthology.orchestra.run.smithi088.stdout:115964117006 2023-12-09T02:32:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.723+0000 7ff1a19e6700 1 -- 172.21.15.88:0/2882933991 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff184069030 msgr2=0x7ff18406b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.723+0000 7ff1a19e6700 1 --2- 172.21.15.88:0/2882933991 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff184069030 0x7ff18406b4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff18c004f90 tx=0x7ff18c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.723+0000 7ff1a19e6700 1 -- 172.21.15.88:0/2882933991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c065390 msgr2=0x7ff19c113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.723+0000 7ff1a19e6700 1 --2- 172.21.15.88:0/2882933991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c065390 0x7ff19c113730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff19000c8c0 tx=0x7ff1900044c0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.724+0000 7ff1a19e6700 1 -- 172.21.15.88:0/2882933991 shutdown_connections 2023-12-09T02:32:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.724+0000 7ff1a19e6700 1 --2- 172.21.15.88:0/2882933991 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff184069030 0x7ff18406b4e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.724+0000 7ff1a19e6700 1 --2- 172.21.15.88:0/2882933991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c065390 0x7ff19c113730 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.724+0000 7ff1a19e6700 1 --2- 172.21.15.88:0/2882933991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff19c102c20 0x7ff19c113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.724+0000 7ff1a19e6700 1 -- 172.21.15.88:0/2882933991 >> 172.21.15.88:0/2882933991 conn(0x7ff19c0719b0 msgr2=0x7ff19c0fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.724+0000 7ff1a19e6700 1 -- 172.21.15.88:0/2882933991 shutdown_connections 2023-12-09T02:32:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:24.724+0000 7ff1a19e6700 1 -- 172.21.15.88:0/2882933991 wait complete. 2023-12-09T02:32:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:25 smithi088 ceph-mon[112028]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:25 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2299782173' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-09T02:32:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:25 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2882933991' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-09T02:32:25.393 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:25.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:25 smithi161 ceph-mon[121170]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:25.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:25 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2299782173' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-09T02:32:25.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:25 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2882933991' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-09T02:32:25.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.697+0000 7f04abac7700 1 -- 172.21.15.88:0/1189711987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04a4101b00 msgr2=0x7f04a4101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:25.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.697+0000 7f04abac7700 1 --2- 172.21.15.88:0/1189711987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04a4101b00 0x7f04a4101ed0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0498004940 tx=0x7f0498009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:25.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.697+0000 7f04abac7700 1 -- 172.21.15.88:0/1189711987 shutdown_connections 2023-12-09T02:32:25.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.697+0000 7f04abac7700 1 --2- 172.21.15.88:0/1189711987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a40fbb40 0x7f04a40fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:25.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.697+0000 7f04abac7700 1 --2- 172.21.15.88:0/1189711987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04a4101b00 0x7f04a4101ed0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:25.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.697+0000 7f04abac7700 1 -- 172.21.15.88:0/1189711987 >> 172.21.15.88:0/1189711987 conn(0x7f04a40719b0 msgr2=0x7f04a4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:25.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.697+0000 7f04abac7700 1 -- 172.21.15.88:0/1189711987 shutdown_connections 2023-12-09T02:32:25.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.697+0000 7f04abac7700 1 -- 172.21.15.88:0/1189711987 wait complete. 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.697+0000 7f04abac7700 1 Processor -- start 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04abac7700 1 -- start start 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04abac7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04a40fbb40 0x7f04a4113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04abac7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a4101b00 0x7f04a4113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04abac7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41141f0 con 0x7f04a40fbb40 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04abac7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a410d4e0 con 0x7f04a4101b00 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04a9863700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04a40fbb40 0x7f04a4113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04a9863700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04a40fbb40 0x7f04a4113620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58650/0 (socket says 172.21.15.88:58650) 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04a9863700 1 -- 172.21.15.88:0/3747826131 learned_addr learned my addr 172.21.15.88:0/3747826131 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04a9863700 1 -- 172.21.15.88:0/3747826131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a4101b00 msgr2=0x7f04a4113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04a9062700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a4101b00 0x7f04a4113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04a9863700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a4101b00 0x7f04a4113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04a9863700 1 -- 172.21.15.88:0/3747826131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0498005040 con 0x7f04a40fbb40 2023-12-09T02:32:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04a9062700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a4101b00 0x7f04a4113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04a9863700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04a40fbb40 0x7f04a4113620 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f049800b3b0 tx=0x7f0498009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04967fc700 1 -- 172.21.15.88:0/3747826131 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f049800e040 con 0x7f04a40fbb40 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04967fc700 1 -- 172.21.15.88:0/3747826131 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f049800bc50 con 0x7f04a40fbb40 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04abac7700 1 -- 172.21.15.88:0/3747826131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a410d710 con 0x7f04a40fbb40 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04967fc700 1 -- 172.21.15.88:0/3747826131 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0498013420 con 0x7f04a40fbb40 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.698+0000 7f04abac7700 1 -- 172.21.15.88:0/3747826131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a410dc50 con 0x7f04a40fbb40 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.699+0000 7f04abac7700 1 -- 172.21.15.88:0/3747826131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a40734d0 con 0x7f04a40fbb40 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.700+0000 7f04967fc700 1 -- 172.21.15.88:0/3747826131 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f049801c430 con 0x7f04a40fbb40 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.700+0000 7f04967fc700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0490068f60 0x7f049006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.700+0000 7f04967fc700 1 -- 172.21.15.88:0/3747826131 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0498087780 con 0x7f04a40fbb40 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.700+0000 7f04a9062700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0490068f60 0x7f049006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.700+0000 7f04a9062700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0490068f60 0x7f049006b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04a0007fd0 tx=0x7f04a0009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.704+0000 7f04967fc700 1 -- 172.21.15.88:0/3747826131 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0498057b70 con 0x7f04a40fbb40 2023-12-09T02:32:25.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.898+0000 7f04abac7700 1 -- 172.21.15.88:0/3747826131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f04a410eca0 con 0x7f04a40fbb40 2023-12-09T02:32:25.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.898+0000 7f04967fc700 1 -- 172.21.15.88:0/3747826131 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0498057700 con 0x7f04a40fbb40 2023-12-09T02:32:25.900 INFO:teuthology.orchestra.run.smithi088.stdout:167503724552 2023-12-09T02:32:25.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.901+0000 7f04abac7700 1 -- 172.21.15.88:0/3747826131 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0490068f60 msgr2=0x7f049006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:25.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.901+0000 7f04abac7700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0490068f60 0x7f049006b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04a0007fd0 tx=0x7f04a0009040 comp rx=0 tx=0).stop 2023-12-09T02:32:25.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.901+0000 7f04abac7700 1 -- 172.21.15.88:0/3747826131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04a40fbb40 msgr2=0x7f04a4113620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:25.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.901+0000 7f04abac7700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04a40fbb40 0x7f04a4113620 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f049800b3b0 tx=0x7f0498009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:25.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.903+0000 7f04abac7700 1 -- 172.21.15.88:0/3747826131 shutdown_connections 2023-12-09T02:32:25.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.903+0000 7f04abac7700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0490068f60 0x7f049006b410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:25.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.903+0000 7f04abac7700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04a40fbb40 0x7f04a4113620 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:25.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.903+0000 7f04abac7700 1 --2- 172.21.15.88:0/3747826131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a4101b00 0x7f04a4113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:25.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.903+0000 7f04abac7700 1 -- 172.21.15.88:0/3747826131 >> 172.21.15.88:0/3747826131 conn(0x7f04a40719b0 msgr2=0x7f04a40ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:25.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.903+0000 7f04abac7700 1 -- 172.21.15.88:0/3747826131 shutdown_connections 2023-12-09T02:32:25.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:25.903+0000 7f04abac7700 1 -- 172.21.15.88:0/3747826131 wait complete. 2023-12-09T02:32:25.933 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:25.969 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117006 got 115964117006 for osd.3 2023-12-09T02:32:25.969 DEBUG:teuthology.parallel:result is None 2023-12-09T02:32:26.177 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:26 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3747826131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-09T02:32:26.315 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:26.353 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378642 got 81604378643 for osd.2 2023-12-09T02:32:26.353 DEBUG:teuthology.parallel:result is None 2023-12-09T02:32:26.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:26 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3747826131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-09T02:32:26.502 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724551 got 167503724552 for osd.5 2023-12-09T02:32:26.502 DEBUG:teuthology.parallel:result is None 2023-12-09T02:32:27.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:27 smithi161 ceph-mon[121170]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:27.457 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:27 smithi088 ceph-mon[112028]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.780+0000 7f271670a700 1 -- 172.21.15.88:0/1201766693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27100fdc70 msgr2=0x7f27100fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.780+0000 7f271670a700 1 --2- 172.21.15.88:0/1201766693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27100fdc70 0x7f27100fe040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2700004940 tx=0x7f2700009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.781+0000 7f271670a700 1 -- 172.21.15.88:0/1201766693 shutdown_connections 2023-12-09T02:32:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.781+0000 7f271670a700 1 --2- 172.21.15.88:0/1201766693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27100fe610 0x7f2710106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.781+0000 7f271670a700 1 --2- 172.21.15.88:0/1201766693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27100fdc70 0x7f27100fe040 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.781+0000 7f271670a700 1 -- 172.21.15.88:0/1201766693 >> 172.21.15.88:0/1201766693 conn(0x7f27100f76c0 msgr2=0x7f27100f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.781+0000 7f271670a700 1 -- 172.21.15.88:0/1201766693 shutdown_connections 2023-12-09T02:32:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.781+0000 7f271670a700 1 -- 172.21.15.88:0/1201766693 wait complete. 2023-12-09T02:32:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.781+0000 7f271670a700 1 Processor -- start 2023-12-09T02:32:27.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.781+0000 7f271670a700 1 -- start start 2023-12-09T02:32:27.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f271670a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27100fdc70 0x7f2710113600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:27.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f271670a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27100fe610 0x7f2710113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:27.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f271670a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271010d4c0 con 0x7f27100fe610 2023-12-09T02:32:27.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f271670a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271010d630 con 0x7f27100fdc70 2023-12-09T02:32:27.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f270f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27100fe610 0x7f2710113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:27.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f270f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27100fe610 0x7f2710113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58912/0 (socket says 172.21.15.88:58912) 2023-12-09T02:32:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f270f7fe700 1 -- 172.21.15.88:0/3771655464 learned_addr learned my addr 172.21.15.88:0/3771655464 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f270ffff700 1 --2- 172.21.15.88:0/3771655464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27100fdc70 0x7f2710113600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f270f7fe700 1 -- 172.21.15.88:0/3771655464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27100fdc70 msgr2=0x7f2710113600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f270f7fe700 1 --2- 172.21.15.88:0/3771655464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27100fdc70 0x7f2710113600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f270f7fe700 1 -- 172.21.15.88:0/3771655464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700005040 con 0x7f27100fe610 2023-12-09T02:32:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f270f7fe700 1 --2- 172.21.15.88:0/3771655464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27100fe610 0x7f2710113b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f270400b790 tx=0x7f2704009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f270cff9700 1 -- 172.21.15.88:0/3771655464 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f270400f6f0 con 0x7f27100fe610 2023-12-09T02:32:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.782+0000 7f270cff9700 1 -- 172.21.15.88:0/3771655464 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f270400fd00 con 0x7f27100fe610 2023-12-09T02:32:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.783+0000 7f270cff9700 1 -- 172.21.15.88:0/3771655464 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27040103a0 con 0x7f27100fe610 2023-12-09T02:32:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.783+0000 7f271670a700 1 -- 172.21.15.88:0/3771655464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271010d830 con 0x7f27100fe610 2023-12-09T02:32:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.783+0000 7f271670a700 1 -- 172.21.15.88:0/3771655464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271010dd20 con 0x7f27100fe610 2023-12-09T02:32:27.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.784+0000 7f271670a700 1 -- 172.21.15.88:0/3771655464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2710104260 con 0x7f27100fe610 2023-12-09T02:32:27.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.784+0000 7f270cff9700 1 -- 172.21.15.88:0/3771655464 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f270400f850 con 0x7f27100fe610 2023-12-09T02:32:27.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.785+0000 7f270cff9700 1 --2- 172.21.15.88:0/3771655464 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f26f8068f60 0x7f26f806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:27.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.785+0000 7f270cff9700 1 -- 172.21.15.88:0/3771655464 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2704086870 con 0x7f27100fe610 2023-12-09T02:32:27.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.785+0000 7f270ffff700 1 --2- 172.21.15.88:0/3771655464 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f26f8068f60 0x7f26f806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.785+0000 7f270ffff700 1 --2- 172.21.15.88:0/3771655464 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f26f8068f60 0x7f26f806b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2700009fd0 tx=0x7f2700009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:27.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.789+0000 7f270cff9700 1 -- 172.21.15.88:0/3771655464 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2704056b10 con 0x7f27100fe610 2023-12-09T02:32:27.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.880+0000 7fa766618700 1 -- 172.21.15.88:0/1237152280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760102bf0 msgr2=0x7fa760102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:27.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.880+0000 7fa766618700 1 --2- 172.21.15.88:0/1237152280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760102bf0 0x7fa760102fc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa750004940 tx=0x7fa750009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:27.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.880+0000 7fa766618700 1 -- 172.21.15.88:0/1237152280 shutdown_connections 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.880+0000 7fa766618700 1 --2- 172.21.15.88:0/1237152280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa760103590 0x7fa7600fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.880+0000 7fa766618700 1 --2- 172.21.15.88:0/1237152280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760102bf0 0x7fa760102fc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.880+0000 7fa766618700 1 -- 172.21.15.88:0/1237152280 >> 172.21.15.88:0/1237152280 conn(0x7fa7600f87a0 msgr2=0x7fa7600fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.880+0000 7fa766618700 1 -- 172.21.15.88:0/1237152280 shutdown_connections 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.880+0000 7fa766618700 1 -- 172.21.15.88:0/1237152280 wait complete. 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa766618700 1 Processor -- start 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa766618700 1 -- start start 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa766618700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760102bf0 0x7fa76006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa766618700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa760103590 0x7fa760070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa766618700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa760070b10 con 0x7fa760102bf0 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa766618700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa760070c80 con 0x7fa760103590 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa75ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760102bf0 0x7fa76006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa75ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760102bf0 0x7fa76006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58944/0 (socket says 172.21.15.88:58944) 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa75ffff700 1 -- 172.21.15.88:0/3605327229 learned_addr learned my addr 172.21.15.88:0/3605327229 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa75ffff700 1 -- 172.21.15.88:0/3605327229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa760103590 msgr2=0x7fa760070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa75ffff700 1 --2- 172.21.15.88:0/3605327229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa760103590 0x7fa760070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.881+0000 7fa75ffff700 1 -- 172.21.15.88:0/3605327229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750005040 con 0x7fa760102bf0 2023-12-09T02:32:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.882+0000 7fa75ffff700 1 --2- 172.21.15.88:0/3605327229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760102bf0 0x7fa76006ff40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa75000b3b0 tx=0x7fa750009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.882+0000 7fa75d7fa700 1 -- 172.21.15.88:0/3605327229 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa75000e040 con 0x7fa760102bf0 2023-12-09T02:32:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.882+0000 7fa75d7fa700 1 -- 172.21.15.88:0/3605327229 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa75000bc50 con 0x7fa760102bf0 2023-12-09T02:32:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.882+0000 7fa766618700 1 -- 172.21.15.88:0/3605327229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa760119900 con 0x7fa760102bf0 2023-12-09T02:32:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.882+0000 7fa75d7fa700 1 -- 172.21.15.88:0/3605327229 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa750013420 con 0x7fa760102bf0 2023-12-09T02:32:27.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.882+0000 7fa766618700 1 -- 172.21.15.88:0/3605327229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa760119df0 con 0x7fa760102bf0 2023-12-09T02:32:27.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.883+0000 7fa766618700 1 -- 172.21.15.88:0/3605327229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7600fc3a0 con 0x7fa760102bf0 2023-12-09T02:32:27.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.883+0000 7fa75d7fa700 1 -- 172.21.15.88:0/3605327229 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa75001c430 con 0x7fa760102bf0 2023-12-09T02:32:27.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.883+0000 7fa75d7fa700 1 --2- 172.21.15.88:0/3605327229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa74c068f60 0x7fa74c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:27.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.884+0000 7fa75d7fa700 1 -- 172.21.15.88:0/3605327229 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa750087840 con 0x7fa760102bf0 2023-12-09T02:32:27.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.884+0000 7fa757fff700 1 --2- 172.21.15.88:0/3605327229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa74c068f60 0x7fa74c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:27.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.884+0000 7fa757fff700 1 --2- 172.21.15.88:0/3605327229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa74c068f60 0x7fa74c06b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa748006fd0 tx=0x7fa748006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:27.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.888+0000 7fa75d7fa700 1 -- 172.21.15.88:0/3605327229 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa7500540e0 con 0x7fa760102bf0 2023-12-09T02:32:27.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.989+0000 7f271670a700 1 -- 172.21.15.88:0/3771655464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f27100fb2c0 con 0x7f27100fe610 2023-12-09T02:32:27.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.990+0000 7f270cff9700 1 -- 172.21.15.88:0/3771655464 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27040566a0 con 0x7f27100fe610 2023-12-09T02:32:27.992 INFO:teuthology.orchestra.run.smithi088.stdout:146028888075 2023-12-09T02:32:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.993+0000 7f271670a700 1 -- 172.21.15.88:0/3771655464 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f26f8068f60 msgr2=0x7f26f806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.993+0000 7f271670a700 1 --2- 172.21.15.88:0/3771655464 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f26f8068f60 0x7f26f806b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2700009fd0 tx=0x7f2700009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.993+0000 7f271670a700 1 -- 172.21.15.88:0/3771655464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27100fe610 msgr2=0x7f2710113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.993+0000 7f271670a700 1 --2- 172.21.15.88:0/3771655464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27100fe610 0x7f2710113b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f270400b790 tx=0x7f2704009250 comp rx=0 tx=0).stop 2023-12-09T02:32:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.993+0000 7f271670a700 1 -- 172.21.15.88:0/3771655464 shutdown_connections 2023-12-09T02:32:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.993+0000 7f271670a700 1 --2- 172.21.15.88:0/3771655464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27100fdc70 0x7f2710113600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.993+0000 7f271670a700 1 --2- 172.21.15.88:0/3771655464 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f26f8068f60 0x7f26f806b410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.993+0000 7f271670a700 1 --2- 172.21.15.88:0/3771655464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27100fe610 0x7f2710113b80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.993+0000 7f271670a700 1 -- 172.21.15.88:0/3771655464 >> 172.21.15.88:0/3771655464 conn(0x7f27100f76c0 msgr2=0x7f27101013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:27.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.993+0000 7f271670a700 1 -- 172.21.15.88:0/3771655464 shutdown_connections 2023-12-09T02:32:27.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:27.993+0000 7f271670a700 1 -- 172.21.15.88:0/3771655464 wait complete. 2023-12-09T02:32:28.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.096+0000 7fa766618700 1 -- 172.21.15.88:0/3605327229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa760109c20 con 0x7fa760102bf0 2023-12-09T02:32:28.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.097+0000 7fa75d7fa700 1 -- 172.21.15.88:0/3605327229 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa750057700 con 0x7fa760102bf0 2023-12-09T02:32:28.099 INFO:teuthology.orchestra.run.smithi088.stdout:38654705691 2023-12-09T02:32:28.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.099+0000 7fa766618700 1 -- 172.21.15.88:0/3605327229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa74c068f60 msgr2=0x7fa74c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:28.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.099+0000 7fa766618700 1 --2- 172.21.15.88:0/3605327229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa74c068f60 0x7fa74c06b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa748006fd0 tx=0x7fa748006db0 comp rx=0 tx=0).stop 2023-12-09T02:32:28.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.099+0000 7fa766618700 1 -- 172.21.15.88:0/3605327229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760102bf0 msgr2=0x7fa76006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:28.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.099+0000 7fa766618700 1 --2- 172.21.15.88:0/3605327229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760102bf0 0x7fa76006ff40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa75000b3b0 tx=0x7fa750009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:28.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.099+0000 7fa766618700 1 -- 172.21.15.88:0/3605327229 shutdown_connections 2023-12-09T02:32:28.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.099+0000 7fa766618700 1 --2- 172.21.15.88:0/3605327229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa74c068f60 0x7fa74c06b410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:28.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.099+0000 7fa766618700 1 --2- 172.21.15.88:0/3605327229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760102bf0 0x7fa76006ff40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:28.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.099+0000 7fa766618700 1 --2- 172.21.15.88:0/3605327229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa760103590 0x7fa760070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:28.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.099+0000 7fa766618700 1 -- 172.21.15.88:0/3605327229 >> 172.21.15.88:0/3605327229 conn(0x7fa7600f87a0 msgr2=0x7fa7600fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:28.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.099+0000 7fa766618700 1 -- 172.21.15.88:0/3605327229 shutdown_connections 2023-12-09T02:32:28.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.099+0000 7fa766618700 1 -- 172.21.15.88:0/3605327229 wait complete. 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 -- 172.21.15.88:0/3469608844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7a40fdc60 msgr2=0x7fd7a40fe030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 --2- 172.21.15.88:0/3469608844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7a40fdc60 0x7fd7a40fe030 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0004940 tx=0x7fd7a0009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 -- 172.21.15.88:0/3469608844 shutdown_connections 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 --2- 172.21.15.88:0/3469608844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a40fe600 0x7fd7a4106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 --2- 172.21.15.88:0/3469608844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7a40fdc60 0x7fd7a40fe030 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 -- 172.21.15.88:0/3469608844 >> 172.21.15.88:0/3469608844 conn(0x7fd7a40f7690 msgr2=0x7fd7a40f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 -- 172.21.15.88:0/3469608844 shutdown_connections 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 -- 172.21.15.88:0/3469608844 wait complete. 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 Processor -- start 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 -- start start 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7a40fdc60 0x7fd7a40fba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a40fe600 0x7fd7a40fbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40fc660 con 0x7fd7a40fdc60 2023-12-09T02:32:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.116+0000 7fd7ab383700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40fc7d0 con 0x7fd7a40fe600 2023-12-09T02:32:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd7a911f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7a40fdc60 0x7fd7a40fba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd7a911f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7a40fdc60 0x7fd7a40fba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58958/0 (socket says 172.21.15.88:58958) 2023-12-09T02:32:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd7a911f700 1 -- 172.21.15.88:0/1121215342 learned_addr learned my addr 172.21.15.88:0/1121215342 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd7a911f700 1 -- 172.21.15.88:0/1121215342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a40fe600 msgr2=0x7fd7a40fbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd7a891e700 1 --2- 172.21.15.88:0/1121215342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a40fe600 0x7fd7a40fbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd7a911f700 1 --2- 172.21.15.88:0/1121215342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a40fe600 0x7fd7a40fbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd7a911f700 1 -- 172.21.15.88:0/1121215342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a0005040 con 0x7fd7a40fdc60 2023-12-09T02:32:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd7a911f700 1 --2- 172.21.15.88:0/1121215342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7a40fdc60 0x7fd7a40fba90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000b3b0 tx=0x7fd7a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd799ffb700 1 -- 172.21.15.88:0/1121215342 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a000e040 con 0x7fd7a40fdc60 2023-12-09T02:32:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd799ffb700 1 -- 172.21.15.88:0/1121215342 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd7a0004290 con 0x7fd7a40fdc60 2023-12-09T02:32:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd7ab383700 1 -- 172.21.15.88:0/1121215342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a41198f0 con 0x7fd7a40fdc60 2023-12-09T02:32:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd799ffb700 1 -- 172.21.15.88:0/1121215342 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a001c3f0 con 0x7fd7a40fdc60 2023-12-09T02:32:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.117+0000 7fd7ab383700 1 -- 172.21.15.88:0/1121215342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a4119de0 con 0x7fd7a40fdc60 2023-12-09T02:32:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.119+0000 7fd7ab383700 1 -- 172.21.15.88:0/1121215342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a4104250 con 0x7fd7a40fdc60 2023-12-09T02:32:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.119+0000 7fd799ffb700 1 -- 172.21.15.88:0/1121215342 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd7a000bc50 con 0x7fd7a40fdc60 2023-12-09T02:32:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.119+0000 7fd799ffb700 1 --2- 172.21.15.88:0/1121215342 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd790068f60 0x7fd79006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.119+0000 7fd799ffb700 1 -- 172.21.15.88:0/1121215342 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd7a0087ec0 con 0x7fd7a40fdc60 2023-12-09T02:32:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.119+0000 7fd7a891e700 1 --2- 172.21.15.88:0/1121215342 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd790068f60 0x7fd79006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.120+0000 7fd7a891e700 1 --2- 172.21.15.88:0/1121215342 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd790068f60 0x7fd79006b410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd794006fd0 tx=0x7fd794008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:28.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.124+0000 7fd799ffb700 1 -- 172.21.15.88:0/1121215342 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd7a00546d0 con 0x7fd7a40fdc60 2023-12-09T02:32:28.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:28 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3771655464' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-09T02:32:28.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:28 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3605327229' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-09T02:32:28.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.318+0000 7fd7ab383700 1 -- 172.21.15.88:0/1121215342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd7a40fd1d0 con 0x7fd7a40fdc60 2023-12-09T02:32:28.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.318+0000 7fd799ffb700 1 -- 172.21.15.88:0/1121215342 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd7a0057cf0 con 0x7fd7a40fdc60 2023-12-09T02:32:28.323 INFO:teuthology.orchestra.run.smithi088.stdout:60129542168 2023-12-09T02:32:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.320+0000 7fd7ab383700 1 -- 172.21.15.88:0/1121215342 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd790068f60 msgr2=0x7fd79006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.320+0000 7fd7ab383700 1 --2- 172.21.15.88:0/1121215342 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd790068f60 0x7fd79006b410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd794006fd0 tx=0x7fd794008040 comp rx=0 tx=0).stop 2023-12-09T02:32:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.320+0000 7fd7ab383700 1 -- 172.21.15.88:0/1121215342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7a40fdc60 msgr2=0x7fd7a40fba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.320+0000 7fd7ab383700 1 --2- 172.21.15.88:0/1121215342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7a40fdc60 0x7fd7a40fba90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000b3b0 tx=0x7fd7a0009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.320+0000 7fd7ab383700 1 -- 172.21.15.88:0/1121215342 shutdown_connections 2023-12-09T02:32:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.320+0000 7fd7ab383700 1 --2- 172.21.15.88:0/1121215342 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd790068f60 0x7fd79006b410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.320+0000 7fd7ab383700 1 --2- 172.21.15.88:0/1121215342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7a40fdc60 0x7fd7a40fba90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.320+0000 7fd7ab383700 1 --2- 172.21.15.88:0/1121215342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a40fe600 0x7fd7a40fbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.320+0000 7fd7ab383700 1 -- 172.21.15.88:0/1121215342 >> 172.21.15.88:0/1121215342 conn(0x7fd7a40f7690 msgr2=0x7fd7a41013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.321+0000 7fd7ab383700 1 -- 172.21.15.88:0/1121215342 shutdown_connections 2023-12-09T02:32:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:28.321+0000 7fd7ab383700 1 -- 172.21.15.88:0/1121215342 wait complete. 2023-12-09T02:32:28.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:28 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3771655464' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-09T02:32:28.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:28 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3605327229' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-09T02:32:28.684 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888074 got 146028888075 for osd.4 2023-12-09T02:32:28.684 DEBUG:teuthology.parallel:result is None 2023-12-09T02:32:28.908 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542167 got 60129542168 for osd.1 2023-12-09T02:32:28.908 DEBUG:teuthology.parallel:result is None 2023-12-09T02:32:29.068 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705690 got 38654705691 for osd.0 2023-12-09T02:32:29.068 DEBUG:teuthology.parallel:result is None 2023-12-09T02:32:29.069 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-09T02:32:29.069 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph pg dump --format=json 2023-12-09T02:32:29.331 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:29.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:29 smithi161 ceph-mon[121170]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:29.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:29 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/1121215342' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-09T02:32:29.460 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:29 smithi088 ceph-mon[112028]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:29.460 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:29 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1121215342' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-09T02:32:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.353+0000 7faf03bbb700 1 -- 172.21.15.88:0/2045884360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0fe5e0 msgr2=0x7faefc106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.353+0000 7faf03bbb700 1 --2- 172.21.15.88:0/2045884360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0fe5e0 0x7faefc106c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faeec004970 tx=0x7faeec009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.353+0000 7faf03bbb700 1 -- 172.21.15.88:0/2045884360 shutdown_connections 2023-12-09T02:32:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.353+0000 7faf03bbb700 1 --2- 172.21.15.88:0/2045884360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0fe5e0 0x7faefc106c20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.353+0000 7faf03bbb700 1 --2- 172.21.15.88:0/2045884360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faefc0fdc40 0x7faefc0fe010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.353+0000 7faf03bbb700 1 -- 172.21.15.88:0/2045884360 >> 172.21.15.88:0/2045884360 conn(0x7faefc0f7690 msgr2=0x7faefc0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.353+0000 7faf03bbb700 1 -- 172.21.15.88:0/2045884360 shutdown_connections 2023-12-09T02:32:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.353+0000 7faf03bbb700 1 -- 172.21.15.88:0/2045884360 wait complete. 2023-12-09T02:32:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.353+0000 7faf03bbb700 1 Processor -- start 2023-12-09T02:32:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf03bbb700 1 -- start start 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf03bbb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faefc0fdc40 0x7faefc0fba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf03bbb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0fe5e0 0x7faefc0fbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf03bbb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0fc640 con 0x7faefc0fe5e0 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf03bbb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0fc7b0 con 0x7faefc0fdc40 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf01156700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0fe5e0 0x7faefc0fbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf01156700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0fe5e0 0x7faefc0fbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58974/0 (socket says 172.21.15.88:58974) 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf01156700 1 -- 172.21.15.88:0/3698701496 learned_addr learned my addr 172.21.15.88:0/3698701496 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf01957700 1 --2- 172.21.15.88:0/3698701496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faefc0fdc40 0x7faefc0fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf01156700 1 -- 172.21.15.88:0/3698701496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faefc0fdc40 msgr2=0x7faefc0fba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf01156700 1 --2- 172.21.15.88:0/3698701496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faefc0fdc40 0x7faefc0fba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf01156700 1 -- 172.21.15.88:0/3698701496 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec005040 con 0x7faefc0fe5e0 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf01156700 1 --2- 172.21.15.88:0/3698701496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0fe5e0 0x7faefc0fbfb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faeec000c00 tx=0x7faeec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faef27fc700 1 -- 172.21.15.88:0/3698701496 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faeec00e040 con 0x7faefc0fe5e0 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faef27fc700 1 -- 172.21.15.88:0/3698701496 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faeec00bc10 con 0x7faefc0fe5e0 2023-12-09T02:32:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf03bbb700 1 -- 172.21.15.88:0/3698701496 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc119900 con 0x7faefc0fe5e0 2023-12-09T02:32:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faef27fc700 1 -- 172.21.15.88:0/3698701496 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faeec01c3f0 con 0x7faefc0fe5e0 2023-12-09T02:32:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.354+0000 7faf03bbb700 1 -- 172.21.15.88:0/3698701496 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc119df0 con 0x7faefc0fe5e0 2023-12-09T02:32:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.355+0000 7faf03bbb700 1 -- 172.21.15.88:0/3698701496 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc1042c0 con 0x7faefc0fe5e0 2023-12-09T02:32:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.356+0000 7faef27fc700 1 -- 172.21.15.88:0/3698701496 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7faeec013420 con 0x7faefc0fe5e0 2023-12-09T02:32:30.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.356+0000 7faef27fc700 1 --2- 172.21.15.88:0/3698701496 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7faee8068fb0 0x7faee806b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:30.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.356+0000 7faef27fc700 1 -- 172.21.15.88:0/3698701496 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faeec087e40 con 0x7faefc0fe5e0 2023-12-09T02:32:30.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.356+0000 7faf01957700 1 --2- 172.21.15.88:0/3698701496 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7faee8068fb0 0x7faee806b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:30.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.357+0000 7faf01957700 1 --2- 172.21.15.88:0/3698701496 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7faee8068fb0 0x7faee806b460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faef8006fd0 tx=0x7faef8008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:30.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.360+0000 7faef27fc700 1 -- 172.21.15.88:0/3698701496 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faeec0545b0 con 0x7faefc0fe5e0 2023-12-09T02:32:30.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.538+0000 7faf03bbb700 1 -- 172.21.15.88:0/3698701496 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faefc04bb80 con 0x7faee8068fb0 2023-12-09T02:32:30.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.539+0000 7faef27fc700 1 -- 172.21.15.88:0/3698701496 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24446 (secure 0 0 0) 0x7faefc04bb80 con 0x7faee8068fb0 2023-12-09T02:32:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:30.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.541+0000 7faf03bbb700 1 -- 172.21.15.88:0/3698701496 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7faee8068fb0 msgr2=0x7faee806b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:30.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.541+0000 7faf03bbb700 1 --2- 172.21.15.88:0/3698701496 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7faee8068fb0 0x7faee806b460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faef8006fd0 tx=0x7faef8008040 comp rx=0 tx=0).stop 2023-12-09T02:32:30.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.541+0000 7faf03bbb700 1 -- 172.21.15.88:0/3698701496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0fe5e0 msgr2=0x7faefc0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:30.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.541+0000 7faf03bbb700 1 --2- 172.21.15.88:0/3698701496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0fe5e0 0x7faefc0fbfb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faeec000c00 tx=0x7faeec009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:30.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.541+0000 7faf03bbb700 1 -- 172.21.15.88:0/3698701496 shutdown_connections 2023-12-09T02:32:30.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.541+0000 7faf03bbb700 1 --2- 172.21.15.88:0/3698701496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faefc0fdc40 0x7faefc0fba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:30.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.541+0000 7faf03bbb700 1 --2- 172.21.15.88:0/3698701496 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7faee8068fb0 0x7faee806b460 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:30.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.541+0000 7faf03bbb700 1 --2- 172.21.15.88:0/3698701496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0fe5e0 0x7faefc0fbfb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:30.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.541+0000 7faf03bbb700 1 -- 172.21.15.88:0/3698701496 >> 172.21.15.88:0/3698701496 conn(0x7faefc0f7690 msgr2=0x7faefc101440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:30.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.541+0000 7faf03bbb700 1 -- 172.21.15.88:0/3698701496 shutdown_connections 2023-12-09T02:32:30.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:30.541+0000 7faf03bbb700 1 -- 172.21.15.88:0/3698701496 wait complete. 2023-12-09T02:32:30.544 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-09T02:32:30.916 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-12-09T02:32:29.538865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787600,"kb_used_data":3872,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683312,"statfs":{"total":575970213888,"available":574139711488,"internally_reserved":0,"allocated":3964928,"data_stored":2600527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001986"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-09T02:32:02.551744+0000","last_change":"2023-12-09T02:31:43.377813+0000","last_active":"2023-12-09T02:32:02.551744+0000","last_peered":"2023-12-09T02:32:02.551744+0000","last_clean":"2023-12-09T02:32:02.551744+0000","last_became_active":"2023-12-09T02:31:43.377472+0000","last_became_peered":"2023-12-09T02:31:43.377472+0000","last_unstale":"2023-12-09T02:32:02.551744+0000","last_undegraded":"2023-12-09T02:32:02.551744+0000","last_fullsized":"2023-12-09T02:32:02.551744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-09T02:31:08.452685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-09T02:31:08.452685+0000","last_clean_scrub_stamp":"2023-12-09T02:31:08.452685+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T12:37:41.434745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888076,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117008,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 9 02:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Sat Dec 9 02:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Sat Dec 9 02:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447512,"statfs":{"total":95995035648,"available":95690252288,"internally_reserved":0,"allocated":360448,"data_stored":137728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 9 02:32:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.249}]},{"osd":1,"last update":"Sat Dec 9 02:32:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.26900000000000002}]},{"osd":3,"last update":"Sat Dec 9 02:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 9 02:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.24299999999999999}]},{"osd":2,"last update":"Sat Dec 9 02:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.27800000000000002}]},{"osd":3,"last update":"Sat Dec 9 02:32:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 9 02:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.34699999999999998}]},{"osd":2,"last update":"Sat Dec 9 02:32:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Dec 9 02:32:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-09T02:32:30.917 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph pg dump --format=json 2023-12-09T02:32:31.178 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:31.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:31 smithi161 ceph-mon[121170]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:31.449 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:31 smithi088 ceph-mon[112028]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.124+0000 7f6a37d5d700 1 -- 172.21.15.88:0/225778087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a300fbb40 msgr2=0x7f6a300fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.124+0000 7f6a37d5d700 1 --2- 172.21.15.88:0/225778087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a300fbb40 0x7f6a300fbfb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6a20004940 tx=0x7f6a20009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.124+0000 7f6a37d5d700 1 -- 172.21.15.88:0/225778087 shutdown_connections 2023-12-09T02:32:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.124+0000 7f6a37d5d700 1 --2- 172.21.15.88:0/225778087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a300fbb40 0x7f6a300fbfb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.124+0000 7f6a37d5d700 1 --2- 172.21.15.88:0/225778087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30101b00 0x7f6a30101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.124+0000 7f6a37d5d700 1 -- 172.21.15.88:0/225778087 >> 172.21.15.88:0/225778087 conn(0x7f6a300719b0 msgr2=0x7f6a30071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.124+0000 7f6a37d5d700 1 -- 172.21.15.88:0/225778087 shutdown_connections 2023-12-09T02:32:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.124+0000 7f6a37d5d700 1 -- 172.21.15.88:0/225778087 wait complete. 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.124+0000 7f6a37d5d700 1 Processor -- start 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.124+0000 7f6a37d5d700 1 -- start start 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a37d5d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a300fbb40 0x7f6a301136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a37d5d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30101b00 0x7f6a30113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a37d5d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a30114290 con 0x7f6a300fbb40 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a37d5d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3010d580 con 0x7f6a30101b00 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a35af9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a300fbb40 0x7f6a301136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a35af9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a300fbb40 0x7f6a301136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58990/0 (socket says 172.21.15.88:58990) 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a35af9700 1 -- 172.21.15.88:0/3852437988 learned_addr learned my addr 172.21.15.88:0/3852437988 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a352f8700 1 --2- 172.21.15.88:0/3852437988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30101b00 0x7f6a30113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a35af9700 1 -- 172.21.15.88:0/3852437988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30101b00 msgr2=0x7f6a30113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a35af9700 1 --2- 172.21.15.88:0/3852437988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30101b00 0x7f6a30113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a35af9700 1 -- 172.21.15.88:0/3852437988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20005040 con 0x7f6a300fbb40 2023-12-09T02:32:32.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a35af9700 1 --2- 172.21.15.88:0/3852437988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a300fbb40 0x7f6a301136c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00c8c0 tx=0x7f6a2c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:32.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a267fc700 1 -- 172.21.15.88:0/3852437988 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a2c00a980 con 0x7f6a300fbb40 2023-12-09T02:32:32.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a267fc700 1 -- 172.21.15.88:0/3852437988 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a2c00ce60 con 0x7f6a300fbb40 2023-12-09T02:32:32.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a267fc700 1 -- 172.21.15.88:0/3852437988 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a2c0113a0 con 0x7f6a300fbb40 2023-12-09T02:32:32.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a37d5d700 1 -- 172.21.15.88:0/3852437988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3010d810 con 0x7f6a300fbb40 2023-12-09T02:32:32.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.125+0000 7f6a37d5d700 1 -- 172.21.15.88:0/3852437988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3010dd50 con 0x7f6a300fbb40 2023-12-09T02:32:32.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.126+0000 7f6a37d5d700 1 -- 172.21.15.88:0/3852437988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a300734d0 con 0x7f6a300fbb40 2023-12-09T02:32:32.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.127+0000 7f6a267fc700 1 -- 172.21.15.88:0/3852437988 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6a2c012400 con 0x7f6a300fbb40 2023-12-09T02:32:32.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.127+0000 7f6a267fc700 1 --2- 172.21.15.88:0/3852437988 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6a1c068f60 0x7f6a1c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:32.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.127+0000 7f6a267fc700 1 -- 172.21.15.88:0/3852437988 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6a2c086a70 con 0x7f6a300fbb40 2023-12-09T02:32:32.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.127+0000 7f6a352f8700 1 --2- 172.21.15.88:0/3852437988 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6a1c068f60 0x7f6a1c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:32.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.128+0000 7f6a352f8700 1 --2- 172.21.15.88:0/3852437988 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6a1c068f60 0x7f6a1c06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a20004f90 tx=0x7f6a20009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:32.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.131+0000 7f6a267fc700 1 -- 172.21.15.88:0/3852437988 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6a2c056db0 con 0x7f6a300fbb40 2023-12-09T02:32:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.309+0000 7f6a37d5d700 1 -- 172.21.15.88:0/3852437988 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a3010ed10 con 0x7f6a1c068f60 2023-12-09T02:32:32.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.310+0000 7f6a267fc700 1 -- 172.21.15.88:0/3852437988 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24446 (secure 0 0 0) 0x7f6a3010ed10 con 0x7f6a1c068f60 2023-12-09T02:32:32.313 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.312+0000 7f6a37d5d700 1 -- 172.21.15.88:0/3852437988 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6a1c068f60 msgr2=0x7f6a1c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.312+0000 7f6a37d5d700 1 --2- 172.21.15.88:0/3852437988 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6a1c068f60 0x7f6a1c06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a20004f90 tx=0x7f6a20009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.312+0000 7f6a37d5d700 1 -- 172.21.15.88:0/3852437988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a300fbb40 msgr2=0x7f6a301136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.312+0000 7f6a37d5d700 1 --2- 172.21.15.88:0/3852437988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a300fbb40 0x7f6a301136c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00c8c0 tx=0x7f6a2c0044c0 comp rx=0 tx=0).stop 2023-12-09T02:32:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.312+0000 7f6a37d5d700 1 -- 172.21.15.88:0/3852437988 shutdown_connections 2023-12-09T02:32:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.312+0000 7f6a37d5d700 1 --2- 172.21.15.88:0/3852437988 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6a1c068f60 0x7f6a1c06b410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.312+0000 7f6a37d5d700 1 --2- 172.21.15.88:0/3852437988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a300fbb40 0x7f6a301136c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.312+0000 7f6a37d5d700 1 --2- 172.21.15.88:0/3852437988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30101b00 0x7f6a30113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.312+0000 7f6a37d5d700 1 -- 172.21.15.88:0/3852437988 >> 172.21.15.88:0/3852437988 conn(0x7f6a300719b0 msgr2=0x7f6a300654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.312+0000 7f6a37d5d700 1 -- 172.21.15.88:0/3852437988 shutdown_connections 2023-12-09T02:32:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:32.312+0000 7f6a37d5d700 1 -- 172.21.15.88:0/3852437988 wait complete. 2023-12-09T02:32:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-09T02:32:32.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:32 smithi161 ceph-mon[121170]: from='client.14410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-09T02:32:32.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:32 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:32:32.470 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:32 smithi088 ceph-mon[112028]: from='client.14410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-09T02:32:32.470 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:32 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:32:32.691 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-12-09T02:32:31.539247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787600,"kb_used_data":3872,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683312,"statfs":{"total":575970213888,"available":574139711488,"internally_reserved":0,"allocated":3964928,"data_stored":2600527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001979"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-09T02:32:02.551744+0000","last_change":"2023-12-09T02:31:43.377813+0000","last_active":"2023-12-09T02:32:02.551744+0000","last_peered":"2023-12-09T02:32:02.551744+0000","last_clean":"2023-12-09T02:32:02.551744+0000","last_became_active":"2023-12-09T02:31:43.377472+0000","last_became_peered":"2023-12-09T02:31:43.377472+0000","last_unstale":"2023-12-09T02:32:02.551744+0000","last_undegraded":"2023-12-09T02:32:02.551744+0000","last_fullsized":"2023-12-09T02:32:02.551744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-09T02:31:08.452685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-09T02:31:08.452685+0000","last_clean_scrub_stamp":"2023-12-09T02:31:08.452685+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T12:37:41.434745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888076,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117008,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 9 02:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Sat Dec 9 02:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Sat Dec 9 02:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447512,"statfs":{"total":95995035648,"available":95690252288,"internally_reserved":0,"allocated":360448,"data_stored":137728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 9 02:32:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.249}]},{"osd":1,"last update":"Sat Dec 9 02:32:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.26900000000000002}]},{"osd":3,"last update":"Sat Dec 9 02:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 9 02:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.24299999999999999}]},{"osd":2,"last update":"Sat Dec 9 02:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.27800000000000002}]},{"osd":3,"last update":"Sat Dec 9 02:32:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 9 02:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.34699999999999998}]},{"osd":2,"last update":"Sat Dec 9 02:32:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Dec 9 02:32:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-09T02:32:32.692 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-09T02:32:32.692 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-09T02:32:32.692 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-09T02:32:32.692 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph health --format=json 2023-12-09T02:32:32.951 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:33.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:33 smithi161 ceph-mon[121170]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:33.436 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:33 smithi088 ceph-mon[112028]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.993+0000 7fdacbb4d700 1 -- 172.21.15.88:0/553964313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdac4101af0 msgr2=0x7fdac4101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.993+0000 7fdacbb4d700 1 --2- 172.21.15.88:0/553964313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdac4101af0 0x7fdac4101ec0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdab4004940 tx=0x7fdab4009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.993+0000 7fdacbb4d700 1 -- 172.21.15.88:0/553964313 shutdown_connections 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.993+0000 7fdacbb4d700 1 --2- 172.21.15.88:0/553964313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fbb30 0x7fdac40fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.993+0000 7fdacbb4d700 1 --2- 172.21.15.88:0/553964313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdac4101af0 0x7fdac4101ec0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.993+0000 7fdacbb4d700 1 -- 172.21.15.88:0/553964313 >> 172.21.15.88:0/553964313 conn(0x7fdac40f7690 msgr2=0x7fdac40f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.993+0000 7fdacbb4d700 1 -- 172.21.15.88:0/553964313 shutdown_connections 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.993+0000 7fdacbb4d700 1 -- 172.21.15.88:0/553964313 wait complete. 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.994+0000 7fdacbb4d700 1 Processor -- start 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.994+0000 7fdacbb4d700 1 -- start start 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.994+0000 7fdacbb4d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fbb30 0x7fdac41136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.994+0000 7fdacbb4d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdac4101af0 0x7fdac4113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.994+0000 7fdacbb4d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac4114280 con 0x7fdac4101af0 2023-12-09T02:32:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.994+0000 7fdacbb4d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac410d570 con 0x7fdac40fbb30 2023-12-09T02:32:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.994+0000 7fdac90e8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdac4101af0 0x7fdac4113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.994+0000 7fdac90e8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdac4101af0 0x7fdac4113c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59016/0 (socket says 172.21.15.88:59016) 2023-12-09T02:32:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.994+0000 7fdac90e8700 1 -- 172.21.15.88:0/3597643503 learned_addr learned my addr 172.21.15.88:0/3597643503 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.994+0000 7fdac98e9700 1 --2- 172.21.15.88:0/3597643503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fbb30 0x7fdac41136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.995+0000 7fdac90e8700 1 -- 172.21.15.88:0/3597643503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fbb30 msgr2=0x7fdac41136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.995+0000 7fdac90e8700 1 --2- 172.21.15.88:0/3597643503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fbb30 0x7fdac41136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.995+0000 7fdac90e8700 1 -- 172.21.15.88:0/3597643503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4005040 con 0x7fdac4101af0 2023-12-09T02:32:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.995+0000 7fdac90e8700 1 --2- 172.21.15.88:0/3597643503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdac4101af0 0x7fdac4113c30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b790 tx=0x7fdac0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.995+0000 7fdaba7fc700 1 -- 172.21.15.88:0/3597643503 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdac000f6f0 con 0x7fdac4101af0 2023-12-09T02:32:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.995+0000 7fdaba7fc700 1 -- 172.21.15.88:0/3597643503 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdac000fd00 con 0x7fdac4101af0 2023-12-09T02:32:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.995+0000 7fdaba7fc700 1 -- 172.21.15.88:0/3597643503 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdac00103a0 con 0x7fdac4101af0 2023-12-09T02:32:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.995+0000 7fdacbb4d700 1 -- 172.21.15.88:0/3597643503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac410d850 con 0x7fdac4101af0 2023-12-09T02:32:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.995+0000 7fdacbb4d700 1 -- 172.21.15.88:0/3597643503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac410dd90 con 0x7fdac4101af0 2023-12-09T02:32:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.996+0000 7fdacbb4d700 1 -- 172.21.15.88:0/3597643503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac40647b0 con 0x7fdac4101af0 2023-12-09T02:32:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.997+0000 7fdaba7fc700 1 -- 172.21.15.88:0/3597643503 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdac000f850 con 0x7fdac4101af0 2023-12-09T02:32:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.997+0000 7fdaba7fc700 1 --2- 172.21.15.88:0/3597643503 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdab0068f60 0x7fdab006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.997+0000 7fdaba7fc700 1 -- 172.21.15.88:0/3597643503 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdac0086840 con 0x7fdac4101af0 2023-12-09T02:32:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.997+0000 7fdac98e9700 1 --2- 172.21.15.88:0/3597643503 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdab0068f60 0x7fdab006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:33.997+0000 7fdac98e9700 1 --2- 172.21.15.88:0/3597643503 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdab0068f60 0x7fdab006b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdab4004f90 tx=0x7fdab4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:34.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.002+0000 7fdaba7fc700 1 -- 172.21.15.88:0/3597643503 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdac0056ac0 con 0x7fdac4101af0 2023-12-09T02:32:34.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.226+0000 7fdacbb4d700 1 -- 172.21.15.88:0/3597643503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdac40fb290 con 0x7fdac4101af0 2023-12-09T02:32:34.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.226+0000 7fdaba7fc700 1 -- 172.21.15.88:0/3597643503 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fdac40fb290 con 0x7fdac4101af0 2023-12-09T02:32:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:34.229 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-09T02:32:34.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.228+0000 7fdacbb4d700 1 -- 172.21.15.88:0/3597643503 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdab0068f60 msgr2=0x7fdab006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:34.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.228+0000 7fdacbb4d700 1 --2- 172.21.15.88:0/3597643503 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdab0068f60 0x7fdab006b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdab4004f90 tx=0x7fdab4009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:34.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.228+0000 7fdacbb4d700 1 -- 172.21.15.88:0/3597643503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdac4101af0 msgr2=0x7fdac4113c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:34.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.228+0000 7fdacbb4d700 1 --2- 172.21.15.88:0/3597643503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdac4101af0 0x7fdac4113c30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b790 tx=0x7fdac0009250 comp rx=0 tx=0).stop 2023-12-09T02:32:34.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.228+0000 7fdacbb4d700 1 -- 172.21.15.88:0/3597643503 shutdown_connections 2023-12-09T02:32:34.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.228+0000 7fdacbb4d700 1 --2- 172.21.15.88:0/3597643503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fbb30 0x7fdac41136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:34.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.228+0000 7fdacbb4d700 1 --2- 172.21.15.88:0/3597643503 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdab0068f60 0x7fdab006b410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:34.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.228+0000 7fdacbb4d700 1 --2- 172.21.15.88:0/3597643503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdac4101af0 0x7fdac4113c30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:34.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.228+0000 7fdacbb4d700 1 -- 172.21.15.88:0/3597643503 >> 172.21.15.88:0/3597643503 conn(0x7fdac40f7690 msgr2=0x7fdac40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:34.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.228+0000 7fdacbb4d700 1 -- 172.21.15.88:0/3597643503 shutdown_connections 2023-12-09T02:32:34.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:34.228+0000 7fdacbb4d700 1 -- 172.21.15.88:0/3597643503 wait complete. 2023-12-09T02:32:34.403 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:34 smithi088 ceph-mon[112028]: from='client.14414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-09T02:32:34.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:34 smithi161 ceph-mon[121170]: from='client.14414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-09T02:32:34.607 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-09T02:32:34.607 INFO:tasks.cephadm:Setup complete, yielding 2023-12-09T02:32:34.608 INFO:teuthology.run_tasks:Running task print... 2023-12-09T02:32:34.617 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-09T02:32:34.617 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-09T02:32:34.634 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:32:34.635 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-09T02:32:34.895 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:35.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:35 smithi088 ceph-mon[112028]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:35.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:35 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3597643503' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-09T02:32:35.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:35 smithi161 ceph-mon[121170]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:35.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:35 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3597643503' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-09T02:32:35.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.885+0000 7f8da74a1700 1 -- 172.21.15.88:0/4265543077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da00fe270 msgr2=0x7f8da00fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.885+0000 7f8da74a1700 1 --2- 172.21.15.88:0/4265543077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da00fe270 0x7f8da00fe680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8d90004940 tx=0x7f8d90009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.885+0000 7f8da74a1700 1 -- 172.21.15.88:0/4265543077 shutdown_connections 2023-12-09T02:32:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.885+0000 7f8da74a1700 1 --2- 172.21.15.88:0/4265543077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8da00fec50 0x7f8da00fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.885+0000 7f8da74a1700 1 --2- 172.21.15.88:0/4265543077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da00fe270 0x7f8da00fe680 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.885+0000 7f8da74a1700 1 -- 172.21.15.88:0/4265543077 >> 172.21.15.88:0/4265543077 conn(0x7f8da00f6950 msgr2=0x7f8da00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.885+0000 7f8da74a1700 1 -- 172.21.15.88:0/4265543077 shutdown_connections 2023-12-09T02:32:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.885+0000 7f8da74a1700 1 -- 172.21.15.88:0/4265543077 wait complete. 2023-12-09T02:32:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da74a1700 1 Processor -- start 2023-12-09T02:32:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da74a1700 1 -- start start 2023-12-09T02:32:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da74a1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da00fe270 0x7f8da010d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da74a1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8da010db30 0x7f8da010e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da74a1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da010e080 con 0x7f8da00fe270 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da74a1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da010e1c0 con 0x7f8da010db30 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da523d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da00fe270 0x7f8da010d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da523d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da00fe270 0x7f8da010d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59044/0 (socket says 172.21.15.88:59044) 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da523d700 1 -- 172.21.15.88:0/1501732299 learned_addr learned my addr 172.21.15.88:0/1501732299 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da4a3c700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8da010db30 0x7f8da010e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da523d700 1 -- 172.21.15.88:0/1501732299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8da010db30 msgr2=0x7f8da010e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da523d700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8da010db30 0x7f8da010e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da523d700 1 -- 172.21.15.88:0/1501732299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d90005040 con 0x7f8da00fe270 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.886+0000 7f8da4a3c700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8da010db30 0x7f8da010e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.887+0000 7f8da523d700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da00fe270 0x7f8da010d5f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009180 tx=0x7f8d90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.887+0000 7f8d95ffb700 1 -- 172.21.15.88:0/1501732299 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d9000e040 con 0x7f8da00fe270 2023-12-09T02:32:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.887+0000 7f8d95ffb700 1 -- 172.21.15.88:0/1501732299 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d90004290 con 0x7f8da00fe270 2023-12-09T02:32:35.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.887+0000 7f8da74a1700 1 -- 172.21.15.88:0/1501732299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da010f050 con 0x7f8da00fe270 2023-12-09T02:32:35.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.887+0000 7f8d95ffb700 1 -- 172.21.15.88:0/1501732299 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d9001c630 con 0x7f8da00fe270 2023-12-09T02:32:35.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.887+0000 7f8da74a1700 1 -- 172.21.15.88:0/1501732299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da010f590 con 0x7f8da00fe270 2023-12-09T02:32:35.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.888+0000 7f8da74a1700 1 -- 172.21.15.88:0/1501732299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da004bb80 con 0x7f8da00fe270 2023-12-09T02:32:35.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.888+0000 7f8d95ffb700 1 -- 172.21.15.88:0/1501732299 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8d9000bc50 con 0x7f8da00fe270 2023-12-09T02:32:35.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.889+0000 7f8d95ffb700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8d8c068f70 0x7f8d8c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:35.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.889+0000 7f8d95ffb700 1 -- 172.21.15.88:0/1501732299 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8d90087e60 con 0x7f8da00fe270 2023-12-09T02:32:35.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.889+0000 7f8da4a3c700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8d8c068f70 0x7f8d8c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:35.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.889+0000 7f8da4a3c700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8d8c068f70 0x7f8d8c06b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c006fd0 tx=0x7f8d9c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:35.893+0000 7f8d95ffb700 1 -- 172.21.15.88:0/1501732299 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8d90058100 con 0x7f8da00fe270 2023-12-09T02:32:36.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.076+0000 7f8da74a1700 1 -- 172.21.15.88:0/1501732299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f8da010f7b0 con 0x7f8da00fe270 2023-12-09T02:32:36.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.080+0000 7f8d95ffb700 1 -- 172.21.15.88:0/1501732299 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f8d90057c90 con 0x7f8da00fe270 2023-12-09T02:32:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.082+0000 7f8da74a1700 1 -- 172.21.15.88:0/1501732299 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8d8c068f70 msgr2=0x7f8d8c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.082+0000 7f8da74a1700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8d8c068f70 0x7f8d8c06b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c006fd0 tx=0x7f8d9c008040 comp rx=0 tx=0).stop 2023-12-09T02:32:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.082+0000 7f8da74a1700 1 -- 172.21.15.88:0/1501732299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da00fe270 msgr2=0x7f8da010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.082+0000 7f8da74a1700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da00fe270 0x7f8da010d5f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009180 tx=0x7f8d90009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.082+0000 7f8da74a1700 1 -- 172.21.15.88:0/1501732299 shutdown_connections 2023-12-09T02:32:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.082+0000 7f8da74a1700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8d8c068f70 0x7f8d8c06b420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.082+0000 7f8da74a1700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da00fe270 0x7f8da010d5f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.082+0000 7f8da74a1700 1 --2- 172.21.15.88:0/1501732299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8da010db30 0x7f8da010e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.082+0000 7f8da74a1700 1 -- 172.21.15.88:0/1501732299 >> 172.21.15.88:0/1501732299 conn(0x7f8da00f6950 msgr2=0x7f8da0101250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.083+0000 7f8da74a1700 1 -- 172.21.15.88:0/1501732299 shutdown_connections 2023-12-09T02:32:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:36.083+0000 7f8da74a1700 1 -- 172.21.15.88:0/1501732299 wait complete. 2023-12-09T02:32:36.457 INFO:teuthology.run_tasks:Running task print... 2023-12-09T02:32:36.468 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-09T02:32:36.468 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-09T02:32:36.481 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:32:36.482 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph orch status' 2023-12-09T02:32:36.742 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:37 smithi088 ceph-mon[112028]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:37 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1501732299' entity='client.admin' 2023-12-09T02:32:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:32:37.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:37.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:32:37.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:37 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:37.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:37 smithi161 ceph-mon[121170]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:37.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:37 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/1501732299' entity='client.admin' 2023-12-09T02:32:37.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:37 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:32:37.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:37 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:37.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:37 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:32:37.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:37 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.794+0000 7f8fcd45d700 1 -- 172.21.15.88:0/1818700955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fc80fde00 msgr2=0x7f8fc80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.794+0000 7f8fcd45d700 1 --2- 172.21.15.88:0/1818700955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fc80fde00 0x7f8fc80fe250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc004940 tx=0x7f8fbc009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.794+0000 7f8fcd45d700 1 -- 172.21.15.88:0/1818700955 shutdown_connections 2023-12-09T02:32:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.794+0000 7f8fcd45d700 1 --2- 172.21.15.88:0/1818700955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fc80fde00 0x7f8fc80fe250 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.794+0000 7f8fcd45d700 1 --2- 172.21.15.88:0/1818700955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc80fcbf0 0x7f8fc80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.794+0000 7f8fcd45d700 1 -- 172.21.15.88:0/1818700955 >> 172.21.15.88:0/1818700955 conn(0x7f8fc80f82d0 msgr2=0x7f8fc80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.795+0000 7f8fcd45d700 1 -- 172.21.15.88:0/1818700955 shutdown_connections 2023-12-09T02:32:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.795+0000 7f8fcd45d700 1 -- 172.21.15.88:0/1818700955 wait complete. 2023-12-09T02:32:37.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.795+0000 7f8fcd45d700 1 Processor -- start 2023-12-09T02:32:37.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.795+0000 7f8fcd45d700 1 -- start start 2023-12-09T02:32:37.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.795+0000 7f8fcd45d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fc80fcbf0 0x7f8fc810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:37.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.795+0000 7f8fcd45d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc80fde00 0x7f8fc810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:37.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.795+0000 7f8fcd45d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc810e130 con 0x7f8fc80fcbf0 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.795+0000 7f8fcd45d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc810e970 con 0x7f8fc80fde00 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.795+0000 7f8fc6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fc80fcbf0 0x7f8fc810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.795+0000 7f8fc6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fc80fcbf0 0x7f8fc810d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38638/0 (socket says 172.21.15.88:38638) 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.795+0000 7f8fc6ffd700 1 -- 172.21.15.88:0/3747594751 learned_addr learned my addr 172.21.15.88:0/3747594751 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.796+0000 7f8fc67fc700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc80fde00 0x7f8fc810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.796+0000 7f8fc6ffd700 1 -- 172.21.15.88:0/3747594751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc80fde00 msgr2=0x7f8fc810daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.796+0000 7f8fc6ffd700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc80fde00 0x7f8fc810daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.796+0000 7f8fc6ffd700 1 -- 172.21.15.88:0/3747594751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc005040 con 0x7f8fc80fcbf0 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.796+0000 7f8fc67fc700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc80fde00 0x7f8fc810daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.796+0000 7f8fc6ffd700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fc80fcbf0 0x7f8fc810d560 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800b790 tx=0x7f8fb8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.796+0000 7f8faf7fe700 1 -- 172.21.15.88:0/3747594751 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fb800f6f0 con 0x7f8fc80fcbf0 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.796+0000 7f8faf7fe700 1 -- 172.21.15.88:0/3747594751 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fb800fd00 con 0x7f8fc80fcbf0 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.796+0000 7f8fcd45d700 1 -- 172.21.15.88:0/3747594751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc810ec50 con 0x7f8fc80fcbf0 2023-12-09T02:32:37.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.796+0000 7f8faf7fe700 1 -- 172.21.15.88:0/3747594751 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fb80103a0 con 0x7f8fc80fcbf0 2023-12-09T02:32:37.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.796+0000 7f8fcd45d700 1 -- 172.21.15.88:0/3747594751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc810f190 con 0x7f8fc80fcbf0 2023-12-09T02:32:37.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.797+0000 7f8fcd45d700 1 -- 172.21.15.88:0/3747594751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc804bb80 con 0x7f8fc80fcbf0 2023-12-09T02:32:37.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.797+0000 7f8faf7fe700 1 -- 172.21.15.88:0/3747594751 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8fb800f850 con 0x7f8fc80fcbf0 2023-12-09T02:32:37.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.798+0000 7f8faf7fe700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8fb0068f60 0x7f8fb006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:37.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.798+0000 7f8faf7fe700 1 -- 172.21.15.88:0/3747594751 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8fb8086890 con 0x7f8fc80fcbf0 2023-12-09T02:32:37.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.798+0000 7f8fc67fc700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8fb0068f60 0x7f8fb006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:37.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.798+0000 7f8fc67fc700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8fb0068f60 0x7f8fb006b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc004560 tx=0x7f8fbc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:37.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.802+0000 7f8faf7fe700 1 -- 172.21.15.88:0/3747594751 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8fb8056ab0 con 0x7f8fc80fcbf0 2023-12-09T02:32:38.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:37.999+0000 7f8fcd45d700 1 -- 172.21.15.88:0/3747594751 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fc810f640 con 0x7f8fb0068f60 2023-12-09T02:32:38.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.000+0000 7f8faf7fe700 1 -- 172.21.15.88:0/3747594751 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8fc810f640 con 0x7f8fb0068f60 2023-12-09T02:32:38.002 INFO:teuthology.orchestra.run.smithi088.stdout:Backend: cephadm 2023-12-09T02:32:38.003 INFO:teuthology.orchestra.run.smithi088.stdout:Available: Yes 2023-12-09T02:32:38.003 INFO:teuthology.orchestra.run.smithi088.stdout:Paused: No 2023-12-09T02:32:38.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.002+0000 7f8fcd45d700 1 -- 172.21.15.88:0/3747594751 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8fb0068f60 msgr2=0x7f8fb006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:38.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.002+0000 7f8fcd45d700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8fb0068f60 0x7f8fb006b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc004560 tx=0x7f8fbc009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:38.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.002+0000 7f8fcd45d700 1 -- 172.21.15.88:0/3747594751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fc80fcbf0 msgr2=0x7f8fc810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:38.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.002+0000 7f8fcd45d700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fc80fcbf0 0x7f8fc810d560 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800b790 tx=0x7f8fb8009220 comp rx=0 tx=0).stop 2023-12-09T02:32:38.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.002+0000 7f8fcd45d700 1 -- 172.21.15.88:0/3747594751 shutdown_connections 2023-12-09T02:32:38.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.002+0000 7f8fcd45d700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8fb0068f60 0x7f8fb006b410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:38.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.002+0000 7f8fcd45d700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fc80fcbf0 0x7f8fc810d560 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:38.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.002+0000 7f8fcd45d700 1 --2- 172.21.15.88:0/3747594751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc80fde00 0x7f8fc810daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:38.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.002+0000 7f8fcd45d700 1 -- 172.21.15.88:0/3747594751 >> 172.21.15.88:0/3747594751 conn(0x7f8fc80f82d0 msgr2=0x7f8fc8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:38.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.002+0000 7f8fcd45d700 1 -- 172.21.15.88:0/3747594751 shutdown_connections 2023-12-09T02:32:38.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:38.002+0000 7f8fcd45d700 1 -- 172.21.15.88:0/3747594751 wait complete. 2023-12-09T02:32:38.398 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-09T02:32:38.657 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:39.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:39 smithi161 ceph-mon[121170]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:39.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:39 smithi161 ceph-mon[121170]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:39.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:39 smithi088 ceph-mon[112028]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:39.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:39 smithi088 ceph-mon[112028]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:39.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.673+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1487343323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a40fcbf0 msgr2=0x7f16a40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:39.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.673+0000 7f16aaf8a700 1 --2- 172.21.15.88:0/1487343323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a40fcbf0 0x7f16a40fd000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1698004940 tx=0x7f1698009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:39.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.673+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1487343323 shutdown_connections 2023-12-09T02:32:39.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.673+0000 7f16aaf8a700 1 --2- 172.21.15.88:0/1487343323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a40fde00 0x7f16a40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.673+0000 7f16aaf8a700 1 --2- 172.21.15.88:0/1487343323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a40fcbf0 0x7f16a40fd000 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.673+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1487343323 >> 172.21.15.88:0/1487343323 conn(0x7f16a40f82d0 msgr2=0x7f16a40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.673+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1487343323 shutdown_connections 2023-12-09T02:32:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.673+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1487343323 wait complete. 2023-12-09T02:32:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16aaf8a700 1 Processor -- start 2023-12-09T02:32:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16aaf8a700 1 -- start start 2023-12-09T02:32:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16aaf8a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a40fcbf0 0x7f16a4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16aaf8a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a40fde00 0x7f16a406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16aaf8a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4070620 con 0x7f16a40fde00 2023-12-09T02:32:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16aaf8a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4070790 con 0x7f16a40fcbf0 2023-12-09T02:32:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16a3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a40fde00 0x7f16a406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16a3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a40fde00 0x7f16a406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38654/0 (socket says 172.21.15.88:38654) 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16a3fff700 1 -- 172.21.15.88:0/1027330052 learned_addr learned my addr 172.21.15.88:0/1027330052 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16a8d26700 1 --2- 172.21.15.88:0/1027330052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a40fcbf0 0x7f16a4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16a3fff700 1 -- 172.21.15.88:0/1027330052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a40fcbf0 msgr2=0x7f16a4071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16a3fff700 1 --2- 172.21.15.88:0/1027330052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a40fcbf0 0x7f16a4071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16a3fff700 1 -- 172.21.15.88:0/1027330052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698005040 con 0x7f16a40fde00 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.674+0000 7f16a3fff700 1 --2- 172.21.15.88:0/1027330052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a40fde00 0x7f16a406ff90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f169000b790 tx=0x7f1690009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.675+0000 7f16a17fa700 1 -- 172.21.15.88:0/1027330052 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f169000f6f0 con 0x7f16a40fde00 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.675+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1027330052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a4070a70 con 0x7f16a40fde00 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.675+0000 7f16a17fa700 1 -- 172.21.15.88:0/1027330052 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f169000fd00 con 0x7f16a40fde00 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.675+0000 7f16a17fa700 1 -- 172.21.15.88:0/1027330052 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16900103a0 con 0x7f16a40fde00 2023-12-09T02:32:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.675+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1027330052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a4070df0 con 0x7f16a40fde00 2023-12-09T02:32:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.676+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1027330052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a404bb80 con 0x7f16a40fde00 2023-12-09T02:32:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.676+0000 7f16a17fa700 1 -- 172.21.15.88:0/1027330052 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f169000f850 con 0x7f16a40fde00 2023-12-09T02:32:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.676+0000 7f16a17fa700 1 --2- 172.21.15.88:0/1027330052 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1694068f60 0x7f169406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.676+0000 7f16a17fa700 1 -- 172.21.15.88:0/1027330052 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1690086870 con 0x7f16a40fde00 2023-12-09T02:32:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.676+0000 7f16a8d26700 1 --2- 172.21.15.88:0/1027330052 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1694068f60 0x7f169406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.677+0000 7f16a8d26700 1 --2- 172.21.15.88:0/1027330052 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1694068f60 0x7f169406b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1698004890 tx=0x7f1698009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:39.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.681+0000 7f16a17fa700 1 -- 172.21.15.88:0/1027330052 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1690056b10 con 0x7f16a40fde00 2023-12-09T02:32:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.872+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1027330052 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f16a4102750 con 0x7f1694068f60 2023-12-09T02:32:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.880+0000 7f16a17fa700 1 -- 172.21.15.88:0/1027330052 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7f16a4102750 con 0x7f1694068f60 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (2m) 96s ago 3m 28.4M - 0.25.0 c8568f914cd2 578f197f8707 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (3m) 96s ago 3m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 9098f424ee11 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (3m) 41s ago 3m 7490k - 17.2.7-119-ge2143d99 f761b6e42225 15c5154f5f2e 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (2m) 96s ago 3m 81.7M - 9.4.7 954c08fa6188 04aa719e29b6 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:9283 running (4m) 96s ago 4m 485M - 17.2.7-119-ge2143d99 f761b6e42225 0fffc89bc055 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283 running (2m) 41s ago 2m 441M - 17.2.7-119-ge2143d99 f761b6e42225 785e62ae75e6 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (4m) 96s ago 4m 56.3M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d21a10406297 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (2m) 41s ago 2m 53.4M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d6b9d9265450 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (3m) 96s ago 3m 14.5M - 1.5.0 0da6a335fe13 0a3f7cc72867 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (2m) 41s ago 2m 16.8M - 1.5.0 0da6a335fe13 43bf179905a8 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (2m) 96s ago 2m 39.4M 4299M 17.2.7-119-ge2143d99 f761b6e42225 fdd606881a64 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (2m) 96s ago 2m 38.8M 4299M 17.2.7-119-ge2143d99 f761b6e42225 354d4a4d3430 2023-12-09T02:32:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (101s) 96s ago 100s 14.5M 4299M 17.2.7-119-ge2143d99 f761b6e42225 0b0abbb070ec 2023-12-09T02:32:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (82s) 41s ago 82s 44.4M 5323M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:32:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (63s) 41s ago 63s 40.3M 5323M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:32:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (44s) 41s ago 43s 12.0M 5323M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:32:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (2m) 96s ago 3m 36.8M - 2.43.0 a07b618ecd1d 5e8226460d4a 2023-12-09T02:32:39.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.882+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1027330052 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1694068f60 msgr2=0x7f169406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:39.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.882+0000 7f16aaf8a700 1 --2- 172.21.15.88:0/1027330052 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1694068f60 0x7f169406b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1698004890 tx=0x7f1698009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:39.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.882+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1027330052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a40fde00 msgr2=0x7f16a406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:39.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.882+0000 7f16aaf8a700 1 --2- 172.21.15.88:0/1027330052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a40fde00 0x7f16a406ff90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f169000b790 tx=0x7f1690009250 comp rx=0 tx=0).stop 2023-12-09T02:32:39.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.882+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1027330052 shutdown_connections 2023-12-09T02:32:39.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.882+0000 7f16aaf8a700 1 --2- 172.21.15.88:0/1027330052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a40fcbf0 0x7f16a4071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:39.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.882+0000 7f16aaf8a700 1 --2- 172.21.15.88:0/1027330052 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f1694068f60 0x7f169406b410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:39.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.882+0000 7f16aaf8a700 1 --2- 172.21.15.88:0/1027330052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a40fde00 0x7f16a406ff90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:39.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.882+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1027330052 >> 172.21.15.88:0/1027330052 conn(0x7f16a40f82d0 msgr2=0x7f16a4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:39.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.882+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1027330052 shutdown_connections 2023-12-09T02:32:39.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:39.882+0000 7f16aaf8a700 1 -- 172.21.15.88:0/1027330052 wait complete. 2023-12-09T02:32:40.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-09T02:32:40.517 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:41.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:41 smithi088 ceph-mon[112028]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:41.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:41 smithi088 ceph-mon[112028]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:41.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:41 smithi161 ceph-mon[121170]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:41.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:41 smithi161 ceph-mon[121170]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:41.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.512+0000 7fad98cc9700 1 -- 172.21.15.88:0/377887417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad940ffd90 msgr2=0x7fad941021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:41.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.512+0000 7fad98cc9700 1 --2- 172.21.15.88:0/377887417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad940ffd90 0x7fad941021d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fad84004940 tx=0x7fad84009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.512+0000 7fad98cc9700 1 -- 172.21.15.88:0/377887417 shutdown_connections 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.512+0000 7fad98cc9700 1 --2- 172.21.15.88:0/377887417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad940ffd90 0x7fad941021d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.512+0000 7fad98cc9700 1 --2- 172.21.15.88:0/377887417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad94066900 0x7fad940ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.512+0000 7fad98cc9700 1 -- 172.21.15.88:0/377887417 >> 172.21.15.88:0/377887417 conn(0x7fad940f71b0 msgr2=0x7fad940f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.512+0000 7fad98cc9700 1 -- 172.21.15.88:0/377887417 shutdown_connections 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.512+0000 7fad98cc9700 1 -- 172.21.15.88:0/377887417 wait complete. 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad98cc9700 1 Processor -- start 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad98cc9700 1 -- start start 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad98cc9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94066900 0x7fad940fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad98cc9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad940ffd90 0x7fad940fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad98cc9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940fbd50 con 0x7fad94066900 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad98cc9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940fbec0 con 0x7fad940ffd90 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad9259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94066900 0x7fad940fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad9259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94066900 0x7fad940fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38672/0 (socket says 172.21.15.88:38672) 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad9259c700 1 -- 172.21.15.88:0/605453614 learned_addr learned my addr 172.21.15.88:0/605453614 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad91d9b700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad940ffd90 0x7fad940fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad9259c700 1 -- 172.21.15.88:0/605453614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad940ffd90 msgr2=0x7fad940fb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad9259c700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad940ffd90 0x7fad940fb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad9259c700 1 -- 172.21.15.88:0/605453614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84005040 con 0x7fad94066900 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.513+0000 7fad91d9b700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad940ffd90 0x7fad940fb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.514+0000 7fad9259c700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94066900 0x7fad940fd240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00b790 tx=0x7fad7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.514+0000 7fad8affd700 1 -- 172.21.15.88:0/605453614 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad7c00f770 con 0x7fad94066900 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.514+0000 7fad8affd700 1 -- 172.21.15.88:0/605453614 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad7c00fd80 con 0x7fad94066900 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.514+0000 7fad98cc9700 1 -- 172.21.15.88:0/605453614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad940fc1a0 con 0x7fad94066900 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.514+0000 7fad8affd700 1 -- 172.21.15.88:0/605453614 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad7c00d310 con 0x7fad94066900 2023-12-09T02:32:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.514+0000 7fad98cc9700 1 -- 172.21.15.88:0/605453614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad940fc520 con 0x7fad94066900 2023-12-09T02:32:41.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.515+0000 7fad98cc9700 1 -- 172.21.15.88:0/605453614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9404bb80 con 0x7fad94066900 2023-12-09T02:32:41.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.515+0000 7fad8affd700 1 -- 172.21.15.88:0/605453614 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fad7c010420 con 0x7fad94066900 2023-12-09T02:32:41.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.515+0000 7fad8affd700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad80068f70 0x7fad8006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:41.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.516+0000 7fad8affd700 1 -- 172.21.15.88:0/605453614 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fad7c086920 con 0x7fad94066900 2023-12-09T02:32:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.516+0000 7fad91d9b700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad80068f70 0x7fad8006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.516+0000 7fad91d9b700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad80068f70 0x7fad8006b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fad84004f90 tx=0x7fad84009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:41.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.520+0000 7fad8affd700 1 -- 172.21.15.88:0/605453614 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fad7c056c60 con 0x7fad94066900 2023-12-09T02:32:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.710+0000 7fad98cc9700 1 -- 172.21.15.88:0/605453614 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fad94100a10 con 0x7fad80068f70 2023-12-09T02:32:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.714+0000 7fad8affd700 1 -- 172.21.15.88:0/605453614 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7fad94100a10 con 0x7fad80068f70 2023-12-09T02:32:41.716 INFO:teuthology.orchestra.run.smithi088.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-09T02:32:41.716 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager ?:9093,9094 1/1 98s ago 4m count:1 2023-12-09T02:32:41.716 INFO:teuthology.orchestra.run.smithi088.stdout:crash 2/2 98s ago 4m * 2023-12-09T02:32:41.716 INFO:teuthology.orchestra.run.smithi088.stdout:grafana ?:3000 1/1 98s ago 4m count:1 2023-12-09T02:32:41.716 INFO:teuthology.orchestra.run.smithi088.stdout:mgr 2/2 98s ago 4m count:2 2023-12-09T02:32:41.716 INFO:teuthology.orchestra.run.smithi088.stdout:mon 2/2 98s ago 3m smithi088:172.21.15.88=smithi088;smithi161:172.21.15.161=smithi161;count:2 2023-12-09T02:32:41.716 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter ?:9100 2/2 98s ago 4m * 2023-12-09T02:32:41.716 INFO:teuthology.orchestra.run.smithi088.stdout:osd 6 98s ago - 2023-12-09T02:32:41.716 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus ?:9095 1/1 98s ago 4m count:1 2023-12-09T02:32:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.716+0000 7fad98cc9700 1 -- 172.21.15.88:0/605453614 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad80068f70 msgr2=0x7fad8006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.716+0000 7fad98cc9700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad80068f70 0x7fad8006b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fad84004f90 tx=0x7fad84009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.716+0000 7fad98cc9700 1 -- 172.21.15.88:0/605453614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94066900 msgr2=0x7fad940fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.716+0000 7fad98cc9700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94066900 0x7fad940fd240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00b790 tx=0x7fad7c009250 comp rx=0 tx=0).stop 2023-12-09T02:32:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.716+0000 7fad98cc9700 1 -- 172.21.15.88:0/605453614 shutdown_connections 2023-12-09T02:32:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.716+0000 7fad98cc9700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fad80068f70 0x7fad8006b420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.716+0000 7fad98cc9700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94066900 0x7fad940fd240 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.716+0000 7fad98cc9700 1 --2- 172.21.15.88:0/605453614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad940ffd90 0x7fad940fb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.716+0000 7fad98cc9700 1 -- 172.21.15.88:0/605453614 >> 172.21.15.88:0/605453614 conn(0x7fad940f71b0 msgr2=0x7fad940f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:41.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.716+0000 7fad98cc9700 1 -- 172.21.15.88:0/605453614 shutdown_connections 2023-12-09T02:32:41.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:41.716+0000 7fad98cc9700 1 -- 172.21.15.88:0/605453614 wait complete. 2023-12-09T02:32:42.090 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-09T02:32:42.350 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:43.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.273+0000 7fe420327700 1 -- 172.21.15.88:0/3193857672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4180fcd00 msgr2=0x7fe4180fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:43.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.273+0000 7fe420327700 1 --2- 172.21.15.88:0/3193857672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4180fcd00 0x7fe4180fd150 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe414004940 tx=0x7fe414009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:43.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.273+0000 7fe420327700 1 -- 172.21.15.88:0/3193857672 shutdown_connections 2023-12-09T02:32:43.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.273+0000 7fe420327700 1 --2- 172.21.15.88:0/3193857672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4180fcd00 0x7fe4180fd150 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:43.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.273+0000 7fe420327700 1 --2- 172.21.15.88:0/3193857672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4180fbaf0 0x7fe4180fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:43.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.273+0000 7fe420327700 1 -- 172.21.15.88:0/3193857672 >> 172.21.15.88:0/3193857672 conn(0x7fe4180f7190 msgr2=0x7fe4180f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:43.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.273+0000 7fe420327700 1 -- 172.21.15.88:0/3193857672 shutdown_connections 2023-12-09T02:32:43.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.273+0000 7fe420327700 1 -- 172.21.15.88:0/3193857672 wait complete. 2023-12-09T02:32:43.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.274+0000 7fe420327700 1 Processor -- start 2023-12-09T02:32:43.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.274+0000 7fe420327700 1 -- start start 2023-12-09T02:32:43.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.274+0000 7fe420327700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4180fbaf0 0x7fe41810d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:43.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.274+0000 7fe420327700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4180fcd00 0x7fe41810dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:43.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.274+0000 7fe420327700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41810e200 con 0x7fe4180fbaf0 2023-12-09T02:32:43.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.274+0000 7fe420327700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41810eaa0 con 0x7fe4180fcd00 2023-12-09T02:32:43.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe41e0c3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4180fbaf0 0x7fe41810d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:43.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe41e0c3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4180fbaf0 0x7fe41810d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38688/0 (socket says 172.21.15.88:38688) 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe41e0c3700 1 -- 172.21.15.88:0/1686694022 learned_addr learned my addr 172.21.15.88:0/1686694022 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe41d8c2700 1 --2- 172.21.15.88:0/1686694022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4180fcd00 0x7fe41810dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe41e0c3700 1 -- 172.21.15.88:0/1686694022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4180fcd00 msgr2=0x7fe41810dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe41e0c3700 1 --2- 172.21.15.88:0/1686694022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4180fcd00 0x7fe41810dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe41e0c3700 1 -- 172.21.15.88:0/1686694022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe414005040 con 0x7fe4180fbaf0 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe41e0c3700 1 --2- 172.21.15.88:0/1686694022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4180fbaf0 0x7fe41810d6c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00c8b0 tx=0x7fe40c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe40affd700 1 -- 172.21.15.88:0/1686694022 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe40c00a760 con 0x7fe4180fbaf0 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe40affd700 1 -- 172.21.15.88:0/1686694022 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe40c00ad70 con 0x7fe4180fbaf0 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe420327700 1 -- 172.21.15.88:0/1686694022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41810ed80 con 0x7fe4180fbaf0 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe40affd700 1 -- 172.21.15.88:0/1686694022 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe40c0113a0 con 0x7fe4180fbaf0 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.275+0000 7fe420327700 1 -- 172.21.15.88:0/1686694022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41810f2c0 con 0x7fe4180fbaf0 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.276+0000 7fe420327700 1 -- 172.21.15.88:0/1686694022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4181074e0 con 0x7fe4180fbaf0 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.276+0000 7fe40affd700 1 -- 172.21.15.88:0/1686694022 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe40c012400 con 0x7fe4180fbaf0 2023-12-09T02:32:43.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.277+0000 7fe40affd700 1 --2- 172.21.15.88:0/1686694022 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe404068f70 0x7fe40406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:43.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.277+0000 7fe40affd700 1 -- 172.21.15.88:0/1686694022 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe40c086a90 con 0x7fe4180fbaf0 2023-12-09T02:32:43.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.277+0000 7fe41d8c2700 1 --2- 172.21.15.88:0/1686694022 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe404068f70 0x7fe40406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:43.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.277+0000 7fe41d8c2700 1 --2- 172.21.15.88:0/1686694022 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe404068f70 0x7fe40406b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe414004f90 tx=0x7fe414009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:43.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.281+0000 7fe40affd700 1 -- 172.21.15.88:0/1686694022 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe40c056d30 con 0x7fe4180fbaf0 2023-12-09T02:32:43.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:43 smithi161 ceph-mon[121170]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:43.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:43 smithi161 ceph-mon[121170]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:43.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.468+0000 7fe420327700 1 -- 172.21.15.88:0/1686694022 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe41810f540 con 0x7fe404068f70 2023-12-09T02:32:43.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.470+0000 7fe40affd700 1 -- 172.21.15.88:0/1686694022 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fe41810f540 con 0x7fe404068f70 2023-12-09T02:32:43.472 INFO:teuthology.orchestra.run.smithi088.stdout:HOST ADDR LABELS STATUS 2023-12-09T02:32:43.472 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088 172.21.15.88 2023-12-09T02:32:43.472 INFO:teuthology.orchestra.run.smithi088.stdout:smithi161 172.21.15.161 2023-12-09T02:32:43.472 INFO:teuthology.orchestra.run.smithi088.stdout:2 hosts in cluster 2023-12-09T02:32:43.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.472+0000 7fe420327700 1 -- 172.21.15.88:0/1686694022 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe404068f70 msgr2=0x7fe40406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:43.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.472+0000 7fe420327700 1 --2- 172.21.15.88:0/1686694022 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe404068f70 0x7fe40406b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe414004f90 tx=0x7fe414009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:43.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.472+0000 7fe420327700 1 -- 172.21.15.88:0/1686694022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4180fbaf0 msgr2=0x7fe41810d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:43.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.472+0000 7fe420327700 1 --2- 172.21.15.88:0/1686694022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4180fbaf0 0x7fe41810d6c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00c8b0 tx=0x7fe40c004470 comp rx=0 tx=0).stop 2023-12-09T02:32:43.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.472+0000 7fe420327700 1 -- 172.21.15.88:0/1686694022 shutdown_connections 2023-12-09T02:32:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.472+0000 7fe420327700 1 --2- 172.21.15.88:0/1686694022 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe404068f70 0x7fe40406b420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.472+0000 7fe420327700 1 --2- 172.21.15.88:0/1686694022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4180fbaf0 0x7fe41810d6c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.472+0000 7fe420327700 1 --2- 172.21.15.88:0/1686694022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4180fcd00 0x7fe41810dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.472+0000 7fe420327700 1 -- 172.21.15.88:0/1686694022 >> 172.21.15.88:0/1686694022 conn(0x7fe4180f7190 msgr2=0x7fe418101420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.472+0000 7fe420327700 1 -- 172.21.15.88:0/1686694022 shutdown_connections 2023-12-09T02:32:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:43.472+0000 7fe420327700 1 -- 172.21.15.88:0/1686694022 wait complete. 2023-12-09T02:32:43.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:43 smithi088 ceph-mon[112028]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:43.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:43 smithi088 ceph-mon[112028]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:43.880 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-09T02:32:44.139 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.106+0000 7f8cb1d07700 1 -- 172.21.15.88:0/2690449731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cac0fcd00 msgr2=0x7f8cac0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.106+0000 7f8cb1d07700 1 --2- 172.21.15.88:0/2690449731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cac0fcd00 0x7f8cac0fd150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c004940 tx=0x7f8c9c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.106+0000 7f8cb1d07700 1 -- 172.21.15.88:0/2690449731 shutdown_connections 2023-12-09T02:32:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.106+0000 7f8cb1d07700 1 --2- 172.21.15.88:0/2690449731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cac0fcd00 0x7f8cac0fd150 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.106+0000 7f8cb1d07700 1 --2- 172.21.15.88:0/2690449731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cac0fbaf0 0x7f8cac0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.106+0000 7f8cb1d07700 1 -- 172.21.15.88:0/2690449731 >> 172.21.15.88:0/2690449731 conn(0x7f8cac0f7190 msgr2=0x7f8cac0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.106+0000 7f8cb1d07700 1 -- 172.21.15.88:0/2690449731 shutdown_connections 2023-12-09T02:32:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.106+0000 7f8cb1d07700 1 -- 172.21.15.88:0/2690449731 wait complete. 2023-12-09T02:32:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.107+0000 7f8cb1d07700 1 Processor -- start 2023-12-09T02:32:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.107+0000 7f8cb1d07700 1 -- start start 2023-12-09T02:32:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.107+0000 7f8cb1d07700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cac0fbaf0 0x7f8cac10c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.107+0000 7f8cb1d07700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cac0fcd00 0x7f8cac10c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.107+0000 7f8cb1d07700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac10cfc0 con 0x7f8cac0fbaf0 2023-12-09T02:32:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.107+0000 7f8cb1d07700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac10d860 con 0x7f8cac0fcd00 2023-12-09T02:32:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.107+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cac0fbaf0 0x7f8cac10c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.107+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cac0fbaf0 0x7f8cac10c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38708/0 (socket says 172.21.15.88:38708) 2023-12-09T02:32:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.107+0000 7f8cab7fe700 1 -- 172.21.15.88:0/613626822 learned_addr learned my addr 172.21.15.88:0/613626822 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.107+0000 7f8caaffd700 1 --2- 172.21.15.88:0/613626822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cac0fcd00 0x7f8cac10c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:45.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.108+0000 7f8cab7fe700 1 -- 172.21.15.88:0/613626822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cac0fcd00 msgr2=0x7f8cac10c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:45.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.108+0000 7f8cab7fe700 1 --2- 172.21.15.88:0/613626822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cac0fcd00 0x7f8cac10c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:45.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.108+0000 7f8cab7fe700 1 -- 172.21.15.88:0/613626822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c005040 con 0x7f8cac0fbaf0 2023-12-09T02:32:45.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.108+0000 7f8cab7fe700 1 --2- 172.21.15.88:0/613626822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cac0fbaf0 0x7f8cac10c480 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8c94002a50 tx=0x7f8c94004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:45.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.108+0000 7f8ca3fff700 1 -- 172.21.15.88:0/613626822 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c94007cc0 con 0x7f8cac0fbaf0 2023-12-09T02:32:45.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.108+0000 7f8ca3fff700 1 -- 172.21.15.88:0/613626822 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c9400f040 con 0x7f8cac0fbaf0 2023-12-09T02:32:45.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.108+0000 7f8cb1d07700 1 -- 172.21.15.88:0/613626822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac10db40 con 0x7f8cac0fbaf0 2023-12-09T02:32:45.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.108+0000 7f8ca3fff700 1 -- 172.21.15.88:0/613626822 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9400d8d0 con 0x7f8cac0fbaf0 2023-12-09T02:32:45.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.108+0000 7f8cb1d07700 1 -- 172.21.15.88:0/613626822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac10e080 con 0x7f8cac0fbaf0 2023-12-09T02:32:45.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.109+0000 7f8cb1d07700 1 -- 172.21.15.88:0/613626822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac04bb80 con 0x7f8cac0fbaf0 2023-12-09T02:32:45.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.109+0000 7f8ca3fff700 1 -- 172.21.15.88:0/613626822 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8c9400dab0 con 0x7f8cac0fbaf0 2023-12-09T02:32:45.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.110+0000 7f8ca3fff700 1 --2- 172.21.15.88:0/613626822 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8c98068f60 0x7f8c9806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:45.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.110+0000 7f8ca3fff700 1 -- 172.21.15.88:0/613626822 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8c94086700 con 0x7f8cac0fbaf0 2023-12-09T02:32:45.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.110+0000 7f8caaffd700 1 --2- 172.21.15.88:0/613626822 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8c98068f60 0x7f8c9806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:45.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.110+0000 7f8caaffd700 1 --2- 172.21.15.88:0/613626822 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8c98068f60 0x7f8c9806b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00b3b0 tx=0x7f8c9c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:45.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.114+0000 7f8ca3fff700 1 -- 172.21.15.88:0/613626822 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8c940569a0 con 0x7f8cac0fbaf0 2023-12-09T02:32:45.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:45 smithi088 ceph-mon[112028]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:45.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:45 smithi088 ceph-mon[112028]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:45.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.305+0000 7f8cb1d07700 1 -- 172.21.15.88:0/613626822 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cac10e4f0 con 0x7f8c98068f60 2023-12-09T02:32:45.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.307+0000 7f8ca3fff700 1 -- 172.21.15.88:0/613626822 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f8cac10e4f0 con 0x7f8c98068f60 2023-12-09T02:32:45.309 INFO:teuthology.orchestra.run.smithi088.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-09T02:32:45.309 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400XD400BGN 372G No 99s ago Has a FileSystem, LVM detected 2023-12-09T02:32:45.309 INFO:teuthology.orchestra.run.smithi088.stdout:smithi161 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233001X400BGN 372G No 43s ago Has a FileSystem, LVM detected 2023-12-09T02:32:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.308+0000 7f8cb1d07700 1 -- 172.21.15.88:0/613626822 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8c98068f60 msgr2=0x7f8c9806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.308+0000 7f8cb1d07700 1 --2- 172.21.15.88:0/613626822 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8c98068f60 0x7f8c9806b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00b3b0 tx=0x7f8c9c009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.308+0000 7f8cb1d07700 1 -- 172.21.15.88:0/613626822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cac0fbaf0 msgr2=0x7f8cac10c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.308+0000 7f8cb1d07700 1 --2- 172.21.15.88:0/613626822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cac0fbaf0 0x7f8cac10c480 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8c94002a50 tx=0x7f8c94004600 comp rx=0 tx=0).stop 2023-12-09T02:32:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.308+0000 7f8cb1d07700 1 -- 172.21.15.88:0/613626822 shutdown_connections 2023-12-09T02:32:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.308+0000 7f8cb1d07700 1 --2- 172.21.15.88:0/613626822 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8c98068f60 0x7f8c9806b410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.308+0000 7f8cb1d07700 1 --2- 172.21.15.88:0/613626822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cac0fbaf0 0x7f8cac10c480 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.308+0000 7f8cb1d07700 1 --2- 172.21.15.88:0/613626822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cac0fcd00 0x7f8cac10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.308+0000 7f8cb1d07700 1 -- 172.21.15.88:0/613626822 >> 172.21.15.88:0/613626822 conn(0x7f8cac0f7190 msgr2=0x7f8cac0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.309+0000 7f8cb1d07700 1 -- 172.21.15.88:0/613626822 shutdown_connections 2023-12-09T02:32:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:45.309+0000 7f8cb1d07700 1 -- 172.21.15.88:0/613626822 wait complete. 2023-12-09T02:32:45.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:45 smithi161 ceph-mon[121170]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:45.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:45 smithi161 ceph-mon[121170]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:45.712 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-09T02:32:45.722 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:32:45.722 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-09T02:32:45.982 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:47.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.010+0000 7fcfbd206700 1 -- 172.21.15.88:0/2339494311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb80fde00 msgr2=0x7fcfb80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:47.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.010+0000 7fcfbd206700 1 --2- 172.21.15.88:0/2339494311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb80fde00 0x7fcfb80fe250 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8004940 tx=0x7fcfa8009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:47.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 -- 172.21.15.88:0/2339494311 shutdown_connections 2023-12-09T02:32:47.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 --2- 172.21.15.88:0/2339494311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb80fde00 0x7fcfb80fe250 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:47.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 --2- 172.21.15.88:0/2339494311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb80fcbf0 0x7fcfb80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 -- 172.21.15.88:0/2339494311 >> 172.21.15.88:0/2339494311 conn(0x7fcfb80f82d0 msgr2=0x7fcfb80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 -- 172.21.15.88:0/2339494311 shutdown_connections 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 -- 172.21.15.88:0/2339494311 wait complete. 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 Processor -- start 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 -- start start 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb80fcbf0 0x7fcfb810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb80fde00 0x7fcfb810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb810e0c0 con 0x7fcfb80fcbf0 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfbd206700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb810e960 con 0x7fcfb80fde00 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.011+0000 7fcfb6d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb80fcbf0 0x7fcfb810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcfb6d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb80fcbf0 0x7fcfb810d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56130/0 (socket says 172.21.15.88:56130) 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcfb6d9d700 1 -- 172.21.15.88:0/2272312056 learned_addr learned my addr 172.21.15.88:0/2272312056 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcfb659c700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb80fde00 0x7fcfb810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:47.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcfb6d9d700 1 -- 172.21.15.88:0/2272312056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb80fde00 msgr2=0x7fcfb810dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:47.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcfb6d9d700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb80fde00 0x7fcfb810dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:47.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcfb6d9d700 1 -- 172.21.15.88:0/2272312056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8005040 con 0x7fcfb80fcbf0 2023-12-09T02:32:47.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcfb659c700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb80fde00 0x7fcfb810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:32:47.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcfb6d9d700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb80fcbf0 0x7fcfb810d580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c8b0 tx=0x7fcfac004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:47.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcf9f7fe700 1 -- 172.21.15.88:0/2272312056 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfac00a760 con 0x7fcfb80fcbf0 2023-12-09T02:32:47.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcf9f7fe700 1 -- 172.21.15.88:0/2272312056 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcfac00ad70 con 0x7fcfb80fcbf0 2023-12-09T02:32:47.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcfbd206700 1 -- 172.21.15.88:0/2272312056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb810ec40 con 0x7fcfb80fcbf0 2023-12-09T02:32:47.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcf9f7fe700 1 -- 172.21.15.88:0/2272312056 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfac0113a0 con 0x7fcfb80fcbf0 2023-12-09T02:32:47.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.012+0000 7fcfbd206700 1 -- 172.21.15.88:0/2272312056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb810f180 con 0x7fcfb80fcbf0 2023-12-09T02:32:47.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.013+0000 7fcfbd206700 1 -- 172.21.15.88:0/2272312056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb804bb80 con 0x7fcfb80fcbf0 2023-12-09T02:32:47.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.013+0000 7fcf9f7fe700 1 -- 172.21.15.88:0/2272312056 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcfac012400 con 0x7fcfb80fcbf0 2023-12-09T02:32:47.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.014+0000 7fcf9f7fe700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcfa0068f60 0x7fcfa006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:47.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.014+0000 7fcfb659c700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcfa0068f60 0x7fcfa006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:47.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.014+0000 7fcf9f7fe700 1 -- 172.21.15.88:0/2272312056 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcfac0869c0 con 0x7fcfb80fcbf0 2023-12-09T02:32:47.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.014+0000 7fcfb659c700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcfa0068f60 0x7fcfa006b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009fd0 tx=0x7fcfa8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:47.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.018+0000 7fcf9f7fe700 1 -- 172.21.15.88:0/2272312056 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcfac056d00 con 0x7fcfb80fcbf0 2023-12-09T02:32:47.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:47.228+0000 7fcfbd206700 1 -- 172.21.15.88:0/2272312056 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfb810f6a0 con 0x7fcfa0068f60 2023-12-09T02:32:47.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:47 smithi161 ceph-mon[121170]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:47.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:47 smithi161 ceph-mon[121170]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:47.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:47 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:32:47.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:47 smithi088 ceph-mon[112028]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:47.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:47 smithi088 ceph-mon[112028]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:47.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:47 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:32:48.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:48 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-09T02:32:48.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:48 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-09T02:32:49.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.137+0000 7fcf9f7fe700 1 -- 172.21.15.88:0/2272312056 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcfb810f6a0 con 0x7fcfa0068f60 2023-12-09T02:32:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.139+0000 7fcfbd206700 1 -- 172.21.15.88:0/2272312056 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcfa0068f60 msgr2=0x7fcfa006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.139+0000 7fcfbd206700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcfa0068f60 0x7fcfa006b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009fd0 tx=0x7fcfa8009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.139+0000 7fcfbd206700 1 -- 172.21.15.88:0/2272312056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb80fcbf0 msgr2=0x7fcfb810d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.139+0000 7fcfbd206700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb80fcbf0 0x7fcfb810d580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c8b0 tx=0x7fcfac004470 comp rx=0 tx=0).stop 2023-12-09T02:32:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.139+0000 7fcfbd206700 1 -- 172.21.15.88:0/2272312056 shutdown_connections 2023-12-09T02:32:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.139+0000 7fcfbd206700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcfa0068f60 0x7fcfa006b410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.139+0000 7fcfbd206700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb80fcbf0 0x7fcfb810d580 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.139+0000 7fcfbd206700 1 --2- 172.21.15.88:0/2272312056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb80fde00 0x7fcfb810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.139+0000 7fcfbd206700 1 -- 172.21.15.88:0/2272312056 >> 172.21.15.88:0/2272312056 conn(0x7fcfb80f82d0 msgr2=0x7fcfb8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.139+0000 7fcfbd206700 1 -- 172.21.15.88:0/2272312056 shutdown_connections 2023-12-09T02:32:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:49.139+0000 7fcfbd206700 1 -- 172.21.15.88:0/2272312056 wait complete. 2023-12-09T02:32:49.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:49 smithi161 ceph-mon[121170]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:49.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:49 smithi161 ceph-mon[121170]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:49.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:49 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-09T02:32:49.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:49 smithi161 ceph-mon[121170]: osdmap e41: 6 total, 6 up, 6 in 2023-12-09T02:32:49.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:49 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-09T02:32:49.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:49 smithi088 ceph-mon[112028]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:32:49.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:49 smithi088 ceph-mon[112028]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:49.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:49 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-09T02:32:49.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:49 smithi088 ceph-mon[112028]: osdmap e41: 6 total, 6 up, 6 in 2023-12-09T02:32:49.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:49 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-09T02:32:49.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:49 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi088[112004]: 2023-12-09T02:32:49.114+0000 7efd9f07d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-09T02:32:49.518 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-09T02:32:50.119 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:50.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-09T02:32:50.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: osdmap e42: 6 total, 6 up, 6 in 2023-12-09T02:32:50.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-09T02:32:50.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-09T02:32:50.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-09T02:32:50.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: osdmap e43: 6 total, 6 up, 6 in 2023-12-09T02:32:50.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-09T02:32:50.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: fsmap cephfs:0 2023-12-09T02:32:50.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:50.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:32:50.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:50.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:32:50.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:50.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.utskxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:32:50.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.utskxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-09T02:32:50.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:50 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:50.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-09T02:32:50.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: osdmap e42: 6 total, 6 up, 6 in 2023-12-09T02:32:50.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-09T02:32:50.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-09T02:32:50.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-09T02:32:50.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: osdmap e43: 6 total, 6 up, 6 in 2023-12-09T02:32:50.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-09T02:32:50.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: fsmap cephfs:0 2023-12-09T02:32:50.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:50.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:32:50.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:50.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:32:50.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:50.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.utskxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:32:50.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.utskxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-09T02:32:50.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:50 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.263+0000 7f8538540700 1 -- 172.21.15.88:0/2210164645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300fbdb0 msgr2=0x7f85300fc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.263+0000 7f8538540700 1 --2- 172.21.15.88:0/2210164645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300fbdb0 0x7f85300fc220 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8520004940 tx=0x7f8520009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.263+0000 7f8538540700 1 -- 172.21.15.88:0/2210164645 shutdown_connections 2023-12-09T02:32:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.263+0000 7f8538540700 1 --2- 172.21.15.88:0/2210164645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300fbdb0 0x7f85300fc220 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.263+0000 7f8538540700 1 --2- 172.21.15.88:0/2210164645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85300fd130 0x7f85300fd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.263+0000 7f8538540700 1 -- 172.21.15.88:0/2210164645 >> 172.21.15.88:0/2210164645 conn(0x7f85300f68f0 msgr2=0x7f85300f8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.263+0000 7f8538540700 1 -- 172.21.15.88:0/2210164645 shutdown_connections 2023-12-09T02:32:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.263+0000 7f8538540700 1 -- 172.21.15.88:0/2210164645 wait complete. 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8538540700 1 Processor -- start 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8538540700 1 -- start start 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8538540700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85300fbdb0 0x7f85301101b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8538540700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300fd130 0x7f8530112700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8538540700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300fba60 con 0x7f85300fd130 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8538540700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300fbba0 con 0x7f85300fbdb0 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8535adb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300fd130 0x7f8530112700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8535adb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300fd130 0x7f8530112700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56152/0 (socket says 172.21.15.88:56152) 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8535adb700 1 -- 172.21.15.88:0/2529919543 learned_addr learned my addr 172.21.15.88:0/2529919543 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f85362dc700 1 --2- 172.21.15.88:0/2529919543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85300fbdb0 0x7f85301101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8535adb700 1 -- 172.21.15.88:0/2529919543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85300fbdb0 msgr2=0x7f85301101b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8535adb700 1 --2- 172.21.15.88:0/2529919543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85300fbdb0 0x7f85301101b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8535adb700 1 -- 172.21.15.88:0/2529919543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8520005040 con 0x7f85300fd130 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8535adb700 1 --2- 172.21.15.88:0/2529919543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300fd130 0x7f8530112700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8520009fd0 tx=0x7f8520009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.264+0000 7f8526ffd700 1 -- 172.21.15.88:0/2529919543 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f852000e040 con 0x7f85300fd130 2023-12-09T02:32:51.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.265+0000 7f8526ffd700 1 -- 172.21.15.88:0/2529919543 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8520013420 con 0x7f85300fd130 2023-12-09T02:32:51.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.265+0000 7f8538540700 1 -- 172.21.15.88:0/2529919543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8530112d00 con 0x7f85300fd130 2023-12-09T02:32:51.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.265+0000 7f8526ffd700 1 -- 172.21.15.88:0/2529919543 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f852001c630 con 0x7f85300fd130 2023-12-09T02:32:51.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.265+0000 7f8538540700 1 -- 172.21.15.88:0/2529919543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8530113270 con 0x7f85300fd130 2023-12-09T02:32:51.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.266+0000 7f8538540700 1 -- 172.21.15.88:0/2529919543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853004bb80 con 0x7f85300fd130 2023-12-09T02:32:51.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.266+0000 7f8526ffd700 1 -- 172.21.15.88:0/2529919543 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8520013a20 con 0x7f85300fd130 2023-12-09T02:32:51.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.267+0000 7f8526ffd700 1 --2- 172.21.15.88:0/2529919543 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f851c068f70 0x7f851c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:51.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.267+0000 7f8526ffd700 1 -- 172.21.15.88:0/2529919543 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8520087f80 con 0x7f85300fd130 2023-12-09T02:32:51.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.267+0000 7f85362dc700 1 --2- 172.21.15.88:0/2529919543 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f851c068f70 0x7f851c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:51.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.267+0000 7f85362dc700 1 --2- 172.21.15.88:0/2529919543 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f851c068f70 0x7f851c06b420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f85300fb6e0 tx=0x7f852c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:51.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.271+0000 7f8526ffd700 1 -- 172.21.15.88:0/2529919543 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f85200544f0 con 0x7f85300fd130 2023-12-09T02:32:51.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:51 smithi161 ceph-mon[121170]: Saving service mds.cephfs spec with placement count:4 2023-12-09T02:32:51.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:51 smithi161 ceph-mon[121170]: Deploying daemon mds.cephfs.smithi088.utskxh on smithi088 2023-12-09T02:32:51.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:51 smithi161 ceph-mon[121170]: pgmap v130: 65 pgs: 12 creating+peering, 52 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:51.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:51 smithi161 ceph-mon[121170]: osdmap e44: 6 total, 6 up, 6 in 2023-12-09T02:32:51.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:51 smithi088 ceph-mon[112028]: Saving service mds.cephfs spec with placement count:4 2023-12-09T02:32:51.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:51 smithi088 ceph-mon[112028]: Deploying daemon mds.cephfs.smithi088.utskxh on smithi088 2023-12-09T02:32:51.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:51 smithi088 ceph-mon[112028]: pgmap v130: 65 pgs: 12 creating+peering, 52 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:51.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:51 smithi088 ceph-mon[112028]: osdmap e44: 6 total, 6 up, 6 in 2023-12-09T02:32:51.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.508+0000 7f8538540700 1 -- 172.21.15.88:0/2529919543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f85301044f0 con 0x7f85300fd130 2023-12-09T02:32:51.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.509+0000 7f8526ffd700 1 -- 172.21.15.88:0/2529919543 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f8520057b10 con 0x7f85300fd130 2023-12-09T02:32:51.514 INFO:teuthology.orchestra.run.smithi088.stdout:e2 2023-12-09T02:32:51.514 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:32:51.514 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 2 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:32:49.115759+0000 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:32:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 0 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:in 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:up {} 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 0 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:51.516 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:32:51.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.511+0000 7f8538540700 1 -- 172.21.15.88:0/2529919543 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f851c068f70 msgr2=0x7f851c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:51.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.511+0000 7f8538540700 1 --2- 172.21.15.88:0/2529919543 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f851c068f70 0x7f851c06b420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f85300fb6e0 tx=0x7f852c00b040 comp rx=0 tx=0).stop 2023-12-09T02:32:51.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.511+0000 7f8538540700 1 -- 172.21.15.88:0/2529919543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300fd130 msgr2=0x7f8530112700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:51.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.511+0000 7f8538540700 1 --2- 172.21.15.88:0/2529919543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300fd130 0x7f8530112700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8520009fd0 tx=0x7f8520009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:51.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.511+0000 7f8538540700 1 -- 172.21.15.88:0/2529919543 shutdown_connections 2023-12-09T02:32:51.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.511+0000 7f8538540700 1 --2- 172.21.15.88:0/2529919543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85300fbdb0 0x7f85301101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:51.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.511+0000 7f8538540700 1 --2- 172.21.15.88:0/2529919543 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f851c068f70 0x7f851c06b420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:51.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.511+0000 7f8538540700 1 --2- 172.21.15.88:0/2529919543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300fd130 0x7f8530112700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:51.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.511+0000 7f8538540700 1 -- 172.21.15.88:0/2529919543 >> 172.21.15.88:0/2529919543 conn(0x7f85300f68f0 msgr2=0x7f85300ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:51.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.511+0000 7f8538540700 1 -- 172.21.15.88:0/2529919543 shutdown_connections 2023-12-09T02:32:51.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:51.511+0000 7f8538540700 1 -- 172.21.15.88:0/2529919543 wait complete. 2023-12-09T02:32:51.518 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 2 2023-12-09T02:32:51.837 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-09T02:32:51.847 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:32:51.848 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 1' 2023-12-09T02:32:52.111 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:52.383 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:52 smithi161 ceph-mon[121170]: osdmap e45: 6 total, 6 up, 6 in 2023-12-09T02:32:52.383 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:52 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:52.383 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:52 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:52.383 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:52 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:52.383 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:52 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.dhvdif", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:32:52.383 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:52 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.dhvdif", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-09T02:32:52.383 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:52 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:52.383 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:52 smithi161 ceph-mon[121170]: Deploying daemon mds.cephfs.smithi161.dhvdif on smithi161 2023-12-09T02:32:52.383 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:52 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2529919543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:32:52.384 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:52 smithi161 ceph-mon[121170]: pgmap v133: 65 pgs: 12 creating+peering, 52 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:52.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:52 smithi088 ceph-mon[112028]: osdmap e45: 6 total, 6 up, 6 in 2023-12-09T02:32:52.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:52 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:52.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:52 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:52.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:52 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:52.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:52 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.dhvdif", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:32:52.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:52 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.dhvdif", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-09T02:32:52.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:52 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:52.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:52 smithi088 ceph-mon[112028]: Deploying daemon mds.cephfs.smithi161.dhvdif on smithi161 2023-12-09T02:32:52.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:52 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2529919543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:32:52.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:52 smithi088 ceph-mon[112028]: pgmap v133: 65 pgs: 12 creating+peering, 52 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:32:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.116+0000 7fd358db2700 1 -- 172.21.15.88:0/3453453130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3540fdf60 msgr2=0x7fd3540fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.116+0000 7fd358db2700 1 --2- 172.21.15.88:0/3453453130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3540fdf60 0x7fd3540fe3b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd348004940 tx=0x7fd348009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 -- 172.21.15.88:0/3453453130 shutdown_connections 2023-12-09T02:32:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 --2- 172.21.15.88:0/3453453130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3540fdf60 0x7fd3540fe3b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 --2- 172.21.15.88:0/3453453130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3540faed0 0x7fd3540fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 -- 172.21.15.88:0/3453453130 >> 172.21.15.88:0/3453453130 conn(0x7fd3540f6950 msgr2=0x7fd3540f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 -- 172.21.15.88:0/3453453130 shutdown_connections 2023-12-09T02:32:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 -- 172.21.15.88:0/3453453130 wait complete. 2023-12-09T02:32:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 Processor -- start 2023-12-09T02:32:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 -- start start 2023-12-09T02:32:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3540faed0 0x7fd35410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3540fdf60 0x7fd35410db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35410e110 con 0x7fd3540fdf60 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd358db2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35410e9b0 con 0x7fd3540faed0 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd351d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3540fdf60 0x7fd35410db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd351d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3540fdf60 0x7fd35410db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56190/0 (socket says 172.21.15.88:56190) 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.117+0000 7fd351d9b700 1 -- 172.21.15.88:0/3628943964 learned_addr learned my addr 172.21.15.88:0/3628943964 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.118+0000 7fd35259c700 1 --2- 172.21.15.88:0/3628943964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3540faed0 0x7fd35410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.118+0000 7fd351d9b700 1 -- 172.21.15.88:0/3628943964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3540faed0 msgr2=0x7fd35410d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.118+0000 7fd351d9b700 1 --2- 172.21.15.88:0/3628943964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3540faed0 0x7fd35410d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.118+0000 7fd351d9b700 1 -- 172.21.15.88:0/3628943964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348005040 con 0x7fd3540fdf60 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.118+0000 7fd351d9b700 1 --2- 172.21.15.88:0/3628943964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3540fdf60 0x7fd35410db10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd34800b3b0 tx=0x7fd348009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.118+0000 7fd342ffd700 1 -- 172.21.15.88:0/3628943964 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd34800e040 con 0x7fd3540fdf60 2023-12-09T02:32:53.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.118+0000 7fd342ffd700 1 -- 172.21.15.88:0/3628943964 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd34800bc50 con 0x7fd3540fdf60 2023-12-09T02:32:53.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.118+0000 7fd358db2700 1 -- 172.21.15.88:0/3628943964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35410ec30 con 0x7fd3540fdf60 2023-12-09T02:32:53.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.118+0000 7fd342ffd700 1 -- 172.21.15.88:0/3628943964 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd348013660 con 0x7fd3540fdf60 2023-12-09T02:32:53.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.118+0000 7fd358db2700 1 -- 172.21.15.88:0/3628943964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35410f170 con 0x7fd3540fdf60 2023-12-09T02:32:53.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.119+0000 7fd358db2700 1 -- 172.21.15.88:0/3628943964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3541075f0 con 0x7fd3540fdf60 2023-12-09T02:32:53.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.119+0000 7fd342ffd700 1 -- 172.21.15.88:0/3628943964 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd34801c430 con 0x7fd3540fdf60 2023-12-09T02:32:53.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.120+0000 7fd342ffd700 1 --2- 172.21.15.88:0/3628943964 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd33c068f60 0x7fd33c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:53.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.120+0000 7fd342ffd700 1 -- 172.21.15.88:0/3628943964 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd348087b80 con 0x7fd3540fdf60 2023-12-09T02:32:53.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.120+0000 7fd35259c700 1 --2- 172.21.15.88:0/3628943964 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd33c068f60 0x7fd33c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:53.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.120+0000 7fd35259c700 1 --2- 172.21.15.88:0/3628943964 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd33c068f60 0x7fd33c06b410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd344007fd0 tx=0x7fd344009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:53.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.124+0000 7fd342ffd700 1 -- 172.21.15.88:0/3628943964 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd348057b90 con 0x7fd3540fdf60 2023-12-09T02:32:53.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:53.362+0000 7fd358db2700 1 -- 172.21.15.88:0/3628943964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fd354107010 con 0x7fd3540fdf60 2023-12-09T02:32:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:53 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.88:6826/2247714894,v1:172.21.15.88:6827/2247714894] up:boot 2023-12-09T02:32:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:53 smithi161 ceph-mon[121170]: daemon mds.cephfs.smithi088.utskxh assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-09T02:32:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:53 smithi161 ceph-mon[121170]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-09T02:32:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:53 smithi161 ceph-mon[121170]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-09T02:32:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:53 smithi161 ceph-mon[121170]: Cluster is now healthy 2023-12-09T02:32:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:53 smithi161 ceph-mon[121170]: fsmap cephfs:0 1 up:standby 2023-12-09T02:32:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:53 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.utskxh"}]: dispatch 2023-12-09T02:32:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:53 smithi161 ceph-mon[121170]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:creating} 2023-12-09T02:32:53.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:53 smithi161 ceph-mon[121170]: daemon mds.cephfs.smithi088.utskxh is now active in filesystem cephfs as rank 0 2023-12-09T02:32:53.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:53 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.88:6826/2247714894,v1:172.21.15.88:6827/2247714894] up:boot 2023-12-09T02:32:53.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:53 smithi088 ceph-mon[112028]: daemon mds.cephfs.smithi088.utskxh assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-09T02:32:53.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:53 smithi088 ceph-mon[112028]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-09T02:32:53.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:53 smithi088 ceph-mon[112028]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-09T02:32:53.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:53 smithi088 ceph-mon[112028]: Cluster is now healthy 2023-12-09T02:32:53.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:53 smithi088 ceph-mon[112028]: fsmap cephfs:0 1 up:standby 2023-12-09T02:32:53.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:53 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.utskxh"}]: dispatch 2023-12-09T02:32:53.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:53 smithi088 ceph-mon[112028]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:creating} 2023-12-09T02:32:53.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:53 smithi088 ceph-mon[112028]: daemon mds.cephfs.smithi088.utskxh is now active in filesystem cephfs as rank 0 2023-12-09T02:32:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.217+0000 7fd342ffd700 1 -- 172.21.15.88:0/3628943964 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd348057720 con 0x7fd3540fdf60 2023-12-09T02:32:54.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.219+0000 7fd358db2700 1 -- 172.21.15.88:0/3628943964 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd33c068f60 msgr2=0x7fd33c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:54.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.219+0000 7fd358db2700 1 --2- 172.21.15.88:0/3628943964 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd33c068f60 0x7fd33c06b410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd344007fd0 tx=0x7fd344009040 comp rx=0 tx=0).stop 2023-12-09T02:32:54.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.219+0000 7fd358db2700 1 -- 172.21.15.88:0/3628943964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3540fdf60 msgr2=0x7fd35410db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:54.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.219+0000 7fd358db2700 1 --2- 172.21.15.88:0/3628943964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3540fdf60 0x7fd35410db10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd34800b3b0 tx=0x7fd348009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:54.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.219+0000 7fd358db2700 1 -- 172.21.15.88:0/3628943964 shutdown_connections 2023-12-09T02:32:54.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.219+0000 7fd358db2700 1 --2- 172.21.15.88:0/3628943964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3540faed0 0x7fd35410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:54.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.219+0000 7fd358db2700 1 --2- 172.21.15.88:0/3628943964 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd33c068f60 0x7fd33c06b410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:54.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.219+0000 7fd358db2700 1 --2- 172.21.15.88:0/3628943964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3540fdf60 0x7fd35410db10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:54.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.219+0000 7fd358db2700 1 -- 172.21.15.88:0/3628943964 >> 172.21.15.88:0/3628943964 conn(0x7fd3540f6950 msgr2=0x7fd3540f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:54.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.219+0000 7fd358db2700 1 -- 172.21.15.88:0/3628943964 shutdown_connections 2023-12-09T02:32:54.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:54.219+0000 7fd358db2700 1 -- 172.21.15.88:0/3628943964 wait complete. 2023-12-09T02:32:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.88:6826/2247714894,v1:172.21.15.88:6827/2247714894] up:active 2023-12-09T02:32:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] up:boot 2023-12-09T02:32:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:active} 1 up:standby 2023-12-09T02:32:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.dhvdif"}]: dispatch 2023-12-09T02:32:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:active} 1 up:standby 2023-12-09T02:32:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:54.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.zfojux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:32:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.zfojux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-09T02:32:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: Deploying daemon mds.cephfs.smithi088.zfojux on smithi088 2023-12-09T02:32:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3628943964' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-12-09T02:32:54.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:54 smithi088 ceph-mon[112028]: pgmap v134: 65 pgs: 9 creating+peering, 6 unknown, 50 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s wr, 3 op/s 2023-12-09T02:32:54.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.88:6826/2247714894,v1:172.21.15.88:6827/2247714894] up:active 2023-12-09T02:32:54.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] up:boot 2023-12-09T02:32:54.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:active} 1 up:standby 2023-12-09T02:32:54.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.dhvdif"}]: dispatch 2023-12-09T02:32:54.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:active} 1 up:standby 2023-12-09T02:32:54.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:54.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:54.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:54.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.zfojux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:32:54.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.zfojux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-09T02:32:54.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:54.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: Deploying daemon mds.cephfs.smithi088.zfojux on smithi088 2023-12-09T02:32:54.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3628943964' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-12-09T02:32:54.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:54 smithi161 ceph-mon[121170]: pgmap v134: 65 pgs: 9 creating+peering, 6 unknown, 50 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s wr, 3 op/s 2023-12-09T02:32:54.662 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-09T02:32:54.673 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:32:54.673 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2023-12-09T02:32:55.101 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:55.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:55 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3628943964' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-12-09T02:32:55.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:55 smithi088 ceph-mon[112028]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:active} 1 up:standby 2023-12-09T02:32:55.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:55 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:55.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:55 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:55.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:55 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:55.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:55 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.posrbq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:32:55.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:55 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.posrbq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-09T02:32:55.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:55 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:55.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:55 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3628943964' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-12-09T02:32:55.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:55 smithi161 ceph-mon[121170]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:active} 1 up:standby 2023-12-09T02:32:55.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:55 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:55.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:55 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:55.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:55 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:55.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:55 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.posrbq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:32:55.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:55 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.posrbq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-09T02:32:55.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:55 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:32:56.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.075+0000 7fd6e8260700 1 -- 172.21.15.88:0/415385053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e00fde00 msgr2=0x7fd6e00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:56.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.075+0000 7fd6e8260700 1 --2- 172.21.15.88:0/415385053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e00fde00 0x7fd6e00fe250 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc004940 tx=0x7fd6dc009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:56.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.075+0000 7fd6e8260700 1 -- 172.21.15.88:0/415385053 shutdown_connections 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.075+0000 7fd6e8260700 1 --2- 172.21.15.88:0/415385053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e00fde00 0x7fd6e00fe250 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.075+0000 7fd6e8260700 1 --2- 172.21.15.88:0/415385053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6e00fcbf0 0x7fd6e00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.075+0000 7fd6e8260700 1 -- 172.21.15.88:0/415385053 >> 172.21.15.88:0/415385053 conn(0x7fd6e00f82d0 msgr2=0x7fd6e00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.075+0000 7fd6e8260700 1 -- 172.21.15.88:0/415385053 shutdown_connections 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.075+0000 7fd6e8260700 1 -- 172.21.15.88:0/415385053 wait complete. 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e8260700 1 Processor -- start 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e8260700 1 -- start start 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e8260700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6e00fcbf0 0x7fd6e0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e8260700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e00fde00 0x7fd6e006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e8260700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0070590 con 0x7fd6e00fde00 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e8260700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0070700 con 0x7fd6e00fcbf0 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e57fb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e00fde00 0x7fd6e006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e57fb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e00fde00 0x7fd6e006ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56236/0 (socket says 172.21.15.88:56236) 2023-12-09T02:32:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e57fb700 1 -- 172.21.15.88:0/490896394 learned_addr learned my addr 172.21.15.88:0/490896394 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e5ffc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6e00fcbf0 0x7fd6e0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e57fb700 1 -- 172.21.15.88:0/490896394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6e00fcbf0 msgr2=0x7fd6e0071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e57fb700 1 --2- 172.21.15.88:0/490896394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6e00fcbf0 0x7fd6e0071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.076+0000 7fd6e57fb700 1 -- 172.21.15.88:0/490896394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc005040 con 0x7fd6e00fde00 2023-12-09T02:32:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.077+0000 7fd6e57fb700 1 --2- 172.21.15.88:0/490896394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e00fde00 0x7fd6e006ff90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009360 tx=0x7fd6dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.077+0000 7fd6d67fc700 1 -- 172.21.15.88:0/490896394 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc00e040 con 0x7fd6e00fde00 2023-12-09T02:32:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.077+0000 7fd6e8260700 1 -- 172.21.15.88:0/490896394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e0070980 con 0x7fd6e00fde00 2023-12-09T02:32:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.077+0000 7fd6d67fc700 1 -- 172.21.15.88:0/490896394 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd6dc00bc50 con 0x7fd6e00fde00 2023-12-09T02:32:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.077+0000 7fd6d67fc700 1 -- 172.21.15.88:0/490896394 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc01c3f0 con 0x7fd6e00fde00 2023-12-09T02:32:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.077+0000 7fd6e8260700 1 -- 172.21.15.88:0/490896394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e01155b0 con 0x7fd6e00fde00 2023-12-09T02:32:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.078+0000 7fd6e8260700 1 -- 172.21.15.88:0/490896394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e004bb80 con 0x7fd6e00fde00 2023-12-09T02:32:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.078+0000 7fd6d67fc700 1 -- 172.21.15.88:0/490896394 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd6dc013420 con 0x7fd6e00fde00 2023-12-09T02:32:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.079+0000 7fd6d67fc700 1 --2- 172.21.15.88:0/490896394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd6cc068fb0 0x7fd6cc06b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.079+0000 7fd6e5ffc700 1 --2- 172.21.15.88:0/490896394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd6cc068fb0 0x7fd6cc06b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.079+0000 7fd6d67fc700 1 -- 172.21.15.88:0/490896394 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd6dc087ee0 con 0x7fd6e00fde00 2023-12-09T02:32:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.079+0000 7fd6e5ffc700 1 --2- 172.21.15.88:0/490896394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd6cc068fb0 0x7fd6cc06b460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00718a0 tx=0x7fd6d0009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:56.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.083+0000 7fd6d67fc700 1 -- 172.21.15.88:0/490896394 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd6dc057d20 con 0x7fd6e00fde00 2023-12-09T02:32:56.288 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:56 smithi161 ceph-mon[121170]: Deploying daemon mds.cephfs.smithi161.posrbq on smithi161 2023-12-09T02:32:56.288 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:56 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] up:boot 2023-12-09T02:32:56.288 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:56 smithi161 ceph-mon[121170]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:active} 2 up:standby 2023-12-09T02:32:56.288 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:56 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.zfojux"}]: dispatch 2023-12-09T02:32:56.288 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:56 smithi161 ceph-mon[121170]: pgmap v135: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 4 op/s 2023-12-09T02:32:56.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:56.311+0000 7fd6e8260700 1 -- 172.21.15.88:0/490896394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd6e0105590 con 0x7fd6e00fde00 2023-12-09T02:32:56.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:56 smithi088 ceph-mon[112028]: Deploying daemon mds.cephfs.smithi161.posrbq on smithi161 2023-12-09T02:32:56.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:56 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] up:boot 2023-12-09T02:32:56.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:56 smithi088 ceph-mon[112028]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:active} 2 up:standby 2023-12-09T02:32:56.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:56 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.zfojux"}]: dispatch 2023-12-09T02:32:56.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:56 smithi088 ceph-mon[112028]: pgmap v135: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 4 op/s 2023-12-09T02:32:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.229+0000 7fd6d67fc700 1 -- 172.21.15.88:0/490896394 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd6dc0578b0 con 0x7fd6e00fde00 2023-12-09T02:32:57.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.232+0000 7fd6e8260700 1 -- 172.21.15.88:0/490896394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd6cc068fb0 msgr2=0x7fd6cc06b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:57.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.232+0000 7fd6e8260700 1 --2- 172.21.15.88:0/490896394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd6cc068fb0 0x7fd6cc06b460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00718a0 tx=0x7fd6d0009040 comp rx=0 tx=0).stop 2023-12-09T02:32:57.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.232+0000 7fd6e8260700 1 -- 172.21.15.88:0/490896394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e00fde00 msgr2=0x7fd6e006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:57.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.232+0000 7fd6e8260700 1 --2- 172.21.15.88:0/490896394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e00fde00 0x7fd6e006ff90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009360 tx=0x7fd6dc009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:57.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.232+0000 7fd6e8260700 1 -- 172.21.15.88:0/490896394 shutdown_connections 2023-12-09T02:32:57.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.232+0000 7fd6e8260700 1 --2- 172.21.15.88:0/490896394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6e00fcbf0 0x7fd6e0071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:57.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.232+0000 7fd6e8260700 1 --2- 172.21.15.88:0/490896394 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd6cc068fb0 0x7fd6cc06b460 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:57.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.232+0000 7fd6e8260700 1 --2- 172.21.15.88:0/490896394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e00fde00 0x7fd6e006ff90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:57.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.232+0000 7fd6e8260700 1 -- 172.21.15.88:0/490896394 >> 172.21.15.88:0/490896394 conn(0x7fd6e00f82d0 msgr2=0x7fd6e0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:57.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.232+0000 7fd6e8260700 1 -- 172.21.15.88:0/490896394 shutdown_connections 2023-12-09T02:32:57.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:57.232+0000 7fd6e8260700 1 -- 172.21.15.88:0/490896394 wait complete. 2023-12-09T02:32:57.440 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:57 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/490896394' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-09T02:32:57.440 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:57 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:57.440 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:57 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:57.440 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:57 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:57.440 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:57 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:57.440 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:57 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:57.440 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:57 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:32:57.630 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-09T02:32:57.640 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:32:57.641 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2023-12-09T02:32:57.655 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:57 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/490896394' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-09T02:32:57.655 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:57 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:57.655 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:57 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:57.656 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:57 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:57.656 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:57 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:57.656 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:57 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:57.656 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:57 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:32:58.051 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:32:58.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:58 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/490896394' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-09T02:32:58.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:58 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] up:boot 2023-12-09T02:32:58.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:58 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] up:standby 2023-12-09T02:32:58.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:58 smithi161 ceph-mon[121170]: Dropping low affinity active daemon mds.cephfs.smithi088.utskxh in favor of higher affinity standby. 2023-12-09T02:32:58.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:58 smithi161 ceph-mon[121170]: Replacing daemon mds.cephfs.smithi088.utskxh as rank 0 with standby daemon mds.cephfs.smithi161.dhvdif 2023-12-09T02:32:58.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:58 smithi161 ceph-mon[121170]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-09T02:32:58.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:58 smithi161 ceph-mon[121170]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:active} 3 up:standby 2023-12-09T02:32:58.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:58 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.posrbq"}]: dispatch 2023-12-09T02:32:58.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:58 smithi161 ceph-mon[121170]: osdmap e46: 6 total, 6 up, 6 in 2023-12-09T02:32:58.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:58 smithi161 ceph-mon[121170]: fsmap cephfs:1/1 {0=cephfs.smithi161.dhvdif=up:replay} 2 up:standby 2023-12-09T02:32:58.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:58 smithi161 ceph-mon[121170]: pgmap v137: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 552 B/s rd, 1.8 KiB/s wr, 6 op/s 2023-12-09T02:32:58.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:58 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/490896394' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-09T02:32:58.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:58 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] up:boot 2023-12-09T02:32:58.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:58 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] up:standby 2023-12-09T02:32:58.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:58 smithi088 ceph-mon[112028]: Dropping low affinity active daemon mds.cephfs.smithi088.utskxh in favor of higher affinity standby. 2023-12-09T02:32:58.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:58 smithi088 ceph-mon[112028]: Replacing daemon mds.cephfs.smithi088.utskxh as rank 0 with standby daemon mds.cephfs.smithi161.dhvdif 2023-12-09T02:32:58.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:58 smithi088 ceph-mon[112028]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-09T02:32:58.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:58 smithi088 ceph-mon[112028]: fsmap cephfs:1 {0=cephfs.smithi088.utskxh=up:active} 3 up:standby 2023-12-09T02:32:58.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:58 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.posrbq"}]: dispatch 2023-12-09T02:32:58.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:58 smithi088 ceph-mon[112028]: osdmap e46: 6 total, 6 up, 6 in 2023-12-09T02:32:58.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:58 smithi088 ceph-mon[112028]: fsmap cephfs:1/1 {0=cephfs.smithi161.dhvdif=up:replay} 2 up:standby 2023-12-09T02:32:58.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:58 smithi088 ceph-mon[112028]: pgmap v137: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 552 B/s rd, 1.8 KiB/s wr, 6 op/s 2023-12-09T02:32:59.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:59 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] up:reconnect 2023-12-09T02:32:59.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:59 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] up:boot 2023-12-09T02:32:59.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:59 smithi161 ceph-mon[121170]: fsmap cephfs:1/1 {0=cephfs.smithi161.dhvdif=up:reconnect} 3 up:standby 2023-12-09T02:32:59.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:59 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.utskxh"}]: dispatch 2023-12-09T02:32:59.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:59 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:59.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:32:59 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:59.434 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:59 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] up:reconnect 2023-12-09T02:32:59.434 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:59 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] up:boot 2023-12-09T02:32:59.434 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:59 smithi088 ceph-mon[112028]: fsmap cephfs:1/1 {0=cephfs.smithi161.dhvdif=up:reconnect} 3 up:standby 2023-12-09T02:32:59.434 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:59 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.utskxh"}]: dispatch 2023-12-09T02:32:59.434 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:59 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:59.435 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:32:59 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:32:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.989+0000 7fefc7329700 1 -- 172.21.15.88:0/4200455941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc00fd730 msgr2=0x7fefc00ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.989+0000 7fefc7329700 1 --2- 172.21.15.88:0/4200455941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc00fd730 0x7fefc00ffb10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fefbc004880 tx=0x7fefbc009e30 comp rx=0 tx=0).stop 2023-12-09T02:32:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.989+0000 7fefc7329700 1 -- 172.21.15.88:0/4200455941 shutdown_connections 2023-12-09T02:32:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.989+0000 7fefc7329700 1 --2- 172.21.15.88:0/4200455941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefc0100050 0x7fefc0102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.989+0000 7fefc7329700 1 --2- 172.21.15.88:0/4200455941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc00fd730 0x7fefc00ffb10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.989+0000 7fefc7329700 1 -- 172.21.15.88:0/4200455941 >> 172.21.15.88:0/4200455941 conn(0x7fefc00f7190 msgr2=0x7fefc00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:32:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.989+0000 7fefc7329700 1 -- 172.21.15.88:0/4200455941 shutdown_connections 2023-12-09T02:32:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.989+0000 7fefc7329700 1 -- 172.21.15.88:0/4200455941 wait complete. 2023-12-09T02:32:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc7329700 1 Processor -- start 2023-12-09T02:32:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc7329700 1 -- start start 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc7329700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefc00fd730 0x7fefc010d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc7329700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc0100050 0x7fefc010d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc7329700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc010dfb0 con 0x7fefc00fd730 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc7329700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc010e850 con 0x7fefc0100050 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc50c5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefc00fd730 0x7fefc010d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc50c5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefc00fd730 0x7fefc010d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52592/0 (socket says 172.21.15.88:52592) 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc50c5700 1 -- 172.21.15.88:0/711389717 learned_addr learned my addr 172.21.15.88:0/711389717 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc48c4700 1 --2- 172.21.15.88:0/711389717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc0100050 0x7fefc010d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc50c5700 1 -- 172.21.15.88:0/711389717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc0100050 msgr2=0x7fefc010d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc50c5700 1 --2- 172.21.15.88:0/711389717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc0100050 0x7fefc010d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.990+0000 7fefc50c5700 1 -- 172.21.15.88:0/711389717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc005040 con 0x7fefc00fd730 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.991+0000 7fefc50c5700 1 --2- 172.21.15.88:0/711389717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefc00fd730 0x7fefc010d470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fefbc000c00 tx=0x7fefbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.991+0000 7fefb5ffb700 1 -- 172.21.15.88:0/711389717 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefbc00e040 con 0x7fefc00fd730 2023-12-09T02:32:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.991+0000 7fefb5ffb700 1 -- 172.21.15.88:0/711389717 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fefbc014d10 con 0x7fefc00fd730 2023-12-09T02:32:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.991+0000 7fefc7329700 1 -- 172.21.15.88:0/711389717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc010ead0 con 0x7fefc00fd730 2023-12-09T02:32:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.991+0000 7fefb5ffb700 1 -- 172.21.15.88:0/711389717 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefbc0125c0 con 0x7fefc00fd730 2023-12-09T02:32:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.991+0000 7fefc7329700 1 -- 172.21.15.88:0/711389717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc010f010 con 0x7fefc00fd730 2023-12-09T02:32:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.992+0000 7fefc7329700 1 -- 172.21.15.88:0/711389717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc004bb80 con 0x7fefc00fd730 2023-12-09T02:32:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.993+0000 7fefb5ffb700 1 -- 172.21.15.88:0/711389717 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fefbc01c3f0 con 0x7fefc00fd730 2023-12-09T02:32:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.994+0000 7fefb5ffb700 1 --2- 172.21.15.88:0/711389717 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fefac068f70 0x7fefac06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:32:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.994+0000 7fefb5ffb700 1 -- 172.21.15.88:0/711389717 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fefbc0888c0 con 0x7fefc00fd730 2023-12-09T02:32:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.994+0000 7fefc48c4700 1 --2- 172.21.15.88:0/711389717 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fefac068f70 0x7fefac06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:32:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.994+0000 7fefc48c4700 1 --2- 172.21.15.88:0/711389717 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fefac068f70 0x7fefac06b420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fefb0004990 tx=0x7fefb0009e20 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:00.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:32:59.998+0000 7fefb5ffb700 1 -- 172.21.15.88:0/711389717 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fefbc058870 con 0x7fefc00fd730 2023-12-09T02:33:00.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:00.264+0000 7fefc7329700 1 -- 172.21.15.88:0/711389717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7fefc010f230 con 0x7fefc00fd730 2023-12-09T02:33:00.354 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:00 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] up:rejoin 2023-12-09T02:33:00.354 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:00 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] up:standby 2023-12-09T02:33:00.354 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:00 smithi088 ceph-mon[112028]: fsmap cephfs:1/1 {0=cephfs.smithi161.dhvdif=up:rejoin} 3 up:standby 2023-12-09T02:33:00.354 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:00 smithi088 ceph-mon[112028]: daemon mds.cephfs.smithi161.dhvdif is now active in filesystem cephfs as rank 0 2023-12-09T02:33:00.354 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:00 smithi088 ceph-mon[112028]: pgmap v138: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2023-12-09T02:33:00.355 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:00 smithi088 ceph-mon[112028]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-09T02:33:00.355 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:00 smithi088 ceph-mon[112028]: Cluster is now healthy 2023-12-09T02:33:00.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:00 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] up:rejoin 2023-12-09T02:33:00.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:00 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] up:standby 2023-12-09T02:33:00.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:00 smithi161 ceph-mon[121170]: fsmap cephfs:1/1 {0=cephfs.smithi161.dhvdif=up:rejoin} 3 up:standby 2023-12-09T02:33:00.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:00 smithi161 ceph-mon[121170]: daemon mds.cephfs.smithi161.dhvdif is now active in filesystem cephfs as rank 0 2023-12-09T02:33:00.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:00 smithi161 ceph-mon[121170]: pgmap v138: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2023-12-09T02:33:00.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:00 smithi161 ceph-mon[121170]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-09T02:33:00.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:00 smithi161 ceph-mon[121170]: Cluster is now healthy 2023-12-09T02:33:01.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.257+0000 7fefb5ffb700 1 -- 172.21.15.88:0/711389717 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v14) v1 ==== 133+0+0 (secure 0 0 0) 0x7fefbc058400 con 0x7fefc00fd730 2023-12-09T02:33:01.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.259+0000 7fefc7329700 1 -- 172.21.15.88:0/711389717 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fefac068f70 msgr2=0x7fefac06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:01.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.259+0000 7fefc7329700 1 --2- 172.21.15.88:0/711389717 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fefac068f70 0x7fefac06b420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fefb0004990 tx=0x7fefb0009e20 comp rx=0 tx=0).stop 2023-12-09T02:33:01.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.259+0000 7fefc7329700 1 -- 172.21.15.88:0/711389717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefc00fd730 msgr2=0x7fefc010d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:01.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.259+0000 7fefc7329700 1 --2- 172.21.15.88:0/711389717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefc00fd730 0x7fefc010d470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fefbc000c00 tx=0x7fefbc009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:01.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.259+0000 7fefc7329700 1 -- 172.21.15.88:0/711389717 shutdown_connections 2023-12-09T02:33:01.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.259+0000 7fefc7329700 1 --2- 172.21.15.88:0/711389717 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fefac068f70 0x7fefac06b420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:01.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.259+0000 7fefc7329700 1 --2- 172.21.15.88:0/711389717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefc00fd730 0x7fefc010d470 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:01.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.259+0000 7fefc7329700 1 --2- 172.21.15.88:0/711389717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc0100050 0x7fefc010d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:01.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.259+0000 7fefc7329700 1 -- 172.21.15.88:0/711389717 >> 172.21.15.88:0/711389717 conn(0x7fefc00f7190 msgr2=0x7fefc00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:01.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.259+0000 7fefc7329700 1 -- 172.21.15.88:0/711389717 shutdown_connections 2023-12-09T02:33:01.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:01.259+0000 7fefc7329700 1 -- 172.21.15.88:0/711389717 wait complete. 2023-12-09T02:33:01.262 INFO:teuthology.orchestra.run.smithi088.stderr:inline data disabled 2023-12-09T02:33:01.645 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:01 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] up:active 2023-12-09T02:33:01.645 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:01 smithi088 ceph-mon[112028]: fsmap cephfs:1 {0=cephfs.smithi161.dhvdif=up:active} 3 up:standby 2023-12-09T02:33:01.645 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:01 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/711389717' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-09T02:33:01.645 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:01.646 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:01.646 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:33:01.646 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:33:01.646 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:01.664 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-09T02:33:01.678 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:33:01.679 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-09T02:33:01.680 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:01 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] up:active 2023-12-09T02:33:01.680 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:01 smithi161 ceph-mon[121170]: fsmap cephfs:1 {0=cephfs.smithi161.dhvdif=up:active} 3 up:standby 2023-12-09T02:33:01.680 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:01 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/711389717' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-09T02:33:01.681 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:01.681 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:01.681 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:33:01.681 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:33:01.681 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:02.258 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:33:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:02 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/711389717' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-09T02:33:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:02 smithi161 ceph-mon[121170]: mds.? [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] up:standby 2023-12-09T02:33:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:02 smithi161 ceph-mon[121170]: fsmap cephfs:1 {0=cephfs.smithi161.dhvdif=up:active} 3 up:standby 2023-12-09T02:33:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:02 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:33:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:02 smithi161 ceph-mon[121170]: pgmap v139: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-12-09T02:33:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:02 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:33:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:02 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:02.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:02 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/711389717' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-09T02:33:02.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:02 smithi088 ceph-mon[112028]: mds.? [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] up:standby 2023-12-09T02:33:02.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:02 smithi088 ceph-mon[112028]: fsmap cephfs:1 {0=cephfs.smithi161.dhvdif=up:active} 3 up:standby 2023-12-09T02:33:02.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:02 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:33:02.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:02 smithi088 ceph-mon[112028]: pgmap v139: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-12-09T02:33:02.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:02 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:33:02.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:02 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.827+0000 7fc06fe98700 1 -- 172.21.15.88:0/1618623979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0680fde90 msgr2=0x7fc0680fe300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.827+0000 7fc06fe98700 1 --2- 172.21.15.88:0/1618623979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0680fde90 0x7fc0680fe300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc058004940 tx=0x7fc058009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.827+0000 7fc06fe98700 1 -- 172.21.15.88:0/1618623979 shutdown_connections 2023-12-09T02:33:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.827+0000 7fc06fe98700 1 --2- 172.21.15.88:0/1618623979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0680fde90 0x7fc0680fe300 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.827+0000 7fc06fe98700 1 --2- 172.21.15.88:0/1618623979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0680fcbe0 0x7fc0680fcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.827+0000 7fc06fe98700 1 -- 172.21.15.88:0/1618623979 >> 172.21.15.88:0/1618623979 conn(0x7fc0680f8360 msgr2=0x7fc0680fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.827+0000 7fc06fe98700 1 -- 172.21.15.88:0/1618623979 shutdown_connections 2023-12-09T02:33:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.827+0000 7fc06fe98700 1 -- 172.21.15.88:0/1618623979 wait complete. 2023-12-09T02:33:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.827+0000 7fc06fe98700 1 Processor -- start 2023-12-09T02:33:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.827+0000 7fc06fe98700 1 -- start start 2023-12-09T02:33:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06fe98700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0680fcbe0 0x7fc068071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06fe98700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0680fde90 0x7fc06806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06fe98700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc068070590 con 0x7fc0680fcbe0 2023-12-09T02:33:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06fe98700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc068070700 con 0x7fc0680fde90 2023-12-09T02:33:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06dc34700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0680fcbe0 0x7fc068071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06dc34700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0680fcbe0 0x7fc068071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52614/0 (socket says 172.21.15.88:52614) 2023-12-09T02:33:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06dc34700 1 -- 172.21.15.88:0/830807929 learned_addr learned my addr 172.21.15.88:0/830807929 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06d433700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0680fde90 0x7fc06806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06dc34700 1 -- 172.21.15.88:0/830807929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0680fde90 msgr2=0x7fc06806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06dc34700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0680fde90 0x7fc06806ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06dc34700 1 -- 172.21.15.88:0/830807929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058005040 con 0x7fc0680fcbe0 2023-12-09T02:33:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06d433700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0680fde90 0x7fc06806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:33:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06dc34700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0680fcbe0 0x7fc068071b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc06400eb40 tx=0x7fc06400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc05e7fc700 1 -- 172.21.15.88:0/830807929 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc064007cc0 con 0x7fc0680fcbe0 2023-12-09T02:33:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc05e7fc700 1 -- 172.21.15.88:0/830807929 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc06400f040 con 0x7fc0680fcbe0 2023-12-09T02:33:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06fe98700 1 -- 172.21.15.88:0/830807929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc068070980 con 0x7fc0680fcbe0 2023-12-09T02:33:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc05e7fc700 1 -- 172.21.15.88:0/830807929 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc064009570 con 0x7fc0680fcbe0 2023-12-09T02:33:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.828+0000 7fc06fe98700 1 -- 172.21.15.88:0/830807929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc068115500 con 0x7fc0680fcbe0 2023-12-09T02:33:03.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.829+0000 7fc06fe98700 1 -- 172.21.15.88:0/830807929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06804bb80 con 0x7fc0680fcbe0 2023-12-09T02:33:03.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.830+0000 7fc05e7fc700 1 -- 172.21.15.88:0/830807929 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc0640096d0 con 0x7fc0680fcbe0 2023-12-09T02:33:03.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.830+0000 7fc05e7fc700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc054068f60 0x7fc05406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.830+0000 7fc05e7fc700 1 -- 172.21.15.88:0/830807929 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc064086b20 con 0x7fc0680fcbe0 2023-12-09T02:33:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.830+0000 7fc06d433700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc054068f60 0x7fc05406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.831+0000 7fc06d433700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc054068f60 0x7fc05406b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc05800b0d0 tx=0x7fc058009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:03.835+0000 7fc05e7fc700 1 -- 172.21.15.88:0/830807929 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc06404da00 con 0x7fc0680fcbe0 2023-12-09T02:33:04.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.094+0000 7fc06fe98700 1 -- 172.21.15.88:0/830807929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc068115870 con 0x7fc0680fcbe0 2023-12-09T02:33:04.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.095+0000 7fc05e7fc700 1 -- 172.21.15.88:0/830807929 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1810 (secure 0 0 0) 0x7fc064019730 con 0x7fc0680fcbe0 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:33:04.098 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:33:04.099 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:33:04.100 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:33:04.100 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:33:04.100 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:33:04.100 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:33:04.100 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:33:04.100 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:33:04.100 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:33:04.100 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:33:04.100 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:33:04.100 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:33:04.100 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:33:04.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.097+0000 7fc06fe98700 1 -- 172.21.15.88:0/830807929 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc054068f60 msgr2=0x7fc05406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:04.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.097+0000 7fc06fe98700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc054068f60 0x7fc05406b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc05800b0d0 tx=0x7fc058009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:04.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.097+0000 7fc06fe98700 1 -- 172.21.15.88:0/830807929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0680fcbe0 msgr2=0x7fc068071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:04.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.097+0000 7fc06fe98700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0680fcbe0 0x7fc068071b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc06400eb40 tx=0x7fc06400b040 comp rx=0 tx=0).stop 2023-12-09T02:33:04.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.097+0000 7fc06fe98700 1 -- 172.21.15.88:0/830807929 shutdown_connections 2023-12-09T02:33:04.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.097+0000 7fc06fe98700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc054068f60 0x7fc05406b410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:04.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.097+0000 7fc06fe98700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0680fcbe0 0x7fc068071b10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:04.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.097+0000 7fc06fe98700 1 --2- 172.21.15.88:0/830807929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0680fde90 0x7fc06806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:04.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.097+0000 7fc06fe98700 1 -- 172.21.15.88:0/830807929 >> 172.21.15.88:0/830807929 conn(0x7fc0680f8360 msgr2=0x7fc0681010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:04.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.097+0000 7fc06fe98700 1 -- 172.21.15.88:0/830807929 shutdown_connections 2023-12-09T02:33:04.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:04.097+0000 7fc06fe98700 1 -- 172.21.15.88:0/830807929 wait complete. 2023-12-09T02:33:04.102 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:33:04.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:03 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:04.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:03 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:03 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:04.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:03 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:04.722 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-09T02:33:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:04 smithi088 ceph-mon[112028]: pgmap v140: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-12-09T02:33:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:04 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/830807929' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:33:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:33:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:33:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:05.011 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:33:05.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:04 smithi161 ceph-mon[121170]: pgmap v140: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-12-09T02:33:05.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:04 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/830807929' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:33:05.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:05.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:05.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:33:05.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:33:05.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.047+0000 7f7168dc6700 1 -- 172.21.15.88:0/3650663789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71640ffd70 msgr2=0x7f71641021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.047+0000 7f7168dc6700 1 --2- 172.21.15.88:0/3650663789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71640ffd70 0x7f71641021d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f714c004940 tx=0x7f714c009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.047+0000 7f7168dc6700 1 -- 172.21.15.88:0/3650663789 shutdown_connections 2023-12-09T02:33:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.047+0000 7f7168dc6700 1 --2- 172.21.15.88:0/3650663789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71640ffd70 0x7f71641021d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.047+0000 7f7168dc6700 1 --2- 172.21.15.88:0/3650663789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7164066090 0x7f71640ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.047+0000 7f7168dc6700 1 -- 172.21.15.88:0/3650663789 >> 172.21.15.88:0/3650663789 conn(0x7f71640f7190 msgr2=0x7f71640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.047+0000 7f7168dc6700 1 -- 172.21.15.88:0/3650663789 shutdown_connections 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.047+0000 7f7168dc6700 1 -- 172.21.15.88:0/3650663789 wait complete. 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f7168dc6700 1 Processor -- start 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f7168dc6700 1 -- start start 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f7168dc6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7164066090 0x7f716410d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f7168dc6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71640ffd70 0x7f716410da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f7168dc6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716410e070 con 0x7f7164066090 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f7168dc6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716410e910 con 0x7f71640ffd70 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f716259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7164066090 0x7f716410d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f716259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7164066090 0x7f716410d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52626/0 (socket says 172.21.15.88:52626) 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f716259c700 1 -- 172.21.15.88:0/2580045395 learned_addr learned my addr 172.21.15.88:0/2580045395 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f716259c700 1 -- 172.21.15.88:0/2580045395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71640ffd70 msgr2=0x7f716410da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f716259c700 1 --2- 172.21.15.88:0/2580045395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71640ffd70 0x7f716410da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f716259c700 1 -- 172.21.15.88:0/2580045395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c005040 con 0x7f7164066090 2023-12-09T02:33:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f716259c700 1 --2- 172.21.15.88:0/2580045395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7164066090 0x7f716410d530 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f715c00c8c0 tx=0x7f715c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.048+0000 7f715affd700 1 -- 172.21.15.88:0/2580045395 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715c00a980 con 0x7f7164066090 2023-12-09T02:33:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.049+0000 7f715affd700 1 -- 172.21.15.88:0/2580045395 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f715c00ce60 con 0x7f7164066090 2023-12-09T02:33:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.049+0000 7f7168dc6700 1 -- 172.21.15.88:0/2580045395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716410ebf0 con 0x7f7164066090 2023-12-09T02:33:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.049+0000 7f715affd700 1 -- 172.21.15.88:0/2580045395 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715c0113a0 con 0x7f7164066090 2023-12-09T02:33:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.049+0000 7f7168dc6700 1 -- 172.21.15.88:0/2580045395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716410f130 con 0x7f7164066090 2023-12-09T02:33:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.050+0000 7f7168dc6700 1 -- 172.21.15.88:0/2580045395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71641075c0 con 0x7f7164066090 2023-12-09T02:33:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.050+0000 7f715affd700 1 -- 172.21.15.88:0/2580045395 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f715c012400 con 0x7f7164066090 2023-12-09T02:33:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.050+0000 7f715affd700 1 --2- 172.21.15.88:0/2580045395 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f7150068f60 0x7f715006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.050+0000 7f715affd700 1 -- 172.21.15.88:0/2580045395 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f715c086f30 con 0x7f7164066090 2023-12-09T02:33:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.050+0000 7f7161d9b700 1 --2- 172.21.15.88:0/2580045395 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f7150068f60 0x7f715006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.051+0000 7f7161d9b700 1 --2- 172.21.15.88:0/2580045395 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f7150068f60 0x7f715006b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b3b0 tx=0x7f714c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.055+0000 7f715affd700 1 -- 172.21.15.88:0/2580045395 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f715c056e40 con 0x7f7164066090 2023-12-09T02:33:06.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.281+0000 7f7168dc6700 1 -- 172.21.15.88:0/2580045395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f716404bb80 con 0x7f7164066090 2023-12-09T02:33:06.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.282+0000 7f715affd700 1 -- 172.21.15.88:0/2580045395 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4691 (secure 0 0 0) 0x7f715c0569d0 con 0x7f7164066090 2023-12-09T02:33:06.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.283+0000 7f7168dc6700 1 -- 172.21.15.88:0/2580045395 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f7150068f60 msgr2=0x7f715006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:06.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.283+0000 7f7168dc6700 1 --2- 172.21.15.88:0/2580045395 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f7150068f60 0x7f715006b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b3b0 tx=0x7f714c009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:06.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.284+0000 7f7168dc6700 1 -- 172.21.15.88:0/2580045395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7164066090 msgr2=0x7f716410d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:06.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.284+0000 7f7168dc6700 1 --2- 172.21.15.88:0/2580045395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7164066090 0x7f716410d530 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f715c00c8c0 tx=0x7f715c0044c0 comp rx=0 tx=0).stop 2023-12-09T02:33:06.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.284+0000 7f7168dc6700 1 -- 172.21.15.88:0/2580045395 shutdown_connections 2023-12-09T02:33:06.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.284+0000 7f7168dc6700 1 --2- 172.21.15.88:0/2580045395 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f7150068f60 0x7f715006b410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:06.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.284+0000 7f7168dc6700 1 --2- 172.21.15.88:0/2580045395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7164066090 0x7f716410d530 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:06.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.284+0000 7f7168dc6700 1 --2- 172.21.15.88:0/2580045395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71640ffd70 0x7f716410da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:06.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.284+0000 7f7168dc6700 1 -- 172.21.15.88:0/2580045395 >> 172.21.15.88:0/2580045395 conn(0x7f71640f7190 msgr2=0x7f71640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:06.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.284+0000 7f7168dc6700 1 -- 172.21.15.88:0/2580045395 shutdown_connections 2023-12-09T02:33:06.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:06.284+0000 7f7168dc6700 1 -- 172.21.15.88:0/2580045395 wait complete. 2023-12-09T02:33:06.287 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:33:06.296 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:33:06.668 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-09T02:33:06.929 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:33:07.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:06 smithi088 ceph-mon[112028]: pgmap v141: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 6 op/s 2023-12-09T02:33:07.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:06 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2580045395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-09T02:33:07.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:06 smithi161 ceph-mon[121170]: pgmap v141: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 6 op/s 2023-12-09T02:33:07.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:06 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2580045395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-09T02:33:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.960+0000 7f00a70bc700 1 -- 172.21.15.88:0/2153256558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00a00fcd00 msgr2=0x7f00a00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.960+0000 7f00a70bc700 1 --2- 172.21.15.88:0/2153256558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00a00fcd00 0x7f00a00fd150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f008c004940 tx=0x7f008c009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.960+0000 7f00a70bc700 1 -- 172.21.15.88:0/2153256558 shutdown_connections 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.960+0000 7f00a70bc700 1 --2- 172.21.15.88:0/2153256558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00a00fcd00 0x7f00a00fd150 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.960+0000 7f00a70bc700 1 --2- 172.21.15.88:0/2153256558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a00fbaf0 0x7f00a00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.960+0000 7f00a70bc700 1 -- 172.21.15.88:0/2153256558 >> 172.21.15.88:0/2153256558 conn(0x7f00a00f71b0 msgr2=0x7f00a00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.960+0000 7f00a70bc700 1 -- 172.21.15.88:0/2153256558 shutdown_connections 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.960+0000 7f00a70bc700 1 -- 172.21.15.88:0/2153256558 wait complete. 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.961+0000 7f00a70bc700 1 Processor -- start 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.961+0000 7f00a70bc700 1 -- start start 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.961+0000 7f00a70bc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00a00fbaf0 0x7f00a00ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.961+0000 7f00a70bc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a00fcd00 0x7f00a00fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.961+0000 7f00a70bc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00fe640 con 0x7f00a00fbaf0 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.961+0000 7f00a70bc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00fe7b0 con 0x7f00a00fcd00 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.961+0000 7f00a4e58700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00a00fbaf0 0x7f00a00ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.961+0000 7f00a4e58700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00a00fbaf0 0x7f00a00ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35846/0 (socket says 172.21.15.88:35846) 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.961+0000 7f00a4e58700 1 -- 172.21.15.88:0/1642712492 learned_addr learned my addr 172.21.15.88:0/1642712492 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.962+0000 7f009ffff700 1 --2- 172.21.15.88:0/1642712492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a00fcd00 0x7f00a00fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.962+0000 7f00a4e58700 1 -- 172.21.15.88:0/1642712492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a00fcd00 msgr2=0x7f00a00fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.962+0000 7f00a4e58700 1 --2- 172.21.15.88:0/1642712492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a00fcd00 0x7f00a00fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.962+0000 7f00a4e58700 1 -- 172.21.15.88:0/1642712492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c005040 con 0x7f00a00fbaf0 2023-12-09T02:33:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.962+0000 7f00a4e58700 1 --2- 172.21.15.88:0/1642712492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00a00fbaf0 0x7f00a00ffbc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0094002a80 tx=0x7f0094004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.962+0000 7f009d7fa700 1 -- 172.21.15.88:0/1642712492 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0094007cc0 con 0x7f00a00fbaf0 2023-12-09T02:33:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.962+0000 7f009d7fa700 1 -- 172.21.15.88:0/1642712492 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f009400f040 con 0x7f00a00fbaf0 2023-12-09T02:33:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.962+0000 7f00a70bc700 1 -- 172.21.15.88:0/1642712492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a00fea90 con 0x7f00a00fbaf0 2023-12-09T02:33:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.962+0000 7f009d7fa700 1 -- 172.21.15.88:0/1642712492 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f009400d9c0 con 0x7f00a00fbaf0 2023-12-09T02:33:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.962+0000 7f00a70bc700 1 -- 172.21.15.88:0/1642712492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a0115550 con 0x7f00a00fbaf0 2023-12-09T02:33:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.963+0000 7f00a70bc700 1 -- 172.21.15.88:0/1642712492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a004bb80 con 0x7f00a00fbaf0 2023-12-09T02:33:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.963+0000 7f009d7fa700 1 -- 172.21.15.88:0/1642712492 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f009400db20 con 0x7f00a00fbaf0 2023-12-09T02:33:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.964+0000 7f009d7fa700 1 --2- 172.21.15.88:0/1642712492 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0090068f70 0x7f009006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.964+0000 7f009d7fa700 1 -- 172.21.15.88:0/1642712492 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0094086b10 con 0x7f00a00fbaf0 2023-12-09T02:33:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.964+0000 7f009ffff700 1 --2- 172.21.15.88:0/1642712492 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0090068f70 0x7f009006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.964+0000 7f009ffff700 1 --2- 172.21.15.88:0/1642712492 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0090068f70 0x7f009006b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f008c00b3b0 tx=0x7f008c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:07.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:07.968+0000 7f009d7fa700 1 -- 172.21.15.88:0/1642712492 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f00940569a0 con 0x7f00a00fbaf0 2023-12-09T02:33:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.228+0000 7f00a70bc700 1 -- 172.21.15.88:0/1642712492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f00a0115930 con 0x7f00a00fbaf0 2023-12-09T02:33:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.229+0000 7f009d7fa700 1 -- 172.21.15.88:0/1642712492 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+99 (secure 0 0 0) 0x7f0094056530 con 0x7f00a00fbaf0 2023-12-09T02:33:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.231+0000 7f00a70bc700 1 -- 172.21.15.88:0/1642712492 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0090068f70 msgr2=0x7f009006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.231+0000 7f00a70bc700 1 --2- 172.21.15.88:0/1642712492 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0090068f70 0x7f009006b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f008c00b3b0 tx=0x7f008c009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.231+0000 7f00a70bc700 1 -- 172.21.15.88:0/1642712492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00a00fbaf0 msgr2=0x7f00a00ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.231+0000 7f00a70bc700 1 --2- 172.21.15.88:0/1642712492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00a00fbaf0 0x7f00a00ffbc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0094002a80 tx=0x7f0094004600 comp rx=0 tx=0).stop 2023-12-09T02:33:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.231+0000 7f00a70bc700 1 -- 172.21.15.88:0/1642712492 shutdown_connections 2023-12-09T02:33:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.231+0000 7f00a70bc700 1 --2- 172.21.15.88:0/1642712492 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0090068f70 0x7f009006b420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.231+0000 7f00a70bc700 1 --2- 172.21.15.88:0/1642712492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00a00fbaf0 0x7f00a00ffbc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:08.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.231+0000 7f00a70bc700 1 --2- 172.21.15.88:0/1642712492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a00fcd00 0x7f00a00fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:08.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.231+0000 7f00a70bc700 1 -- 172.21.15.88:0/1642712492 >> 172.21.15.88:0/1642712492 conn(0x7f00a00f71b0 msgr2=0x7f00a0065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:08.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.231+0000 7f00a70bc700 1 -- 172.21.15.88:0/1642712492 shutdown_connections 2023-12-09T02:33:08.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.231+0000 7f00a70bc700 1 -- 172.21.15.88:0/1642712492 wait complete. 2023-12-09T02:33:08.242 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:33:08.599 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-09T02:33:08.612 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-09T02:33:08.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.779+0000 7fd74dac5700 1 -- 172.21.15.88:0/3523313774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7480fe0c0 msgr2=0x7fd7480fe4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:08.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.779+0000 7fd74dac5700 1 --2- 172.21.15.88:0/3523313774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7480fe0c0 0x7fd7480fe4d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd738004940 tx=0x7fd738009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:08.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.779+0000 7fd74dac5700 1 -- 172.21.15.88:0/3523313774 shutdown_connections 2023-12-09T02:33:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.779+0000 7fd74dac5700 1 --2- 172.21.15.88:0/3523313774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7480feaa0 0x7fd7480fab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.779+0000 7fd74dac5700 1 --2- 172.21.15.88:0/3523313774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7480fe0c0 0x7fd7480fe4d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.779+0000 7fd74dac5700 1 -- 172.21.15.88:0/3523313774 >> 172.21.15.88:0/3523313774 conn(0x7fd7480f67c0 msgr2=0x7fd7480f8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.779+0000 7fd74dac5700 1 -- 172.21.15.88:0/3523313774 shutdown_connections 2023-12-09T02:33:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.779+0000 7fd74dac5700 1 -- 172.21.15.88:0/3523313774 wait complete. 2023-12-09T02:33:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.779+0000 7fd74dac5700 1 Processor -- start 2023-12-09T02:33:08.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd74dac5700 1 -- start start 2023-12-09T02:33:08.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd74dac5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7480fe0c0 0x7fd74810d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:08.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd74dac5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd74810d780 0x7fd748112800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:08.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd74dac5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74810dc40 con 0x7fd74810d780 2023-12-09T02:33:08.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd74dac5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74810dd80 con 0x7fd7480fe0c0 2023-12-09T02:33:08.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd746ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd74810d780 0x7fd748112800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:08.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd746ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd74810d780 0x7fd748112800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35862/0 (socket says 172.21.15.88:35862) 2023-12-09T02:33:08.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd746ffd700 1 -- 172.21.15.88:0/660959667 learned_addr learned my addr 172.21.15.88:0/660959667 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:08.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd7477fe700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7480fe0c0 0x7fd74810d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd746ffd700 1 -- 172.21.15.88:0/660959667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7480fe0c0 msgr2=0x7fd74810d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd746ffd700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7480fe0c0 0x7fd74810d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd746ffd700 1 -- 172.21.15.88:0/660959667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738005040 con 0x7fd74810d780 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd7477fe700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7480fe0c0 0x7fd74810d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd746ffd700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd74810d780 0x7fd748112800 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd73c002a50 tx=0x7fd73c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.780+0000 7fd72ffff700 1 -- 172.21.15.88:0/660959667 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73c007cc0 con 0x7fd74810d780 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.781+0000 7fd74dac5700 1 -- 172.21.15.88:0/660959667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd748112da0 con 0x7fd74810d780 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.781+0000 7fd72ffff700 1 -- 172.21.15.88:0/660959667 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd73c00f040 con 0x7fd74810d780 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.781+0000 7fd72ffff700 1 -- 172.21.15.88:0/660959667 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73c00d990 con 0x7fd74810d780 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.781+0000 7fd74dac5700 1 -- 172.21.15.88:0/660959667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd748113310 con 0x7fd74810d780 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.781+0000 7fd74dac5700 1 -- 172.21.15.88:0/660959667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd748105430 con 0x7fd74810d780 2023-12-09T02:33:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.782+0000 7fd72ffff700 1 -- 172.21.15.88:0/660959667 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd73c009710 con 0x7fd74810d780 2023-12-09T02:33:08.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.782+0000 7fd72ffff700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd730068fb0 0x7fd73006b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:08.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.782+0000 7fd72ffff700 1 -- 172.21.15.88:0/660959667 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd73c086c20 con 0x7fd74810d780 2023-12-09T02:33:08.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.782+0000 7fd7477fe700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd730068fb0 0x7fd73006b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:08.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.783+0000 7fd7477fe700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd730068fb0 0x7fd73006b460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd738009fd0 tx=0x7fd738009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:08.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.787+0000 7fd72ffff700 1 -- 172.21.15.88:0/660959667 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd73c056ab0 con 0x7fd74810d780 2023-12-09T02:33:08.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.973+0000 7fd74dac5700 1 -- 172.21.15.88:0/660959667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7481135d0 con 0x7fd74810d780 2023-12-09T02:33:08.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.973+0000 7fd72ffff700 1 -- 172.21.15.88:0/660959667 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14411 (secure 0 0 0) 0x7fd73c056640 con 0x7fd74810d780 2023-12-09T02:33:08.975 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:33:08.975 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":46,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","created":"2023-12-09T02:27:49.802100+0000","modified":"2023-12-09T02:32:57.231261+0000","last_up_change":"2023-12-09T02:32:01.964039+0000","last_in_change":"2023-12-09T02:31:45.877281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-09T02:31:07.797033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-09T02:32:47.454661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-09T02:32:48.330279+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94c4c8ad-f87e-4abd-aff2-ea13d8630f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6803","nonce":4163243891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6805","nonce":4163243891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6809","nonce":4163243891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":4163243891},{"type":"v1","addr":"172.21.15.88:6807","nonce":4163243891}]},"public_addr":"172.21.15.88:6803/4163243891","cluster_addr":"172.21.15.88:6805/4163243891","heartbeat_back_addr":"172.21.15.88:6809/4163243891","heartbeat_front_addr":"172.21.15.88:6807/4163243891","state":["exists","up"]},{"osd":1,"uuid":"1b6c3137-e616-4979-a9cb-89665a8a2919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6811","nonce":1049229781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6813","nonce":1049229781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6817","nonce":1049229781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1049229781},{"type":"v1","addr":"172.21.15.88:6815","nonce":1049229781}]},"public_addr":"172.21.15.88:6811/1049229781","cluster_addr":"172.21.15.88:6813/1049229781","heartbeat_back_addr":"172.21.15.88:6817/1049229781","heartbeat_front_addr":"172.21.15.88:6815/1049229781","state":["exists","up"]},{"osd":2,"uuid":"c5d0b176-113f-450a-8737-2dcf542f1f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6819","nonce":2614314803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6821","nonce":2614314803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6825","nonce":2614314803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2614314803},{"type":"v1","addr":"172.21.15.88:6823","nonce":2614314803}]},"public_addr":"172.21.15.88:6819/2614314803","cluster_addr":"172.21.15.88:6821/2614314803","heartbeat_back_addr":"172.21.15.88:6825/2614314803","heartbeat_front_addr":"172.21.15.88:6823/2614314803","state":["exists","up"]},{"osd":3,"uuid":"6584d86c-84e6-4f9e-a481-d297f6892df8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6801","nonce":1856287356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6803","nonce":1856287356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6807","nonce":1856287356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1856287356},{"type":"v1","addr":"172.21.15.161:6805","nonce":1856287356}]},"public_addr":"172.21.15.161:6801/1856287356","cluster_addr":"172.21.15.161:6803/1856287356","heartbeat_back_addr":"172.21.15.161:6807/1856287356","heartbeat_front_addr":"172.21.15.161:6805/1856287356","state":["exists","up"]},{"osd":4,"uuid":"729b6d7a-8045-40d4-b07d-aa8d8912a357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6809","nonce":1385340150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6811","nonce":1385340150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6815","nonce":1385340150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1385340150},{"type":"v1","addr":"172.21.15.161:6813","nonce":1385340150}]},"public_addr":"172.21.15.161:6809/1385340150","cluster_addr":"172.21.15.161:6811/1385340150","heartbeat_back_addr":"172.21.15.161:6815/1385340150","heartbeat_front_addr":"172.21.15.161:6813/1385340150","state":["exists","up"]},{"osd":5,"uuid":"973d7656-a340-4dc0-a2df-7cd3c96df604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6817","nonce":2958715517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6819","nonce":2958715517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6823","nonce":2958715517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2958715517},{"type":"v1","addr":"172.21.15.161:6821","nonce":2958715517}]},"public_addr":"172.21.15.161:6817/2958715517","cluster_addr":"172.21.15.161:6819/2958715517","heartbeat_back_addr":"172.21.15.161:6823/2958715517","heartbeat_front_addr":"172.21.15.161:6821/2958715517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:24.723561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:44.412595+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:04.087324+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:22.198894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:41.741094+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:32:00.865763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6801/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.88:6827/2247714894":"2023-12-10T02:32:57.231230+0000","172.21.15.88:0/712942340":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/1442782127":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/2691791328":"2023-12-10T02:29:31.504500+0000","172.21.15.88:6801/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6800/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/2169163782":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/2588418845":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/1114065717":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/2387855456":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/3372513144":"2023-12-10T02:28:42.918100+0000","172.21.15.88:6800/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.88:6800/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/2622749836":"2023-12-10T02:29:31.504500+0000","172.21.15.88:6801/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.88:6826/2247714894":"2023-12-10T02:32:57.231230+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-09T02:33:08.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.975+0000 7fd74dac5700 1 -- 172.21.15.88:0/660959667 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd730068fb0 msgr2=0x7fd73006b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:08.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.975+0000 7fd74dac5700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd730068fb0 0x7fd73006b460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd738009fd0 tx=0x7fd738009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:08.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.975+0000 7fd74dac5700 1 -- 172.21.15.88:0/660959667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd74810d780 msgr2=0x7fd748112800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:08.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.975+0000 7fd74dac5700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd74810d780 0x7fd748112800 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd73c002a50 tx=0x7fd73c004600 comp rx=0 tx=0).stop 2023-12-09T02:33:08.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.975+0000 7fd74dac5700 1 -- 172.21.15.88:0/660959667 shutdown_connections 2023-12-09T02:33:08.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.975+0000 7fd74dac5700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7480fe0c0 0x7fd74810d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:08.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.975+0000 7fd74dac5700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fd730068fb0 0x7fd73006b460 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:08.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.975+0000 7fd74dac5700 1 --2- 172.21.15.88:0/660959667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd74810d780 0x7fd748112800 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:08.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.975+0000 7fd74dac5700 1 -- 172.21.15.88:0/660959667 >> 172.21.15.88:0/660959667 conn(0x7fd7480f67c0 msgr2=0x7fd7481010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:08.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.976+0000 7fd74dac5700 1 -- 172.21.15.88:0/660959667 shutdown_connections 2023-12-09T02:33:08.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:08.976+0000 7fd74dac5700 1 -- 172.21.15.88:0/660959667 wait complete. 2023-12-09T02:33:08.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-09T02:31:07.797033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-09T02:32:47.454661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-09T02:32:48.330279+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-09T02:33:08.990 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-09T02:33:09.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.108+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3548354681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00fcb80 msgr2=0x7f2ed00fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.108+0000 7f2ed5e2e700 1 --2- 172.21.15.88:0/3548354681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00fcb80 0x7f2ed00fcfd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0004940 tx=0x7f2ec0009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:09.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.108+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3548354681 shutdown_connections 2023-12-09T02:33:09.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.108+0000 7f2ed5e2e700 1 --2- 172.21.15.88:0/3548354681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00fcb80 0x7f2ed00fcfd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.108+0000 7f2ed5e2e700 1 --2- 172.21.15.88:0/3548354681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ed00fb970 0x7f2ed00fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.108+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3548354681 >> 172.21.15.88:0/3548354681 conn(0x7f2ed00f7010 msgr2=0x7f2ed00f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:09.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.108+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3548354681 shutdown_connections 2023-12-09T02:33:09.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.108+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3548354681 wait complete. 2023-12-09T02:33:09.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.109+0000 7f2ed5e2e700 1 Processor -- start 2023-12-09T02:33:09.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.109+0000 7f2ed5e2e700 1 -- start start 2023-12-09T02:33:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.109+0000 7f2ed5e2e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ed00fb970 0x7f2ed010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.109+0000 7f2ed5e2e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00fcb80 0x7f2ed010c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.109+0000 7f2ed5e2e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed010ccd0 con 0x7f2ed00fcb80 2023-12-09T02:33:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.109+0000 7f2ed5e2e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed010ce40 con 0x7f2ed00fb970 2023-12-09T02:33:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.109+0000 7f2eceffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00fcb80 0x7f2ed010c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.109+0000 7f2eceffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00fcb80 0x7f2ed010c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35888/0 (socket says 172.21.15.88:35888) 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.109+0000 7f2eceffd700 1 -- 172.21.15.88:0/3720393840 learned_addr learned my addr 172.21.15.88:0/3720393840 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.109+0000 7f2ecf7fe700 1 --2- 172.21.15.88:0/3720393840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ed00fb970 0x7f2ed010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.110+0000 7f2eceffd700 1 -- 172.21.15.88:0/3720393840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ed00fb970 msgr2=0x7f2ed010c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.110+0000 7f2eceffd700 1 --2- 172.21.15.88:0/3720393840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ed00fb970 0x7f2ed010c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.110+0000 7f2eceffd700 1 -- 172.21.15.88:0/3720393840 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0005040 con 0x7f2ed00fcb80 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.110+0000 7f2eceffd700 1 --2- 172.21.15.88:0/3720393840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00fcb80 0x7f2ed010c6d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009380 tx=0x7f2ec0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.110+0000 7f2eb7fff700 1 -- 172.21.15.88:0/3720393840 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec000e040 con 0x7f2ed00fcb80 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.110+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3720393840 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed0111890 con 0x7f2ed00fcb80 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.110+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3720393840 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed0111e50 con 0x7f2ed00fcb80 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.110+0000 7f2eb7fff700 1 -- 172.21.15.88:0/3720393840 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ec000bd20 con 0x7f2ed00fcb80 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.110+0000 7f2eb7fff700 1 -- 172.21.15.88:0/3720393840 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec001c630 con 0x7f2ed00fcb80 2023-12-09T02:33:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.111+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3720393840 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed0104310 con 0x7f2ed00fcb80 2023-12-09T02:33:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.111+0000 7f2eb7fff700 1 -- 172.21.15.88:0/3720393840 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2ec0013420 con 0x7f2ed00fcb80 2023-12-09T02:33:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.112+0000 7f2eb7fff700 1 --2- 172.21.15.88:0/3720393840 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2eb8068f60 0x7f2eb806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.112+0000 7f2eb7fff700 1 -- 172.21.15.88:0/3720393840 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2ec0088150 con 0x7f2ed00fcb80 2023-12-09T02:33:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.112+0000 7f2ecf7fe700 1 --2- 172.21.15.88:0/3720393840 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2eb8068f60 0x7f2eb806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.112+0000 7f2ecf7fe700 1 --2- 172.21.15.88:0/3720393840 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2eb8068f60 0x7f2eb806b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00fc9e0 tx=0x7f2ec4009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.116+0000 7f2eb7fff700 1 -- 172.21.15.88:0/3720393840 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2ec0058060 con 0x7f2ed00fcb80 2023-12-09T02:33:09.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:08 smithi088 ceph-mon[112028]: pgmap v142: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-09T02:33:09.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:08 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1642712492' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-09T02:33:09.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.302+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3720393840 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ed0112130 con 0x7f2ed00fcb80 2023-12-09T02:33:09.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.302+0000 7f2eb7fff700 1 -- 172.21.15.88:0/3720393840 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ec0057bf0 con 0x7f2ed00fcb80 2023-12-09T02:33:09.304 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-09T02:33:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.304+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3720393840 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2eb8068f60 msgr2=0x7f2eb806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.304+0000 7f2ed5e2e700 1 --2- 172.21.15.88:0/3720393840 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2eb8068f60 0x7f2eb806b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00fc9e0 tx=0x7f2ec4009040 comp rx=0 tx=0).stop 2023-12-09T02:33:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.304+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3720393840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00fcb80 msgr2=0x7f2ed010c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.304+0000 7f2ed5e2e700 1 --2- 172.21.15.88:0/3720393840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00fcb80 0x7f2ed010c6d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009380 tx=0x7f2ec0009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.304+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3720393840 shutdown_connections 2023-12-09T02:33:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.304+0000 7f2ed5e2e700 1 --2- 172.21.15.88:0/3720393840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ed00fb970 0x7f2ed010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.304+0000 7f2ed5e2e700 1 --2- 172.21.15.88:0/3720393840 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2eb8068f60 0x7f2eb806b410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.304+0000 7f2ed5e2e700 1 --2- 172.21.15.88:0/3720393840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00fcb80 0x7f2ed010c6d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.304+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3720393840 >> 172.21.15.88:0/3720393840 conn(0x7f2ed00f7010 msgr2=0x7f2ed00ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.304+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3720393840 shutdown_connections 2023-12-09T02:33:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.304+0000 7f2ed5e2e700 1 -- 172.21.15.88:0/3720393840 wait complete. 2023-12-09T02:33:09.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-09T02:33:09.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:08 smithi161 ceph-mon[121170]: pgmap v142: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-09T02:33:09.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:08 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/1642712492' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-09T02:33:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.437+0000 7f68bcc05700 1 -- 172.21.15.88:0/1294788912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68b80ffed0 msgr2=0x7f68b81022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.437+0000 7f68bcc05700 1 --2- 172.21.15.88:0/1294788912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68b80ffed0 0x7f68b81022b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f68a0004940 tx=0x7f68a0009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.437+0000 7f68bcc05700 1 -- 172.21.15.88:0/1294788912 shutdown_connections 2023-12-09T02:33:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.437+0000 7f68bcc05700 1 --2- 172.21.15.88:0/1294788912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68b80ffed0 0x7f68b81022b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.437+0000 7f68bcc05700 1 --2- 172.21.15.88:0/1294788912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68b80fd5b0 0x7f68b80ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.437+0000 7f68bcc05700 1 -- 172.21.15.88:0/1294788912 >> 172.21.15.88:0/1294788912 conn(0x7f68b80f7010 msgr2=0x7f68b80f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.437+0000 7f68bcc05700 1 -- 172.21.15.88:0/1294788912 shutdown_connections 2023-12-09T02:33:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.437+0000 7f68bcc05700 1 -- 172.21.15.88:0/1294788912 wait complete. 2023-12-09T02:33:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.437+0000 7f68bcc05700 1 Processor -- start 2023-12-09T02:33:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68bcc05700 1 -- start start 2023-12-09T02:33:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68bcc05700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68b80fd5b0 0x7f68b810d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68bcc05700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68b80ffed0 0x7f68b810d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68bcc05700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b810dd70 con 0x7f68b80fd5b0 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68bcc05700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b810dee0 con 0x7f68b80ffed0 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68b659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68b80fd5b0 0x7f68b810d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68b659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68b80fd5b0 0x7f68b810d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35910/0 (socket says 172.21.15.88:35910) 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68b659c700 1 -- 172.21.15.88:0/3181593355 learned_addr learned my addr 172.21.15.88:0/3181593355 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68b5d9b700 1 --2- 172.21.15.88:0/3181593355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68b80ffed0 0x7f68b810d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68b659c700 1 -- 172.21.15.88:0/3181593355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68b80ffed0 msgr2=0x7f68b810d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68b659c700 1 --2- 172.21.15.88:0/3181593355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68b80ffed0 0x7f68b810d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68b659c700 1 -- 172.21.15.88:0/3181593355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a0005040 con 0x7f68b80fd5b0 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68b659c700 1 --2- 172.21.15.88:0/3181593355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68b80fd5b0 0x7f68b810d230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68a800c8c0 tx=0x7f68a80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68aeffd700 1 -- 172.21.15.88:0/3181593355 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a800a980 con 0x7f68b80fd5b0 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68aeffd700 1 -- 172.21.15.88:0/3181593355 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68a800ce60 con 0x7f68b80fd5b0 2023-12-09T02:33:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68aeffd700 1 -- 172.21.15.88:0/3181593355 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a80113a0 con 0x7f68b80fd5b0 2023-12-09T02:33:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68bcc05700 1 -- 172.21.15.88:0/3181593355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b8112990 con 0x7f68b80fd5b0 2023-12-09T02:33:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.438+0000 7f68bcc05700 1 -- 172.21.15.88:0/3181593355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b8112f00 con 0x7f68b80fd5b0 2023-12-09T02:33:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.439+0000 7f68bcc05700 1 -- 172.21.15.88:0/3181593355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b8105400 con 0x7f68b80fd5b0 2023-12-09T02:33:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.440+0000 7f68aeffd700 1 -- 172.21.15.88:0/3181593355 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f68a8012400 con 0x7f68b80fd5b0 2023-12-09T02:33:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.440+0000 7f68aeffd700 1 --2- 172.21.15.88:0/3181593355 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f68a4068f60 0x7f68a406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.440+0000 7f68aeffd700 1 -- 172.21.15.88:0/3181593355 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f68a8086ed0 con 0x7f68b80fd5b0 2023-12-09T02:33:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.440+0000 7f68b5d9b700 1 --2- 172.21.15.88:0/3181593355 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f68a4068f60 0x7f68a406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.440+0000 7f68b5d9b700 1 --2- 172.21.15.88:0/3181593355 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f68a4068f60 0x7f68a406b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68a000b3b0 tx=0x7f68a0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:09.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.444+0000 7f68aeffd700 1 -- 172.21.15.88:0/3181593355 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f68a8056de0 con 0x7f68b80fd5b0 2023-12-09T02:33:09.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.625+0000 7f68bcc05700 1 -- 172.21.15.88:0/3181593355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f68b81131e0 con 0x7f68b80fd5b0 2023-12-09T02:33:09.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.625+0000 7f68aeffd700 1 -- 172.21.15.88:0/3181593355 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f68a8056970 con 0x7f68b80fd5b0 2023-12-09T02:33:09.626 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-09T02:33:09.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.627+0000 7f68bcc05700 1 -- 172.21.15.88:0/3181593355 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f68a4068f60 msgr2=0x7f68a406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.627+0000 7f68bcc05700 1 --2- 172.21.15.88:0/3181593355 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f68a4068f60 0x7f68a406b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68a000b3b0 tx=0x7f68a0009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:09.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.627+0000 7f68bcc05700 1 -- 172.21.15.88:0/3181593355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68b80fd5b0 msgr2=0x7f68b810d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.627+0000 7f68bcc05700 1 --2- 172.21.15.88:0/3181593355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68b80fd5b0 0x7f68b810d230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68a800c8c0 tx=0x7f68a80044c0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.627+0000 7f68bcc05700 1 -- 172.21.15.88:0/3181593355 shutdown_connections 2023-12-09T02:33:09.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.627+0000 7f68bcc05700 1 --2- 172.21.15.88:0/3181593355 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f68a4068f60 0x7f68a406b410 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.627+0000 7f68bcc05700 1 --2- 172.21.15.88:0/3181593355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68b80fd5b0 0x7f68b810d230 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.627+0000 7f68bcc05700 1 --2- 172.21.15.88:0/3181593355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68b80ffed0 0x7f68b810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.627+0000 7f68bcc05700 1 -- 172.21.15.88:0/3181593355 >> 172.21.15.88:0/3181593355 conn(0x7f68b80f7010 msgr2=0x7f68b80f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:09.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.627+0000 7f68bcc05700 1 -- 172.21.15.88:0/3181593355 shutdown_connections 2023-12-09T02:33:09.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.627+0000 7f68bcc05700 1 -- 172.21.15.88:0/3181593355 wait complete. 2023-12-09T02:33:09.640 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-09T02:33:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.758+0000 7fa9ff027700 1 -- 172.21.15.88:0/2321125467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f80fcb80 msgr2=0x7fa9f80fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.758+0000 7fa9ff027700 1 --2- 172.21.15.88:0/2321125467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f80fcb80 0x7fa9f80fcfd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4004940 tx=0x7fa9e4009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.758+0000 7fa9ff027700 1 -- 172.21.15.88:0/2321125467 shutdown_connections 2023-12-09T02:33:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.758+0000 7fa9ff027700 1 --2- 172.21.15.88:0/2321125467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f80fcb80 0x7fa9f80fcfd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.758+0000 7fa9ff027700 1 --2- 172.21.15.88:0/2321125467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9f80fb970 0x7fa9f80fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.758+0000 7fa9ff027700 1 -- 172.21.15.88:0/2321125467 >> 172.21.15.88:0/2321125467 conn(0x7fa9f80f7010 msgr2=0x7fa9f80f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.758+0000 7fa9ff027700 1 -- 172.21.15.88:0/2321125467 shutdown_connections 2023-12-09T02:33:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.758+0000 7fa9ff027700 1 -- 172.21.15.88:0/2321125467 wait complete. 2023-12-09T02:33:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.759+0000 7fa9ff027700 1 Processor -- start 2023-12-09T02:33:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.759+0000 7fa9ff027700 1 -- start start 2023-12-09T02:33:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.759+0000 7fa9ff027700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f80fb970 0x7fa9f8065650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.759+0000 7fa9ff027700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9f80fcb80 0x7fa9f81120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.759+0000 7fa9ff027700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81125e0 con 0x7fa9f80fb970 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.759+0000 7fa9ff027700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8112720 con 0x7fa9f80fcb80 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.759+0000 7fa9fcdc3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f80fb970 0x7fa9f8065650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.759+0000 7fa9fcdc3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f80fb970 0x7fa9f8065650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35938/0 (socket says 172.21.15.88:35938) 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.759+0000 7fa9fcdc3700 1 -- 172.21.15.88:0/3895535414 learned_addr learned my addr 172.21.15.88:0/3895535414 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.760+0000 7fa9f7fff700 1 --2- 172.21.15.88:0/3895535414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9f80fcb80 0x7fa9f81120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.760+0000 7fa9fcdc3700 1 -- 172.21.15.88:0/3895535414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9f80fcb80 msgr2=0x7fa9f81120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.760+0000 7fa9fcdc3700 1 --2- 172.21.15.88:0/3895535414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9f80fcb80 0x7fa9f81120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.760+0000 7fa9fcdc3700 1 -- 172.21.15.88:0/3895535414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e4005040 con 0x7fa9f80fb970 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.760+0000 7fa9fcdc3700 1 --2- 172.21.15.88:0/3895535414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f80fb970 0x7fa9f8065650 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00c800 tx=0x7fa9ec004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.760+0000 7fa9f57fa700 1 -- 172.21.15.88:0/3895535414 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec00a760 con 0x7fa9f80fb970 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.760+0000 7fa9ff027700 1 -- 172.21.15.88:0/3895535414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f8112a00 con 0x7fa9f80fb970 2023-12-09T02:33:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.760+0000 7fa9f57fa700 1 -- 172.21.15.88:0/3895535414 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9ec00ad70 con 0x7fa9f80fb970 2023-12-09T02:33:09.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.760+0000 7fa9f57fa700 1 -- 172.21.15.88:0/3895535414 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec0113a0 con 0x7fa9f80fb970 2023-12-09T02:33:09.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.760+0000 7fa9ff027700 1 -- 172.21.15.88:0/3895535414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f8112fc0 con 0x7fa9f80fb970 2023-12-09T02:33:09.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.761+0000 7fa9ff027700 1 -- 172.21.15.88:0/3895535414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f8104330 con 0x7fa9f80fb970 2023-12-09T02:33:09.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.762+0000 7fa9f57fa700 1 -- 172.21.15.88:0/3895535414 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa9ec012400 con 0x7fa9f80fb970 2023-12-09T02:33:09.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.762+0000 7fa9f57fa700 1 --2- 172.21.15.88:0/3895535414 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa9e8068fb0 0x7fa9e806b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:09.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.762+0000 7fa9f57fa700 1 -- 172.21.15.88:0/3895535414 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa9ec086eb0 con 0x7fa9f80fb970 2023-12-09T02:33:09.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.762+0000 7fa9f7fff700 1 --2- 172.21.15.88:0/3895535414 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa9e8068fb0 0x7fa9e806b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:09.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.762+0000 7fa9f7fff700 1 --2- 172.21.15.88:0/3895535414 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa9e8068fb0 0x7fa9e806b460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400b3b0 tx=0x7fa9e4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.766+0000 7fa9f57fa700 1 -- 172.21.15.88:0/3895535414 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa9ec056d20 con 0x7fa9f80fb970 2023-12-09T02:33:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.950+0000 7fa9ff027700 1 -- 172.21.15.88:0/3895535414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fa9f8113270 con 0x7fa9f80fb970 2023-12-09T02:33:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.950+0000 7fa9f57fa700 1 -- 172.21.15.88:0/3895535414 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa9ec0568b0 con 0x7fa9f80fb970 2023-12-09T02:33:09.952 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-09T02:33:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.952+0000 7fa9ff027700 1 -- 172.21.15.88:0/3895535414 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa9e8068fb0 msgr2=0x7fa9e806b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.952+0000 7fa9ff027700 1 --2- 172.21.15.88:0/3895535414 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa9e8068fb0 0x7fa9e806b460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400b3b0 tx=0x7fa9e4009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.952+0000 7fa9ff027700 1 -- 172.21.15.88:0/3895535414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f80fb970 msgr2=0x7fa9f8065650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.952+0000 7fa9ff027700 1 --2- 172.21.15.88:0/3895535414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f80fb970 0x7fa9f8065650 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00c800 tx=0x7fa9ec004470 comp rx=0 tx=0).stop 2023-12-09T02:33:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.952+0000 7fa9ff027700 1 -- 172.21.15.88:0/3895535414 shutdown_connections 2023-12-09T02:33:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.952+0000 7fa9ff027700 1 --2- 172.21.15.88:0/3895535414 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa9e8068fb0 0x7fa9e806b460 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.952+0000 7fa9ff027700 1 --2- 172.21.15.88:0/3895535414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f80fb970 0x7fa9f8065650 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.952+0000 7fa9ff027700 1 --2- 172.21.15.88:0/3895535414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9f80fcb80 0x7fa9f81120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.952+0000 7fa9ff027700 1 -- 172.21.15.88:0/3895535414 >> 172.21.15.88:0/3895535414 conn(0x7fa9f80f7010 msgr2=0x7fa9f80ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.952+0000 7fa9ff027700 1 -- 172.21.15.88:0/3895535414 shutdown_connections 2023-12-09T02:33:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:09.952+0000 7fa9ff027700 1 -- 172.21.15.88:0/3895535414 wait complete. 2023-12-09T02:33:09.965 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-09T02:33:10.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.081+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/1427277351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc40fcc00 msgr2=0x7f2bc40fd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:10.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.081+0000 7f2bcb8b5700 1 --2- 172.21.15.88:0/1427277351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc40fcc00 0x7f2bc40fd050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8004940 tx=0x7f2bb8009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:10.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.081+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/1427277351 shutdown_connections 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.081+0000 7f2bcb8b5700 1 --2- 172.21.15.88:0/1427277351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc40fcc00 0x7f2bc40fd050 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.081+0000 7f2bcb8b5700 1 --2- 172.21.15.88:0/1427277351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc40fb9f0 0x7f2bc40fbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.081+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/1427277351 >> 172.21.15.88:0/1427277351 conn(0x7f2bc40f7070 msgr2=0x7f2bc40f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.081+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/1427277351 shutdown_connections 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.081+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/1427277351 wait complete. 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.081+0000 7f2bcb8b5700 1 Processor -- start 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.081+0000 7f2bcb8b5700 1 -- start start 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bcb8b5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc40fb9f0 0x7f2bc410c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bcb8b5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc40fcc00 0x7f2bc410c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bcb8b5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc410cca0 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bcb8b5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc410ce10 con 0x7f2bc40fcc00 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bc9651700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc40fb9f0 0x7f2bc410c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bc9651700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc40fb9f0 0x7f2bc410c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35964/0 (socket says 172.21.15.88:35964) 2023-12-09T02:33:10.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bc9651700 1 -- 172.21.15.88:0/183725862 learned_addr learned my addr 172.21.15.88:0/183725862 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:10.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bc8e50700 1 --2- 172.21.15.88:0/183725862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc40fcc00 0x7f2bc410c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:10.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bc9651700 1 -- 172.21.15.88:0/183725862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc40fcc00 msgr2=0x7f2bc410c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:10.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bc9651700 1 --2- 172.21.15.88:0/183725862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc40fcc00 0x7f2bc410c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:10.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bc9651700 1 -- 172.21.15.88:0/183725862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb8005040 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bc9651700 1 --2- 172.21.15.88:0/183725862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc40fb9f0 0x7f2bc410c160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000fd10 tx=0x7f2bc0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:10.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bb5ffb700 1 -- 172.21.15.88:0/183725862 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bc000dcf0 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bb5ffb700 1 -- 172.21.15.88:0/183725862 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2bc000de50 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/183725862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc4064be0 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.082+0000 7f2bb5ffb700 1 -- 172.21.15.88:0/183725862 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bc00126a0 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.083+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/183725862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc40651a0 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.083+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/183725862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc4104390 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.084+0000 7f2bb5ffb700 1 -- 172.21.15.88:0/183725862 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2bc0007ab0 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.084+0000 7f2bb5ffb700 1 --2- 172.21.15.88:0/183725862 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2bb0068f60 0x7f2bb006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:10.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.084+0000 7f2bb5ffb700 1 -- 172.21.15.88:0/183725862 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2bc0089470 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.084+0000 7f2bc8e50700 1 --2- 172.21.15.88:0/183725862 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2bb0068f60 0x7f2bb006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:10.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.084+0000 7f2bc8e50700 1 --2- 172.21.15.88:0/183725862 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2bb0068f60 0x7f2bb006b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800b3b0 tx=0x7f2bb8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:10.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.088+0000 7f2bb5ffb700 1 -- 172.21.15.88:0/183725862 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2bc0059300 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:09 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/660959667' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:33:10.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:09 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3720393840' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-09T02:33:10.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:09 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3181593355' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-09T02:33:10.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:09 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3895535414' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-09T02:33:10.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.314+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/183725862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bc4106070 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.314+0000 7f2bb5ffb700 1 -- 172.21.15.88:0/183725862 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4691 (secure 0 0 0) 0x7f2bc0058e90 con 0x7f2bc40fb9f0 2023-12-09T02:33:10.316 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:33:10.316 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"cephfs.smithi088.zfojux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6829/1027941625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1027941625},{"type":"v1","addr":"172.21.15.88:6829","nonce":1027941625}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":14474,"name":"cephfs.smithi088.utskxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/130622055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":130622055},{"type":"v1","addr":"172.21.15.88:6827","nonce":130622055}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24259,"name":"cephfs.smithi161.posrbq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.161:6827/1570309399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1570309399},{"type":"v1","addr":"172.21.15.161:6827","nonce":1570309399}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-09T02:32:49.115700+0000","modified":"2023-12-09T02:33:01.255575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24251":{"gid":24251,"name":"cephfs.smithi161.dhvdif","rank":0,"incarnation":10,"state":"up:active","state_seq":5,"addr":"172.21.15.161:6825/3342684425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3342684425},{"type":"v1","addr":"172.21.15.161:6825","nonce":3342684425}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-09T02:33:10.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.316+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/183725862 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2bb0068f60 msgr2=0x7f2bb006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:10.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.316+0000 7f2bcb8b5700 1 --2- 172.21.15.88:0/183725862 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2bb0068f60 0x7f2bb006b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800b3b0 tx=0x7f2bb8009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:10.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.316+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/183725862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc40fb9f0 msgr2=0x7f2bc410c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:10.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.316+0000 7f2bcb8b5700 1 --2- 172.21.15.88:0/183725862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc40fb9f0 0x7f2bc410c160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000fd10 tx=0x7f2bc0004600 comp rx=0 tx=0).stop 2023-12-09T02:33:10.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.316+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/183725862 shutdown_connections 2023-12-09T02:33:10.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.316+0000 7f2bcb8b5700 1 --2- 172.21.15.88:0/183725862 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f2bb0068f60 0x7f2bb006b410 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800b3b0 tx=0x7f2bb8009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:10.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.316+0000 7f2bcb8b5700 1 --2- 172.21.15.88:0/183725862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc40fb9f0 0x7f2bc410c160 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:10.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.316+0000 7f2bcb8b5700 1 --2- 172.21.15.88:0/183725862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc40fcc00 0x7f2bc410c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:10.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.316+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/183725862 >> 172.21.15.88:0/183725862 conn(0x7f2bc40f7070 msgr2=0x7f2bc40f9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:10.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.316+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/183725862 shutdown_connections 2023-12-09T02:33:10.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:10.316+0000 7f2bcb8b5700 1 -- 172.21.15.88:0/183725862 wait complete. 2023-12-09T02:33:10.319 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:33:10.329 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2023-12-09T02:33:10.330 INFO:teuthology.run_tasks:Running task kclient... 2023-12-09T02:33:10.354 INFO:tasks.kclient:Mounting kernel clients... 2023-12-09T02:33:10.354 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-09T02:33:10.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:10.355 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-09T02:33:10.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:10.373 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-12-09T02:33:10.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:09 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/660959667' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:33:10.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:09 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3720393840' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-09T02:33:10.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:09 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3181593355' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-09T02:33:10.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:09 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3895535414' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-09T02:33:10.442 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2023-12-09T02:33:10.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-09T02:33:10.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:10.444 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-12-09T02:33:10.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:10.467 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-12-09T02:33:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2023-12-09T02:33:10.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-09T02:33:10.546 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-09T02:33:10.546 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-09T02:33:10.546 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-09T02:33:10.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph fs ls 2023-12-09T02:33:10.806 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:33:11.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:10 smithi088 ceph-mon[112028]: pgmap v143: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-09T02:33:11.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:10 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/183725862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-09T02:33:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:10 smithi161 ceph-mon[121170]: pgmap v143: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-09T02:33:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:10 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/183725862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-09T02:33:11.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.874+0000 7fe2eddad700 1 -- 172.21.15.88:0/47313778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e80fe600 msgr2=0x7fe2e8106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:11.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.874+0000 7fe2eddad700 1 --2- 172.21.15.88:0/47313778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e80fe600 0x7fe2e8106c40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc004940 tx=0x7fe2dc009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:11.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.874+0000 7fe2eddad700 1 -- 172.21.15.88:0/47313778 shutdown_connections 2023-12-09T02:33:11.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.874+0000 7fe2eddad700 1 --2- 172.21.15.88:0/47313778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e80fe600 0x7fe2e8106c40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:11.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.874+0000 7fe2eddad700 1 --2- 172.21.15.88:0/47313778 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e80fdc60 0x7fe2e80fe030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:11.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.874+0000 7fe2eddad700 1 -- 172.21.15.88:0/47313778 >> 172.21.15.88:0/47313778 conn(0x7fe2e80f7690 msgr2=0x7fe2e80f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:11.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.874+0000 7fe2eddad700 1 -- 172.21.15.88:0/47313778 shutdown_connections 2023-12-09T02:33:11.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.874+0000 7fe2eddad700 1 -- 172.21.15.88:0/47313778 wait complete. 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.875+0000 7fe2eddad700 1 Processor -- start 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.875+0000 7fe2eddad700 1 -- start start 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.875+0000 7fe2eddad700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e80fdc60 0x7fe2e8113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.875+0000 7fe2eddad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e80fe600 0x7fe2e8113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.875+0000 7fe2eddad700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8114260 con 0x7fe2e80fe600 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.875+0000 7fe2eddad700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e810d550 con 0x7fe2e80fdc60 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.875+0000 7fe2e6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e80fe600 0x7fe2e8113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.875+0000 7fe2e6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e80fe600 0x7fe2e8113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35984/0 (socket says 172.21.15.88:35984) 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.875+0000 7fe2e6ffd700 1 -- 172.21.15.88:0/1962587571 learned_addr learned my addr 172.21.15.88:0/1962587571 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.875+0000 7fe2e77fe700 1 --2- 172.21.15.88:0/1962587571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e80fdc60 0x7fe2e8113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.876+0000 7fe2e6ffd700 1 -- 172.21.15.88:0/1962587571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e80fdc60 msgr2=0x7fe2e8113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.876+0000 7fe2e6ffd700 1 --2- 172.21.15.88:0/1962587571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e80fdc60 0x7fe2e8113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:11.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.876+0000 7fe2e6ffd700 1 -- 172.21.15.88:0/1962587571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc005040 con 0x7fe2e80fe600 2023-12-09T02:33:11.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.876+0000 7fe2e6ffd700 1 --2- 172.21.15.88:0/1962587571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e80fe600 0x7fe2e8113c10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00b3b0 tx=0x7fe2dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:11.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.876+0000 7fe2cffff700 1 -- 172.21.15.88:0/1962587571 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2dc00e040 con 0x7fe2e80fe600 2023-12-09T02:33:11.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.876+0000 7fe2cffff700 1 -- 172.21.15.88:0/1962587571 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe2dc004290 con 0x7fe2e80fe600 2023-12-09T02:33:11.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.876+0000 7fe2eddad700 1 -- 172.21.15.88:0/1962587571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e810d7e0 con 0x7fe2e80fe600 2023-12-09T02:33:11.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.876+0000 7fe2cffff700 1 -- 172.21.15.88:0/1962587571 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2dc01c3f0 con 0x7fe2e80fe600 2023-12-09T02:33:11.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.876+0000 7fe2eddad700 1 -- 172.21.15.88:0/1962587571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e810dd20 con 0x7fe2e80fe600 2023-12-09T02:33:11.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.877+0000 7fe2eddad700 1 -- 172.21.15.88:0/1962587571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e8104250 con 0x7fe2e80fe600 2023-12-09T02:33:11.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.877+0000 7fe2cffff700 1 -- 172.21.15.88:0/1962587571 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe2dc013820 con 0x7fe2e80fe600 2023-12-09T02:33:11.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.878+0000 7fe2cffff700 1 --2- 172.21.15.88:0/1962587571 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2d0068f60 0x7fe2d006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:11.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.878+0000 7fe2cffff700 1 -- 172.21.15.88:0/1962587571 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe2dc088b60 con 0x7fe2e80fe600 2023-12-09T02:33:11.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.878+0000 7fe2e77fe700 1 --2- 172.21.15.88:0/1962587571 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2d0068f60 0x7fe2d006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:11.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.878+0000 7fe2e77fe700 1 --2- 172.21.15.88:0/1962587571 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2d0068f60 0x7fe2d006b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80041d0 tx=0x7fe2d80043c0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:11.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:11.882+0000 7fe2cffff700 1 -- 172.21.15.88:0/1962587571 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe2dc058b10 con 0x7fe2e80fe600 2023-12-09T02:33:12.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.109+0000 7fe2eddad700 1 -- 172.21.15.88:0/1962587571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe2e80fb290 con 0x7fe2e80fe600 2023-12-09T02:33:12.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.109+0000 7fe2cffff700 1 -- 172.21.15.88:0/1962587571 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7fe2dc0586a0 con 0x7fe2e80fe600 2023-12-09T02:33:12.111 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-09T02:33:12.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.111+0000 7fe2eddad700 1 -- 172.21.15.88:0/1962587571 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2d0068f60 msgr2=0x7fe2d006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.111+0000 7fe2eddad700 1 --2- 172.21.15.88:0/1962587571 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2d0068f60 0x7fe2d006b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80041d0 tx=0x7fe2d80043c0 comp rx=0 tx=0).stop 2023-12-09T02:33:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.111+0000 7fe2eddad700 1 -- 172.21.15.88:0/1962587571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e80fe600 msgr2=0x7fe2e8113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.111+0000 7fe2eddad700 1 --2- 172.21.15.88:0/1962587571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e80fe600 0x7fe2e8113c10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00b3b0 tx=0x7fe2dc009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.111+0000 7fe2eddad700 1 -- 172.21.15.88:0/1962587571 shutdown_connections 2023-12-09T02:33:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.111+0000 7fe2eddad700 1 --2- 172.21.15.88:0/1962587571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e80fdc60 0x7fe2e8113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.111+0000 7fe2eddad700 1 --2- 172.21.15.88:0/1962587571 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2d0068f60 0x7fe2d006b410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.111+0000 7fe2eddad700 1 --2- 172.21.15.88:0/1962587571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e80fe600 0x7fe2e8113c10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.111+0000 7fe2eddad700 1 -- 172.21.15.88:0/1962587571 >> 172.21.15.88:0/1962587571 conn(0x7fe2e80f7690 msgr2=0x7fe2e81013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.111+0000 7fe2eddad700 1 -- 172.21.15.88:0/1962587571 shutdown_connections 2023-12-09T02:33:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:12.111+0000 7fe2eddad700 1 -- 172.21.15.88:0/1962587571 wait complete. 2023-12-09T02:33:12.490 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-09T02:33:12.490 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-09T02:33:12.490 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-12-09T02:33:12.491 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-09T02:33:12.491 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-09T02:33:12.491 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-09T02:33:12.491 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-09T02:33:12.491 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-09T02:33:12.491 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-09T02:33:12.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:12.491 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-12-09T02:33:12.511 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-09T02:33:12.511 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-09T02:33:12.511 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-12-09T02:33:12.511 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-09T02:33:12.511 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-12-09T02:33:12.511 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-09T02:33:12.511 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 41579sec preferred_lft 41579sec 2023-12-09T02:33:12.512 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-12-09T02:33:12.513 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-09T02:33:12.513 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-09T02:33:12.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:12.513 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-09T02:33:12.513 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-09T02:33:12.513 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2023-12-09T02:33:12.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2023-12-09T02:33:12.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2023-12-09T02:33:12.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-09T02:33:12.514 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-09T02:33:12.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:12.671 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-09T02:33:12.699 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-12-09T02:33:12.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:12.700 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-12-09T02:33:12.770 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-12-09T02:33:12.770 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-09T02:33:12.770 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-09T02:33:12.770 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-09T02:33:12.770 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-09T02:33:12.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:12.771 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-09T02:33:12.771 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-09T02:33:12.771 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-09T02:33:12.771 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-09T02:33:12.771 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-09T02:33:12.771 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-09T02:33:13.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:13.063 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-09T02:33:13.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:13.082 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-12-09T02:33:13.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:13.140 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-09T02:33:13.140 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-09T02:33:13.140 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-09T02:33:13.140 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-09T02:33:13.140 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-09T02:33:13.219 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:12 smithi088 ceph-mon[112028]: pgmap v144: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-09T02:33:13.219 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:12 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1962587571' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-09T02:33:13.234 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-09T02:33:13.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:13.235 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-09T02:33:13.235 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-09T02:33:13.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-09T02:33:13.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-09T02:33:13.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-09T02:33:13.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-09T02:33:13.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-09T02:33:13.235 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-09T02:33:13.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:12 smithi161 ceph-mon[121170]: pgmap v144: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-09T02:33:13.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:12 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/1962587571' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-09T02:33:13.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:13.502 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-09T02:33:13.502 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-09T02:33:13.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-12-09T02:33:13.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2023-12-09T02:33:13.502 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-09T02:33:13.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-09T02:33:13.601 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-09T02:33:13.619 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-09T02:33:13.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-09T02:33:13.619 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-09T02:33:13.676 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-09T02:33:13.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:13.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-09T02:33:13.776 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-09T02:33:13.776 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-09T02:33:13.776 INFO:teuthology.orchestra.run.smithi088.stdout:invalid new device string format 2023-12-09T02:33:13.870 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-09T02:33:13.870 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-09T02:33:13.871 INFO:teuthology.orchestra.run.smithi088.stdout:invalid new device string format 2023-12-09T02:33:13.871 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.161:3300" 2023-12-09T02:33:13.871 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-09T02:33:13.889 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-09T02:33:13.889 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-09T02:33:13.889 INFO:teuthology.orchestra.run.smithi088.stdout:invalid new device string format 2023-12-09T02:33:13.889 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.161:3300" 2023-12-09T02:33:13.889 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-09T02:33:13.890 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:6789,172.21.15.161:6789" 2023-12-09T02:33:13.890 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.88:6789,172.21.15.161:6789:/ 2023-12-09T02:33:13.890 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=70b26980-963a-11ee-95a3-87774f69a715" will pass to kernel 2023-12-09T02:33:13.892 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-09T02:33:13.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:13.892 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-09T02:33:13.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:13.920 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-09T02:33:14.010 INFO:teuthology.orchestra.run.smithi088.stdout:client14516 2023-12-09T02:33:14.011 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:33:14.011 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-09T02:33:14.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:14.030 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-09T02:33:14.119 INFO:teuthology.orchestra.run.smithi088.stdout:client14516 2023-12-09T02:33:14.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:14.120 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-09T02:33:14.168 INFO:teuthology.orchestra.run.smithi088.stdout:client14516 2023-12-09T02:33:14.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:14.168 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/70b26980-963a-11ee-95a3-87774f69a715.client14516/status') 2023-12-09T02:33:14.224 INFO:teuthology.orchestra.run.smithi088.stdout:instance: client.14516 (3)192.168.0.1:0/1476335334 2023-12-09T02:33:14.224 INFO:teuthology.orchestra.run.smithi088.stdout:blocklisted: false 2023-12-09T02:33:14.224 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records in 2023-12-09T02:33:14.224 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records out 2023-12-09T02:33:14.224 INFO:teuthology.orchestra.run.smithi088.stderr:70 bytes copied, 1.9492e-05 s, 3.6 MB/s 2023-12-09T02:33:14.225 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-09T02:33:14.225 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-09T02:33:14.225 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-09T02:33:14.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 70b26980-963a-11ee-95a3-87774f69a715 -- ceph fs ls 2023-12-09T02:33:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:33:15.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:14 smithi088 ceph-mon[112028]: pgmap v145: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-09T02:33:15.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:14 smithi161 ceph-mon[121170]: pgmap v145: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-09T02:33:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.549+0000 7fac6e968700 1 -- 172.21.15.88:0/2246163648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac680fbb30 msgr2=0x7fac680fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.549+0000 7fac6e968700 1 --2- 172.21.15.88:0/2246163648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac680fbb30 0x7fac680fbfa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fac50004940 tx=0x7fac50009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.549+0000 7fac6e968700 1 -- 172.21.15.88:0/2246163648 shutdown_connections 2023-12-09T02:33:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.549+0000 7fac6e968700 1 --2- 172.21.15.88:0/2246163648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac680fbb30 0x7fac680fbfa0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.549+0000 7fac6e968700 1 --2- 172.21.15.88:0/2246163648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac68101af0 0x7fac68101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.549+0000 7fac6e968700 1 -- 172.21.15.88:0/2246163648 >> 172.21.15.88:0/2246163648 conn(0x7fac680f7690 msgr2=0x7fac680f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.549+0000 7fac6e968700 1 -- 172.21.15.88:0/2246163648 shutdown_connections 2023-12-09T02:33:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.549+0000 7fac6e968700 1 -- 172.21.15.88:0/2246163648 wait complete. 2023-12-09T02:33:15.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.550+0000 7fac6e968700 1 Processor -- start 2023-12-09T02:33:15.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.550+0000 7fac6e968700 1 -- start start 2023-12-09T02:33:15.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.550+0000 7fac6e968700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac680fbb30 0x7fac68112570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:15.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.550+0000 7fac6e968700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac68101af0 0x7fac68112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:15.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.550+0000 7fac6e968700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac68113100 con 0x7fac68101af0 2023-12-09T02:33:15.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.550+0000 7fac6e968700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6810c430 con 0x7fac680fbb30 2023-12-09T02:33:15.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.550+0000 7fac677fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac68101af0 0x7fac68112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:15.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.550+0000 7fac677fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac68101af0 0x7fac68112ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35988/0 (socket says 172.21.15.88:35988) 2023-12-09T02:33:15.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.550+0000 7fac677fe700 1 -- 172.21.15.88:0/3517906054 learned_addr learned my addr 172.21.15.88:0/3517906054 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:15.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.551+0000 7fac67fff700 1 --2- 172.21.15.88:0/3517906054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac680fbb30 0x7fac68112570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:15.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.551+0000 7fac677fe700 1 -- 172.21.15.88:0/3517906054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac680fbb30 msgr2=0x7fac68112570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:15.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.551+0000 7fac677fe700 1 --2- 172.21.15.88:0/3517906054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac680fbb30 0x7fac68112570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:15.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.551+0000 7fac677fe700 1 -- 172.21.15.88:0/3517906054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac50005040 con 0x7fac68101af0 2023-12-09T02:33:15.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.551+0000 7fac677fe700 1 --2- 172.21.15.88:0/3517906054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac68101af0 0x7fac68112ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fac50009fd0 tx=0x7fac50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:15.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.551+0000 7fac64ff9700 1 -- 172.21.15.88:0/3517906054 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac5000e040 con 0x7fac68101af0 2023-12-09T02:33:15.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.551+0000 7fac6e968700 1 -- 172.21.15.88:0/3517906054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6810c6b0 con 0x7fac68101af0 2023-12-09T02:33:15.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.551+0000 7fac64ff9700 1 -- 172.21.15.88:0/3517906054 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fac50013420 con 0x7fac68101af0 2023-12-09T02:33:15.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.551+0000 7fac64ff9700 1 -- 172.21.15.88:0/3517906054 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac5001c630 con 0x7fac68101af0 2023-12-09T02:33:15.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.551+0000 7fac6e968700 1 -- 172.21.15.88:0/3517906054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6810cbf0 con 0x7fac68101af0 2023-12-09T02:33:15.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.552+0000 7fac6e968700 1 -- 172.21.15.88:0/3517906054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac68103fa0 con 0x7fac68101af0 2023-12-09T02:33:15.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.553+0000 7fac64ff9700 1 -- 172.21.15.88:0/3517906054 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fac50013590 con 0x7fac68101af0 2023-12-09T02:33:15.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.553+0000 7fac64ff9700 1 --2- 172.21.15.88:0/3517906054 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fac54068f70 0x7fac5406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:15.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.553+0000 7fac64ff9700 1 -- 172.21.15.88:0/3517906054 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fac50087f70 con 0x7fac68101af0 2023-12-09T02:33:15.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.553+0000 7fac67fff700 1 --2- 172.21.15.88:0/3517906054 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fac54068f70 0x7fac5406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:15.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.554+0000 7fac67fff700 1 --2- 172.21.15.88:0/3517906054 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fac54068f70 0x7fac5406b420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fac58004f60 tx=0x7fac5800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:15.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.558+0000 7fac64ff9700 1 -- 172.21.15.88:0/3517906054 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fac500b9a00 con 0x7fac68101af0 2023-12-09T02:33:15.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.783+0000 7fac6e968700 1 -- 172.21.15.88:0/3517906054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fac6804bc10 con 0x7fac68101af0 2023-12-09T02:33:15.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.783+0000 7fac64ff9700 1 -- 172.21.15.88:0/3517906054 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7fac50057f20 con 0x7fac68101af0 2023-12-09T02:33:15.785 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-09T02:33:15.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.785+0000 7fac6e968700 1 -- 172.21.15.88:0/3517906054 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fac54068f70 msgr2=0x7fac5406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:15.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.785+0000 7fac6e968700 1 --2- 172.21.15.88:0/3517906054 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fac54068f70 0x7fac5406b420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fac58004f60 tx=0x7fac5800b040 comp rx=0 tx=0).stop 2023-12-09T02:33:15.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.785+0000 7fac6e968700 1 -- 172.21.15.88:0/3517906054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac68101af0 msgr2=0x7fac68112ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:15.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.785+0000 7fac6e968700 1 --2- 172.21.15.88:0/3517906054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac68101af0 0x7fac68112ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fac50009fd0 tx=0x7fac50009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:15.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.785+0000 7fac6e968700 1 -- 172.21.15.88:0/3517906054 shutdown_connections 2023-12-09T02:33:15.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.785+0000 7fac6e968700 1 --2- 172.21.15.88:0/3517906054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac680fbb30 0x7fac68112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:15.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.785+0000 7fac6e968700 1 --2- 172.21.15.88:0/3517906054 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fac54068f70 0x7fac5406b420 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:15.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.785+0000 7fac6e968700 1 --2- 172.21.15.88:0/3517906054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac68101af0 0x7fac68112ab0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:15.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.785+0000 7fac6e968700 1 -- 172.21.15.88:0/3517906054 >> 172.21.15.88:0/3517906054 conn(0x7fac680f7690 msgr2=0x7fac680f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:15.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.785+0000 7fac6e968700 1 -- 172.21.15.88:0/3517906054 shutdown_connections 2023-12-09T02:33:15.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:15.785+0000 7fac6e968700 1 -- 172.21.15.88:0/3517906054 wait complete. 2023-12-09T02:33:16.171 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:15 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3517906054' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-09T02:33:16.191 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-09T02:33:16.191 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-09T02:33:16.191 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-12-09T02:33:16.191 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-09T02:33:16.191 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-09T02:33:16.191 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-09T02:33:16.191 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-09T02:33:16.191 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-09T02:33:16.192 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-09T02:33:16.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:16.192 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-12-09T02:33:16.215 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-09T02:33:16.215 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-09T02:33:16.215 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-12-09T02:33:16.215 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-12-09T02:33:16.215 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-12-09T02:33:16.215 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 41819sec preferred_lft 41819sec 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-12-09T02:33:16.216 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-12-09T02:33:16.217 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-09T02:33:16.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:16.217 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-12-09T02:33:16.217 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-12-09T02:33:16.217 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2023-12-09T02:33:16.217 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2023-12-09T02:33:16.217 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2023-12-09T02:33:16.217 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-09T02:33:16.217 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-12-09T02:33:16.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:15 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3517906054' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-09T02:33:16.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:16.390 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-09T02:33:16.418 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-12-09T02:33:16.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:16.420 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-12-09T02:33:16.497 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-12-09T02:33:16.497 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-09T02:33:16.497 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-09T02:33:16.497 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-09T02:33:16.497 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-09T02:33:16.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:16.498 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-12-09T02:33:16.498 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-12-09T02:33:16.498 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-09T02:33:16.498 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-09T02:33:16.498 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-09T02:33:16.498 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-12-09T02:33:16.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:16.804 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-12-09T02:33:16.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:16.822 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2023-12-09T02:33:16.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:16.880 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-12-09T02:33:16.880 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-12-09T02:33:16.880 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-09T02:33:16.880 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-09T02:33:16.880 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-12-09T02:33:16.975 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-09T02:33:16.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:16.976 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-12-09T02:33:16.976 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-12-09T02:33:16.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-09T02:33:16.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-09T02:33:16.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-09T02:33:16.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-09T02:33:16.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-09T02:33:16.976 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-12-09T02:33:17.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:17.203 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-12-09T02:33:17.203 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-12-09T02:33:17.204 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-12-09T02:33:17.204 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2023-12-09T02:33:17.204 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-12-09T02:33:17.243 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:16 smithi161 ceph-mon[121170]: pgmap v146: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2023-12-09T02:33:17.243 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:33:17.301 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-09T02:33:17.301 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-09T02:33:17.360 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-09T02:33:17.360 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-09T02:33:17.360 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-09T02:33:17.417 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-09T02:33:17.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:17.418 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-09T02:33:17.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:16 smithi088 ceph-mon[112028]: pgmap v146: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2023-12-09T02:33:17.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:33:17.543 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-09T02:33:17.543 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-09T02:33:17.544 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-12-09T02:33:17.629 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-09T02:33:17.629 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-09T02:33:17.629 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-12-09T02:33:17.629 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.161:3300" 2023-12-09T02:33:17.630 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-09T02:33:17.647 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-09T02:33:17.647 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-09T02:33:17.647 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-12-09T02:33:17.647 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.161:3300" 2023-12-09T02:33:17.647 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-09T02:33:17.647 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.88:6789,172.21.15.161:6789" 2023-12-09T02:33:17.647 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.88:6789,172.21.15.161:6789:/ 2023-12-09T02:33:17.647 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=70b26980-963a-11ee-95a3-87774f69a715" will pass to kernel 2023-12-09T02:33:17.649 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-09T02:33:17.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:17.650 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-09T02:33:17.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:17.677 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-09T02:33:17.751 INFO:teuthology.orchestra.run.smithi161.stdout:client14522 2023-12-09T02:33:17.751 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:33:17.751 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-09T02:33:17.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:17.811 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-09T02:33:17.884 INFO:teuthology.orchestra.run.smithi161.stdout:client14522 2023-12-09T02:33:17.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:17.884 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-09T02:33:17.958 INFO:teuthology.orchestra.run.smithi161.stdout:client14522 2023-12-09T02:33:17.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:33:17.959 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/70b26980-963a-11ee-95a3-87774f69a715.client14522/status') 2023-12-09T02:33:18.040 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.14522 (3)172.21.15.161:0/449359838 2023-12-09T02:33:18.040 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2023-12-09T02:33:18.041 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2023-12-09T02:33:18.041 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2023-12-09T02:33:18.041 INFO:teuthology.orchestra.run.smithi161.stderr:71 bytes copied, 2.1799e-05 s, 3.3 MB/s 2023-12-09T02:33:18.042 INFO:teuthology.run_tasks:Running task print... 2023-12-09T02:33:18.053 INFO:teuthology.task.print:**** done client 2023-12-09T02:33:18.054 INFO:teuthology.run_tasks:Running task parallel... 2023-12-09T02:33:18.083 INFO:teuthology.task.parallel:starting parallel... 2023-12-09T02:33:18.083 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-09T02:33:18.084 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-09T02:33:18.084 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:33:18.085 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2023-12-09T02:33:18.085 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-09T02:33:18.085 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-09T02:33:18.088 INFO:tasks.workunit:Pulling workunits from ref 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:33:18.089 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-09T02:33:18.089 INFO:tasks.workunit:timeout=3h 2023-12-09T02:33:18.089 INFO:tasks.workunit:cleanup=True 2023-12-09T02:33:18.089 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-09T02:33:18.114 INFO:teuthology.orchestra.run.smithi088.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-09T02:33:18.115 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-09T02:33:18.115 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 99h/153d Inode: 1 Links: 2 2023-12-09T02:33:18.115 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-09T02:33:18.115 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-09T02:33:18.115 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-09T02:33:18.115 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-12-09 02:32:52.143209532 +0000 2023-12-09T02:33:18.115 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-12-09 02:33:13.916043935 +0000 2023-12-09T02:33:18.115 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-12-09 02:32:52.143209532 +0000 2023-12-09T02:33:18.116 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-09T02:33:18.116 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-09T02:33:18.191 DEBUG:teuthology.orchestra.run.smithi161:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-09T02:33:18.209 INFO:teuthology.orchestra.run.smithi161.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-09T02:33:18.209 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-09T02:33:18.209 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 78h/120d Inode: 1 Links: 3 2023-12-09T02:33:18.210 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-09T02:33:18.210 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-09T02:33:18.210 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-09T02:33:18.210 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-12-09 02:33:18.181957639 +0000 2023-12-09T02:33:18.210 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-12-09 02:33:18.181957639 +0000 2023-12-09T02:33:18.210 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-12-09 02:32:52.143209532 +0000 2023-12-09T02:33:18.210 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-09T02:33:18.210 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-09T02:33:18.281 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:33:18.281 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:33:18.299 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-09T02:33:18.339 INFO:tasks.workunit.client.1.smithi161.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-09T02:33:18.373 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:33:19.202 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:18 smithi088 ceph-mon[112028]: pgmap v147: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-09T02:33:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.376+0000 7f033aec3700 1 -- 172.21.15.88:0/3018569678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03340faed0 msgr2=0x7f03340fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.376+0000 7f033aec3700 1 --2- 172.21.15.88:0/3018569678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03340faed0 0x7f03340fb2e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0328004940 tx=0x7f0328009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.376+0000 7f033aec3700 1 -- 172.21.15.88:0/3018569678 shutdown_connections 2023-12-09T02:33:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.376+0000 7f033aec3700 1 --2- 172.21.15.88:0/3018569678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03340fdf60 0x7f03340fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.376+0000 7f033aec3700 1 --2- 172.21.15.88:0/3018569678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03340faed0 0x7f03340fb2e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.376+0000 7f033aec3700 1 -- 172.21.15.88:0/3018569678 >> 172.21.15.88:0/3018569678 conn(0x7f03340f6950 msgr2=0x7f03340f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.376+0000 7f033aec3700 1 -- 172.21.15.88:0/3018569678 shutdown_connections 2023-12-09T02:33:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.376+0000 7f033aec3700 1 -- 172.21.15.88:0/3018569678 wait complete. 2023-12-09T02:33:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.376+0000 7f033aec3700 1 Processor -- start 2023-12-09T02:33:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.376+0000 7f033aec3700 1 -- start start 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f033aec3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03340faed0 0x7f03340fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f033aec3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03340fdf60 0x7f03340fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f033aec3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340fc500 con 0x7f03340fdf60 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f033aec3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340fc670 con 0x7f03340faed0 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f0333fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03340fdf60 0x7f03340fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f0333fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03340fdf60 0x7f03340fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38878/0 (socket says 172.21.15.88:38878) 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f0333fff700 1 -- 172.21.15.88:0/3917247364 learned_addr learned my addr 172.21.15.88:0/3917247364 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f0338c5f700 1 --2- 172.21.15.88:0/3917247364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03340faed0 0x7f03340fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f0333fff700 1 -- 172.21.15.88:0/3917247364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03340faed0 msgr2=0x7f03340fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f0333fff700 1 --2- 172.21.15.88:0/3917247364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03340faed0 0x7f03340fd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f0333fff700 1 -- 172.21.15.88:0/3917247364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0328005040 con 0x7f03340fdf60 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f0333fff700 1 --2- 172.21.15.88:0/3917247364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03340fdf60 0x7f03340fbe70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f032000b790 tx=0x7f0320009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.377+0000 7f03317fa700 1 -- 172.21.15.88:0/3917247364 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f032000f770 con 0x7f03340fdf60 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.378+0000 7f03317fa700 1 -- 172.21.15.88:0/3917247364 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f032000fd80 con 0x7f03340fdf60 2023-12-09T02:33:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.378+0000 7f03317fa700 1 -- 172.21.15.88:0/3917247364 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f032000d310 con 0x7f03340fdf60 2023-12-09T02:33:19.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.378+0000 7f033aec3700 1 -- 172.21.15.88:0/3917247364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03340fc950 con 0x7f03340fdf60 2023-12-09T02:33:19.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.378+0000 7f033aec3700 1 -- 172.21.15.88:0/3917247364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03340fccd0 con 0x7f03340fdf60 2023-12-09T02:33:19.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.378+0000 7f033aec3700 1 -- 172.21.15.88:0/3917247364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0334107670 con 0x7f03340fdf60 2023-12-09T02:33:19.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.379+0000 7f03317fa700 1 -- 172.21.15.88:0/3917247364 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0320010420 con 0x7f03340fdf60 2023-12-09T02:33:19.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.380+0000 7f03317fa700 1 --2- 172.21.15.88:0/3917247364 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0324068f60 0x7f032406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:19.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.380+0000 7f03317fa700 1 -- 172.21.15.88:0/3917247364 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f03200874c0 con 0x7f03340fdf60 2023-12-09T02:33:19.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.380+0000 7f0338c5f700 1 --2- 172.21.15.88:0/3917247364 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0324068f60 0x7f032406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:19.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.380+0000 7f0338c5f700 1 --2- 172.21.15.88:0/3917247364 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0324068f60 0x7f032406b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f032800b3b0 tx=0x7f0328009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:19.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.384+0000 7f03317fa700 1 -- 172.21.15.88:0/3917247364 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0320057470 con 0x7f03340fdf60 2023-12-09T02:33:19.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:18 smithi161 ceph-mon[121170]: pgmap v147: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-09T02:33:19.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.574+0000 7f033aec3700 1 -- 172.21.15.88:0/3917247364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f03341057c0 con 0x7f03340fdf60 2023-12-09T02:33:19.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:19.575+0000 7f03317fa700 1 -- 172.21.15.88:0/3917247364 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f03341057c0 con 0x7f03340fdf60 2023-12-09T02:33:19.578 INFO:teuthology.orchestra.run.smithi088.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2023-12-09T02:33:19.965 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-09T02:33:19.966 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:33:19.966 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-09T02:33:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:33:21.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:20 smithi088 ceph-mon[112028]: pgmap v148: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-09T02:33:21.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/629413351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc080fde00 msgr2=0x7fdc080fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:21.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 --2- 172.21.15.88:0/629413351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc080fde00 0x7fdc080fe250 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8004940 tx=0x7fdbf8009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:21.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/629413351 shutdown_connections 2023-12-09T02:33:21.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 --2- 172.21.15.88:0/629413351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc080fde00 0x7fdc080fe250 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 --2- 172.21.15.88:0/629413351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc080fcbf0 0x7fdc080fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/629413351 >> 172.21.15.88:0/629413351 conn(0x7fdc080f82d0 msgr2=0x7fdc080fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/629413351 shutdown_connections 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/629413351 wait complete. 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 Processor -- start 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 -- start start 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc080fcbf0 0x7fdc0810d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc080fde00 0x7fdc0810da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0810e080 con 0x7fdc080fde00 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc0ce7a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0810e920 con 0x7fdc080fcbf0 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc05d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc080fde00 0x7fdc0810da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc05d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc080fde00 0x7fdc0810da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38904/0 (socket says 172.21.15.88:38904) 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.335+0000 7fdc05d9b700 1 -- 172.21.15.88:0/2786866906 learned_addr learned my addr 172.21.15.88:0/2786866906 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.336+0000 7fdc0659c700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc080fcbf0 0x7fdc0810d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.336+0000 7fdc05d9b700 1 -- 172.21.15.88:0/2786866906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc080fcbf0 msgr2=0x7fdc0810d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:21.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.336+0000 7fdc05d9b700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc080fcbf0 0x7fdc0810d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:21.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.336+0000 7fdc05d9b700 1 -- 172.21.15.88:0/2786866906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf8005040 con 0x7fdc080fde00 2023-12-09T02:33:21.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.336+0000 7fdc0659c700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc080fcbf0 0x7fdc0810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:33:21.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.336+0000 7fdc05d9b700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc080fde00 0x7fdc0810da80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800b3b0 tx=0x7fdbf8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:21.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.336+0000 7fdbf6ffd700 1 -- 172.21.15.88:0/2786866906 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbf800e040 con 0x7fdc080fde00 2023-12-09T02:33:21.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.336+0000 7fdbf6ffd700 1 -- 172.21.15.88:0/2786866906 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdbf8009b10 con 0x7fdc080fde00 2023-12-09T02:33:21.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.336+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/2786866906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0810eba0 con 0x7fdc080fde00 2023-12-09T02:33:21.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.336+0000 7fdbf6ffd700 1 -- 172.21.15.88:0/2786866906 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbf801c630 con 0x7fdc080fde00 2023-12-09T02:33:21.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.336+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/2786866906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0810f0e0 con 0x7fdc080fde00 2023-12-09T02:33:21.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.337+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/2786866906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0804bb80 con 0x7fdc080fde00 2023-12-09T02:33:21.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.337+0000 7fdbf6ffd700 1 -- 172.21.15.88:0/2786866906 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdbf8013960 con 0x7fdc080fde00 2023-12-09T02:33:21.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.338+0000 7fdbf6ffd700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdbf0068f60 0x7fdbf006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:21.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.338+0000 7fdbf6ffd700 1 -- 172.21.15.88:0/2786866906 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdbf8088200 con 0x7fdc080fde00 2023-12-09T02:33:21.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.338+0000 7fdc0659c700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdbf0068f60 0x7fdbf006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:21.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.338+0000 7fdc0659c700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdbf0068f60 0x7fdbf006b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdc080fdc60 tx=0x7fdbfc009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:21.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.342+0000 7fdbf6ffd700 1 -- 172.21.15.88:0/2786866906 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdbf8058110 con 0x7fdc080fde00 2023-12-09T02:33:21.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:20 smithi161 ceph-mon[121170]: pgmap v148: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-09T02:33:21.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.534+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/2786866906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fdc08105590 con 0x7fdc080fde00 2023-12-09T02:33:21.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.534+0000 7fdbf6ffd700 1 -- 172.21.15.88:0/2786866906 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fdbf8057ca0 con 0x7fdc080fde00 2023-12-09T02:33:21.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.536+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/2786866906 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdbf0068f60 msgr2=0x7fdbf006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:21.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.536+0000 7fdc0ce7a700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdbf0068f60 0x7fdbf006b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdc080fdc60 tx=0x7fdbfc009040 comp rx=0 tx=0).stop 2023-12-09T02:33:21.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.536+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/2786866906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc080fde00 msgr2=0x7fdc0810da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:21.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.536+0000 7fdc0ce7a700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc080fde00 0x7fdc0810da80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800b3b0 tx=0x7fdbf8009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:21.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.536+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/2786866906 shutdown_connections 2023-12-09T02:33:21.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.536+0000 7fdc0ce7a700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc080fcbf0 0x7fdc0810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:21.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.536+0000 7fdc0ce7a700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdbf0068f60 0x7fdbf006b410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:21.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.536+0000 7fdc0ce7a700 1 --2- 172.21.15.88:0/2786866906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc080fde00 0x7fdc0810da80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:21.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.536+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/2786866906 >> 172.21.15.88:0/2786866906 conn(0x7fdc080f82d0 msgr2=0x7fdc08101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:21.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.536+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/2786866906 shutdown_connections 2023-12-09T02:33:21.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:21.536+0000 7fdc0ce7a700 1 -- 172.21.15.88:0/2786866906 wait complete. 2023-12-09T02:33:21.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-09T02:33:22.191 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:33:23.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.193+0000 7f6cbde76700 1 -- 172.21.15.88:0/3263075476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb8100050 msgr2=0x7f6cb8102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:23.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.193+0000 7f6cbde76700 1 --2- 172.21.15.88:0/3263075476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb8100050 0x7f6cb8102430 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8004940 tx=0x7f6ca8009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:23.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.193+0000 7f6cbde76700 1 -- 172.21.15.88:0/3263075476 shutdown_connections 2023-12-09T02:33:23.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.193+0000 7f6cbde76700 1 --2- 172.21.15.88:0/3263075476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb8100050 0x7f6cb8102430 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:23.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.193+0000 7f6cbde76700 1 --2- 172.21.15.88:0/3263075476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cb80fd730 0x7f6cb80ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:23.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.193+0000 7f6cbde76700 1 -- 172.21.15.88:0/3263075476 >> 172.21.15.88:0/3263075476 conn(0x7f6cb80f7190 msgr2=0x7f6cb80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:23.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.193+0000 7f6cbde76700 1 -- 172.21.15.88:0/3263075476 shutdown_connections 2023-12-09T02:33:23.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.193+0000 7f6cbde76700 1 -- 172.21.15.88:0/3263075476 wait complete. 2023-12-09T02:33:23.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.193+0000 7f6cbde76700 1 Processor -- start 2023-12-09T02:33:23.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cbde76700 1 -- start start 2023-12-09T02:33:23.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cbde76700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cb80fd730 0x7f6cb80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:23.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cbde76700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb8100050 0x7f6cb80fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:23.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cbde76700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb80fbc40 con 0x7f6cb8100050 2023-12-09T02:33:23.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cbde76700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb80fbdb0 con 0x7f6cb80fd730 2023-12-09T02:33:23.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cb6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb8100050 0x7f6cb80fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:23.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cb6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb8100050 0x7f6cb80fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38918/0 (socket says 172.21.15.88:38918) 2023-12-09T02:33:23.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cb6ffd700 1 -- 172.21.15.88:0/1838373739 learned_addr learned my addr 172.21.15.88:0/1838373739 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:23.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cb6ffd700 1 -- 172.21.15.88:0/1838373739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cb80fd730 msgr2=0x7f6cb80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:23.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cb6ffd700 1 --2- 172.21.15.88:0/1838373739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cb80fd730 0x7f6cb80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:23.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cb6ffd700 1 -- 172.21.15.88:0/1838373739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8005040 con 0x7f6cb8100050 2023-12-09T02:33:23.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cb6ffd700 1 --2- 172.21.15.88:0/1838373739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb8100050 0x7f6cb80fb640 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009360 tx=0x7f6ca8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:23.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6caffff700 1 -- 172.21.15.88:0/1838373739 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ca800e040 con 0x7f6cb8100050 2023-12-09T02:33:23.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6caffff700 1 -- 172.21.15.88:0/1838373739 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ca800bcd0 con 0x7f6cb8100050 2023-12-09T02:33:23.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6cbde76700 1 -- 172.21.15.88:0/1838373739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb80fc030 con 0x7f6cb8100050 2023-12-09T02:33:23.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.194+0000 7f6caffff700 1 -- 172.21.15.88:0/1838373739 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ca801c630 con 0x7f6cb8100050 2023-12-09T02:33:23.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.195+0000 7f6cbde76700 1 -- 172.21.15.88:0/1838373739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb8115560 con 0x7f6cb8100050 2023-12-09T02:33:23.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.195+0000 7f6cbde76700 1 -- 172.21.15.88:0/1838373739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb81075c0 con 0x7f6cb8100050 2023-12-09T02:33:23.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.196+0000 7f6caffff700 1 -- 172.21.15.88:0/1838373739 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6ca8013960 con 0x7f6cb8100050 2023-12-09T02:33:23.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.196+0000 7f6caffff700 1 --2- 172.21.15.88:0/1838373739 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6ca4068f60 0x7f6ca406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:23.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.196+0000 7f6caffff700 1 -- 172.21.15.88:0/1838373739 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6ca80882b0 con 0x7f6cb8100050 2023-12-09T02:33:23.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.196+0000 7f6cb77fe700 1 --2- 172.21.15.88:0/1838373739 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6ca4068f60 0x7f6ca406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:23.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.197+0000 7f6cb77fe700 1 --2- 172.21.15.88:0/1838373739 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6ca4068f60 0x7f6ca406b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6cb80fcf50 tx=0x7f6ca0007d40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:23.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.200+0000 7f6caffff700 1 -- 172.21.15.88:0/1838373739 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6ca80581c0 con 0x7f6cb8100050 2023-12-09T02:33:23.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.391+0000 7f6cbde76700 1 -- 172.21.15.88:0/1838373739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f6cb802b240 con 0x7f6cb8100050 2023-12-09T02:33:23.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.391+0000 7f6caffff700 1 -- 172.21.15.88:0/1838373739 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f6ca8057d50 con 0x7f6cb8100050 2023-12-09T02:33:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.393+0000 7f6cbde76700 1 -- 172.21.15.88:0/1838373739 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6ca4068f60 msgr2=0x7f6ca406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.393+0000 7f6cbde76700 1 --2- 172.21.15.88:0/1838373739 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6ca4068f60 0x7f6ca406b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6cb80fcf50 tx=0x7f6ca0007d40 comp rx=0 tx=0).stop 2023-12-09T02:33:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.393+0000 7f6cbde76700 1 -- 172.21.15.88:0/1838373739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb8100050 msgr2=0x7f6cb80fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.393+0000 7f6cbde76700 1 --2- 172.21.15.88:0/1838373739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb8100050 0x7f6cb80fb640 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009360 tx=0x7f6ca8009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.393+0000 7f6cbde76700 1 -- 172.21.15.88:0/1838373739 shutdown_connections 2023-12-09T02:33:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.393+0000 7f6cbde76700 1 --2- 172.21.15.88:0/1838373739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cb80fd730 0x7f6cb80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:23.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.393+0000 7f6cbde76700 1 --2- 172.21.15.88:0/1838373739 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6ca4068f60 0x7f6ca406b410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:23.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.393+0000 7f6cbde76700 1 --2- 172.21.15.88:0/1838373739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb8100050 0x7f6cb80fb640 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:23.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.393+0000 7f6cbde76700 1 -- 172.21.15.88:0/1838373739 >> 172.21.15.88:0/1838373739 conn(0x7f6cb80f7190 msgr2=0x7f6cb80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:23.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.394+0000 7f6cbde76700 1 -- 172.21.15.88:0/1838373739 shutdown_connections 2023-12-09T02:33:23.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:23.394+0000 7f6cbde76700 1 -- 172.21.15.88:0/1838373739 wait complete. 2023-12-09T02:33:23.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:22 smithi161 ceph-mon[121170]: pgmap v149: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-09T02:33:23.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:22 smithi088 ceph-mon[112028]: pgmap v149: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-09T02:33:23.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-09T02:33:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:33:25.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.106+0000 7fb6c6084700 1 -- 172.21.15.88:0/158225620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c00fcbf0 msgr2=0x7fb6c00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.106+0000 7fb6c6084700 1 --2- 172.21.15.88:0/158225620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c00fcbf0 0x7fb6c00fd000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0004940 tx=0x7fb6b0009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.106+0000 7fb6c6084700 1 -- 172.21.15.88:0/158225620 shutdown_connections 2023-12-09T02:33:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.106+0000 7fb6c6084700 1 --2- 172.21.15.88:0/158225620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c00fde00 0x7fb6c00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.106+0000 7fb6c6084700 1 --2- 172.21.15.88:0/158225620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c00fcbf0 0x7fb6c00fd000 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.106+0000 7fb6c6084700 1 -- 172.21.15.88:0/158225620 >> 172.21.15.88:0/158225620 conn(0x7fb6c00f82d0 msgr2=0x7fb6c00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:25.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.106+0000 7fb6c6084700 1 -- 172.21.15.88:0/158225620 shutdown_connections 2023-12-09T02:33:25.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.106+0000 7fb6c6084700 1 -- 172.21.15.88:0/158225620 wait complete. 2023-12-09T02:33:25.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.106+0000 7fb6c6084700 1 Processor -- start 2023-12-09T02:33:25.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6c6084700 1 -- start start 2023-12-09T02:33:25.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6c6084700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c00fcbf0 0x7fb6c010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:25.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6c6084700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c00fde00 0x7fb6c010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:25.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6c6084700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c010e010 con 0x7fb6c00fde00 2023-12-09T02:33:25.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6c6084700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c010e8b0 con 0x7fb6c00fcbf0 2023-12-09T02:33:25.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6beffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c00fde00 0x7fb6c010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:25.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6beffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c00fde00 0x7fb6c010da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38942/0 (socket says 172.21.15.88:38942) 2023-12-09T02:33:25.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6beffd700 1 -- 172.21.15.88:0/1673235498 learned_addr learned my addr 172.21.15.88:0/1673235498 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:25.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6bf7fe700 1 --2- 172.21.15.88:0/1673235498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c00fcbf0 0x7fb6c010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:25.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6beffd700 1 -- 172.21.15.88:0/1673235498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c00fcbf0 msgr2=0x7fb6c010d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:25.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6beffd700 1 --2- 172.21.15.88:0/1673235498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c00fcbf0 0x7fb6c010d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:25.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6beffd700 1 -- 172.21.15.88:0/1673235498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4005040 con 0x7fb6c00fde00 2023-12-09T02:33:25.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.107+0000 7fb6beffd700 1 --2- 172.21.15.88:0/1673235498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c00fde00 0x7fb6c010da10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40096d0 tx=0x7fb6b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:25.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.108+0000 7fb6a7fff700 1 -- 172.21.15.88:0/1673235498 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b400e840 con 0x7fb6c00fde00 2023-12-09T02:33:25.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.108+0000 7fb6a7fff700 1 -- 172.21.15.88:0/1673235498 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb6b400f040 con 0x7fb6c00fde00 2023-12-09T02:33:25.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.108+0000 7fb6c6084700 1 -- 172.21.15.88:0/1673235498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b0005040 con 0x7fb6c00fde00 2023-12-09T02:33:25.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.108+0000 7fb6a7fff700 1 -- 172.21.15.88:0/1673235498 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b4013d30 con 0x7fb6c00fde00 2023-12-09T02:33:25.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.108+0000 7fb6c6084700 1 -- 172.21.15.88:0/1673235498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c010eee0 con 0x7fb6c00fde00 2023-12-09T02:33:25.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.109+0000 7fb6c6084700 1 -- 172.21.15.88:0/1673235498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c004bb80 con 0x7fb6c00fde00 2023-12-09T02:33:25.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.109+0000 7fb6a7fff700 1 -- 172.21.15.88:0/1673235498 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb6b400e9a0 con 0x7fb6c00fde00 2023-12-09T02:33:25.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.110+0000 7fb6a7fff700 1 --2- 172.21.15.88:0/1673235498 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb6a8068f60 0x7fb6a806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:25.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.110+0000 7fb6a7fff700 1 -- 172.21.15.88:0/1673235498 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb6b4086ad0 con 0x7fb6c00fde00 2023-12-09T02:33:25.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.110+0000 7fb6bf7fe700 1 --2- 172.21.15.88:0/1673235498 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb6a8068f60 0x7fb6a806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:25.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.110+0000 7fb6bf7fe700 1 --2- 172.21.15.88:0/1673235498 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb6a8068f60 0x7fb6a806b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0013680 tx=0x7fb6b0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:25.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.115+0000 7fb6a7fff700 1 -- 172.21.15.88:0/1673235498 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb6b40569e0 con 0x7fb6c00fde00 2023-12-09T02:33:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:24 smithi088 ceph-mon[112028]: pgmap v150: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-09T02:33:25.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.325+0000 7fb6c6084700 1 -- 172.21.15.88:0/1673235498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fb6c0105590 con 0x7fb6c00fde00 2023-12-09T02:33:25.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.325+0000 7fb6a7fff700 1 -- 172.21.15.88:0/1673235498 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb6b4056570 con 0x7fb6c00fde00 2023-12-09T02:33:25.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.327+0000 7fb6c6084700 1 -- 172.21.15.88:0/1673235498 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb6a8068f60 msgr2=0x7fb6a806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:25.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.327+0000 7fb6c6084700 1 --2- 172.21.15.88:0/1673235498 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb6a8068f60 0x7fb6a806b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0013680 tx=0x7fb6b0009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:25.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.327+0000 7fb6c6084700 1 -- 172.21.15.88:0/1673235498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c00fde00 msgr2=0x7fb6c010da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:25.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.327+0000 7fb6c6084700 1 --2- 172.21.15.88:0/1673235498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c00fde00 0x7fb6c010da10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40096d0 tx=0x7fb6b4009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:25.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.327+0000 7fb6c6084700 1 -- 172.21.15.88:0/1673235498 shutdown_connections 2023-12-09T02:33:25.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.327+0000 7fb6c6084700 1 --2- 172.21.15.88:0/1673235498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c00fcbf0 0x7fb6c010d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:25.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.327+0000 7fb6c6084700 1 --2- 172.21.15.88:0/1673235498 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fb6a8068f60 0x7fb6a806b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:25.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.327+0000 7fb6c6084700 1 --2- 172.21.15.88:0/1673235498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c00fde00 0x7fb6c010da10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:25.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.327+0000 7fb6c6084700 1 -- 172.21.15.88:0/1673235498 >> 172.21.15.88:0/1673235498 conn(0x7fb6c00f82d0 msgr2=0x7fb6c0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:25.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.327+0000 7fb6c6084700 1 -- 172.21.15.88:0/1673235498 shutdown_connections 2023-12-09T02:33:25.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:25.327+0000 7fb6c6084700 1 -- 172.21.15.88:0/1673235498 wait complete. 2023-12-09T02:33:25.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:24 smithi161 ceph-mon[121170]: pgmap v150: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-09T02:33:25.787 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-09T02:33:26.065 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:33:27.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/344979197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee40fbe70 msgr2=0x7f8ee40fc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 --2- 172.21.15.88:0/344979197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee40fbe70 0x7f8ee40fc2e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8004940 tx=0x7f8ed8009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/344979197 shutdown_connections 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 --2- 172.21.15.88:0/344979197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee40fbe70 0x7f8ee40fc2e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 --2- 172.21.15.88:0/344979197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40fb520 0x7f8ee40fb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/344979197 >> 172.21.15.88:0/344979197 conn(0x7f8ee40f7190 msgr2=0x7f8ee40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/344979197 shutdown_connections 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/344979197 wait complete. 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 Processor -- start 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 -- start start 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40fb520 0x7f8ee410f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee40fbe70 0x7f8ee410fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:27.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.094+0000 7f8ee9ec6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee4110360 con 0x7f8ee40fbe70 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ee9ec6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee4110c00 con 0x7f8ee40fb520 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ee2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee40fbe70 0x7f8ee410fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ee2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee40fbe70 0x7f8ee410fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50874/0 (socket says 172.21.15.88:50874) 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ee2ffd700 1 -- 172.21.15.88:0/3267916564 learned_addr learned my addr 172.21.15.88:0/3267916564 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ee37fe700 1 --2- 172.21.15.88:0/3267916564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40fb520 0x7f8ee410f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ee2ffd700 1 -- 172.21.15.88:0/3267916564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40fb520 msgr2=0x7f8ee410f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ee2ffd700 1 --2- 172.21.15.88:0/3267916564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40fb520 0x7f8ee410f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ee2ffd700 1 -- 172.21.15.88:0/3267916564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8005040 con 0x7f8ee40fbe70 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ee2ffd700 1 --2- 172.21.15.88:0/3267916564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee40fbe70 0x7f8ee410fd60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8000c00 tx=0x7f8ed8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ecbfff700 1 -- 172.21.15.88:0/3267916564 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed8021070 con 0x7f8ee40fbe70 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ecbfff700 1 -- 172.21.15.88:0/3267916564 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ed801c400 con 0x7f8ee40fbe70 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/3267916564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee4110e80 con 0x7f8ee40fbe70 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ecbfff700 1 -- 172.21.15.88:0/3267916564 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed800e070 con 0x7f8ee40fbe70 2023-12-09T02:33:27.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.095+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/3267916564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee4111360 con 0x7f8ee40fbe70 2023-12-09T02:33:27.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.096+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/3267916564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee4109700 con 0x7f8ee40fbe70 2023-12-09T02:33:27.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.097+0000 7f8ecbfff700 1 -- 172.21.15.88:0/3267916564 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8ed801c9c0 con 0x7f8ee40fbe70 2023-12-09T02:33:27.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.097+0000 7f8ecbfff700 1 --2- 172.21.15.88:0/3267916564 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8ecc068f60 0x7f8ecc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:27.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.097+0000 7f8ecbfff700 1 -- 172.21.15.88:0/3267916564 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8ed8088040 con 0x7f8ee40fbe70 2023-12-09T02:33:27.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.097+0000 7f8ee37fe700 1 --2- 172.21.15.88:0/3267916564 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8ecc068f60 0x7f8ecc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:27.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.098+0000 7f8ee37fe700 1 --2- 172.21.15.88:0/3267916564 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8ecc068f60 0x7f8ecc06b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009b80 tx=0x7f8ed400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:27.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.102+0000 7f8ecbfff700 1 -- 172.21.15.88:0/3267916564 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8ed8057f50 con 0x7f8ee40fbe70 2023-12-09T02:33:27.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:26 smithi088 ceph-mon[112028]: pgmap v151: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-09T02:33:27.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.307+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/3267916564 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ee4111580 con 0x7f8ecc068f60 2023-12-09T02:33:27.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.312+0000 7f8ecbfff700 1 -- 172.21.15.88:0/3267916564 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f8ee4111580 con 0x7f8ecc068f60 2023-12-09T02:33:27.314 INFO:teuthology.orchestra.run.smithi088.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:33:27.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.314+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/3267916564 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8ecc068f60 msgr2=0x7f8ecc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.314+0000 7f8ee9ec6700 1 --2- 172.21.15.88:0/3267916564 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8ecc068f60 0x7f8ecc06b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009b80 tx=0x7f8ed400b040 comp rx=0 tx=0).stop 2023-12-09T02:33:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.314+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/3267916564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee40fbe70 msgr2=0x7f8ee410fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.314+0000 7f8ee9ec6700 1 --2- 172.21.15.88:0/3267916564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee40fbe70 0x7f8ee410fd60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8000c00 tx=0x7f8ed8009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.314+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/3267916564 shutdown_connections 2023-12-09T02:33:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.314+0000 7f8ee9ec6700 1 --2- 172.21.15.88:0/3267916564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40fb520 0x7f8ee410f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.314+0000 7f8ee9ec6700 1 --2- 172.21.15.88:0/3267916564 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f8ecc068f60 0x7f8ecc06b410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.314+0000 7f8ee9ec6700 1 --2- 172.21.15.88:0/3267916564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee40fbe70 0x7f8ee410fd60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.314+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/3267916564 >> 172.21.15.88:0/3267916564 conn(0x7f8ee40f7190 msgr2=0x7f8ee40f95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.314+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/3267916564 shutdown_connections 2023-12-09T02:33:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:27.314+0000 7f8ee9ec6700 1 -- 172.21.15.88:0/3267916564 wait complete. 2023-12-09T02:33:27.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:26 smithi161 ceph-mon[121170]: pgmap v151: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-09T02:33:27.729 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-09T02:33:27.730 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:33:27.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-09T02:33:28.031 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:33:28.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:28 smithi088 ceph-mon[112028]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:33:28.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:28 smithi088 ceph-mon[112028]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:33:28.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:28 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:28.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:28 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:33:28.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:28 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:33:28.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:28 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:33:28.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:28 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:28.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:28 smithi088 ceph-mon[112028]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:33:28.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:28 smithi088 ceph-mon[112028]: pgmap v152: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-09T02:33:28.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:28 smithi161 ceph-mon[121170]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:33:28.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:28 smithi161 ceph-mon[121170]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:33:28.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:28 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:28.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:28 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:33:28.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:28 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:33:28.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:28 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:33:28.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:28 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:33:28.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:28 smithi161 ceph-mon[121170]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-09T02:33:28.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:28 smithi161 ceph-mon[121170]: pgmap v152: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-09T02:33:29.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.101+0000 7fe2bbd51700 1 -- 172.21.15.88:0/2453095230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2b40fcd00 msgr2=0x7fe2b40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:29.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.101+0000 7fe2bbd51700 1 --2- 172.21.15.88:0/2453095230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2b40fcd00 0x7fe2b40fd150 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4004940 tx=0x7fe2a4009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:29.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.101+0000 7fe2bbd51700 1 -- 172.21.15.88:0/2453095230 shutdown_connections 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.101+0000 7fe2bbd51700 1 --2- 172.21.15.88:0/2453095230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2b40fcd00 0x7fe2b40fd150 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.101+0000 7fe2bbd51700 1 --2- 172.21.15.88:0/2453095230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2b40fbaf0 0x7fe2b40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.101+0000 7fe2bbd51700 1 -- 172.21.15.88:0/2453095230 >> 172.21.15.88:0/2453095230 conn(0x7fe2b40f7190 msgr2=0x7fe2b40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.102+0000 7fe2bbd51700 1 -- 172.21.15.88:0/2453095230 shutdown_connections 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.102+0000 7fe2bbd51700 1 -- 172.21.15.88:0/2453095230 wait complete. 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.102+0000 7fe2bbd51700 1 Processor -- start 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.102+0000 7fe2bbd51700 1 -- start start 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.102+0000 7fe2bbd51700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2b40fbaf0 0x7fe2b40ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.102+0000 7fe2bbd51700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2b40fcd00 0x7fe2b40fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.102+0000 7fe2bbd51700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b41111b0 con 0x7fe2b40fcd00 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.102+0000 7fe2bbd51700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4111320 con 0x7fe2b40fbaf0 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2b92ec700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2b40fcd00 0x7fe2b40fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2b92ec700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2b40fcd00 0x7fe2b40fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50888/0 (socket says 172.21.15.88:50888) 2023-12-09T02:33:29.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2b92ec700 1 -- 172.21.15.88:0/226811229 learned_addr learned my addr 172.21.15.88:0/226811229 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:29.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2b9aed700 1 --2- 172.21.15.88:0/226811229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2b40fbaf0 0x7fe2b40ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:29.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2b92ec700 1 -- 172.21.15.88:0/226811229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2b40fbaf0 msgr2=0x7fe2b40ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:29.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2b92ec700 1 --2- 172.21.15.88:0/226811229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2b40fbaf0 0x7fe2b40ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2b92ec700 1 -- 172.21.15.88:0/226811229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4005040 con 0x7fe2b40fcd00 2023-12-09T02:33:29.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2b92ec700 1 --2- 172.21.15.88:0/226811229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2b40fcd00 0x7fe2b40fe040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4000c00 tx=0x7fe2a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:29.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2aa7fc700 1 -- 172.21.15.88:0/226811229 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2a4021070 con 0x7fe2b40fcd00 2023-12-09T02:33:29.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2bbd51700 1 -- 172.21.15.88:0/226811229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b40fe640 con 0x7fe2b40fcd00 2023-12-09T02:33:29.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2aa7fc700 1 -- 172.21.15.88:0/226811229 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe2a401c400 con 0x7fe2b40fcd00 2023-12-09T02:33:29.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.103+0000 7fe2aa7fc700 1 -- 172.21.15.88:0/226811229 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2a400e070 con 0x7fe2b40fcd00 2023-12-09T02:33:29.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.104+0000 7fe2bbd51700 1 -- 172.21.15.88:0/226811229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b40feb20 con 0x7fe2b40fcd00 2023-12-09T02:33:29.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.105+0000 7fe2bbd51700 1 -- 172.21.15.88:0/226811229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b404bb80 con 0x7fe2b40fcd00 2023-12-09T02:33:29.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.105+0000 7fe2aa7fc700 1 -- 172.21.15.88:0/226811229 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe2a4013a30 con 0x7fe2b40fcd00 2023-12-09T02:33:29.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.105+0000 7fe2aa7fc700 1 --2- 172.21.15.88:0/226811229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2a0068f60 0x7fe2a006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:29.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.106+0000 7fe2aa7fc700 1 -- 172.21.15.88:0/226811229 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe2a408ea80 con 0x7fe2b40fcd00 2023-12-09T02:33:29.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.106+0000 7fe2b9aed700 1 --2- 172.21.15.88:0/226811229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2a0068f60 0x7fe2a006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:29.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.106+0000 7fe2b9aed700 1 --2- 172.21.15.88:0/226811229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2a0068f60 0x7fe2a006b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40ff950 tx=0x7fe2b000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.112+0000 7fe2aa7fc700 1 -- 172.21.15.88:0/226811229 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe2a40576b0 con 0x7fe2b40fcd00 2023-12-09T02:33:29.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.349+0000 7fe2bbd51700 1 -- 172.21.15.88:0/226811229 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2b4065a80 con 0x7fe2a0068f60 2023-12-09T02:33:29.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.350+0000 7fe2aa7fc700 1 -- 172.21.15.88:0/226811229 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fe2b4065a80 con 0x7fe2a0068f60 2023-12-09T02:33:29.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.353+0000 7fe2bbd51700 1 -- 172.21.15.88:0/226811229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2a0068f60 msgr2=0x7fe2a006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:29.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.353+0000 7fe2bbd51700 1 --2- 172.21.15.88:0/226811229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2a0068f60 0x7fe2a006b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40ff950 tx=0x7fe2b000b040 comp rx=0 tx=0).stop 2023-12-09T02:33:29.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.353+0000 7fe2bbd51700 1 -- 172.21.15.88:0/226811229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2b40fcd00 msgr2=0x7fe2b40fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:29.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.354+0000 7fe2bbd51700 1 --2- 172.21.15.88:0/226811229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2b40fcd00 0x7fe2b40fe040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4000c00 tx=0x7fe2a4009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:29.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.354+0000 7fe2bbd51700 1 -- 172.21.15.88:0/226811229 shutdown_connections 2023-12-09T02:33:29.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.354+0000 7fe2bbd51700 1 --2- 172.21.15.88:0/226811229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2b40fbaf0 0x7fe2b40ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.354+0000 7fe2bbd51700 1 --2- 172.21.15.88:0/226811229 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe2a0068f60 0x7fe2a006b410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.354+0000 7fe2bbd51700 1 --2- 172.21.15.88:0/226811229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2b40fcd00 0x7fe2b40fe040 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.354+0000 7fe2bbd51700 1 -- 172.21.15.88:0/226811229 >> 172.21.15.88:0/226811229 conn(0x7fe2b40f7190 msgr2=0x7fe2b4065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:29.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.354+0000 7fe2bbd51700 1 -- 172.21.15.88:0/226811229 shutdown_connections 2023-12-09T02:33:29.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.354+0000 7fe2bbd51700 1 -- 172.21.15.88:0/226811229 wait complete. 2023-12-09T02:33:29.367 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:33:29.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.467+0000 7fabdde74700 1 -- 172.21.15.88:0/2728515165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabd80fcd00 msgr2=0x7fabd80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:29.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.467+0000 7fabdde74700 1 --2- 172.21.15.88:0/2728515165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabd80fcd00 0x7fabd80fd150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fabcc004940 tx=0x7fabcc009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:29.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.467+0000 7fabdde74700 1 -- 172.21.15.88:0/2728515165 shutdown_connections 2023-12-09T02:33:29.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.467+0000 7fabdde74700 1 --2- 172.21.15.88:0/2728515165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabd80fcd00 0x7fabd80fd150 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.467+0000 7fabdde74700 1 --2- 172.21.15.88:0/2728515165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabd80fbaf0 0x7fabd80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.467+0000 7fabdde74700 1 -- 172.21.15.88:0/2728515165 >> 172.21.15.88:0/2728515165 conn(0x7fabd80f7190 msgr2=0x7fabd80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:29.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.468+0000 7fabdde74700 1 -- 172.21.15.88:0/2728515165 shutdown_connections 2023-12-09T02:33:29.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.468+0000 7fabdde74700 1 -- 172.21.15.88:0/2728515165 wait complete. 2023-12-09T02:33:29.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.468+0000 7fabdde74700 1 Processor -- start 2023-12-09T02:33:29.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabdde74700 1 -- start start 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabdde74700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabd80fbaf0 0x7fabd80ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabdde74700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabd80fcd00 0x7fabd80fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabdde74700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd81111b0 con 0x7fabd80fcd00 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabdde74700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8111320 con 0x7fabd80fbaf0 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabd77fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabd80fbaf0 0x7fabd80ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabd6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabd80fcd00 0x7fabd80fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabd6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabd80fcd00 0x7fabd80fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50908/0 (socket says 172.21.15.88:50908) 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabd6ffd700 1 -- 172.21.15.88:0/112100164 learned_addr learned my addr 172.21.15.88:0/112100164 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabd6ffd700 1 -- 172.21.15.88:0/112100164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabd80fbaf0 msgr2=0x7fabd80ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabd6ffd700 1 --2- 172.21.15.88:0/112100164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabd80fbaf0 0x7fabd80ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabd6ffd700 1 -- 172.21.15.88:0/112100164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc005040 con 0x7fabd80fcd00 2023-12-09T02:33:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.469+0000 7fabd6ffd700 1 --2- 172.21.15.88:0/112100164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabd80fcd00 0x7fabd80fe040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fabcc000c00 tx=0x7fabcc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:29.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.470+0000 7fabbffff700 1 -- 172.21.15.88:0/112100164 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabcc021070 con 0x7fabd80fcd00 2023-12-09T02:33:29.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.470+0000 7fabdde74700 1 -- 172.21.15.88:0/112100164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd81115a0 con 0x7fabd80fcd00 2023-12-09T02:33:29.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.470+0000 7fabdde74700 1 -- 172.21.15.88:0/112100164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd8111a80 con 0x7fabd80fcd00 2023-12-09T02:33:29.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.470+0000 7fabbffff700 1 -- 172.21.15.88:0/112100164 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fabcc01c400 con 0x7fabd80fcd00 2023-12-09T02:33:29.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.470+0000 7fabbffff700 1 -- 172.21.15.88:0/112100164 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabcc00e070 con 0x7fabd80fcd00 2023-12-09T02:33:29.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.471+0000 7fabdde74700 1 -- 172.21.15.88:0/112100164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd804bb80 con 0x7fabd80fcd00 2023-12-09T02:33:29.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.471+0000 7fabbffff700 1 -- 172.21.15.88:0/112100164 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fabcc01c9c0 con 0x7fabd80fcd00 2023-12-09T02:33:29.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.472+0000 7fabbffff700 1 --2- 172.21.15.88:0/112100164 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fabc0068f60 0x7fabc006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:29.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.472+0000 7fabbffff700 1 -- 172.21.15.88:0/112100164 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fabcc088020 con 0x7fabd80fcd00 2023-12-09T02:33:29.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.472+0000 7fabd77fe700 1 --2- 172.21.15.88:0/112100164 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fabc0068f60 0x7fabc006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:29.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.472+0000 7fabd77fe700 1 --2- 172.21.15.88:0/112100164 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fabc0068f60 0x7fabc006b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fabd80ff950 tx=0x7fabc800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:29.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.479+0000 7fabbffff700 1 -- 172.21.15.88:0/112100164 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fabcc057f30 con 0x7fabd80fcd00 2023-12-09T02:33:29.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.707+0000 7fabdde74700 1 -- 172.21.15.88:0/112100164 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fabd8065a80 con 0x7fabc0068f60 2023-12-09T02:33:29.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.709+0000 7fabbffff700 1 -- 172.21.15.88:0/112100164 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fabd8065a80 con 0x7fabc0068f60 2023-12-09T02:33:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.711+0000 7fabdde74700 1 -- 172.21.15.88:0/112100164 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fabc0068f60 msgr2=0x7fabc006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.711+0000 7fabdde74700 1 --2- 172.21.15.88:0/112100164 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fabc0068f60 0x7fabc006b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fabd80ff950 tx=0x7fabc800b040 comp rx=0 tx=0).stop 2023-12-09T02:33:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.711+0000 7fabdde74700 1 -- 172.21.15.88:0/112100164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabd80fcd00 msgr2=0x7fabd80fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.711+0000 7fabdde74700 1 --2- 172.21.15.88:0/112100164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabd80fcd00 0x7fabd80fe040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fabcc000c00 tx=0x7fabcc009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.711+0000 7fabdde74700 1 -- 172.21.15.88:0/112100164 shutdown_connections 2023-12-09T02:33:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.711+0000 7fabdde74700 1 --2- 172.21.15.88:0/112100164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabd80fbaf0 0x7fabd80ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.711+0000 7fabdde74700 1 --2- 172.21.15.88:0/112100164 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fabc0068f60 0x7fabc006b410 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.711+0000 7fabdde74700 1 --2- 172.21.15.88:0/112100164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabd80fcd00 0x7fabd80fe040 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.711+0000 7fabdde74700 1 -- 172.21.15.88:0/112100164 >> 172.21.15.88:0/112100164 conn(0x7fabd80f7190 msgr2=0x7fabd8065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.712+0000 7fabdde74700 1 -- 172.21.15.88:0/112100164 shutdown_connections 2023-12-09T02:33:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.712+0000 7fabdde74700 1 -- 172.21.15.88:0/112100164 wait complete. 2023-12-09T02:33:29.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.821+0000 7f332343a700 1 -- 172.21.15.88:0/3242280844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331c066030 msgr2=0x7f331c0ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:29.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.821+0000 7f332343a700 1 --2- 172.21.15.88:0/3242280844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331c066030 0x7f331c0ff800 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3318004940 tx=0x7f3318009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:29.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.821+0000 7f332343a700 1 -- 172.21.15.88:0/3242280844 shutdown_connections 2023-12-09T02:33:29.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.821+0000 7f332343a700 1 --2- 172.21.15.88:0/3242280844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f331c0ffdd0 0x7f331c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.821+0000 7f332343a700 1 --2- 172.21.15.88:0/3242280844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331c066030 0x7f331c0ff800 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.821+0000 7f332343a700 1 -- 172.21.15.88:0/3242280844 >> 172.21.15.88:0/3242280844 conn(0x7f331c0f7190 msgr2=0x7f331c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:29.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.821+0000 7f332343a700 1 -- 172.21.15.88:0/3242280844 shutdown_connections 2023-12-09T02:33:29.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.821+0000 7f332343a700 1 -- 172.21.15.88:0/3242280844 wait complete. 2023-12-09T02:33:29.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.821+0000 7f332343a700 1 Processor -- start 2023-12-09T02:33:29.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.821+0000 7f332343a700 1 -- start start 2023-12-09T02:33:29.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.822+0000 7f332343a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f331c066030 0x7f331c10d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:29.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.822+0000 7f332343a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331c0ffdd0 0x7f331c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:29.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.822+0000 7f332343a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c10e000 con 0x7f331c0ffdd0 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.822+0000 7f332343a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c10e8a0 con 0x7f331c066030 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.822+0000 7f33211d6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f331c066030 0x7f331c10d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.822+0000 7f33211d6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f331c066030 0x7f331c10d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.88:37722/0 (socket says 172.21.15.88:37722) 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.822+0000 7f33211d6700 1 -- 172.21.15.88:0/3147664980 learned_addr learned my addr 172.21.15.88:0/3147664980 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.822+0000 7f33211d6700 1 -- 172.21.15.88:0/3147664980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331c0ffdd0 msgr2=0x7f331c10da00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.822+0000 7f33211d6700 1 --2- 172.21.15.88:0/3147664980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331c0ffdd0 0x7f331c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.822+0000 7f33211d6700 1 -- 172.21.15.88:0/3147664980 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3318005040 con 0x7f331c066030 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.822+0000 7f33211d6700 1 --2- 172.21.15.88:0/3147664980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f331c066030 0x7f331c10d4c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3318000c00 tx=0x7f3318009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.823+0000 7f3311ffb700 1 -- 172.21.15.88:0/3147664980 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3318021070 con 0x7f331c066030 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.823+0000 7f332343a700 1 -- 172.21.15.88:0/3147664980 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331c10eb20 con 0x7f331c066030 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.823+0000 7f3311ffb700 1 -- 172.21.15.88:0/3147664980 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f331801c400 con 0x7f331c066030 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.823+0000 7f3311ffb700 1 -- 172.21.15.88:0/3147664980 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f331800e070 con 0x7f331c066030 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.823+0000 7f332343a700 1 -- 172.21.15.88:0/3147664980 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331c10f000 con 0x7f331c066030 2023-12-09T02:33:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.824+0000 7f332343a700 1 -- 172.21.15.88:0/3147664980 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331c04bb80 con 0x7f331c066030 2023-12-09T02:33:29.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.825+0000 7f3311ffb700 1 -- 172.21.15.88:0/3147664980 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f331800b760 con 0x7f331c066030 2023-12-09T02:33:29.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.825+0000 7f3311ffb700 1 --2- 172.21.15.88:0/3147664980 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3308068f60 0x7f330806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:29.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.825+0000 7f3311ffb700 1 -- 172.21.15.88:0/3147664980 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f33180880e0 con 0x7f331c066030 2023-12-09T02:33:29.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.825+0000 7f33209d5700 1 --2- 172.21.15.88:0/3147664980 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3308068f60 0x7f330806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:29.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.826+0000 7f33209d5700 1 --2- 172.21.15.88:0/3147664980 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3308068f60 0x7f330806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f331c065d70 tx=0x7f330c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:29.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:29.834+0000 7f3311ffb700 1 -- 172.21.15.88:0/3147664980 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3318057ff0 con 0x7f331c066030 2023-12-09T02:33:30.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.051+0000 7f332343a700 1 -- 172.21.15.88:0/3147664980 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f331c10f470 con 0x7f3308068f60 2023-12-09T02:33:30.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.060+0000 7f3311ffb700 1 -- 172.21.15.88:0/3147664980 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f331c10f470 con 0x7f3308068f60 2023-12-09T02:33:30.063 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:33:30.063 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (3m) 25s ago 4m 28.4M - 0.25.0 c8568f914cd2 578f197f8707 2023-12-09T02:33:30.063 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (4m) 25s ago 4m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 9098f424ee11 2023-12-09T02:33:30.063 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (3m) 27s ago 3m 7482k - 17.2.7-119-ge2143d99 f761b6e42225 15c5154f5f2e 2023-12-09T02:33:30.063 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (3m) 25s ago 4m 89.6M - 9.4.7 954c08fa6188 04aa719e29b6 2023-12-09T02:33:30.063 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (39s) 25s ago 38s 11.9M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (35s) 25s ago 34s 13.3M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (37s) 27s ago 36s 15.9M - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (33s) 27s ago 33s 13.2M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:9283 running (5m) 25s ago 5m 496M - 17.2.7-119-ge2143d99 f761b6e42225 0fffc89bc055 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283 running (3m) 27s ago 3m 442M - 17.2.7-119-ge2143d99 f761b6e42225 785e62ae75e6 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (5m) 25s ago 5m 74.6M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d21a10406297 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (3m) 27s ago 3m 60.0M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d6b9d9265450 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (4m) 25s ago 4m 14.8M - 1.5.0 0da6a335fe13 0a3f7cc72867 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (3m) 27s ago 3m 17.3M - 1.5.0 0da6a335fe13 43bf179905a8 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (3m) 25s ago 3m 54.8M 4299M 17.2.7-119-ge2143d99 f761b6e42225 fdd606881a64 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (2m) 25s ago 2m 58.0M 4299M 17.2.7-119-ge2143d99 f761b6e42225 354d4a4d3430 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (2m) 25s ago 2m 57.5M 4299M 17.2.7-119-ge2143d99 f761b6e42225 0b0abbb070ec 2023-12-09T02:33:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (2m) 27s ago 2m 55.7M 5323M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:33:30.065 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (113s) 27s ago 113s 48.8M 5323M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:33:30.065 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (94s) 27s ago 94s 51.5M 5323M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:33:30.065 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (3m) 25s ago 4m 48.7M - 2.43.0 a07b618ecd1d 5e8226460d4a 2023-12-09T02:33:30.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.063+0000 7f332343a700 1 -- 172.21.15.88:0/3147664980 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3308068f60 msgr2=0x7f330806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.063+0000 7f332343a700 1 --2- 172.21.15.88:0/3147664980 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3308068f60 0x7f330806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f331c065d70 tx=0x7f330c00b040 comp rx=0 tx=0).stop 2023-12-09T02:33:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.063+0000 7f332343a700 1 -- 172.21.15.88:0/3147664980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f331c066030 msgr2=0x7f331c10d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.063+0000 7f332343a700 1 --2- 172.21.15.88:0/3147664980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f331c066030 0x7f331c10d4c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3318000c00 tx=0x7f3318009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.063+0000 7f332343a700 1 -- 172.21.15.88:0/3147664980 shutdown_connections 2023-12-09T02:33:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.063+0000 7f332343a700 1 --2- 172.21.15.88:0/3147664980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f331c066030 0x7f331c10d4c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.063+0000 7f332343a700 1 --2- 172.21.15.88:0/3147664980 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f3308068f60 0x7f330806b410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.063+0000 7f332343a700 1 --2- 172.21.15.88:0/3147664980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331c0ffdd0 0x7f331c10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.063+0000 7f332343a700 1 -- 172.21.15.88:0/3147664980 >> 172.21.15.88:0/3147664980 conn(0x7f331c0f7190 msgr2=0x7f331c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.063+0000 7f332343a700 1 -- 172.21.15.88:0/3147664980 shutdown_connections 2023-12-09T02:33:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.063+0000 7f332343a700 1 -- 172.21.15.88:0/3147664980 wait complete. 2023-12-09T02:33:30.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.172+0000 7f980fef9700 1 -- 172.21.15.88:0/1153859305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98080fff70 msgr2=0x7f98081003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.172+0000 7f980fef9700 1 --2- 172.21.15.88:0/1153859305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98080fff70 0x7f98081003e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f97f8004940 tx=0x7f97f8009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:30.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.172+0000 7f980fef9700 1 -- 172.21.15.88:0/1153859305 shutdown_connections 2023-12-09T02:33:30.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.172+0000 7f980fef9700 1 --2- 172.21.15.88:0/1153859305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98080fff70 0x7f98081003e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.172+0000 7f980fef9700 1 --2- 172.21.15.88:0/1153859305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98080fee00 0x7f98080ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.172+0000 7f980fef9700 1 -- 172.21.15.88:0/1153859305 >> 172.21.15.88:0/1153859305 conn(0x7f98080fa5d0 msgr2=0x7f98080fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:30.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.172+0000 7f980fef9700 1 -- 172.21.15.88:0/1153859305 shutdown_connections 2023-12-09T02:33:30.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.172+0000 7f980fef9700 1 -- 172.21.15.88:0/1153859305 wait complete. 2023-12-09T02:33:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.172+0000 7f980fef9700 1 Processor -- start 2023-12-09T02:33:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.172+0000 7f980fef9700 1 -- start start 2023-12-09T02:33:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980fef9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98080fee00 0x7f9808072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980fef9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98080fff70 0x7f9808072970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980fef9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9808072fc0 con 0x7f98080fff70 2023-12-09T02:33:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980fef9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9808073860 con 0x7f98080fee00 2023-12-09T02:33:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980d494700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98080fff70 0x7f9808072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980dc95700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98080fee00 0x7f9808072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980d494700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98080fff70 0x7f9808072970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50942/0 (socket says 172.21.15.88:50942) 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980dc95700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98080fee00 0x7f9808072430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.88:37742/0 (socket says 172.21.15.88:37742) 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980d494700 1 -- 172.21.15.88:0/2982060612 learned_addr learned my addr 172.21.15.88:0/2982060612 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980d494700 1 -- 172.21.15.88:0/2982060612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98080fee00 msgr2=0x7f9808072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980d494700 1 --2- 172.21.15.88:0/2982060612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98080fee00 0x7f9808072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980d494700 1 -- 172.21.15.88:0/2982060612 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8005040 con 0x7f98080fff70 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.173+0000 7f980d494700 1 --2- 172.21.15.88:0/2982060612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98080fff70 0x7f9808072970 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009fd0 tx=0x7f97f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.174+0000 7f97fe7fc700 1 -- 172.21.15.88:0/2982060612 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f8021070 con 0x7f98080fff70 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.174+0000 7f980fef9700 1 -- 172.21.15.88:0/2982060612 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9808073a60 con 0x7f98080fff70 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.174+0000 7f97fe7fc700 1 -- 172.21.15.88:0/2982060612 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97f801c400 con 0x7f98080fff70 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.174+0000 7f97fe7fc700 1 -- 172.21.15.88:0/2982060612 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f800e070 con 0x7f98080fff70 2023-12-09T02:33:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.174+0000 7f980fef9700 1 -- 172.21.15.88:0/2982060612 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9808073f70 con 0x7f98080fff70 2023-12-09T02:33:30.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.175+0000 7f980fef9700 1 -- 172.21.15.88:0/2982060612 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980804bb80 con 0x7f98080fff70 2023-12-09T02:33:30.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.175+0000 7f97fe7fc700 1 -- 172.21.15.88:0/2982060612 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f97f801c570 con 0x7f98080fff70 2023-12-09T02:33:30.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.176+0000 7f97fe7fc700 1 --2- 172.21.15.88:0/2982060612 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f97f4068f60 0x7f97f406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:30.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.176+0000 7f97fe7fc700 1 -- 172.21.15.88:0/2982060612 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f97f8088000 con 0x7f98080fff70 2023-12-09T02:33:30.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.176+0000 7f980dc95700 1 --2- 172.21.15.88:0/2982060612 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f97f4068f60 0x7f97f406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:30.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.176+0000 7f980dc95700 1 --2- 172.21.15.88:0/2982060612 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f97f4068f60 0x7f97f406b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f98080721c0 tx=0x7f980400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:30.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.181+0000 7f97fe7fc700 1 -- 172.21.15.88:0/2982060612 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f97f8054480 con 0x7f98080fff70 2023-12-09T02:33:30.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.484+0000 7f980fef9700 1 -- 172.21.15.88:0/2982060612 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f98081077b0 con 0x7f98080fff70 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.484+0000 7f97fe7fc700 1 -- 172.21.15.88:0/2982060612 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f97f8004490 con 0x7f98080fff70 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:33:30.487 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:33:30.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:33:30.488 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:33:30.488 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 14 2023-12-09T02:33:30.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:33:30.488 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:33:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.486+0000 7f980fef9700 1 -- 172.21.15.88:0/2982060612 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f97f4068f60 msgr2=0x7f97f406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.486+0000 7f980fef9700 1 --2- 172.21.15.88:0/2982060612 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f97f4068f60 0x7f97f406b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f98080721c0 tx=0x7f980400b040 comp rx=0 tx=0).stop 2023-12-09T02:33:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.487+0000 7f980fef9700 1 -- 172.21.15.88:0/2982060612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98080fff70 msgr2=0x7f9808072970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.487+0000 7f980fef9700 1 --2- 172.21.15.88:0/2982060612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98080fff70 0x7f9808072970 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009fd0 tx=0x7f97f8009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.487+0000 7f980fef9700 1 -- 172.21.15.88:0/2982060612 shutdown_connections 2023-12-09T02:33:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.487+0000 7f980fef9700 1 --2- 172.21.15.88:0/2982060612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98080fee00 0x7f9808072430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.487+0000 7f980fef9700 1 --2- 172.21.15.88:0/2982060612 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f97f4068f60 0x7f97f406b410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.487+0000 7f980fef9700 1 --2- 172.21.15.88:0/2982060612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98080fff70 0x7f9808072970 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.487+0000 7f980fef9700 1 -- 172.21.15.88:0/2982060612 >> 172.21.15.88:0/2982060612 conn(0x7f98080fa5d0 msgr2=0x7f9808103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.487+0000 7f980fef9700 1 -- 172.21.15.88:0/2982060612 shutdown_connections 2023-12-09T02:33:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.487+0000 7f980fef9700 1 -- 172.21.15.88:0/2982060612 wait complete. 2023-12-09T02:33:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.598+0000 7fc48f268700 1 -- 172.21.15.88:0/2286359218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4880fcbf0 msgr2=0x7fc4880fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.598+0000 7fc48f268700 1 --2- 172.21.15.88:0/2286359218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4880fcbf0 0x7fc4880fd000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc4840049c0 tx=0x7fc484009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.598+0000 7fc48f268700 1 -- 172.21.15.88:0/2286359218 shutdown_connections 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.598+0000 7fc48f268700 1 --2- 172.21.15.88:0/2286359218 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4880fde00 0x7fc4880fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.598+0000 7fc48f268700 1 --2- 172.21.15.88:0/2286359218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4880fcbf0 0x7fc4880fd000 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.598+0000 7fc48f268700 1 -- 172.21.15.88:0/2286359218 >> 172.21.15.88:0/2286359218 conn(0x7fc4880f82d0 msgr2=0x7fc4880fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.599+0000 7fc48f268700 1 -- 172.21.15.88:0/2286359218 shutdown_connections 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.599+0000 7fc48f268700 1 -- 172.21.15.88:0/2286359218 wait complete. 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.599+0000 7fc48f268700 1 Processor -- start 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.599+0000 7fc48f268700 1 -- start start 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.599+0000 7fc48f268700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4880fcbf0 0x7fc48810b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.599+0000 7fc48f268700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4880fde00 0x7fc48810ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.599+0000 7fc48f268700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48810c060 con 0x7fc4880fde00 2023-12-09T02:33:30.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.599+0000 7fc48f268700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48810c900 con 0x7fc4880fcbf0 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc48c803700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4880fde00 0x7fc48810ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc48c803700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4880fde00 0x7fc48810ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50960/0 (socket says 172.21.15.88:50960) 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc48c803700 1 -- 172.21.15.88:0/3861452136 learned_addr learned my addr 172.21.15.88:0/3861452136 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc48d004700 1 --2- 172.21.15.88:0/3861452136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4880fcbf0 0x7fc48810b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc48c803700 1 -- 172.21.15.88:0/3861452136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4880fcbf0 msgr2=0x7fc48810b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc48c803700 1 --2- 172.21.15.88:0/3861452136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4880fcbf0 0x7fc48810b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc48c803700 1 -- 172.21.15.88:0/3861452136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484005040 con 0x7fc4880fde00 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc48c803700 1 --2- 172.21.15.88:0/3861452136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4880fde00 0x7fc48810ba60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc47800eb40 tx=0x7fc47800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc47dffb700 1 -- 172.21.15.88:0/3861452136 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc478007cc0 con 0x7fc4880fde00 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc47dffb700 1 -- 172.21.15.88:0/3861452136 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc47800f040 con 0x7fc4880fde00 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc47dffb700 1 -- 172.21.15.88:0/3861452136 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc47800c910 con 0x7fc4880fde00 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.600+0000 7fc48f268700 1 -- 172.21.15.88:0/3861452136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48810cb80 con 0x7fc4880fde00 2023-12-09T02:33:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.601+0000 7fc48f268700 1 -- 172.21.15.88:0/3861452136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48810d070 con 0x7fc4880fde00 2023-12-09T02:33:30.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.602+0000 7fc48f268700 1 -- 172.21.15.88:0/3861452136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4881053b0 con 0x7fc4880fde00 2023-12-09T02:33:30.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.602+0000 7fc47dffb700 1 -- 172.21.15.88:0/3861452136 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc47800cb80 con 0x7fc4880fde00 2023-12-09T02:33:30.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.603+0000 7fc47dffb700 1 --2- 172.21.15.88:0/3861452136 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc474068f70 0x7fc47406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:30.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.603+0000 7fc47dffb700 1 -- 172.21.15.88:0/3861452136 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc478086950 con 0x7fc4880fde00 2023-12-09T02:33:30.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.603+0000 7fc48d004700 1 --2- 172.21.15.88:0/3861452136 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc474068f70 0x7fc47406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.603+0000 7fc48d004700 1 --2- 172.21.15.88:0/3861452136 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc474068f70 0x7fc47406b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc484004910 tx=0x7fc48401a040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:30.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.607+0000 7fc47dffb700 1 -- 172.21.15.88:0/3861452136 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc47804da00 con 0x7fc4880fde00 2023-12-09T02:33:30.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.853+0000 7fc48f268700 1 -- 172.21.15.88:0/3861452136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc48804bb80 con 0x7fc4880fde00 2023-12-09T02:33:30.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.854+0000 7fc47dffb700 1 -- 172.21.15.88:0/3861452136 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1810 (secure 0 0 0) 0x7fc478019730 con 0x7fc4880fde00 2023-12-09T02:33:30.856 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:33:30.856 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:33:30.857 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:33:30.858 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:33:30.859 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:33:30.859 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:33:30.859 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:33:30.859 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:33:30.859 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:33:30.859 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.856+0000 7fc48f268700 1 -- 172.21.15.88:0/3861452136 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc474068f70 msgr2=0x7fc47406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.856+0000 7fc48f268700 1 --2- 172.21.15.88:0/3861452136 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc474068f70 0x7fc47406b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc484004910 tx=0x7fc48401a040 comp rx=0 tx=0).stop 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.856+0000 7fc48f268700 1 -- 172.21.15.88:0/3861452136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4880fde00 msgr2=0x7fc48810ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.856+0000 7fc48f268700 1 --2- 172.21.15.88:0/3861452136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4880fde00 0x7fc48810ba60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc47800eb40 tx=0x7fc47800b040 comp rx=0 tx=0).stop 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.856+0000 7fc48f268700 1 -- 172.21.15.88:0/3861452136 shutdown_connections 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.856+0000 7fc48f268700 1 --2- 172.21.15.88:0/3861452136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4880fcbf0 0x7fc48810b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.856+0000 7fc48f268700 1 --2- 172.21.15.88:0/3861452136 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc474068f70 0x7fc47406b420 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.856+0000 7fc48f268700 1 --2- 172.21.15.88:0/3861452136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4880fde00 0x7fc48810ba60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.856+0000 7fc48f268700 1 -- 172.21.15.88:0/3861452136 >> 172.21.15.88:0/3861452136 conn(0x7fc4880f82d0 msgr2=0x7fc4880fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.856+0000 7fc48f268700 1 -- 172.21.15.88:0/3861452136 shutdown_connections 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.856+0000 7fc48f268700 1 -- 172.21.15.88:0/3861452136 wait complete. 2023-12-09T02:33:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:33:30.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.969+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2687627949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce080fcd00 msgr2=0x7fce080fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.969+0000 7fce0ddb0700 1 --2- 172.21.15.88:0/2687627949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce080fcd00 0x7fce080fd150 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc004940 tx=0x7fcdfc009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:30.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.969+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2687627949 shutdown_connections 2023-12-09T02:33:30.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.969+0000 7fce0ddb0700 1 --2- 172.21.15.88:0/2687627949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce080fcd00 0x7fce080fd150 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.969+0000 7fce0ddb0700 1 --2- 172.21.15.88:0/2687627949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce080fbaf0 0x7fce080fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.969+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2687627949 >> 172.21.15.88:0/2687627949 conn(0x7fce080f7190 msgr2=0x7fce080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:30.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.969+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2687627949 shutdown_connections 2023-12-09T02:33:30.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.969+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2687627949 wait complete. 2023-12-09T02:33:30.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.969+0000 7fce0ddb0700 1 Processor -- start 2023-12-09T02:33:30.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce0ddb0700 1 -- start start 2023-12-09T02:33:30.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce0ddb0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce080fbaf0 0x7fce081125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:30.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce0ddb0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce080fcd00 0x7fce08114b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:30.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce0ddb0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce08066000 con 0x7fce080fcd00 2023-12-09T02:33:30.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce0ddb0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce08066140 con 0x7fce080fbaf0 2023-12-09T02:33:30.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce06ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce080fcd00 0x7fce08114b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:30.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce06ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce080fcd00 0x7fce08114b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50990/0 (socket says 172.21.15.88:50990) 2023-12-09T02:33:30.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce06ffd700 1 -- 172.21.15.88:0/2266205305 learned_addr learned my addr 172.21.15.88:0/2266205305 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:30.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce077fe700 1 --2- 172.21.15.88:0/2266205305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce080fbaf0 0x7fce081125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:30.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce06ffd700 1 -- 172.21.15.88:0/2266205305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce080fbaf0 msgr2=0x7fce081125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:30.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce06ffd700 1 --2- 172.21.15.88:0/2266205305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce080fbaf0 0x7fce081125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:30.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.970+0000 7fce06ffd700 1 -- 172.21.15.88:0/2266205305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc005040 con 0x7fce080fcd00 2023-12-09T02:33:30.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.971+0000 7fce06ffd700 1 --2- 172.21.15.88:0/2266205305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce080fcd00 0x7fce08114b40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc000c00 tx=0x7fcdfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:30.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.971+0000 7fcdeffff700 1 -- 172.21.15.88:0/2266205305 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdfc021070 con 0x7fce080fcd00 2023-12-09T02:33:30.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.971+0000 7fcdeffff700 1 -- 172.21.15.88:0/2266205305 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcdfc01c400 con 0x7fce080fcd00 2023-12-09T02:33:30.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.971+0000 7fcdeffff700 1 -- 172.21.15.88:0/2266205305 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdfc00e070 con 0x7fce080fcd00 2023-12-09T02:33:30.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.971+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2266205305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce08115080 con 0x7fce080fcd00 2023-12-09T02:33:30.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.972+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2266205305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce081153d0 con 0x7fce080fcd00 2023-12-09T02:33:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.973+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2266205305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0804bb80 con 0x7fce080fcd00 2023-12-09T02:33:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.973+0000 7fcdeffff700 1 -- 172.21.15.88:0/2266205305 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcdfc01c9c0 con 0x7fce080fcd00 2023-12-09T02:33:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:30 smithi088 ceph-mon[112028]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:33:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:30 smithi088 ceph-mon[112028]: pgmap v153: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-09T02:33:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:30 smithi088 ceph-mon[112028]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:33:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:30 smithi088 ceph-mon[112028]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:33:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:30 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2982060612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:33:30.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.974+0000 7fcdeffff700 1 --2- 172.21.15.88:0/2266205305 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcdf0068f60 0x7fcdf006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:30.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.974+0000 7fcdeffff700 1 -- 172.21.15.88:0/2266205305 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcdfc087960 con 0x7fce080fcd00 2023-12-09T02:33:30.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.974+0000 7fce077fe700 1 --2- 172.21.15.88:0/2266205305 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcdf0068f60 0x7fcdf006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:30.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.974+0000 7fce077fe700 1 --2- 172.21.15.88:0/2266205305 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcdf0068f60 0x7fcdf006b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fce08065d90 tx=0x7fcdf800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:30.982+0000 7fcdeffff700 1 -- 172.21.15.88:0/2266205305 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcdfc053e90 con 0x7fce080fcd00 2023-12-09T02:33:31.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:30 smithi161 ceph-mon[121170]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:33:31.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:30 smithi161 ceph-mon[121170]: pgmap v153: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-09T02:33:31.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:30 smithi161 ceph-mon[121170]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:33:31.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:30 smithi161 ceph-mon[121170]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:33:31.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:30 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2982060612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:33:31.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.221+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2266205305 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce08101650 con 0x7fcdf0068f60 2023-12-09T02:33:31.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.222+0000 7fcdeffff700 1 -- 172.21.15.88:0/2266205305 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fce08101650 con 0x7fcdf0068f60 2023-12-09T02:33:31.225 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:33:31.225 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", 2023-12-09T02:33:31.225 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:33:31.225 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:33:31.225 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2023-12-09T02:33:31.225 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "", 2023-12-09T02:33:31.225 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 image", 2023-12-09T02:33:31.225 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:33:31.225 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:33:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.224+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2266205305 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcdf0068f60 msgr2=0x7fcdf006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.224+0000 7fce0ddb0700 1 --2- 172.21.15.88:0/2266205305 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcdf0068f60 0x7fcdf006b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fce08065d90 tx=0x7fcdf800b040 comp rx=0 tx=0).stop 2023-12-09T02:33:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.225+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2266205305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce080fcd00 msgr2=0x7fce08114b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.225+0000 7fce0ddb0700 1 --2- 172.21.15.88:0/2266205305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce080fcd00 0x7fce08114b40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc000c00 tx=0x7fcdfc009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.225+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2266205305 shutdown_connections 2023-12-09T02:33:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.225+0000 7fce0ddb0700 1 --2- 172.21.15.88:0/2266205305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce080fbaf0 0x7fce081125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.225+0000 7fce0ddb0700 1 --2- 172.21.15.88:0/2266205305 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fcdf0068f60 0x7fcdf006b410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.225+0000 7fce0ddb0700 1 --2- 172.21.15.88:0/2266205305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce080fcd00 0x7fce08114b40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.225+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2266205305 >> 172.21.15.88:0/2266205305 conn(0x7fce080f7190 msgr2=0x7fce080fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:31.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.225+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2266205305 shutdown_connections 2023-12-09T02:33:31.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.225+0000 7fce0ddb0700 1 -- 172.21.15.88:0/2266205305 wait complete. 2023-12-09T02:33:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.332+0000 7f9fa9e48700 1 -- 172.21.15.88:0/3282880658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fa4066090 msgr2=0x7f9fa40ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.332+0000 7f9fa9e48700 1 --2- 172.21.15.88:0/3282880658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fa4066090 0x7f9fa40ff7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9f94004940 tx=0x7f9f94009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.332+0000 7f9fa9e48700 1 -- 172.21.15.88:0/3282880658 shutdown_connections 2023-12-09T02:33:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.332+0000 7f9fa9e48700 1 --2- 172.21.15.88:0/3282880658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa40ffd70 0x7f9fa41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.332+0000 7f9fa9e48700 1 --2- 172.21.15.88:0/3282880658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fa4066090 0x7f9fa40ff7a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.332+0000 7f9fa9e48700 1 -- 172.21.15.88:0/3282880658 >> 172.21.15.88:0/3282880658 conn(0x7f9fa40f7190 msgr2=0x7f9fa40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.332+0000 7f9fa9e48700 1 -- 172.21.15.88:0/3282880658 shutdown_connections 2023-12-09T02:33:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.332+0000 7f9fa9e48700 1 -- 172.21.15.88:0/3282880658 wait complete. 2023-12-09T02:33:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa9e48700 1 Processor -- start 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa9e48700 1 -- start start 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa9e48700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fa4066090 0x7f9fa40fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa9e48700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa40ffd70 0x7f9fa40fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa9e48700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa40fbca0 con 0x7f9fa4066090 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa9e48700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa40fbe10 con 0x7f9fa40ffd70 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fa4066090 0x7f9fa40fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fa4066090 0x7f9fa40fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51000/0 (socket says 172.21.15.88:51000) 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa37fe700 1 -- 172.21.15.88:0/2681495876 learned_addr learned my addr 172.21.15.88:0/2681495876 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa2ffd700 1 --2- 172.21.15.88:0/2681495876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa40ffd70 0x7f9fa40fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa37fe700 1 -- 172.21.15.88:0/2681495876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa40ffd70 msgr2=0x7f9fa40fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa37fe700 1 --2- 172.21.15.88:0/2681495876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa40ffd70 0x7f9fa40fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.333+0000 7f9fa37fe700 1 -- 172.21.15.88:0/2681495876 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98005040 con 0x7f9fa4066090 2023-12-09T02:33:31.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.334+0000 7f9fa37fe700 1 --2- 172.21.15.88:0/2681495876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fa4066090 0x7f9fa40fd220 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9f94000c00 tx=0x7f9f94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:31.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.334+0000 7f9f8bfff700 1 -- 172.21.15.88:0/2681495876 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f94021070 con 0x7f9fa4066090 2023-12-09T02:33:31.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.334+0000 7f9fa9e48700 1 -- 172.21.15.88:0/2681495876 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f94005040 con 0x7f9fa4066090 2023-12-09T02:33:31.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.334+0000 7f9f8bfff700 1 -- 172.21.15.88:0/2681495876 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9f9401c400 con 0x7f9fa4066090 2023-12-09T02:33:31.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.334+0000 7f9f8bfff700 1 -- 172.21.15.88:0/2681495876 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9400e070 con 0x7f9fa4066090 2023-12-09T02:33:31.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.334+0000 7f9fa9e48700 1 -- 172.21.15.88:0/2681495876 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa40fc3e0 con 0x7f9fa4066090 2023-12-09T02:33:31.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.335+0000 7f9fa9e48700 1 -- 172.21.15.88:0/2681495876 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa404bb80 con 0x7f9fa4066090 2023-12-09T02:33:31.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.336+0000 7f9f8bfff700 1 -- 172.21.15.88:0/2681495876 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9f9401c9c0 con 0x7f9fa4066090 2023-12-09T02:33:31.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.336+0000 7f9f8bfff700 1 --2- 172.21.15.88:0/2681495876 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9f8c068f60 0x7f9f8c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:33:31.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.336+0000 7f9f8bfff700 1 -- 172.21.15.88:0/2681495876 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9f94088040 con 0x7f9fa4066090 2023-12-09T02:33:31.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.336+0000 7f9fa2ffd700 1 --2- 172.21.15.88:0/2681495876 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9f8c068f60 0x7f9f8c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:33:31.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.337+0000 7f9fa2ffd700 1 --2- 172.21.15.88:0/2681495876 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9f8c068f60 0x7f9f8c06b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4065dd0 tx=0x7f9f9800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:33:31.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.341+0000 7f9f8bfff700 1 -- 172.21.15.88:0/2681495876 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9f94057f50 con 0x7f9fa4066090 2023-12-09T02:33:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.642+0000 7f9fa9e48700 1 -- 172.21.15.88:0/2681495876 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9fa41055a0 con 0x7f9fa4066090 2023-12-09T02:33:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.643+0000 7f9f8bfff700 1 -- 172.21.15.88:0/2681495876 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9f94057ae0 con 0x7f9fa4066090 2023-12-09T02:33:31.645 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:33:31.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.645+0000 7f9fa9e48700 1 -- 172.21.15.88:0/2681495876 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9f8c068f60 msgr2=0x7f9f8c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:31.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.645+0000 7f9fa9e48700 1 --2- 172.21.15.88:0/2681495876 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9f8c068f60 0x7f9f8c06b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4065dd0 tx=0x7f9f9800b040 comp rx=0 tx=0).stop 2023-12-09T02:33:31.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.645+0000 7f9fa9e48700 1 -- 172.21.15.88:0/2681495876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fa4066090 msgr2=0x7f9fa40fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:33:31.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.645+0000 7f9fa9e48700 1 --2- 172.21.15.88:0/2681495876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fa4066090 0x7f9fa40fd220 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9f94000c00 tx=0x7f9f94009e30 comp rx=0 tx=0).stop 2023-12-09T02:33:31.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.645+0000 7f9fa9e48700 1 -- 172.21.15.88:0/2681495876 shutdown_connections 2023-12-09T02:33:31.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.645+0000 7f9fa9e48700 1 --2- 172.21.15.88:0/2681495876 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9f8c068f60 0x7f9f8c06b410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:31.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.645+0000 7f9fa9e48700 1 --2- 172.21.15.88:0/2681495876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fa4066090 0x7f9fa40fd220 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:31.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.645+0000 7f9fa9e48700 1 --2- 172.21.15.88:0/2681495876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa40ffd70 0x7f9fa40fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:33:31.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.645+0000 7f9fa9e48700 1 -- 172.21.15.88:0/2681495876 >> 172.21.15.88:0/2681495876 conn(0x7f9fa40f7190 msgr2=0x7f9fa40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:33:31.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.645+0000 7f9fa9e48700 1 -- 172.21.15.88:0/2681495876 shutdown_connections 2023-12-09T02:33:31.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:33:31.645+0000 7f9fa9e48700 1 -- 172.21.15.88:0/2681495876 wait complete. 2023-12-09T02:33:31.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:31 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3861452136' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:33:31.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:33:31.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:31 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2681495876' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:33:32.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:31 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3861452136' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:33:32.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:31 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:33:32.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:31 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2681495876' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:33:32.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:32 smithi088 ceph-mon[112028]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:33:32.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:32 smithi088 ceph-mon[112028]: pgmap v154: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-09T02:33:33.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:32 smithi161 ceph-mon[121170]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:33:33.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:32 smithi161 ceph-mon[121170]: pgmap v154: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-09T02:33:34.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:34 smithi088 ceph-mon[112028]: pgmap v155: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-09T02:33:35.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:34 smithi161 ceph-mon[121170]: pgmap v155: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-09T02:33:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:36 smithi161 ceph-mon[121170]: pgmap v156: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-09T02:33:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:36 smithi088 ceph-mon[112028]: pgmap v156: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-09T02:33:39.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:38 smithi161 ceph-mon[121170]: pgmap v157: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-09T02:33:39.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:38 smithi088 ceph-mon[112028]: pgmap v157: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-09T02:33:41.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:40 smithi161 ceph-mon[121170]: pgmap v158: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:41.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:40 smithi088 ceph-mon[112028]: pgmap v158: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:43.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:42 smithi161 ceph-mon[121170]: pgmap v159: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:42 smithi088 ceph-mon[112028]: pgmap v159: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:44 smithi161 ceph-mon[121170]: pgmap v160: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:45.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:44 smithi088 ceph-mon[112028]: pgmap v160: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:47.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:46 smithi161 ceph-mon[121170]: pgmap v161: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:47.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:46 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:33:47.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:46 smithi088 ceph-mon[112028]: pgmap v161: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:47.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:33:49.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:48 smithi161 ceph-mon[121170]: pgmap v162: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:49.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:48 smithi088 ceph-mon[112028]: pgmap v162: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:51.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:50 smithi161 ceph-mon[121170]: pgmap v163: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:51.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:50 smithi088 ceph-mon[112028]: pgmap v163: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:53.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:52 smithi161 ceph-mon[121170]: pgmap v164: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:53.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:52 smithi088 ceph-mon[112028]: pgmap v164: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:55.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:54 smithi161 ceph-mon[121170]: pgmap v165: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:55.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:54 smithi088 ceph-mon[112028]: pgmap v165: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:33:57.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:56 smithi161 ceph-mon[121170]: pgmap v166: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-09T02:33:57.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:56 smithi088 ceph-mon[112028]: pgmap v166: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-09T02:33:59.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:33:58 smithi161 ceph-mon[121170]: pgmap v167: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-09T02:33:59.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:33:58 smithi088 ceph-mon[112028]: pgmap v167: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-09T02:34:01.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:00 smithi161 ceph-mon[121170]: pgmap v168: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-09T02:34:01.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:00 smithi088 ceph-mon[112028]: pgmap v168: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-09T02:34:01.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.771+0000 7f323a1de700 1 -- 172.21.15.88:0/429224800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32340fcd00 msgr2=0x7f32340fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:01.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.771+0000 7f323a1de700 1 --2- 172.21.15.88:0/429224800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32340fcd00 0x7f32340fd150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3224004940 tx=0x7f3224009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:01.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.771+0000 7f323a1de700 1 -- 172.21.15.88:0/429224800 shutdown_connections 2023-12-09T02:34:01.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.771+0000 7f323a1de700 1 --2- 172.21.15.88:0/429224800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32340fcd00 0x7f32340fd150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:01.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.771+0000 7f323a1de700 1 --2- 172.21.15.88:0/429224800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32340fbaf0 0x7f32340fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:01.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.771+0000 7f323a1de700 1 -- 172.21.15.88:0/429224800 >> 172.21.15.88:0/429224800 conn(0x7f32340f71d0 msgr2=0x7f32340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:01.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.771+0000 7f323a1de700 1 -- 172.21.15.88:0/429224800 shutdown_connections 2023-12-09T02:34:01.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.771+0000 7f323a1de700 1 -- 172.21.15.88:0/429224800 wait complete. 2023-12-09T02:34:01.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.772+0000 7f323a1de700 1 Processor -- start 2023-12-09T02:34:01.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.772+0000 7f323a1de700 1 -- start start 2023-12-09T02:34:01.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.772+0000 7f323a1de700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32340fbaf0 0x7f3234103be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:01.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.772+0000 7f323a1de700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32340fcd00 0x7f3234102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:01.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.772+0000 7f323a1de700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32341026f0 con 0x7f32340fbaf0 2023-12-09T02:34:01.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.772+0000 7f323a1de700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3234102860 con 0x7f32340fcd00 2023-12-09T02:34:01.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.772+0000 7f3232ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32340fcd00 0x7f3234102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.772+0000 7f3232ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32340fcd00 0x7f3234102060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.88:38840/0 (socket says 172.21.15.88:38840) 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.772+0000 7f3232ffd700 1 -- 172.21.15.88:0/1068696956 learned_addr learned my addr 172.21.15.88:0/1068696956 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.773+0000 7f32337fe700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32340fbaf0 0x7f3234103be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.773+0000 7f3232ffd700 1 -- 172.21.15.88:0/1068696956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32340fbaf0 msgr2=0x7f3234103be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.773+0000 7f3232ffd700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32340fbaf0 0x7f3234103be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.773+0000 7f3232ffd700 1 -- 172.21.15.88:0/1068696956 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3224005040 con 0x7f32340fcd00 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.773+0000 7f32337fe700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32340fbaf0 0x7f3234103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.773+0000 7f3232ffd700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32340fcd00 0x7f3234102060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3224009fd0 tx=0x7f3224009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.773+0000 7f321bfff700 1 -- 172.21.15.88:0/1068696956 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f322400e040 con 0x7f32340fcd00 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.773+0000 7f321bfff700 1 -- 172.21.15.88:0/1068696956 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3224004290 con 0x7f32340fcd00 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.773+0000 7f321bfff700 1 -- 172.21.15.88:0/1068696956 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f322401c3f0 con 0x7f32340fcd00 2023-12-09T02:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.774+0000 7f323a1de700 1 -- 172.21.15.88:0/1068696956 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3234102ae0 con 0x7f32340fcd00 2023-12-09T02:34:01.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.774+0000 7f323a1de700 1 -- 172.21.15.88:0/1068696956 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3234115590 con 0x7f32340fcd00 2023-12-09T02:34:01.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.775+0000 7f323a1de700 1 -- 172.21.15.88:0/1068696956 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323404bb80 con 0x7f32340fcd00 2023-12-09T02:34:01.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.775+0000 7f321bfff700 1 -- 172.21.15.88:0/1068696956 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3224013420 con 0x7f32340fcd00 2023-12-09T02:34:01.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.776+0000 7f321bfff700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f321c068f70 0x7f321c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:01.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.776+0000 7f321bfff700 1 -- 172.21.15.88:0/1068696956 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3224088260 con 0x7f32340fcd00 2023-12-09T02:34:01.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.776+0000 7f32337fe700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f321c068f70 0x7f321c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:01.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.776+0000 7f32337fe700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f321c068f70 0x7f321c06b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3234103970 tx=0x7f3228008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:01.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:01.780+0000 7f321bfff700 1 -- 172.21.15.88:0/1068696956 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f32240580f0 con 0x7f32340fcd00 2023-12-09T02:34:02.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.069+0000 7f323a1de700 1 -- 172.21.15.88:0/1068696956 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3234101650 con 0x7f321c068f70 2023-12-09T02:34:02.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.071+0000 7f321bfff700 1 -- 172.21.15.88:0/1068696956 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f3234101650 con 0x7f321c068f70 2023-12-09T02:34:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.073+0000 7f323a1de700 1 -- 172.21.15.88:0/1068696956 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f321c068f70 msgr2=0x7f321c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.073+0000 7f323a1de700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f321c068f70 0x7f321c06b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3234103970 tx=0x7f3228008040 comp rx=0 tx=0).stop 2023-12-09T02:34:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.074+0000 7f323a1de700 1 -- 172.21.15.88:0/1068696956 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32340fcd00 msgr2=0x7f3234102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.074+0000 7f323a1de700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32340fcd00 0x7f3234102060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3224009fd0 tx=0x7f3224009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.074+0000 7f323a1de700 1 -- 172.21.15.88:0/1068696956 shutdown_connections 2023-12-09T02:34:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.074+0000 7f323a1de700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f321c068f70 0x7f321c06b420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.074+0000 7f323a1de700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32340fbaf0 0x7f3234103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.074+0000 7f323a1de700 1 --2- 172.21.15.88:0/1068696956 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32340fcd00 0x7f3234102060 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.074+0000 7f323a1de700 1 -- 172.21.15.88:0/1068696956 >> 172.21.15.88:0/1068696956 conn(0x7f32340f71d0 msgr2=0x7f32340fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.074+0000 7f323a1de700 1 -- 172.21.15.88:0/1068696956 shutdown_connections 2023-12-09T02:34:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.074+0000 7f323a1de700 1 -- 172.21.15.88:0/1068696956 wait complete. 2023-12-09T02:34:02.088 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:34:02.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:34:02.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.193+0000 7fc63fab9700 1 -- 172.21.15.88:0/1984900137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fcd00 msgr2=0x7fc6380fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:02.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.193+0000 7fc63fab9700 1 --2- 172.21.15.88:0/1984900137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fcd00 0x7fc6380fd150 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc628004940 tx=0x7fc628009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:02.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.193+0000 7fc63fab9700 1 -- 172.21.15.88:0/1984900137 shutdown_connections 2023-12-09T02:34:02.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.193+0000 7fc63fab9700 1 --2- 172.21.15.88:0/1984900137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fcd00 0x7fc6380fd150 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.193+0000 7fc63fab9700 1 --2- 172.21.15.88:0/1984900137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6380fbaf0 0x7fc6380fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.193+0000 7fc63fab9700 1 -- 172.21.15.88:0/1984900137 >> 172.21.15.88:0/1984900137 conn(0x7fc6380f7190 msgr2=0x7fc6380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:02.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.193+0000 7fc63fab9700 1 -- 172.21.15.88:0/1984900137 shutdown_connections 2023-12-09T02:34:02.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.193+0000 7fc63fab9700 1 -- 172.21.15.88:0/1984900137 wait complete. 2023-12-09T02:34:02.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.193+0000 7fc63fab9700 1 Processor -- start 2023-12-09T02:34:02.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63fab9700 1 -- start start 2023-12-09T02:34:02.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63fab9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6380fbaf0 0x7fc63810d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:02.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63fab9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fcd00 0x7fc63810da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:02.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63fab9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63810e000 con 0x7fc6380fcd00 2023-12-09T02:34:02.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63fab9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63810e8a0 con 0x7fc6380fbaf0 2023-12-09T02:34:02.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63d855700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6380fbaf0 0x7fc63810d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:02.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63d855700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6380fbaf0 0x7fc63810d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.88:38858/0 (socket says 172.21.15.88:38858) 2023-12-09T02:34:02.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63d855700 1 -- 172.21.15.88:0/496481147 learned_addr learned my addr 172.21.15.88:0/496481147 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:02.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63d855700 1 -- 172.21.15.88:0/496481147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fcd00 msgr2=0x7fc63810da00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-09T02:34:02.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63d054700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fcd00 0x7fc63810da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:02.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63d855700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fcd00 0x7fc63810da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.194+0000 7fc63d855700 1 -- 172.21.15.88:0/496481147 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628005040 con 0x7fc6380fbaf0 2023-12-09T02:34:02.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.195+0000 7fc63d054700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fcd00 0x7fc63810da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:34:02.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.195+0000 7fc63d855700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6380fbaf0 0x7fc63810d4c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc63400eb70 tx=0x7fc63400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:02.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.195+0000 7fc62e7fc700 1 -- 172.21.15.88:0/496481147 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc634007cc0 con 0x7fc6380fbaf0 2023-12-09T02:34:02.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.195+0000 7fc62e7fc700 1 -- 172.21.15.88:0/496481147 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc63400f040 con 0x7fc6380fbaf0 2023-12-09T02:34:02.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.195+0000 7fc62e7fc700 1 -- 172.21.15.88:0/496481147 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc63400cad0 con 0x7fc6380fbaf0 2023-12-09T02:34:02.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.195+0000 7fc63fab9700 1 -- 172.21.15.88:0/496481147 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63810eb20 con 0x7fc6380fbaf0 2023-12-09T02:34:02.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.195+0000 7fc63fab9700 1 -- 172.21.15.88:0/496481147 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63810f060 con 0x7fc6380fbaf0 2023-12-09T02:34:02.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.196+0000 7fc63fab9700 1 -- 172.21.15.88:0/496481147 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63804bb80 con 0x7fc6380fbaf0 2023-12-09T02:34:02.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.197+0000 7fc62e7fc700 1 -- 172.21.15.88:0/496481147 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc63400cc30 con 0x7fc6380fbaf0 2023-12-09T02:34:02.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.197+0000 7fc62e7fc700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc624068f60 0x7fc62406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:02.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.198+0000 7fc62e7fc700 1 -- 172.21.15.88:0/496481147 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc634086800 con 0x7fc6380fbaf0 2023-12-09T02:34:02.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.198+0000 7fc63d054700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc624068f60 0x7fc62406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:02.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.198+0000 7fc63d054700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc624068f60 0x7fc62406b410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6280043d0 tx=0x7fc628009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:02.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.202+0000 7fc62e7fc700 1 -- 172.21.15.88:0/496481147 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc63404da00 con 0x7fc6380fbaf0 2023-12-09T02:34:02.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:34:02.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.526+0000 7fc63fab9700 1 -- 172.21.15.88:0/496481147 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc638101650 con 0x7fc624068f60 2023-12-09T02:34:02.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.527+0000 7fc62e7fc700 1 -- 172.21.15.88:0/496481147 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fc638101650 con 0x7fc624068f60 2023-12-09T02:34:02.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.529+0000 7fc63fab9700 1 -- 172.21.15.88:0/496481147 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc624068f60 msgr2=0x7fc62406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:02.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.529+0000 7fc63fab9700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc624068f60 0x7fc62406b410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6280043d0 tx=0x7fc628009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:02.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.529+0000 7fc63fab9700 1 -- 172.21.15.88:0/496481147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6380fbaf0 msgr2=0x7fc63810d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:02.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.529+0000 7fc63fab9700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6380fbaf0 0x7fc63810d4c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc63400eb70 tx=0x7fc63400b040 comp rx=0 tx=0).stop 2023-12-09T02:34:02.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.530+0000 7fc63fab9700 1 -- 172.21.15.88:0/496481147 shutdown_connections 2023-12-09T02:34:02.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.530+0000 7fc63fab9700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6380fbaf0 0x7fc63810d4c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.530+0000 7fc63fab9700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc624068f60 0x7fc62406b410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.530+0000 7fc63fab9700 1 --2- 172.21.15.88:0/496481147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fcd00 0x7fc63810da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.530+0000 7fc63fab9700 1 -- 172.21.15.88:0/496481147 >> 172.21.15.88:0/496481147 conn(0x7fc6380f7190 msgr2=0x7fc6380fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:02.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.530+0000 7fc63fab9700 1 -- 172.21.15.88:0/496481147 shutdown_connections 2023-12-09T02:34:02.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.530+0000 7fc63fab9700 1 -- 172.21.15.88:0/496481147 wait complete. 2023-12-09T02:34:02.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.674+0000 7f930e8d3700 1 -- 172.21.15.88:0/2474664001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93080fbaf0 msgr2=0x7f93080fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:02.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.674+0000 7f930e8d3700 1 --2- 172.21.15.88:0/2474664001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93080fbaf0 0x7f93080fbf00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f92f8004940 tx=0x7f92f8009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:02.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.674+0000 7f930e8d3700 1 -- 172.21.15.88:0/2474664001 shutdown_connections 2023-12-09T02:34:02.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.674+0000 7f930e8d3700 1 --2- 172.21.15.88:0/2474664001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93080fcd00 0x7f93080fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.674+0000 7f930e8d3700 1 --2- 172.21.15.88:0/2474664001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93080fbaf0 0x7f93080fbf00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.674+0000 7f930e8d3700 1 -- 172.21.15.88:0/2474664001 >> 172.21.15.88:0/2474664001 conn(0x7f93080f7190 msgr2=0x7f93080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.675+0000 7f930e8d3700 1 -- 172.21.15.88:0/2474664001 shutdown_connections 2023-12-09T02:34:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.675+0000 7f930e8d3700 1 -- 172.21.15.88:0/2474664001 wait complete. 2023-12-09T02:34:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.675+0000 7f930e8d3700 1 Processor -- start 2023-12-09T02:34:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.675+0000 7f930e8d3700 1 -- start start 2023-12-09T02:34:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.675+0000 7f930e8d3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93080fbaf0 0x7f93081126a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.676+0000 7f930e8d3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93080fcd00 0x7f9308114bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.676+0000 7f930e8d3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308066000 con 0x7f93080fcd00 2023-12-09T02:34:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.676+0000 7f930e8d3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308066140 con 0x7f93080fbaf0 2023-12-09T02:34:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.676+0000 7f93077fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93080fcd00 0x7f9308114bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.676+0000 7f93077fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93080fcd00 0x7f9308114bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34368/0 (socket says 172.21.15.88:34368) 2023-12-09T02:34:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.676+0000 7f93077fe700 1 -- 172.21.15.88:0/1096972816 learned_addr learned my addr 172.21.15.88:0/1096972816 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.676+0000 7f9307fff700 1 --2- 172.21.15.88:0/1096972816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93080fbaf0 0x7f93081126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.676+0000 7f93077fe700 1 -- 172.21.15.88:0/1096972816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93080fbaf0 msgr2=0x7f93081126a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.676+0000 7f93077fe700 1 --2- 172.21.15.88:0/1096972816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93080fbaf0 0x7f93081126a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.676+0000 7f93077fe700 1 -- 172.21.15.88:0/1096972816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f8005040 con 0x7f93080fcd00 2023-12-09T02:34:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.676+0000 7f93077fe700 1 --2- 172.21.15.88:0/1096972816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93080fcd00 0x7f9308114bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00c830 tx=0x7f92fc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.677+0000 7f9304ff9700 1 -- 172.21.15.88:0/1096972816 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92fc0106f0 con 0x7f93080fcd00 2023-12-09T02:34:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.677+0000 7f930e8d3700 1 -- 172.21.15.88:0/1096972816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9308115130 con 0x7f93080fcd00 2023-12-09T02:34:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.677+0000 7f930e8d3700 1 -- 172.21.15.88:0/1096972816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9308115530 con 0x7f93080fcd00 2023-12-09T02:34:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.677+0000 7f9304ff9700 1 -- 172.21.15.88:0/1096972816 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f92fc010d00 con 0x7f93080fcd00 2023-12-09T02:34:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.677+0000 7f9304ff9700 1 -- 172.21.15.88:0/1096972816 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92fc012e90 con 0x7f93080fcd00 2023-12-09T02:34:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.678+0000 7f930e8d3700 1 -- 172.21.15.88:0/1096972816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f40052e0 con 0x7f93080fcd00 2023-12-09T02:34:02.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.679+0000 7f9304ff9700 1 -- 172.21.15.88:0/1096972816 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f92fc010850 con 0x7f93080fcd00 2023-12-09T02:34:02.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.680+0000 7f9304ff9700 1 --2- 172.21.15.88:0/1096972816 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f92f0068f70 0x7f92f006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:02.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.680+0000 7f9304ff9700 1 -- 172.21.15.88:0/1096972816 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f92fc0877c0 con 0x7f93080fcd00 2023-12-09T02:34:02.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.680+0000 7f9307fff700 1 --2- 172.21.15.88:0/1096972816 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f92f0068f70 0x7f92f006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:02.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.681+0000 7f9307fff700 1 --2- 172.21.15.88:0/1096972816 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f92f0068f70 0x7f92f006b420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92f800b7d0 tx=0x7f92f8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:02.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.683+0000 7f9304ff9700 1 -- 172.21.15.88:0/1096972816 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f92fc053ce0 con 0x7f93080fcd00 2023-12-09T02:34:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.927+0000 7f930e8d3700 1 -- 172.21.15.88:0/1096972816 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f92f4000bf0 con 0x7f92f0068f70 2023-12-09T02:34:02.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.945+0000 7f9304ff9700 1 -- 172.21.15.88:0/1096972816 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f92f4000bf0 con 0x7f92f0068f70 2023-12-09T02:34:02.946 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:34:02.946 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (4m) 58s ago 4m 28.4M - 0.25.0 c8568f914cd2 578f197f8707 2023-12-09T02:34:02.946 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (5m) 58s ago 5m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 9098f424ee11 2023-12-09T02:34:02.946 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (4m) 59s ago 4m 7482k - 17.2.7-119-ge2143d99 f761b6e42225 15c5154f5f2e 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (3m) 58s ago 4m 89.6M - 9.4.7 954c08fa6188 04aa719e29b6 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (71s) 58s ago 71s 11.9M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (68s) 58s ago 67s 13.3M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (70s) 59s ago 69s 15.9M - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (66s) 59s ago 66s 13.2M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:9283 running (6m) 58s ago 6m 496M - 17.2.7-119-ge2143d99 f761b6e42225 0fffc89bc055 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283 running (4m) 59s ago 4m 442M - 17.2.7-119-ge2143d99 f761b6e42225 785e62ae75e6 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (6m) 58s ago 6m 74.6M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d21a10406297 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (4m) 59s ago 4m 60.0M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d6b9d9265450 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (5m) 58s ago 5m 14.8M - 1.5.0 0da6a335fe13 0a3f7cc72867 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (4m) 59s ago 4m 17.3M - 1.5.0 0da6a335fe13 43bf179905a8 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (3m) 58s ago 3m 54.8M 4299M 17.2.7-119-ge2143d99 f761b6e42225 fdd606881a64 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (3m) 58s ago 3m 58.0M 4299M 17.2.7-119-ge2143d99 f761b6e42225 354d4a4d3430 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (3m) 58s ago 3m 57.5M 4299M 17.2.7-119-ge2143d99 f761b6e42225 0b0abbb070ec 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (2m) 59s ago 2m 55.7M 5323M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:34:02.947 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (2m) 59s ago 2m 48.8M 5323M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:34:02.948 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (2m) 59s ago 2m 51.5M 5323M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:34:02.948 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (3m) 58s ago 4m 48.7M - 2.43.0 a07b618ecd1d 5e8226460d4a 2023-12-09T02:34:02.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.948+0000 7f930e8d3700 1 -- 172.21.15.88:0/1096972816 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f92f0068f70 msgr2=0x7f92f006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:02.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.948+0000 7f930e8d3700 1 --2- 172.21.15.88:0/1096972816 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f92f0068f70 0x7f92f006b420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92f800b7d0 tx=0x7f92f8009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:02.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.948+0000 7f930e8d3700 1 -- 172.21.15.88:0/1096972816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93080fcd00 msgr2=0x7f9308114bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:02.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.948+0000 7f930e8d3700 1 --2- 172.21.15.88:0/1096972816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93080fcd00 0x7f9308114bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00c830 tx=0x7f92fc004470 comp rx=0 tx=0).stop 2023-12-09T02:34:02.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.948+0000 7f930e8d3700 1 -- 172.21.15.88:0/1096972816 shutdown_connections 2023-12-09T02:34:02.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.948+0000 7f930e8d3700 1 --2- 172.21.15.88:0/1096972816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93080fbaf0 0x7f93081126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.948+0000 7f930e8d3700 1 --2- 172.21.15.88:0/1096972816 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f92f0068f70 0x7f92f006b420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.948+0000 7f930e8d3700 1 --2- 172.21.15.88:0/1096972816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93080fcd00 0x7f9308114bf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:02.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.948+0000 7f930e8d3700 1 -- 172.21.15.88:0/1096972816 >> 172.21.15.88:0/1096972816 conn(0x7f93080f7190 msgr2=0x7f93080fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:02.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.948+0000 7f930e8d3700 1 -- 172.21.15.88:0/1096972816 shutdown_connections 2023-12-09T02:34:02.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:02.948+0000 7f930e8d3700 1 -- 172.21.15.88:0/1096972816 wait complete. 2023-12-09T02:34:03.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.071+0000 7f0c7288f700 1 -- 172.21.15.88:0/1920518636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c6c0fbaf0 msgr2=0x7f0c6c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:03.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.071+0000 7f0c7288f700 1 --2- 172.21.15.88:0/1920518636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c6c0fbaf0 0x7f0c6c0fbf00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c004940 tx=0x7f0c5c009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:03.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.071+0000 7f0c7288f700 1 -- 172.21.15.88:0/1920518636 shutdown_connections 2023-12-09T02:34:03.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.071+0000 7f0c7288f700 1 --2- 172.21.15.88:0/1920518636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6c0fcd00 0x7f0c6c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:03.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.071+0000 7f0c7288f700 1 --2- 172.21.15.88:0/1920518636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c6c0fbaf0 0x7f0c6c0fbf00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:03.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.071+0000 7f0c7288f700 1 -- 172.21.15.88:0/1920518636 >> 172.21.15.88:0/1920518636 conn(0x7f0c6c0f7190 msgr2=0x7f0c6c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:03.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.071+0000 7f0c7288f700 1 -- 172.21.15.88:0/1920518636 shutdown_connections 2023-12-09T02:34:03.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.071+0000 7f0c7288f700 1 -- 172.21.15.88:0/1920518636 wait complete. 2023-12-09T02:34:03.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.071+0000 7f0c7288f700 1 Processor -- start 2023-12-09T02:34:03.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c7288f700 1 -- start start 2023-12-09T02:34:03.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c7288f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c6c0fbaf0 0x7f0c6c10c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c7288f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6c0fcd00 0x7f0c6c10c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c7288f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c10cf30 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c7288f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c10d7d0 con 0x7f0c6c0fcd00 2023-12-09T02:34:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c6bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c6c0fbaf0 0x7f0c6c10c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c6bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c6c0fbaf0 0x7f0c6c10c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34384/0 (socket says 172.21.15.88:34384) 2023-12-09T02:34:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c6bfff700 1 -- 172.21.15.88:0/3059492457 learned_addr learned my addr 172.21.15.88:0/3059492457 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c6b7fe700 1 --2- 172.21.15.88:0/3059492457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6c0fcd00 0x7f0c6c10c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c6bfff700 1 -- 172.21.15.88:0/3059492457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6c0fcd00 msgr2=0x7f0c6c10c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c6bfff700 1 --2- 172.21.15.88:0/3059492457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6c0fcd00 0x7f0c6c10c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.072+0000 7f0c6bfff700 1 -- 172.21.15.88:0/3059492457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c005040 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.073+0000 7f0c6bfff700 1 --2- 172.21.15.88:0/3059492457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c6c0fbaf0 0x7f0c6c10c3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c000c00 tx=0x7f0c5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.073+0000 7f0c68ff9700 1 -- 172.21.15.88:0/3059492457 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c5c021070 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.073+0000 7f0c68ff9700 1 -- 172.21.15.88:0/3059492457 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0c5c01c400 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.073+0000 7f0c7288f700 1 -- 172.21.15.88:0/3059492457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c10d9d0 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.073+0000 7f0c68ff9700 1 -- 172.21.15.88:0/3059492457 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c5c00e070 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.073+0000 7f0c7288f700 1 -- 172.21.15.88:0/3059492457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c10df10 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.075+0000 7f0c68ff9700 1 -- 172.21.15.88:0/3059492457 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0c5c013a30 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.075+0000 7f0c68ff9700 1 --2- 172.21.15.88:0/3059492457 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0c54068f60 0x7f0c5406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:03.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.075+0000 7f0c68ff9700 1 -- 172.21.15.88:0/3059492457 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0c5c088150 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.076+0000 7f0c6b7fe700 1 --2- 172.21.15.88:0/3059492457 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0c54068f60 0x7f0c5406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:03.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.076+0000 7f0c6b7fe700 1 --2- 172.21.15.88:0/3059492457 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0c54068f60 0x7f0c5406b410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0c60004600 tx=0x7f0c6000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:03.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.078+0000 7f0c7288f700 1 -- 172.21.15.88:0/3059492457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6c04bb80 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.080 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:02 smithi088 ceph-mon[112028]: pgmap v169: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-09T02:34:03.080 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:02 smithi088 ceph-mon[112028]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:03.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.083+0000 7f0c68ff9700 1 -- 172.21.15.88:0/3059492457 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0c5c058060 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:02 smithi161 ceph-mon[121170]: pgmap v169: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-09T02:34:03.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:02 smithi161 ceph-mon[121170]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:03.371 INFO:tasks.workunit.client.1.smithi161.stderr:Note: switching to '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'. 2023-12-09T02:34:03.371 INFO:tasks.workunit.client.1.smithi161.stderr: 2023-12-09T02:34:03.371 INFO:tasks.workunit.client.1.smithi161.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-09T02:34:03.371 INFO:tasks.workunit.client.1.smithi161.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-09T02:34:03.371 INFO:tasks.workunit.client.1.smithi161.stderr:state without impacting any branches by switching back to a branch. 2023-12-09T02:34:03.371 INFO:tasks.workunit.client.1.smithi161.stderr: 2023-12-09T02:34:03.371 INFO:tasks.workunit.client.1.smithi161.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-09T02:34:03.371 INFO:tasks.workunit.client.1.smithi161.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-09T02:34:03.371 INFO:tasks.workunit.client.1.smithi161.stderr: 2023-12-09T02:34:03.371 INFO:tasks.workunit.client.1.smithi161.stderr: git switch -c 2023-12-09T02:34:03.372 INFO:tasks.workunit.client.1.smithi161.stderr: 2023-12-09T02:34:03.372 INFO:tasks.workunit.client.1.smithi161.stderr:Or undo this operation with: 2023-12-09T02:34:03.372 INFO:tasks.workunit.client.1.smithi161.stderr: 2023-12-09T02:34:03.372 INFO:tasks.workunit.client.1.smithi161.stderr: git switch - 2023-12-09T02:34:03.372 INFO:tasks.workunit.client.1.smithi161.stderr: 2023-12-09T02:34:03.372 INFO:tasks.workunit.client.1.smithi161.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-09T02:34:03.372 INFO:tasks.workunit.client.1.smithi161.stderr: 2023-12-09T02:34:03.372 INFO:tasks.workunit.client.1.smithi161.stderr:HEAD is now at 9dcc13bb80d Merge pull request #54751 from zdover23/wip-doc-2023-12-02-radosgw-multisite-starting-the-gateway 2023-12-09T02:34:03.375 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-09T02:34:03.438 INFO:tasks.workunit.client.1.smithi161.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-09T02:34:03.440 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-09T02:34:03.440 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-09T02:34:03.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.588+0000 7f0c7288f700 1 -- 172.21.15.88:0/3059492457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0c6c104490 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.588+0000 7f0c68ff9700 1 -- 172.21.15.88:0/3059492457 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f0c5c057bf0 con 0x7f0c6c0fbaf0 2023-12-09T02:34:03.590 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:34:03.590 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:34:03.590 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-09T02:34:03.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:34:03.590 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:34:03.590 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-09T02:34:03.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:34:03.591 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:34:03.591 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-09T02:34:03.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:34:03.591 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:34:03.591 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:34:03.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:34:03.591 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:34:03.591 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 14 2023-12-09T02:34:03.591 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:34:03.591 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:34:03.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.591+0000 7f0c7288f700 1 -- 172.21.15.88:0/3059492457 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0c54068f60 msgr2=0x7f0c5406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:03.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.591+0000 7f0c7288f700 1 --2- 172.21.15.88:0/3059492457 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0c54068f60 0x7f0c5406b410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0c60004600 tx=0x7f0c6000b040 comp rx=0 tx=0).stop 2023-12-09T02:34:03.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.591+0000 7f0c7288f700 1 -- 172.21.15.88:0/3059492457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c6c0fbaf0 msgr2=0x7f0c6c10c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:03.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.591+0000 7f0c7288f700 1 --2- 172.21.15.88:0/3059492457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c6c0fbaf0 0x7f0c6c10c3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c000c00 tx=0x7f0c5c009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:03.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.591+0000 7f0c7288f700 1 -- 172.21.15.88:0/3059492457 shutdown_connections 2023-12-09T02:34:03.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.591+0000 7f0c7288f700 1 --2- 172.21.15.88:0/3059492457 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f0c54068f60 0x7f0c5406b410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:03.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.591+0000 7f0c7288f700 1 --2- 172.21.15.88:0/3059492457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c6c0fbaf0 0x7f0c6c10c3f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:03.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.591+0000 7f0c7288f700 1 --2- 172.21.15.88:0/3059492457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6c0fcd00 0x7f0c6c10c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:03.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.591+0000 7f0c7288f700 1 -- 172.21.15.88:0/3059492457 >> 172.21.15.88:0/3059492457 conn(0x7f0c6c0f7190 msgr2=0x7f0c6c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:03.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.592+0000 7f0c7288f700 1 -- 172.21.15.88:0/3059492457 shutdown_connections 2023-12-09T02:34:03.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.592+0000 7f0c7288f700 1 -- 172.21.15.88:0/3059492457 wait complete. 2023-12-09T02:34:03.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.744+0000 7f6b5ceef700 1 -- 172.21.15.88:0/77115734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b580fcd00 msgr2=0x7f6b580fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:03.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.744+0000 7f6b5ceef700 1 --2- 172.21.15.88:0/77115734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b580fcd00 0x7f6b580fd150 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c004940 tx=0x7f6b4c009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:03.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.744+0000 7f6b5ceef700 1 -- 172.21.15.88:0/77115734 shutdown_connections 2023-12-09T02:34:03.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.744+0000 7f6b5ceef700 1 --2- 172.21.15.88:0/77115734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b580fcd00 0x7f6b580fd150 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:03.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.744+0000 7f6b5ceef700 1 --2- 172.21.15.88:0/77115734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b580fbaf0 0x7f6b580fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:03.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.744+0000 7f6b5ceef700 1 -- 172.21.15.88:0/77115734 >> 172.21.15.88:0/77115734 conn(0x7f6b580f7190 msgr2=0x7f6b580f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:03.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.744+0000 7f6b5ceef700 1 -- 172.21.15.88:0/77115734 shutdown_connections 2023-12-09T02:34:03.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.744+0000 7f6b5ceef700 1 -- 172.21.15.88:0/77115734 wait complete. 2023-12-09T02:34:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.745+0000 7f6b5ceef700 1 Processor -- start 2023-12-09T02:34:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.745+0000 7f6b5ceef700 1 -- start start 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.745+0000 7f6b5ceef700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b580fbaf0 0x7f6b5810c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.745+0000 7f6b5ceef700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b580fcd00 0x7f6b5810c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.745+0000 7f6b5ceef700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5810cf10 con 0x7f6b580fcd00 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.745+0000 7f6b5ceef700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5810d7b0 con 0x7f6b580fbaf0 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b55d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b580fcd00 0x7f6b5810c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b5659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b580fbaf0 0x7f6b5810c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b55d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b580fcd00 0x7f6b5810c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34400/0 (socket says 172.21.15.88:34400) 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b55d9b700 1 -- 172.21.15.88:0/456355939 learned_addr learned my addr 172.21.15.88:0/456355939 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b5659c700 1 -- 172.21.15.88:0/456355939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b580fcd00 msgr2=0x7f6b5810c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b5659c700 1 --2- 172.21.15.88:0/456355939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b580fcd00 0x7f6b5810c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b5659c700 1 -- 172.21.15.88:0/456355939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c005040 con 0x7f6b580fbaf0 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b55d9b700 1 --2- 172.21.15.88:0/456355939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b580fcd00 0x7f6b5810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b5659c700 1 --2- 172.21.15.88:0/456355939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b580fbaf0 0x7f6b5810c3d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6b580fcb60 tx=0x7f6b4800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b46ffd700 1 -- 172.21.15.88:0/456355939 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b48015070 con 0x7f6b580fbaf0 2023-12-09T02:34:03.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b5ceef700 1 -- 172.21.15.88:0/456355939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5810da30 con 0x7f6b580fbaf0 2023-12-09T02:34:03.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b5ceef700 1 -- 172.21.15.88:0/456355939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5810df70 con 0x7f6b580fbaf0 2023-12-09T02:34:03.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b46ffd700 1 -- 172.21.15.88:0/456355939 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b48010e50 con 0x7f6b580fbaf0 2023-12-09T02:34:03.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.746+0000 7f6b46ffd700 1 -- 172.21.15.88:0/456355939 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b48009900 con 0x7f6b580fbaf0 2023-12-09T02:34:03.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.747+0000 7f6b5ceef700 1 -- 172.21.15.88:0/456355939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b380052e0 con 0x7f6b580fbaf0 2023-12-09T02:34:03.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.748+0000 7f6b46ffd700 1 -- 172.21.15.88:0/456355939 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6b4800b900 con 0x7f6b580fbaf0 2023-12-09T02:34:03.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.749+0000 7f6b46ffd700 1 --2- 172.21.15.88:0/456355939 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6b40068f60 0x7f6b4006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:03.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.749+0000 7f6b46ffd700 1 -- 172.21.15.88:0/456355939 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6b4808b680 con 0x7f6b580fbaf0 2023-12-09T02:34:03.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.749+0000 7f6b55d9b700 1 --2- 172.21.15.88:0/456355939 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6b40068f60 0x7f6b4006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:03.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.749+0000 7f6b55d9b700 1 --2- 172.21.15.88:0/456355939 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6b40068f60 0x7f6b4006b410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0135e0 tx=0x7f6b4c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:03.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:03.752+0000 7f6b46ffd700 1 -- 172.21.15.88:0/456355939 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6b4805b4f0 con 0x7f6b580fbaf0 2023-12-09T02:34:04.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.030+0000 7f6b5ceef700 1 -- 172.21.15.88:0/456355939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6b38005860 con 0x7f6b580fbaf0 2023-12-09T02:34:04.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.031+0000 7f6b46ffd700 1 -- 172.21.15.88:0/456355939 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1810 (secure 0 0 0) 0x7f6b4805b080 con 0x7f6b580fbaf0 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:34:04.033 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:34:04.034 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:34:04.035 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:34:04.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.033+0000 7f6b5ceef700 1 -- 172.21.15.88:0/456355939 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6b40068f60 msgr2=0x7f6b4006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:04.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.033+0000 7f6b5ceef700 1 --2- 172.21.15.88:0/456355939 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6b40068f60 0x7f6b4006b410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0135e0 tx=0x7f6b4c009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:04.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.033+0000 7f6b5ceef700 1 -- 172.21.15.88:0/456355939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b580fbaf0 msgr2=0x7f6b5810c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:04.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.033+0000 7f6b5ceef700 1 --2- 172.21.15.88:0/456355939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b580fbaf0 0x7f6b5810c3d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6b580fcb60 tx=0x7f6b4800b040 comp rx=0 tx=0).stop 2023-12-09T02:34:04.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.033+0000 7f6b5ceef700 1 -- 172.21.15.88:0/456355939 shutdown_connections 2023-12-09T02:34:04.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.033+0000 7f6b5ceef700 1 --2- 172.21.15.88:0/456355939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b580fbaf0 0x7f6b5810c3d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.033+0000 7f6b5ceef700 1 --2- 172.21.15.88:0/456355939 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6b40068f60 0x7f6b4006b410 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.033+0000 7f6b5ceef700 1 --2- 172.21.15.88:0/456355939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b580fcd00 0x7f6b5810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.033+0000 7f6b5ceef700 1 -- 172.21.15.88:0/456355939 >> 172.21.15.88:0/456355939 conn(0x7f6b580f7190 msgr2=0x7f6b580fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:04.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.034+0000 7f6b5ceef700 1 -- 172.21.15.88:0/456355939 shutdown_connections 2023-12-09T02:34:04.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.034+0000 7f6b5ceef700 1 -- 172.21.15.88:0/456355939 wait complete. 2023-12-09T02:34:04.037 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:34:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.144+0000 7f691d876700 1 -- 172.21.15.88:0/3636362504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69181020e0 msgr2=0x7f69181044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.144+0000 7f691d876700 1 --2- 172.21.15.88:0/3636362504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69181020e0 0x7f69181044c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f690c004940 tx=0x7f690c009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:04.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.144+0000 7f691d876700 1 -- 172.21.15.88:0/3636362504 shutdown_connections 2023-12-09T02:34:04.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.144+0000 7f691d876700 1 --2- 172.21.15.88:0/3636362504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69181020e0 0x7f69181044c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.144+0000 7f691d876700 1 --2- 172.21.15.88:0/3636362504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6918066090 0x7f6918101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.144+0000 7f691d876700 1 -- 172.21.15.88:0/3636362504 >> 172.21.15.88:0/3636362504 conn(0x7f69180f7190 msgr2=0x7f69180f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:04.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.144+0000 7f691d876700 1 -- 172.21.15.88:0/3636362504 shutdown_connections 2023-12-09T02:34:04.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.144+0000 7f691d876700 1 -- 172.21.15.88:0/3636362504 wait complete. 2023-12-09T02:34:04.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.145+0000 7f691d876700 1 Processor -- start 2023-12-09T02:34:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.145+0000 7f691d876700 1 -- start start 2023-12-09T02:34:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.145+0000 7f691d876700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6918066090 0x7f691810f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.145+0000 7f691d876700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69181020e0 0x7f691810fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.145+0000 7f691d876700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918110240 con 0x7f69181020e0 2023-12-09T02:34:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.145+0000 7f691d876700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918110ae0 con 0x7f6918066090 2023-12-09T02:34:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.145+0000 7f69167fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69181020e0 0x7f691810fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.145+0000 7f69167fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69181020e0 0x7f691810fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34428/0 (socket says 172.21.15.88:34428) 2023-12-09T02:34:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.145+0000 7f69167fc700 1 -- 172.21.15.88:0/876206033 learned_addr learned my addr 172.21.15.88:0/876206033 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.145+0000 7f6916ffd700 1 --2- 172.21.15.88:0/876206033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6918066090 0x7f691810f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:04.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.146+0000 7f69167fc700 1 -- 172.21.15.88:0/876206033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6918066090 msgr2=0x7f691810f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:04.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.146+0000 7f69167fc700 1 --2- 172.21.15.88:0/876206033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6918066090 0x7f691810f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.146+0000 7f69167fc700 1 -- 172.21.15.88:0/876206033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c005040 con 0x7f69181020e0 2023-12-09T02:34:04.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.146+0000 7f69167fc700 1 --2- 172.21.15.88:0/876206033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69181020e0 0x7f691810fc40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f690c000c00 tx=0x7f690c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:04.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.146+0000 7f68ff7fe700 1 -- 172.21.15.88:0/876206033 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f690c021070 con 0x7f69181020e0 2023-12-09T02:34:04.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.146+0000 7f691d876700 1 -- 172.21.15.88:0/876206033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6918110d60 con 0x7f69181020e0 2023-12-09T02:34:04.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.146+0000 7f691d876700 1 -- 172.21.15.88:0/876206033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6918111240 con 0x7f69181020e0 2023-12-09T02:34:04.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.146+0000 7f68ff7fe700 1 -- 172.21.15.88:0/876206033 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f690c01c400 con 0x7f69181020e0 2023-12-09T02:34:04.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.146+0000 7f68ff7fe700 1 -- 172.21.15.88:0/876206033 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f690c00e070 con 0x7f69181020e0 2023-12-09T02:34:04.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.147+0000 7f691d876700 1 -- 172.21.15.88:0/876206033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69040052e0 con 0x7f69181020e0 2023-12-09T02:34:04.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.148+0000 7f68ff7fe700 1 -- 172.21.15.88:0/876206033 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f690c013a30 con 0x7f69181020e0 2023-12-09T02:34:04.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.148+0000 7f68ff7fe700 1 --2- 172.21.15.88:0/876206033 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6900068f60 0x7f690006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:04.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.149+0000 7f68ff7fe700 1 -- 172.21.15.88:0/876206033 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f690c087f90 con 0x7f69181020e0 2023-12-09T02:34:04.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.152+0000 7f6916ffd700 1 --2- 172.21.15.88:0/876206033 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6900068f60 0x7f690006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:04.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.152+0000 7f6916ffd700 1 --2- 172.21.15.88:0/876206033 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6900068f60 0x7f690006b410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6908009b80 tx=0x7f690800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:04.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.153+0000 7f68ff7fe700 1 -- 172.21.15.88:0/876206033 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f690c057e00 con 0x7f69181020e0 2023-12-09T02:34:04.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:03 smithi161 ceph-mon[121170]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:04.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:03 smithi161 ceph-mon[121170]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:04.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:03 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:34:04.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:03 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:34:04.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:03 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:34:04.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:03 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3059492457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:34:04.196 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-09T02:34:04.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:03 smithi088 ceph-mon[112028]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:04.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:03 smithi088 ceph-mon[112028]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:04.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:03 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:34:04.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:03 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:34:04.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:03 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:34:04.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:03 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3059492457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:34:04.253 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-09T02:34:04.292 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-09T02:34:04.293 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-09T02:34:04.293 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-09T02:34:04.331 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-09T02:34:04.334 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:34:04.334 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-09T02:34:04.394 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-09T02:34:04.395 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-09T02:34:04.396 DEBUG:teuthology.orchestra.run.smithi161:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-09T02:34:04.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.436+0000 7f691d876700 1 -- 172.21.15.88:0/876206033 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6904000bf0 con 0x7f6900068f60 2023-12-09T02:34:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.438+0000 7f68ff7fe700 1 -- 172.21.15.88:0/876206033 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f6904000bf0 con 0x7f6900068f60 2023-12-09T02:34:04.439 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:34:04.439 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:34:04.439 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:34:04.439 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:34:04.439 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2023-12-09T02:34:04.439 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "0/21 daemons upgraded", 2023-12-09T02:34:04.440 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389 image on host smithi161", 2023-12-09T02:34:04.440 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:34:04.440 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:34:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.440+0000 7f691d876700 1 -- 172.21.15.88:0/876206033 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6900068f60 msgr2=0x7f690006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.440+0000 7f691d876700 1 --2- 172.21.15.88:0/876206033 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6900068f60 0x7f690006b410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6908009b80 tx=0x7f690800b040 comp rx=0 tx=0).stop 2023-12-09T02:34:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.440+0000 7f691d876700 1 -- 172.21.15.88:0/876206033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69181020e0 msgr2=0x7f691810fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.440+0000 7f691d876700 1 --2- 172.21.15.88:0/876206033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69181020e0 0x7f691810fc40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f690c000c00 tx=0x7f690c009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.441+0000 7f691d876700 1 -- 172.21.15.88:0/876206033 shutdown_connections 2023-12-09T02:34:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.441+0000 7f691d876700 1 --2- 172.21.15.88:0/876206033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6918066090 0x7f691810f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.441+0000 7f691d876700 1 --2- 172.21.15.88:0/876206033 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6900068f60 0x7f690006b410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.441+0000 7f691d876700 1 --2- 172.21.15.88:0/876206033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69181020e0 0x7f691810fc40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.441+0000 7f691d876700 1 -- 172.21.15.88:0/876206033 >> 172.21.15.88:0/876206033 conn(0x7f69180f7190 msgr2=0x7f69180f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:04.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.441+0000 7f691d876700 1 -- 172.21.15.88:0/876206033 shutdown_connections 2023-12-09T02:34:04.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.441+0000 7f691d876700 1 -- 172.21.15.88:0/876206033 wait complete. 2023-12-09T02:34:04.458 INFO:tasks.workunit.client.1.smithi161.stderr:+ mkdir -p fsstress 2023-12-09T02:34:04.459 INFO:tasks.workunit.client.1.smithi161.stderr:+ pushd fsstress 2023-12-09T02:34:04.459 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-09T02:34:04.460 INFO:tasks.workunit.client.1.smithi161.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-09T02:34:04.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.553+0000 7f7038f31700 1 -- 172.21.15.88:0/1748533442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70340fb290 msgr2=0x7f70340fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:04.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.553+0000 7f7038f31700 1 --2- 172.21.15.88:0/1748533442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70340fb290 0x7f70340fb6a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7024004a50 tx=0x7f702400af40 comp rx=0 tx=0).stop 2023-12-09T02:34:04.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.553+0000 7f7038f31700 1 -- 172.21.15.88:0/1748533442 shutdown_connections 2023-12-09T02:34:04.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.553+0000 7f7038f31700 1 --2- 172.21.15.88:0/1748533442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70340fc4a0 0x7f70340fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.553+0000 7f7038f31700 1 --2- 172.21.15.88:0/1748533442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70340fb290 0x7f70340fb6a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.553+0000 7f7038f31700 1 -- 172.21.15.88:0/1748533442 >> 172.21.15.88:0/1748533442 conn(0x7f70340f6950 msgr2=0x7f70340f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:04.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.553+0000 7f7038f31700 1 -- 172.21.15.88:0/1748533442 shutdown_connections 2023-12-09T02:34:04.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.554+0000 7f7038f31700 1 -- 172.21.15.88:0/1748533442 wait complete. 2023-12-09T02:34:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.554+0000 7f7038f31700 1 Processor -- start 2023-12-09T02:34:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.554+0000 7f7038f31700 1 -- start start 2023-12-09T02:34:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.554+0000 7f7038f31700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70340fb290 0x7f703410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.554+0000 7f7038f31700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70340fc4a0 0x7f703410daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.554+0000 7f7038f31700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703410e180 con 0x7f70340fb290 2023-12-09T02:34:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.554+0000 7f7038f31700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703410e9c0 con 0x7f70340fc4a0 2023-12-09T02:34:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f703259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70340fb290 0x7f703410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f703259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70340fb290 0x7f703410d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34432/0 (socket says 172.21.15.88:34432) 2023-12-09T02:34:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f703259c700 1 -- 172.21.15.88:0/1169056769 learned_addr learned my addr 172.21.15.88:0/1169056769 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f7031d9b700 1 --2- 172.21.15.88:0/1169056769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70340fc4a0 0x7f703410daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f703259c700 1 -- 172.21.15.88:0/1169056769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70340fc4a0 msgr2=0x7f703410daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f703259c700 1 --2- 172.21.15.88:0/1169056769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70340fc4a0 0x7f703410daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f703259c700 1 -- 172.21.15.88:0/1169056769 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024005040 con 0x7f70340fb290 2023-12-09T02:34:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f703259c700 1 --2- 172.21.15.88:0/1169056769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70340fb290 0x7f703410d5b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7024004710 tx=0x7f702400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f7022ffd700 1 -- 172.21.15.88:0/1169056769 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f702400f070 con 0x7f70340fb290 2023-12-09T02:34:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f7038f31700 1 -- 172.21.15.88:0/1169056769 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703410ec40 con 0x7f70340fb290 2023-12-09T02:34:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f7022ffd700 1 -- 172.21.15.88:0/1169056769 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f702401c8d0 con 0x7f70340fb290 2023-12-09T02:34:04.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f7022ffd700 1 -- 172.21.15.88:0/1169056769 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7024014800 con 0x7f70340fb290 2023-12-09T02:34:04.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.555+0000 7f7038f31700 1 -- 172.21.15.88:0/1169056769 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703410f120 con 0x7f70340fb290 2023-12-09T02:34:04.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.557+0000 7f7038f31700 1 -- 172.21.15.88:0/1169056769 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7034105470 con 0x7f70340fb290 2023-12-09T02:34:04.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.557+0000 7f7022ffd700 1 -- 172.21.15.88:0/1169056769 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f702401ca40 con 0x7f70340fb290 2023-12-09T02:34:04.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.558+0000 7f7022ffd700 1 --2- 172.21.15.88:0/1169056769 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f701c068f60 0x7f701c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:04.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.558+0000 7f7022ffd700 1 -- 172.21.15.88:0/1169056769 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7024088700 con 0x7f70340fb290 2023-12-09T02:34:04.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.558+0000 7f7031d9b700 1 --2- 172.21.15.88:0/1169056769 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f701c068f60 0x7f701c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:04.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.558+0000 7f7031d9b700 1 --2- 172.21.15.88:0/1169056769 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f701c068f60 0x7f701c06b410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7028009bf0 tx=0x7f70280091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:04.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.562+0000 7f7022ffd700 1 -- 172.21.15.88:0/1169056769 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f70240586b0 con 0x7f70340fb290 2023-12-09T02:34:04.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.978+0000 7f7038f31700 1 -- 172.21.15.88:0/1169056769 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7034104e90 con 0x7f70340fb290 2023-12-09T02:34:04.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.978+0000 7f7022ffd700 1 -- 172.21.15.88:0/1169056769 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7024058240 con 0x7f70340fb290 2023-12-09T02:34:04.980 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:34:04.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.981+0000 7f7038f31700 1 -- 172.21.15.88:0/1169056769 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f701c068f60 msgr2=0x7f701c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:04.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.981+0000 7f7038f31700 1 --2- 172.21.15.88:0/1169056769 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f701c068f60 0x7f701c06b410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7028009bf0 tx=0x7f70280091a0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.981+0000 7f7038f31700 1 -- 172.21.15.88:0/1169056769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70340fb290 msgr2=0x7f703410d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:04.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.981+0000 7f7038f31700 1 --2- 172.21.15.88:0/1169056769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70340fb290 0x7f703410d5b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7024004710 tx=0x7f702400af40 comp rx=0 tx=0).stop 2023-12-09T02:34:04.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.981+0000 7f7038f31700 1 -- 172.21.15.88:0/1169056769 shutdown_connections 2023-12-09T02:34:04.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.981+0000 7f7038f31700 1 --2- 172.21.15.88:0/1169056769 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f701c068f60 0x7f701c06b410 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.981+0000 7f7038f31700 1 --2- 172.21.15.88:0/1169056769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70340fb290 0x7f703410d5b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.981+0000 7f7038f31700 1 --2- 172.21.15.88:0/1169056769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70340fc4a0 0x7f703410daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:04.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.981+0000 7f7038f31700 1 -- 172.21.15.88:0/1169056769 >> 172.21.15.88:0/1169056769 conn(0x7f70340f6950 msgr2=0x7f70340f8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:04.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.981+0000 7f7038f31700 1 -- 172.21.15.88:0/1169056769 shutdown_connections 2023-12-09T02:34:04.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:04.981+0000 7f7038f31700 1 -- 172.21.15.88:0/1169056769 wait complete. 2023-12-09T02:34:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:04 smithi161 ceph-mon[121170]: Upgrade: Target is version 19.0.0-44-g9dcc13bb (unknown) 2023-12-09T02:34:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:04 smithi161 ceph-mon[121170]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389'] 2023-12-09T02:34:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:04 smithi161 ceph-mon[121170]: Upgrade: Need to upgrade myself (mgr.smithi088.jwlofb) 2023-12-09T02:34:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:04 smithi161 ceph-mon[121170]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389 on smithi161 2023-12-09T02:34:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:04 smithi161 ceph-mon[121170]: pgmap v170: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-09T02:34:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:04 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/456355939' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:34:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:04 smithi088 ceph-mon[112028]: Upgrade: Target is version 19.0.0-44-g9dcc13bb (unknown) 2023-12-09T02:34:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:04 smithi088 ceph-mon[112028]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389'] 2023-12-09T02:34:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:04 smithi088 ceph-mon[112028]: Upgrade: Need to upgrade myself (mgr.smithi088.jwlofb) 2023-12-09T02:34:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:04 smithi088 ceph-mon[112028]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389 on smithi161 2023-12-09T02:34:05.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:04 smithi088 ceph-mon[112028]: pgmap v170: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-09T02:34:05.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:04 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/456355939' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:34:05.416 INFO:tasks.workunit.client.1.smithi161.stderr:+ tar xzf ltp-full.tgz 2023-12-09T02:34:06.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:05 smithi161 ceph-mon[121170]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:06.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:05 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/1169056769' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:34:06.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:05 smithi088 ceph-mon[112028]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:06.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:05 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/1169056769' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:34:07.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:06 smithi161 ceph-mon[121170]: pgmap v171: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-09T02:34:07.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:06 smithi088 ceph-mon[112028]: pgmap v171: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-09T02:34:08.792 INFO:tasks.workunit.client.0.smithi088.stderr:Note: switching to '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'. 2023-12-09T02:34:08.792 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-12-09T02:34:08.792 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-09T02:34:08.792 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-09T02:34:08.792 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by switching back to a branch. 2023-12-09T02:34:08.792 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-12-09T02:34:08.792 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-09T02:34:08.792 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-09T02:34:08.793 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-12-09T02:34:08.793 INFO:tasks.workunit.client.0.smithi088.stderr: git switch -c 2023-12-09T02:34:08.793 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-12-09T02:34:08.793 INFO:tasks.workunit.client.0.smithi088.stderr:Or undo this operation with: 2023-12-09T02:34:08.793 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-12-09T02:34:08.793 INFO:tasks.workunit.client.0.smithi088.stderr: git switch - 2023-12-09T02:34:08.793 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-12-09T02:34:08.793 INFO:tasks.workunit.client.0.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-09T02:34:08.793 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-12-09T02:34:08.793 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at 9dcc13bb80d Merge pull request #54751 from zdover23/wip-doc-2023-12-02-radosgw-multisite-starting-the-gateway 2023-12-09T02:34:08.797 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-09T02:34:08.824 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-09T02:34:08.826 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-09T02:34:08.826 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-09T02:34:09.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:08 smithi161 ceph-mon[121170]: pgmap v172: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-09T02:34:09.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:08 smithi088 ceph-mon[112028]: pgmap v172: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-09T02:34:09.373 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-09T02:34:09.431 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-09T02:34:09.467 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-09T02:34:09.469 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-09T02:34:09.469 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-09T02:34:09.505 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-09T02:34:09.508 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:34:09.508 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-09T02:34:09.566 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-09T02:34:09.567 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-09T02:34:09.567 DEBUG:teuthology.orchestra.run.smithi088:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-09T02:34:09.683 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir -p fsstress 2023-12-09T02:34:09.699 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-09T02:34:09.700 INFO:tasks.workunit.client.0.smithi088.stderr:+ pushd fsstress 2023-12-09T02:34:09.700 INFO:tasks.workunit.client.0.smithi088.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-09T02:34:11.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:10 smithi161 ceph-mon[121170]: pgmap v173: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 KiB/s wr, 1 op/s 2023-12-09T02:34:11.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:10 smithi088 ceph-mon[112028]: pgmap v173: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 KiB/s wr, 1 op/s 2023-12-09T02:34:11.911 INFO:tasks.workunit.client.0.smithi088.stderr:+ tar xzf ltp-full.tgz 2023-12-09T02:34:13.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:12 smithi161 ceph-mon[121170]: pgmap v174: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 KiB/s wr, 1 op/s 2023-12-09T02:34:13.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:12 smithi088 ceph-mon[112028]: pgmap v174: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 KiB/s wr, 1 op/s 2023-12-09T02:34:15.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:14 smithi161 ceph-mon[121170]: pgmap v175: 65 pgs: 65 active+clean; 41 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.5 MiB/s wr, 282 op/s 2023-12-09T02:34:15.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:14 smithi088 ceph-mon[112028]: pgmap v175: 65 pgs: 65 active+clean; 41 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.5 MiB/s wr, 282 op/s 2023-12-09T02:34:17.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:16 smithi161 ceph-mon[121170]: pgmap v176: 65 pgs: 65 active+clean; 53 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s wr, 349 op/s 2023-12-09T02:34:17.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:16 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:34:17.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:16 smithi088 ceph-mon[112028]: pgmap v176: 65 pgs: 65 active+clean; 53 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s wr, 349 op/s 2023-12-09T02:34:17.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:16 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:34:19.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:18 smithi161 ceph-mon[121170]: pgmap v177: 65 pgs: 65 active+clean; 58 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 5.0 MiB/s wr, 388 op/s 2023-12-09T02:34:19.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:18 smithi088 ceph-mon[112028]: pgmap v177: 65 pgs: 65 active+clean; 58 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 5.0 MiB/s wr, 388 op/s 2023-12-09T02:34:21.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:20 smithi161 ceph-mon[121170]: pgmap v178: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 480 op/s 2023-12-09T02:34:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:20 smithi088 ceph-mon[112028]: pgmap v178: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 480 op/s 2023-12-09T02:34:23.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:22 smithi161 ceph-mon[121170]: pgmap v179: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s wr, 480 op/s 2023-12-09T02:34:23.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:22 smithi088 ceph-mon[112028]: pgmap v179: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s wr, 480 op/s 2023-12-09T02:34:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:24 smithi161 ceph-mon[121170]: pgmap v180: 65 pgs: 65 active+clean; 82 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 480 op/s 2023-12-09T02:34:25.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:24 smithi088 ceph-mon[112028]: pgmap v180: 65 pgs: 65 active+clean; 82 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 480 op/s 2023-12-09T02:34:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:26 smithi161 ceph-mon[121170]: pgmap v181: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 199 op/s 2023-12-09T02:34:27.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:26 smithi088 ceph-mon[112028]: pgmap v181: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 199 op/s 2023-12-09T02:34:29.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:28 smithi161 ceph-mon[121170]: pgmap v182: 65 pgs: 65 active+clean; 94 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s wr, 245 op/s 2023-12-09T02:34:29.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:28 smithi088 ceph-mon[112028]: pgmap v182: 65 pgs: 65 active+clean; 94 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s wr, 245 op/s 2023-12-09T02:34:29.318 INFO:tasks.workunit.client.1.smithi161.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-09T02:34:29.318 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-09T02:34:29.318 INFO:tasks.workunit.client.1.smithi161.stderr:+ make 2023-12-09T02:34:31.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:30 smithi161 ceph-mon[121170]: pgmap v183: 65 pgs: 65 active+clean; 118 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.3 MiB/s wr, 494 op/s 2023-12-09T02:34:31.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:30 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:34:31.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:30 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:34:31.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:30 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:34:31.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:30 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:34:31.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:30 smithi088 ceph-mon[112028]: pgmap v183: 65 pgs: 65 active+clean; 118 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.3 MiB/s wr, 494 op/s 2023-12-09T02:34:31.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:30 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:34:31.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:30 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:34:31.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:30 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:34:31.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:30 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:34:31.860 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:31 smithi161 ceph-mon[121170]: Upgrade: Updating mgr.smithi161.qmxtmg 2023-12-09T02:34:31.860 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:31 smithi161 ceph-mon[121170]: Deploying daemon mgr.smithi161.qmxtmg on smithi161 2023-12-09T02:34:31.860 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:31 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:34:32.066 INFO:tasks.workunit.client.1.smithi161.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-09T02:34:32.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:31 smithi088 ceph-mon[112028]: Upgrade: Updating mgr.smithi161.qmxtmg 2023-12-09T02:34:32.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:31 smithi088 ceph-mon[112028]: Deploying daemon mgr.smithi161.qmxtmg on smithi161 2023-12-09T02:34:32.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:31 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:34:33.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:32 smithi161 ceph-mon[121170]: pgmap v184: 65 pgs: 65 active+clean; 118 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s wr, 402 op/s 2023-12-09T02:34:33.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:32 smithi088 ceph-mon[112028]: pgmap v184: 65 pgs: 65 active+clean; 118 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s wr, 402 op/s 2023-12-09T02:34:35.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.098+0000 7ff58f4f4700 1 -- 172.21.15.88:0/3547751845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5880fbaf0 msgr2=0x7ff5880fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.098+0000 7ff58f4f4700 1 --2- 172.21.15.88:0/3547751845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5880fbaf0 0x7ff5880fbf00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff580009ce0 tx=0x7ff580004d10 comp rx=0 tx=0).stop 2023-12-09T02:34:35.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.098+0000 7ff58f4f4700 1 -- 172.21.15.88:0/3547751845 shutdown_connections 2023-12-09T02:34:35.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.098+0000 7ff58f4f4700 1 --2- 172.21.15.88:0/3547751845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5880fcd00 0x7ff5880fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.098+0000 7ff58f4f4700 1 --2- 172.21.15.88:0/3547751845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5880fbaf0 0x7ff5880fbf00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.098+0000 7ff58f4f4700 1 -- 172.21.15.88:0/3547751845 >> 172.21.15.88:0/3547751845 conn(0x7ff5880f7190 msgr2=0x7ff5880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:35.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.098+0000 7ff58f4f4700 1 -- 172.21.15.88:0/3547751845 shutdown_connections 2023-12-09T02:34:35.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.099+0000 7ff58f4f4700 1 -- 172.21.15.88:0/3547751845 wait complete. 2023-12-09T02:34:35.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.099+0000 7ff58f4f4700 1 Processor -- start 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.099+0000 7ff58f4f4700 1 -- start start 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.099+0000 7ff58f4f4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5880fbaf0 0x7ff58810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.099+0000 7ff58f4f4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5880fcd00 0x7ff58810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.099+0000 7ff58f4f4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58810e0c0 con 0x7ff5880fbaf0 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.099+0000 7ff58f4f4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58810e960 con 0x7ff5880fcd00 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.099+0000 7ff58d290700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5880fbaf0 0x7ff58810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.099+0000 7ff58d290700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5880fbaf0 0x7ff58810d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52054/0 (socket says 172.21.15.88:52054) 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.099+0000 7ff58d290700 1 -- 172.21.15.88:0/1283314847 learned_addr learned my addr 172.21.15.88:0/1283314847 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.099+0000 7ff58ca8f700 1 --2- 172.21.15.88:0/1283314847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5880fcd00 0x7ff58810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.100+0000 7ff58d290700 1 -- 172.21.15.88:0/1283314847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5880fcd00 msgr2=0x7ff58810dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.100+0000 7ff58d290700 1 --2- 172.21.15.88:0/1283314847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5880fcd00 0x7ff58810dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.100+0000 7ff58d290700 1 -- 172.21.15.88:0/1283314847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff580009940 con 0x7ff5880fbaf0 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.100+0000 7ff58d290700 1 --2- 172.21.15.88:0/1283314847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5880fbaf0 0x7ff58810d580 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff580004740 tx=0x7ff580004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:35.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.100+0000 7ff585ffb700 1 -- 172.21.15.88:0/1283314847 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff58000e040 con 0x7ff5880fbaf0 2023-12-09T02:34:35.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.100+0000 7ff585ffb700 1 -- 172.21.15.88:0/1283314847 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff58001cce0 con 0x7ff5880fbaf0 2023-12-09T02:34:35.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.100+0000 7ff58f4f4700 1 -- 172.21.15.88:0/1283314847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58810ebe0 con 0x7ff5880fbaf0 2023-12-09T02:34:35.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.100+0000 7ff585ffb700 1 -- 172.21.15.88:0/1283314847 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff580012c20 con 0x7ff5880fbaf0 2023-12-09T02:34:35.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.100+0000 7ff58f4f4700 1 -- 172.21.15.88:0/1283314847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58810f120 con 0x7ff5880fbaf0 2023-12-09T02:34:35.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.101+0000 7ff58f4f4700 1 -- 172.21.15.88:0/1283314847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58804bb80 con 0x7ff5880fbaf0 2023-12-09T02:34:35.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.103+0000 7ff585ffb700 1 -- 172.21.15.88:0/1283314847 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff580012410 con 0x7ff5880fbaf0 2023-12-09T02:34:35.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.103+0000 7ff585ffb700 1 --2- 172.21.15.88:0/1283314847 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff570068f60 0x7ff57006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:35.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.103+0000 7ff585ffb700 1 -- 172.21.15.88:0/1283314847 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff580089750 con 0x7ff5880fbaf0 2023-12-09T02:34:35.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.103+0000 7ff58ca8f700 1 --2- 172.21.15.88:0/1283314847 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff570068f60 0x7ff57006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:35.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.103+0000 7ff58ca8f700 1 --2- 172.21.15.88:0/1283314847 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff570068f60 0x7ff57006b410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009b80 tx=0x7ff57c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:35.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.107+0000 7ff585ffb700 1 -- 172.21.15.88:0/1283314847 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff5800595c0 con 0x7ff5880fbaf0 2023-12-09T02:34:35.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:34 smithi161 ceph-mon[121170]: pgmap v185: 65 pgs: 65 active+clean; 152 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.7 MiB/s wr, 851 op/s 2023-12-09T02:34:35.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:34 smithi088 ceph-mon[112028]: pgmap v185: 65 pgs: 65 active+clean; 152 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.7 MiB/s wr, 851 op/s 2023-12-09T02:34:35.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.313+0000 7ff58f4f4700 1 -- 172.21.15.88:0/1283314847 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff588065a80 con 0x7ff570068f60 2023-12-09T02:34:35.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.314+0000 7ff585ffb700 1 -- 172.21.15.88:0/1283314847 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7ff588065a80 con 0x7ff570068f60 2023-12-09T02:34:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.316+0000 7ff58f4f4700 1 -- 172.21.15.88:0/1283314847 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff570068f60 msgr2=0x7ff57006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.316+0000 7ff58f4f4700 1 --2- 172.21.15.88:0/1283314847 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff570068f60 0x7ff57006b410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009b80 tx=0x7ff57c00b040 comp rx=0 tx=0).stop 2023-12-09T02:34:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.316+0000 7ff58f4f4700 1 -- 172.21.15.88:0/1283314847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5880fbaf0 msgr2=0x7ff58810d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.316+0000 7ff58f4f4700 1 --2- 172.21.15.88:0/1283314847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5880fbaf0 0x7ff58810d580 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff580004740 tx=0x7ff580004d10 comp rx=0 tx=0).stop 2023-12-09T02:34:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.316+0000 7ff58f4f4700 1 -- 172.21.15.88:0/1283314847 shutdown_connections 2023-12-09T02:34:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.316+0000 7ff58f4f4700 1 --2- 172.21.15.88:0/1283314847 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7ff570068f60 0x7ff57006b410 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.316+0000 7ff58f4f4700 1 --2- 172.21.15.88:0/1283314847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5880fbaf0 0x7ff58810d580 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.316+0000 7ff58f4f4700 1 --2- 172.21.15.88:0/1283314847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5880fcd00 0x7ff58810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.316+0000 7ff58f4f4700 1 -- 172.21.15.88:0/1283314847 >> 172.21.15.88:0/1283314847 conn(0x7ff5880f7190 msgr2=0x7ff588065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.316+0000 7ff58f4f4700 1 -- 172.21.15.88:0/1283314847 shutdown_connections 2023-12-09T02:34:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.316+0000 7ff58f4f4700 1 -- 172.21.15.88:0/1283314847 wait complete. 2023-12-09T02:34:35.329 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:34:35.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.419+0000 7fc661cc6700 1 -- 172.21.15.88:0/1056570659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65c0ffd70 msgr2=0x7fc65c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.419+0000 7fc661cc6700 1 --2- 172.21.15.88:0/1056570659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65c0ffd70 0x7fc65c1021d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc644004940 tx=0x7fc644009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:35.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.420+0000 7fc661cc6700 1 -- 172.21.15.88:0/1056570659 shutdown_connections 2023-12-09T02:34:35.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.420+0000 7fc661cc6700 1 --2- 172.21.15.88:0/1056570659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65c0ffd70 0x7fc65c1021d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.420+0000 7fc661cc6700 1 --2- 172.21.15.88:0/1056570659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc65c066090 0x7fc65c0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.420+0000 7fc661cc6700 1 -- 172.21.15.88:0/1056570659 >> 172.21.15.88:0/1056570659 conn(0x7fc65c0f7190 msgr2=0x7fc65c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:35.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.420+0000 7fc661cc6700 1 -- 172.21.15.88:0/1056570659 shutdown_connections 2023-12-09T02:34:35.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.420+0000 7fc661cc6700 1 -- 172.21.15.88:0/1056570659 wait complete. 2023-12-09T02:34:35.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.420+0000 7fc661cc6700 1 Processor -- start 2023-12-09T02:34:35.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.420+0000 7fc661cc6700 1 -- start start 2023-12-09T02:34:35.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc661cc6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc65c066090 0x7fc65c10d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:35.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc661cc6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65c0ffd70 0x7fc65c10da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:35.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc661cc6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c10e040 con 0x7fc65c0ffd70 2023-12-09T02:34:35.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc661cc6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c10e8e0 con 0x7fc65c066090 2023-12-09T02:34:35.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc65affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65c0ffd70 0x7fc65c10da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:35.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc65affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65c0ffd70 0x7fc65c10da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52078/0 (socket says 172.21.15.88:52078) 2023-12-09T02:34:35.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc65affd700 1 -- 172.21.15.88:0/1416180349 learned_addr learned my addr 172.21.15.88:0/1416180349 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:35.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc65b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc65c066090 0x7fc65c10d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:35.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc65affd700 1 -- 172.21.15.88:0/1416180349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc65c066090 msgr2=0x7fc65c10d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc65affd700 1 --2- 172.21.15.88:0/1416180349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc65c066090 0x7fc65c10d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc65affd700 1 -- 172.21.15.88:0/1416180349 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc644005040 con 0x7fc65c0ffd70 2023-12-09T02:34:35.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc65affd700 1 --2- 172.21.15.88:0/1416180349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65c0ffd70 0x7fc65c10da40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc644000c00 tx=0x7fc644009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:35.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc653fff700 1 -- 172.21.15.88:0/1416180349 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc644021070 con 0x7fc65c0ffd70 2023-12-09T02:34:35.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc653fff700 1 -- 172.21.15.88:0/1416180349 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc64401c400 con 0x7fc65c0ffd70 2023-12-09T02:34:35.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc661cc6700 1 -- 172.21.15.88:0/1416180349 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65c10eb60 con 0x7fc65c0ffd70 2023-12-09T02:34:35.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc653fff700 1 -- 172.21.15.88:0/1416180349 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc64400e070 con 0x7fc65c0ffd70 2023-12-09T02:34:35.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.421+0000 7fc661cc6700 1 -- 172.21.15.88:0/1416180349 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c10f040 con 0x7fc65c0ffd70 2023-12-09T02:34:35.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.422+0000 7fc661cc6700 1 -- 172.21.15.88:0/1416180349 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65c04bb80 con 0x7fc65c0ffd70 2023-12-09T02:34:35.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.423+0000 7fc653fff700 1 -- 172.21.15.88:0/1416180349 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc64401ca00 con 0x7fc65c0ffd70 2023-12-09T02:34:35.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.423+0000 7fc653fff700 1 --2- 172.21.15.88:0/1416180349 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc648068f60 0x7fc64806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:35.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.423+0000 7fc653fff700 1 -- 172.21.15.88:0/1416180349 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc644087fa0 con 0x7fc65c0ffd70 2023-12-09T02:34:35.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.423+0000 7fc65b7fe700 1 --2- 172.21.15.88:0/1416180349 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc648068f60 0x7fc64806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:35.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.424+0000 7fc65b7fe700 1 --2- 172.21.15.88:0/1416180349 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc648068f60 0x7fc64806b410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009b80 tx=0x7fc64c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:35.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.428+0000 7fc653fff700 1 -- 172.21.15.88:0/1416180349 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc644057eb0 con 0x7fc65c0ffd70 2023-12-09T02:34:35.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.631+0000 7fc661cc6700 1 -- 172.21.15.88:0/1416180349 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc65c10f450 con 0x7fc648068f60 2023-12-09T02:34:35.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.632+0000 7fc653fff700 1 -- 172.21.15.88:0/1416180349 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fc65c10f450 con 0x7fc648068f60 2023-12-09T02:34:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.634+0000 7fc661cc6700 1 -- 172.21.15.88:0/1416180349 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc648068f60 msgr2=0x7fc64806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.634+0000 7fc661cc6700 1 --2- 172.21.15.88:0/1416180349 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc648068f60 0x7fc64806b410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009b80 tx=0x7fc64c00b040 comp rx=0 tx=0).stop 2023-12-09T02:34:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.634+0000 7fc661cc6700 1 -- 172.21.15.88:0/1416180349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65c0ffd70 msgr2=0x7fc65c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.634+0000 7fc661cc6700 1 --2- 172.21.15.88:0/1416180349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65c0ffd70 0x7fc65c10da40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc644000c00 tx=0x7fc644009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.634+0000 7fc661cc6700 1 -- 172.21.15.88:0/1416180349 shutdown_connections 2023-12-09T02:34:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.634+0000 7fc661cc6700 1 --2- 172.21.15.88:0/1416180349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc65c066090 0x7fc65c10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.634+0000 7fc661cc6700 1 --2- 172.21.15.88:0/1416180349 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc648068f60 0x7fc64806b410 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.634+0000 7fc661cc6700 1 --2- 172.21.15.88:0/1416180349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65c0ffd70 0x7fc65c10da40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.634+0000 7fc661cc6700 1 -- 172.21.15.88:0/1416180349 >> 172.21.15.88:0/1416180349 conn(0x7fc65c0f7190 msgr2=0x7fc65c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.635+0000 7fc661cc6700 1 -- 172.21.15.88:0/1416180349 shutdown_connections 2023-12-09T02:34:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.635+0000 7fc661cc6700 1 -- 172.21.15.88:0/1416180349 wait complete. 2023-12-09T02:34:35.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.735+0000 7f20d13c6700 1 -- 172.21.15.88:0/854046361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20cc0fbaf0 msgr2=0x7f20cc0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.735+0000 7f20d13c6700 1 --2- 172.21.15.88:0/854046361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20cc0fbaf0 0x7f20cc0fbf00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20c0004940 tx=0x7f20c0009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:35.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.735+0000 7f20d13c6700 1 -- 172.21.15.88:0/854046361 shutdown_connections 2023-12-09T02:34:35.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.735+0000 7f20d13c6700 1 --2- 172.21.15.88:0/854046361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20cc0fcd00 0x7f20cc0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.735+0000 7f20d13c6700 1 --2- 172.21.15.88:0/854046361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20cc0fbaf0 0x7f20cc0fbf00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.735+0000 7f20d13c6700 1 -- 172.21.15.88:0/854046361 >> 172.21.15.88:0/854046361 conn(0x7f20cc0f7190 msgr2=0x7f20cc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:35.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.735+0000 7f20d13c6700 1 -- 172.21.15.88:0/854046361 shutdown_connections 2023-12-09T02:34:35.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.735+0000 7f20d13c6700 1 -- 172.21.15.88:0/854046361 wait complete. 2023-12-09T02:34:35.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.736+0000 7f20d13c6700 1 Processor -- start 2023-12-09T02:34:35.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.736+0000 7f20d13c6700 1 -- start start 2023-12-09T02:34:35.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.736+0000 7f20d13c6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20cc0fbaf0 0x7f20cc10c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:35.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.736+0000 7f20d13c6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20cc0fcd00 0x7f20cc10c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:35.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.736+0000 7f20d13c6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc10cfc0 con 0x7f20cc0fbaf0 2023-12-09T02:34:35.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.736+0000 7f20d13c6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc10d860 con 0x7f20cc0fcd00 2023-12-09T02:34:35.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.736+0000 7f20caffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20cc0fbaf0 0x7f20cc10c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:35.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.736+0000 7f20caffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20cc0fbaf0 0x7f20cc10c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52098/0 (socket says 172.21.15.88:52098) 2023-12-09T02:34:35.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.736+0000 7f20caffd700 1 -- 172.21.15.88:0/2709458691 learned_addr learned my addr 172.21.15.88:0/2709458691 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:35.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.737+0000 7f20ca7fc700 1 --2- 172.21.15.88:0/2709458691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20cc0fcd00 0x7f20cc10c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:35.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.737+0000 7f20caffd700 1 -- 172.21.15.88:0/2709458691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20cc0fcd00 msgr2=0x7f20cc10c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.737+0000 7f20caffd700 1 --2- 172.21.15.88:0/2709458691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20cc0fcd00 0x7f20cc10c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.737+0000 7f20caffd700 1 -- 172.21.15.88:0/2709458691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c0005040 con 0x7f20cc0fbaf0 2023-12-09T02:34:35.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.737+0000 7f20caffd700 1 --2- 172.21.15.88:0/2709458691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20cc0fbaf0 0x7f20cc10c480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20c0004f90 tx=0x7f20c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:35.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.737+0000 7f20b37fe700 1 -- 172.21.15.88:0/2709458691 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20c000e040 con 0x7f20cc0fbaf0 2023-12-09T02:34:35.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.737+0000 7f20b37fe700 1 -- 172.21.15.88:0/2709458691 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f20c000bc50 con 0x7f20cc0fbaf0 2023-12-09T02:34:35.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.737+0000 7f20d13c6700 1 -- 172.21.15.88:0/2709458691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc10dae0 con 0x7f20cc0fbaf0 2023-12-09T02:34:35.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.737+0000 7f20b37fe700 1 -- 172.21.15.88:0/2709458691 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20c001c630 con 0x7f20cc0fbaf0 2023-12-09T02:34:35.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.737+0000 7f20d13c6700 1 -- 172.21.15.88:0/2709458691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc10e020 con 0x7f20cc0fbaf0 2023-12-09T02:34:35.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.738+0000 7f20d13c6700 1 -- 172.21.15.88:0/2709458691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20cc04bb80 con 0x7f20cc0fbaf0 2023-12-09T02:34:35.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.739+0000 7f20b37fe700 1 -- 172.21.15.88:0/2709458691 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f20c0013420 con 0x7f20cc0fbaf0 2023-12-09T02:34:35.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.739+0000 7f20b37fe700 1 --2- 172.21.15.88:0/2709458691 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f20b4068f60 0x7f20b406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:35.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.739+0000 7f20b37fe700 1 -- 172.21.15.88:0/2709458691 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f20c00881a0 con 0x7f20cc0fbaf0 2023-12-09T02:34:35.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.739+0000 7f20ca7fc700 1 --2- 172.21.15.88:0/2709458691 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f20b4068f60 0x7f20b406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:35.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.739+0000 7f20ca7fc700 1 --2- 172.21.15.88:0/2709458691 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f20b4068f60 0x7f20b406b410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f20bc007fd0 tx=0x7f20bc009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:35.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.743+0000 7f20b37fe700 1 -- 172.21.15.88:0/2709458691 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f20c00580b0 con 0x7f20cc0fbaf0 2023-12-09T02:34:35.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.944+0000 7f20d13c6700 1 -- 172.21.15.88:0/2709458691 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f20cc10e3b0 con 0x7f20b4068f60 2023-12-09T02:34:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.954+0000 7f20b37fe700 1 -- 172.21.15.88:0/2709458691 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f20cc10e3b0 con 0x7f20b4068f60 2023-12-09T02:34:35.956 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:34:35.956 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (4m) 91s ago 5m 28.4M - 0.25.0 c8568f914cd2 578f197f8707 2023-12-09T02:34:35.956 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (5m) 91s ago 5m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 9098f424ee11 2023-12-09T02:34:35.956 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (4m) 93s ago 4m 7482k - 17.2.7-119-ge2143d99 f761b6e42225 15c5154f5f2e 2023-12-09T02:34:35.956 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (4m) 91s ago 5m 89.6M - 9.4.7 954c08fa6188 04aa719e29b6 2023-12-09T02:34:35.956 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (104s) 91s ago 104s 11.9M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (101s) 91s ago 100s 13.3M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (103s) 93s ago 102s 15.9M - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (99s) 93s ago 99s 13.2M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:9283 running (6m) 91s ago 6m 496M - 17.2.7-119-ge2143d99 f761b6e42225 0fffc89bc055 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283 running (4m) 93s ago 4m 442M - 17.2.7-119-ge2143d99 f761b6e42225 785e62ae75e6 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (6m) 91s ago 6m 74.6M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d21a10406297 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (4m) 93s ago 4m 60.0M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d6b9d9265450 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (5m) 91s ago 5m 14.8M - 1.5.0 0da6a335fe13 0a3f7cc72867 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (4m) 93s ago 4m 17.3M - 1.5.0 0da6a335fe13 43bf179905a8 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (4m) 91s ago 4m 54.8M 4299M 17.2.7-119-ge2143d99 f761b6e42225 fdd606881a64 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (3m) 91s ago 3m 58.0M 4299M 17.2.7-119-ge2143d99 f761b6e42225 354d4a4d3430 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (3m) 91s ago 3m 57.5M 4299M 17.2.7-119-ge2143d99 f761b6e42225 0b0abbb070ec 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (3m) 93s ago 3m 55.7M 5323M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (2m) 93s ago 2m 48.8M 5323M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:34:35.957 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (2m) 93s ago 2m 51.5M 5323M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:34:35.958 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (4m) 91s ago 5m 48.7M - 2.43.0 a07b618ecd1d 5e8226460d4a 2023-12-09T02:34:35.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.956+0000 7f20d13c6700 1 -- 172.21.15.88:0/2709458691 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f20b4068f60 msgr2=0x7f20b406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.956+0000 7f20d13c6700 1 --2- 172.21.15.88:0/2709458691 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f20b4068f60 0x7f20b406b410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f20bc007fd0 tx=0x7f20bc009040 comp rx=0 tx=0).stop 2023-12-09T02:34:35.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.956+0000 7f20d13c6700 1 -- 172.21.15.88:0/2709458691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20cc0fbaf0 msgr2=0x7f20cc10c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:35.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.956+0000 7f20d13c6700 1 --2- 172.21.15.88:0/2709458691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20cc0fbaf0 0x7f20cc10c480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20c0004f90 tx=0x7f20c0009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:35.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.956+0000 7f20d13c6700 1 -- 172.21.15.88:0/2709458691 shutdown_connections 2023-12-09T02:34:35.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.956+0000 7f20d13c6700 1 --2- 172.21.15.88:0/2709458691 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f20b4068f60 0x7f20b406b410 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.956+0000 7f20d13c6700 1 --2- 172.21.15.88:0/2709458691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20cc0fbaf0 0x7f20cc10c480 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.956+0000 7f20d13c6700 1 --2- 172.21.15.88:0/2709458691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20cc0fcd00 0x7f20cc10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:35.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.956+0000 7f20d13c6700 1 -- 172.21.15.88:0/2709458691 >> 172.21.15.88:0/2709458691 conn(0x7f20cc0f7190 msgr2=0x7f20cc0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:35.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.956+0000 7f20d13c6700 1 -- 172.21.15.88:0/2709458691 shutdown_connections 2023-12-09T02:34:35.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:35.956+0000 7f20d13c6700 1 -- 172.21.15.88:0/2709458691 wait complete. 2023-12-09T02:34:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.058+0000 7f9554671700 1 -- 172.21.15.88:0/971023890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c100050 msgr2=0x7f954c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.058+0000 7f9554671700 1 --2- 172.21.15.88:0/971023890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c100050 0x7f954c102430 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9540004940 tx=0x7f9540009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.058+0000 7f9554671700 1 -- 172.21.15.88:0/971023890 shutdown_connections 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.058+0000 7f9554671700 1 --2- 172.21.15.88:0/971023890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c100050 0x7f954c102430 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.058+0000 7f9554671700 1 --2- 172.21.15.88:0/971023890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f954c0fd730 0x7f954c0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.058+0000 7f9554671700 1 -- 172.21.15.88:0/971023890 >> 172.21.15.88:0/971023890 conn(0x7f954c0f7190 msgr2=0x7f954c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.058+0000 7f9554671700 1 -- 172.21.15.88:0/971023890 shutdown_connections 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.058+0000 7f9554671700 1 -- 172.21.15.88:0/971023890 wait complete. 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f9554671700 1 Processor -- start 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f9554671700 1 -- start start 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f9554671700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c0fd730 0x7f954c10d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f9554671700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f954c100050 0x7f954c10d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f9554671700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c10dfe0 con 0x7f954c0fd730 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f9554671700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c10e880 con 0x7f954c100050 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f955240d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c0fd730 0x7f954c10d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f955240d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c0fd730 0x7f954c10d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52110/0 (socket says 172.21.15.88:52110) 2023-12-09T02:34:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f955240d700 1 -- 172.21.15.88:0/3139785603 learned_addr learned my addr 172.21.15.88:0/3139785603 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f9551c0c700 1 --2- 172.21.15.88:0/3139785603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f954c100050 0x7f954c10d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f955240d700 1 -- 172.21.15.88:0/3139785603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f954c100050 msgr2=0x7f954c10d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f955240d700 1 --2- 172.21.15.88:0/3139785603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f954c100050 0x7f954c10d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.059+0000 7f955240d700 1 -- 172.21.15.88:0/3139785603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9540005040 con 0x7f954c0fd730 2023-12-09T02:34:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.060+0000 7f955240d700 1 --2- 172.21.15.88:0/3139785603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c0fd730 0x7f954c10d4a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f954400ec90 tx=0x7f954400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.060+0000 7f954affd700 1 -- 172.21.15.88:0/3139785603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9544007b30 con 0x7f954c0fd730 2023-12-09T02:34:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.060+0000 7f954affd700 1 -- 172.21.15.88:0/3139785603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f954400f040 con 0x7f954c0fd730 2023-12-09T02:34:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.060+0000 7f9554671700 1 -- 172.21.15.88:0/3139785603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c10eb60 con 0x7f954c0fd730 2023-12-09T02:34:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.060+0000 7f954affd700 1 -- 172.21.15.88:0/3139785603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954400cbd0 con 0x7f954c0fd730 2023-12-09T02:34:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.060+0000 7f9554671700 1 -- 172.21.15.88:0/3139785603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c10f0a0 con 0x7f954c0fd730 2023-12-09T02:34:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.061+0000 7f9554671700 1 -- 172.21.15.88:0/3139785603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c04bb80 con 0x7f954c0fd730 2023-12-09T02:34:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.062+0000 7f954affd700 1 -- 172.21.15.88:0/3139785603 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9544007c90 con 0x7f954c0fd730 2023-12-09T02:34:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.062+0000 7f954affd700 1 --2- 172.21.15.88:0/3139785603 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9534068f70 0x7f953406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.062+0000 7f954affd700 1 -- 172.21.15.88:0/3139785603 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9544086fe0 con 0x7f954c0fd730 2023-12-09T02:34:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.062+0000 7f9551c0c700 1 --2- 172.21.15.88:0/3139785603 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9534068f70 0x7f953406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.063+0000 7f9551c0c700 1 --2- 172.21.15.88:0/3139785603 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9534068f70 0x7f953406b420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9540013600 tx=0x7f9540009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:36.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.066+0000 7f954affd700 1 -- 172.21.15.88:0/3139785603 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9544056f10 con 0x7f954c0fd730 2023-12-09T02:34:36.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.334+0000 7f9554671700 1 -- 172.21.15.88:0/3139785603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f954c10f3d0 con 0x7f954c0fd730 2023-12-09T02:34:36.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.335+0000 7f954affd700 1 -- 172.21.15.88:0/3139785603 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f9544056aa0 con 0x7f954c0fd730 2023-12-09T02:34:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:34:36.337 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:34:36.337 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-09T02:34:36.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:34:36.338 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:34:36.338 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-09T02:34:36.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:34:36.338 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:34:36.338 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-09T02:34:36.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:34:36.338 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:34:36.338 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:34:36.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:34:36.339 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:34:36.339 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 14 2023-12-09T02:34:36.339 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:34:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:34:36.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.337+0000 7f9554671700 1 -- 172.21.15.88:0/3139785603 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9534068f70 msgr2=0x7f953406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:36.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.337+0000 7f9554671700 1 --2- 172.21.15.88:0/3139785603 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9534068f70 0x7f953406b420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9540013600 tx=0x7f9540009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:36.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.337+0000 7f9554671700 1 -- 172.21.15.88:0/3139785603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c0fd730 msgr2=0x7f954c10d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:36.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.337+0000 7f9554671700 1 --2- 172.21.15.88:0/3139785603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c0fd730 0x7f954c10d4a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f954400ec90 tx=0x7f954400b040 comp rx=0 tx=0).stop 2023-12-09T02:34:36.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.337+0000 7f9554671700 1 -- 172.21.15.88:0/3139785603 shutdown_connections 2023-12-09T02:34:36.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.337+0000 7f9554671700 1 --2- 172.21.15.88:0/3139785603 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f9534068f70 0x7f953406b420 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.337+0000 7f9554671700 1 --2- 172.21.15.88:0/3139785603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c0fd730 0x7f954c10d4a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.337+0000 7f9554671700 1 --2- 172.21.15.88:0/3139785603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f954c100050 0x7f954c10d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.337+0000 7f9554671700 1 -- 172.21.15.88:0/3139785603 >> 172.21.15.88:0/3139785603 conn(0x7f954c0f7190 msgr2=0x7f954c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:36.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.337+0000 7f9554671700 1 -- 172.21.15.88:0/3139785603 shutdown_connections 2023-12-09T02:34:36.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.337+0000 7f9554671700 1 -- 172.21.15.88:0/3139785603 wait complete. 2023-12-09T02:34:36.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.442+0000 7f6540a3a700 1 -- 172.21.15.88:0/2279496864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c0ffdd0 msgr2=0x7f653c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:36.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.442+0000 7f6540a3a700 1 --2- 172.21.15.88:0/2279496864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c0ffdd0 0x7f653c1021d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6530004940 tx=0x7f6530009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:36.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.442+0000 7f6540a3a700 1 -- 172.21.15.88:0/2279496864 shutdown_connections 2023-12-09T02:34:36.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.442+0000 7f6540a3a700 1 --2- 172.21.15.88:0/2279496864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c0ffdd0 0x7f653c1021d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.442+0000 7f6540a3a700 1 --2- 172.21.15.88:0/2279496864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c0668c0 0x7f653c0ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.442+0000 7f6540a3a700 1 -- 172.21.15.88:0/2279496864 >> 172.21.15.88:0/2279496864 conn(0x7f653c0f71b0 msgr2=0x7f653c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.442+0000 7f6540a3a700 1 -- 172.21.15.88:0/2279496864 shutdown_connections 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.442+0000 7f6540a3a700 1 -- 172.21.15.88:0/2279496864 wait complete. 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.443+0000 7f6540a3a700 1 Processor -- start 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.443+0000 7f6540a3a700 1 -- start start 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.443+0000 7f6540a3a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c0668c0 0x7f653c10d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.443+0000 7f6540a3a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c0ffdd0 0x7f653c10d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.443+0000 7f6540a3a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c10dfe0 con 0x7f653c0ffdd0 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.443+0000 7f6540a3a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c10e880 con 0x7f653c0668c0 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.443+0000 7f6539d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c0ffdd0 0x7f653c10d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.443+0000 7f6539d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c0ffdd0 0x7f653c10d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41338/0 (socket says 172.21.15.88:41338) 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.443+0000 7f6539d9b700 1 -- 172.21.15.88:0/115168032 learned_addr learned my addr 172.21.15.88:0/115168032 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.443+0000 7f653a59c700 1 --2- 172.21.15.88:0/115168032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c0668c0 0x7f653c10d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.444+0000 7f6539d9b700 1 -- 172.21.15.88:0/115168032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c0668c0 msgr2=0x7f653c10d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.444+0000 7f6539d9b700 1 --2- 172.21.15.88:0/115168032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c0668c0 0x7f653c10d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.444+0000 7f6539d9b700 1 -- 172.21.15.88:0/115168032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6530005040 con 0x7f653c0ffdd0 2023-12-09T02:34:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.444+0000 7f6539d9b700 1 --2- 172.21.15.88:0/115168032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c0ffdd0 0x7f653c10d9e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6530000c00 tx=0x7f6530009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.444+0000 7f652affd700 1 -- 172.21.15.88:0/115168032 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6530021070 con 0x7f653c0ffdd0 2023-12-09T02:34:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.444+0000 7f652affd700 1 -- 172.21.15.88:0/115168032 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f653001c400 con 0x7f653c0ffdd0 2023-12-09T02:34:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.444+0000 7f6540a3a700 1 -- 172.21.15.88:0/115168032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c10eb00 con 0x7f653c0ffdd0 2023-12-09T02:34:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.444+0000 7f652affd700 1 -- 172.21.15.88:0/115168032 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f653000e070 con 0x7f653c0ffdd0 2023-12-09T02:34:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.444+0000 7f6540a3a700 1 -- 172.21.15.88:0/115168032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c10efe0 con 0x7f653c0ffdd0 2023-12-09T02:34:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.445+0000 7f6540a3a700 1 -- 172.21.15.88:0/115168032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c04bb80 con 0x7f653c0ffdd0 2023-12-09T02:34:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.446+0000 7f652affd700 1 -- 172.21.15.88:0/115168032 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f653001ca00 con 0x7f653c0ffdd0 2023-12-09T02:34:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.446+0000 7f652affd700 1 --2- 172.21.15.88:0/115168032 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6524068f60 0x7f652406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.446+0000 7f652affd700 1 -- 172.21.15.88:0/115168032 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f65300886f0 con 0x7f653c0ffdd0 2023-12-09T02:34:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.446+0000 7f653a59c700 1 --2- 172.21.15.88:0/115168032 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6524068f60 0x7f652406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.447+0000 7f653a59c700 1 --2- 172.21.15.88:0/115168032 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6524068f60 0x7f652406b410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f652c009b80 tx=0x7f652c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.451+0000 7f652affd700 1 -- 172.21.15.88:0/115168032 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f65300585e0 con 0x7f653c0ffdd0 2023-12-09T02:34:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.689+0000 7f6540a3a700 1 -- 172.21.15.88:0/115168032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f653c105580 con 0x7f653c0ffdd0 2023-12-09T02:34:36.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.689+0000 7f652affd700 1 -- 172.21.15.88:0/115168032 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1810 (secure 0 0 0) 0x7f6530058170 con 0x7f653c0ffdd0 2023-12-09T02:34:36.692 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:34:36.692 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:34:36.692 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:34:36.692 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:34:36.692 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:34:36.692 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:34:36.692 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:34:36.692 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:34:36.692 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:34:36.692 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:34:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:34:36.694 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:34:36.695 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:34:36.695 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:34:36.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.691+0000 7f6540a3a700 1 -- 172.21.15.88:0/115168032 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6524068f60 msgr2=0x7f652406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.691+0000 7f6540a3a700 1 --2- 172.21.15.88:0/115168032 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6524068f60 0x7f652406b410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f652c009b80 tx=0x7f652c00b040 comp rx=0 tx=0).stop 2023-12-09T02:34:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.691+0000 7f6540a3a700 1 -- 172.21.15.88:0/115168032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c0ffdd0 msgr2=0x7f653c10d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.691+0000 7f6540a3a700 1 --2- 172.21.15.88:0/115168032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c0ffdd0 0x7f653c10d9e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6530000c00 tx=0x7f6530009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.691+0000 7f6540a3a700 1 -- 172.21.15.88:0/115168032 shutdown_connections 2023-12-09T02:34:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.691+0000 7f6540a3a700 1 --2- 172.21.15.88:0/115168032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c0668c0 0x7f653c10d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.691+0000 7f6540a3a700 1 --2- 172.21.15.88:0/115168032 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f6524068f60 0x7f652406b410 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.691+0000 7f6540a3a700 1 --2- 172.21.15.88:0/115168032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c0ffdd0 0x7f653c10d9e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.691+0000 7f6540a3a700 1 -- 172.21.15.88:0/115168032 >> 172.21.15.88:0/115168032 conn(0x7f653c0f71b0 msgr2=0x7f653c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.691+0000 7f6540a3a700 1 -- 172.21.15.88:0/115168032 shutdown_connections 2023-12-09T02:34:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.691+0000 7f6540a3a700 1 -- 172.21.15.88:0/115168032 wait complete. 2023-12-09T02:34:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:34:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.795+0000 7f04c797d700 1 -- 172.21.15.88:0/2713416646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04c0066920 msgr2=0x7f04c0101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.795+0000 7f04c797d700 1 --2- 172.21.15.88:0/2713416646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04c0066920 0x7f04c0101ba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f04bc004940 tx=0x7f04bc009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.795+0000 7f04c797d700 1 -- 172.21.15.88:0/2713416646 shutdown_connections 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.795+0000 7f04c797d700 1 --2- 172.21.15.88:0/2713416646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c01020e0 0x7f04c01044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.795+0000 7f04c797d700 1 --2- 172.21.15.88:0/2713416646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04c0066920 0x7f04c0101ba0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.795+0000 7f04c797d700 1 -- 172.21.15.88:0/2713416646 >> 172.21.15.88:0/2713416646 conn(0x7f04c00f71b0 msgr2=0x7f04c00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.796+0000 7f04c797d700 1 -- 172.21.15.88:0/2713416646 shutdown_connections 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.796+0000 7f04c797d700 1 -- 172.21.15.88:0/2713416646 wait complete. 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.796+0000 7f04c797d700 1 Processor -- start 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.796+0000 7f04c797d700 1 -- start start 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.796+0000 7f04c797d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04c0066920 0x7f04c010f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.796+0000 7f04c797d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c01020e0 0x7f04c010fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.796+0000 7f04c797d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0110220 con 0x7f04c0066920 2023-12-09T02:34:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.796+0000 7f04c797d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0110ac0 con 0x7f04c01020e0 2023-12-09T02:34:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.796+0000 7f04c5719700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04c0066920 0x7f04c010f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.796+0000 7f04c5719700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04c0066920 0x7f04c010f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41356/0 (socket says 172.21.15.88:41356) 2023-12-09T02:34:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.796+0000 7f04c5719700 1 -- 172.21.15.88:0/3160498729 learned_addr learned my addr 172.21.15.88:0/3160498729 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.797+0000 7f04c4f18700 1 --2- 172.21.15.88:0/3160498729 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c01020e0 0x7f04c010fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.797+0000 7f04c5719700 1 -- 172.21.15.88:0/3160498729 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c01020e0 msgr2=0x7f04c010fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.797+0000 7f04c5719700 1 --2- 172.21.15.88:0/3160498729 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c01020e0 0x7f04c010fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.797+0000 7f04c5719700 1 -- 172.21.15.88:0/3160498729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc005040 con 0x7f04c0066920 2023-12-09T02:34:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.797+0000 7f04c5719700 1 --2- 172.21.15.88:0/3160498729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04c0066920 0x7f04c010f6e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f04bc000c00 tx=0x7f04bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.797+0000 7f04b5ffb700 1 -- 172.21.15.88:0/3160498729 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04bc021070 con 0x7f04c0066920 2023-12-09T02:34:36.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.797+0000 7f04b5ffb700 1 -- 172.21.15.88:0/3160498729 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f04bc01c400 con 0x7f04c0066920 2023-12-09T02:34:36.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.797+0000 7f04c797d700 1 -- 172.21.15.88:0/3160498729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c0110d40 con 0x7f04c0066920 2023-12-09T02:34:36.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.797+0000 7f04b5ffb700 1 -- 172.21.15.88:0/3160498729 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04bc00e070 con 0x7f04c0066920 2023-12-09T02:34:36.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.797+0000 7f04c797d700 1 -- 172.21.15.88:0/3160498729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c0111220 con 0x7f04c0066920 2023-12-09T02:34:36.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.798+0000 7f04c797d700 1 -- 172.21.15.88:0/3160498729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c004bb80 con 0x7f04c0066920 2023-12-09T02:34:36.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.799+0000 7f04b5ffb700 1 -- 172.21.15.88:0/3160498729 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f04bc013a30 con 0x7f04c0066920 2023-12-09T02:34:36.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.799+0000 7f04b5ffb700 1 --2- 172.21.15.88:0/3160498729 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f04ac068f60 0x7f04ac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:36.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.799+0000 7f04b5ffb700 1 -- 172.21.15.88:0/3160498729 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f04bc087fe0 con 0x7f04c0066920 2023-12-09T02:34:36.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.799+0000 7f04c4f18700 1 --2- 172.21.15.88:0/3160498729 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f04ac068f60 0x7f04ac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:36.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.800+0000 7f04c4f18700 1 --2- 172.21.15.88:0/3160498729 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f04ac068f60 0x7f04ac06b410 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009b80 tx=0x7f04b000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:36.804+0000 7f04b5ffb700 1 -- 172.21.15.88:0/3160498729 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f04bc057ef0 con 0x7f04c0066920 2023-12-09T02:34:37.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.008+0000 7f04c797d700 1 -- 172.21.15.88:0/3160498729 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04c0111670 con 0x7f04ac068f60 2023-12-09T02:34:37.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.009+0000 7f04b5ffb700 1 -- 172.21.15.88:0/3160498729 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f04c0111670 con 0x7f04ac068f60 2023-12-09T02:34:37.011 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:34:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:34:37.011 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:34:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:34:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2023-12-09T02:34:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "", 2023-12-09T02:34:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mgr daemons", 2023-12-09T02:34:37.012 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:34:37.012 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:34:37.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.011+0000 7f04c797d700 1 -- 172.21.15.88:0/3160498729 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f04ac068f60 msgr2=0x7f04ac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:37.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.011+0000 7f04c797d700 1 --2- 172.21.15.88:0/3160498729 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f04ac068f60 0x7f04ac06b410 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009b80 tx=0x7f04b000b040 comp rx=0 tx=0).stop 2023-12-09T02:34:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.011+0000 7f04c797d700 1 -- 172.21.15.88:0/3160498729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04c0066920 msgr2=0x7f04c010f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.011+0000 7f04c797d700 1 --2- 172.21.15.88:0/3160498729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04c0066920 0x7f04c010f6e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f04bc000c00 tx=0x7f04bc009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.011+0000 7f04c797d700 1 -- 172.21.15.88:0/3160498729 shutdown_connections 2023-12-09T02:34:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.011+0000 7f04c797d700 1 --2- 172.21.15.88:0/3160498729 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f04ac068f60 0x7f04ac06b410 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.011+0000 7f04c797d700 1 --2- 172.21.15.88:0/3160498729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04c0066920 0x7f04c010f6e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.011+0000 7f04c797d700 1 --2- 172.21.15.88:0/3160498729 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c01020e0 0x7f04c010fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.011+0000 7f04c797d700 1 -- 172.21.15.88:0/3160498729 >> 172.21.15.88:0/3160498729 conn(0x7f04c00f71b0 msgr2=0x7f04c00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.011+0000 7f04c797d700 1 -- 172.21.15.88:0/3160498729 shutdown_connections 2023-12-09T02:34:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.011+0000 7f04c797d700 1 -- 172.21.15.88:0/3160498729 wait complete. 2023-12-09T02:34:37.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.114+0000 7fc39aa66700 1 -- 172.21.15.88:0/4145366284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3940fcd00 msgr2=0x7fc3940fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:37.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.114+0000 7fc39aa66700 1 --2- 172.21.15.88:0/4145366284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3940fcd00 0x7fc3940fd150 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc380004940 tx=0x7fc380009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:37.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.114+0000 7fc39aa66700 1 -- 172.21.15.88:0/4145366284 shutdown_connections 2023-12-09T02:34:37.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.114+0000 7fc39aa66700 1 --2- 172.21.15.88:0/4145366284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3940fcd00 0x7fc3940fd150 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:37.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.114+0000 7fc39aa66700 1 --2- 172.21.15.88:0/4145366284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3940fbaf0 0x7fc3940fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:37.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.114+0000 7fc39aa66700 1 -- 172.21.15.88:0/4145366284 >> 172.21.15.88:0/4145366284 conn(0x7fc3940f7190 msgr2=0x7fc3940f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:37.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.114+0000 7fc39aa66700 1 -- 172.21.15.88:0/4145366284 shutdown_connections 2023-12-09T02:34:37.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.114+0000 7fc39aa66700 1 -- 172.21.15.88:0/4145366284 wait complete. 2023-12-09T02:34:37.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc39aa66700 1 Processor -- start 2023-12-09T02:34:37.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc39aa66700 1 -- start start 2023-12-09T02:34:37.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc39aa66700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3940fbaf0 0x7fc39410c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:37.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc39aa66700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3940fcd00 0x7fc39410c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:37.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc39aa66700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39410cfc0 con 0x7fc3940fcd00 2023-12-09T02:34:37.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc39aa66700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39410d860 con 0x7fc3940fbaf0 2023-12-09T02:34:37.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc393fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3940fcd00 0x7fc39410c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:37.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc393fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3940fcd00 0x7fc39410c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41376/0 (socket says 172.21.15.88:41376) 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc393fff700 1 -- 172.21.15.88:0/122751774 learned_addr learned my addr 172.21.15.88:0/122751774 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc398802700 1 --2- 172.21.15.88:0/122751774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3940fbaf0 0x7fc39410c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc393fff700 1 -- 172.21.15.88:0/122751774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3940fbaf0 msgr2=0x7fc39410c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc393fff700 1 --2- 172.21.15.88:0/122751774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3940fbaf0 0x7fc39410c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.115+0000 7fc393fff700 1 -- 172.21.15.88:0/122751774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc380005040 con 0x7fc3940fcd00 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.116+0000 7fc393fff700 1 --2- 172.21.15.88:0/122751774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3940fcd00 0x7fc39410c9c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc380004f90 tx=0x7fc380009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.116+0000 7fc3917fa700 1 -- 172.21.15.88:0/122751774 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38000e040 con 0x7fc3940fcd00 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.116+0000 7fc3917fa700 1 -- 172.21.15.88:0/122751774 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc38000be60 con 0x7fc3940fcd00 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.116+0000 7fc3917fa700 1 -- 172.21.15.88:0/122751774 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc380013770 con 0x7fc3940fcd00 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.116+0000 7fc39aa66700 1 -- 172.21.15.88:0/122751774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39410dae0 con 0x7fc3940fcd00 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.116+0000 7fc39aa66700 1 -- 172.21.15.88:0/122751774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39410dfc0 con 0x7fc3940fcd00 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.117+0000 7fc39aa66700 1 -- 172.21.15.88:0/122751774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39404bb80 con 0x7fc3940fcd00 2023-12-09T02:34:37.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.117+0000 7fc3917fa700 1 -- 172.21.15.88:0/122751774 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc38001ead0 con 0x7fc3940fcd00 2023-12-09T02:34:37.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.117+0000 7fc3917fa700 1 --2- 172.21.15.88:0/122751774 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc384068f60 0x7fc38406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:34:37.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.118+0000 7fc3917fa700 1 -- 172.21.15.88:0/122751774 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc38008ad80 con 0x7fc3940fcd00 2023-12-09T02:34:37.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.118+0000 7fc398802700 1 --2- 172.21.15.88:0/122751774 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc384068f60 0x7fc38406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:34:37.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.118+0000 7fc398802700 1 --2- 172.21.15.88:0/122751774 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc384068f60 0x7fc38406b410 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3940fcb60 tx=0x7fc38800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:34:37.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.122+0000 7fc3917fa700 1 -- 172.21.15.88:0/122751774 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc38005ac90 con 0x7fc3940fcd00 2023-12-09T02:34:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:36 smithi161 ceph-mon[121170]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:36 smithi161 ceph-mon[121170]: pgmap v186: 65 pgs: 65 active+clean; 164 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s wr, 960 op/s 2023-12-09T02:34:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:36 smithi161 ceph-mon[121170]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:36 smithi161 ceph-mon[121170]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:36 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3139785603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:34:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:36 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:34:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:36 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:34:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:36 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:34:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:36 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/115168032' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:34:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:36 smithi088 ceph-mon[112028]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:36 smithi088 ceph-mon[112028]: pgmap v186: 65 pgs: 65 active+clean; 164 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s wr, 960 op/s 2023-12-09T02:34:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:36 smithi088 ceph-mon[112028]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:36 smithi088 ceph-mon[112028]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:36 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3139785603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:34:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:36 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:34:37.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:36 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:34:37.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:36 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:34:37.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:36 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/115168032' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:34:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.390+0000 7fc39aa66700 1 -- 172.21.15.88:0/122751774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc3941044b0 con 0x7fc3940fcd00 2023-12-09T02:34:37.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.390+0000 7fc3917fa700 1 -- 172.21.15.88:0/122751774 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc38005a820 con 0x7fc3940fcd00 2023-12-09T02:34:37.393 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:34:37.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.392+0000 7fc39aa66700 1 -- 172.21.15.88:0/122751774 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc384068f60 msgr2=0x7fc38406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:37.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.392+0000 7fc39aa66700 1 --2- 172.21.15.88:0/122751774 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc384068f60 0x7fc38406b410 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3940fcb60 tx=0x7fc38800b040 comp rx=0 tx=0).stop 2023-12-09T02:34:37.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.392+0000 7fc39aa66700 1 -- 172.21.15.88:0/122751774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3940fcd00 msgr2=0x7fc39410c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:34:37.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.392+0000 7fc39aa66700 1 --2- 172.21.15.88:0/122751774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3940fcd00 0x7fc39410c9c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc380004f90 tx=0x7fc380009e30 comp rx=0 tx=0).stop 2023-12-09T02:34:37.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.392+0000 7fc39aa66700 1 -- 172.21.15.88:0/122751774 shutdown_connections 2023-12-09T02:34:37.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.392+0000 7fc39aa66700 1 --2- 172.21.15.88:0/122751774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3940fbaf0 0x7fc39410c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:37.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.392+0000 7fc39aa66700 1 --2- 172.21.15.88:0/122751774 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc384068f60 0x7fc38406b410 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:37.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.392+0000 7fc39aa66700 1 --2- 172.21.15.88:0/122751774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3940fcd00 0x7fc39410c9c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:34:37.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.392+0000 7fc39aa66700 1 -- 172.21.15.88:0/122751774 >> 172.21.15.88:0/122751774 conn(0x7fc3940f7190 msgr2=0x7fc3940fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:34:37.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.393+0000 7fc39aa66700 1 -- 172.21.15.88:0/122751774 shutdown_connections 2023-12-09T02:34:37.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:34:37.393+0000 7fc39aa66700 1 -- 172.21.15.88:0/122751774 wait complete. 2023-12-09T02:34:38.104 INFO:tasks.workunit.client.1.smithi161.stderr:++ readlink -f fsstress 2023-12-09T02:34:38.106 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-09T02:34:38.106 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-09T02:34:38.106 INFO:tasks.workunit.client.1.smithi161.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-09T02:34:38.106 INFO:tasks.workunit.client.1.smithi161.stderr:+ popd 2023-12-09T02:34:38.107 INFO:tasks.workunit.client.1.smithi161.stderr:+ popd 2023-12-09T02:34:38.107 INFO:tasks.workunit.client.1.smithi161.stderr:++ mktemp -d -p . 2023-12-09T02:34:38.158 INFO:tasks.workunit.client.1.smithi161.stderr:+ T=./tmp.LXP8cY6KUP 2023-12-09T02:34:38.158 INFO:tasks.workunit.client.1.smithi161.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.LXP8cY6KUP -l 1 -n 1000 -p 10 -v 2023-12-09T02:34:38.162 INFO:tasks.workunit.client.1.smithi161.stdout:seed = 1701946725 2023-12-09T02:34:38.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:37 smithi161 ceph-mon[121170]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:38.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:37 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/122751774' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:34:38.170 INFO:tasks.workunit.client.1.smithi161.stdout:2/0: readlink - no filename 2023-12-09T02:34:38.170 INFO:tasks.workunit.client.1.smithi161.stdout:1/0: symlink l0 0 2023-12-09T02:34:38.170 INFO:tasks.workunit.client.1.smithi161.stdout:1/1: rmdir - no directory 2023-12-09T02:34:38.170 INFO:tasks.workunit.client.1.smithi161.stdout:1/2: rmdir - no directory 2023-12-09T02:34:38.170 INFO:tasks.workunit.client.1.smithi161.stdout:1/3: truncate - no filename 2023-12-09T02:34:38.172 INFO:tasks.workunit.client.1.smithi161.stdout:2/1: mknod c0 0 2023-12-09T02:34:38.175 INFO:tasks.workunit.client.1.smithi161.stdout:1/4: mknod c1 0 2023-12-09T02:34:38.175 INFO:tasks.workunit.client.1.smithi161.stdout:1/5: fsync - no filename 2023-12-09T02:34:38.175 INFO:tasks.workunit.client.1.smithi161.stdout:1/6: dread - no filename 2023-12-09T02:34:38.177 INFO:tasks.workunit.client.1.smithi161.stdout:2/2: creat f1 x:0 0 0 2023-12-09T02:34:38.177 INFO:tasks.workunit.client.1.smithi161.stdout:2/3: chown f1 133992801 1 2023-12-09T02:34:38.177 INFO:tasks.workunit.client.1.smithi161.stdout:2/4: dread - f1 zero size 2023-12-09T02:34:38.177 INFO:tasks.workunit.client.1.smithi161.stdout:2/5: chown c0 11 1 2023-12-09T02:34:38.178 INFO:tasks.workunit.client.1.smithi161.stdout:4/0: write - no filename 2023-12-09T02:34:38.179 INFO:tasks.workunit.client.1.smithi161.stdout:3/0: mknod c0 0 2023-12-09T02:34:38.179 INFO:tasks.workunit.client.1.smithi161.stdout:3/1: stat c0 0 2023-12-09T02:34:38.181 INFO:tasks.workunit.client.1.smithi161.stdout:1/7: unlink c1 0 2023-12-09T02:34:38.181 INFO:tasks.workunit.client.1.smithi161.stdout:1/8: write - no filename 2023-12-09T02:34:38.181 INFO:tasks.workunit.client.1.smithi161.stdout:2/6: symlink l2 0 2023-12-09T02:34:38.184 INFO:tasks.workunit.client.1.smithi161.stdout:4/1: symlink l0 0 2023-12-09T02:34:38.187 INFO:tasks.workunit.client.1.smithi161.stdout:1/9: symlink l2 0 2023-12-09T02:34:38.187 INFO:tasks.workunit.client.1.smithi161.stdout:1/10: dwrite - no filename 2023-12-09T02:34:38.187 INFO:tasks.workunit.client.1.smithi161.stdout:1/11: fdatasync - no filename 2023-12-09T02:34:38.188 INFO:tasks.workunit.client.1.smithi161.stdout:1/12: write - no filename 2023-12-09T02:34:38.188 INFO:tasks.workunit.client.1.smithi161.stdout:2/7: creat f3 x:0 0 0 2023-12-09T02:34:38.189 INFO:tasks.workunit.client.1.smithi161.stdout:2/8: truncate f1 993477 0 2023-12-09T02:34:38.190 INFO:tasks.workunit.client.1.smithi161.stdout:6/0: chown . 5 1 2023-12-09T02:34:38.190 INFO:tasks.workunit.client.1.smithi161.stdout:6/1: stat - no entries 2023-12-09T02:34:38.190 INFO:tasks.workunit.client.1.smithi161.stdout:6/2: dread - no filename 2023-12-09T02:34:38.192 INFO:tasks.workunit.client.1.smithi161.stdout:4/2: symlink l1 0 2023-12-09T02:34:38.192 INFO:tasks.workunit.client.1.smithi161.stdout:4/3: rmdir - no directory 2023-12-09T02:34:38.192 INFO:tasks.workunit.client.1.smithi161.stdout:4/4: dread - no filename 2023-12-09T02:34:38.192 INFO:tasks.workunit.client.1.smithi161.stdout:4/5: write - no filename 2023-12-09T02:34:38.192 INFO:tasks.workunit.client.1.smithi161.stdout:4/6: write - no filename 2023-12-09T02:34:38.192 INFO:tasks.workunit.client.1.smithi161.stdout:4/7: write - no filename 2023-12-09T02:34:38.193 INFO:tasks.workunit.client.1.smithi161.stdout:4/8: chown l0 509 1 2023-12-09T02:34:38.194 INFO:tasks.workunit.client.1.smithi161.stdout:1/13: symlink l3 0 2023-12-09T02:34:38.196 INFO:tasks.workunit.client.1.smithi161.stdout:8/0: chown . 0 1 2023-12-09T02:34:38.197 INFO:tasks.workunit.client.1.smithi161.stdout:4/9: mknod c2 0 2023-12-09T02:34:38.202 INFO:tasks.workunit.client.1.smithi161.stdout:1/14: mknod c4 0 2023-12-09T02:34:38.203 INFO:tasks.workunit.client.1.smithi161.stdout:4/10: rename l1 to l3 0 2023-12-09T02:34:38.203 INFO:tasks.workunit.client.1.smithi161.stdout:9/0: getdents . 0 2023-12-09T02:34:38.203 INFO:tasks.workunit.client.1.smithi161.stdout:9/1: fdatasync - no filename 2023-12-09T02:34:38.203 INFO:tasks.workunit.client.1.smithi161.stdout:9/2: dwrite - no filename 2023-12-09T02:34:38.203 INFO:tasks.workunit.client.1.smithi161.stdout:9/3: dread - no filename 2023-12-09T02:34:38.203 INFO:tasks.workunit.client.1.smithi161.stdout:4/11: creat f4 x:0 0 0 2023-12-09T02:34:38.206 INFO:tasks.workunit.client.1.smithi161.stdout:1/15: creat f5 x:0 0 0 2023-12-09T02:34:38.207 INFO:tasks.workunit.client.1.smithi161.stdout:0/0: dwrite - no filename 2023-12-09T02:34:38.208 INFO:tasks.workunit.client.1.smithi161.stdout:0/1: chown . 121053 1 2023-12-09T02:34:38.208 INFO:tasks.workunit.client.1.smithi161.stdout:0/2: dread - no filename 2023-12-09T02:34:38.208 INFO:tasks.workunit.client.1.smithi161.stdout:0/3: dread - no filename 2023-12-09T02:34:38.208 INFO:tasks.workunit.client.1.smithi161.stdout:2/9: dwrite f3 [0,4194304] 0 2023-12-09T02:34:38.209 INFO:tasks.workunit.client.1.smithi161.stdout:9/4: creat f0 x:0 0 0 2023-12-09T02:34:38.211 INFO:tasks.workunit.client.1.smithi161.stdout:4/12: mknod c5 0 2023-12-09T02:34:38.213 INFO:tasks.workunit.client.1.smithi161.stdout:7/0: chown . 5 1 2023-12-09T02:34:38.213 INFO:tasks.workunit.client.1.smithi161.stdout:7/1: rename - no filename 2023-12-09T02:34:38.213 INFO:tasks.workunit.client.1.smithi161.stdout:7/2: dwrite - no filename 2023-12-09T02:34:38.213 INFO:tasks.workunit.client.1.smithi161.stdout:7/3: write - no filename 2023-12-09T02:34:38.214 INFO:tasks.workunit.client.1.smithi161.stdout:7/4: link - no file 2023-12-09T02:34:38.214 INFO:tasks.workunit.client.1.smithi161.stdout:7/5: getdents . 0 2023-12-09T02:34:38.214 INFO:tasks.workunit.client.1.smithi161.stdout:7/6: chown . 288194604 1 2023-12-09T02:34:38.221 INFO:tasks.workunit.client.1.smithi161.stdout:2/10: mkdir d4 0 2023-12-09T02:34:38.221 INFO:tasks.workunit.client.1.smithi161.stdout:2/11: write f1 [1349173,33987] 0 2023-12-09T02:34:38.225 INFO:tasks.workunit.client.1.smithi161.stdout:7/7: mkdir d0 0 2023-12-09T02:34:38.225 INFO:tasks.workunit.client.1.smithi161.stdout:7/8: stat d0 0 2023-12-09T02:34:38.226 INFO:tasks.workunit.client.1.smithi161.stdout:7/9: unlink - no file 2023-12-09T02:34:38.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:37 smithi088 ceph-mon[112028]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:34:38.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:37 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/122751774' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:34:38.227 INFO:tasks.workunit.client.1.smithi161.stdout:2/12: mknod d4/c5 0 2023-12-09T02:34:38.229 INFO:tasks.workunit.client.1.smithi161.stdout:7/10: mknod d0/c1 0 2023-12-09T02:34:38.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/11: unlink d0/c1 0 2023-12-09T02:34:38.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/12: dread - no filename 2023-12-09T02:34:38.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/13: write - no filename 2023-12-09T02:34:38.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/14: dread - no filename 2023-12-09T02:34:38.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/15: chown d0 1 1 2023-12-09T02:34:38.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/16: chown d0 0 1 2023-12-09T02:34:38.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/17: dread - no filename 2023-12-09T02:34:38.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/18: dwrite - no filename 2023-12-09T02:34:38.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/19: unlink - no file 2023-12-09T02:34:38.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/20: truncate - no filename 2023-12-09T02:34:38.233 INFO:tasks.workunit.client.1.smithi161.stdout:1/16: dwrite f5 [0,4194304] 0 2023-12-09T02:34:38.233 INFO:tasks.workunit.client.1.smithi161.stdout:7/21: creat d0/f2 x:0 0 0 2023-12-09T02:34:38.233 INFO:tasks.workunit.client.1.smithi161.stdout:9/5: dwrite f0 [0,4194304] 0 2023-12-09T02:34:38.234 INFO:tasks.workunit.client.1.smithi161.stdout:1/17: write f5 [3145669,50384] 0 2023-12-09T02:34:38.241 INFO:tasks.workunit.client.1.smithi161.stdout:7/22: mkdir d0/d3 0 2023-12-09T02:34:38.241 INFO:tasks.workunit.client.1.smithi161.stdout:7/23: chown d0/d3 195662908 1 2023-12-09T02:34:38.241 INFO:tasks.workunit.client.1.smithi161.stdout:2/13: dread f3 [0,4194304] 0 2023-12-09T02:34:38.242 INFO:tasks.workunit.client.1.smithi161.stdout:9/6: rename f0 to f1 0 2023-12-09T02:34:38.246 INFO:tasks.workunit.client.1.smithi161.stdout:1/18: dread f5 [0,4194304] 0 2023-12-09T02:34:38.246 INFO:tasks.workunit.client.1.smithi161.stdout:2/14: mknod d4/c6 0 2023-12-09T02:34:38.247 INFO:tasks.workunit.client.1.smithi161.stdout:2/15: write f1 [1051200,115869] 0 2023-12-09T02:34:38.249 INFO:tasks.workunit.client.1.smithi161.stdout:1/19: dread f5 [0,4194304] 0 2023-12-09T02:34:38.250 INFO:tasks.workunit.client.1.smithi161.stdout:9/7: mkdir d2 0 2023-12-09T02:34:38.250 INFO:tasks.workunit.client.1.smithi161.stdout:9/8: getdents d2 0 2023-12-09T02:34:38.253 INFO:tasks.workunit.client.1.smithi161.stdout:9/9: mknod d2/c3 0 2023-12-09T02:34:38.260 INFO:tasks.workunit.client.1.smithi161.stdout:9/10: dread f1 [0,4194304] 0 2023-12-09T02:34:38.268 INFO:tasks.workunit.client.1.smithi161.stdout:2/16: dwrite f3 [0,4194304] 0 2023-12-09T02:34:38.275 INFO:tasks.workunit.client.1.smithi161.stdout:9/11: dwrite f1 [0,4194304] 0 2023-12-09T02:34:38.279 INFO:tasks.workunit.client.1.smithi161.stdout:2/17: dread f1 [0,4194304] 0 2023-12-09T02:34:38.300 INFO:tasks.workunit.client.1.smithi161.stdout:2/18: dwrite f1 [0,4194304] 0 2023-12-09T02:34:38.301 INFO:tasks.workunit.client.1.smithi161.stdout:2/19: mkdir d4/d7 0 2023-12-09T02:34:38.302 INFO:tasks.workunit.client.1.smithi161.stdout:2/20: write f1 [919812,67770] 0 2023-12-09T02:34:38.318 INFO:tasks.workunit.client.1.smithi161.stdout:2/21: dread f3 [0,4194304] 0 2023-12-09T02:34:38.466 INFO:tasks.workunit.client.1.smithi161.stdout:3/2: getdents . 0 2023-12-09T02:34:38.466 INFO:tasks.workunit.client.1.smithi161.stdout:3/3: dread - no filename 2023-12-09T02:34:38.467 INFO:tasks.workunit.client.1.smithi161.stdout:3/4: symlink l1 0 2023-12-09T02:34:38.471 INFO:tasks.workunit.client.1.smithi161.stdout:3/5: mkdir d2 0 2023-12-09T02:34:38.473 INFO:tasks.workunit.client.1.smithi161.stdout:3/6: creat d2/f3 x:0 0 0 2023-12-09T02:34:38.493 INFO:tasks.workunit.client.1.smithi161.stdout:1/20: getdents . 0 2023-12-09T02:34:38.496 INFO:tasks.workunit.client.1.smithi161.stdout:1/21: mkdir d6 0 2023-12-09T02:34:38.498 INFO:tasks.workunit.client.1.smithi161.stdout:4/13: getdents . 0 2023-12-09T02:34:38.498 INFO:tasks.workunit.client.1.smithi161.stdout:4/14: read - f4 zero size 2023-12-09T02:34:38.499 INFO:tasks.workunit.client.1.smithi161.stdout:1/22: symlink d6/l7 0 2023-12-09T02:34:38.501 INFO:tasks.workunit.client.1.smithi161.stdout:4/15: symlink l6 0 2023-12-09T02:34:38.502 INFO:tasks.workunit.client.1.smithi161.stdout:2/22: write f3 [4950231,3178] 0 2023-12-09T02:34:38.503 INFO:tasks.workunit.client.1.smithi161.stdout:1/23: chown f5 534269526 1 2023-12-09T02:34:38.503 INFO:tasks.workunit.client.1.smithi161.stdout:1/24: chown f5 364 1 2023-12-09T02:34:38.506 INFO:tasks.workunit.client.1.smithi161.stdout:1/25: dread f5 [0,4194304] 0 2023-12-09T02:34:38.517 INFO:tasks.workunit.client.1.smithi161.stdout:1/26: mkdir d6/d8 0 2023-12-09T02:34:38.517 INFO:tasks.workunit.client.1.smithi161.stdout:1/27: fdatasync f5 0 2023-12-09T02:34:38.517 INFO:tasks.workunit.client.1.smithi161.stdout:1/28: chown f5 1722 1 2023-12-09T02:34:38.517 INFO:tasks.workunit.client.1.smithi161.stdout:1/29: chown d6/d8 1586799 1 2023-12-09T02:34:38.519 INFO:tasks.workunit.client.1.smithi161.stdout:1/30: mkdir d6/d9 0 2023-12-09T02:34:38.519 INFO:tasks.workunit.client.1.smithi161.stdout:1/31: read f5 [1292802,19675] 0 2023-12-09T02:34:38.520 INFO:tasks.workunit.client.1.smithi161.stdout:1/32: write f5 [2080917,65177] 0 2023-12-09T02:34:38.522 INFO:tasks.workunit.client.1.smithi161.stdout:7/24: fsync d0/f2 0 2023-12-09T02:34:38.523 INFO:tasks.workunit.client.1.smithi161.stdout:2/23: dwrite f1 [0,4194304] 0 2023-12-09T02:34:38.525 INFO:tasks.workunit.client.1.smithi161.stdout:7/25: creat d0/f4 x:0 0 0 2023-12-09T02:34:38.526 INFO:tasks.workunit.client.1.smithi161.stdout:2/24: mknod d4/d7/c8 0 2023-12-09T02:34:38.529 INFO:tasks.workunit.client.1.smithi161.stdout:7/26: mknod d0/c5 0 2023-12-09T02:34:38.529 INFO:tasks.workunit.client.1.smithi161.stdout:7/27: chown d0/d3 36168914 1 2023-12-09T02:34:38.532 INFO:tasks.workunit.client.1.smithi161.stdout:2/25: rename d4/c5 to d4/d7/c9 0 2023-12-09T02:34:38.543 INFO:tasks.workunit.client.1.smithi161.stdout:1/33: dwrite f5 [0,4194304] 0 2023-12-09T02:34:38.550 INFO:tasks.workunit.client.1.smithi161.stdout:9/12: truncate f1 198270 0 2023-12-09T02:34:38.699 INFO:tasks.workunit.client.1.smithi161.stdout:3/7: rmdir d2 39 2023-12-09T02:34:38.719 INFO:tasks.workunit.client.1.smithi161.stdout:3/8: dwrite d2/f3 [0,4194304] 0 2023-12-09T02:34:38.724 INFO:tasks.workunit.client.1.smithi161.stdout:3/9: mkdir d2/d4 0 2023-12-09T02:34:38.726 INFO:tasks.workunit.client.1.smithi161.stdout:3/10: creat d2/d4/f5 x:0 0 0 2023-12-09T02:34:38.727 INFO:tasks.workunit.client.1.smithi161.stdout:3/11: write d2/f3 [1408545,113210] 0 2023-12-09T02:34:38.734 INFO:tasks.workunit.client.1.smithi161.stdout:7/28: fsync d0/f4 0 2023-12-09T02:34:38.734 INFO:tasks.workunit.client.1.smithi161.stdout:7/29: dread - d0/f4 zero size 2023-12-09T02:34:38.734 INFO:tasks.workunit.client.1.smithi161.stdout:7/30: fsync d0/f2 0 2023-12-09T02:34:38.738 INFO:tasks.workunit.client.1.smithi161.stdout:7/31: link d0/f4 d0/d3/f6 0 2023-12-09T02:34:38.738 INFO:tasks.workunit.client.1.smithi161.stdout:7/32: chown d0/f2 106 1 2023-12-09T02:34:38.738 INFO:tasks.workunit.client.1.smithi161.stdout:7/33: fdatasync d0/f4 0 2023-12-09T02:34:38.738 INFO:tasks.workunit.client.1.smithi161.stdout:7/34: fsync d0/f2 0 2023-12-09T02:34:38.741 INFO:tasks.workunit.client.1.smithi161.stdout:7/35: rename d0/f2 to d0/d3/f7 0 2023-12-09T02:34:38.741 INFO:tasks.workunit.client.1.smithi161.stdout:2/26: getdents d4/d7 0 2023-12-09T02:34:38.741 INFO:tasks.workunit.client.1.smithi161.stdout:2/27: fsync f1 0 2023-12-09T02:34:38.749 INFO:tasks.workunit.client.1.smithi161.stdout:2/28: dread f3 [0,4194304] 0 2023-12-09T02:34:38.754 INFO:tasks.workunit.client.1.smithi161.stdout:2/29: creat d4/fa x:0 0 0 2023-12-09T02:34:38.754 INFO:tasks.workunit.client.1.smithi161.stdout:3/12: dwrite d2/f3 [0,4194304] 0 2023-12-09T02:34:38.756 INFO:tasks.workunit.client.1.smithi161.stdout:2/30: mkdir d4/d7/db 0 2023-12-09T02:34:38.756 INFO:tasks.workunit.client.1.smithi161.stdout:3/13: write d2/f3 [624597,3592] 0 2023-12-09T02:34:38.758 INFO:tasks.workunit.client.1.smithi161.stdout:3/14: rename d2/f3 to d2/d4/f6 0 2023-12-09T02:34:38.760 INFO:tasks.workunit.client.1.smithi161.stdout:3/15: mkdir d2/d4/d7 0 2023-12-09T02:34:38.762 INFO:tasks.workunit.client.1.smithi161.stdout:3/16: symlink d2/d4/l8 0 2023-12-09T02:34:38.765 INFO:tasks.workunit.client.1.smithi161.stdout:7/36: dwrite d0/f4 [0,4194304] 0 2023-12-09T02:34:38.765 INFO:tasks.workunit.client.1.smithi161.stdout:9/13: dread f1 [0,4194304] 0 2023-12-09T02:34:38.765 INFO:tasks.workunit.client.1.smithi161.stdout:9/14: stat f1 0 2023-12-09T02:34:38.765 INFO:tasks.workunit.client.1.smithi161.stdout:9/15: write f1 [1199818,84560] 0 2023-12-09T02:34:38.765 INFO:tasks.workunit.client.1.smithi161.stdout:9/16: chown f1 8615122 1 2023-12-09T02:34:38.767 INFO:tasks.workunit.client.1.smithi161.stdout:7/37: read d0/d3/f6 [2611864,68491] 0 2023-12-09T02:34:38.773 INFO:tasks.workunit.client.1.smithi161.stdout:2/31: dread f1 [0,4194304] 0 2023-12-09T02:34:38.774 INFO:tasks.workunit.client.1.smithi161.stdout:7/38: creat d0/d3/f8 x:0 0 0 2023-12-09T02:34:38.783 INFO:tasks.workunit.client.1.smithi161.stdout:7/39: creat d0/d3/f9 x:0 0 0 2023-12-09T02:34:38.784 INFO:tasks.workunit.client.1.smithi161.stdout:3/17: dwrite d2/d4/f5 [0,4194304] 0 2023-12-09T02:34:38.786 INFO:tasks.workunit.client.1.smithi161.stdout:7/40: unlink d0/f4 0 2023-12-09T02:34:38.787 INFO:tasks.workunit.client.1.smithi161.stdout:7/41: dread - d0/d3/f8 zero size 2023-12-09T02:34:38.790 INFO:tasks.workunit.client.1.smithi161.stdout:7/42: symlink d0/d3/la 0 2023-12-09T02:34:38.790 INFO:tasks.workunit.client.1.smithi161.stdout:7/43: chown d0/d3 125075 1 2023-12-09T02:34:38.790 INFO:tasks.workunit.client.1.smithi161.stdout:7/44: chown d0/d3/f8 445258317 1 2023-12-09T02:34:38.790 INFO:tasks.workunit.client.1.smithi161.stdout:7/45: readlink d0/d3/la 0 2023-12-09T02:34:38.791 INFO:tasks.workunit.client.1.smithi161.stdout:3/18: read d2/d4/f6 [1203600,69368] 0 2023-12-09T02:34:38.792 INFO:tasks.workunit.client.1.smithi161.stdout:7/46: mkdir d0/d3/db 0 2023-12-09T02:34:38.792 INFO:tasks.workunit.client.1.smithi161.stdout:7/47: stat d0/d3/db 0 2023-12-09T02:34:38.794 INFO:tasks.workunit.client.1.smithi161.stdout:3/19: rmdir d2/d4/d7 0 2023-12-09T02:34:38.794 INFO:tasks.workunit.client.1.smithi161.stdout:3/20: chown d2/d4/f5 1 1 2023-12-09T02:34:38.795 INFO:tasks.workunit.client.1.smithi161.stdout:7/48: creat d0/fc x:0 0 0 2023-12-09T02:34:38.795 INFO:tasks.workunit.client.1.smithi161.stdout:7/49: dread - d0/d3/f7 zero size 2023-12-09T02:34:38.795 INFO:tasks.workunit.client.1.smithi161.stdout:7/50: dread - d0/d3/f8 zero size 2023-12-09T02:34:38.796 INFO:tasks.workunit.client.1.smithi161.stdout:3/21: mknod d2/d4/c9 0 2023-12-09T02:34:38.798 INFO:tasks.workunit.client.1.smithi161.stdout:7/51: creat d0/fd x:0 0 0 2023-12-09T02:34:38.801 INFO:tasks.workunit.client.1.smithi161.stdout:7/52: mkdir d0/d3/de 0 2023-12-09T02:34:38.802 INFO:tasks.workunit.client.1.smithi161.stdout:9/17: dwrite f1 [0,4194304] 0 2023-12-09T02:34:38.803 INFO:tasks.workunit.client.1.smithi161.stdout:7/53: creat d0/d3/ff x:0 0 0 2023-12-09T02:34:38.804 INFO:tasks.workunit.client.1.smithi161.stdout:2/32: dwrite f1 [0,4194304] 0 2023-12-09T02:34:38.804 INFO:tasks.workunit.client.1.smithi161.stdout:2/33: dread - d4/fa zero size 2023-12-09T02:34:38.807 INFO:tasks.workunit.client.1.smithi161.stdout:7/54: creat d0/d3/db/f10 x:0 0 0 2023-12-09T02:34:38.807 INFO:tasks.workunit.client.1.smithi161.stdout:3/22: dread d2/d4/f5 [0,4194304] 0 2023-12-09T02:34:38.810 INFO:tasks.workunit.client.1.smithi161.stdout:2/34: creat d4/d7/fc x:0 0 0 2023-12-09T02:34:38.811 INFO:tasks.workunit.client.1.smithi161.stdout:2/35: write f3 [556925,19378] 0 2023-12-09T02:34:38.814 INFO:tasks.workunit.client.1.smithi161.stdout:7/55: mknod d0/d3/c11 0 2023-12-09T02:34:38.840 INFO:tasks.workunit.client.1.smithi161.stdout:2/36: dwrite f1 [0,4194304] 0 2023-12-09T02:34:38.840 INFO:tasks.workunit.client.1.smithi161.stdout:7/56: dwrite d0/d3/f7 [0,4194304] 0 2023-12-09T02:34:38.845 INFO:tasks.workunit.client.1.smithi161.stdout:7/57: symlink d0/d3/l12 0 2023-12-09T02:34:38.863 INFO:tasks.workunit.client.1.smithi161.stdout:2/37: dwrite d4/fa [0,4194304] 0 2023-12-09T02:34:38.863 INFO:tasks.workunit.client.1.smithi161.stdout:2/38: write d4/fa [1643320,36862] 0 2023-12-09T02:34:38.877 INFO:tasks.workunit.client.1.smithi161.stdout:7/58: dread d0/d3/f6 [0,4194304] 0 2023-12-09T02:34:38.885 INFO:tasks.workunit.client.1.smithi161.stdout:7/59: dread d0/d3/f7 [0,4194304] 0 2023-12-09T02:34:38.886 INFO:tasks.workunit.client.1.smithi161.stdout:7/60: mkdir d0/d3/d13 0 2023-12-09T02:34:38.888 INFO:tasks.workunit.client.1.smithi161.stdout:7/61: symlink d0/d3/d13/l14 0 2023-12-09T02:34:38.893 INFO:tasks.workunit.client.1.smithi161.stdout:7/62: dread d0/d3/f7 [0,4194304] 0 2023-12-09T02:34:38.893 INFO:tasks.workunit.client.1.smithi161.stdout:7/63: getdents d0/d3/de 0 2023-12-09T02:34:38.894 INFO:tasks.workunit.client.1.smithi161.stdout:7/64: write d0/d3/f6 [2001959,90017] 0 2023-12-09T02:34:38.897 INFO:tasks.workunit.client.1.smithi161.stdout:7/65: link d0/d3/f6 d0/f15 0 2023-12-09T02:34:38.898 INFO:tasks.workunit.client.1.smithi161.stdout:7/66: mknod d0/d3/c16 0 2023-12-09T02:34:38.899 INFO:tasks.workunit.client.1.smithi161.stdout:7/67: write d0/fd [781315,10461] 0 2023-12-09T02:34:38.900 INFO:tasks.workunit.client.1.smithi161.stdout:7/68: creat d0/d3/f17 x:0 0 0 2023-12-09T02:34:38.901 INFO:tasks.workunit.client.1.smithi161.stdout:7/69: write d0/d3/f8 [1034805,53218] 0 2023-12-09T02:34:38.914 INFO:tasks.workunit.client.1.smithi161.stdout:7/70: dwrite d0/d3/f9 [0,4194304] 0 2023-12-09T02:34:38.915 INFO:tasks.workunit.client.1.smithi161.stdout:3/23: write d2/d4/f6 [5120865,32479] 0 2023-12-09T02:34:38.921 INFO:tasks.workunit.client.1.smithi161.stdout:3/24: creat d2/fa x:0 0 0 2023-12-09T02:34:38.922 INFO:tasks.workunit.client.1.smithi161.stdout:3/25: read d2/d4/f5 [591909,7800] 0 2023-12-09T02:34:38.922 INFO:tasks.workunit.client.1.smithi161.stdout:3/26: read - d2/fa zero size 2023-12-09T02:34:38.925 INFO:tasks.workunit.client.1.smithi161.stdout:7/71: rmdir d0/d3/de 0 2023-12-09T02:34:38.930 INFO:tasks.workunit.client.1.smithi161.stdout:7/72: dread d0/d3/f7 [0,4194304] 0 2023-12-09T02:34:38.930 INFO:tasks.workunit.client.1.smithi161.stdout:7/73: read - d0/d3/f17 zero size 2023-12-09T02:34:38.935 INFO:tasks.workunit.client.1.smithi161.stdout:7/74: dread d0/fd [0,4194304] 0 2023-12-09T02:34:38.935 INFO:tasks.workunit.client.1.smithi161.stdout:7/75: chown d0/d3/f9 251110 1 2023-12-09T02:34:38.935 INFO:tasks.workunit.client.1.smithi161.stdout:7/76: write d0/fc [954369,26291] 0 2023-12-09T02:34:38.950 INFO:tasks.workunit.client.1.smithi161.stdout:7/77: dwrite d0/d3/f9 [0,4194304] 0 2023-12-09T02:34:38.959 INFO:tasks.workunit.client.1.smithi161.stdout:7/78: dread d0/d3/f6 [0,4194304] 0 2023-12-09T02:34:38.959 INFO:tasks.workunit.client.1.smithi161.stdout:7/79: stat d0/d3/f17 0 2023-12-09T02:34:38.961 INFO:tasks.workunit.client.1.smithi161.stdout:7/80: creat d0/d3/d13/f18 x:0 0 0 2023-12-09T02:34:38.978 INFO:tasks.workunit.client.1.smithi161.stdout:9/18: truncate f1 3397912 0 2023-12-09T02:34:38.979 INFO:tasks.workunit.client.1.smithi161.stdout:9/19: symlink d2/l4 0 2023-12-09T02:34:38.981 INFO:tasks.workunit.client.1.smithi161.stdout:9/20: rename d2/l4 to d2/l5 0 2023-12-09T02:34:38.983 INFO:tasks.workunit.client.1.smithi161.stdout:9/21: mknod d2/c6 0 2023-12-09T02:34:39.046 INFO:tasks.workunit.client.1.smithi161.stdout:3/27: getdents d2 0 2023-12-09T02:34:39.052 INFO:tasks.workunit.client.1.smithi161.stdout:7/81: unlink d0/d3/la 0 2023-12-09T02:34:39.053 INFO:tasks.workunit.client.1.smithi161.stdout:3/28: dread d2/d4/f6 [0,4194304] 0 2023-12-09T02:34:39.055 INFO:tasks.workunit.client.1.smithi161.stdout:3/29: creat d2/fb x:0 0 0 2023-12-09T02:34:39.057 INFO:tasks.workunit.client.1.smithi161.stdout:3/30: symlink d2/d4/lc 0 2023-12-09T02:34:39.058 INFO:tasks.workunit.client.1.smithi161.stdout:3/31: write d2/d4/f6 [4082963,4834] 0 2023-12-09T02:34:39.058 INFO:tasks.workunit.client.1.smithi161.stdout:3/32: truncate d2/fb 240545 0 2023-12-09T02:34:39.059 INFO:tasks.workunit.client.1.smithi161.stdout:3/33: chown c0 506373223 1 2023-12-09T02:34:39.059 INFO:tasks.workunit.client.1.smithi161.stdout:3/34: chown d2/d4 179412964 1 2023-12-09T02:34:39.059 INFO:tasks.workunit.client.1.smithi161.stdout:3/35: chown c0 1940657497 1 2023-12-09T02:34:39.084 INFO:tasks.workunit.client.1.smithi161.stdout:3/36: dwrite d2/d4/f6 [4194304,4194304] 0 2023-12-09T02:34:39.085 INFO:tasks.workunit.client.1.smithi161.stdout:9/22: rename d2/l5 to d2/l7 0 2023-12-09T02:34:39.089 INFO:tasks.workunit.client.1.smithi161.stdout:9/23: creat d2/f8 x:0 0 0 2023-12-09T02:34:39.089 INFO:tasks.workunit.client.1.smithi161.stdout:9/24: truncate d2/f8 291473 0 2023-12-09T02:34:39.094 INFO:tasks.workunit.client.1.smithi161.stdout:9/25: dread f1 [0,4194304] 0 2023-12-09T02:34:39.097 INFO:tasks.workunit.client.1.smithi161.stdout:9/26: unlink d2/c3 0 2023-12-09T02:34:39.161 INFO:tasks.workunit.client.1.smithi161.stdout:7/82: dwrite d0/f15 [0,4194304] 0 2023-12-09T02:34:39.163 INFO:tasks.workunit.client.1.smithi161.stdout:3/37: rmdir d2 39 2023-12-09T02:34:39.163 INFO:tasks.workunit.client.1.smithi161.stdout:3/38: stat d2/d4/lc 0 2023-12-09T02:34:39.163 INFO:tasks.workunit.client.1.smithi161.stdout:3/39: chown d2/fb 0 1 2023-12-09T02:34:39.165 INFO:tasks.workunit.client.1.smithi161.stdout:3/40: symlink d2/ld 0 2023-12-09T02:34:39.168 INFO:tasks.workunit.client.1.smithi161.stdout:3/41: creat d2/fe x:0 0 0 2023-12-09T02:34:39.168 INFO:tasks.workunit.client.1.smithi161.stdout:3/42: truncate d2/fa 1023400 0 2023-12-09T02:34:39.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:38 smithi161 ceph-mon[121170]: pgmap v187: 65 pgs: 65 active+clean; 170 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s wr, 961 op/s 2023-12-09T02:34:39.170 INFO:tasks.workunit.client.1.smithi161.stdout:7/83: rmdir d0/d3/d13 39 2023-12-09T02:34:39.174 INFO:tasks.workunit.client.1.smithi161.stdout:7/84: chown d0/d3/db 49491 1 2023-12-09T02:34:39.181 INFO:tasks.workunit.client.1.smithi161.stdout:3/43: dwrite d2/fb [0,4194304] 0 2023-12-09T02:34:39.182 INFO:tasks.workunit.client.1.smithi161.stdout:3/44: dread d2/fa [0,4194304] 0 2023-12-09T02:34:39.186 INFO:tasks.workunit.client.1.smithi161.stdout:3/45: symlink d2/d4/lf 0 2023-12-09T02:34:39.189 INFO:tasks.workunit.client.1.smithi161.stdout:3/46: link d2/d4/lc d2/d4/l10 0 2023-12-09T02:34:39.192 INFO:tasks.workunit.client.1.smithi161.stdout:3/47: dread d2/d4/f6 [0,4194304] 0 2023-12-09T02:34:39.192 INFO:tasks.workunit.client.1.smithi161.stdout:3/48: truncate d2/d4/f5 4895258 0 2023-12-09T02:34:39.193 INFO:tasks.workunit.client.1.smithi161.stdout:3/49: dread d2/fa [0,4194304] 0 2023-12-09T02:34:39.193 INFO:tasks.workunit.client.1.smithi161.stdout:3/50: write d2/fe [998277,5773] 0 2023-12-09T02:34:39.194 INFO:tasks.workunit.client.1.smithi161.stdout:7/85: dwrite d0/d3/f9 [4194304,4194304] 0 2023-12-09T02:34:39.194 INFO:tasks.workunit.client.1.smithi161.stdout:9/27: rmdir d2 39 2023-12-09T02:34:39.197 INFO:tasks.workunit.client.1.smithi161.stdout:7/86: creat d0/d3/db/f19 x:0 0 0 2023-12-09T02:34:39.197 INFO:tasks.workunit.client.1.smithi161.stdout:7/87: chown d0/d3/db/f19 339712 1 2023-12-09T02:34:39.200 INFO:tasks.workunit.client.1.smithi161.stdout:9/28: creat d2/f9 x:0 0 0 2023-12-09T02:34:39.200 INFO:tasks.workunit.client.1.smithi161.stdout:9/29: fdatasync d2/f9 0 2023-12-09T02:34:39.200 INFO:tasks.workunit.client.1.smithi161.stdout:9/30: truncate d2/f8 534954 0 2023-12-09T02:34:39.202 INFO:tasks.workunit.client.1.smithi161.stdout:3/51: dread d2/fb [0,4194304] 0 2023-12-09T02:34:39.202 INFO:tasks.workunit.client.1.smithi161.stdout:9/31: mkdir d2/da 0 2023-12-09T02:34:39.204 INFO:tasks.workunit.client.1.smithi161.stdout:7/88: symlink d0/d3/l1a 0 2023-12-09T02:34:39.206 INFO:tasks.workunit.client.1.smithi161.stdout:3/52: mkdir d2/d4/d11 0 2023-12-09T02:34:39.207 INFO:tasks.workunit.client.1.smithi161.stdout:3/53: dread d2/d4/f5 [4194304,4194304] 0 2023-12-09T02:34:39.208 INFO:tasks.workunit.client.1.smithi161.stdout:7/89: mkdir d0/d3/d13/d1b 0 2023-12-09T02:34:39.214 INFO:tasks.workunit.client.1.smithi161.stdout:7/90: write d0/d3/f17 [194054,102551] 0 2023-12-09T02:34:39.214 INFO:tasks.workunit.client.1.smithi161.stdout:7/91: dread - d0/d3/db/f19 zero size 2023-12-09T02:34:39.214 INFO:tasks.workunit.client.1.smithi161.stdout:7/92: fdatasync d0/d3/db/f19 0 2023-12-09T02:34:39.219 INFO:tasks.workunit.client.1.smithi161.stdout:7/93: unlink d0/f15 0 2023-12-09T02:34:39.220 INFO:tasks.workunit.client.1.smithi161.stdout:7/94: chown d0/d3/f8 728 1 2023-12-09T02:34:39.224 INFO:tasks.workunit.client.1.smithi161.stdout:7/95: rename d0/d3/ff to d0/d3/db/f1c 0 2023-12-09T02:34:39.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:38 smithi088 ceph-mon[112028]: pgmap v187: 65 pgs: 65 active+clean; 170 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s wr, 961 op/s 2023-12-09T02:34:39.226 INFO:tasks.workunit.client.1.smithi161.stdout:7/96: chown d0/d3/f6 5799 1 2023-12-09T02:34:39.226 INFO:tasks.workunit.client.1.smithi161.stdout:7/97: dread - d0/d3/d13/f18 zero size 2023-12-09T02:34:39.231 INFO:tasks.workunit.client.1.smithi161.stdout:7/98: mknod d0/c1d 0 2023-12-09T02:34:39.233 INFO:tasks.workunit.client.1.smithi161.stdout:7/99: creat d0/d3/d13/f1e x:0 0 0 2023-12-09T02:34:39.251 INFO:tasks.workunit.client.1.smithi161.stdout:9/32: truncate d2/f8 239939 0 2023-12-09T02:34:39.255 INFO:tasks.workunit.client.1.smithi161.stdout:3/54: truncate d2/d4/f6 2012347 0 2023-12-09T02:34:39.258 INFO:tasks.workunit.client.1.smithi161.stdout:3/55: creat d2/d4/d11/f12 x:0 0 0 2023-12-09T02:34:39.262 INFO:tasks.workunit.client.1.smithi161.stdout:3/56: dread d2/d4/f5 [0,4194304] 0 2023-12-09T02:34:39.262 INFO:tasks.workunit.client.1.smithi161.stdout:3/57: rename d2/d4/d11 to d2/d4/d11/d13 22 2023-12-09T02:34:39.262 INFO:tasks.workunit.client.1.smithi161.stdout:3/58: readlink d2/d4/lc 0 2023-12-09T02:34:39.263 INFO:tasks.workunit.client.1.smithi161.stdout:3/59: write d2/fb [3575797,84458] 0 2023-12-09T02:34:39.263 INFO:tasks.workunit.client.1.smithi161.stdout:3/60: chown d2 1044 1 2023-12-09T02:34:39.263 INFO:tasks.workunit.client.1.smithi161.stdout:3/61: truncate d2/fa 1642852 0 2023-12-09T02:34:39.263 INFO:tasks.workunit.client.1.smithi161.stdout:3/62: fdatasync d2/d4/f6 0 2023-12-09T02:34:39.265 INFO:tasks.workunit.client.1.smithi161.stdout:9/33: dwrite d2/f9 [0,4194304] 0 2023-12-09T02:34:39.265 INFO:tasks.workunit.client.1.smithi161.stdout:9/34: readlink d2/l7 0 2023-12-09T02:34:39.266 INFO:tasks.workunit.client.1.smithi161.stdout:9/35: read f1 [2947076,113274] 0 2023-12-09T02:34:39.273 INFO:tasks.workunit.client.1.smithi161.stdout:9/36: creat d2/da/fb x:0 0 0 2023-12-09T02:34:39.273 INFO:tasks.workunit.client.1.smithi161.stdout:9/37: rename d2 to d2/dc 22 2023-12-09T02:34:39.279 INFO:tasks.workunit.client.1.smithi161.stdout:3/63: dwrite d2/d4/d11/f12 [0,4194304] 0 2023-12-09T02:34:39.285 INFO:tasks.workunit.client.1.smithi161.stdout:3/64: creat d2/d4/d11/f14 x:0 0 0 2023-12-09T02:34:39.285 INFO:tasks.workunit.client.1.smithi161.stdout:3/65: write d2/d4/d11/f14 [552938,3502] 0 2023-12-09T02:34:39.287 INFO:tasks.workunit.client.1.smithi161.stdout:3/66: creat d2/f15 x:0 0 0 2023-12-09T02:34:39.291 INFO:tasks.workunit.client.1.smithi161.stdout:3/67: unlink d2/fb 0 2023-12-09T02:34:39.318 INFO:tasks.workunit.client.1.smithi161.stdout:3/68: write d2/d4/d11/f12 [4888860,48308] 0 2023-12-09T02:34:39.332 INFO:tasks.workunit.client.1.smithi161.stdout:3/69: dwrite d2/fa [0,4194304] 0 2023-12-09T02:34:39.332 INFO:tasks.workunit.client.1.smithi161.stdout:3/70: readlink d2/d4/l10 0 2023-12-09T02:34:39.335 INFO:tasks.workunit.client.1.smithi161.stdout:3/71: mknod d2/d4/d11/c16 0 2023-12-09T02:34:39.335 INFO:tasks.workunit.client.1.smithi161.stdout:3/72: fdatasync d2/d4/f6 0 2023-12-09T02:34:39.338 INFO:tasks.workunit.client.1.smithi161.stdout:3/73: dread d2/d4/d11/f14 [0,4194304] 0 2023-12-09T02:34:39.344 INFO:tasks.workunit.client.1.smithi161.stdout:3/74: write d2/d4/d11/f12 [3039728,25855] 0 2023-12-09T02:34:39.361 INFO:tasks.workunit.client.1.smithi161.stdout:3/75: dwrite d2/d4/d11/f12 [4194304,4194304] 0 2023-12-09T02:34:39.366 INFO:tasks.workunit.client.1.smithi161.stdout:3/76: truncate d2/fa 3048160 0 2023-12-09T02:34:39.366 INFO:tasks.workunit.client.1.smithi161.stdout:3/77: readlink d2/d4/l8 0 2023-12-09T02:34:39.369 INFO:tasks.workunit.client.1.smithi161.stdout:3/78: rename d2/ld to d2/d4/l17 0 2023-12-09T02:34:39.371 INFO:tasks.workunit.client.1.smithi161.stdout:3/79: link d2/d4/f5 d2/d4/f18 0 2023-12-09T02:34:39.371 INFO:tasks.workunit.client.1.smithi161.stdout:3/80: chown d2/d4/f6 217 1 2023-12-09T02:34:39.394 INFO:tasks.workunit.client.1.smithi161.stdout:3/81: dwrite d2/d4/f18 [4194304,4194304] 0 2023-12-09T02:34:39.398 INFO:tasks.workunit.client.1.smithi161.stdout:3/82: mkdir d2/d4/d11/d19 0 2023-12-09T02:34:39.398 INFO:tasks.workunit.client.1.smithi161.stdout:3/83: write d2/f15 [703891,86191] 0 2023-12-09T02:34:39.416 INFO:tasks.workunit.client.1.smithi161.stdout:3/84: dwrite d2/d4/d11/f12 [0,4194304] 0 2023-12-09T02:34:39.418 INFO:tasks.workunit.client.1.smithi161.stdout:3/85: mkdir d2/d4/d11/d1a 0 2023-12-09T02:34:39.424 INFO:tasks.workunit.client.1.smithi161.stdout:3/86: dread d2/f15 [0,4194304] 0 2023-12-09T02:34:39.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/87: fsync d2/d4/f5 0 2023-12-09T02:34:39.427 INFO:tasks.workunit.client.1.smithi161.stdout:3/88: mkdir d2/d4/d11/d19/d1b 0 2023-12-09T02:34:39.453 INFO:tasks.workunit.client.1.smithi161.stdout:3/89: truncate d2/d4/d11/f12 5734345 0 2023-12-09T02:34:39.457 INFO:tasks.workunit.client.1.smithi161.stdout:3/90: dread d2/f15 [0,4194304] 0 2023-12-09T02:34:39.457 INFO:tasks.workunit.client.1.smithi161.stdout:3/91: getdents d2 0 2023-12-09T02:34:39.460 INFO:tasks.workunit.client.1.smithi161.stdout:3/92: creat d2/d4/d11/d1a/f1c x:0 0 0 2023-12-09T02:34:39.460 INFO:tasks.workunit.client.1.smithi161.stdout:3/93: fdatasync d2/f15 0 2023-12-09T02:34:39.460 INFO:tasks.workunit.client.1.smithi161.stdout:3/94: write d2/fe [1891484,55001] 0 2023-12-09T02:34:39.460 INFO:tasks.workunit.client.1.smithi161.stdout:3/95: readlink d2/d4/l8 0 2023-12-09T02:34:39.460 INFO:tasks.workunit.client.1.smithi161.stdout:3/96: dread - d2/d4/d11/d1a/f1c zero size 2023-12-09T02:34:39.462 INFO:tasks.workunit.client.1.smithi161.stdout:3/97: symlink d2/l1d 0 2023-12-09T02:34:39.463 INFO:tasks.workunit.client.1.smithi161.stdout:3/98: dread d2/d4/d11/f14 [0,4194304] 0 2023-12-09T02:34:39.463 INFO:tasks.workunit.client.1.smithi161.stdout:3/99: read d2/fe [885360,17478] 0 2023-12-09T02:34:41.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:40 smithi161 ceph-mon[121170]: pgmap v188: 65 pgs: 65 active+clean; 191 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 9.2 MiB/s wr, 867 op/s 2023-12-09T02:34:41.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:40 smithi088 ceph-mon[112028]: pgmap v188: 65 pgs: 65 active+clean; 191 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 9.2 MiB/s wr, 867 op/s 2023-12-09T02:34:41.745 INFO:tasks.workunit.client.0.smithi088.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-09T02:34:41.745 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-09T02:34:41.745 INFO:tasks.workunit.client.0.smithi088.stderr:+ make 2023-12-09T02:34:41.876 INFO:tasks.workunit.client.0.smithi088.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-09T02:34:42.086 INFO:tasks.workunit.client.0.smithi088.stderr:++ readlink -f fsstress 2023-12-09T02:34:42.086 INFO:tasks.workunit.client.0.smithi088.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-09T02:34:42.087 INFO:tasks.workunit.client.0.smithi088.stderr:+ popd 2023-12-09T02:34:42.087 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-09T02:34:42.087 INFO:tasks.workunit.client.0.smithi088.stderr:+ popd 2023-12-09T02:34:42.087 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-09T02:34:42.088 INFO:tasks.workunit.client.0.smithi088.stderr:++ mktemp -d -p . 2023-12-09T02:34:42.088 INFO:tasks.workunit.client.0.smithi088.stderr:+ T=./tmp.jT8WBkintA 2023-12-09T02:34:42.088 INFO:tasks.workunit.client.0.smithi088.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.jT8WBkintA -l 1 -n 1000 -p 10 -v 2023-12-09T02:34:42.089 INFO:tasks.workunit.client.0.smithi088.stdout:seed = 1702005174 2023-12-09T02:34:42.091 INFO:tasks.workunit.client.0.smithi088.stdout:0/0: truncate - no filename 2023-12-09T02:34:42.091 INFO:tasks.workunit.client.0.smithi088.stdout:0/1: truncate - no filename 2023-12-09T02:34:42.091 INFO:tasks.workunit.client.0.smithi088.stdout:0/2: dread - no filename 2023-12-09T02:34:42.091 INFO:tasks.workunit.client.0.smithi088.stdout:0/3: dread - no filename 2023-12-09T02:34:42.091 INFO:tasks.workunit.client.0.smithi088.stdout:0/4: dwrite - no filename 2023-12-09T02:34:42.092 INFO:tasks.workunit.client.0.smithi088.stdout:0/5: dread - no filename 2023-12-09T02:34:42.092 INFO:tasks.workunit.client.0.smithi088.stdout:0/6: stat - no entries 2023-12-09T02:34:42.092 INFO:tasks.workunit.client.0.smithi088.stdout:0/7: dwrite - no filename 2023-12-09T02:34:42.092 INFO:tasks.workunit.client.0.smithi088.stdout:0/8: write - no filename 2023-12-09T02:34:42.092 INFO:tasks.workunit.client.0.smithi088.stdout:0/9: dread - no filename 2023-12-09T02:34:42.092 INFO:tasks.workunit.client.0.smithi088.stdout:1/0: dwrite - no filename 2023-12-09T02:34:42.092 INFO:tasks.workunit.client.0.smithi088.stdout:1/1: dread - no filename 2023-12-09T02:34:42.092 INFO:tasks.workunit.client.0.smithi088.stdout:1/2: stat - no entries 2023-12-09T02:34:42.092 INFO:tasks.workunit.client.0.smithi088.stdout:0/10: mknod c0 0 2023-12-09T02:34:42.093 INFO:tasks.workunit.client.0.smithi088.stdout:0/11: chown c0 14 1 2023-12-09T02:34:42.094 INFO:tasks.workunit.client.0.smithi088.stdout:2/0: dread - no filename 2023-12-09T02:34:42.094 INFO:tasks.workunit.client.0.smithi088.stdout:1/3: symlink l0 0 2023-12-09T02:34:42.094 INFO:tasks.workunit.client.0.smithi088.stdout:0/12: creat f1 x:0 0 0 2023-12-09T02:34:42.094 INFO:tasks.workunit.client.0.smithi088.stdout:0/13: write f1 [709922,7652] 0 2023-12-09T02:34:42.095 INFO:tasks.workunit.client.0.smithi088.stdout:3/0: link - no file 2023-12-09T02:34:42.095 INFO:tasks.workunit.client.0.smithi088.stdout:3/1: rename - no filename 2023-12-09T02:34:42.095 INFO:tasks.workunit.client.0.smithi088.stdout:3/2: dread - no filename 2023-12-09T02:34:42.095 INFO:tasks.workunit.client.0.smithi088.stdout:2/1: creat f0 x:0 0 0 2023-12-09T02:34:42.096 INFO:tasks.workunit.client.0.smithi088.stdout:1/4: symlink l1 0 2023-12-09T02:34:42.097 INFO:tasks.workunit.client.0.smithi088.stdout:1/5: fdatasync - no filename 2023-12-09T02:34:42.097 INFO:tasks.workunit.client.0.smithi088.stdout:1/6: dwrite - no filename 2023-12-09T02:34:42.097 INFO:tasks.workunit.client.0.smithi088.stdout:1/7: dwrite - no filename 2023-12-09T02:34:42.097 INFO:tasks.workunit.client.0.smithi088.stdout:1/8: rmdir - no directory 2023-12-09T02:34:42.098 INFO:tasks.workunit.client.0.smithi088.stdout:4/0: dwrite - no filename 2023-12-09T02:34:42.098 INFO:tasks.workunit.client.0.smithi088.stdout:3/3: symlink l0 0 2023-12-09T02:34:42.098 INFO:tasks.workunit.client.0.smithi088.stdout:3/4: dwrite - no filename 2023-12-09T02:34:42.098 INFO:tasks.workunit.client.0.smithi088.stdout:0/14: dread f1 [0,4194304] 0 2023-12-09T02:34:42.098 INFO:tasks.workunit.client.0.smithi088.stdout:0/15: stat f1 0 2023-12-09T02:34:42.099 INFO:tasks.workunit.client.0.smithi088.stdout:2/2: creat f1 x:0 0 0 2023-12-09T02:34:42.099 INFO:tasks.workunit.client.0.smithi088.stdout:2/3: dread - f1 zero size 2023-12-09T02:34:42.099 INFO:tasks.workunit.client.0.smithi088.stdout:4/1: creat f0 x:0 0 0 2023-12-09T02:34:42.100 INFO:tasks.workunit.client.0.smithi088.stdout:3/5: mkdir d1 0 2023-12-09T02:34:42.102 INFO:tasks.workunit.client.0.smithi088.stdout:5/0: mknod c0 0 2023-12-09T02:34:42.102 INFO:tasks.workunit.client.0.smithi088.stdout:5/1: chown c0 42371 1 2023-12-09T02:34:42.104 INFO:tasks.workunit.client.0.smithi088.stdout:3/6: mkdir d1/d2 0 2023-12-09T02:34:42.105 INFO:tasks.workunit.client.0.smithi088.stdout:7/0: chown . 5959 1 2023-12-09T02:34:42.105 INFO:tasks.workunit.client.0.smithi088.stdout:7/1: rename - no filename 2023-12-09T02:34:42.105 INFO:tasks.workunit.client.0.smithi088.stdout:7/2: truncate - no filename 2023-12-09T02:34:42.108 INFO:tasks.workunit.client.0.smithi088.stdout:6/0: mknod c0 0 2023-12-09T02:34:42.108 INFO:tasks.workunit.client.0.smithi088.stdout:6/1: write - no filename 2023-12-09T02:34:42.113 INFO:tasks.workunit.client.0.smithi088.stdout:7/3: mknod c0 0 2023-12-09T02:34:42.115 INFO:tasks.workunit.client.0.smithi088.stdout:1/9: getdents . 0 2023-12-09T02:34:42.116 INFO:tasks.workunit.client.0.smithi088.stdout:0/16: dread f1 [0,4194304] 0 2023-12-09T02:34:42.117 INFO:tasks.workunit.client.0.smithi088.stdout:0/17: chown f1 24124 1 2023-12-09T02:34:42.137 INFO:tasks.workunit.client.0.smithi088.stdout:7/4: mknod c1 0 2023-12-09T02:34:42.137 INFO:tasks.workunit.client.0.smithi088.stdout:7/5: read - no filename 2023-12-09T02:34:42.137 INFO:tasks.workunit.client.0.smithi088.stdout:7/6: truncate - no filename 2023-12-09T02:34:42.137 INFO:tasks.workunit.client.0.smithi088.stdout:8/0: creat f0 x:0 0 0 2023-12-09T02:34:42.138 INFO:tasks.workunit.client.0.smithi088.stdout:6/2: symlink l1 0 2023-12-09T02:34:42.138 INFO:tasks.workunit.client.0.smithi088.stdout:6/3: dwrite - no filename 2023-12-09T02:34:42.139 INFO:tasks.workunit.client.0.smithi088.stdout:1/10: creat f2 x:0 0 0 2023-12-09T02:34:42.139 INFO:tasks.workunit.client.0.smithi088.stdout:1/11: dread - f2 zero size 2023-12-09T02:34:42.139 INFO:tasks.workunit.client.0.smithi088.stdout:0/18: creat f2 x:0 0 0 2023-12-09T02:34:42.143 INFO:tasks.workunit.client.0.smithi088.stdout:8/1: creat f1 x:0 0 0 2023-12-09T02:34:42.144 INFO:tasks.workunit.client.0.smithi088.stdout:9/0: creat f0 x:0 0 0 2023-12-09T02:34:42.144 INFO:tasks.workunit.client.0.smithi088.stdout:7/7: creat f2 x:0 0 0 2023-12-09T02:34:42.144 INFO:tasks.workunit.client.0.smithi088.stdout:7/8: chown c0 24 1 2023-12-09T02:34:42.144 INFO:tasks.workunit.client.0.smithi088.stdout:7/9: chown c1 84152496 1 2023-12-09T02:34:42.146 INFO:tasks.workunit.client.0.smithi088.stdout:1/12: creat f3 x:0 0 0 2023-12-09T02:34:42.151 INFO:tasks.workunit.client.0.smithi088.stdout:7/10: mknod c3 0 2023-12-09T02:34:42.151 INFO:tasks.workunit.client.0.smithi088.stdout:7/11: readlink - no filename 2023-12-09T02:34:42.151 INFO:tasks.workunit.client.0.smithi088.stdout:7/12: write f2 [73476,35380] 0 2023-12-09T02:34:42.155 INFO:tasks.workunit.client.0.smithi088.stdout:7/13: symlink l4 0 2023-12-09T02:34:42.155 INFO:tasks.workunit.client.0.smithi088.stdout:7/14: chown c0 1 1 2023-12-09T02:34:42.160 INFO:tasks.workunit.client.0.smithi088.stdout:7/15: creat f5 x:0 0 0 2023-12-09T02:34:42.171 INFO:tasks.workunit.client.0.smithi088.stdout:7/16: symlink l6 0 2023-12-09T02:34:42.172 INFO:tasks.workunit.client.0.smithi088.stdout:7/17: readlink l6 0 2023-12-09T02:34:42.607 INFO:tasks.workunit.client.0.smithi088.stdout:0/19: dread f1 [0,4194304] 0 2023-12-09T02:34:42.607 INFO:tasks.workunit.client.0.smithi088.stdout:0/20: readlink - no filename 2023-12-09T02:34:42.892 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:42 smithi161 ceph-mon[121170]: pgmap v189: 65 pgs: 65 active+clean; 191 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 7.0 MiB/s wr, 578 op/s 2023-12-09T02:34:43.036 INFO:tasks.workunit.client.0.smithi088.stdout:8/2: read - f1 zero size 2023-12-09T02:34:43.036 INFO:tasks.workunit.client.0.smithi088.stdout:9/1: truncate f0 487374 0 2023-12-09T02:34:43.036 INFO:tasks.workunit.client.0.smithi088.stdout:8/3: readlink - no filename 2023-12-09T02:34:43.124 INFO:tasks.workunit.client.0.smithi088.stdout:9/2: dwrite f0 [0,4194304] 0 2023-12-09T02:34:43.202 INFO:tasks.workunit.client.0.smithi088.stdout:5/2: getdents . 0 2023-12-09T02:34:43.202 INFO:tasks.workunit.client.0.smithi088.stdout:5/3: dwrite - no filename 2023-12-09T02:34:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:42 smithi088 ceph-mon[112028]: pgmap v189: 65 pgs: 65 active+clean; 191 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 7.0 MiB/s wr, 578 op/s 2023-12-09T02:34:43.362 INFO:tasks.workunit.client.0.smithi088.stdout:6/4: getdents . 0 2023-12-09T02:34:43.362 INFO:tasks.workunit.client.0.smithi088.stdout:6/5: chown l1 33 1 2023-12-09T02:34:43.371 INFO:tasks.workunit.client.0.smithi088.stdout:1/13: getdents . 0 2023-12-09T02:34:43.371 INFO:tasks.workunit.client.0.smithi088.stdout:1/14: chown l0 1093 1 2023-12-09T02:34:43.371 INFO:tasks.workunit.client.0.smithi088.stdout:1/15: dread - f2 zero size 2023-12-09T02:34:43.376 INFO:tasks.workunit.client.0.smithi088.stdout:7/18: getdents . 0 2023-12-09T02:34:44.133 INFO:tasks.workunit.client.0.smithi088.stdout:0/21: rename f1 to f3 0 2023-12-09T02:34:44.133 INFO:tasks.workunit.client.0.smithi088.stdout:0/22: chown f3 3862 1 2023-12-09T02:34:44.133 INFO:tasks.workunit.client.0.smithi088.stdout:0/23: write f2 [438691,10111] 0 2023-12-09T02:34:44.134 INFO:tasks.workunit.client.0.smithi088.stdout:0/24: dread f3 [0,4194304] 0 2023-12-09T02:34:44.134 INFO:tasks.workunit.client.0.smithi088.stdout:0/25: write f3 [1239848,131064] 0 2023-12-09T02:34:44.134 INFO:tasks.workunit.client.0.smithi088.stdout:0/26: truncate f3 2274113 0 2023-12-09T02:34:45.069 INFO:tasks.workunit.client.0.smithi088.stdout:8/4: mkdir d2 0 2023-12-09T02:34:45.070 INFO:tasks.workunit.client.0.smithi088.stdout:8/5: write f0 [847749,17473] 0 2023-12-09T02:34:45.071 INFO:tasks.workunit.client.0.smithi088.stdout:8/6: fdatasync f0 0 2023-12-09T02:34:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:44 smithi161 ceph-mon[121170]: pgmap v190: 65 pgs: 65 active+clean; 255 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.3 MiB/s rd, 16 MiB/s wr, 778 op/s 2023-12-09T02:34:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:44 smithi161 ceph-mon[121170]: Standby manager daemon smithi161.qmxtmg restarted 2023-12-09T02:34:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:44 smithi161 ceph-mon[121170]: Standby manager daemon smithi161.qmxtmg started 2023-12-09T02:34:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:44 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/crt"}]: dispatch 2023-12-09T02:34:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:44 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:34:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:44 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/key"}]: dispatch 2023-12-09T02:34:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:44 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:34:45.218 INFO:tasks.workunit.client.0.smithi088.stdout:5/4: symlink l1 0 2023-12-09T02:34:45.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:44 smithi088 ceph-mon[112028]: pgmap v190: 65 pgs: 65 active+clean; 255 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.3 MiB/s rd, 16 MiB/s wr, 778 op/s 2023-12-09T02:34:45.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:44 smithi088 ceph-mon[112028]: Standby manager daemon smithi161.qmxtmg restarted 2023-12-09T02:34:45.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:44 smithi088 ceph-mon[112028]: Standby manager daemon smithi161.qmxtmg started 2023-12-09T02:34:45.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:44 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/crt"}]: dispatch 2023-12-09T02:34:45.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:44 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:34:45.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:44 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/key"}]: dispatch 2023-12-09T02:34:45.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:44 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:34:45.371 INFO:tasks.workunit.client.0.smithi088.stdout:6/6: mknod c2 0 2023-12-09T02:34:45.372 INFO:tasks.workunit.client.0.smithi088.stdout:6/7: truncate - no filename 2023-12-09T02:34:45.372 INFO:tasks.workunit.client.0.smithi088.stdout:1/16: creat f4 x:0 0 0 2023-12-09T02:34:45.372 INFO:tasks.workunit.client.0.smithi088.stdout:1/17: dread - f2 zero size 2023-12-09T02:34:45.372 INFO:tasks.workunit.client.0.smithi088.stdout:7/19: symlink l7 0 2023-12-09T02:34:45.373 INFO:tasks.workunit.client.0.smithi088.stdout:0/27: creat f4 x:0 0 0 2023-12-09T02:34:45.373 INFO:tasks.workunit.client.0.smithi088.stdout:0/28: readlink - no filename 2023-12-09T02:34:45.373 INFO:tasks.workunit.client.0.smithi088.stdout:0/29: chown f2 0 1 2023-12-09T02:34:45.374 INFO:tasks.workunit.client.0.smithi088.stdout:8/7: creat d2/f3 x:0 0 0 2023-12-09T02:34:45.378 INFO:tasks.workunit.client.0.smithi088.stdout:8/8: dread f0 [0,4194304] 0 2023-12-09T02:34:45.379 INFO:tasks.workunit.client.0.smithi088.stdout:1/18: link f3 f5 0 2023-12-09T02:34:45.379 INFO:tasks.workunit.client.0.smithi088.stdout:1/19: read - f4 zero size 2023-12-09T02:34:45.379 INFO:tasks.workunit.client.0.smithi088.stdout:1/20: dread - f4 zero size 2023-12-09T02:34:45.379 INFO:tasks.workunit.client.0.smithi088.stdout:1/21: write f2 [325847,103811] 0 2023-12-09T02:34:45.379 INFO:tasks.workunit.client.0.smithi088.stdout:1/22: truncate f3 563189 0 2023-12-09T02:34:45.380 INFO:tasks.workunit.client.0.smithi088.stdout:1/23: dread f5 [0,4194304] 0 2023-12-09T02:34:45.380 INFO:tasks.workunit.client.0.smithi088.stdout:0/30: symlink l5 0 2023-12-09T02:34:45.381 INFO:tasks.workunit.client.0.smithi088.stdout:0/31: stat f3 0 2023-12-09T02:34:45.381 INFO:tasks.workunit.client.0.smithi088.stdout:0/32: rmdir - no directory 2023-12-09T02:34:45.382 INFO:tasks.workunit.client.0.smithi088.stdout:5/5: mknod c2 0 2023-12-09T02:34:45.382 INFO:tasks.workunit.client.0.smithi088.stdout:5/6: write - no filename 2023-12-09T02:34:45.383 INFO:tasks.workunit.client.0.smithi088.stdout:1/24: creat f6 x:0 0 0 2023-12-09T02:34:45.383 INFO:tasks.workunit.client.0.smithi088.stdout:1/25: rmdir - no directory 2023-12-09T02:34:45.384 INFO:tasks.workunit.client.0.smithi088.stdout:1/26: creat f7 x:0 0 0 2023-12-09T02:34:45.384 INFO:tasks.workunit.client.0.smithi088.stdout:1/27: chown f6 28243 1 2023-12-09T02:34:45.385 INFO:tasks.workunit.client.0.smithi088.stdout:1/28: chown l1 9594 1 2023-12-09T02:34:45.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/7: mkdir d3 0 2023-12-09T02:34:45.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/8: stat d3 0 2023-12-09T02:34:45.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/9: dwrite - no filename 2023-12-09T02:34:45.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/10: write - no filename 2023-12-09T02:34:45.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/11: write - no filename 2023-12-09T02:34:45.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/12: dread - no filename 2023-12-09T02:34:45.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/13: chown c2 29515 1 2023-12-09T02:34:45.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/14: write - no filename 2023-12-09T02:34:45.387 INFO:tasks.workunit.client.0.smithi088.stdout:1/29: mkdir d8 0 2023-12-09T02:34:45.388 INFO:tasks.workunit.client.0.smithi088.stdout:0/33: dread f3 [0,4194304] 0 2023-12-09T02:34:45.388 INFO:tasks.workunit.client.0.smithi088.stdout:5/15: unlink c2 0 2023-12-09T02:34:45.388 INFO:tasks.workunit.client.0.smithi088.stdout:5/16: fsync - no filename 2023-12-09T02:34:45.388 INFO:tasks.workunit.client.0.smithi088.stdout:5/17: fdatasync - no filename 2023-12-09T02:34:45.389 INFO:tasks.workunit.client.0.smithi088.stdout:1/30: mknod d8/c9 0 2023-12-09T02:34:45.394 INFO:tasks.workunit.client.0.smithi088.stdout:0/34: creat f6 x:0 0 0 2023-12-09T02:34:45.394 INFO:tasks.workunit.client.0.smithi088.stdout:0/35: write f4 [200145,20306] 0 2023-12-09T02:34:45.394 INFO:tasks.workunit.client.0.smithi088.stdout:0/36: readlink l5 0 2023-12-09T02:34:45.395 INFO:tasks.workunit.client.0.smithi088.stdout:5/18: link c0 d3/c4 0 2023-12-09T02:34:45.395 INFO:tasks.workunit.client.0.smithi088.stdout:5/19: chown d3/c4 797 1 2023-12-09T02:34:45.395 INFO:tasks.workunit.client.0.smithi088.stdout:5/20: write - no filename 2023-12-09T02:34:45.396 INFO:tasks.workunit.client.0.smithi088.stdout:5/21: write - no filename 2023-12-09T02:34:45.396 INFO:tasks.workunit.client.0.smithi088.stdout:5/22: write - no filename 2023-12-09T02:34:45.396 INFO:tasks.workunit.client.0.smithi088.stdout:0/37: creat f7 x:0 0 0 2023-12-09T02:34:45.396 INFO:tasks.workunit.client.0.smithi088.stdout:0/38: readlink l5 0 2023-12-09T02:34:45.396 INFO:tasks.workunit.client.0.smithi088.stdout:5/23: rmdir d3 39 2023-12-09T02:34:45.399 INFO:tasks.workunit.client.0.smithi088.stdout:8/9: dwrite f1 [0,4194304] 0 2023-12-09T02:34:45.401 INFO:tasks.workunit.client.0.smithi088.stdout:0/39: dread f2 [0,4194304] 0 2023-12-09T02:34:45.410 INFO:tasks.workunit.client.0.smithi088.stdout:1/31: dwrite f3 [0,4194304] 0 2023-12-09T02:34:45.410 INFO:tasks.workunit.client.0.smithi088.stdout:0/40: fdatasync f4 0 2023-12-09T02:34:45.416 INFO:tasks.workunit.client.0.smithi088.stdout:1/32: rename f7 to d8/fa 0 2023-12-09T02:34:45.416 INFO:tasks.workunit.client.0.smithi088.stdout:0/41: rename f7 to f8 0 2023-12-09T02:34:45.416 INFO:tasks.workunit.client.0.smithi088.stdout:1/33: read f5 [2716275,84101] 0 2023-12-09T02:34:46.110 INFO:tasks.workunit.client.0.smithi088.stdout:9/3: truncate f0 3934340 0 2023-12-09T02:34:46.111 INFO:tasks.workunit.client.0.smithi088.stdout:9/4: stat f0 0 2023-12-09T02:34:46.111 INFO:tasks.workunit.client.0.smithi088.stdout:9/5: stat f0 0 2023-12-09T02:34:46.149 INFO:tasks.workunit.client.0.smithi088.stdout:0/42: symlink l9 0 2023-12-09T02:34:46.150 INFO:tasks.workunit.client.0.smithi088.stdout:0/43: write f4 [102838,119275] 0 2023-12-09T02:34:46.150 INFO:tasks.workunit.client.0.smithi088.stdout:1/34: rmdir d8 39 2023-12-09T02:34:46.151 INFO:tasks.workunit.client.0.smithi088.stdout:9/6: symlink l1 0 2023-12-09T02:34:46.151 INFO:tasks.workunit.client.0.smithi088.stdout:9/7: stat l1 0 2023-12-09T02:34:46.152 INFO:tasks.workunit.client.0.smithi088.stdout:1/35: rename f5 to d8/fb 0 2023-12-09T02:34:46.153 INFO:tasks.workunit.client.0.smithi088.stdout:9/8: mknod c2 0 2023-12-09T02:34:46.153 INFO:tasks.workunit.client.0.smithi088.stdout:1/36: write d8/fb [605376,127343] 0 2023-12-09T02:34:46.154 INFO:tasks.workunit.client.0.smithi088.stdout:9/9: mknod c3 0 2023-12-09T02:34:46.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:45 smithi161 ceph-mon[121170]: mgrmap e20: smithi088.jwlofb(active, since 5m), standbys: smithi161.qmxtmg 2023-12-09T02:34:46.172 INFO:tasks.workunit.client.0.smithi088.stdout:1/37: dwrite f2 [0,4194304] 0 2023-12-09T02:34:46.176 INFO:tasks.workunit.client.0.smithi088.stdout:0/44: dwrite f8 [0,4194304] 0 2023-12-09T02:34:46.176 INFO:tasks.workunit.client.0.smithi088.stdout:0/45: chown f6 91698166 1 2023-12-09T02:34:46.179 INFO:tasks.workunit.client.0.smithi088.stdout:0/46: mknod ca 0 2023-12-09T02:34:46.179 INFO:tasks.workunit.client.0.smithi088.stdout:0/47: creat fb x:0 0 0 2023-12-09T02:34:46.180 INFO:tasks.workunit.client.0.smithi088.stdout:0/48: chown ca 5795672 1 2023-12-09T02:34:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:45 smithi088 ceph-mon[112028]: mgrmap e20: smithi088.jwlofb(active, since 5m), standbys: smithi161.qmxtmg 2023-12-09T02:34:46.229 INFO:tasks.workunit.client.0.smithi088.stdout:6/8: getdents . 0 2023-12-09T02:34:46.229 INFO:tasks.workunit.client.0.smithi088.stdout:6/9: rmdir - no directory 2023-12-09T02:34:46.229 INFO:tasks.workunit.client.0.smithi088.stdout:6/10: dread - no filename 2023-12-09T02:34:46.229 INFO:tasks.workunit.client.0.smithi088.stdout:7/20: getdents . 0 2023-12-09T02:34:46.249 INFO:tasks.workunit.client.0.smithi088.stdout:8/10: dwrite f1 [4194304,4194304] 0 2023-12-09T02:34:46.249 INFO:tasks.workunit.client.0.smithi088.stdout:7/21: dwrite f2 [0,4194304] 0 2023-12-09T02:34:46.250 INFO:tasks.workunit.client.0.smithi088.stdout:7/22: write f2 [1938051,20411] 0 2023-12-09T02:34:46.251 INFO:tasks.workunit.client.0.smithi088.stdout:8/11: symlink d2/l4 0 2023-12-09T02:34:46.251 INFO:tasks.workunit.client.0.smithi088.stdout:8/12: fdatasync f1 0 2023-12-09T02:34:46.254 INFO:tasks.workunit.client.0.smithi088.stdout:7/23: rename l6 to l8 0 2023-12-09T02:34:46.254 INFO:tasks.workunit.client.0.smithi088.stdout:7/24: fdatasync f5 0 2023-12-09T02:34:46.270 INFO:tasks.workunit.client.0.smithi088.stdout:7/25: dread f2 [0,4194304] 0 2023-12-09T02:34:46.271 INFO:tasks.workunit.client.0.smithi088.stdout:7/26: readlink l4 0 2023-12-09T02:34:46.271 INFO:tasks.workunit.client.0.smithi088.stdout:7/27: symlink l9 0 2023-12-09T02:34:46.272 INFO:tasks.workunit.client.0.smithi088.stdout:7/28: rename l9 to la 0 2023-12-09T02:34:46.290 INFO:tasks.workunit.client.0.smithi088.stdout:7/29: dwrite f5 [0,4194304] 0 2023-12-09T02:34:46.290 INFO:tasks.workunit.client.0.smithi088.stdout:7/30: fsync f5 0 2023-12-09T02:34:46.468 INFO:tasks.workunit.client.0.smithi088.stdout:0/49: getdents . 0 2023-12-09T02:34:46.470 INFO:tasks.workunit.client.0.smithi088.stdout:0/50: link f8 fc 0 2023-12-09T02:34:46.472 INFO:tasks.workunit.client.0.smithi088.stdout:0/51: rename c0 to cd 0 2023-12-09T02:34:46.473 INFO:tasks.workunit.client.0.smithi088.stdout:0/52: creat fe x:0 0 0 2023-12-09T02:34:46.476 INFO:tasks.workunit.client.0.smithi088.stdout:0/53: mkdir df 0 2023-12-09T02:34:46.476 INFO:tasks.workunit.client.0.smithi088.stdout:0/54: dread - fb zero size 2023-12-09T02:34:46.478 INFO:tasks.workunit.client.0.smithi088.stdout:0/55: mkdir df/d10 0 2023-12-09T02:34:46.479 INFO:tasks.workunit.client.0.smithi088.stdout:0/56: chown ca 0 1 2023-12-09T02:34:46.479 INFO:tasks.workunit.client.0.smithi088.stdout:0/57: symlink df/d10/l11 0 2023-12-09T02:34:46.480 INFO:tasks.workunit.client.0.smithi088.stdout:0/58: chown l9 12662175 1 2023-12-09T02:34:46.481 INFO:tasks.workunit.client.0.smithi088.stdout:0/59: mknod df/c12 0 2023-12-09T02:34:46.482 INFO:tasks.workunit.client.0.smithi088.stdout:0/60: creat df/d10/f13 x:0 0 0 2023-12-09T02:34:46.482 INFO:tasks.workunit.client.0.smithi088.stdout:0/61: readlink l5 0 2023-12-09T02:34:46.482 INFO:tasks.workunit.client.0.smithi088.stdout:0/62: chown df/c12 188583 1 2023-12-09T02:34:46.483 INFO:tasks.workunit.client.0.smithi088.stdout:0/63: stat df/c12 0 2023-12-09T02:34:46.483 INFO:tasks.workunit.client.0.smithi088.stdout:0/64: dread - fb zero size 2023-12-09T02:34:46.483 INFO:tasks.workunit.client.0.smithi088.stdout:0/65: link df/d10/l11 df/d10/l14 0 2023-12-09T02:34:46.484 INFO:tasks.workunit.client.0.smithi088.stdout:0/66: creat df/d10/f15 x:0 0 0 2023-12-09T02:34:46.491 INFO:tasks.workunit.client.0.smithi088.stdout:7/31: dwrite f2 [4194304,4194304] 0 2023-12-09T02:34:46.498 INFO:tasks.workunit.client.0.smithi088.stdout:0/67: getdents df/d10 0 2023-12-09T02:34:46.510 INFO:tasks.workunit.client.0.smithi088.stdout:7/32: dwrite f5 [0,4194304] 0 2023-12-09T02:34:46.510 INFO:tasks.workunit.client.0.smithi088.stdout:7/33: truncate f5 4871024 0 2023-12-09T02:34:46.511 INFO:tasks.workunit.client.0.smithi088.stdout:7/34: creat fb x:0 0 0 2023-12-09T02:34:46.511 INFO:tasks.workunit.client.0.smithi088.stdout:7/35: fsync f2 0 2023-12-09T02:34:46.511 INFO:tasks.workunit.client.0.smithi088.stdout:7/36: chown l8 1029 1 2023-12-09T02:34:46.512 INFO:tasks.workunit.client.0.smithi088.stdout:7/37: mkdir dc 0 2023-12-09T02:34:46.513 INFO:tasks.workunit.client.0.smithi088.stdout:7/38: symlink dc/ld 0 2023-12-09T02:34:46.513 INFO:tasks.workunit.client.0.smithi088.stdout:7/39: fsync f5 0 2023-12-09T02:34:46.518 INFO:tasks.workunit.client.0.smithi088.stdout:0/68: dwrite f8 [0,4194304] 0 2023-12-09T02:34:46.527 INFO:tasks.workunit.client.0.smithi088.stdout:7/40: dwrite f5 [4194304,4194304] 0 2023-12-09T02:34:46.527 INFO:tasks.workunit.client.0.smithi088.stdout:7/41: stat dc 0 2023-12-09T02:34:46.528 INFO:tasks.workunit.client.0.smithi088.stdout:7/42: unlink c0 0 2023-12-09T02:34:46.529 INFO:tasks.workunit.client.0.smithi088.stdout:7/43: mkdir dc/de 0 2023-12-09T02:34:46.529 INFO:tasks.workunit.client.0.smithi088.stdout:7/44: chown l8 52 1 2023-12-09T02:34:46.529 INFO:tasks.workunit.client.0.smithi088.stdout:7/45: creat dc/de/ff x:0 0 0 2023-12-09T02:34:46.529 INFO:tasks.workunit.client.0.smithi088.stdout:7/46: chown la 107904 1 2023-12-09T02:34:46.533 INFO:tasks.workunit.client.0.smithi088.stdout:7/47: truncate f5 6842376 0 2023-12-09T02:34:46.534 INFO:tasks.workunit.client.0.smithi088.stdout:7/48: mkdir dc/d10 0 2023-12-09T02:34:46.535 INFO:tasks.workunit.client.0.smithi088.stdout:7/49: rmdir dc/de 39 2023-12-09T02:34:46.538 INFO:tasks.workunit.client.0.smithi088.stdout:0/69: dwrite df/d10/f13 [0,4194304] 0 2023-12-09T02:34:46.538 INFO:tasks.workunit.client.0.smithi088.stdout:0/70: fdatasync fc 0 2023-12-09T02:34:46.542 INFO:tasks.workunit.client.0.smithi088.stdout:0/71: unlink f8 0 2023-12-09T02:34:46.548 INFO:tasks.workunit.client.0.smithi088.stdout:7/50: dwrite f2 [8388608,4194304] 0 2023-12-09T02:34:46.549 INFO:tasks.workunit.client.0.smithi088.stdout:7/51: mknod dc/d10/c11 0 2023-12-09T02:34:46.551 INFO:tasks.workunit.client.0.smithi088.stdout:7/52: mknod dc/de/c12 0 2023-12-09T02:34:46.551 INFO:tasks.workunit.client.0.smithi088.stdout:7/53: dread - fb zero size 2023-12-09T02:34:46.551 INFO:tasks.workunit.client.0.smithi088.stdout:7/54: readlink dc/ld 0 2023-12-09T02:34:46.558 INFO:tasks.workunit.client.0.smithi088.stdout:0/72: dwrite fb [0,4194304] 0 2023-12-09T02:34:46.559 INFO:tasks.workunit.client.0.smithi088.stdout:0/73: truncate fe 394634 0 2023-12-09T02:34:46.561 INFO:tasks.workunit.client.0.smithi088.stdout:0/74: write f3 [1116238,120710] 0 2023-12-09T02:34:46.562 INFO:tasks.workunit.client.0.smithi088.stdout:0/75: link cd df/c16 0 2023-12-09T02:34:46.571 INFO:tasks.workunit.client.0.smithi088.stdout:7/55: dwrite dc/de/ff [0,4194304] 0 2023-12-09T02:34:46.575 INFO:tasks.workunit.client.0.smithi088.stdout:7/56: rmdir dc/de 39 2023-12-09T02:34:46.579 INFO:tasks.workunit.client.0.smithi088.stdout:7/57: symlink dc/d10/l13 0 2023-12-09T02:34:46.580 INFO:tasks.workunit.client.0.smithi088.stdout:7/58: mknod dc/d10/c14 0 2023-12-09T02:34:46.580 INFO:tasks.workunit.client.0.smithi088.stdout:7/59: dread - fb zero size 2023-12-09T02:34:46.591 INFO:tasks.workunit.client.0.smithi088.stdout:7/60: dread dc/de/ff [0,4194304] 0 2023-12-09T02:34:46.592 INFO:tasks.workunit.client.0.smithi088.stdout:7/61: creat dc/f15 x:0 0 0 2023-12-09T02:34:46.593 INFO:tasks.workunit.client.0.smithi088.stdout:7/62: write dc/de/ff [3625154,60699] 0 2023-12-09T02:34:46.594 INFO:tasks.workunit.client.0.smithi088.stdout:7/63: rename c1 to dc/de/c16 0 2023-12-09T02:34:46.595 INFO:tasks.workunit.client.0.smithi088.stdout:7/64: write dc/de/ff [1519505,92296] 0 2023-12-09T02:34:46.595 INFO:tasks.workunit.client.0.smithi088.stdout:7/65: dread - dc/f15 zero size 2023-12-09T02:34:46.600 INFO:tasks.workunit.client.0.smithi088.stdout:7/66: dread f2 [4194304,4194304] 0 2023-12-09T02:34:46.613 INFO:tasks.workunit.client.0.smithi088.stdout:7/67: dread dc/de/ff [0,4194304] 0 2023-12-09T02:34:46.613 INFO:tasks.workunit.client.0.smithi088.stdout:7/68: stat f5 0 2023-12-09T02:34:46.613 INFO:tasks.workunit.client.0.smithi088.stdout:7/69: write dc/f15 [637212,119059] 0 2023-12-09T02:34:46.767 INFO:tasks.workunit.client.0.smithi088.stdout:2/4: sync 2023-12-09T02:34:46.768 INFO:tasks.workunit.client.0.smithi088.stdout:2/5: link f0 f2 0 2023-12-09T02:34:46.769 INFO:tasks.workunit.client.0.smithi088.stdout:2/6: readlink - no filename 2023-12-09T02:34:46.770 INFO:tasks.workunit.client.0.smithi088.stdout:2/7: link f0 f3 0 2023-12-09T02:34:46.770 INFO:tasks.workunit.client.0.smithi088.stdout:2/8: read - f2 zero size 2023-12-09T02:34:46.770 INFO:tasks.workunit.client.0.smithi088.stdout:2/9: chown f2 5 1 2023-12-09T02:34:46.770 INFO:tasks.workunit.client.0.smithi088.stdout:2/10: dread - f2 zero size 2023-12-09T02:34:46.770 INFO:tasks.workunit.client.0.smithi088.stdout:8/13: sync 2023-12-09T02:34:46.770 INFO:tasks.workunit.client.0.smithi088.stdout:5/24: sync 2023-12-09T02:34:46.770 INFO:tasks.workunit.client.0.smithi088.stdout:3/7: sync 2023-12-09T02:34:46.770 INFO:tasks.workunit.client.0.smithi088.stdout:6/11: sync 2023-12-09T02:34:46.770 INFO:tasks.workunit.client.0.smithi088.stdout:5/25: fdatasync - no filename 2023-12-09T02:34:46.770 INFO:tasks.workunit.client.0.smithi088.stdout:9/10: sync 2023-12-09T02:34:46.771 INFO:tasks.workunit.client.0.smithi088.stdout:1/38: sync 2023-12-09T02:34:46.771 INFO:tasks.workunit.client.0.smithi088.stdout:5/26: fsync - no filename 2023-12-09T02:34:46.771 INFO:tasks.workunit.client.0.smithi088.stdout:6/12: stat c0 0 2023-12-09T02:34:46.771 INFO:tasks.workunit.client.0.smithi088.stdout:3/8: chown d1/d2 16 1 2023-12-09T02:34:46.771 INFO:tasks.workunit.client.0.smithi088.stdout:9/11: chown f0 48852 1 2023-12-09T02:34:46.771 INFO:tasks.workunit.client.0.smithi088.stdout:9/12: rmdir - no directory 2023-12-09T02:34:46.771 INFO:tasks.workunit.client.0.smithi088.stdout:4/2: sync 2023-12-09T02:34:46.771 INFO:tasks.workunit.client.0.smithi088.stdout:4/3: stat f0 0 2023-12-09T02:34:46.771 INFO:tasks.workunit.client.0.smithi088.stdout:2/11: creat f4 x:0 0 0 2023-12-09T02:34:46.772 INFO:tasks.workunit.client.0.smithi088.stdout:1/39: write f3 [1077092,80359] 0 2023-12-09T02:34:46.772 INFO:tasks.workunit.client.0.smithi088.stdout:5/27: mknod d3/c5 0 2023-12-09T02:34:46.772 INFO:tasks.workunit.client.0.smithi088.stdout:5/28: dread - no filename 2023-12-09T02:34:46.772 INFO:tasks.workunit.client.0.smithi088.stdout:5/29: truncate - no filename 2023-12-09T02:34:46.772 INFO:tasks.workunit.client.0.smithi088.stdout:5/30: dread - no filename 2023-12-09T02:34:46.773 INFO:tasks.workunit.client.0.smithi088.stdout:8/14: mknod d2/c5 0 2023-12-09T02:34:46.773 INFO:tasks.workunit.client.0.smithi088.stdout:8/15: fdatasync f0 0 2023-12-09T02:34:46.775 INFO:tasks.workunit.client.0.smithi088.stdout:6/13: rename l1 to l3 0 2023-12-09T02:34:46.775 INFO:tasks.workunit.client.0.smithi088.stdout:6/14: read - no filename 2023-12-09T02:34:46.775 INFO:tasks.workunit.client.0.smithi088.stdout:6/15: read - no filename 2023-12-09T02:34:46.775 INFO:tasks.workunit.client.0.smithi088.stdout:6/16: dwrite - no filename 2023-12-09T02:34:46.776 INFO:tasks.workunit.client.0.smithi088.stdout:1/40: dread f2 [0,4194304] 0 2023-12-09T02:34:46.777 INFO:tasks.workunit.client.0.smithi088.stdout:9/13: write f0 [1673463,70972] 0 2023-12-09T02:34:46.778 INFO:tasks.workunit.client.0.smithi088.stdout:3/9: rename l0 to d1/d2/l3 0 2023-12-09T02:34:46.779 INFO:tasks.workunit.client.0.smithi088.stdout:5/31: rename d3/c4 to d3/c6 0 2023-12-09T02:34:46.780 INFO:tasks.workunit.client.0.smithi088.stdout:8/16: mknod d2/c6 0 2023-12-09T02:34:46.781 INFO:tasks.workunit.client.0.smithi088.stdout:6/17: creat f4 x:0 0 0 2023-12-09T02:34:46.785 INFO:tasks.workunit.client.0.smithi088.stdout:8/17: creat d2/f7 x:0 0 0 2023-12-09T02:34:46.785 INFO:tasks.workunit.client.0.smithi088.stdout:8/18: fsync f1 0 2023-12-09T02:34:46.785 INFO:tasks.workunit.client.0.smithi088.stdout:8/19: fdatasync f1 0 2023-12-09T02:34:46.785 INFO:tasks.workunit.client.0.smithi088.stdout:6/18: mknod c5 0 2023-12-09T02:34:46.786 INFO:tasks.workunit.client.0.smithi088.stdout:8/20: creat d2/f8 x:0 0 0 2023-12-09T02:34:46.787 INFO:tasks.workunit.client.0.smithi088.stdout:8/21: mkdir d2/d9 0 2023-12-09T02:34:46.788 INFO:tasks.workunit.client.0.smithi088.stdout:8/22: rename d2/f7 to d2/fa 0 2023-12-09T02:34:46.788 INFO:tasks.workunit.client.0.smithi088.stdout:8/23: chown d2/f8 1 1 2023-12-09T02:34:46.788 INFO:tasks.workunit.client.0.smithi088.stdout:8/24: chown f0 644743 1 2023-12-09T02:34:46.788 INFO:tasks.workunit.client.0.smithi088.stdout:8/25: chown d2 45812826 1 2023-12-09T02:34:46.791 INFO:tasks.workunit.client.0.smithi088.stdout:8/26: write f1 [4455019,64587] 0 2023-12-09T02:34:46.797 INFO:tasks.workunit.client.0.smithi088.stdout:4/4: dwrite f0 [0,4194304] 0 2023-12-09T02:34:46.797 INFO:tasks.workunit.client.0.smithi088.stdout:9/14: fdatasync f0 0 2023-12-09T02:34:46.798 INFO:tasks.workunit.client.0.smithi088.stdout:2/12: dwrite f3 [0,4194304] 0 2023-12-09T02:34:46.800 INFO:tasks.workunit.client.0.smithi088.stdout:4/5: creat f1 x:0 0 0 2023-12-09T02:34:46.805 INFO:tasks.workunit.client.0.smithi088.stdout:2/13: symlink l5 0 2023-12-09T02:34:46.805 INFO:tasks.workunit.client.0.smithi088.stdout:2/14: rmdir - no directory 2023-12-09T02:34:46.806 INFO:tasks.workunit.client.0.smithi088.stdout:3/10: rename d1/d2/l3 to d1/l4 0 2023-12-09T02:34:46.806 INFO:tasks.workunit.client.0.smithi088.stdout:1/41: rename d8 to d8/dc 22 2023-12-09T02:34:46.809 INFO:tasks.workunit.client.0.smithi088.stdout:5/32: rename d3/c6 to d3/c7 0 2023-12-09T02:34:46.809 INFO:tasks.workunit.client.0.smithi088.stdout:5/33: truncate - no filename 2023-12-09T02:34:46.809 INFO:tasks.workunit.client.0.smithi088.stdout:5/34: dread - no filename 2023-12-09T02:34:46.809 INFO:tasks.workunit.client.0.smithi088.stdout:5/35: write - no filename 2023-12-09T02:34:46.810 INFO:tasks.workunit.client.0.smithi088.stdout:2/15: mkdir d6 0 2023-12-09T02:34:46.810 INFO:tasks.workunit.client.0.smithi088.stdout:1/42: mknod d8/cd 0 2023-12-09T02:34:46.812 INFO:tasks.workunit.client.0.smithi088.stdout:1/43: write d8/fb [3957254,97054] 0 2023-12-09T02:34:46.812 INFO:tasks.workunit.client.0.smithi088.stdout:3/11: creat d1/f5 x:0 0 0 2023-12-09T02:34:46.812 INFO:tasks.workunit.client.0.smithi088.stdout:9/15: truncate f0 11595 0 2023-12-09T02:34:46.814 INFO:tasks.workunit.client.0.smithi088.stdout:5/36: mkdir d3/d8 0 2023-12-09T02:34:46.815 INFO:tasks.workunit.client.0.smithi088.stdout:2/16: symlink d6/l7 0 2023-12-09T02:34:46.815 INFO:tasks.workunit.client.0.smithi088.stdout:2/17: chown f4 1671 1 2023-12-09T02:34:46.815 INFO:tasks.workunit.client.0.smithi088.stdout:2/18: chown d6 63461 1 2023-12-09T02:34:46.815 INFO:tasks.workunit.client.0.smithi088.stdout:6/19: getdents . 0 2023-12-09T02:34:46.816 INFO:tasks.workunit.client.0.smithi088.stdout:1/44: symlink d8/le 0 2023-12-09T02:34:46.816 INFO:tasks.workunit.client.0.smithi088.stdout:1/45: write f6 [911757,102723] 0 2023-12-09T02:34:46.816 INFO:tasks.workunit.client.0.smithi088.stdout:1/46: readlink d8/le 0 2023-12-09T02:34:46.816 INFO:tasks.workunit.client.0.smithi088.stdout:5/37: rmdir d3 39 2023-12-09T02:34:46.817 INFO:tasks.workunit.client.0.smithi088.stdout:4/6: dwrite f1 [0,4194304] 0 2023-12-09T02:34:46.818 INFO:tasks.workunit.client.0.smithi088.stdout:8/27: rmdir d2 39 2023-12-09T02:34:46.818 INFO:tasks.workunit.client.0.smithi088.stdout:8/28: write d2/f8 [529975,25070] 0 2023-12-09T02:34:46.819 INFO:tasks.workunit.client.0.smithi088.stdout:2/19: mkdir d6/d8 0 2023-12-09T02:34:46.821 INFO:tasks.workunit.client.0.smithi088.stdout:6/20: creat f6 x:0 0 0 2023-12-09T02:34:46.821 INFO:tasks.workunit.client.0.smithi088.stdout:6/21: chown f6 480871405 1 2023-12-09T02:34:46.823 INFO:tasks.workunit.client.0.smithi088.stdout:1/47: creat d8/ff x:0 0 0 2023-12-09T02:34:46.824 INFO:tasks.workunit.client.0.smithi088.stdout:5/38: creat d3/d8/f9 x:0 0 0 2023-12-09T02:34:46.825 INFO:tasks.workunit.client.0.smithi088.stdout:5/39: readlink l1 0 2023-12-09T02:34:46.825 INFO:tasks.workunit.client.0.smithi088.stdout:5/40: write d3/d8/f9 [636156,107807] 0 2023-12-09T02:34:46.827 INFO:tasks.workunit.client.0.smithi088.stdout:4/7: creat f2 x:0 0 0 2023-12-09T02:34:46.828 INFO:tasks.workunit.client.0.smithi088.stdout:8/29: creat d2/d9/fb x:0 0 0 2023-12-09T02:34:46.828 INFO:tasks.workunit.client.0.smithi088.stdout:8/30: truncate d2/fa 254852 0 2023-12-09T02:34:46.831 INFO:tasks.workunit.client.0.smithi088.stdout:6/22: stat c2 0 2023-12-09T02:34:46.831 INFO:tasks.workunit.client.0.smithi088.stdout:6/23: truncate f6 254919 0 2023-12-09T02:34:46.832 INFO:tasks.workunit.client.0.smithi088.stdout:3/12: dwrite d1/f5 [0,4194304] 0 2023-12-09T02:34:46.833 INFO:tasks.workunit.client.0.smithi088.stdout:1/48: rename d8/cd to d8/c10 0 2023-12-09T02:34:46.833 INFO:tasks.workunit.client.0.smithi088.stdout:1/49: read - d8/ff zero size 2023-12-09T02:34:46.833 INFO:tasks.workunit.client.0.smithi088.stdout:9/16: write f0 [1028972,43614] 0 2023-12-09T02:34:46.835 INFO:tasks.workunit.client.0.smithi088.stdout:4/8: mkdir d3 0 2023-12-09T02:34:46.837 INFO:tasks.workunit.client.0.smithi088.stdout:2/20: truncate f0 2526337 0 2023-12-09T02:34:46.841 INFO:tasks.workunit.client.0.smithi088.stdout:5/41: rmdir d3/d8 39 2023-12-09T02:34:46.848 INFO:tasks.workunit.client.0.smithi088.stdout:1/50: mknod d8/c11 0 2023-12-09T02:34:46.849 INFO:tasks.workunit.client.0.smithi088.stdout:4/9: creat d3/f4 x:0 0 0 2023-12-09T02:34:46.851 INFO:tasks.workunit.client.0.smithi088.stdout:1/51: write d8/fb [140807,24227] 0 2023-12-09T02:34:46.851 INFO:tasks.workunit.client.0.smithi088.stdout:1/52: chown d8/ff 138655 1 2023-12-09T02:34:46.855 INFO:tasks.workunit.client.0.smithi088.stdout:4/10: symlink d3/l5 0 2023-12-09T02:34:46.855 INFO:tasks.workunit.client.0.smithi088.stdout:4/11: fdatasync d3/f4 0 2023-12-09T02:34:46.855 INFO:tasks.workunit.client.0.smithi088.stdout:4/12: chown d3/l5 1592025 1 2023-12-09T02:34:46.855 INFO:tasks.workunit.client.0.smithi088.stdout:4/13: fdatasync f2 0 2023-12-09T02:34:46.859 INFO:tasks.workunit.client.0.smithi088.stdout:6/24: dwrite f4 [0,4194304] 0 2023-12-09T02:34:46.859 INFO:tasks.workunit.client.0.smithi088.stdout:1/53: dread f6 [0,4194304] 0 2023-12-09T02:34:46.859 INFO:tasks.workunit.client.0.smithi088.stdout:3/13: truncate d1/f5 3480284 0 2023-12-09T02:34:46.865 INFO:tasks.workunit.client.0.smithi088.stdout:5/42: truncate d3/d8/f9 569133 0 2023-12-09T02:34:46.865 INFO:tasks.workunit.client.0.smithi088.stdout:5/43: rename d3 to d3/d8/da 22 2023-12-09T02:34:46.866 INFO:tasks.workunit.client.0.smithi088.stdout:5/44: chown d3/c5 7 1 2023-12-09T02:34:46.868 INFO:tasks.workunit.client.0.smithi088.stdout:3/14: mkdir d1/d2/d6 0 2023-12-09T02:34:46.869 INFO:tasks.workunit.client.0.smithi088.stdout:9/17: dwrite f0 [0,4194304] 0 2023-12-09T02:34:46.869 INFO:tasks.workunit.client.0.smithi088.stdout:2/21: dread f0 [0,4194304] 0 2023-12-09T02:34:46.869 INFO:tasks.workunit.client.0.smithi088.stdout:2/22: write f2 [2735032,8466] 0 2023-12-09T02:34:46.869 INFO:tasks.workunit.client.0.smithi088.stdout:9/18: write f0 [4348474,72347] 0 2023-12-09T02:34:46.869 INFO:tasks.workunit.client.0.smithi088.stdout:5/45: mkdir d3/d8/db 0 2023-12-09T02:34:46.870 INFO:tasks.workunit.client.0.smithi088.stdout:2/23: write f3 [1231900,54773] 0 2023-12-09T02:34:46.871 INFO:tasks.workunit.client.0.smithi088.stdout:6/25: mknod c7 0 2023-12-09T02:34:46.873 INFO:tasks.workunit.client.0.smithi088.stdout:9/19: rename c2 to c4 0 2023-12-09T02:34:46.874 INFO:tasks.workunit.client.0.smithi088.stdout:4/14: dwrite d3/f4 [0,4194304] 0 2023-12-09T02:34:46.874 INFO:tasks.workunit.client.0.smithi088.stdout:4/15: chown f2 36714334 1 2023-12-09T02:34:46.875 INFO:tasks.workunit.client.0.smithi088.stdout:2/24: symlink d6/d8/l9 0 2023-12-09T02:34:46.887 INFO:tasks.workunit.client.0.smithi088.stdout:4/16: dread d3/f4 [0,4194304] 0 2023-12-09T02:34:46.887 INFO:tasks.workunit.client.0.smithi088.stdout:2/25: truncate f0 134857 0 2023-12-09T02:34:46.887 INFO:tasks.workunit.client.0.smithi088.stdout:2/26: write f4 [834036,101175] 0 2023-12-09T02:34:46.889 INFO:tasks.workunit.client.0.smithi088.stdout:1/54: dwrite d8/fb [0,4194304] 0 2023-12-09T02:34:46.889 INFO:tasks.workunit.client.0.smithi088.stdout:6/26: dwrite f4 [0,4194304] 0 2023-12-09T02:34:46.889 INFO:tasks.workunit.client.0.smithi088.stdout:6/27: rmdir - no directory 2023-12-09T02:34:46.889 INFO:tasks.workunit.client.0.smithi088.stdout:7/70: sync 2023-12-09T02:34:46.889 INFO:tasks.workunit.client.0.smithi088.stdout:0/76: sync 2023-12-09T02:34:46.890 INFO:tasks.workunit.client.0.smithi088.stdout:7/71: readlink l4 0 2023-12-09T02:34:46.890 INFO:tasks.workunit.client.0.smithi088.stdout:3/15: read d1/f5 [3351401,26861] 0 2023-12-09T02:34:46.891 INFO:tasks.workunit.client.0.smithi088.stdout:3/16: stat d1/f5 0 2023-12-09T02:34:46.891 INFO:tasks.workunit.client.0.smithi088.stdout:0/77: write f6 [337078,60785] 0 2023-12-09T02:34:46.893 INFO:tasks.workunit.client.0.smithi088.stdout:7/72: rename f5 to dc/de/f17 0 2023-12-09T02:34:46.893 INFO:tasks.workunit.client.0.smithi088.stdout:3/17: rename d1/d2 to d1/d2/d7 22 2023-12-09T02:34:46.893 INFO:tasks.workunit.client.0.smithi088.stdout:3/18: fsync d1/f5 0 2023-12-09T02:34:46.896 INFO:tasks.workunit.client.0.smithi088.stdout:0/78: mknod df/d10/c17 0 2023-12-09T02:34:46.900 INFO:tasks.workunit.client.0.smithi088.stdout:8/31: sync 2023-12-09T02:34:46.900 INFO:tasks.workunit.client.0.smithi088.stdout:6/28: dread f4 [0,4194304] 0 2023-12-09T02:34:46.900 INFO:tasks.workunit.client.0.smithi088.stdout:6/29: write f4 [4162111,46790] 0 2023-12-09T02:34:46.900 INFO:tasks.workunit.client.0.smithi088.stdout:6/30: rmdir - no directory 2023-12-09T02:34:46.902 INFO:tasks.workunit.client.0.smithi088.stdout:8/32: creat d2/d9/fc x:0 0 0 2023-12-09T02:34:46.902 INFO:tasks.workunit.client.0.smithi088.stdout:8/33: readlink d2/l4 0 2023-12-09T02:34:46.902 INFO:tasks.workunit.client.0.smithi088.stdout:8/34: truncate d2/f3 486678 0 2023-12-09T02:34:46.903 INFO:tasks.workunit.client.0.smithi088.stdout:4/17: dread d3/f4 [0,4194304] 0 2023-12-09T02:34:46.906 INFO:tasks.workunit.client.0.smithi088.stdout:8/35: symlink d2/d9/ld 0 2023-12-09T02:34:46.909 INFO:tasks.workunit.client.0.smithi088.stdout:8/36: link d2/d9/fb d2/fe 0 2023-12-09T02:34:46.911 INFO:tasks.workunit.client.0.smithi088.stdout:8/37: mknod d2/cf 0 2023-12-09T02:34:46.911 INFO:tasks.workunit.client.0.smithi088.stdout:8/38: write d2/d9/fb [76883,21711] 0 2023-12-09T02:34:46.912 INFO:tasks.workunit.client.0.smithi088.stdout:8/39: unlink d2/d9/fb 0 2023-12-09T02:34:46.913 INFO:tasks.workunit.client.0.smithi088.stdout:1/55: dwrite f3 [0,4194304] 0 2023-12-09T02:34:46.915 INFO:tasks.workunit.client.0.smithi088.stdout:8/40: rename d2/fe to d2/d9/f10 0 2023-12-09T02:34:46.915 INFO:tasks.workunit.client.0.smithi088.stdout:8/41: dread - d2/d9/fc zero size 2023-12-09T02:34:46.916 INFO:tasks.workunit.client.0.smithi088.stdout:8/42: dread d2/fa [0,4194304] 0 2023-12-09T02:34:46.917 INFO:tasks.workunit.client.0.smithi088.stdout:1/56: mknod d8/c12 0 2023-12-09T02:34:46.919 INFO:tasks.workunit.client.0.smithi088.stdout:2/27: dread f2 [0,4194304] 0 2023-12-09T02:34:46.919 INFO:tasks.workunit.client.0.smithi088.stdout:2/28: fsync f0 0 2023-12-09T02:34:46.919 INFO:tasks.workunit.client.0.smithi088.stdout:2/29: stat f2 0 2023-12-09T02:34:46.919 INFO:tasks.workunit.client.0.smithi088.stdout:2/30: readlink d6/d8/l9 0 2023-12-09T02:34:46.919 INFO:tasks.workunit.client.0.smithi088.stdout:8/43: creat d2/f11 x:0 0 0 2023-12-09T02:34:46.919 INFO:tasks.workunit.client.0.smithi088.stdout:8/44: truncate d2/d9/f10 158539 0 2023-12-09T02:34:46.919 INFO:tasks.workunit.client.0.smithi088.stdout:8/45: chown d2/d9/ld 117 1 2023-12-09T02:34:46.919 INFO:tasks.workunit.client.0.smithi088.stdout:7/73: dwrite dc/f15 [0,4194304] 0 2023-12-09T02:34:46.920 INFO:tasks.workunit.client.0.smithi088.stdout:3/19: dread d1/f5 [0,4194304] 0 2023-12-09T02:34:46.921 INFO:tasks.workunit.client.0.smithi088.stdout:0/79: dread fc [0,4194304] 0 2023-12-09T02:34:46.921 INFO:tasks.workunit.client.0.smithi088.stdout:1/57: creat d8/f13 x:0 0 0 2023-12-09T02:34:46.921 INFO:tasks.workunit.client.0.smithi088.stdout:2/31: dread f2 [0,4194304] 0 2023-12-09T02:34:46.922 INFO:tasks.workunit.client.0.smithi088.stdout:2/32: rename d6 to d6/d8/da 22 2023-12-09T02:34:46.922 INFO:tasks.workunit.client.0.smithi088.stdout:8/46: mknod d2/c12 0 2023-12-09T02:34:46.922 INFO:tasks.workunit.client.0.smithi088.stdout:5/46: dwrite d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:46.923 INFO:tasks.workunit.client.0.smithi088.stdout:7/74: creat dc/f18 x:0 0 0 2023-12-09T02:34:46.923 INFO:tasks.workunit.client.0.smithi088.stdout:7/75: dread - dc/f18 zero size 2023-12-09T02:34:46.923 INFO:tasks.workunit.client.0.smithi088.stdout:7/76: stat dc/f15 0 2023-12-09T02:34:46.923 INFO:tasks.workunit.client.0.smithi088.stdout:7/77: write dc/f18 [58505,8281] 0 2023-12-09T02:34:46.924 INFO:tasks.workunit.client.0.smithi088.stdout:4/18: dread d3/f4 [0,4194304] 0 2023-12-09T02:34:46.924 INFO:tasks.workunit.client.0.smithi088.stdout:3/20: symlink d1/l8 0 2023-12-09T02:34:46.924 INFO:tasks.workunit.client.0.smithi088.stdout:7/78: write dc/de/ff [4032407,38645] 0 2023-12-09T02:34:46.925 INFO:tasks.workunit.client.0.smithi088.stdout:0/80: getdents df 0 2023-12-09T02:34:46.926 INFO:tasks.workunit.client.0.smithi088.stdout:1/58: symlink d8/l14 0 2023-12-09T02:34:46.928 INFO:tasks.workunit.client.0.smithi088.stdout:2/33: creat d6/fb x:0 0 0 2023-12-09T02:34:46.928 INFO:tasks.workunit.client.0.smithi088.stdout:2/34: chown d6 0 1 2023-12-09T02:34:46.928 INFO:tasks.workunit.client.0.smithi088.stdout:2/35: read f3 [121017,46097] 0 2023-12-09T02:34:46.930 INFO:tasks.workunit.client.0.smithi088.stdout:8/47: mkdir d2/d9/d13 0 2023-12-09T02:34:46.933 INFO:tasks.workunit.client.0.smithi088.stdout:9/20: dwrite f0 [0,4194304] 0 2023-12-09T02:34:46.934 INFO:tasks.workunit.client.0.smithi088.stdout:5/47: mkdir d3/d8/db/dc 0 2023-12-09T02:34:46.942 INFO:tasks.workunit.client.0.smithi088.stdout:3/21: truncate d1/f5 741021 0 2023-12-09T02:34:46.942 INFO:tasks.workunit.client.0.smithi088.stdout:4/19: dwrite f2 [0,4194304] 0 2023-12-09T02:34:46.943 INFO:tasks.workunit.client.0.smithi088.stdout:7/79: truncate dc/de/f17 2571585 0 2023-12-09T02:34:46.943 INFO:tasks.workunit.client.0.smithi088.stdout:0/81: truncate df/d10/f13 810049 0 2023-12-09T02:34:46.943 INFO:tasks.workunit.client.0.smithi088.stdout:0/82: truncate f6 977340 0 2023-12-09T02:34:46.944 INFO:tasks.workunit.client.0.smithi088.stdout:9/21: write f0 [3867291,78193] 0 2023-12-09T02:34:46.947 INFO:tasks.workunit.client.0.smithi088.stdout:2/36: creat d6/fc x:0 0 0 2023-12-09T02:34:46.955 INFO:tasks.workunit.client.0.smithi088.stdout:9/22: fdatasync f0 0 2023-12-09T02:34:46.955 INFO:tasks.workunit.client.0.smithi088.stdout:8/48: dwrite f1 [0,4194304] 0 2023-12-09T02:34:46.955 INFO:tasks.workunit.client.0.smithi088.stdout:7/80: symlink dc/d10/l19 0 2023-12-09T02:34:46.955 INFO:tasks.workunit.client.0.smithi088.stdout:7/81: fsync fb 0 2023-12-09T02:34:46.957 INFO:tasks.workunit.client.0.smithi088.stdout:0/83: symlink df/d10/l18 0 2023-12-09T02:34:46.959 INFO:tasks.workunit.client.0.smithi088.stdout:1/59: rename d8/f13 to d8/f15 0 2023-12-09T02:34:46.961 INFO:tasks.workunit.client.0.smithi088.stdout:4/20: dwrite d3/f4 [4194304,4194304] 0 2023-12-09T02:34:46.961 INFO:tasks.workunit.client.0.smithi088.stdout:2/37: creat d6/fd x:0 0 0 2023-12-09T02:34:46.961 INFO:tasks.workunit.client.0.smithi088.stdout:2/38: chown f2 837 1 2023-12-09T02:34:46.962 INFO:tasks.workunit.client.0.smithi088.stdout:5/48: truncate d3/d8/f9 3467303 0 2023-12-09T02:34:46.968 INFO:tasks.workunit.client.0.smithi088.stdout:8/49: link d2/c5 d2/c14 0 2023-12-09T02:34:46.970 INFO:tasks.workunit.client.0.smithi088.stdout:7/82: creat dc/d10/f1a x:0 0 0 2023-12-09T02:34:46.972 INFO:tasks.workunit.client.0.smithi088.stdout:1/60: mknod d8/c16 0 2023-12-09T02:34:46.974 INFO:tasks.workunit.client.0.smithi088.stdout:4/21: creat d3/f6 x:0 0 0 2023-12-09T02:34:46.974 INFO:tasks.workunit.client.0.smithi088.stdout:4/22: read f2 [1853292,74163] 0 2023-12-09T02:34:46.975 INFO:tasks.workunit.client.0.smithi088.stdout:2/39: unlink d6/fb 0 2023-12-09T02:34:46.982 INFO:tasks.workunit.client.0.smithi088.stdout:1/61: dread f3 [0,4194304] 0 2023-12-09T02:34:46.985 INFO:tasks.workunit.client.0.smithi088.stdout:7/83: mkdir dc/d1b 0 2023-12-09T02:34:46.987 INFO:tasks.workunit.client.0.smithi088.stdout:0/84: truncate df/d10/f13 182599 0 2023-12-09T02:34:46.989 INFO:tasks.workunit.client.0.smithi088.stdout:0/85: write fc [637302,79406] 0 2023-12-09T02:34:46.991 INFO:tasks.workunit.client.0.smithi088.stdout:1/62: symlink d8/l17 0 2023-12-09T02:34:46.994 INFO:tasks.workunit.client.0.smithi088.stdout:7/84: link dc/d10/l13 dc/d10/l1c 0 2023-12-09T02:34:46.994 INFO:tasks.workunit.client.0.smithi088.stdout:9/23: dwrite f0 [0,4194304] 0 2023-12-09T02:34:46.994 INFO:tasks.workunit.client.0.smithi088.stdout:4/23: dread f1 [0,4194304] 0 2023-12-09T02:34:46.995 INFO:tasks.workunit.client.0.smithi088.stdout:8/50: unlink d2/d9/fc 0 2023-12-09T02:34:46.996 INFO:tasks.workunit.client.0.smithi088.stdout:1/63: rename d8/le to d8/l18 0 2023-12-09T02:34:46.996 INFO:tasks.workunit.client.0.smithi088.stdout:1/64: read - d8/ff zero size 2023-12-09T02:34:46.997 INFO:tasks.workunit.client.0.smithi088.stdout:2/40: dwrite f0 [0,4194304] 0 2023-12-09T02:34:47.001 INFO:tasks.workunit.client.0.smithi088.stdout:9/24: unlink c3 0 2023-12-09T02:34:47.001 INFO:tasks.workunit.client.0.smithi088.stdout:4/24: creat d3/f7 x:0 0 0 2023-12-09T02:34:47.002 INFO:tasks.workunit.client.0.smithi088.stdout:2/41: link d6/fc d6/d8/fe 0 2023-12-09T02:34:47.003 INFO:tasks.workunit.client.0.smithi088.stdout:4/25: truncate f0 618302 0 2023-12-09T02:34:47.005 INFO:tasks.workunit.client.0.smithi088.stdout:8/51: mkdir d2/d9/d13/d15 0 2023-12-09T02:34:47.005 INFO:tasks.workunit.client.0.smithi088.stdout:8/52: truncate d2/f8 1028301 0 2023-12-09T02:34:47.006 INFO:tasks.workunit.client.0.smithi088.stdout:9/25: write f0 [1449364,11917] 0 2023-12-09T02:34:47.006 INFO:tasks.workunit.client.0.smithi088.stdout:4/26: creat d3/f8 x:0 0 0 2023-12-09T02:34:47.007 INFO:tasks.workunit.client.0.smithi088.stdout:8/53: dread d2/f8 [0,4194304] 0 2023-12-09T02:34:47.007 INFO:tasks.workunit.client.0.smithi088.stdout:8/54: write d2/f11 [867014,102117] 0 2023-12-09T02:34:47.008 INFO:tasks.workunit.client.0.smithi088.stdout:9/26: creat f5 x:0 0 0 2023-12-09T02:34:47.013 INFO:tasks.workunit.client.0.smithi088.stdout:9/27: rename f5 to f6 0 2023-12-09T02:34:47.013 INFO:tasks.workunit.client.0.smithi088.stdout:8/55: symlink d2/d9/l16 0 2023-12-09T02:34:47.014 INFO:tasks.workunit.client.0.smithi088.stdout:9/28: creat f7 x:0 0 0 2023-12-09T02:34:47.015 INFO:tasks.workunit.client.0.smithi088.stdout:9/29: write f6 [71023,55188] 0 2023-12-09T02:34:47.015 INFO:tasks.workunit.client.0.smithi088.stdout:9/30: symlink l8 0 2023-12-09T02:34:47.024 INFO:tasks.workunit.client.0.smithi088.stdout:2/42: dread f0 [0,4194304] 0 2023-12-09T02:34:47.024 INFO:tasks.workunit.client.0.smithi088.stdout:2/43: write f1 [120249,16941] 0 2023-12-09T02:34:47.024 INFO:tasks.workunit.client.0.smithi088.stdout:9/31: read f0 [56220,107825] 0 2023-12-09T02:34:47.024 INFO:tasks.workunit.client.0.smithi088.stdout:9/32: dread - f7 zero size 2023-12-09T02:34:47.024 INFO:tasks.workunit.client.0.smithi088.stdout:5/49: dwrite d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:47.024 INFO:tasks.workunit.client.0.smithi088.stdout:9/33: chown l8 5 1 2023-12-09T02:34:47.031 INFO:tasks.workunit.client.0.smithi088.stdout:7/85: dwrite dc/de/f17 [0,4194304] 0 2023-12-09T02:34:47.041 INFO:tasks.workunit.client.0.smithi088.stdout:9/34: write f0 [2089445,62430] 0 2023-12-09T02:34:47.041 INFO:tasks.workunit.client.0.smithi088.stdout:5/50: dread d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:47.042 INFO:tasks.workunit.client.0.smithi088.stdout:1/65: dwrite f3 [0,4194304] 0 2023-12-09T02:34:47.042 INFO:tasks.workunit.client.0.smithi088.stdout:2/44: fsync f1 0 2023-12-09T02:34:47.043 INFO:tasks.workunit.client.0.smithi088.stdout:0/86: dwrite fc [0,4194304] 0 2023-12-09T02:34:47.043 INFO:tasks.workunit.client.0.smithi088.stdout:9/35: symlink l9 0 2023-12-09T02:34:47.044 INFO:tasks.workunit.client.0.smithi088.stdout:5/51: mknod d3/d8/db/cd 0 2023-12-09T02:34:47.045 INFO:tasks.workunit.client.0.smithi088.stdout:5/52: write d3/d8/f9 [1920509,112274] 0 2023-12-09T02:34:47.046 INFO:tasks.workunit.client.0.smithi088.stdout:1/66: creat d8/f19 x:0 0 0 2023-12-09T02:34:47.046 INFO:tasks.workunit.client.0.smithi088.stdout:1/67: chown d8/c16 7811028 1 2023-12-09T02:34:47.047 INFO:tasks.workunit.client.0.smithi088.stdout:2/45: creat d6/d8/ff x:0 0 0 2023-12-09T02:34:47.049 INFO:tasks.workunit.client.0.smithi088.stdout:8/56: dwrite f1 [4194304,4194304] 0 2023-12-09T02:34:47.049 INFO:tasks.workunit.client.0.smithi088.stdout:8/57: write d2/f11 [1056596,8556] 0 2023-12-09T02:34:47.051 INFO:tasks.workunit.client.0.smithi088.stdout:4/27: dwrite f0 [0,4194304] 0 2023-12-09T02:34:47.051 INFO:tasks.workunit.client.0.smithi088.stdout:7/86: dwrite dc/d10/f1a [0,4194304] 0 2023-12-09T02:34:47.054 INFO:tasks.workunit.client.0.smithi088.stdout:0/87: symlink df/l19 0 2023-12-09T02:34:47.054 INFO:tasks.workunit.client.0.smithi088.stdout:0/88: truncate df/d10/f13 1071745 0 2023-12-09T02:34:47.057 INFO:tasks.workunit.client.0.smithi088.stdout:5/53: mkdir d3/d8/db/de 0 2023-12-09T02:34:47.057 INFO:tasks.workunit.client.0.smithi088.stdout:1/68: link d8/fa d8/f1a 0 2023-12-09T02:34:47.058 INFO:tasks.workunit.client.0.smithi088.stdout:1/69: chown d8/c9 5 1 2023-12-09T02:34:47.060 INFO:tasks.workunit.client.0.smithi088.stdout:2/46: rename d6/fc to d6/d8/f10 0 2023-12-09T02:34:47.063 INFO:tasks.workunit.client.0.smithi088.stdout:8/58: rmdir d2 39 2023-12-09T02:34:47.064 INFO:tasks.workunit.client.0.smithi088.stdout:4/28: creat d3/f9 x:0 0 0 2023-12-09T02:34:47.067 INFO:tasks.workunit.client.0.smithi088.stdout:7/87: creat dc/de/f1d x:0 0 0 2023-12-09T02:34:47.069 INFO:tasks.workunit.client.0.smithi088.stdout:0/89: rename df/d10/l11 to df/d10/l1a 0 2023-12-09T02:34:47.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/54: creat d3/d8/ff x:0 0 0 2023-12-09T02:34:47.069 INFO:tasks.workunit.client.0.smithi088.stdout:1/70: mkdir d8/d1b 0 2023-12-09T02:34:47.070 INFO:tasks.workunit.client.0.smithi088.stdout:1/71: write f2 [3412372,69988] 0 2023-12-09T02:34:47.073 INFO:tasks.workunit.client.0.smithi088.stdout:0/90: dread f2 [0,4194304] 0 2023-12-09T02:34:47.073 INFO:tasks.workunit.client.0.smithi088.stdout:5/55: mkdir d3/d8/db/de/d10 0 2023-12-09T02:34:47.075 INFO:tasks.workunit.client.0.smithi088.stdout:1/72: unlink f6 0 2023-12-09T02:34:47.076 INFO:tasks.workunit.client.0.smithi088.stdout:2/47: rename d6/d8/ff to d6/d8/f11 0 2023-12-09T02:34:47.076 INFO:tasks.workunit.client.0.smithi088.stdout:2/48: chown f3 46 1 2023-12-09T02:34:47.078 INFO:tasks.workunit.client.0.smithi088.stdout:0/91: mkdir df/d1b 0 2023-12-09T02:34:47.079 INFO:tasks.workunit.client.0.smithi088.stdout:2/49: dread f4 [0,4194304] 0 2023-12-09T02:34:47.080 INFO:tasks.workunit.client.0.smithi088.stdout:0/92: dread f2 [0,4194304] 0 2023-12-09T02:34:47.080 INFO:tasks.workunit.client.0.smithi088.stdout:5/56: mkdir d3/d8/db/dc/d11 0 2023-12-09T02:34:47.081 INFO:tasks.workunit.client.0.smithi088.stdout:6/31: sync 2023-12-09T02:34:47.085 INFO:tasks.workunit.client.0.smithi088.stdout:8/59: dwrite d2/f3 [0,4194304] 0 2023-12-09T02:34:47.085 INFO:tasks.workunit.client.0.smithi088.stdout:5/57: unlink d3/c7 0 2023-12-09T02:34:47.087 INFO:tasks.workunit.client.0.smithi088.stdout:4/29: getdents d3 0 2023-12-09T02:34:47.088 INFO:tasks.workunit.client.0.smithi088.stdout:9/36: dwrite f6 [0,4194304] 0 2023-12-09T02:34:47.088 INFO:tasks.workunit.client.0.smithi088.stdout:3/22: sync 2023-12-09T02:34:47.089 INFO:tasks.workunit.client.0.smithi088.stdout:3/23: dread d1/f5 [0,4194304] 0 2023-12-09T02:34:47.090 INFO:tasks.workunit.client.0.smithi088.stdout:5/58: symlink d3/d8/l12 0 2023-12-09T02:34:47.091 INFO:tasks.workunit.client.0.smithi088.stdout:1/73: dwrite d8/fa [0,4194304] 0 2023-12-09T02:34:47.091 INFO:tasks.workunit.client.0.smithi088.stdout:7/88: dwrite dc/de/f1d [0,4194304] 0 2023-12-09T02:34:47.092 INFO:tasks.workunit.client.0.smithi088.stdout:7/89: fsync dc/d10/f1a 0 2023-12-09T02:34:47.092 INFO:tasks.workunit.client.0.smithi088.stdout:6/32: symlink l8 0 2023-12-09T02:34:47.093 INFO:tasks.workunit.client.0.smithi088.stdout:3/24: dread d1/f5 [0,4194304] 0 2023-12-09T02:34:47.099 INFO:tasks.workunit.client.0.smithi088.stdout:0/93: getdents df/d10 0 2023-12-09T02:34:47.099 INFO:tasks.workunit.client.0.smithi088.stdout:9/37: mknod ca 0 2023-12-09T02:34:47.099 INFO:tasks.workunit.client.0.smithi088.stdout:9/38: chown ca 292582 1 2023-12-09T02:34:47.099 INFO:tasks.workunit.client.0.smithi088.stdout:8/60: symlink d2/d9/l17 0 2023-12-09T02:34:47.100 INFO:tasks.workunit.client.0.smithi088.stdout:8/61: dread d2/fa [0,4194304] 0 2023-12-09T02:34:47.102 INFO:tasks.workunit.client.0.smithi088.stdout:4/30: dwrite d3/f6 [0,4194304] 0 2023-12-09T02:34:47.102 INFO:tasks.workunit.client.0.smithi088.stdout:4/31: dread - d3/f9 zero size 2023-12-09T02:34:47.102 INFO:tasks.workunit.client.0.smithi088.stdout:4/32: stat d3/l5 0 2023-12-09T02:34:47.102 INFO:tasks.workunit.client.0.smithi088.stdout:4/33: read - d3/f9 zero size 2023-12-09T02:34:47.102 INFO:tasks.workunit.client.0.smithi088.stdout:4/34: getdents d3 0 2023-12-09T02:34:47.102 INFO:tasks.workunit.client.0.smithi088.stdout:2/50: rmdir d6 39 2023-12-09T02:34:47.102 INFO:tasks.workunit.client.0.smithi088.stdout:2/51: stat d6/d8/l9 0 2023-12-09T02:34:47.103 INFO:tasks.workunit.client.0.smithi088.stdout:2/52: stat d6/d8 0 2023-12-09T02:34:47.104 INFO:tasks.workunit.client.0.smithi088.stdout:7/90: mkdir dc/de/d1e 0 2023-12-09T02:34:47.105 INFO:tasks.workunit.client.0.smithi088.stdout:6/33: creat f9 x:0 0 0 2023-12-09T02:34:47.107 INFO:tasks.workunit.client.0.smithi088.stdout:3/25: unlink d1/l4 0 2023-12-09T02:34:47.109 INFO:tasks.workunit.client.0.smithi088.stdout:0/94: rmdir df/d1b 0 2023-12-09T02:34:47.109 INFO:tasks.workunit.client.0.smithi088.stdout:0/95: chown df 16212 1 2023-12-09T02:34:47.113 INFO:tasks.workunit.client.0.smithi088.stdout:1/74: dwrite d8/fb [0,4194304] 0 2023-12-09T02:34:47.117 INFO:tasks.workunit.client.0.smithi088.stdout:4/35: mknod d3/ca 0 2023-12-09T02:34:47.121 INFO:tasks.workunit.client.0.smithi088.stdout:2/53: creat d6/f12 x:0 0 0 2023-12-09T02:34:47.121 INFO:tasks.workunit.client.0.smithi088.stdout:2/54: truncate f1 204955 0 2023-12-09T02:34:47.122 INFO:tasks.workunit.client.0.smithi088.stdout:6/34: creat fa x:0 0 0 2023-12-09T02:34:47.123 INFO:tasks.workunit.client.0.smithi088.stdout:3/26: mkdir d1/d9 0 2023-12-09T02:34:47.125 INFO:tasks.workunit.client.0.smithi088.stdout:4/36: creat d3/fb x:0 0 0 2023-12-09T02:34:47.126 INFO:tasks.workunit.client.0.smithi088.stdout:2/55: mkdir d6/d13 0 2023-12-09T02:34:47.127 INFO:tasks.workunit.client.0.smithi088.stdout:3/27: creat d1/fa x:0 0 0 2023-12-09T02:34:47.127 INFO:tasks.workunit.client.0.smithi088.stdout:2/56: write f3 [32269,73737] 0 2023-12-09T02:34:47.129 INFO:tasks.workunit.client.0.smithi088.stdout:3/28: dread d1/f5 [0,4194304] 0 2023-12-09T02:34:47.130 INFO:tasks.workunit.client.0.smithi088.stdout:8/62: dwrite d2/f8 [0,4194304] 0 2023-12-09T02:34:47.133 INFO:tasks.workunit.client.0.smithi088.stdout:2/57: mknod d6/d13/c14 0 2023-12-09T02:34:47.134 INFO:tasks.workunit.client.0.smithi088.stdout:9/39: dwrite f6 [0,4194304] 0 2023-12-09T02:34:47.137 INFO:tasks.workunit.client.0.smithi088.stdout:2/58: rename f2 to d6/d13/f15 0 2023-12-09T02:34:47.138 INFO:tasks.workunit.client.0.smithi088.stdout:9/40: read f0 [762982,114374] 0 2023-12-09T02:34:47.142 INFO:tasks.workunit.client.0.smithi088.stdout:2/59: creat d6/d13/f16 x:0 0 0 2023-12-09T02:34:47.142 INFO:tasks.workunit.client.0.smithi088.stdout:2/60: dread - d6/d13/f16 zero size 2023-12-09T02:34:47.143 INFO:tasks.workunit.client.0.smithi088.stdout:7/91: write dc/de/f1d [4564089,105469] 0 2023-12-09T02:34:47.145 INFO:tasks.workunit.client.0.smithi088.stdout:1/75: dwrite d8/fb [4194304,4194304] 0 2023-12-09T02:34:47.148 INFO:tasks.workunit.client.0.smithi088.stdout:2/61: mkdir d6/d8/d17 0 2023-12-09T02:34:47.149 INFO:tasks.workunit.client.0.smithi088.stdout:7/92: mknod dc/d1b/c1f 0 2023-12-09T02:34:47.152 INFO:tasks.workunit.client.0.smithi088.stdout:6/35: dwrite fa [0,4194304] 0 2023-12-09T02:34:47.152 INFO:tasks.workunit.client.0.smithi088.stdout:6/36: write f9 [418143,56079] 0 2023-12-09T02:34:47.154 INFO:tasks.workunit.client.0.smithi088.stdout:9/41: dread f0 [0,4194304] 0 2023-12-09T02:34:47.154 INFO:tasks.workunit.client.0.smithi088.stdout:9/42: fsync f7 0 2023-12-09T02:34:47.157 INFO:tasks.workunit.client.0.smithi088.stdout:1/76: mkdir d8/d1c 0 2023-12-09T02:34:47.157 INFO:tasks.workunit.client.0.smithi088.stdout:2/62: rename d6/d8/d17 to d6/d13/d18 0 2023-12-09T02:34:47.157 INFO:tasks.workunit.client.0.smithi088.stdout:1/77: write f2 [5208095,94931] 0 2023-12-09T02:34:47.161 INFO:tasks.workunit.client.0.smithi088.stdout:2/63: creat d6/d13/d18/f19 x:0 0 0 2023-12-09T02:34:47.163 INFO:tasks.workunit.client.0.smithi088.stdout:9/43: dread f0 [0,4194304] 0 2023-12-09T02:34:47.163 INFO:tasks.workunit.client.0.smithi088.stdout:1/78: write f2 [2380295,30718] 0 2023-12-09T02:34:47.163 INFO:tasks.workunit.client.0.smithi088.stdout:1/79: chown d8/c9 268 1 2023-12-09T02:34:47.163 INFO:tasks.workunit.client.0.smithi088.stdout:1/80: chown d8/f15 76162 1 2023-12-09T02:34:47.163 INFO:tasks.workunit.client.0.smithi088.stdout:1/81: chown d8/f15 14 1 2023-12-09T02:34:47.163 INFO:tasks.workunit.client.0.smithi088.stdout:1/82: getdents d8/d1c 0 2023-12-09T02:34:47.163 INFO:tasks.workunit.client.0.smithi088.stdout:1/83: dread - d8/f15 zero size 2023-12-09T02:34:47.163 INFO:tasks.workunit.client.0.smithi088.stdout:0/96: dwrite f4 [0,4194304] 0 2023-12-09T02:34:47.163 INFO:tasks.workunit.client.0.smithi088.stdout:2/64: creat d6/d8/f1a x:0 0 0 2023-12-09T02:34:47.164 INFO:tasks.workunit.client.0.smithi088.stdout:2/65: fsync d6/d8/f11 0 2023-12-09T02:34:47.164 INFO:tasks.workunit.client.0.smithi088.stdout:2/66: dread - d6/d8/f11 zero size 2023-12-09T02:34:47.164 INFO:tasks.workunit.client.0.smithi088.stdout:1/84: write f2 [4313578,4756] 0 2023-12-09T02:34:47.164 INFO:tasks.workunit.client.0.smithi088.stdout:9/44: symlink lb 0 2023-12-09T02:34:47.169 INFO:tasks.workunit.client.0.smithi088.stdout:2/67: creat d6/d13/d18/f1b x:0 0 0 2023-12-09T02:34:47.169 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:46 smithi161 ceph-mon[121170]: pgmap v191: 65 pgs: 65 active+clean; 271 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.7 MiB/s rd, 15 MiB/s wr, 401 op/s 2023-12-09T02:34:47.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:46 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:34:47.170 INFO:tasks.workunit.client.0.smithi088.stdout:1/85: mkdir d8/d1b/d1d 0 2023-12-09T02:34:47.171 INFO:tasks.workunit.client.0.smithi088.stdout:8/63: truncate d2/f8 4005317 0 2023-12-09T02:34:47.173 INFO:tasks.workunit.client.0.smithi088.stdout:0/97: unlink f3 0 2023-12-09T02:34:47.173 INFO:tasks.workunit.client.0.smithi088.stdout:3/29: dwrite d1/f5 [0,4194304] 0 2023-12-09T02:34:47.173 INFO:tasks.workunit.client.0.smithi088.stdout:4/37: dwrite d3/f4 [0,4194304] 0 2023-12-09T02:34:47.174 INFO:tasks.workunit.client.0.smithi088.stdout:8/64: creat d2/d9/d13/d15/f18 x:0 0 0 2023-12-09T02:34:47.175 INFO:tasks.workunit.client.0.smithi088.stdout:1/86: write f3 [4700716,130186] 0 2023-12-09T02:34:47.175 INFO:tasks.workunit.client.0.smithi088.stdout:0/98: chown l5 6924 1 2023-12-09T02:34:47.177 INFO:tasks.workunit.client.0.smithi088.stdout:7/93: dwrite dc/f15 [4194304,4194304] 0 2023-12-09T02:34:47.177 INFO:tasks.workunit.client.0.smithi088.stdout:7/94: truncate dc/de/f17 4624072 0 2023-12-09T02:34:47.177 INFO:tasks.workunit.client.0.smithi088.stdout:3/30: creat d1/d2/fb x:0 0 0 2023-12-09T02:34:47.177 INFO:tasks.workunit.client.0.smithi088.stdout:9/45: dwrite f7 [0,4194304] 0 2023-12-09T02:34:47.178 INFO:tasks.workunit.client.0.smithi088.stdout:4/38: mkdir d3/dc 0 2023-12-09T02:34:47.178 INFO:tasks.workunit.client.0.smithi088.stdout:4/39: write d3/f8 [722713,69060] 0 2023-12-09T02:34:47.179 INFO:tasks.workunit.client.0.smithi088.stdout:8/65: creat d2/d9/d13/f19 x:0 0 0 2023-12-09T02:34:47.181 INFO:tasks.workunit.client.0.smithi088.stdout:1/87: creat d8/d1b/d1d/f1e x:0 0 0 2023-12-09T02:34:47.183 INFO:tasks.workunit.client.0.smithi088.stdout:0/99: symlink df/l1c 0 2023-12-09T02:34:47.187 INFO:tasks.workunit.client.0.smithi088.stdout:7/95: getdents dc/d10 0 2023-12-09T02:34:47.188 INFO:tasks.workunit.client.0.smithi088.stdout:6/37: truncate fa 3199948 0 2023-12-09T02:34:47.192 INFO:tasks.workunit.client.0.smithi088.stdout:3/31: dwrite d1/d2/fb [0,4194304] 0 2023-12-09T02:34:47.192 INFO:tasks.workunit.client.0.smithi088.stdout:2/68: getdents d6/d13/d18 0 2023-12-09T02:34:47.199 INFO:tasks.workunit.client.0.smithi088.stdout:9/46: creat fc x:0 0 0 2023-12-09T02:34:47.199 INFO:tasks.workunit.client.0.smithi088.stdout:4/40: creat d3/fd x:0 0 0 2023-12-09T02:34:47.199 INFO:tasks.workunit.client.0.smithi088.stdout:4/41: fsync d3/f7 0 2023-12-09T02:34:47.201 INFO:tasks.workunit.client.0.smithi088.stdout:4/42: write d3/f4 [6161856,23839] 0 2023-12-09T02:34:47.201 INFO:tasks.workunit.client.0.smithi088.stdout:4/43: dread - d3/f7 zero size 2023-12-09T02:34:47.201 INFO:tasks.workunit.client.0.smithi088.stdout:0/100: getdents df 0 2023-12-09T02:34:47.201 INFO:tasks.workunit.client.0.smithi088.stdout:0/101: write df/d10/f15 [245556,72249] 0 2023-12-09T02:34:47.201 INFO:tasks.workunit.client.0.smithi088.stdout:0/102: fsync f4 0 2023-12-09T02:34:47.202 INFO:tasks.workunit.client.0.smithi088.stdout:7/96: symlink dc/d1b/l20 0 2023-12-09T02:34:47.203 INFO:tasks.workunit.client.0.smithi088.stdout:0/103: dread f2 [0,4194304] 0 2023-12-09T02:34:47.203 INFO:tasks.workunit.client.0.smithi088.stdout:6/38: creat fb x:0 0 0 2023-12-09T02:34:47.205 INFO:tasks.workunit.client.0.smithi088.stdout:6/39: write fa [2443553,114900] 0 2023-12-09T02:34:47.207 INFO:tasks.workunit.client.0.smithi088.stdout:4/44: dread d3/f6 [0,4194304] 0 2023-12-09T02:34:47.207 INFO:tasks.workunit.client.0.smithi088.stdout:4/45: fdatasync d3/f8 0 2023-12-09T02:34:47.207 INFO:tasks.workunit.client.0.smithi088.stdout:3/32: mkdir d1/d9/dc 0 2023-12-09T02:34:47.209 INFO:tasks.workunit.client.0.smithi088.stdout:9/47: mknod cd 0 2023-12-09T02:34:47.209 INFO:tasks.workunit.client.0.smithi088.stdout:8/66: mkdir d2/d9/d1a 0 2023-12-09T02:34:47.211 INFO:tasks.workunit.client.0.smithi088.stdout:9/48: write f6 [3270315,43950] 0 2023-12-09T02:34:47.212 INFO:tasks.workunit.client.0.smithi088.stdout:7/97: rename dc/d10 to dc/d21 0 2023-12-09T02:34:47.213 INFO:tasks.workunit.client.0.smithi088.stdout:0/104: mknod df/c1d 0 2023-12-09T02:34:47.213 INFO:tasks.workunit.client.0.smithi088.stdout:5/59: sync 2023-12-09T02:34:47.213 INFO:tasks.workunit.client.0.smithi088.stdout:5/60: dread - d3/d8/ff zero size 2023-12-09T02:34:47.216 INFO:tasks.workunit.client.0.smithi088.stdout:4/46: creat d3/fe x:0 0 0 2023-12-09T02:34:47.216 INFO:tasks.workunit.client.0.smithi088.stdout:4/47: chown d3/f9 26472 1 2023-12-09T02:34:47.216 INFO:tasks.workunit.client.0.smithi088.stdout:6/40: dread fa [0,4194304] 0 2023-12-09T02:34:47.218 INFO:tasks.workunit.client.0.smithi088.stdout:8/67: mknod d2/c1b 0 2023-12-09T02:34:47.219 INFO:tasks.workunit.client.0.smithi088.stdout:9/49: truncate f0 1445759 0 2023-12-09T02:34:47.219 INFO:tasks.workunit.client.0.smithi088.stdout:5/61: dread d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:47.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/98: mknod dc/d1b/c22 0 2023-12-09T02:34:47.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/99: fsync dc/f15 0 2023-12-09T02:34:47.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/100: chown dc/de/c16 7410539 1 2023-12-09T02:34:47.221 INFO:tasks.workunit.client.0.smithi088.stdout:9/50: fsync f6 0 2023-12-09T02:34:47.222 INFO:tasks.workunit.client.0.smithi088.stdout:9/51: write f7 [2809394,5377] 0 2023-12-09T02:34:47.223 INFO:tasks.workunit.client.0.smithi088.stdout:4/48: mknod d3/cf 0 2023-12-09T02:34:47.223 INFO:tasks.workunit.client.0.smithi088.stdout:6/41: truncate f6 27958 0 2023-12-09T02:34:47.223 INFO:tasks.workunit.client.0.smithi088.stdout:7/101: dread dc/f18 [0,4194304] 0 2023-12-09T02:34:47.224 INFO:tasks.workunit.client.0.smithi088.stdout:8/68: mkdir d2/d9/d13/d1c 0 2023-12-09T02:34:47.226 INFO:tasks.workunit.client.0.smithi088.stdout:5/62: creat d3/d8/db/dc/f13 x:0 0 0 2023-12-09T02:34:47.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:46 smithi088 ceph-mon[112028]: pgmap v191: 65 pgs: 65 active+clean; 271 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.7 MiB/s rd, 15 MiB/s wr, 401 op/s 2023-12-09T02:34:47.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:46 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:34:47.227 INFO:tasks.workunit.client.0.smithi088.stdout:0/105: link fe df/d10/f1e 0 2023-12-09T02:34:47.228 INFO:tasks.workunit.client.0.smithi088.stdout:7/102: dread dc/de/ff [0,4194304] 0 2023-12-09T02:34:47.231 INFO:tasks.workunit.client.0.smithi088.stdout:4/49: creat d3/dc/f10 x:0 0 0 2023-12-09T02:34:47.236 INFO:tasks.workunit.client.0.smithi088.stdout:0/106: mknod df/c1f 0 2023-12-09T02:34:47.236 INFO:tasks.workunit.client.0.smithi088.stdout:0/107: write df/d10/f13 [325787,42359] 0 2023-12-09T02:34:47.237 INFO:tasks.workunit.client.0.smithi088.stdout:0/108: chown f2 2 1 2023-12-09T02:34:47.237 INFO:tasks.workunit.client.0.smithi088.stdout:7/103: creat dc/de/d1e/f23 x:0 0 0 2023-12-09T02:34:47.238 INFO:tasks.workunit.client.0.smithi088.stdout:4/50: creat d3/dc/f11 x:0 0 0 2023-12-09T02:34:47.238 INFO:tasks.workunit.client.0.smithi088.stdout:0/109: dread f6 [0,4194304] 0 2023-12-09T02:34:47.239 INFO:tasks.workunit.client.0.smithi088.stdout:6/42: link l8 lc 0 2023-12-09T02:34:47.241 INFO:tasks.workunit.client.0.smithi088.stdout:7/104: stat dc/d21/l1c 0 2023-12-09T02:34:47.242 INFO:tasks.workunit.client.0.smithi088.stdout:4/51: creat d3/dc/f12 x:0 0 0 2023-12-09T02:34:47.242 INFO:tasks.workunit.client.0.smithi088.stdout:4/52: chown f0 35351 1 2023-12-09T02:34:47.243 INFO:tasks.workunit.client.0.smithi088.stdout:0/110: mknod df/c20 0 2023-12-09T02:34:47.244 INFO:tasks.workunit.client.0.smithi088.stdout:0/111: dread fe [0,4194304] 0 2023-12-09T02:34:47.244 INFO:tasks.workunit.client.0.smithi088.stdout:6/43: truncate fa 3105679 0 2023-12-09T02:34:47.245 INFO:tasks.workunit.client.0.smithi088.stdout:4/53: mknod d3/dc/c13 0 2023-12-09T02:34:47.246 INFO:tasks.workunit.client.0.smithi088.stdout:9/52: dwrite f7 [4194304,4194304] 0 2023-12-09T02:34:47.246 INFO:tasks.workunit.client.0.smithi088.stdout:9/53: chown ca 18919906 1 2023-12-09T02:34:47.247 INFO:tasks.workunit.client.0.smithi088.stdout:0/112: truncate fc 3587502 0 2023-12-09T02:34:47.247 INFO:tasks.workunit.client.0.smithi088.stdout:0/113: write df/d10/f13 [1236490,107551] 0 2023-12-09T02:34:47.249 INFO:tasks.workunit.client.0.smithi088.stdout:7/105: dread dc/f15 [4194304,4194304] 0 2023-12-09T02:34:47.249 INFO:tasks.workunit.client.0.smithi088.stdout:7/106: dread - fb zero size 2023-12-09T02:34:47.249 INFO:tasks.workunit.client.0.smithi088.stdout:7/107: chown dc/f15 0 1 2023-12-09T02:34:47.249 INFO:tasks.workunit.client.0.smithi088.stdout:4/54: link d3/fb d3/dc/f14 0 2023-12-09T02:34:47.250 INFO:tasks.workunit.client.0.smithi088.stdout:4/55: truncate d3/dc/f11 608510 0 2023-12-09T02:34:47.252 INFO:tasks.workunit.client.0.smithi088.stdout:9/54: rename c4 to ce 0 2023-12-09T02:34:47.253 INFO:tasks.workunit.client.0.smithi088.stdout:0/114: creat df/f21 x:0 0 0 2023-12-09T02:34:47.254 INFO:tasks.workunit.client.0.smithi088.stdout:7/108: mknod dc/d21/c24 0 2023-12-09T02:34:47.254 INFO:tasks.workunit.client.0.smithi088.stdout:5/63: dwrite d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:47.255 INFO:tasks.workunit.client.0.smithi088.stdout:6/44: link l8 ld 0 2023-12-09T02:34:47.256 INFO:tasks.workunit.client.0.smithi088.stdout:0/115: mkdir df/d10/d22 0 2023-12-09T02:34:47.257 INFO:tasks.workunit.client.0.smithi088.stdout:7/109: creat dc/f25 x:0 0 0 2023-12-09T02:34:47.258 INFO:tasks.workunit.client.0.smithi088.stdout:5/64: mkdir d3/d8/db/dc/d14 0 2023-12-09T02:34:47.261 INFO:tasks.workunit.client.0.smithi088.stdout:6/45: write fa [3244798,84032] 0 2023-12-09T02:34:47.261 INFO:tasks.workunit.client.0.smithi088.stdout:6/46: stat c2 0 2023-12-09T02:34:47.261 INFO:tasks.workunit.client.0.smithi088.stdout:6/47: truncate fb 920652 0 2023-12-09T02:34:47.272 INFO:tasks.workunit.client.0.smithi088.stdout:6/48: rename ld to le 0 2023-12-09T02:34:47.302 INFO:tasks.workunit.client.0.smithi088.stdout:9/55: dwrite f7 [4194304,4194304] 0 2023-12-09T02:34:47.302 INFO:tasks.workunit.client.0.smithi088.stdout:9/56: chown f7 681796 1 2023-12-09T02:34:47.302 INFO:tasks.workunit.client.0.smithi088.stdout:4/56: dwrite f2 [0,4194304] 0 2023-12-09T02:34:47.302 INFO:tasks.workunit.client.0.smithi088.stdout:4/57: fsync d3/f7 0 2023-12-09T02:34:47.303 INFO:tasks.workunit.client.0.smithi088.stdout:7/110: dwrite dc/de/f1d [0,4194304] 0 2023-12-09T02:34:47.303 INFO:tasks.workunit.client.0.smithi088.stdout:7/111: dread - fb zero size 2023-12-09T02:34:47.303 INFO:tasks.workunit.client.0.smithi088.stdout:7/112: write fb [642067,18416] 0 2023-12-09T02:34:47.303 INFO:tasks.workunit.client.0.smithi088.stdout:0/116: dwrite f6 [0,4194304] 0 2023-12-09T02:34:47.303 INFO:tasks.workunit.client.0.smithi088.stdout:0/117: fdatasync df/d10/f1e 0 2023-12-09T02:34:47.307 INFO:tasks.workunit.client.0.smithi088.stdout:9/57: mkdir df 0 2023-12-09T02:34:47.312 INFO:tasks.workunit.client.0.smithi088.stdout:4/58: getdents d3/dc 0 2023-12-09T02:34:47.314 INFO:tasks.workunit.client.0.smithi088.stdout:5/65: rename d3/d8/db to d3/d15 0 2023-12-09T02:34:47.315 INFO:tasks.workunit.client.0.smithi088.stdout:7/113: getdents dc 0 2023-12-09T02:34:47.315 INFO:tasks.workunit.client.0.smithi088.stdout:7/114: stat dc/de 0 2023-12-09T02:34:47.321 INFO:tasks.workunit.client.0.smithi088.stdout:6/49: getdents . 0 2023-12-09T02:34:47.322 INFO:tasks.workunit.client.0.smithi088.stdout:4/59: creat d3/f15 x:0 0 0 2023-12-09T02:34:47.323 INFO:tasks.workunit.client.0.smithi088.stdout:7/115: rename la to dc/d1b/l26 0 2023-12-09T02:34:47.325 INFO:tasks.workunit.client.0.smithi088.stdout:4/60: creat d3/f16 x:0 0 0 2023-12-09T02:34:47.325 INFO:tasks.workunit.client.0.smithi088.stdout:4/61: chown d3/dc/f14 832987 1 2023-12-09T02:34:47.325 INFO:tasks.workunit.client.0.smithi088.stdout:4/62: fsync f2 0 2023-12-09T02:34:47.326 INFO:tasks.workunit.client.0.smithi088.stdout:6/50: mknod cf 0 2023-12-09T02:34:47.327 INFO:tasks.workunit.client.0.smithi088.stdout:4/63: creat d3/f17 x:0 0 0 2023-12-09T02:34:47.327 INFO:tasks.workunit.client.0.smithi088.stdout:4/64: dread - d3/f17 zero size 2023-12-09T02:34:47.327 INFO:tasks.workunit.client.0.smithi088.stdout:5/66: dread d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:47.330 INFO:tasks.workunit.client.0.smithi088.stdout:6/51: creat f10 x:0 0 0 2023-12-09T02:34:47.330 INFO:tasks.workunit.client.0.smithi088.stdout:6/52: write f6 [399754,23676] 0 2023-12-09T02:34:47.331 INFO:tasks.workunit.client.0.smithi088.stdout:6/53: creat f11 x:0 0 0 2023-12-09T02:34:47.331 INFO:tasks.workunit.client.0.smithi088.stdout:6/54: readlink lc 0 2023-12-09T02:34:47.332 INFO:tasks.workunit.client.0.smithi088.stdout:6/55: dread fb [0,4194304] 0 2023-12-09T02:34:47.334 INFO:tasks.workunit.client.0.smithi088.stdout:0/118: dwrite df/f21 [0,4194304] 0 2023-12-09T02:34:47.336 INFO:tasks.workunit.client.0.smithi088.stdout:9/58: dwrite f6 [0,4194304] 0 2023-12-09T02:34:47.340 INFO:tasks.workunit.client.0.smithi088.stdout:1/88: sync 2023-12-09T02:34:47.341 INFO:tasks.workunit.client.0.smithi088.stdout:1/89: chown d8/ff 20 1 2023-12-09T02:34:47.341 INFO:tasks.workunit.client.0.smithi088.stdout:1/90: write d8/f1a [4578763,66947] 0 2023-12-09T02:34:47.341 INFO:tasks.workunit.client.0.smithi088.stdout:1/91: readlink d8/l14 0 2023-12-09T02:34:47.341 INFO:tasks.workunit.client.0.smithi088.stdout:1/92: dread - d8/f19 zero size 2023-12-09T02:34:47.342 INFO:tasks.workunit.client.0.smithi088.stdout:9/59: mkdir df/d10 0 2023-12-09T02:34:47.343 INFO:tasks.workunit.client.0.smithi088.stdout:9/60: truncate f6 5056476 0 2023-12-09T02:34:47.344 INFO:tasks.workunit.client.0.smithi088.stdout:1/93: symlink d8/d1b/d1d/l1f 0 2023-12-09T02:34:47.344 INFO:tasks.workunit.client.0.smithi088.stdout:9/61: read f6 [4005070,15368] 0 2023-12-09T02:34:47.345 INFO:tasks.workunit.client.0.smithi088.stdout:1/94: creat d8/d1b/f20 x:0 0 0 2023-12-09T02:34:47.345 INFO:tasks.workunit.client.0.smithi088.stdout:1/95: chown d8/ff 478764066 1 2023-12-09T02:34:47.348 INFO:tasks.workunit.client.0.smithi088.stdout:9/62: rename f6 to df/f11 0 2023-12-09T02:34:47.351 INFO:tasks.workunit.client.0.smithi088.stdout:9/63: write f7 [7038362,97279] 0 2023-12-09T02:34:47.353 INFO:tasks.workunit.client.0.smithi088.stdout:9/64: dread f0 [0,4194304] 0 2023-12-09T02:34:47.361 INFO:tasks.workunit.client.0.smithi088.stdout:7/116: dwrite dc/f15 [8388608,4194304] 0 2023-12-09T02:34:47.363 INFO:tasks.workunit.client.0.smithi088.stdout:6/56: dwrite f11 [0,4194304] 0 2023-12-09T02:34:47.363 INFO:tasks.workunit.client.0.smithi088.stdout:5/67: dwrite d3/d8/f9 [4194304,4194304] 0 2023-12-09T02:34:47.363 INFO:tasks.workunit.client.0.smithi088.stdout:4/65: dwrite d3/dc/f14 [0,4194304] 0 2023-12-09T02:34:47.363 INFO:tasks.workunit.client.0.smithi088.stdout:5/68: chown d3/d15 1191390993 1 2023-12-09T02:34:47.363 INFO:tasks.workunit.client.0.smithi088.stdout:5/69: read - d3/d8/ff zero size 2023-12-09T02:34:47.364 INFO:tasks.workunit.client.0.smithi088.stdout:4/66: truncate d3/f16 797255 0 2023-12-09T02:34:47.364 INFO:tasks.workunit.client.0.smithi088.stdout:5/70: chown d3/d8/f9 1565484 1 2023-12-09T02:34:47.364 INFO:tasks.workunit.client.0.smithi088.stdout:4/67: getdents d3/dc 0 2023-12-09T02:34:47.364 INFO:tasks.workunit.client.0.smithi088.stdout:6/57: write f10 [958150,31045] 0 2023-12-09T02:34:47.364 INFO:tasks.workunit.client.0.smithi088.stdout:4/68: chown d3/f6 20878553 1 2023-12-09T02:34:47.366 INFO:tasks.workunit.client.0.smithi088.stdout:7/117: link dc/d1b/l26 dc/de/l27 0 2023-12-09T02:34:47.373 INFO:tasks.workunit.client.0.smithi088.stdout:5/71: link l1 d3/d15/dc/d11/l16 0 2023-12-09T02:34:47.373 INFO:tasks.workunit.client.0.smithi088.stdout:5/72: truncate d3/d8/ff 474244 0 2023-12-09T02:34:47.375 INFO:tasks.workunit.client.0.smithi088.stdout:7/118: symlink dc/de/d1e/l28 0 2023-12-09T02:34:47.375 INFO:tasks.workunit.client.0.smithi088.stdout:7/119: write dc/de/ff [4946355,45124] 0 2023-12-09T02:34:47.375 INFO:tasks.workunit.client.0.smithi088.stdout:7/120: getdents dc 0 2023-12-09T02:34:47.376 INFO:tasks.workunit.client.0.smithi088.stdout:5/73: creat d3/d15/de/f17 x:0 0 0 2023-12-09T02:34:47.377 INFO:tasks.workunit.client.0.smithi088.stdout:2/69: sync 2023-12-09T02:34:47.377 INFO:tasks.workunit.client.0.smithi088.stdout:3/33: sync 2023-12-09T02:34:47.377 INFO:tasks.workunit.client.0.smithi088.stdout:8/69: sync 2023-12-09T02:34:47.377 INFO:tasks.workunit.client.0.smithi088.stdout:2/70: read f4 [498559,105627] 0 2023-12-09T02:34:47.378 INFO:tasks.workunit.client.0.smithi088.stdout:9/65: dwrite df/f11 [0,4194304] 0 2023-12-09T02:34:47.378 INFO:tasks.workunit.client.0.smithi088.stdout:1/96: dwrite d8/fa [0,4194304] 0 2023-12-09T02:34:47.379 INFO:tasks.workunit.client.0.smithi088.stdout:6/58: rename f4 to f12 0 2023-12-09T02:34:47.380 INFO:tasks.workunit.client.0.smithi088.stdout:7/121: creat dc/f29 x:0 0 0 2023-12-09T02:34:47.380 INFO:tasks.workunit.client.0.smithi088.stdout:7/122: stat dc/d21 0 2023-12-09T02:34:47.381 INFO:tasks.workunit.client.0.smithi088.stdout:8/70: creat d2/d9/d13/f1d x:0 0 0 2023-12-09T02:34:47.383 INFO:tasks.workunit.client.0.smithi088.stdout:2/71: unlink d6/d13/d18/f1b 0 2023-12-09T02:34:47.384 INFO:tasks.workunit.client.0.smithi088.stdout:1/97: symlink d8/d1c/l21 0 2023-12-09T02:34:47.389 INFO:tasks.workunit.client.0.smithi088.stdout:9/66: rename df/f11 to df/d10/f12 0 2023-12-09T02:34:47.392 INFO:tasks.workunit.client.0.smithi088.stdout:7/123: mknod dc/de/c2a 0 2023-12-09T02:34:47.392 INFO:tasks.workunit.client.0.smithi088.stdout:7/124: readlink dc/d1b/l26 0 2023-12-09T02:34:47.392 INFO:tasks.workunit.client.0.smithi088.stdout:7/125: dread - dc/de/d1e/f23 zero size 2023-12-09T02:34:47.392 INFO:tasks.workunit.client.0.smithi088.stdout:4/69: dwrite f0 [0,4194304] 0 2023-12-09T02:34:47.394 INFO:tasks.workunit.client.0.smithi088.stdout:2/72: link d6/d8/fe d6/f1c 0 2023-12-09T02:34:47.394 INFO:tasks.workunit.client.0.smithi088.stdout:2/73: fsync d6/d13/f15 0 2023-12-09T02:34:47.395 INFO:tasks.workunit.client.0.smithi088.stdout:6/59: write f11 [4499637,4724] 0 2023-12-09T02:34:47.396 INFO:tasks.workunit.client.0.smithi088.stdout:9/67: rmdir df 39 2023-12-09T02:34:47.396 INFO:tasks.workunit.client.0.smithi088.stdout:6/60: write fa [166775,24040] 0 2023-12-09T02:34:47.397 INFO:tasks.workunit.client.0.smithi088.stdout:7/126: rename dc/f25 to dc/d1b/f2b 0 2023-12-09T02:34:47.398 INFO:tasks.workunit.client.0.smithi088.stdout:2/74: creat d6/d8/f1d x:0 0 0 2023-12-09T02:34:47.398 INFO:tasks.workunit.client.0.smithi088.stdout:2/75: dread - d6/d8/f1d zero size 2023-12-09T02:34:47.399 INFO:tasks.workunit.client.0.smithi088.stdout:9/68: creat df/f13 x:0 0 0 2023-12-09T02:34:47.401 INFO:tasks.workunit.client.0.smithi088.stdout:6/61: dread f6 [0,4194304] 0 2023-12-09T02:34:47.413 INFO:tasks.workunit.client.0.smithi088.stdout:8/71: dwrite f1 [4194304,4194304] 0 2023-12-09T02:34:47.522 INFO:tasks.workunit.client.0.smithi088.stdout:6/62: dread f6 [0,4194304] 0 2023-12-09T02:34:47.526 INFO:tasks.workunit.client.0.smithi088.stdout:7/127: rmdir dc/de/d1e 39 2023-12-09T02:34:47.528 INFO:tasks.workunit.client.0.smithi088.stdout:9/69: creat df/f14 x:0 0 0 2023-12-09T02:34:47.529 INFO:tasks.workunit.client.0.smithi088.stdout:3/34: dwrite d1/fa [0,4194304] 0 2023-12-09T02:34:47.530 INFO:tasks.workunit.client.0.smithi088.stdout:2/76: dread f3 [0,4194304] 0 2023-12-09T02:34:47.530 INFO:tasks.workunit.client.0.smithi088.stdout:5/74: dwrite d3/d8/ff [0,4194304] 0 2023-12-09T02:34:47.535 INFO:tasks.workunit.client.0.smithi088.stdout:8/72: symlink d2/d9/l1e 0 2023-12-09T02:34:47.537 INFO:tasks.workunit.client.0.smithi088.stdout:3/35: write d1/fa [2513914,65098] 0 2023-12-09T02:34:47.538 INFO:tasks.workunit.client.0.smithi088.stdout:2/77: creat d6/d13/f1e x:0 0 0 2023-12-09T02:34:47.539 INFO:tasks.workunit.client.0.smithi088.stdout:8/73: creat d2/d9/d1a/f1f x:0 0 0 2023-12-09T02:34:47.539 INFO:tasks.workunit.client.0.smithi088.stdout:4/70: dwrite f0 [0,4194304] 0 2023-12-09T02:34:47.542 INFO:tasks.workunit.client.0.smithi088.stdout:4/71: mkdir d3/dc/d18 0 2023-12-09T02:34:47.543 INFO:tasks.workunit.client.0.smithi088.stdout:1/98: dwrite f3 [4194304,4194304] 0 2023-12-09T02:34:47.545 INFO:tasks.workunit.client.0.smithi088.stdout:4/72: mknod d3/c19 0 2023-12-09T02:34:47.547 INFO:tasks.workunit.client.0.smithi088.stdout:9/70: fsync df/d10/f12 0 2023-12-09T02:34:47.547 INFO:tasks.workunit.client.0.smithi088.stdout:9/71: truncate df/f14 611140 0 2023-12-09T02:34:47.553 INFO:tasks.workunit.client.0.smithi088.stdout:6/63: dread f11 [0,4194304] 0 2023-12-09T02:34:47.557 INFO:tasks.workunit.client.0.smithi088.stdout:1/99: mknod d8/d1b/c22 0 2023-12-09T02:34:47.557 INFO:tasks.workunit.client.0.smithi088.stdout:1/100: dread - d8/d1b/f20 zero size 2023-12-09T02:34:47.557 INFO:tasks.workunit.client.0.smithi088.stdout:1/101: truncate d8/ff 511063 0 2023-12-09T02:34:47.557 INFO:tasks.workunit.client.0.smithi088.stdout:1/102: truncate d8/ff 522418 0 2023-12-09T02:34:47.558 INFO:tasks.workunit.client.0.smithi088.stdout:9/72: rename l8 to df/l15 0 2023-12-09T02:34:47.560 INFO:tasks.workunit.client.0.smithi088.stdout:1/103: link d8/d1b/d1d/l1f d8/d1c/l23 0 2023-12-09T02:34:47.561 INFO:tasks.workunit.client.0.smithi088.stdout:9/73: rename f0 to df/d10/f16 0 2023-12-09T02:34:47.562 INFO:tasks.workunit.client.0.smithi088.stdout:9/74: read df/f14 [283985,2594] 0 2023-12-09T02:34:47.562 INFO:tasks.workunit.client.0.smithi088.stdout:9/75: read - df/f13 zero size 2023-12-09T02:34:47.562 INFO:tasks.workunit.client.0.smithi088.stdout:9/76: stat l9 0 2023-12-09T02:34:47.562 INFO:tasks.workunit.client.0.smithi088.stdout:6/64: symlink l13 0 2023-12-09T02:34:47.563 INFO:tasks.workunit.client.0.smithi088.stdout:1/104: symlink d8/d1c/l24 0 2023-12-09T02:34:47.563 INFO:tasks.workunit.client.0.smithi088.stdout:1/105: chown d8/d1c/l21 134884733 1 2023-12-09T02:34:47.563 INFO:tasks.workunit.client.0.smithi088.stdout:1/106: chown f2 238590 1 2023-12-09T02:34:47.564 INFO:tasks.workunit.client.0.smithi088.stdout:6/65: creat f14 x:0 0 0 2023-12-09T02:34:47.565 INFO:tasks.workunit.client.0.smithi088.stdout:1/107: symlink d8/d1b/d1d/l25 0 2023-12-09T02:34:47.566 INFO:tasks.workunit.client.0.smithi088.stdout:6/66: creat f15 x:0 0 0 2023-12-09T02:34:47.566 INFO:tasks.workunit.client.0.smithi088.stdout:6/67: readlink l8 0 2023-12-09T02:34:47.567 INFO:tasks.workunit.client.0.smithi088.stdout:1/108: mknod d8/d1b/c26 0 2023-12-09T02:34:47.568 INFO:tasks.workunit.client.0.smithi088.stdout:8/74: rmdir d2/d9/d1a 39 2023-12-09T02:34:47.569 INFO:tasks.workunit.client.0.smithi088.stdout:8/75: dread - d2/d9/d13/f1d zero size 2023-12-09T02:34:47.569 INFO:tasks.workunit.client.0.smithi088.stdout:8/76: write d2/d9/d13/f19 [501869,2179] 0 2023-12-09T02:34:47.570 INFO:tasks.workunit.client.0.smithi088.stdout:7/128: dwrite dc/d21/f1a [0,4194304] 0 2023-12-09T02:34:47.570 INFO:tasks.workunit.client.0.smithi088.stdout:6/68: mkdir d16 0 2023-12-09T02:34:47.571 INFO:tasks.workunit.client.0.smithi088.stdout:3/36: truncate d1/fa 3604946 0 2023-12-09T02:34:47.572 INFO:tasks.workunit.client.0.smithi088.stdout:8/77: creat d2/d9/d13/d1c/f20 x:0 0 0 2023-12-09T02:34:47.575 INFO:tasks.workunit.client.0.smithi088.stdout:7/129: symlink dc/d21/l2c 0 2023-12-09T02:34:47.575 INFO:tasks.workunit.client.0.smithi088.stdout:6/69: symlink d16/l17 0 2023-12-09T02:34:47.576 INFO:tasks.workunit.client.0.smithi088.stdout:7/130: mknod dc/de/c2d 0 2023-12-09T02:34:47.577 INFO:tasks.workunit.client.0.smithi088.stdout:7/131: chown dc/d21/l1c 1326 1 2023-12-09T02:34:47.577 INFO:tasks.workunit.client.0.smithi088.stdout:5/75: dwrite d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:47.577 INFO:tasks.workunit.client.0.smithi088.stdout:6/70: mknod d16/c18 0 2023-12-09T02:34:47.579 INFO:tasks.workunit.client.0.smithi088.stdout:7/132: rename dc/d21/l13 to dc/d21/l2e 0 2023-12-09T02:34:47.579 INFO:tasks.workunit.client.0.smithi088.stdout:5/76: mkdir d3/d15/de/d10/d18 0 2023-12-09T02:34:47.580 INFO:tasks.workunit.client.0.smithi088.stdout:4/73: dwrite d3/dc/f11 [0,4194304] 0 2023-12-09T02:34:47.581 INFO:tasks.workunit.client.0.smithi088.stdout:6/71: unlink d16/l17 0 2023-12-09T02:34:47.583 INFO:tasks.workunit.client.0.smithi088.stdout:7/133: truncate dc/f15 4283826 0 2023-12-09T02:34:47.583 INFO:tasks.workunit.client.0.smithi088.stdout:7/134: truncate dc/d1b/f2b 960213 0 2023-12-09T02:34:47.583 INFO:tasks.workunit.client.0.smithi088.stdout:7/135: fsync f2 0 2023-12-09T02:34:47.585 INFO:tasks.workunit.client.0.smithi088.stdout:9/77: dwrite df/f13 [0,4194304] 0 2023-12-09T02:34:47.587 INFO:tasks.workunit.client.0.smithi088.stdout:2/78: dwrite d6/d13/f1e [0,4194304] 0 2023-12-09T02:34:47.587 INFO:tasks.workunit.client.0.smithi088.stdout:5/77: getdents d3 0 2023-12-09T02:34:47.587 INFO:tasks.workunit.client.0.smithi088.stdout:5/78: stat d3/d15/de 0 2023-12-09T02:34:47.587 INFO:tasks.workunit.client.0.smithi088.stdout:5/79: dread - d3/d15/de/f17 zero size 2023-12-09T02:34:47.592 INFO:tasks.workunit.client.0.smithi088.stdout:6/72: mknod d16/c19 0 2023-12-09T02:34:47.593 INFO:tasks.workunit.client.0.smithi088.stdout:6/73: write f15 [873393,130864] 0 2023-12-09T02:34:47.593 INFO:tasks.workunit.client.0.smithi088.stdout:6/74: fdatasync f12 0 2023-12-09T02:34:47.594 INFO:tasks.workunit.client.0.smithi088.stdout:6/75: write f12 [2634215,110278] 0 2023-12-09T02:34:47.594 INFO:tasks.workunit.client.0.smithi088.stdout:7/136: mknod dc/de/c2f 0 2023-12-09T02:34:47.594 INFO:tasks.workunit.client.0.smithi088.stdout:7/137: dread dc/f18 [0,4194304] 0 2023-12-09T02:34:47.594 INFO:tasks.workunit.client.0.smithi088.stdout:1/109: rmdir d8/d1b/d1d 39 2023-12-09T02:34:47.596 INFO:tasks.workunit.client.0.smithi088.stdout:9/78: creat df/f17 x:0 0 0 2023-12-09T02:34:47.599 INFO:tasks.workunit.client.0.smithi088.stdout:0/119: sync 2023-12-09T02:34:47.600 INFO:tasks.workunit.client.0.smithi088.stdout:2/79: mkdir d6/d8/d1f 0 2023-12-09T02:34:47.600 INFO:tasks.workunit.client.0.smithi088.stdout:2/80: fdatasync d6/d8/f10 0 2023-12-09T02:34:47.600 INFO:tasks.workunit.client.0.smithi088.stdout:2/81: dread - d6/d8/f1a zero size 2023-12-09T02:34:47.600 INFO:tasks.workunit.client.0.smithi088.stdout:2/82: fdatasync f1 0 2023-12-09T02:34:47.600 INFO:tasks.workunit.client.0.smithi088.stdout:5/80: dread d3/d8/ff [0,4194304] 0 2023-12-09T02:34:47.600 INFO:tasks.workunit.client.0.smithi088.stdout:7/138: mknod dc/d21/c30 0 2023-12-09T02:34:47.600 INFO:tasks.workunit.client.0.smithi088.stdout:1/110: truncate d8/f1a 4588064 0 2023-12-09T02:34:47.601 INFO:tasks.workunit.client.0.smithi088.stdout:9/79: creat df/f18 x:0 0 0 2023-12-09T02:34:47.601 INFO:tasks.workunit.client.0.smithi088.stdout:9/80: read df/f14 [508995,86570] 0 2023-12-09T02:34:47.602 INFO:tasks.workunit.client.0.smithi088.stdout:9/81: write df/f14 [1027730,37967] 0 2023-12-09T02:34:47.602 INFO:tasks.workunit.client.0.smithi088.stdout:2/83: mkdir d6/d20 0 2023-12-09T02:34:47.602 INFO:tasks.workunit.client.0.smithi088.stdout:7/139: mknod dc/de/c31 0 2023-12-09T02:34:47.603 INFO:tasks.workunit.client.0.smithi088.stdout:7/140: dread - dc/f29 zero size 2023-12-09T02:34:47.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/82: truncate df/d10/f12 4164749 0 2023-12-09T02:34:47.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/83: write df/f17 [523858,15016] 0 2023-12-09T02:34:47.604 INFO:tasks.workunit.client.0.smithi088.stdout:7/141: mkdir dc/d1b/d32 0 2023-12-09T02:34:47.605 INFO:tasks.workunit.client.0.smithi088.stdout:0/120: write fc [3153977,110200] 0 2023-12-09T02:34:47.605 INFO:tasks.workunit.client.0.smithi088.stdout:0/121: chown l5 89680934 1 2023-12-09T02:34:47.606 INFO:tasks.workunit.client.0.smithi088.stdout:8/78: dwrite f0 [0,4194304] 0 2023-12-09T02:34:47.606 INFO:tasks.workunit.client.0.smithi088.stdout:6/76: fsync fa 0 2023-12-09T02:34:47.607 INFO:tasks.workunit.client.0.smithi088.stdout:0/122: truncate f4 3328089 0 2023-12-09T02:34:47.609 INFO:tasks.workunit.client.0.smithi088.stdout:8/79: readlink d2/d9/ld 0 2023-12-09T02:34:47.611 INFO:tasks.workunit.client.0.smithi088.stdout:6/77: rename d16/c19 to d16/c1a 0 2023-12-09T02:34:47.611 INFO:tasks.workunit.client.0.smithi088.stdout:6/78: fdatasync f14 0 2023-12-09T02:34:47.611 INFO:tasks.workunit.client.0.smithi088.stdout:2/84: write d6/d13/f15 [617509,82649] 0 2023-12-09T02:34:47.611 INFO:tasks.workunit.client.0.smithi088.stdout:3/37: dwrite d1/d2/fb [0,4194304] 0 2023-12-09T02:34:47.611 INFO:tasks.workunit.client.0.smithi088.stdout:4/74: dwrite d3/f8 [0,4194304] 0 2023-12-09T02:34:47.612 INFO:tasks.workunit.client.0.smithi088.stdout:0/123: symlink df/d10/d22/l23 0 2023-12-09T02:34:47.614 INFO:tasks.workunit.client.0.smithi088.stdout:8/80: mknod d2/c21 0 2023-12-09T02:34:47.618 INFO:tasks.workunit.client.0.smithi088.stdout:6/79: mkdir d16/d1b 0 2023-12-09T02:34:47.618 INFO:tasks.workunit.client.0.smithi088.stdout:9/84: dread f7 [0,4194304] 0 2023-12-09T02:34:47.620 INFO:tasks.workunit.client.0.smithi088.stdout:3/38: mknod d1/d9/cd 0 2023-12-09T02:34:47.620 INFO:tasks.workunit.client.0.smithi088.stdout:3/39: chown d1/d9 62 1 2023-12-09T02:34:47.621 INFO:tasks.workunit.client.0.smithi088.stdout:9/85: dread df/d10/f16 [0,4194304] 0 2023-12-09T02:34:47.621 INFO:tasks.workunit.client.0.smithi088.stdout:9/86: dread - df/f18 zero size 2023-12-09T02:34:47.621 INFO:tasks.workunit.client.0.smithi088.stdout:8/81: write d2/f8 [2589597,31168] 0 2023-12-09T02:34:47.621 INFO:tasks.workunit.client.0.smithi088.stdout:8/82: stat d2/d9/d13/f1d 0 2023-12-09T02:34:47.623 INFO:tasks.workunit.client.0.smithi088.stdout:4/75: creat d3/dc/f1a x:0 0 0 2023-12-09T02:34:47.628 INFO:tasks.workunit.client.0.smithi088.stdout:4/76: dread f1 [0,4194304] 0 2023-12-09T02:34:47.628 INFO:tasks.workunit.client.0.smithi088.stdout:4/77: dread - d3/fe zero size 2023-12-09T02:34:47.629 INFO:tasks.workunit.client.0.smithi088.stdout:5/81: dwrite d3/d8/ff [0,4194304] 0 2023-12-09T02:34:47.629 INFO:tasks.workunit.client.0.smithi088.stdout:7/142: dwrite dc/d21/f1a [0,4194304] 0 2023-12-09T02:34:47.630 INFO:tasks.workunit.client.0.smithi088.stdout:3/40: creat d1/d2/fe x:0 0 0 2023-12-09T02:34:47.630 INFO:tasks.workunit.client.0.smithi088.stdout:7/143: write dc/de/f1d [1273063,20236] 0 2023-12-09T02:34:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:7/144: write dc/de/f17 [2374242,75642] 0 2023-12-09T02:34:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:7/145: chown dc/d21/c14 24762 1 2023-12-09T02:34:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:7/146: chown dc/d1b 338 1 2023-12-09T02:34:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:4/78: creat d3/f1b x:0 0 0 2023-12-09T02:34:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:4/79: dread - d3/fe zero size 2023-12-09T02:34:47.639 INFO:tasks.workunit.client.0.smithi088.stdout:1/111: write d8/fa [3674837,40254] 0 2023-12-09T02:34:47.640 INFO:tasks.workunit.client.0.smithi088.stdout:5/82: mkdir d3/d15/de/d10/d18/d19 0 2023-12-09T02:34:47.640 INFO:tasks.workunit.client.0.smithi088.stdout:2/85: rmdir d6 39 2023-12-09T02:34:47.640 INFO:tasks.workunit.client.0.smithi088.stdout:2/86: write d6/d8/f1a [840002,90975] 0 2023-12-09T02:34:47.642 INFO:tasks.workunit.client.0.smithi088.stdout:3/41: creat d1/d2/d6/ff x:0 0 0 2023-12-09T02:34:47.644 INFO:tasks.workunit.client.0.smithi088.stdout:9/87: rename df/d10 to df/d19 0 2023-12-09T02:34:47.644 INFO:tasks.workunit.client.0.smithi088.stdout:9/88: truncate df/f18 255089 0 2023-12-09T02:34:47.649 INFO:tasks.workunit.client.0.smithi088.stdout:7/147: creat dc/de/d1e/f33 x:0 0 0 2023-12-09T02:34:47.649 INFO:tasks.workunit.client.0.smithi088.stdout:7/148: fsync fb 0 2023-12-09T02:34:47.649 INFO:tasks.workunit.client.0.smithi088.stdout:7/149: write dc/d21/f1a [4901910,111574] 0 2023-12-09T02:34:47.650 INFO:tasks.workunit.client.0.smithi088.stdout:4/80: symlink d3/dc/d18/l1c 0 2023-12-09T02:34:47.651 INFO:tasks.workunit.client.0.smithi088.stdout:4/81: fsync d3/f17 0 2023-12-09T02:34:47.651 INFO:tasks.workunit.client.0.smithi088.stdout:7/150: write dc/d21/f1a [2652538,53912] 0 2023-12-09T02:34:47.651 INFO:tasks.workunit.client.0.smithi088.stdout:7/151: fdatasync dc/de/f1d 0 2023-12-09T02:34:47.651 INFO:tasks.workunit.client.0.smithi088.stdout:1/112: rmdir d8/d1b 39 2023-12-09T02:34:47.651 INFO:tasks.workunit.client.0.smithi088.stdout:1/113: fsync d8/d1b/d1d/f1e 0 2023-12-09T02:34:47.653 INFO:tasks.workunit.client.0.smithi088.stdout:5/83: rmdir d3/d15/dc 39 2023-12-09T02:34:47.655 INFO:tasks.workunit.client.0.smithi088.stdout:2/87: symlink d6/d8/d1f/l21 0 2023-12-09T02:34:47.655 INFO:tasks.workunit.client.0.smithi088.stdout:2/88: fdatasync f3 0 2023-12-09T02:34:47.657 INFO:tasks.workunit.client.0.smithi088.stdout:3/42: mkdir d1/d10 0 2023-12-09T02:34:47.657 INFO:tasks.workunit.client.0.smithi088.stdout:6/80: rmdir d16 39 2023-12-09T02:34:47.657 INFO:tasks.workunit.client.0.smithi088.stdout:6/81: getdents d16/d1b 0 2023-12-09T02:34:47.662 INFO:tasks.workunit.client.0.smithi088.stdout:7/152: creat dc/d1b/d32/f34 x:0 0 0 2023-12-09T02:34:47.664 INFO:tasks.workunit.client.0.smithi088.stdout:5/84: link d3/d8/l12 d3/d15/de/d10/l1a 0 2023-12-09T02:34:47.664 INFO:tasks.workunit.client.0.smithi088.stdout:5/85: readlink d3/d8/l12 0 2023-12-09T02:34:47.666 INFO:tasks.workunit.client.0.smithi088.stdout:2/89: mkdir d6/d8/d1f/d22 0 2023-12-09T02:34:47.666 INFO:tasks.workunit.client.0.smithi088.stdout:2/90: fdatasync f4 0 2023-12-09T02:34:47.666 INFO:tasks.workunit.client.0.smithi088.stdout:2/91: fdatasync d6/f1c 0 2023-12-09T02:34:47.666 INFO:tasks.workunit.client.0.smithi088.stdout:3/43: truncate d1/fa 2037439 0 2023-12-09T02:34:47.666 INFO:tasks.workunit.client.0.smithi088.stdout:3/44: stat d1/d2/fb 0 2023-12-09T02:34:47.666 INFO:tasks.workunit.client.0.smithi088.stdout:3/45: readlink d1/l8 0 2023-12-09T02:34:47.669 INFO:tasks.workunit.client.0.smithi088.stdout:6/82: unlink le 0 2023-12-09T02:34:47.670 INFO:tasks.workunit.client.0.smithi088.stdout:6/83: dread fb [0,4194304] 0 2023-12-09T02:34:47.670 INFO:tasks.workunit.client.0.smithi088.stdout:6/84: chown l8 779958 1 2023-12-09T02:34:47.670 INFO:tasks.workunit.client.0.smithi088.stdout:6/85: fsync f9 0 2023-12-09T02:34:47.670 INFO:tasks.workunit.client.0.smithi088.stdout:6/86: fsync f10 0 2023-12-09T02:34:47.670 INFO:tasks.workunit.client.0.smithi088.stdout:5/86: write d3/d8/ff [2324606,117258] 0 2023-12-09T02:34:47.670 INFO:tasks.workunit.client.0.smithi088.stdout:7/153: mknod dc/c35 0 2023-12-09T02:34:47.672 INFO:tasks.workunit.client.0.smithi088.stdout:2/92: creat d6/d20/f23 x:0 0 0 2023-12-09T02:34:47.672 INFO:tasks.workunit.client.0.smithi088.stdout:4/82: dwrite f2 [0,4194304] 0 2023-12-09T02:34:47.672 INFO:tasks.workunit.client.0.smithi088.stdout:4/83: fsync d3/dc/f1a 0 2023-12-09T02:34:47.674 INFO:tasks.workunit.client.0.smithi088.stdout:3/46: rmdir d1/d10 0 2023-12-09T02:34:47.674 INFO:tasks.workunit.client.0.smithi088.stdout:3/47: fdatasync d1/d2/d6/ff 0 2023-12-09T02:34:47.676 INFO:tasks.workunit.client.0.smithi088.stdout:5/87: mkdir d3/d15/de/d10/d18/d19/d1b 0 2023-12-09T02:34:47.676 INFO:tasks.workunit.client.0.smithi088.stdout:5/88: write d3/d15/de/f17 [788821,66995] 0 2023-12-09T02:34:47.678 INFO:tasks.workunit.client.0.smithi088.stdout:7/154: symlink dc/de/l36 0 2023-12-09T02:34:47.684 INFO:tasks.workunit.client.0.smithi088.stdout:4/84: mkdir d3/dc/d1d 0 2023-12-09T02:34:47.689 INFO:tasks.workunit.client.0.smithi088.stdout:5/89: rename d3/d8/ff to d3/d15/de/d10/d18/d19/d1b/f1c 0 2023-12-09T02:34:47.690 INFO:tasks.workunit.client.0.smithi088.stdout:7/155: symlink dc/de/l37 0 2023-12-09T02:34:47.692 INFO:tasks.workunit.client.0.smithi088.stdout:4/85: symlink d3/dc/d1d/l1e 0 2023-12-09T02:34:47.694 INFO:tasks.workunit.client.0.smithi088.stdout:4/86: mkdir d3/d1f 0 2023-12-09T02:34:47.702 INFO:tasks.workunit.client.0.smithi088.stdout:6/87: dwrite f6 [0,4194304] 0 2023-12-09T02:34:47.702 INFO:tasks.workunit.client.0.smithi088.stdout:6/88: fsync fb 0 2023-12-09T02:34:47.705 INFO:tasks.workunit.client.0.smithi088.stdout:3/48: dwrite d1/d2/d6/ff [0,4194304] 0 2023-12-09T02:34:47.706 INFO:tasks.workunit.client.0.smithi088.stdout:2/93: dwrite d6/d13/f1e [0,4194304] 0 2023-12-09T02:34:47.707 INFO:tasks.workunit.client.0.smithi088.stdout:5/90: dread d3/d15/de/f17 [0,4194304] 0 2023-12-09T02:34:47.712 INFO:tasks.workunit.client.0.smithi088.stdout:4/87: dwrite d3/f6 [0,4194304] 0 2023-12-09T02:34:47.714 INFO:tasks.workunit.client.0.smithi088.stdout:4/88: creat d3/dc/f20 x:0 0 0 2023-12-09T02:34:47.720 INFO:tasks.workunit.client.0.smithi088.stdout:4/89: symlink d3/d1f/l21 0 2023-12-09T02:34:47.720 INFO:tasks.workunit.client.0.smithi088.stdout:3/49: read d1/fa [1936367,11260] 0 2023-12-09T02:34:47.721 INFO:tasks.workunit.client.0.smithi088.stdout:4/90: chown d3/dc/f1a 2607542 1 2023-12-09T02:34:47.721 INFO:tasks.workunit.client.0.smithi088.stdout:3/50: chown d1/f5 8449 1 2023-12-09T02:34:47.721 INFO:tasks.workunit.client.0.smithi088.stdout:3/51: truncate d1/d2/fe 556106 0 2023-12-09T02:34:47.721 INFO:tasks.workunit.client.0.smithi088.stdout:4/91: fsync d3/f17 0 2023-12-09T02:34:47.721 INFO:tasks.workunit.client.0.smithi088.stdout:7/156: rename dc/de to dc/d1b/d32/d38 0 2023-12-09T02:34:47.723 INFO:tasks.workunit.client.0.smithi088.stdout:4/92: creat d3/f22 x:0 0 0 2023-12-09T02:34:47.730 INFO:tasks.workunit.client.0.smithi088.stdout:6/89: dwrite fa [0,4194304] 0 2023-12-09T02:34:47.731 INFO:tasks.workunit.client.0.smithi088.stdout:6/90: rmdir d16 39 2023-12-09T02:34:47.738 INFO:tasks.workunit.client.0.smithi088.stdout:3/52: truncate d1/d2/d6/ff 12845 0 2023-12-09T02:34:47.741 INFO:tasks.workunit.client.0.smithi088.stdout:5/91: dwrite d3/d8/f9 [4194304,4194304] 0 2023-12-09T02:34:47.742 INFO:tasks.workunit.client.0.smithi088.stdout:5/92: rename d3/d15/dc to d3/d15/dc/d14/d1d 22 2023-12-09T02:34:47.742 INFO:tasks.workunit.client.0.smithi088.stdout:5/93: fsync d3/d15/dc/f13 0 2023-12-09T02:34:47.742 INFO:tasks.workunit.client.0.smithi088.stdout:5/94: write d3/d15/de/f17 [1211518,45972] 0 2023-12-09T02:34:47.742 INFO:tasks.workunit.client.0.smithi088.stdout:5/95: write d3/d15/de/d10/d18/d19/d1b/f1c [4661254,112823] 0 2023-12-09T02:34:47.742 INFO:tasks.workunit.client.0.smithi088.stdout:5/96: symlink d3/d15/l1e 0 2023-12-09T02:34:47.742 INFO:tasks.workunit.client.0.smithi088.stdout:2/94: dwrite d6/d8/f1a [0,4194304] 0 2023-12-09T02:34:47.744 INFO:tasks.workunit.client.0.smithi088.stdout:8/83: sync 2023-12-09T02:34:47.744 INFO:tasks.workunit.client.0.smithi088.stdout:0/124: sync 2023-12-09T02:34:47.744 INFO:tasks.workunit.client.0.smithi088.stdout:5/97: creat d3/d15/f1f x:0 0 0 2023-12-09T02:34:47.745 INFO:tasks.workunit.client.0.smithi088.stdout:3/53: dread d1/d2/fb [0,4194304] 0 2023-12-09T02:34:47.748 INFO:tasks.workunit.client.0.smithi088.stdout:4/93: dwrite d3/f6 [0,4194304] 0 2023-12-09T02:34:47.748 INFO:tasks.workunit.client.0.smithi088.stdout:2/95: rename l5 to d6/d8/l24 0 2023-12-09T02:34:47.749 INFO:tasks.workunit.client.0.smithi088.stdout:8/84: mknod d2/c22 0 2023-12-09T02:34:47.750 INFO:tasks.workunit.client.0.smithi088.stdout:0/125: creat df/d10/f24 x:0 0 0 2023-12-09T02:34:47.750 INFO:tasks.workunit.client.0.smithi088.stdout:6/91: dwrite f14 [0,4194304] 0 2023-12-09T02:34:47.750 INFO:tasks.workunit.client.0.smithi088.stdout:6/92: chown f12 4989 1 2023-12-09T02:34:47.751 INFO:tasks.workunit.client.0.smithi088.stdout:6/93: read f11 [3006054,109359] 0 2023-12-09T02:34:47.751 INFO:tasks.workunit.client.0.smithi088.stdout:6/94: fsync f12 0 2023-12-09T02:34:47.751 INFO:tasks.workunit.client.0.smithi088.stdout:5/98: mkdir d3/d15/de/d10/d18/d19/d20 0 2023-12-09T02:34:47.751 INFO:tasks.workunit.client.0.smithi088.stdout:5/99: dread - d3/d15/dc/f13 zero size 2023-12-09T02:34:47.752 INFO:tasks.workunit.client.0.smithi088.stdout:3/54: creat d1/d2/d6/f11 x:0 0 0 2023-12-09T02:34:47.752 INFO:tasks.workunit.client.0.smithi088.stdout:3/55: fdatasync d1/d2/d6/f11 0 2023-12-09T02:34:47.753 INFO:tasks.workunit.client.0.smithi088.stdout:6/95: write f14 [2700001,71137] 0 2023-12-09T02:34:47.754 INFO:tasks.workunit.client.0.smithi088.stdout:4/94: unlink d3/fe 0 2023-12-09T02:34:47.754 INFO:tasks.workunit.client.0.smithi088.stdout:4/95: truncate d3/dc/f1a 467756 0 2023-12-09T02:34:47.755 INFO:tasks.workunit.client.0.smithi088.stdout:2/96: rename d6/d8/d1f/l21 to d6/d8/l25 0 2023-12-09T02:34:47.756 INFO:tasks.workunit.client.0.smithi088.stdout:8/85: mknod d2/d9/d13/d1c/c23 0 2023-12-09T02:34:47.757 INFO:tasks.workunit.client.0.smithi088.stdout:0/126: creat df/f25 x:0 0 0 2023-12-09T02:34:47.758 INFO:tasks.workunit.client.0.smithi088.stdout:9/89: sync 2023-12-09T02:34:47.760 INFO:tasks.workunit.client.0.smithi088.stdout:5/100: creat d3/d15/dc/d11/f21 x:0 0 0 2023-12-09T02:34:47.760 INFO:tasks.workunit.client.0.smithi088.stdout:5/101: dread - d3/d15/dc/d11/f21 zero size 2023-12-09T02:34:47.762 INFO:tasks.workunit.client.0.smithi088.stdout:3/56: mkdir d1/d12 0 2023-12-09T02:34:47.763 INFO:tasks.workunit.client.0.smithi088.stdout:8/86: dread d2/f3 [0,4194304] 0 2023-12-09T02:34:47.763 INFO:tasks.workunit.client.0.smithi088.stdout:8/87: write f0 [4218853,63973] 0 2023-12-09T02:34:47.765 INFO:tasks.workunit.client.0.smithi088.stdout:6/96: creat d16/f1c x:0 0 0 2023-12-09T02:34:47.765 INFO:tasks.workunit.client.0.smithi088.stdout:6/97: fsync f9 0 2023-12-09T02:34:47.765 INFO:tasks.workunit.client.0.smithi088.stdout:0/127: symlink df/d10/l26 0 2023-12-09T02:34:47.766 INFO:tasks.workunit.client.0.smithi088.stdout:9/90: creat df/f1a x:0 0 0 2023-12-09T02:34:47.769 INFO:tasks.workunit.client.0.smithi088.stdout:1/114: sync 2023-12-09T02:34:47.769 INFO:tasks.workunit.client.0.smithi088.stdout:5/102: creat d3/d15/dc/f22 x:0 0 0 2023-12-09T02:34:47.769 INFO:tasks.workunit.client.0.smithi088.stdout:3/57: creat d1/d2/f13 x:0 0 0 2023-12-09T02:34:47.769 INFO:tasks.workunit.client.0.smithi088.stdout:3/58: chown d1/d2/fb 13424269 1 2023-12-09T02:34:47.770 INFO:tasks.workunit.client.0.smithi088.stdout:8/88: creat d2/f24 x:0 0 0 2023-12-09T02:34:47.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/97: dwrite d6/d8/f10 [0,4194304] 0 2023-12-09T02:34:47.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/98: chown d6/d13 770 1 2023-12-09T02:34:47.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/99: chown d6/l7 2618124 1 2023-12-09T02:34:47.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/100: chown d6/l7 3 1 2023-12-09T02:34:47.773 INFO:tasks.workunit.client.0.smithi088.stdout:6/98: creat d16/d1b/f1d x:0 0 0 2023-12-09T02:34:47.773 INFO:tasks.workunit.client.0.smithi088.stdout:6/99: chown d16/f1c 914 1 2023-12-09T02:34:47.774 INFO:tasks.workunit.client.0.smithi088.stdout:0/128: rename df/d10/f13 to df/d10/d22/f27 0 2023-12-09T02:34:47.775 INFO:tasks.workunit.client.0.smithi088.stdout:1/115: mkdir d8/d27 0 2023-12-09T02:34:47.775 INFO:tasks.workunit.client.0.smithi088.stdout:3/59: truncate d1/d2/fb 3234398 0 2023-12-09T02:34:47.777 INFO:tasks.workunit.client.0.smithi088.stdout:8/89: creat d2/d9/d1a/f25 x:0 0 0 2023-12-09T02:34:47.780 INFO:tasks.workunit.client.0.smithi088.stdout:2/101: symlink d6/d8/d1f/l26 0 2023-12-09T02:34:47.783 INFO:tasks.workunit.client.0.smithi088.stdout:1/116: creat d8/d1c/f28 x:0 0 0 2023-12-09T02:34:47.784 INFO:tasks.workunit.client.0.smithi088.stdout:8/90: truncate d2/d9/f10 862923 0 2023-12-09T02:34:47.784 INFO:tasks.workunit.client.0.smithi088.stdout:8/91: truncate d2/d9/d1a/f25 845266 0 2023-12-09T02:34:47.787 INFO:tasks.workunit.client.0.smithi088.stdout:2/102: creat d6/d8/d1f/d22/f27 x:0 0 0 2023-12-09T02:34:47.787 INFO:tasks.workunit.client.0.smithi088.stdout:4/96: truncate d3/dc/f1a 597 0 2023-12-09T02:34:47.787 INFO:tasks.workunit.client.0.smithi088.stdout:0/129: dread f6 [0,4194304] 0 2023-12-09T02:34:47.787 INFO:tasks.workunit.client.0.smithi088.stdout:5/103: dread d3/d15/de/d10/d18/d19/d1b/f1c [0,4194304] 0 2023-12-09T02:34:47.788 INFO:tasks.workunit.client.0.smithi088.stdout:8/92: write d2/d9/f10 [237867,101142] 0 2023-12-09T02:34:47.788 INFO:tasks.workunit.client.0.smithi088.stdout:4/97: mknod d3/dc/d18/c23 0 2023-12-09T02:34:47.789 INFO:tasks.workunit.client.0.smithi088.stdout:0/130: mkdir df/d28 0 2023-12-09T02:34:47.791 INFO:tasks.workunit.client.0.smithi088.stdout:5/104: symlink d3/d15/dc/d11/l23 0 2023-12-09T02:34:47.791 INFO:tasks.workunit.client.0.smithi088.stdout:5/105: chown d3/d15/de/d10 1775910 1 2023-12-09T02:34:47.791 INFO:tasks.workunit.client.0.smithi088.stdout:5/106: chown l1 27 1 2023-12-09T02:34:47.792 INFO:tasks.workunit.client.0.smithi088.stdout:8/93: unlink d2/d9/ld 0 2023-12-09T02:34:47.793 INFO:tasks.workunit.client.0.smithi088.stdout:0/131: creat df/d10/f29 x:0 0 0 2023-12-09T02:34:47.795 INFO:tasks.workunit.client.0.smithi088.stdout:0/132: dread f2 [0,4194304] 0 2023-12-09T02:34:47.795 INFO:tasks.workunit.client.0.smithi088.stdout:0/133: dread - df/f25 zero size 2023-12-09T02:34:47.795 INFO:tasks.workunit.client.0.smithi088.stdout:5/107: unlink d3/d15/dc/f22 0 2023-12-09T02:34:47.795 INFO:tasks.workunit.client.0.smithi088.stdout:5/108: write d3/d15/dc/f13 [737055,38972] 0 2023-12-09T02:34:47.796 INFO:tasks.workunit.client.0.smithi088.stdout:8/94: creat d2/d9/d13/d15/f26 x:0 0 0 2023-12-09T02:34:47.799 INFO:tasks.workunit.client.0.smithi088.stdout:8/95: creat d2/d9/f27 x:0 0 0 2023-12-09T02:34:47.800 INFO:tasks.workunit.client.0.smithi088.stdout:1/117: dread f3 [0,4194304] 0 2023-12-09T02:34:47.801 INFO:tasks.workunit.client.0.smithi088.stdout:8/96: creat d2/f28 x:0 0 0 2023-12-09T02:34:47.802 INFO:tasks.workunit.client.0.smithi088.stdout:1/118: creat d8/d1c/f29 x:0 0 0 2023-12-09T02:34:47.802 INFO:tasks.workunit.client.0.smithi088.stdout:1/119: truncate d8/d1c/f29 315576 0 2023-12-09T02:34:47.803 INFO:tasks.workunit.client.0.smithi088.stdout:4/98: dread d3/f8 [0,4194304] 0 2023-12-09T02:34:47.803 INFO:tasks.workunit.client.0.smithi088.stdout:8/97: link d2/d9/d1a/f1f d2/f29 0 2023-12-09T02:34:47.804 INFO:tasks.workunit.client.0.smithi088.stdout:4/99: mknod d3/c24 0 2023-12-09T02:34:47.804 INFO:tasks.workunit.client.0.smithi088.stdout:4/100: chown d3/dc/d18 4091739 1 2023-12-09T02:34:47.805 INFO:tasks.workunit.client.0.smithi088.stdout:9/91: dwrite fc [0,4194304] 0 2023-12-09T02:34:47.805 INFO:tasks.workunit.client.0.smithi088.stdout:1/120: dread f3 [0,4194304] 0 2023-12-09T02:34:47.805 INFO:tasks.workunit.client.0.smithi088.stdout:9/92: chown df/f14 32633 1 2023-12-09T02:34:47.806 INFO:tasks.workunit.client.0.smithi088.stdout:4/101: rename d3/f15 to d3/d1f/f25 0 2023-12-09T02:34:47.810 INFO:tasks.workunit.client.0.smithi088.stdout:9/93: creat df/f1b x:0 0 0 2023-12-09T02:34:47.810 INFO:tasks.workunit.client.0.smithi088.stdout:4/102: rmdir d3/dc/d18 39 2023-12-09T02:34:47.811 INFO:tasks.workunit.client.0.smithi088.stdout:9/94: creat df/f1c x:0 0 0 2023-12-09T02:34:47.811 INFO:tasks.workunit.client.0.smithi088.stdout:6/100: dwrite f9 [0,4194304] 0 2023-12-09T02:34:47.811 INFO:tasks.workunit.client.0.smithi088.stdout:2/103: dwrite f3 [0,4194304] 0 2023-12-09T02:34:47.815 INFO:tasks.workunit.client.0.smithi088.stdout:3/60: dwrite d1/d2/fe [0,4194304] 0 2023-12-09T02:34:47.815 INFO:tasks.workunit.client.0.smithi088.stdout:1/121: dread f2 [0,4194304] 0 2023-12-09T02:34:47.815 INFO:tasks.workunit.client.0.smithi088.stdout:1/122: truncate d8/f15 338354 0 2023-12-09T02:34:47.816 INFO:tasks.workunit.client.0.smithi088.stdout:1/123: chown d8/d1c 52687 1 2023-12-09T02:34:47.817 INFO:tasks.workunit.client.0.smithi088.stdout:0/134: dwrite fb [0,4194304] 0 2023-12-09T02:34:47.818 INFO:tasks.workunit.client.0.smithi088.stdout:6/101: creat d16/d1b/f1e x:0 0 0 2023-12-09T02:34:47.818 INFO:tasks.workunit.client.0.smithi088.stdout:2/104: creat d6/d13/d18/f28 x:0 0 0 2023-12-09T02:34:47.818 INFO:tasks.workunit.client.0.smithi088.stdout:2/105: readlink d6/d8/l24 0 2023-12-09T02:34:47.827 INFO:tasks.workunit.client.0.smithi088.stdout:1/124: unlink d8/ff 0 2023-12-09T02:34:47.828 INFO:tasks.workunit.client.0.smithi088.stdout:1/125: read - d8/d1b/d1d/f1e zero size 2023-12-09T02:34:47.828 INFO:tasks.workunit.client.0.smithi088.stdout:1/126: stat d8/c12 0 2023-12-09T02:34:47.832 INFO:tasks.workunit.client.0.smithi088.stdout:4/103: dwrite d3/fd [0,4194304] 0 2023-12-09T02:34:47.832 INFO:tasks.workunit.client.0.smithi088.stdout:0/135: unlink df/d10/c17 0 2023-12-09T02:34:47.833 INFO:tasks.workunit.client.0.smithi088.stdout:4/104: dread d3/dc/f1a [0,4194304] 0 2023-12-09T02:34:47.833 INFO:tasks.workunit.client.0.smithi088.stdout:4/105: chown d3/dc/f10 2965887 1 2023-12-09T02:34:47.833 INFO:tasks.workunit.client.0.smithi088.stdout:4/106: readlink d3/dc/d18/l1c 0 2023-12-09T02:34:47.833 INFO:tasks.workunit.client.0.smithi088.stdout:4/107: chown d3/d1f/f25 11 1 2023-12-09T02:34:47.835 INFO:tasks.workunit.client.0.smithi088.stdout:2/106: mkdir d6/d8/d1f/d22/d29 0 2023-12-09T02:34:47.835 INFO:tasks.workunit.client.0.smithi088.stdout:2/107: stat d6/d20/f23 0 2023-12-09T02:34:47.835 INFO:tasks.workunit.client.0.smithi088.stdout:2/108: write f4 [1443346,18206] 0 2023-12-09T02:34:47.835 INFO:tasks.workunit.client.0.smithi088.stdout:2/109: truncate d6/d13/d18/f28 618409 0 2023-12-09T02:34:47.836 INFO:tasks.workunit.client.0.smithi088.stdout:1/127: link d8/fa d8/d27/f2a 0 2023-12-09T02:34:47.836 INFO:tasks.workunit.client.0.smithi088.stdout:1/128: chown l1 4739 1 2023-12-09T02:34:47.838 INFO:tasks.workunit.client.0.smithi088.stdout:0/136: mknod df/d10/d22/c2a 0 2023-12-09T02:34:47.839 INFO:tasks.workunit.client.0.smithi088.stdout:6/102: truncate f14 992256 0 2023-12-09T02:34:47.840 INFO:tasks.workunit.client.0.smithi088.stdout:9/95: dwrite df/f1c [0,4194304] 0 2023-12-09T02:34:47.840 INFO:tasks.workunit.client.0.smithi088.stdout:9/96: fsync df/f1a 0 2023-12-09T02:34:47.840 INFO:tasks.workunit.client.0.smithi088.stdout:9/97: dread - df/f1b zero size 2023-12-09T02:34:47.840 INFO:tasks.workunit.client.0.smithi088.stdout:9/98: chown ca 239588 1 2023-12-09T02:34:47.840 INFO:tasks.workunit.client.0.smithi088.stdout:3/61: dwrite d1/d2/f13 [0,4194304] 0 2023-12-09T02:34:47.841 INFO:tasks.workunit.client.0.smithi088.stdout:6/103: write f15 [547223,81963] 0 2023-12-09T02:34:47.841 INFO:tasks.workunit.client.0.smithi088.stdout:4/108: symlink d3/d1f/l26 0 2023-12-09T02:34:47.841 INFO:tasks.workunit.client.0.smithi088.stdout:4/109: truncate d3/d1f/f25 674961 0 2023-12-09T02:34:47.841 INFO:tasks.workunit.client.0.smithi088.stdout:4/110: fsync d3/dc/f11 0 2023-12-09T02:34:47.841 INFO:tasks.workunit.client.0.smithi088.stdout:9/99: write df/d19/f16 [895617,7788] 0 2023-12-09T02:34:47.842 INFO:tasks.workunit.client.0.smithi088.stdout:2/110: mknod d6/d8/d1f/c2a 0 2023-12-09T02:34:47.842 INFO:tasks.workunit.client.0.smithi088.stdout:4/111: write d3/fd [2812873,116720] 0 2023-12-09T02:34:47.843 INFO:tasks.workunit.client.0.smithi088.stdout:1/129: creat d8/d27/f2b x:0 0 0 2023-12-09T02:34:47.847 INFO:tasks.workunit.client.0.smithi088.stdout:1/130: dread f2 [0,4194304] 0 2023-12-09T02:34:47.847 INFO:tasks.workunit.client.0.smithi088.stdout:3/62: symlink d1/d9/l14 0 2023-12-09T02:34:47.848 INFO:tasks.workunit.client.0.smithi088.stdout:9/100: symlink df/d19/l1d 0 2023-12-09T02:34:47.852 INFO:tasks.workunit.client.0.smithi088.stdout:2/111: rename d6/d8/d1f/d22/f27 to d6/d8/d1f/d22/f2b 0 2023-12-09T02:34:47.855 INFO:tasks.workunit.client.0.smithi088.stdout:4/112: creat d3/dc/d18/f27 x:0 0 0 2023-12-09T02:34:47.857 INFO:tasks.workunit.client.0.smithi088.stdout:1/131: creat d8/d1b/d1d/f2c x:0 0 0 2023-12-09T02:34:47.857 INFO:tasks.workunit.client.0.smithi088.stdout:1/132: stat d8/d1c/f28 0 2023-12-09T02:34:47.859 INFO:tasks.workunit.client.0.smithi088.stdout:6/104: dread f6 [0,4194304] 0 2023-12-09T02:34:47.860 INFO:tasks.workunit.client.0.smithi088.stdout:2/112: creat d6/d8/d1f/d22/f2c x:0 0 0 2023-12-09T02:34:47.860 INFO:tasks.workunit.client.0.smithi088.stdout:7/157: sync 2023-12-09T02:34:47.863 INFO:tasks.workunit.client.0.smithi088.stdout:1/133: creat d8/d1b/d1d/f2d x:0 0 0 2023-12-09T02:34:47.863 INFO:tasks.workunit.client.0.smithi088.stdout:1/134: write d8/d1b/d1d/f1e [1029548,52923] 0 2023-12-09T02:34:47.863 INFO:tasks.workunit.client.0.smithi088.stdout:1/135: readlink d8/d1c/l21 0 2023-12-09T02:34:47.867 INFO:tasks.workunit.client.0.smithi088.stdout:6/105: creat d16/d1b/f1f x:0 0 0 2023-12-09T02:34:47.867 INFO:tasks.workunit.client.0.smithi088.stdout:6/106: write d16/f1c [581508,80609] 0 2023-12-09T02:34:47.868 INFO:tasks.workunit.client.0.smithi088.stdout:6/107: truncate d16/d1b/f1f 396374 0 2023-12-09T02:34:47.868 INFO:tasks.workunit.client.0.smithi088.stdout:2/113: mknod d6/d20/c2d 0 2023-12-09T02:34:47.870 INFO:tasks.workunit.client.0.smithi088.stdout:1/136: creat d8/d1b/f2e x:0 0 0 2023-12-09T02:34:47.870 INFO:tasks.workunit.client.0.smithi088.stdout:1/137: stat d8/d1c 0 2023-12-09T02:34:47.873 INFO:tasks.workunit.client.0.smithi088.stdout:0/137: dwrite df/f21 [0,4194304] 0 2023-12-09T02:34:47.873 INFO:tasks.workunit.client.0.smithi088.stdout:7/158: dread dc/d21/f1a [0,4194304] 0 2023-12-09T02:34:47.874 INFO:tasks.workunit.client.0.smithi088.stdout:6/108: mknod d16/c20 0 2023-12-09T02:34:47.874 INFO:tasks.workunit.client.0.smithi088.stdout:1/138: unlink d8/d1b/d1d/f1e 0 2023-12-09T02:34:47.874 INFO:tasks.workunit.client.0.smithi088.stdout:2/114: mknod d6/d8/d1f/d22/c2e 0 2023-12-09T02:34:47.875 INFO:tasks.workunit.client.0.smithi088.stdout:3/63: dwrite d1/d2/f13 [0,4194304] 0 2023-12-09T02:34:47.877 INFO:tasks.workunit.client.0.smithi088.stdout:0/138: link df/l19 df/d10/d22/l2b 0 2023-12-09T02:34:47.879 INFO:tasks.workunit.client.0.smithi088.stdout:6/109: link fa d16/f21 0 2023-12-09T02:34:47.879 INFO:tasks.workunit.client.0.smithi088.stdout:4/113: dwrite d3/f1b [0,4194304] 0 2023-12-09T02:34:47.881 INFO:tasks.workunit.client.0.smithi088.stdout:1/139: rename d8/l14 to d8/d1b/d1d/l2f 0 2023-12-09T02:34:47.888 INFO:tasks.workunit.client.0.smithi088.stdout:3/64: rmdir d1/d2 39 2023-12-09T02:34:47.889 INFO:tasks.workunit.client.0.smithi088.stdout:0/139: chown l9 1180 1 2023-12-09T02:34:47.891 INFO:tasks.workunit.client.0.smithi088.stdout:6/110: creat d16/d1b/f22 x:0 0 0 2023-12-09T02:34:47.894 INFO:tasks.workunit.client.0.smithi088.stdout:4/114: creat d3/dc/f28 x:0 0 0 2023-12-09T02:34:47.895 INFO:tasks.workunit.client.0.smithi088.stdout:1/140: getdents d8/d1c 0 2023-12-09T02:34:47.896 INFO:tasks.workunit.client.0.smithi088.stdout:3/65: mkdir d1/d2/d15 0 2023-12-09T02:34:47.898 INFO:tasks.workunit.client.0.smithi088.stdout:4/115: mkdir d3/dc/d18/d29 0 2023-12-09T02:34:47.898 INFO:tasks.workunit.client.0.smithi088.stdout:4/116: rename d3 to d3/d1f/d2a 22 2023-12-09T02:34:47.900 INFO:tasks.workunit.client.0.smithi088.stdout:7/159: dwrite dc/d21/f1a [0,4194304] 0 2023-12-09T02:34:47.900 INFO:tasks.workunit.client.0.smithi088.stdout:4/117: unlink d3/f1b 0 2023-12-09T02:34:47.901 INFO:tasks.workunit.client.0.smithi088.stdout:3/66: write d1/d2/f13 [2548516,52630] 0 2023-12-09T02:34:47.901 INFO:tasks.workunit.client.0.smithi088.stdout:7/160: read dc/f18 [36483,114052] 0 2023-12-09T02:34:47.902 INFO:tasks.workunit.client.0.smithi088.stdout:7/161: truncate fb 910953 0 2023-12-09T02:34:47.902 INFO:tasks.workunit.client.0.smithi088.stdout:2/115: dwrite d6/d8/f1d [0,4194304] 0 2023-12-09T02:34:47.903 INFO:tasks.workunit.client.0.smithi088.stdout:4/118: rename d3/fb to d3/d1f/f2b 0 2023-12-09T02:34:47.905 INFO:tasks.workunit.client.0.smithi088.stdout:3/67: creat d1/d2/d6/f16 x:0 0 0 2023-12-09T02:34:47.911 INFO:tasks.workunit.client.0.smithi088.stdout:2/116: truncate d6/d8/f1a 3147543 0 2023-12-09T02:34:47.911 INFO:tasks.workunit.client.0.smithi088.stdout:2/117: chown d6/d8/d1f/d22/d29 119132309 1 2023-12-09T02:34:47.912 INFO:tasks.workunit.client.0.smithi088.stdout:4/119: creat d3/dc/d18/f2c x:0 0 0 2023-12-09T02:34:47.915 INFO:tasks.workunit.client.0.smithi088.stdout:2/118: creat d6/d8/d1f/f2f x:0 0 0 2023-12-09T02:34:47.915 INFO:tasks.workunit.client.0.smithi088.stdout:2/119: write d6/d13/f15 [4715906,89339] 0 2023-12-09T02:34:47.915 INFO:tasks.workunit.client.0.smithi088.stdout:1/141: dwrite d8/d1c/f29 [0,4194304] 0 2023-12-09T02:34:47.918 INFO:tasks.workunit.client.0.smithi088.stdout:8/98: sync 2023-12-09T02:34:47.918 INFO:tasks.workunit.client.0.smithi088.stdout:8/99: fdatasync d2/d9/d13/d15/f26 0 2023-12-09T02:34:47.918 INFO:tasks.workunit.client.0.smithi088.stdout:8/100: dread - d2/d9/d13/d1c/f20 zero size 2023-12-09T02:34:47.918 INFO:tasks.workunit.client.0.smithi088.stdout:5/109: sync 2023-12-09T02:34:47.919 INFO:tasks.workunit.client.0.smithi088.stdout:8/101: symlink d2/d9/d13/d15/l2a 0 2023-12-09T02:34:47.920 INFO:tasks.workunit.client.0.smithi088.stdout:6/111: getdents d16/d1b 0 2023-12-09T02:34:47.922 INFO:tasks.workunit.client.0.smithi088.stdout:8/102: getdents d2/d9/d13 0 2023-12-09T02:34:47.923 INFO:tasks.workunit.client.0.smithi088.stdout:8/103: write d2/f24 [823819,118010] 0 2023-12-09T02:34:47.923 INFO:tasks.workunit.client.0.smithi088.stdout:5/110: dread d3/d15/dc/f13 [0,4194304] 0 2023-12-09T02:34:47.925 INFO:tasks.workunit.client.0.smithi088.stdout:8/104: mkdir d2/d2b 0 2023-12-09T02:34:47.925 INFO:tasks.workunit.client.0.smithi088.stdout:8/105: truncate d2/d9/d1a/f1f 98684 0 2023-12-09T02:34:47.926 INFO:tasks.workunit.client.0.smithi088.stdout:5/111: creat d3/f24 x:0 0 0 2023-12-09T02:34:47.927 INFO:tasks.workunit.client.0.smithi088.stdout:7/162: dwrite dc/d1b/d32/d38/d1e/f23 [0,4194304] 0 2023-12-09T02:34:47.927 INFO:tasks.workunit.client.0.smithi088.stdout:7/163: write dc/d1b/d32/d38/d1e/f33 [33036,88797] 0 2023-12-09T02:34:47.927 INFO:tasks.workunit.client.0.smithi088.stdout:8/106: truncate f0 2388836 0 2023-12-09T02:34:47.929 INFO:tasks.workunit.client.0.smithi088.stdout:8/107: write d2/f3 [2417144,56167] 0 2023-12-09T02:34:47.929 INFO:tasks.workunit.client.0.smithi088.stdout:5/112: mknod d3/d15/de/d10/c25 0 2023-12-09T02:34:47.929 INFO:tasks.workunit.client.0.smithi088.stdout:8/108: dread d2/fa [0,4194304] 0 2023-12-09T02:34:47.934 INFO:tasks.workunit.client.0.smithi088.stdout:3/68: dread d1/d2/f13 [0,4194304] 0 2023-12-09T02:34:47.935 INFO:tasks.workunit.client.0.smithi088.stdout:5/113: truncate d3/d15/de/d10/d18/d19/d1b/f1c 968005 0 2023-12-09T02:34:47.935 INFO:tasks.workunit.client.0.smithi088.stdout:9/101: sync 2023-12-09T02:34:47.936 INFO:tasks.workunit.client.0.smithi088.stdout:3/69: write d1/d2/f13 [302609,116086] 0 2023-12-09T02:34:47.936 INFO:tasks.workunit.client.0.smithi088.stdout:3/70: fdatasync d1/d2/fb 0 2023-12-09T02:34:47.936 INFO:tasks.workunit.client.0.smithi088.stdout:8/109: creat d2/d9/d13/d15/f2c x:0 0 0 2023-12-09T02:34:47.937 INFO:tasks.workunit.client.0.smithi088.stdout:5/114: creat d3/d15/de/f26 x:0 0 0 2023-12-09T02:34:47.939 INFO:tasks.workunit.client.0.smithi088.stdout:9/102: creat df/d19/f1e x:0 0 0 2023-12-09T02:34:47.939 INFO:tasks.workunit.client.0.smithi088.stdout:9/103: stat cd 0 2023-12-09T02:34:47.939 INFO:tasks.workunit.client.0.smithi088.stdout:9/104: chown df/f17 2097520 1 2023-12-09T02:34:47.940 INFO:tasks.workunit.client.0.smithi088.stdout:9/105: readlink df/d19/l1d 0 2023-12-09T02:34:47.940 INFO:tasks.workunit.client.0.smithi088.stdout:9/106: chown df/f1a 2183234 1 2023-12-09T02:34:47.940 INFO:tasks.workunit.client.0.smithi088.stdout:9/107: truncate df/d19/f1e 624563 0 2023-12-09T02:34:47.941 INFO:tasks.workunit.client.0.smithi088.stdout:8/110: creat d2/d9/d13/d15/f2d x:0 0 0 2023-12-09T02:34:47.950 INFO:tasks.workunit.client.0.smithi088.stdout:3/71: dread d1/f5 [0,4194304] 0 2023-12-09T02:34:47.950 INFO:tasks.workunit.client.0.smithi088.stdout:3/72: dread - d1/d2/d6/f11 zero size 2023-12-09T02:34:47.952 INFO:tasks.workunit.client.0.smithi088.stdout:3/73: symlink d1/d9/dc/l17 0 2023-12-09T02:34:47.953 INFO:tasks.workunit.client.0.smithi088.stdout:2/120: dwrite d6/d13/f15 [0,4194304] 0 2023-12-09T02:34:47.954 INFO:tasks.workunit.client.0.smithi088.stdout:1/142: dwrite d8/d1b/f20 [0,4194304] 0 2023-12-09T02:34:47.954 INFO:tasks.workunit.client.0.smithi088.stdout:1/143: chown d8/d1c/l21 149713282 1 2023-12-09T02:34:47.955 INFO:tasks.workunit.client.0.smithi088.stdout:2/121: rename d6/d13/f16 to d6/d8/f30 0 2023-12-09T02:34:47.956 INFO:tasks.workunit.client.0.smithi088.stdout:3/74: write d1/f5 [3990269,108073] 0 2023-12-09T02:34:47.956 INFO:tasks.workunit.client.0.smithi088.stdout:2/122: rename d6 to d6/d8/d1f/d22/d29/d31 22 2023-12-09T02:34:47.959 INFO:tasks.workunit.client.0.smithi088.stdout:2/123: rename d6/d8/f11 to d6/d13/d18/f32 0 2023-12-09T02:34:47.959 INFO:tasks.workunit.client.0.smithi088.stdout:2/124: read - d6/d13/d18/f19 zero size 2023-12-09T02:34:47.959 INFO:tasks.workunit.client.0.smithi088.stdout:2/125: stat d6/d8/f1d 0 2023-12-09T02:34:47.959 INFO:tasks.workunit.client.0.smithi088.stdout:2/126: chown d6/d8/fe 3 1 2023-12-09T02:34:47.959 INFO:tasks.workunit.client.0.smithi088.stdout:2/127: truncate d6/fd 983318 0 2023-12-09T02:34:47.960 INFO:tasks.workunit.client.0.smithi088.stdout:3/75: creat d1/d12/f18 x:0 0 0 2023-12-09T02:34:47.960 INFO:tasks.workunit.client.0.smithi088.stdout:2/128: creat d6/d13/f33 x:0 0 0 2023-12-09T02:34:47.961 INFO:tasks.workunit.client.0.smithi088.stdout:3/76: mkdir d1/d19 0 2023-12-09T02:34:47.961 INFO:tasks.workunit.client.0.smithi088.stdout:3/77: truncate d1/d2/d6/ff 1036381 0 2023-12-09T02:34:47.962 INFO:tasks.workunit.client.0.smithi088.stdout:2/129: symlink d6/d13/l34 0 2023-12-09T02:34:47.963 INFO:tasks.workunit.client.0.smithi088.stdout:3/78: symlink d1/d2/d15/l1a 0 2023-12-09T02:34:47.965 INFO:tasks.workunit.client.0.smithi088.stdout:2/130: symlink d6/l35 0 2023-12-09T02:34:47.969 INFO:tasks.workunit.client.0.smithi088.stdout:3/79: unlink d1/d2/d6/f16 0 2023-12-09T02:34:47.969 INFO:tasks.workunit.client.0.smithi088.stdout:3/80: stat d1/f5 0 2023-12-09T02:34:47.969 INFO:tasks.workunit.client.0.smithi088.stdout:3/81: write d1/fa [2263217,38649] 0 2023-12-09T02:34:47.969 INFO:tasks.workunit.client.0.smithi088.stdout:3/82: dread - d1/d12/f18 zero size 2023-12-09T02:34:47.969 INFO:tasks.workunit.client.0.smithi088.stdout:8/111: rmdir d2 39 2023-12-09T02:34:47.970 INFO:tasks.workunit.client.0.smithi088.stdout:3/83: getdents d1/d9 0 2023-12-09T02:34:47.970 INFO:tasks.workunit.client.0.smithi088.stdout:8/112: write d2/f11 [86709,17723] 0 2023-12-09T02:34:47.970 INFO:tasks.workunit.client.0.smithi088.stdout:8/113: write d2/d9/d1a/f25 [1647616,59195] 0 2023-12-09T02:34:47.972 INFO:tasks.workunit.client.0.smithi088.stdout:8/114: getdents d2 0 2023-12-09T02:34:47.972 INFO:tasks.workunit.client.0.smithi088.stdout:8/115: read d2/f11 [428789,12098] 0 2023-12-09T02:34:47.973 INFO:tasks.workunit.client.0.smithi088.stdout:5/115: dwrite d3/d15/dc/d11/f21 [0,4194304] 0 2023-12-09T02:34:47.973 INFO:tasks.workunit.client.0.smithi088.stdout:5/116: chown d3/d15/de/d10/c25 39 1 2023-12-09T02:34:47.974 INFO:tasks.workunit.client.0.smithi088.stdout:3/84: dread d1/d2/d6/ff [0,4194304] 0 2023-12-09T02:34:47.974 INFO:tasks.workunit.client.0.smithi088.stdout:9/108: dwrite df/f1b [0,4194304] 0 2023-12-09T02:34:47.974 INFO:tasks.workunit.client.0.smithi088.stdout:8/116: creat d2/d2b/f2e x:0 0 0 2023-12-09T02:34:47.974 INFO:tasks.workunit.client.0.smithi088.stdout:8/117: write d2/d9/f10 [994947,57531] 0 2023-12-09T02:34:47.974 INFO:tasks.workunit.client.0.smithi088.stdout:8/118: fsync d2/d9/d13/f19 0 2023-12-09T02:34:47.974 INFO:tasks.workunit.client.0.smithi088.stdout:8/119: fdatasync d2/d2b/f2e 0 2023-12-09T02:34:47.974 INFO:tasks.workunit.client.0.smithi088.stdout:8/120: readlink d2/d9/l17 0 2023-12-09T02:34:47.978 INFO:tasks.workunit.client.0.smithi088.stdout:5/117: creat d3/d15/de/d10/d18/d19/d20/f27 x:0 0 0 2023-12-09T02:34:47.979 INFO:tasks.workunit.client.0.smithi088.stdout:1/144: dwrite d8/d1b/d1d/f2d [0,4194304] 0 2023-12-09T02:34:47.986 INFO:tasks.workunit.client.0.smithi088.stdout:3/85: creat d1/d9/f1b x:0 0 0 2023-12-09T02:34:47.986 INFO:tasks.workunit.client.0.smithi088.stdout:3/86: write d1/d2/fb [210349,82358] 0 2023-12-09T02:34:47.987 INFO:tasks.workunit.client.0.smithi088.stdout:8/121: creat d2/d9/d13/f2f x:0 0 0 2023-12-09T02:34:47.987 INFO:tasks.workunit.client.0.smithi088.stdout:8/122: chown d2/d9/l16 107 1 2023-12-09T02:34:47.988 INFO:tasks.workunit.client.0.smithi088.stdout:8/123: write d2/f11 [670820,72168] 0 2023-12-09T02:34:47.989 INFO:tasks.workunit.client.0.smithi088.stdout:5/118: link d3/d15/de/f26 d3/d15/dc/d11/f28 0 2023-12-09T02:34:47.989 INFO:tasks.workunit.client.0.smithi088.stdout:5/119: dread - d3/d15/f1f zero size 2023-12-09T02:34:47.992 INFO:tasks.workunit.client.0.smithi088.stdout:1/145: rename d8/d1b/d1d/f2c to d8/d1b/d1d/f30 0 2023-12-09T02:34:47.992 INFO:tasks.workunit.client.0.smithi088.stdout:1/146: fdatasync f3 0 2023-12-09T02:34:47.996 INFO:tasks.workunit.client.0.smithi088.stdout:1/147: rmdir d8/d27 39 2023-12-09T02:34:47.996 INFO:tasks.workunit.client.0.smithi088.stdout:1/148: fsync d8/d1b/f20 0 2023-12-09T02:34:47.997 INFO:tasks.workunit.client.0.smithi088.stdout:5/120: read d3/d8/f9 [3396231,104956] 0 2023-12-09T02:34:47.999 INFO:tasks.workunit.client.0.smithi088.stdout:1/149: mkdir d8/d1c/d31 0 2023-12-09T02:34:48.000 INFO:tasks.workunit.client.0.smithi088.stdout:5/121: symlink d3/d15/l29 0 2023-12-09T02:34:48.000 INFO:tasks.workunit.client.0.smithi088.stdout:5/122: write d3/d15/dc/d11/f28 [286350,97603] 0 2023-12-09T02:34:48.000 INFO:tasks.workunit.client.0.smithi088.stdout:5/123: readlink d3/d8/l12 0 2023-12-09T02:34:48.002 INFO:tasks.workunit.client.0.smithi088.stdout:5/124: mknod d3/d15/de/d10/d18/c2a 0 2023-12-09T02:34:48.002 INFO:tasks.workunit.client.0.smithi088.stdout:1/150: write f3 [6798307,80573] 0 2023-12-09T02:34:48.002 INFO:tasks.workunit.client.0.smithi088.stdout:1/151: truncate d8/f15 618615 0 2023-12-09T02:34:48.005 INFO:tasks.workunit.client.0.smithi088.stdout:0/140: sync 2023-12-09T02:34:48.005 INFO:tasks.workunit.client.0.smithi088.stdout:5/125: link c0 d3/d15/de/c2b 0 2023-12-09T02:34:48.005 INFO:tasks.workunit.client.0.smithi088.stdout:1/152: creat d8/f32 x:0 0 0 2023-12-09T02:34:48.007 INFO:tasks.workunit.client.0.smithi088.stdout:0/141: link f4 df/f2c 0 2023-12-09T02:34:48.007 INFO:tasks.workunit.client.0.smithi088.stdout:0/142: fdatasync df/f25 0 2023-12-09T02:34:48.008 INFO:tasks.workunit.client.0.smithi088.stdout:5/126: mkdir d3/d15/de/d2c 0 2023-12-09T02:34:48.009 INFO:tasks.workunit.client.0.smithi088.stdout:3/87: dwrite d1/d12/f18 [0,4194304] 0 2023-12-09T02:34:48.009 INFO:tasks.workunit.client.0.smithi088.stdout:8/124: dwrite d2/d9/d13/d15/f18 [0,4194304] 0 2023-12-09T02:34:48.009 INFO:tasks.workunit.client.0.smithi088.stdout:8/125: dread - d2/d9/d13/f1d zero size 2023-12-09T02:34:48.011 INFO:tasks.workunit.client.0.smithi088.stdout:0/143: mkdir df/d10/d22/d2d 0 2023-12-09T02:34:48.013 INFO:tasks.workunit.client.0.smithi088.stdout:5/127: creat d3/d15/dc/f2d x:0 0 0 2023-12-09T02:34:48.013 INFO:tasks.workunit.client.0.smithi088.stdout:5/128: write d3/d15/de/d10/d18/d19/d1b/f1c [1280432,109182] 0 2023-12-09T02:34:48.016 INFO:tasks.workunit.client.0.smithi088.stdout:3/88: rmdir d1/d2/d6 39 2023-12-09T02:34:48.020 INFO:tasks.workunit.client.0.smithi088.stdout:1/153: rmdir d8 39 2023-12-09T02:34:48.020 INFO:tasks.workunit.client.0.smithi088.stdout:1/154: chown d8/c10 403412278 1 2023-12-09T02:34:48.021 INFO:tasks.workunit.client.0.smithi088.stdout:8/126: mknod d2/d9/d13/c30 0 2023-12-09T02:34:48.022 INFO:tasks.workunit.client.0.smithi088.stdout:8/127: fdatasync d2/d9/d13/f19 0 2023-12-09T02:34:48.022 INFO:tasks.workunit.client.0.smithi088.stdout:8/128: chown d2/d9/d13/d1c/c23 6 1 2023-12-09T02:34:48.022 INFO:tasks.workunit.client.0.smithi088.stdout:0/144: mkdir df/d10/d22/d2d/d2e 0 2023-12-09T02:34:48.022 INFO:tasks.workunit.client.0.smithi088.stdout:0/145: fsync df/d10/f24 0 2023-12-09T02:34:48.023 INFO:tasks.workunit.client.0.smithi088.stdout:5/129: mkdir d3/d15/d2e 0 2023-12-09T02:34:48.026 INFO:tasks.workunit.client.0.smithi088.stdout:3/89: rename d1/d2/fb to d1/f1c 0 2023-12-09T02:34:48.027 INFO:tasks.workunit.client.0.smithi088.stdout:1/155: creat d8/d1b/f33 x:0 0 0 2023-12-09T02:34:48.028 INFO:tasks.workunit.client.0.smithi088.stdout:0/146: symlink df/d28/l2f 0 2023-12-09T02:34:48.029 INFO:tasks.workunit.client.0.smithi088.stdout:3/90: mknod d1/d2/c1d 0 2023-12-09T02:34:48.029 INFO:tasks.workunit.client.0.smithi088.stdout:4/120: sync 2023-12-09T02:34:48.029 INFO:tasks.workunit.client.0.smithi088.stdout:0/147: dread df/d10/f15 [0,4194304] 0 2023-12-09T02:34:48.029 INFO:tasks.workunit.client.0.smithi088.stdout:1/156: unlink d8/d1c/l23 0 2023-12-09T02:34:48.030 INFO:tasks.workunit.client.0.smithi088.stdout:3/91: mknod d1/d9/c1e 0 2023-12-09T02:34:48.031 INFO:tasks.workunit.client.0.smithi088.stdout:4/121: creat d3/f2d x:0 0 0 2023-12-09T02:34:48.031 INFO:tasks.workunit.client.0.smithi088.stdout:4/122: chown d3/dc/c13 102805 1 2023-12-09T02:34:48.032 INFO:tasks.workunit.client.0.smithi088.stdout:0/148: unlink l9 0 2023-12-09T02:34:48.032 INFO:tasks.workunit.client.0.smithi088.stdout:0/149: readlink df/d28/l2f 0 2023-12-09T02:34:48.033 INFO:tasks.workunit.client.0.smithi088.stdout:1/157: creat d8/f34 x:0 0 0 2023-12-09T02:34:48.033 INFO:tasks.workunit.client.0.smithi088.stdout:1/158: truncate d8/f32 792728 0 2023-12-09T02:34:48.033 INFO:tasks.workunit.client.0.smithi088.stdout:3/92: symlink d1/l1f 0 2023-12-09T02:34:48.034 INFO:tasks.workunit.client.0.smithi088.stdout:3/93: dread - d1/d2/d6/f11 zero size 2023-12-09T02:34:48.034 INFO:tasks.workunit.client.0.smithi088.stdout:3/94: chown d1/d2/f13 28112 1 2023-12-09T02:34:48.035 INFO:tasks.workunit.client.0.smithi088.stdout:0/150: creat df/f30 x:0 0 0 2023-12-09T02:34:48.035 INFO:tasks.workunit.client.0.smithi088.stdout:8/129: dwrite d2/d9/d13/f2f [0,4194304] 0 2023-12-09T02:34:48.036 INFO:tasks.workunit.client.0.smithi088.stdout:3/95: symlink d1/d2/l20 0 2023-12-09T02:34:48.037 INFO:tasks.workunit.client.0.smithi088.stdout:0/151: creat df/d10/f31 x:0 0 0 2023-12-09T02:34:48.040 INFO:tasks.workunit.client.0.smithi088.stdout:3/96: getdents d1/d9/dc 0 2023-12-09T02:34:48.042 INFO:tasks.workunit.client.0.smithi088.stdout:3/97: mknod d1/d9/c21 0 2023-12-09T02:34:48.043 INFO:tasks.workunit.client.0.smithi088.stdout:3/98: mkdir d1/d2/d22 0 2023-12-09T02:34:48.048 INFO:tasks.workunit.client.0.smithi088.stdout:1/159: dwrite d8/fb [8388608,4194304] 0 2023-12-09T02:34:48.049 INFO:tasks.workunit.client.0.smithi088.stdout:1/160: mknod d8/d27/c35 0 2023-12-09T02:34:48.052 INFO:tasks.workunit.client.0.smithi088.stdout:3/99: dread d1/d2/f13 [0,4194304] 0 2023-12-09T02:34:48.053 INFO:tasks.workunit.client.0.smithi088.stdout:3/100: mknod d1/d9/dc/c23 0 2023-12-09T02:34:48.056 INFO:tasks.workunit.client.0.smithi088.stdout:3/101: dread d1/f1c [0,4194304] 0 2023-12-09T02:34:48.056 INFO:tasks.workunit.client.0.smithi088.stdout:3/102: chown d1/d2/d15/l1a 165776584 1 2023-12-09T02:34:48.056 INFO:tasks.workunit.client.0.smithi088.stdout:3/103: chown d1/l1f 2 1 2023-12-09T02:34:48.057 INFO:tasks.workunit.client.0.smithi088.stdout:3/104: mkdir d1/d2/d24 0 2023-12-09T02:34:48.058 INFO:tasks.workunit.client.0.smithi088.stdout:1/161: dread d8/d1b/f20 [0,4194304] 0 2023-12-09T02:34:48.059 INFO:tasks.workunit.client.0.smithi088.stdout:1/162: read d8/d1b/f20 [4193100,72677] 0 2023-12-09T02:34:48.059 INFO:tasks.workunit.client.0.smithi088.stdout:7/164: sync 2023-12-09T02:34:48.059 INFO:tasks.workunit.client.0.smithi088.stdout:6/112: sync 2023-12-09T02:34:48.059 INFO:tasks.workunit.client.0.smithi088.stdout:6/113: rename d16/d1b to d16/d1b/d23 22 2023-12-09T02:34:48.059 INFO:tasks.workunit.client.0.smithi088.stdout:6/114: getdents d16/d1b 0 2023-12-09T02:34:48.060 INFO:tasks.workunit.client.0.smithi088.stdout:7/165: getdents dc/d1b/d32/d38/d1e 0 2023-12-09T02:34:48.060 INFO:tasks.workunit.client.0.smithi088.stdout:1/163: write d8/d1b/d1d/f2d [1680715,45338] 0 2023-12-09T02:34:48.061 INFO:tasks.workunit.client.0.smithi088.stdout:6/115: symlink d16/d1b/l24 0 2023-12-09T02:34:48.061 INFO:tasks.workunit.client.0.smithi088.stdout:6/116: chown d16/f1c 1 1 2023-12-09T02:34:48.061 INFO:tasks.workunit.client.0.smithi088.stdout:6/117: dread - d16/d1b/f1d zero size 2023-12-09T02:34:48.061 INFO:tasks.workunit.client.0.smithi088.stdout:6/118: write d16/d1b/f22 [822395,116516] 0 2023-12-09T02:34:48.064 INFO:tasks.workunit.client.0.smithi088.stdout:7/166: creat dc/d1b/d32/d38/d1e/f39 x:0 0 0 2023-12-09T02:34:48.064 INFO:tasks.workunit.client.0.smithi088.stdout:7/167: fsync dc/d1b/f2b 0 2023-12-09T02:34:48.064 INFO:tasks.workunit.client.0.smithi088.stdout:7/168: write dc/d1b/d32/d38/d1e/f39 [305145,70734] 0 2023-12-09T02:34:48.065 INFO:tasks.workunit.client.0.smithi088.stdout:7/169: stat dc/d1b 0 2023-12-09T02:34:48.065 INFO:tasks.workunit.client.0.smithi088.stdout:1/164: link d8/d1b/c26 d8/d27/c36 0 2023-12-09T02:34:48.066 INFO:tasks.workunit.client.0.smithi088.stdout:1/165: mknod d8/d1c/d31/c37 0 2023-12-09T02:34:48.066 INFO:tasks.workunit.client.0.smithi088.stdout:1/166: read f2 [3305854,113596] 0 2023-12-09T02:34:48.073 INFO:tasks.workunit.client.0.smithi088.stdout:3/105: dwrite d1/d9/f1b [0,4194304] 0 2023-12-09T02:34:48.073 INFO:tasks.workunit.client.0.smithi088.stdout:3/106: stat d1/d2/c1d 0 2023-12-09T02:34:48.078 INFO:tasks.workunit.client.0.smithi088.stdout:3/107: rename d1/d2/fe to d1/f25 0 2023-12-09T02:34:48.078 INFO:tasks.workunit.client.0.smithi088.stdout:3/108: chown d1/d9/c1e 95876169 1 2023-12-09T02:34:48.078 INFO:tasks.workunit.client.0.smithi088.stdout:1/167: write d8/d1b/d1d/f2d [2349476,114608] 0 2023-12-09T02:34:48.078 INFO:tasks.workunit.client.0.smithi088.stdout:3/109: rmdir d1/d12 39 2023-12-09T02:34:48.079 INFO:tasks.workunit.client.0.smithi088.stdout:1/168: creat d8/f38 x:0 0 0 2023-12-09T02:34:48.080 INFO:tasks.workunit.client.0.smithi088.stdout:3/110: creat d1/d19/f26 x:0 0 0 2023-12-09T02:34:48.081 INFO:tasks.workunit.client.0.smithi088.stdout:1/169: creat d8/d1c/d31/f39 x:0 0 0 2023-12-09T02:34:48.088 INFO:tasks.workunit.client.0.smithi088.stdout:6/119: dwrite f9 [0,4194304] 0 2023-12-09T02:34:48.089 INFO:tasks.workunit.client.0.smithi088.stdout:7/170: dwrite dc/f29 [0,4194304] 0 2023-12-09T02:34:48.091 INFO:tasks.workunit.client.0.smithi088.stdout:6/120: rmdir d16 39 2023-12-09T02:34:48.093 INFO:tasks.workunit.client.0.smithi088.stdout:6/121: write f15 [151482,82918] 0 2023-12-09T02:34:48.098 INFO:tasks.workunit.client.0.smithi088.stdout:1/170: dwrite d8/d1c/f28 [0,4194304] 0 2023-12-09T02:34:48.116 INFO:tasks.workunit.client.0.smithi088.stdout:7/171: write dc/d1b/d32/d38/d1e/f23 [619520,89514] 0 2023-12-09T02:34:48.116 INFO:tasks.workunit.client.0.smithi088.stdout:7/172: chown c3 474122 1 2023-12-09T02:34:48.151 INFO:tasks.workunit.client.0.smithi088.stdout:6/122: rmdir d16/d1b 39 2023-12-09T02:34:48.154 INFO:tasks.workunit.client.0.smithi088.stdout:1/171: symlink d8/d1b/l3a 0 2023-12-09T02:34:48.154 INFO:tasks.workunit.client.0.smithi088.stdout:1/172: dread - d8/d1b/d1d/f30 zero size 2023-12-09T02:34:48.157 INFO:tasks.workunit.client.0.smithi088.stdout:7/173: getdents dc 0 2023-12-09T02:34:48.159 INFO:tasks.workunit.client.0.smithi088.stdout:6/123: getdents d16 0 2023-12-09T02:34:48.159 INFO:tasks.workunit.client.0.smithi088.stdout:6/124: fdatasync d16/f21 0 2023-12-09T02:34:48.160 INFO:tasks.workunit.client.0.smithi088.stdout:6/125: dread d16/d1b/f1f [0,4194304] 0 2023-12-09T02:34:48.161 INFO:tasks.workunit.client.0.smithi088.stdout:1/173: creat d8/d1c/f3b x:0 0 0 2023-12-09T02:34:48.162 INFO:tasks.workunit.client.0.smithi088.stdout:7/174: symlink dc/d1b/d32/l3a 0 2023-12-09T02:34:48.164 INFO:tasks.workunit.client.0.smithi088.stdout:6/126: mkdir d16/d1b/d25 0 2023-12-09T02:34:48.166 INFO:tasks.workunit.client.0.smithi088.stdout:1/174: symlink d8/d1c/d31/l3c 0 2023-12-09T02:34:48.166 INFO:tasks.workunit.client.0.smithi088.stdout:1/175: chown d8/d1b/d1d/f2d 128029926 1 2023-12-09T02:34:48.168 INFO:tasks.workunit.client.0.smithi088.stdout:6/127: creat d16/d1b/f26 x:0 0 0 2023-12-09T02:34:48.169 INFO:tasks.workunit.client.0.smithi088.stdout:6/128: dread d16/d1b/f1f [0,4194304] 0 2023-12-09T02:34:48.172 INFO:tasks.workunit.client.0.smithi088.stdout:6/129: creat d16/d1b/d25/f27 x:0 0 0 2023-12-09T02:34:48.173 INFO:tasks.workunit.client.0.smithi088.stdout:6/130: creat d16/d1b/f28 x:0 0 0 2023-12-09T02:34:48.185 INFO:tasks.workunit.client.0.smithi088.stdout:1/176: dwrite f2 [0,4194304] 0 2023-12-09T02:34:48.187 INFO:tasks.workunit.client.0.smithi088.stdout:6/131: dwrite d16/d1b/f28 [0,4194304] 0 2023-12-09T02:34:48.187 INFO:tasks.workunit.client.0.smithi088.stdout:1/177: truncate d8/d1c/f29 3286143 0 2023-12-09T02:34:48.187 INFO:tasks.workunit.client.0.smithi088.stdout:1/178: dread - d8/d1c/f3b zero size 2023-12-09T02:34:48.192 INFO:tasks.workunit.client.0.smithi088.stdout:6/132: link d16/c18 d16/d1b/c29 0 2023-12-09T02:34:48.194 INFO:tasks.workunit.client.0.smithi088.stdout:1/179: unlink d8/fa 0 2023-12-09T02:34:48.195 INFO:tasks.workunit.client.0.smithi088.stdout:6/133: symlink d16/d1b/l2a 0 2023-12-09T02:34:48.197 INFO:tasks.workunit.client.0.smithi088.stdout:1/180: mkdir d8/d3d 0 2023-12-09T02:34:48.197 INFO:tasks.workunit.client.0.smithi088.stdout:1/181: truncate d8/f32 1419609 0 2023-12-09T02:34:48.198 INFO:tasks.workunit.client.0.smithi088.stdout:6/134: creat d16/f2b x:0 0 0 2023-12-09T02:34:48.201 INFO:tasks.workunit.client.0.smithi088.stdout:6/135: mkdir d16/d1b/d2c 0 2023-12-09T02:34:48.201 INFO:tasks.workunit.client.0.smithi088.stdout:6/136: stat d16/c1a 0 2023-12-09T02:34:48.204 INFO:tasks.workunit.client.0.smithi088.stdout:6/137: dread f11 [0,4194304] 0 2023-12-09T02:34:48.205 INFO:tasks.workunit.client.0.smithi088.stdout:6/138: creat d16/d1b/d2c/f2d x:0 0 0 2023-12-09T02:34:48.206 INFO:tasks.workunit.client.0.smithi088.stdout:6/139: symlink d16/d1b/d25/l2e 0 2023-12-09T02:34:48.206 INFO:tasks.workunit.client.0.smithi088.stdout:6/140: readlink lc 0 2023-12-09T02:34:48.206 INFO:tasks.workunit.client.0.smithi088.stdout:6/141: write d16/d1b/f1f [760435,17226] 0 2023-12-09T02:34:48.206 INFO:tasks.workunit.client.0.smithi088.stdout:6/142: fdatasync d16/d1b/d2c/f2d 0 2023-12-09T02:34:48.207 INFO:tasks.workunit.client.0.smithi088.stdout:6/143: write f12 [982104,121717] 0 2023-12-09T02:34:48.210 INFO:tasks.workunit.client.0.smithi088.stdout:6/144: rename d16/d1b/l2a to d16/d1b/d2c/l2f 0 2023-12-09T02:34:48.219 INFO:tasks.workunit.client.0.smithi088.stdout:6/145: dread d16/f21 [0,4194304] 0 2023-12-09T02:34:48.219 INFO:tasks.workunit.client.0.smithi088.stdout:6/146: stat d16/c1a 0 2023-12-09T02:34:48.220 INFO:tasks.workunit.client.0.smithi088.stdout:4/123: sync 2023-12-09T02:34:48.220 INFO:tasks.workunit.client.0.smithi088.stdout:9/109: sync 2023-12-09T02:34:48.220 INFO:tasks.workunit.client.0.smithi088.stdout:5/130: sync 2023-12-09T02:34:48.220 INFO:tasks.workunit.client.0.smithi088.stdout:2/131: sync 2023-12-09T02:34:48.220 INFO:tasks.workunit.client.0.smithi088.stdout:8/130: sync 2023-12-09T02:34:48.220 INFO:tasks.workunit.client.0.smithi088.stdout:4/124: chown d3/dc/d18 0 1 2023-12-09T02:34:48.220 INFO:tasks.workunit.client.0.smithi088.stdout:2/132: dread - d6/d13/f33 zero size 2023-12-09T02:34:48.220 INFO:tasks.workunit.client.0.smithi088.stdout:4/125: truncate d3/dc/f20 287681 0 2023-12-09T02:34:48.221 INFO:tasks.workunit.client.0.smithi088.stdout:8/131: write d2/d9/d13/d15/f26 [93507,99012] 0 2023-12-09T02:34:48.221 INFO:tasks.workunit.client.0.smithi088.stdout:9/110: rmdir df 39 2023-12-09T02:34:48.222 INFO:tasks.workunit.client.0.smithi088.stdout:5/131: symlink d3/d15/l2f 0 2023-12-09T02:34:48.223 INFO:tasks.workunit.client.0.smithi088.stdout:2/133: creat d6/d13/d18/f36 x:0 0 0 2023-12-09T02:34:48.223 INFO:tasks.workunit.client.0.smithi088.stdout:2/134: chown d6/d13/c14 0 1 2023-12-09T02:34:48.223 INFO:tasks.workunit.client.0.smithi088.stdout:2/135: stat d6/d13/d18 0 2023-12-09T02:34:48.223 INFO:tasks.workunit.client.0.smithi088.stdout:2/136: write d6/d8/d1f/d22/f2b [882186,22619] 0 2023-12-09T02:34:48.224 INFO:tasks.workunit.client.0.smithi088.stdout:5/132: dread d3/d15/dc/d11/f28 [0,4194304] 0 2023-12-09T02:34:48.224 INFO:tasks.workunit.client.0.smithi088.stdout:5/133: truncate d3/d15/de/d10/d18/d19/d1b/f1c 1507359 0 2023-12-09T02:34:48.224 INFO:tasks.workunit.client.0.smithi088.stdout:9/111: creat df/d19/f1f x:0 0 0 2023-12-09T02:34:48.226 INFO:tasks.workunit.client.0.smithi088.stdout:4/126: dread d3/dc/f14 [0,4194304] 0 2023-12-09T02:34:48.226 INFO:tasks.workunit.client.0.smithi088.stdout:2/137: symlink d6/d8/d1f/l37 0 2023-12-09T02:34:48.227 INFO:tasks.workunit.client.0.smithi088.stdout:8/132: link d2/l4 d2/d9/l31 0 2023-12-09T02:34:48.228 INFO:tasks.workunit.client.0.smithi088.stdout:5/134: mknod d3/d15/dc/c30 0 2023-12-09T02:34:48.229 INFO:tasks.workunit.client.0.smithi088.stdout:2/138: unlink d6/l35 0 2023-12-09T02:34:48.230 INFO:tasks.workunit.client.0.smithi088.stdout:2/139: write d6/d8/f30 [950579,106128] 0 2023-12-09T02:34:48.230 INFO:tasks.workunit.client.0.smithi088.stdout:2/140: stat d6/d8/d1f/d22/d29 0 2023-12-09T02:34:48.230 INFO:tasks.workunit.client.0.smithi088.stdout:4/127: rmdir d3/d1f 39 2023-12-09T02:34:48.231 INFO:tasks.workunit.client.0.smithi088.stdout:4/128: dread d3/d1f/f25 [0,4194304] 0 2023-12-09T02:34:48.232 INFO:tasks.workunit.client.0.smithi088.stdout:8/133: creat d2/d9/d13/d1c/f32 x:0 0 0 2023-12-09T02:34:48.232 INFO:tasks.workunit.client.0.smithi088.stdout:8/134: dread - d2/d9/d13/d1c/f20 zero size 2023-12-09T02:34:48.232 INFO:tasks.workunit.client.0.smithi088.stdout:8/135: read d2/fa [223622,22567] 0 2023-12-09T02:34:48.234 INFO:tasks.workunit.client.0.smithi088.stdout:5/135: symlink d3/d15/dc/d11/l31 0 2023-12-09T02:34:48.238 INFO:tasks.workunit.client.0.smithi088.stdout:8/136: dread d2/d9/d13/f2f [0,4194304] 0 2023-12-09T02:34:48.243 INFO:tasks.workunit.client.0.smithi088.stdout:2/141: unlink d6/d8/fe 0 2023-12-09T02:34:48.243 INFO:tasks.workunit.client.0.smithi088.stdout:2/142: chown d6/d13/d18/f28 17 1 2023-12-09T02:34:48.244 INFO:tasks.workunit.client.0.smithi088.stdout:4/129: getdents d3/dc/d18 0 2023-12-09T02:34:48.245 INFO:tasks.workunit.client.0.smithi088.stdout:5/136: creat d3/d15/de/d10/d18/d19/d1b/f32 x:0 0 0 2023-12-09T02:34:48.251 INFO:tasks.workunit.client.0.smithi088.stdout:8/137: dwrite d2/f8 [0,4194304] 0 2023-12-09T02:34:48.254 INFO:tasks.workunit.client.0.smithi088.stdout:8/138: creat d2/d9/d13/f33 x:0 0 0 2023-12-09T02:34:48.254 INFO:tasks.workunit.client.0.smithi088.stdout:2/143: dread d6/d8/f30 [0,4194304] 0 2023-12-09T02:34:48.254 INFO:tasks.workunit.client.0.smithi088.stdout:1/182: rmdir d8 39 2023-12-09T02:34:48.256 INFO:tasks.workunit.client.0.smithi088.stdout:8/139: symlink d2/d9/d13/d1c/l34 0 2023-12-09T02:34:48.257 INFO:tasks.workunit.client.0.smithi088.stdout:2/144: getdents d6/d20 0 2023-12-09T02:34:48.260 INFO:tasks.workunit.client.0.smithi088.stdout:4/130: dwrite d3/f6 [0,4194304] 0 2023-12-09T02:34:48.261 INFO:tasks.workunit.client.0.smithi088.stdout:4/131: read d3/f8 [1228704,44961] 0 2023-12-09T02:34:48.261 INFO:tasks.workunit.client.0.smithi088.stdout:4/132: write d3/dc/d18/f2c [268412,80398] 0 2023-12-09T02:34:48.262 INFO:tasks.workunit.client.0.smithi088.stdout:1/183: creat d8/f3e x:0 0 0 2023-12-09T02:34:48.264 INFO:tasks.workunit.client.0.smithi088.stdout:4/133: symlink d3/dc/d1d/l2e 0 2023-12-09T02:34:48.264 INFO:tasks.workunit.client.0.smithi088.stdout:4/134: read - d3/f17 zero size 2023-12-09T02:34:48.265 INFO:tasks.workunit.client.0.smithi088.stdout:1/184: truncate d8/d1b/f33 716320 0 2023-12-09T02:34:48.265 INFO:tasks.workunit.client.0.smithi088.stdout:1/185: fdatasync d8/d1b/f33 0 2023-12-09T02:34:48.266 INFO:tasks.workunit.client.0.smithi088.stdout:4/135: symlink d3/d1f/l2f 0 2023-12-09T02:34:48.270 INFO:tasks.workunit.client.0.smithi088.stdout:4/136: rename d3/dc/d1d/l2e to d3/dc/d18/l30 0 2023-12-09T02:34:48.274 INFO:tasks.workunit.client.0.smithi088.stdout:4/137: dread d3/d1f/f2b [0,4194304] 0 2023-12-09T02:34:48.274 INFO:tasks.workunit.client.0.smithi088.stdout:6/147: getdents d16/d1b 0 2023-12-09T02:34:48.275 INFO:tasks.workunit.client.0.smithi088.stdout:6/148: mknod d16/c30 0 2023-12-09T02:34:48.281 INFO:tasks.workunit.client.0.smithi088.stdout:8/140: dwrite d2/f3 [0,4194304] 0 2023-12-09T02:34:48.285 INFO:tasks.workunit.client.0.smithi088.stdout:2/145: dwrite d6/d13/f15 [4194304,4194304] 0 2023-12-09T02:34:48.285 INFO:tasks.workunit.client.0.smithi088.stdout:2/146: chown f0 43822 1 2023-12-09T02:34:48.286 INFO:tasks.workunit.client.0.smithi088.stdout:3/111: sync 2023-12-09T02:34:48.286 INFO:tasks.workunit.client.0.smithi088.stdout:0/152: sync 2023-12-09T02:34:48.286 INFO:tasks.workunit.client.0.smithi088.stdout:3/112: dread d1/d2/d6/ff [0,4194304] 0 2023-12-09T02:34:48.286 INFO:tasks.workunit.client.0.smithi088.stdout:3/113: stat d1/d2/d6/ff 0 2023-12-09T02:34:48.286 INFO:tasks.workunit.client.0.smithi088.stdout:5/137: rmdir d3/d15/de 39 2023-12-09T02:34:48.295 INFO:tasks.workunit.client.0.smithi088.stdout:1/186: rename d8/f32 to d8/d1c/d31/f3f 0 2023-12-09T02:34:48.295 INFO:tasks.workunit.client.0.smithi088.stdout:1/187: chown l0 43 1 2023-12-09T02:34:48.301 INFO:tasks.workunit.client.0.smithi088.stdout:4/138: getdents d3/dc/d1d 0 2023-12-09T02:34:48.301 INFO:tasks.workunit.client.0.smithi088.stdout:6/149: dwrite d16/f21 [0,4194304] 0 2023-12-09T02:34:48.301 INFO:tasks.workunit.client.0.smithi088.stdout:6/150: chown d16/d1b 180 1 2023-12-09T02:34:48.303 INFO:tasks.workunit.client.0.smithi088.stdout:8/141: rename d2/d9/d13/d1c/l34 to d2/d9/d1a/l35 0 2023-12-09T02:34:48.306 INFO:tasks.workunit.client.0.smithi088.stdout:4/139: unlink d3/dc/d18/f2c 0 2023-12-09T02:34:48.307 INFO:tasks.workunit.client.0.smithi088.stdout:6/151: truncate f14 866360 0 2023-12-09T02:34:48.307 INFO:tasks.workunit.client.0.smithi088.stdout:6/152: write d16/f1c [670518,65836] 0 2023-12-09T02:34:48.307 INFO:tasks.workunit.client.0.smithi088.stdout:6/153: write d16/d1b/d25/f27 [941651,29112] 0 2023-12-09T02:34:48.309 INFO:tasks.workunit.client.0.smithi088.stdout:8/142: rename d2/c14 to d2/d9/d13/d15/c36 0 2023-12-09T02:34:48.312 INFO:tasks.workunit.client.0.smithi088.stdout:2/147: truncate d6/d13/f15 177331 0 2023-12-09T02:34:48.313 INFO:tasks.workunit.client.0.smithi088.stdout:8/143: dread d2/d9/d13/d15/f26 [0,4194304] 0 2023-12-09T02:34:48.314 INFO:tasks.workunit.client.0.smithi088.stdout:8/144: chown d2/d9/d1a/f25 57303 1 2023-12-09T02:34:48.314 INFO:tasks.workunit.client.0.smithi088.stdout:8/145: rename d2 to d2/d9/d13/d15/d37 22 2023-12-09T02:34:48.314 INFO:tasks.workunit.client.0.smithi088.stdout:8/146: truncate d2/f24 1298700 0 2023-12-09T02:34:48.314 INFO:tasks.workunit.client.0.smithi088.stdout:2/148: creat d6/d8/d1f/d22/f38 x:0 0 0 2023-12-09T02:34:48.315 INFO:tasks.workunit.client.0.smithi088.stdout:8/147: symlink d2/d9/d13/d15/l38 0 2023-12-09T02:34:48.316 INFO:tasks.workunit.client.0.smithi088.stdout:8/148: mknod d2/d9/d13/d1c/c39 0 2023-12-09T02:34:48.317 INFO:tasks.workunit.client.0.smithi088.stdout:8/149: truncate d2/d9/d13/d15/f2d 584362 0 2023-12-09T02:34:48.317 INFO:tasks.workunit.client.0.smithi088.stdout:8/150: chown d2/d9/d13/d15/c36 19293 1 2023-12-09T02:34:48.317 INFO:tasks.workunit.client.0.smithi088.stdout:8/151: chown d2/d9/d13/d15/f18 1 1 2023-12-09T02:34:48.320 INFO:tasks.workunit.client.0.smithi088.stdout:6/154: write f9 [2707498,130637] 0 2023-12-09T02:34:48.321 INFO:tasks.workunit.client.0.smithi088.stdout:8/152: dread d2/f11 [0,4194304] 0 2023-12-09T02:34:48.322 INFO:tasks.workunit.client.0.smithi088.stdout:6/155: rename f6 to d16/f31 0 2023-12-09T02:34:48.323 INFO:tasks.workunit.client.0.smithi088.stdout:8/153: creat d2/d9/d13/d1c/f3a x:0 0 0 2023-12-09T02:34:48.323 INFO:tasks.workunit.client.0.smithi088.stdout:8/154: truncate d2/fa 983961 0 2023-12-09T02:34:48.324 INFO:tasks.workunit.client.0.smithi088.stdout:6/156: rename d16/d1b/f28 to d16/d1b/d25/f32 0 2023-12-09T02:34:48.324 INFO:tasks.workunit.client.0.smithi088.stdout:3/114: dwrite d1/d2/f13 [0,4194304] 0 2023-12-09T02:34:48.324 INFO:tasks.workunit.client.0.smithi088.stdout:3/115: chown d1/d9/c1e 143616909 1 2023-12-09T02:34:48.325 INFO:tasks.workunit.client.0.smithi088.stdout:1/188: dwrite d8/d1c/f29 [4194304,4194304] 0 2023-12-09T02:34:48.325 INFO:tasks.workunit.client.0.smithi088.stdout:8/155: mkdir d2/d9/d13/d1c/d3b 0 2023-12-09T02:34:48.326 INFO:tasks.workunit.client.0.smithi088.stdout:4/140: dwrite d3/dc/f10 [0,4194304] 0 2023-12-09T02:34:48.326 INFO:tasks.workunit.client.0.smithi088.stdout:0/153: dwrite f6 [4194304,4194304] 0 2023-12-09T02:34:48.326 INFO:tasks.workunit.client.0.smithi088.stdout:3/116: creat d1/d2/d15/f27 x:0 0 0 2023-12-09T02:34:48.327 INFO:tasks.workunit.client.0.smithi088.stdout:7/175: sync 2023-12-09T02:34:48.331 INFO:tasks.workunit.client.0.smithi088.stdout:8/156: creat d2/d9/f3c x:0 0 0 2023-12-09T02:34:48.332 INFO:tasks.workunit.client.0.smithi088.stdout:4/141: dread f1 [0,4194304] 0 2023-12-09T02:34:48.333 INFO:tasks.workunit.client.0.smithi088.stdout:0/154: write f6 [4295817,16506] 0 2023-12-09T02:34:48.338 INFO:tasks.workunit.client.0.smithi088.stdout:1/189: dread d8/d1c/f28 [0,4194304] 0 2023-12-09T02:34:48.338 INFO:tasks.workunit.client.0.smithi088.stdout:1/190: write d8/d1c/d31/f3f [2226221,9212] 0 2023-12-09T02:34:48.339 INFO:tasks.workunit.client.0.smithi088.stdout:3/117: mknod d1/d9/c28 0 2023-12-09T02:34:48.339 INFO:tasks.workunit.client.0.smithi088.stdout:9/112: sync 2023-12-09T02:34:48.339 INFO:tasks.workunit.client.0.smithi088.stdout:4/142: write d3/f8 [2738831,84684] 0 2023-12-09T02:34:48.340 INFO:tasks.workunit.client.0.smithi088.stdout:9/113: write fc [4159379,91396] 0 2023-12-09T02:34:48.340 INFO:tasks.workunit.client.0.smithi088.stdout:7/176: mknod dc/d1b/d32/d38/c3b 0 2023-12-09T02:34:48.342 INFO:tasks.workunit.client.0.smithi088.stdout:8/157: mknod d2/d9/d13/d1c/c3d 0 2023-12-09T02:34:48.342 INFO:tasks.workunit.client.0.smithi088.stdout:2/149: getdents d6/d8/d1f/d22 0 2023-12-09T02:34:48.343 INFO:tasks.workunit.client.0.smithi088.stdout:2/150: dread d6/fd [0,4194304] 0 2023-12-09T02:34:48.343 INFO:tasks.workunit.client.0.smithi088.stdout:2/151: fsync d6/d20/f23 0 2023-12-09T02:34:48.344 INFO:tasks.workunit.client.0.smithi088.stdout:2/152: fdatasync d6/d8/d1f/d22/f2b 0 2023-12-09T02:34:48.344 INFO:tasks.workunit.client.0.smithi088.stdout:0/155: symlink df/l32 0 2023-12-09T02:34:48.346 INFO:tasks.workunit.client.0.smithi088.stdout:3/118: mknod d1/d2/d24/c29 0 2023-12-09T02:34:48.346 INFO:tasks.workunit.client.0.smithi088.stdout:0/156: dread df/d10/d22/f27 [0,4194304] 0 2023-12-09T02:34:48.346 INFO:tasks.workunit.client.0.smithi088.stdout:0/157: write df/f25 [240068,58647] 0 2023-12-09T02:34:48.348 INFO:tasks.workunit.client.0.smithi088.stdout:4/143: rename d3/dc/c13 to d3/dc/c31 0 2023-12-09T02:34:48.350 INFO:tasks.workunit.client.0.smithi088.stdout:9/114: mkdir df/d20 0 2023-12-09T02:34:48.350 INFO:tasks.workunit.client.0.smithi088.stdout:6/157: dwrite f9 [0,4194304] 0 2023-12-09T02:34:48.352 INFO:tasks.workunit.client.0.smithi088.stdout:8/158: mknod d2/d9/d13/d15/c3e 0 2023-12-09T02:34:48.355 INFO:tasks.workunit.client.0.smithi088.stdout:3/119: rename d1/d9/dc/l17 to d1/d2/d24/l2a 0 2023-12-09T02:34:48.355 INFO:tasks.workunit.client.0.smithi088.stdout:3/120: chown d1/d2/d24 1127517 1 2023-12-09T02:34:48.355 INFO:tasks.workunit.client.0.smithi088.stdout:3/121: dread - d1/d2/d6/f11 zero size 2023-12-09T02:34:48.355 INFO:tasks.workunit.client.0.smithi088.stdout:9/115: dread df/d19/f16 [0,4194304] 0 2023-12-09T02:34:48.355 INFO:tasks.workunit.client.0.smithi088.stdout:0/158: mkdir df/d28/d33 0 2023-12-09T02:34:48.357 INFO:tasks.workunit.client.0.smithi088.stdout:7/177: dread dc/d1b/d32/d38/d1e/f33 [0,4194304] 0 2023-12-09T02:34:48.358 INFO:tasks.workunit.client.0.smithi088.stdout:8/159: symlink d2/d9/d1a/l3f 0 2023-12-09T02:34:48.359 INFO:tasks.workunit.client.0.smithi088.stdout:8/160: dread d2/d9/d1a/f1f [0,4194304] 0 2023-12-09T02:34:48.360 INFO:tasks.workunit.client.0.smithi088.stdout:8/161: dread d2/d9/d13/d15/f2d [0,4194304] 0 2023-12-09T02:34:48.360 INFO:tasks.workunit.client.0.smithi088.stdout:8/162: readlink d2/d9/d1a/l3f 0 2023-12-09T02:34:48.362 INFO:tasks.workunit.client.0.smithi088.stdout:3/122: rename d1/d19 to d1/d9/d2b 0 2023-12-09T02:34:48.362 INFO:tasks.workunit.client.0.smithi088.stdout:3/123: write d1/d2/d6/f11 [734325,88698] 0 2023-12-09T02:34:48.362 INFO:tasks.workunit.client.0.smithi088.stdout:9/116: mknod df/c21 0 2023-12-09T02:34:48.364 INFO:tasks.workunit.client.0.smithi088.stdout:8/163: dread d2/f11 [0,4194304] 0 2023-12-09T02:34:48.365 INFO:tasks.workunit.client.0.smithi088.stdout:8/164: dread d2/d9/d13/d15/f26 [0,4194304] 0 2023-12-09T02:34:48.365 INFO:tasks.workunit.client.0.smithi088.stdout:2/153: dwrite f4 [0,4194304] 0 2023-12-09T02:34:48.366 INFO:tasks.workunit.client.0.smithi088.stdout:2/154: fsync d6/d13/d18/f36 0 2023-12-09T02:34:48.366 INFO:tasks.workunit.client.0.smithi088.stdout:2/155: fsync d6/d8/f30 0 2023-12-09T02:34:48.367 INFO:tasks.workunit.client.0.smithi088.stdout:0/159: mkdir df/d28/d34 0 2023-12-09T02:34:48.367 INFO:tasks.workunit.client.0.smithi088.stdout:7/178: creat dc/d1b/d32/f3c x:0 0 0 2023-12-09T02:34:48.367 INFO:tasks.workunit.client.0.smithi088.stdout:6/158: dread d16/f21 [0,4194304] 0 2023-12-09T02:34:48.368 INFO:tasks.workunit.client.0.smithi088.stdout:9/117: mknod df/d19/c22 0 2023-12-09T02:34:48.368 INFO:tasks.workunit.client.0.smithi088.stdout:1/191: dwrite d8/f1a [0,4194304] 0 2023-12-09T02:34:48.375 INFO:tasks.workunit.client.0.smithi088.stdout:4/144: getdents d3/dc 0 2023-12-09T02:34:48.381 INFO:tasks.workunit.client.0.smithi088.stdout:2/156: dwrite f0 [0,4194304] 0 2023-12-09T02:34:48.382 INFO:tasks.workunit.client.0.smithi088.stdout:0/160: rename df/d10/l1a to df/d10/d22/d2d/d2e/l35 0 2023-12-09T02:34:48.382 INFO:tasks.workunit.client.0.smithi088.stdout:0/161: write df/d10/f1e [174341,53885] 0 2023-12-09T02:34:48.383 INFO:tasks.workunit.client.0.smithi088.stdout:7/179: mknod dc/d1b/d32/d38/c3d 0 2023-12-09T02:34:48.383 INFO:tasks.workunit.client.0.smithi088.stdout:7/180: readlink dc/d1b/l26 0 2023-12-09T02:34:48.385 INFO:tasks.workunit.client.0.smithi088.stdout:7/181: dread dc/d1b/d32/d38/d1e/f39 [0,4194304] 0 2023-12-09T02:34:48.385 INFO:tasks.workunit.client.0.smithi088.stdout:7/182: fsync dc/d1b/d32/f34 0 2023-12-09T02:34:48.385 INFO:tasks.workunit.client.0.smithi088.stdout:6/159: symlink d16/l33 0 2023-12-09T02:34:48.385 INFO:tasks.workunit.client.0.smithi088.stdout:6/160: chown f12 0 1 2023-12-09T02:34:48.385 INFO:tasks.workunit.client.0.smithi088.stdout:7/183: dread dc/f18 [0,4194304] 0 2023-12-09T02:34:48.386 INFO:tasks.workunit.client.0.smithi088.stdout:9/118: creat df/d19/f23 x:0 0 0 2023-12-09T02:34:48.386 INFO:tasks.workunit.client.0.smithi088.stdout:1/192: chown d8/f15 226790 1 2023-12-09T02:34:48.386 INFO:tasks.workunit.client.0.smithi088.stdout:7/184: read dc/d1b/d32/d38/ff [3401528,131054] 0 2023-12-09T02:34:48.387 INFO:tasks.workunit.client.0.smithi088.stdout:6/161: dread f15 [0,4194304] 0 2023-12-09T02:34:48.388 INFO:tasks.workunit.client.0.smithi088.stdout:4/145: mknod d3/dc/d1d/c32 0 2023-12-09T02:34:48.390 INFO:tasks.workunit.client.0.smithi088.stdout:6/162: write fa [638692,130749] 0 2023-12-09T02:34:48.390 INFO:tasks.workunit.client.0.smithi088.stdout:2/157: creat d6/f39 x:0 0 0 2023-12-09T02:34:48.392 INFO:tasks.workunit.client.0.smithi088.stdout:9/119: link l9 df/l24 0 2023-12-09T02:34:48.394 INFO:tasks.workunit.client.0.smithi088.stdout:7/185: mkdir dc/d1b/d32/d3e 0 2023-12-09T02:34:48.394 INFO:tasks.workunit.client.0.smithi088.stdout:4/146: creat d3/dc/d18/f33 x:0 0 0 2023-12-09T02:34:48.395 INFO:tasks.workunit.client.0.smithi088.stdout:4/147: fdatasync d3/f8 0 2023-12-09T02:34:48.395 INFO:tasks.workunit.client.0.smithi088.stdout:6/163: rmdir d16/d1b 39 2023-12-09T02:34:48.396 INFO:tasks.workunit.client.0.smithi088.stdout:2/158: mkdir d6/d20/d3a 0 2023-12-09T02:34:48.397 INFO:tasks.workunit.client.0.smithi088.stdout:9/120: symlink df/l25 0 2023-12-09T02:34:48.400 INFO:tasks.workunit.client.0.smithi088.stdout:0/162: dwrite df/d10/f29 [0,4194304] 0 2023-12-09T02:34:48.402 INFO:tasks.workunit.client.0.smithi088.stdout:4/148: mknod d3/dc/d18/d29/c34 0 2023-12-09T02:34:48.402 INFO:tasks.workunit.client.0.smithi088.stdout:5/138: sync 2023-12-09T02:34:48.404 INFO:tasks.workunit.client.0.smithi088.stdout:2/159: creat d6/d8/d1f/f3b x:0 0 0 2023-12-09T02:34:48.404 INFO:tasks.workunit.client.0.smithi088.stdout:9/121: truncate df/d19/f12 652259 0 2023-12-09T02:34:48.408 INFO:tasks.workunit.client.0.smithi088.stdout:4/149: mknod d3/dc/d18/d29/c35 0 2023-12-09T02:34:48.408 INFO:tasks.workunit.client.0.smithi088.stdout:4/150: fdatasync d3/f17 0 2023-12-09T02:34:48.409 INFO:tasks.workunit.client.0.smithi088.stdout:5/139: symlink d3/d15/de/d10/d18/d19/d20/l33 0 2023-12-09T02:34:48.409 INFO:tasks.workunit.client.0.smithi088.stdout:5/140: write d3/d15/de/d10/d18/d19/d20/f27 [963897,111173] 0 2023-12-09T02:34:48.410 INFO:tasks.workunit.client.0.smithi088.stdout:6/164: getdents d16/d1b 0 2023-12-09T02:34:48.410 INFO:tasks.workunit.client.0.smithi088.stdout:6/165: chown l13 4 1 2023-12-09T02:34:48.410 INFO:tasks.workunit.client.0.smithi088.stdout:6/166: chown f15 836 1 2023-12-09T02:34:48.410 INFO:tasks.workunit.client.0.smithi088.stdout:6/167: dread - d16/f2b zero size 2023-12-09T02:34:48.410 INFO:tasks.workunit.client.0.smithi088.stdout:2/160: mkdir d6/d8/d1f/d22/d29/d3c 0 2023-12-09T02:34:48.411 INFO:tasks.workunit.client.0.smithi088.stdout:9/122: creat df/d19/f26 x:0 0 0 2023-12-09T02:34:48.411 INFO:tasks.workunit.client.0.smithi088.stdout:6/168: dread d16/d1b/f1f [0,4194304] 0 2023-12-09T02:34:48.412 INFO:tasks.workunit.client.0.smithi088.stdout:4/151: read d3/dc/f11 [631,17434] 0 2023-12-09T02:34:48.412 INFO:tasks.workunit.client.0.smithi088.stdout:5/141: unlink d3/d15/l29 0 2023-12-09T02:34:48.414 INFO:tasks.workunit.client.0.smithi088.stdout:2/161: mkdir d6/d20/d3d 0 2023-12-09T02:34:48.414 INFO:tasks.workunit.client.0.smithi088.stdout:2/162: write d6/d13/d18/f36 [827251,84524] 0 2023-12-09T02:34:48.415 INFO:tasks.workunit.client.0.smithi088.stdout:4/152: rename d3/f2d to d3/dc/d1d/f36 0 2023-12-09T02:34:48.415 INFO:tasks.workunit.client.0.smithi088.stdout:4/153: stat d3/dc/d18/c23 0 2023-12-09T02:34:48.415 INFO:tasks.workunit.client.0.smithi088.stdout:4/154: chown d3/f17 10394 1 2023-12-09T02:34:48.415 INFO:tasks.workunit.client.0.smithi088.stdout:4/155: chown d3/f17 2487 1 2023-12-09T02:34:48.415 INFO:tasks.workunit.client.0.smithi088.stdout:5/142: truncate d3/d15/de/f17 117639 0 2023-12-09T02:34:48.416 INFO:tasks.workunit.client.0.smithi088.stdout:2/163: creat d6/d20/f3e x:0 0 0 2023-12-09T02:34:48.416 INFO:tasks.workunit.client.0.smithi088.stdout:4/156: getdents d3/d1f 0 2023-12-09T02:34:48.417 INFO:tasks.workunit.client.0.smithi088.stdout:4/157: mkdir d3/d1f/d37 0 2023-12-09T02:34:48.418 INFO:tasks.workunit.client.0.smithi088.stdout:4/158: truncate d3/f16 529291 0 2023-12-09T02:34:48.419 INFO:tasks.workunit.client.0.smithi088.stdout:1/193: dwrite d8/fb [4194304,4194304] 0 2023-12-09T02:34:48.420 INFO:tasks.workunit.client.0.smithi088.stdout:0/163: dwrite df/d10/f15 [0,4194304] 0 2023-12-09T02:34:48.420 INFO:tasks.workunit.client.0.smithi088.stdout:0/164: fdatasync df/d10/f31 0 2023-12-09T02:34:48.420 INFO:tasks.workunit.client.0.smithi088.stdout:2/164: write d6/d8/f1a [1648231,112272] 0 2023-12-09T02:34:48.422 INFO:tasks.workunit.client.0.smithi088.stdout:7/186: rmdir dc/d1b/d32 39 2023-12-09T02:34:48.422 INFO:tasks.workunit.client.0.smithi088.stdout:7/187: write dc/f29 [4955361,123940] 0 2023-12-09T02:34:48.428 INFO:tasks.workunit.client.0.smithi088.stdout:9/123: dread f7 [4194304,4194304] 0 2023-12-09T02:34:48.430 INFO:tasks.workunit.client.0.smithi088.stdout:0/165: truncate df/f21 2578946 0 2023-12-09T02:34:48.431 INFO:tasks.workunit.client.0.smithi088.stdout:2/165: getdents d6/d8/d1f 0 2023-12-09T02:34:48.435 INFO:tasks.workunit.client.0.smithi088.stdout:7/188: mknod dc/d1b/d32/d3e/c3f 0 2023-12-09T02:34:48.435 INFO:tasks.workunit.client.0.smithi088.stdout:7/189: chown dc/f29 507102 1 2023-12-09T02:34:48.435 INFO:tasks.workunit.client.0.smithi088.stdout:7/190: chown dc/d1b/d32/d38/c12 4923415 1 2023-12-09T02:34:48.435 INFO:tasks.workunit.client.0.smithi088.stdout:7/191: read - dc/d1b/d32/f3c zero size 2023-12-09T02:34:48.435 INFO:tasks.workunit.client.0.smithi088.stdout:7/192: fsync dc/d1b/d32/d38/d1e/f39 0 2023-12-09T02:34:48.436 INFO:tasks.workunit.client.0.smithi088.stdout:1/194: mkdir d8/d27/d40 0 2023-12-09T02:34:48.437 INFO:tasks.workunit.client.0.smithi088.stdout:9/124: stat ce 0 2023-12-09T02:34:48.439 INFO:tasks.workunit.client.0.smithi088.stdout:2/166: dread f4 [0,4194304] 0 2023-12-09T02:34:48.440 INFO:tasks.workunit.client.0.smithi088.stdout:1/195: creat d8/d1b/f41 x:0 0 0 2023-12-09T02:34:48.440 INFO:tasks.workunit.client.0.smithi088.stdout:9/125: mknod df/d20/c27 0 2023-12-09T02:34:48.441 INFO:tasks.workunit.client.0.smithi088.stdout:4/159: getdents d3/d1f 0 2023-12-09T02:34:48.446 INFO:tasks.workunit.client.0.smithi088.stdout:0/166: dwrite f4 [0,4194304] 0 2023-12-09T02:34:48.446 INFO:tasks.workunit.client.0.smithi088.stdout:4/160: dread d3/dc/f1a [0,4194304] 0 2023-12-09T02:34:48.447 INFO:tasks.workunit.client.0.smithi088.stdout:2/167: rename d6/d8/d1f/l26 to d6/d13/d18/l3f 0 2023-12-09T02:34:48.447 INFO:tasks.workunit.client.0.smithi088.stdout:1/196: mknod d8/d1c/d31/c42 0 2023-12-09T02:34:48.448 INFO:tasks.workunit.client.0.smithi088.stdout:1/197: write d8/d1b/f2e [801821,63396] 0 2023-12-09T02:34:48.448 INFO:tasks.workunit.client.0.smithi088.stdout:2/168: write d6/d8/d1f/d22/f2c [874998,122428] 0 2023-12-09T02:34:48.448 INFO:tasks.workunit.client.0.smithi088.stdout:9/126: symlink df/d19/l28 0 2023-12-09T02:34:48.450 INFO:tasks.workunit.client.0.smithi088.stdout:7/193: dread dc/f15 [0,4194304] 0 2023-12-09T02:34:48.450 INFO:tasks.workunit.client.0.smithi088.stdout:0/167: rmdir df/d10/d22/d2d 39 2023-12-09T02:34:48.451 INFO:tasks.workunit.client.0.smithi088.stdout:4/161: rename d3/f22 to d3/dc/d18/d29/f38 0 2023-12-09T02:34:48.453 INFO:tasks.workunit.client.0.smithi088.stdout:1/198: symlink d8/d1b/l43 0 2023-12-09T02:34:48.453 INFO:tasks.workunit.client.0.smithi088.stdout:8/165: sync 2023-12-09T02:34:48.453 INFO:tasks.workunit.client.0.smithi088.stdout:3/124: sync 2023-12-09T02:34:48.454 INFO:tasks.workunit.client.0.smithi088.stdout:2/169: link d6/d8/f1a d6/d8/d1f/d22/f40 0 2023-12-09T02:34:48.456 INFO:tasks.workunit.client.0.smithi088.stdout:9/127: mkdir df/d29 0 2023-12-09T02:34:48.457 INFO:tasks.workunit.client.0.smithi088.stdout:5/143: dwrite d3/d15/de/f17 [0,4194304] 0 2023-12-09T02:34:48.458 INFO:tasks.workunit.client.0.smithi088.stdout:7/194: mknod dc/d1b/d32/d38/c40 0 2023-12-09T02:34:48.464 INFO:tasks.workunit.client.0.smithi088.stdout:5/144: dread d3/d15/de/f26 [0,4194304] 0 2023-12-09T02:34:48.464 INFO:tasks.workunit.client.0.smithi088.stdout:8/166: symlink d2/l40 0 2023-12-09T02:34:48.464 INFO:tasks.workunit.client.0.smithi088.stdout:3/125: creat d1/d2/d15/f2c x:0 0 0 2023-12-09T02:34:48.464 INFO:tasks.workunit.client.0.smithi088.stdout:3/126: chown d1/d2/d6 0 1 2023-12-09T02:34:48.464 INFO:tasks.workunit.client.0.smithi088.stdout:3/127: fdatasync d1/d2/f13 0 2023-12-09T02:34:48.465 INFO:tasks.workunit.client.0.smithi088.stdout:7/195: write dc/d1b/f2b [311550,102839] 0 2023-12-09T02:34:48.465 INFO:tasks.workunit.client.0.smithi088.stdout:7/196: chown dc/d1b/d32/d3e/c3f 18 1 2023-12-09T02:34:48.467 INFO:tasks.workunit.client.0.smithi088.stdout:2/170: symlink d6/d20/d3a/l41 0 2023-12-09T02:34:48.470 INFO:tasks.workunit.client.0.smithi088.stdout:7/197: write dc/f29 [1126453,31687] 0 2023-12-09T02:34:48.471 INFO:tasks.workunit.client.0.smithi088.stdout:1/199: mkdir d8/d3d/d44 0 2023-12-09T02:34:48.473 INFO:tasks.workunit.client.0.smithi088.stdout:8/167: creat d2/f41 x:0 0 0 2023-12-09T02:34:48.474 INFO:tasks.workunit.client.0.smithi088.stdout:3/128: mkdir d1/d2/d2d 0 2023-12-09T02:34:48.475 INFO:tasks.workunit.client.0.smithi088.stdout:2/171: mkdir d6/d13/d42 0 2023-12-09T02:34:48.475 INFO:tasks.workunit.client.0.smithi088.stdout:2/172: fsync d6/d20/f23 0 2023-12-09T02:34:48.476 INFO:tasks.workunit.client.0.smithi088.stdout:1/200: write f2 [77558,101810] 0 2023-12-09T02:34:48.477 INFO:tasks.workunit.client.0.smithi088.stdout:9/128: dwrite fc [0,4194304] 0 2023-12-09T02:34:48.478 INFO:tasks.workunit.client.0.smithi088.stdout:7/198: rename dc/d21/l2e to dc/d1b/d32/d38/l41 0 2023-12-09T02:34:48.481 INFO:tasks.workunit.client.0.smithi088.stdout:4/162: dwrite d3/d1f/f2b [0,4194304] 0 2023-12-09T02:34:48.481 INFO:tasks.workunit.client.0.smithi088.stdout:3/129: creat d1/d2/d24/f2e x:0 0 0 2023-12-09T02:34:48.481 INFO:tasks.workunit.client.0.smithi088.stdout:3/130: write d1/d2/d15/f27 [774979,4654] 0 2023-12-09T02:34:48.482 INFO:tasks.workunit.client.0.smithi088.stdout:0/168: dwrite df/d10/f15 [0,4194304] 0 2023-12-09T02:34:48.485 INFO:tasks.workunit.client.0.smithi088.stdout:1/201: unlink d8/d27/c36 0 2023-12-09T02:34:48.485 INFO:tasks.workunit.client.0.smithi088.stdout:1/202: truncate f4 49368 0 2023-12-09T02:34:48.490 INFO:tasks.workunit.client.0.smithi088.stdout:9/129: creat df/d19/f2a x:0 0 0 2023-12-09T02:34:48.490 INFO:tasks.workunit.client.0.smithi088.stdout:9/130: readlink lb 0 2023-12-09T02:34:48.490 INFO:tasks.workunit.client.0.smithi088.stdout:9/131: read df/f14 [597936,93504] 0 2023-12-09T02:34:48.490 INFO:tasks.workunit.client.0.smithi088.stdout:7/199: truncate f2 4826435 0 2023-12-09T02:34:48.491 INFO:tasks.workunit.client.0.smithi088.stdout:4/163: creat d3/f39 x:0 0 0 2023-12-09T02:34:48.492 INFO:tasks.workunit.client.0.smithi088.stdout:3/131: creat d1/d2/f2f x:0 0 0 2023-12-09T02:34:48.493 INFO:tasks.workunit.client.0.smithi088.stdout:3/132: dread - d1/d2/d24/f2e zero size 2023-12-09T02:34:48.493 INFO:tasks.workunit.client.0.smithi088.stdout:3/133: write d1/d2/d24/f2e [340557,30912] 0 2023-12-09T02:34:48.496 INFO:tasks.workunit.client.0.smithi088.stdout:0/169: creat df/d10/f36 x:0 0 0 2023-12-09T02:34:48.496 INFO:tasks.workunit.client.0.smithi088.stdout:1/203: symlink d8/d1b/d1d/l45 0 2023-12-09T02:34:48.497 INFO:tasks.workunit.client.0.smithi088.stdout:9/132: mknod df/c2b 0 2023-12-09T02:34:48.497 INFO:tasks.workunit.client.0.smithi088.stdout:7/200: rmdir dc/d1b/d32/d38 39 2023-12-09T02:34:48.498 INFO:tasks.workunit.client.0.smithi088.stdout:0/170: dread fe [0,4194304] 0 2023-12-09T02:34:48.499 INFO:tasks.workunit.client.0.smithi088.stdout:8/168: dwrite d2/d9/d13/f33 [0,4194304] 0 2023-12-09T02:34:48.499 INFO:tasks.workunit.client.0.smithi088.stdout:8/169: read - d2/f28 zero size 2023-12-09T02:34:48.500 INFO:tasks.workunit.client.0.smithi088.stdout:2/173: dwrite d6/d8/d1f/f3b [0,4194304] 0 2023-12-09T02:34:48.500 INFO:tasks.workunit.client.0.smithi088.stdout:2/174: fsync d6/f12 0 2023-12-09T02:34:48.500 INFO:tasks.workunit.client.0.smithi088.stdout:7/201: write dc/d1b/d32/d38/f17 [197798,70100] 0 2023-12-09T02:34:48.501 INFO:tasks.workunit.client.0.smithi088.stdout:3/134: unlink d1/d9/d2b/f26 0 2023-12-09T02:34:48.501 INFO:tasks.workunit.client.0.smithi088.stdout:4/164: creat d3/d1f/f3a x:0 0 0 2023-12-09T02:34:48.502 INFO:tasks.workunit.client.0.smithi088.stdout:1/204: truncate d8/d1b/f33 31348 0 2023-12-09T02:34:48.504 INFO:tasks.workunit.client.0.smithi088.stdout:9/133: creat df/f2c x:0 0 0 2023-12-09T02:34:48.512 INFO:tasks.workunit.client.0.smithi088.stdout:3/135: mknod d1/d9/c30 0 2023-12-09T02:34:48.514 INFO:tasks.workunit.client.0.smithi088.stdout:4/165: creat d3/dc/d18/d29/f3b x:0 0 0 2023-12-09T02:34:48.514 INFO:tasks.workunit.client.0.smithi088.stdout:4/166: dread - d3/dc/f12 zero size 2023-12-09T02:34:48.516 INFO:tasks.workunit.client.0.smithi088.stdout:1/205: rename d8/d1b/l3a to d8/d27/l46 0 2023-12-09T02:34:48.517 INFO:tasks.workunit.client.0.smithi088.stdout:9/134: creat df/d29/f2d x:0 0 0 2023-12-09T02:34:48.519 INFO:tasks.workunit.client.0.smithi088.stdout:7/202: symlink dc/d1b/d32/d38/d1e/l42 0 2023-12-09T02:34:48.519 INFO:tasks.workunit.client.0.smithi088.stdout:7/203: stat dc/d1b/d32/d38/c2f 0 2023-12-09T02:34:48.519 INFO:tasks.workunit.client.0.smithi088.stdout:7/204: fdatasync dc/d1b/d32/d38/d1e/f39 0 2023-12-09T02:34:48.519 INFO:tasks.workunit.client.0.smithi088.stdout:4/167: mkdir d3/dc/d1d/d3c 0 2023-12-09T02:34:48.520 INFO:tasks.workunit.client.0.smithi088.stdout:4/168: truncate d3/d1f/f3a 794068 0 2023-12-09T02:34:48.520 INFO:tasks.workunit.client.0.smithi088.stdout:1/206: mknod d8/d3d/c47 0 2023-12-09T02:34:48.522 INFO:tasks.workunit.client.0.smithi088.stdout:9/135: mknod df/d19/c2e 0 2023-12-09T02:34:48.522 INFO:tasks.workunit.client.0.smithi088.stdout:7/205: truncate dc/d1b/d32/d38/f1d 1123215 0 2023-12-09T02:34:48.522 INFO:tasks.workunit.client.0.smithi088.stdout:6/169: sync 2023-12-09T02:34:48.524 INFO:tasks.workunit.client.0.smithi088.stdout:2/175: dwrite f0 [0,4194304] 0 2023-12-09T02:34:48.525 INFO:tasks.workunit.client.0.smithi088.stdout:4/169: unlink d3/f8 0 2023-12-09T02:34:48.525 INFO:tasks.workunit.client.0.smithi088.stdout:8/170: dwrite d2/d9/f3c [0,4194304] 0 2023-12-09T02:34:48.525 INFO:tasks.workunit.client.0.smithi088.stdout:7/206: dread dc/f15 [0,4194304] 0 2023-12-09T02:34:48.525 INFO:tasks.workunit.client.0.smithi088.stdout:7/207: readlink dc/d1b/d32/d38/l37 0 2023-12-09T02:34:48.526 INFO:tasks.workunit.client.0.smithi088.stdout:7/208: read dc/d1b/d32/d38/ff [3187549,56647] 0 2023-12-09T02:34:48.526 INFO:tasks.workunit.client.0.smithi088.stdout:9/136: unlink ca 0 2023-12-09T02:34:48.526 INFO:tasks.workunit.client.0.smithi088.stdout:9/137: chown df/f1c 9905083 1 2023-12-09T02:34:48.527 INFO:tasks.workunit.client.0.smithi088.stdout:6/170: rmdir d16/d1b 39 2023-12-09T02:34:48.527 INFO:tasks.workunit.client.0.smithi088.stdout:2/176: creat d6/d20/f43 x:0 0 0 2023-12-09T02:34:48.527 INFO:tasks.workunit.client.0.smithi088.stdout:8/171: dread d2/d9/d1a/f25 [0,4194304] 0 2023-12-09T02:34:48.527 INFO:tasks.workunit.client.0.smithi088.stdout:2/177: fdatasync d6/d8/f30 0 2023-12-09T02:34:48.533 INFO:tasks.workunit.client.0.smithi088.stdout:4/170: unlink d3/f17 0 2023-12-09T02:34:48.535 INFO:tasks.workunit.client.0.smithi088.stdout:9/138: mkdir df/d29/d2f 0 2023-12-09T02:34:48.535 INFO:tasks.workunit.client.0.smithi088.stdout:9/139: truncate df/f2c 178696 0 2023-12-09T02:34:48.536 INFO:tasks.workunit.client.0.smithi088.stdout:6/171: truncate f9 2514470 0 2023-12-09T02:34:48.536 INFO:tasks.workunit.client.0.smithi088.stdout:6/172: write d16/d1b/f22 [1151487,118862] 0 2023-12-09T02:34:48.538 INFO:tasks.workunit.client.0.smithi088.stdout:8/172: link d2/c6 d2/d9/d1a/c42 0 2023-12-09T02:34:48.540 INFO:tasks.workunit.client.0.smithi088.stdout:2/178: mknod d6/d20/c44 0 2023-12-09T02:34:48.540 INFO:tasks.workunit.client.0.smithi088.stdout:7/209: dwrite fb [0,4194304] 0 2023-12-09T02:34:48.540 INFO:tasks.workunit.client.0.smithi088.stdout:7/210: truncate dc/d1b/d32/f3c 710299 0 2023-12-09T02:34:48.544 INFO:tasks.workunit.client.0.smithi088.stdout:9/140: mkdir df/d20/d30 0 2023-12-09T02:34:48.545 INFO:tasks.workunit.client.0.smithi088.stdout:4/171: dread f2 [0,4194304] 0 2023-12-09T02:34:48.547 INFO:tasks.workunit.client.0.smithi088.stdout:6/173: rename c2 to d16/d1b/d25/c34 0 2023-12-09T02:34:48.548 INFO:tasks.workunit.client.0.smithi088.stdout:8/173: unlink d2/d9/d13/d15/f2c 0 2023-12-09T02:34:48.549 INFO:tasks.workunit.client.0.smithi088.stdout:1/207: dwrite d8/d1b/f33 [0,4194304] 0 2023-12-09T02:34:48.552 INFO:tasks.workunit.client.0.smithi088.stdout:2/179: read d6/d8/f10 [1572946,90879] 0 2023-12-09T02:34:48.552 INFO:tasks.workunit.client.0.smithi088.stdout:2/180: chown d6/d20 4 1 2023-12-09T02:34:48.552 INFO:tasks.workunit.client.0.smithi088.stdout:2/181: chown d6/d8/d1f/d22/f2b 890 1 2023-12-09T02:34:48.552 INFO:tasks.workunit.client.0.smithi088.stdout:7/211: dread dc/d1b/d32/d38/ff [0,4194304] 0 2023-12-09T02:34:48.553 INFO:tasks.workunit.client.0.smithi088.stdout:4/172: unlink d3/dc/d18/f33 0 2023-12-09T02:34:48.554 INFO:tasks.workunit.client.0.smithi088.stdout:6/174: rmdir d16/d1b/d2c 39 2023-12-09T02:34:48.555 INFO:tasks.workunit.client.0.smithi088.stdout:8/174: getdents d2/d9/d13/d1c 0 2023-12-09T02:34:48.556 INFO:tasks.workunit.client.0.smithi088.stdout:8/175: write d2/d9/d13/f19 [1257660,63447] 0 2023-12-09T02:34:48.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/141: dwrite df/f1a [0,4194304] 0 2023-12-09T02:34:48.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/142: dread - df/d19/f26 zero size 2023-12-09T02:34:48.562 INFO:tasks.workunit.client.0.smithi088.stdout:1/208: rmdir d8/d27 39 2023-12-09T02:34:48.563 INFO:tasks.workunit.client.0.smithi088.stdout:2/182: symlink d6/d8/d1f/d22/l45 0 2023-12-09T02:34:48.563 INFO:tasks.workunit.client.0.smithi088.stdout:2/183: read - d6/d20/f43 zero size 2023-12-09T02:34:48.564 INFO:tasks.workunit.client.0.smithi088.stdout:7/212: creat dc/f43 x:0 0 0 2023-12-09T02:34:48.565 INFO:tasks.workunit.client.0.smithi088.stdout:4/173: creat d3/dc/d18/d29/f3d x:0 0 0 2023-12-09T02:34:48.565 INFO:tasks.workunit.client.0.smithi088.stdout:4/174: chown d3/dc/d1d/l1e 602695576 1 2023-12-09T02:34:48.566 INFO:tasks.workunit.client.0.smithi088.stdout:6/175: mkdir d16/d35 0 2023-12-09T02:34:48.566 INFO:tasks.workunit.client.0.smithi088.stdout:8/176: rmdir d2/d9/d1a 39 2023-12-09T02:34:48.570 INFO:tasks.workunit.client.0.smithi088.stdout:9/143: rmdir df/d29 39 2023-12-09T02:34:48.570 INFO:tasks.workunit.client.0.smithi088.stdout:9/144: chown df/d19/l1d 14468 1 2023-12-09T02:34:48.570 INFO:tasks.workunit.client.0.smithi088.stdout:9/145: read fc [2266252,103612] 0 2023-12-09T02:34:48.570 INFO:tasks.workunit.client.0.smithi088.stdout:9/146: rename df/d29/d2f to df/d29/d2f/d31 22 2023-12-09T02:34:48.571 INFO:tasks.workunit.client.0.smithi088.stdout:9/147: chown df/f14 1579414 1 2023-12-09T02:34:48.571 INFO:tasks.workunit.client.0.smithi088.stdout:9/148: chown df/d19/c2e 2926093 1 2023-12-09T02:34:48.574 INFO:tasks.workunit.client.0.smithi088.stdout:1/209: symlink d8/d27/d40/l48 0 2023-12-09T02:34:48.574 INFO:tasks.workunit.client.0.smithi088.stdout:2/184: creat d6/d8/f46 x:0 0 0 2023-12-09T02:34:48.575 INFO:tasks.workunit.client.0.smithi088.stdout:2/185: write d6/d8/d1f/d22/f2c [685953,111578] 0 2023-12-09T02:34:48.576 INFO:tasks.workunit.client.0.smithi088.stdout:7/213: creat dc/d1b/d32/d38/f44 x:0 0 0 2023-12-09T02:34:48.577 INFO:tasks.workunit.client.0.smithi088.stdout:4/175: symlink d3/l3e 0 2023-12-09T02:34:48.577 INFO:tasks.workunit.client.0.smithi088.stdout:4/176: chown d3/dc/d18 16492 1 2023-12-09T02:34:48.578 INFO:tasks.workunit.client.0.smithi088.stdout:4/177: chown d3/ca 175 1 2023-12-09T02:34:48.579 INFO:tasks.workunit.client.0.smithi088.stdout:6/176: mkdir d16/d35/d36 0 2023-12-09T02:34:48.580 INFO:tasks.workunit.client.0.smithi088.stdout:8/177: mknod d2/d2b/c43 0 2023-12-09T02:34:48.580 INFO:tasks.workunit.client.0.smithi088.stdout:8/178: readlink d2/l40 0 2023-12-09T02:34:48.582 INFO:tasks.workunit.client.0.smithi088.stdout:1/210: mkdir d8/d3d/d44/d49 0 2023-12-09T02:34:48.584 INFO:tasks.workunit.client.0.smithi088.stdout:9/149: dwrite f7 [8388608,4194304] 0 2023-12-09T02:34:48.584 INFO:tasks.workunit.client.0.smithi088.stdout:1/211: write d8/d1c/d31/f3f [1098024,103624] 0 2023-12-09T02:34:48.584 INFO:tasks.workunit.client.0.smithi088.stdout:1/212: fdatasync d8/f15 0 2023-12-09T02:34:48.586 INFO:tasks.workunit.client.0.smithi088.stdout:7/214: rename dc/d1b/d32/d38/d1e/f33 to dc/d21/f45 0 2023-12-09T02:34:48.586 INFO:tasks.workunit.client.0.smithi088.stdout:9/150: rename df/d29 to df/d29/d2f/d32 22 2023-12-09T02:34:48.586 INFO:tasks.workunit.client.0.smithi088.stdout:7/215: fdatasync dc/d1b/d32/d38/f1d 0 2023-12-09T02:34:48.586 INFO:tasks.workunit.client.0.smithi088.stdout:7/216: stat dc/d1b/d32/d3e 0 2023-12-09T02:34:48.587 INFO:tasks.workunit.client.0.smithi088.stdout:6/177: mknod d16/d35/c37 0 2023-12-09T02:34:48.587 INFO:tasks.workunit.client.0.smithi088.stdout:6/178: write d16/d1b/f1e [786576,50601] 0 2023-12-09T02:34:48.588 INFO:tasks.workunit.client.0.smithi088.stdout:5/145: sync 2023-12-09T02:34:48.588 INFO:tasks.workunit.client.0.smithi088.stdout:5/146: write d3/d15/dc/d11/f28 [618053,94709] 0 2023-12-09T02:34:48.589 INFO:tasks.workunit.client.0.smithi088.stdout:8/179: getdents d2/d9 0 2023-12-09T02:34:48.591 INFO:tasks.workunit.client.0.smithi088.stdout:9/151: creat df/d29/f33 x:0 0 0 2023-12-09T02:34:48.591 INFO:tasks.workunit.client.0.smithi088.stdout:9/152: write df/f17 [1055513,88569] 0 2023-12-09T02:34:48.592 INFO:tasks.workunit.client.0.smithi088.stdout:2/186: getdents d6/d8/d1f/d22 0 2023-12-09T02:34:48.593 INFO:tasks.workunit.client.0.smithi088.stdout:2/187: write f4 [367677,4732] 0 2023-12-09T02:34:48.595 INFO:tasks.workunit.client.0.smithi088.stdout:6/179: mknod d16/c38 0 2023-12-09T02:34:48.596 INFO:tasks.workunit.client.0.smithi088.stdout:5/147: rename d3/d15/dc/f13 to d3/d15/de/d10/d18/d19/d1b/f34 0 2023-12-09T02:34:48.597 INFO:tasks.workunit.client.0.smithi088.stdout:8/180: symlink d2/d9/l44 0 2023-12-09T02:34:48.600 INFO:tasks.workunit.client.0.smithi088.stdout:7/217: mknod dc/d1b/d32/d38/d1e/c46 0 2023-12-09T02:34:48.600 INFO:tasks.workunit.client.0.smithi088.stdout:7/218: write dc/d1b/d32/f34 [897150,58785] 0 2023-12-09T02:34:48.602 INFO:tasks.workunit.client.0.smithi088.stdout:2/188: write d6/d8/d1f/f3b [2730414,98008] 0 2023-12-09T02:34:48.602 INFO:tasks.workunit.client.0.smithi088.stdout:2/189: chown d6/d20/d3d 2001852 1 2023-12-09T02:34:48.602 INFO:tasks.workunit.client.0.smithi088.stdout:2/190: chown d6/d8/d1f/d22/f38 607681 1 2023-12-09T02:34:48.602 INFO:tasks.workunit.client.0.smithi088.stdout:6/180: write f9 [903489,14840] 0 2023-12-09T02:34:48.602 INFO:tasks.workunit.client.0.smithi088.stdout:0/171: sync 2023-12-09T02:34:48.602 INFO:tasks.workunit.client.0.smithi088.stdout:6/181: read fa [2201550,74375] 0 2023-12-09T02:34:48.603 INFO:tasks.workunit.client.0.smithi088.stdout:6/182: dread fb [0,4194304] 0 2023-12-09T02:34:48.603 INFO:tasks.workunit.client.0.smithi088.stdout:6/183: truncate d16/d1b/f26 394725 0 2023-12-09T02:34:48.603 INFO:tasks.workunit.client.0.smithi088.stdout:8/181: creat d2/d9/d13/d1c/d3b/f45 x:0 0 0 2023-12-09T02:34:48.605 INFO:tasks.workunit.client.0.smithi088.stdout:4/178: dwrite d3/dc/d18/d29/f38 [0,4194304] 0 2023-12-09T02:34:48.608 INFO:tasks.workunit.client.0.smithi088.stdout:7/219: getdents dc/d1b/d32/d38 0 2023-12-09T02:34:48.608 INFO:tasks.workunit.client.0.smithi088.stdout:7/220: chown dc/d21/l19 229457 1 2023-12-09T02:34:48.611 INFO:tasks.workunit.client.0.smithi088.stdout:2/191: mkdir d6/d8/d1f/d22/d29/d47 0 2023-12-09T02:34:48.613 INFO:tasks.workunit.client.0.smithi088.stdout:0/172: unlink fe 0 2023-12-09T02:34:48.615 INFO:tasks.workunit.client.0.smithi088.stdout:1/213: dwrite d8/d1b/f33 [0,4194304] 0 2023-12-09T02:34:48.615 INFO:tasks.workunit.client.0.smithi088.stdout:6/184: creat d16/f39 x:0 0 0 2023-12-09T02:34:48.616 INFO:tasks.workunit.client.0.smithi088.stdout:8/182: mkdir d2/d9/d46 0 2023-12-09T02:34:48.617 INFO:tasks.workunit.client.0.smithi088.stdout:5/148: dwrite d3/d15/de/f17 [0,4194304] 0 2023-12-09T02:34:48.622 INFO:tasks.workunit.client.0.smithi088.stdout:4/179: rename d3/f7 to d3/dc/d1d/f3f 0 2023-12-09T02:34:48.623 INFO:tasks.workunit.client.0.smithi088.stdout:4/180: truncate d3/d1f/f3a 1082117 0 2023-12-09T02:34:48.623 INFO:tasks.workunit.client.0.smithi088.stdout:7/221: creat dc/f47 x:0 0 0 2023-12-09T02:34:48.624 INFO:tasks.workunit.client.0.smithi088.stdout:7/222: write dc/d1b/d32/d38/ff [3671406,28454] 0 2023-12-09T02:34:48.624 INFO:tasks.workunit.client.0.smithi088.stdout:7/223: write dc/d1b/d32/f3c [754644,63579] 0 2023-12-09T02:34:48.624 INFO:tasks.workunit.client.0.smithi088.stdout:2/192: creat d6/d13/d18/f48 x:0 0 0 2023-12-09T02:34:48.624 INFO:tasks.workunit.client.0.smithi088.stdout:2/193: stat d6/d20/c44 0 2023-12-09T02:34:48.624 INFO:tasks.workunit.client.0.smithi088.stdout:2/194: chown d6/l7 934125 1 2023-12-09T02:34:48.625 INFO:tasks.workunit.client.0.smithi088.stdout:0/173: mkdir df/d37 0 2023-12-09T02:34:48.625 INFO:tasks.workunit.client.0.smithi088.stdout:0/174: fdatasync df/d10/f36 0 2023-12-09T02:34:48.626 INFO:tasks.workunit.client.0.smithi088.stdout:1/214: link d8/d1c/d31/l3c d8/d27/l4a 0 2023-12-09T02:34:48.626 INFO:tasks.workunit.client.0.smithi088.stdout:1/215: read f2 [5121182,24366] 0 2023-12-09T02:34:48.626 INFO:tasks.workunit.client.0.smithi088.stdout:1/216: stat d8/d1b 0 2023-12-09T02:34:48.626 INFO:tasks.workunit.client.0.smithi088.stdout:1/217: truncate d8/f3e 323627 0 2023-12-09T02:34:48.627 INFO:tasks.workunit.client.0.smithi088.stdout:6/185: symlink d16/d35/l3a 0 2023-12-09T02:34:48.628 INFO:tasks.workunit.client.0.smithi088.stdout:5/149: mkdir d3/d15/de/d10/d18/d19/d1b/d35 0 2023-12-09T02:34:48.629 INFO:tasks.workunit.client.0.smithi088.stdout:8/183: rename d2/d9/d13/f33 to d2/d9/d46/f47 0 2023-12-09T02:34:48.630 INFO:tasks.workunit.client.0.smithi088.stdout:4/181: mkdir d3/dc/d1d/d40 0 2023-12-09T02:34:48.631 INFO:tasks.workunit.client.0.smithi088.stdout:4/182: readlink d3/d1f/l26 0 2023-12-09T02:34:48.632 INFO:tasks.workunit.client.0.smithi088.stdout:7/224: creat dc/d1b/d32/f48 x:0 0 0 2023-12-09T02:34:48.634 INFO:tasks.workunit.client.0.smithi088.stdout:2/195: link d6/d13/l34 d6/d8/d1f/l49 0 2023-12-09T02:34:48.637 INFO:tasks.workunit.client.0.smithi088.stdout:1/218: creat d8/d27/d40/f4b x:0 0 0 2023-12-09T02:34:48.638 INFO:tasks.workunit.client.0.smithi088.stdout:6/186: getdents d16 0 2023-12-09T02:34:48.641 INFO:tasks.workunit.client.0.smithi088.stdout:5/150: creat d3/d15/de/d10/d18/d19/d1b/f36 x:0 0 0 2023-12-09T02:34:48.641 INFO:tasks.workunit.client.0.smithi088.stdout:3/136: sync 2023-12-09T02:34:48.641 INFO:tasks.workunit.client.0.smithi088.stdout:3/137: chown d1/d2/d2d 806360 1 2023-12-09T02:34:48.641 INFO:tasks.workunit.client.0.smithi088.stdout:3/138: chown d1/d2/d15 130 1 2023-12-09T02:34:48.641 INFO:tasks.workunit.client.0.smithi088.stdout:8/184: rmdir d2/d9/d1a 39 2023-12-09T02:34:48.641 INFO:tasks.workunit.client.0.smithi088.stdout:8/185: fsync d2/d2b/f2e 0 2023-12-09T02:34:48.642 INFO:tasks.workunit.client.0.smithi088.stdout:5/151: write d3/d15/de/d10/d18/d19/d1b/f1c [757997,110865] 0 2023-12-09T02:34:48.643 INFO:tasks.workunit.client.0.smithi088.stdout:7/225: rename dc/f29 to dc/d1b/d32/d38/f49 0 2023-12-09T02:34:48.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/226: fdatasync dc/d1b/d32/f48 0 2023-12-09T02:34:48.647 INFO:tasks.workunit.client.0.smithi088.stdout:2/196: creat d6/d20/d3d/f4a x:0 0 0 2023-12-09T02:34:48.649 INFO:tasks.workunit.client.0.smithi088.stdout:1/219: readlink d8/l17 0 2023-12-09T02:34:48.651 INFO:tasks.workunit.client.0.smithi088.stdout:2/197: read d6/d13/f1e [3648648,6320] 0 2023-12-09T02:34:48.652 INFO:tasks.workunit.client.0.smithi088.stdout:6/187: creat d16/d1b/d25/f3b x:0 0 0 2023-12-09T02:34:48.652 INFO:tasks.workunit.client.0.smithi088.stdout:6/188: chown d16/d1b/d25/c34 424 1 2023-12-09T02:34:48.653 INFO:tasks.workunit.client.0.smithi088.stdout:1/220: read f2 [2844719,115407] 0 2023-12-09T02:34:48.653 INFO:tasks.workunit.client.0.smithi088.stdout:1/221: chown d8/d1b/f33 4624964 1 2023-12-09T02:34:48.655 INFO:tasks.workunit.client.0.smithi088.stdout:5/152: mknod d3/d15/de/d2c/c37 0 2023-12-09T02:34:48.655 INFO:tasks.workunit.client.0.smithi088.stdout:5/153: truncate d3/d15/f1f 111047 0 2023-12-09T02:34:48.657 INFO:tasks.workunit.client.0.smithi088.stdout:8/186: rename d2/d9/l31 to d2/d2b/l48 0 2023-12-09T02:34:48.658 INFO:tasks.workunit.client.0.smithi088.stdout:7/227: creat dc/d21/f4a x:0 0 0 2023-12-09T02:34:48.658 INFO:tasks.workunit.client.0.smithi088.stdout:7/228: readlink dc/d21/l1c 0 2023-12-09T02:34:48.660 INFO:tasks.workunit.client.0.smithi088.stdout:2/198: mknod d6/d8/d1f/d22/d29/c4b 0 2023-12-09T02:34:48.661 INFO:tasks.workunit.client.0.smithi088.stdout:6/189: rmdir d16 39 2023-12-09T02:34:48.661 INFO:tasks.workunit.client.0.smithi088.stdout:6/190: fsync d16/f31 0 2023-12-09T02:34:48.662 INFO:tasks.workunit.client.0.smithi088.stdout:6/191: chown d16/d1b/f1e 9583 1 2023-12-09T02:34:48.662 INFO:tasks.workunit.client.0.smithi088.stdout:3/139: dwrite d1/d2/d15/f27 [0,4194304] 0 2023-12-09T02:34:48.663 INFO:tasks.workunit.client.0.smithi088.stdout:0/175: dwrite df/d10/f1e [0,4194304] 0 2023-12-09T02:34:48.663 INFO:tasks.workunit.client.0.smithi088.stdout:1/222: unlink d8/d1b/d1d/f30 0 2023-12-09T02:34:48.663 INFO:tasks.workunit.client.0.smithi088.stdout:1/223: rename d8 to d8/d1b/d1d/d4c 22 2023-12-09T02:34:48.664 INFO:tasks.workunit.client.0.smithi088.stdout:5/154: symlink d3/d15/de/d10/d18/d19/d20/l38 0 2023-12-09T02:34:48.667 INFO:tasks.workunit.client.0.smithi088.stdout:8/187: mkdir d2/d9/d46/d49 0 2023-12-09T02:34:48.668 INFO:tasks.workunit.client.0.smithi088.stdout:7/229: creat dc/d1b/f4b x:0 0 0 2023-12-09T02:34:48.670 INFO:tasks.workunit.client.0.smithi088.stdout:1/224: dread d8/d1c/f28 [0,4194304] 0 2023-12-09T02:34:48.670 INFO:tasks.workunit.client.0.smithi088.stdout:1/225: fdatasync d8/d1b/d1d/f2d 0 2023-12-09T02:34:48.671 INFO:tasks.workunit.client.0.smithi088.stdout:3/140: truncate d1/d2/d6/ff 723601 0 2023-12-09T02:34:48.673 INFO:tasks.workunit.client.0.smithi088.stdout:2/199: dread f3 [0,4194304] 0 2023-12-09T02:34:48.674 INFO:tasks.workunit.client.0.smithi088.stdout:6/192: write f9 [733525,60682] 0 2023-12-09T02:34:48.675 INFO:tasks.workunit.client.0.smithi088.stdout:0/176: mknod df/d28/c38 0 2023-12-09T02:34:48.675 INFO:tasks.workunit.client.0.smithi088.stdout:0/177: getdents df/d28/d34 0 2023-12-09T02:34:48.675 INFO:tasks.workunit.client.0.smithi088.stdout:5/155: rmdir d3/d15/de/d10 39 2023-12-09T02:34:48.679 INFO:tasks.workunit.client.0.smithi088.stdout:8/188: symlink d2/d9/d13/d1c/d3b/l4a 0 2023-12-09T02:34:48.679 INFO:tasks.workunit.client.0.smithi088.stdout:8/189: chown d2/d9/d1a 3 1 2023-12-09T02:34:48.682 INFO:tasks.workunit.client.0.smithi088.stdout:8/190: read d2/f8 [1024985,71692] 0 2023-12-09T02:34:48.682 INFO:tasks.workunit.client.0.smithi088.stdout:8/191: chown d2/d9/d13/d15 8 1 2023-12-09T02:34:48.682 INFO:tasks.workunit.client.0.smithi088.stdout:8/192: fsync d2/d9/d13/f19 0 2023-12-09T02:34:48.682 INFO:tasks.workunit.client.0.smithi088.stdout:8/193: fdatasync d2/d9/d13/d1c/f3a 0 2023-12-09T02:34:48.683 INFO:tasks.workunit.client.0.smithi088.stdout:7/230: rename dc/d21/l1c to dc/d1b/d32/l4c 0 2023-12-09T02:34:48.687 INFO:tasks.workunit.client.0.smithi088.stdout:6/193: symlink d16/d1b/l3c 0 2023-12-09T02:34:48.687 INFO:tasks.workunit.client.0.smithi088.stdout:1/226: dread d8/fb [8388608,4194304] 0 2023-12-09T02:34:48.691 INFO:tasks.workunit.client.0.smithi088.stdout:8/194: creat d2/d9/d13/d15/f4b x:0 0 0 2023-12-09T02:34:48.692 INFO:tasks.workunit.client.0.smithi088.stdout:2/200: dread d6/d8/f1d [0,4194304] 0 2023-12-09T02:34:48.692 INFO:tasks.workunit.client.0.smithi088.stdout:2/201: rename d6 to d6/d8/d1f/d22/d29/d4c 22 2023-12-09T02:34:48.692 INFO:tasks.workunit.client.0.smithi088.stdout:2/202: fdatasync d6/d13/d18/f48 0 2023-12-09T02:34:48.692 INFO:tasks.workunit.client.0.smithi088.stdout:2/203: truncate d6/d20/f23 659254 0 2023-12-09T02:34:48.693 INFO:tasks.workunit.client.0.smithi088.stdout:7/231: mknod dc/d1b/d32/d38/c4d 0 2023-12-09T02:34:48.693 INFO:tasks.workunit.client.0.smithi088.stdout:7/232: readlink dc/d1b/d32/l3a 0 2023-12-09T02:34:48.693 INFO:tasks.workunit.client.0.smithi088.stdout:6/194: creat d16/d1b/d25/f3d x:0 0 0 2023-12-09T02:34:48.693 INFO:tasks.workunit.client.0.smithi088.stdout:6/195: chown d16/d1b/d25/f27 740750 1 2023-12-09T02:34:48.694 INFO:tasks.workunit.client.0.smithi088.stdout:1/227: write d8/f34 [732048,27838] 0 2023-12-09T02:34:48.697 INFO:tasks.workunit.client.0.smithi088.stdout:3/141: dwrite d1/d2/f2f [0,4194304] 0 2023-12-09T02:34:48.697 INFO:tasks.workunit.client.0.smithi088.stdout:0/178: mknod df/d10/c39 0 2023-12-09T02:34:48.697 INFO:tasks.workunit.client.0.smithi088.stdout:8/195: link d2/d9/d13/f1d d2/d9/d46/f4c 0 2023-12-09T02:34:48.697 INFO:tasks.workunit.client.0.smithi088.stdout:8/196: dread - d2/d9/d13/d1c/f20 zero size 2023-12-09T02:34:48.698 INFO:tasks.workunit.client.0.smithi088.stdout:2/204: link d6/d20/c2d d6/d8/d1f/d22/c4d 0 2023-12-09T02:34:48.698 INFO:tasks.workunit.client.0.smithi088.stdout:7/233: creat dc/d21/f4e x:0 0 0 2023-12-09T02:34:48.699 INFO:tasks.workunit.client.0.smithi088.stdout:6/196: mknod d16/d1b/d25/c3e 0 2023-12-09T02:34:48.699 INFO:tasks.workunit.client.0.smithi088.stdout:6/197: chown d16/c30 3582 1 2023-12-09T02:34:48.701 INFO:tasks.workunit.client.0.smithi088.stdout:3/142: mkdir d1/d2/d31 0 2023-12-09T02:34:48.701 INFO:tasks.workunit.client.0.smithi088.stdout:0/179: dread - df/d10/f36 zero size 2023-12-09T02:34:48.703 INFO:tasks.workunit.client.0.smithi088.stdout:8/197: truncate d2/d9/d13/f2f 3331127 0 2023-12-09T02:34:48.704 INFO:tasks.workunit.client.0.smithi088.stdout:7/234: creat dc/d1b/f4f x:0 0 0 2023-12-09T02:34:48.705 INFO:tasks.workunit.client.0.smithi088.stdout:5/156: dwrite d3/d15/dc/d11/f21 [0,4194304] 0 2023-12-09T02:34:48.705 INFO:tasks.workunit.client.0.smithi088.stdout:5/157: stat d3/d15/dc/d11 0 2023-12-09T02:34:48.708 INFO:tasks.workunit.client.0.smithi088.stdout:6/198: truncate fa 2936269 0 2023-12-09T02:34:48.708 INFO:tasks.workunit.client.0.smithi088.stdout:3/143: rmdir d1/d12 39 2023-12-09T02:34:48.709 INFO:tasks.workunit.client.0.smithi088.stdout:0/180: rename df/d28/c38 to df/d37/c3a 0 2023-12-09T02:34:48.709 INFO:tasks.workunit.client.0.smithi088.stdout:8/198: creat d2/d9/f4d x:0 0 0 2023-12-09T02:34:48.715 INFO:tasks.workunit.client.0.smithi088.stdout:5/158: creat d3/d15/d2e/f39 x:0 0 0 2023-12-09T02:34:48.718 INFO:tasks.workunit.client.0.smithi088.stdout:8/199: symlink d2/d9/d13/l4e 0 2023-12-09T02:34:48.719 INFO:tasks.workunit.client.0.smithi088.stdout:8/200: stat d2/d9/d13/d15/f26 0 2023-12-09T02:34:48.719 INFO:tasks.workunit.client.0.smithi088.stdout:8/201: read - d2/d2b/f2e zero size 2023-12-09T02:34:48.719 INFO:tasks.workunit.client.0.smithi088.stdout:8/202: chown d2/c6 31783 1 2023-12-09T02:34:48.719 INFO:tasks.workunit.client.0.smithi088.stdout:8/203: truncate d2/d9/d13/d1c/d3b/f45 530803 0 2023-12-09T02:34:48.720 INFO:tasks.workunit.client.0.smithi088.stdout:5/159: truncate d3/d8/f9 8058324 0 2023-12-09T02:34:48.721 INFO:tasks.workunit.client.0.smithi088.stdout:6/199: getdents d16/d1b 0 2023-12-09T02:34:48.722 INFO:tasks.workunit.client.0.smithi088.stdout:8/204: creat d2/d9/d46/f4f x:0 0 0 2023-12-09T02:34:48.723 INFO:tasks.workunit.client.0.smithi088.stdout:6/200: mkdir d16/d1b/d2c/d3f 0 2023-12-09T02:34:48.723 INFO:tasks.workunit.client.0.smithi088.stdout:6/201: fdatasync f11 0 2023-12-09T02:34:48.724 INFO:tasks.workunit.client.0.smithi088.stdout:8/205: symlink d2/d2b/l50 0 2023-12-09T02:34:48.725 INFO:tasks.workunit.client.0.smithi088.stdout:6/202: creat d16/d1b/d25/f40 x:0 0 0 2023-12-09T02:34:48.725 INFO:tasks.workunit.client.0.smithi088.stdout:8/206: dread d2/d9/d1a/f25 [0,4194304] 0 2023-12-09T02:34:48.727 INFO:tasks.workunit.client.0.smithi088.stdout:8/207: link d2/d9/f4d d2/d9/f51 0 2023-12-09T02:34:48.727 INFO:tasks.workunit.client.0.smithi088.stdout:8/208: getdents d2/d9/d46/d49 0 2023-12-09T02:34:48.727 INFO:tasks.workunit.client.0.smithi088.stdout:8/209: rmdir d2/d9/d13/d15 39 2023-12-09T02:34:48.729 INFO:tasks.workunit.client.0.smithi088.stdout:8/210: creat d2/f52 x:0 0 0 2023-12-09T02:34:48.729 INFO:tasks.workunit.client.0.smithi088.stdout:8/211: readlink d2/d9/d13/d15/l38 0 2023-12-09T02:34:48.732 INFO:tasks.workunit.client.0.smithi088.stdout:1/228: dwrite d8/d1b/f33 [0,4194304] 0 2023-12-09T02:34:48.733 INFO:tasks.workunit.client.0.smithi088.stdout:8/212: symlink d2/d9/d13/l53 0 2023-12-09T02:34:48.734 INFO:tasks.workunit.client.0.smithi088.stdout:1/229: creat d8/d1b/d1d/f4d x:0 0 0 2023-12-09T02:34:48.736 INFO:tasks.workunit.client.0.smithi088.stdout:3/144: dwrite d1/d2/d15/f2c [0,4194304] 0 2023-12-09T02:34:48.738 INFO:tasks.workunit.client.0.smithi088.stdout:2/205: dwrite d6/d20/d3d/f4a [0,4194304] 0 2023-12-09T02:34:48.738 INFO:tasks.workunit.client.0.smithi088.stdout:8/213: creat d2/f54 x:0 0 0 2023-12-09T02:34:48.738 INFO:tasks.workunit.client.0.smithi088.stdout:1/230: link d8/f15 d8/d1c/d31/f4e 0 2023-12-09T02:34:48.738 INFO:tasks.workunit.client.0.smithi088.stdout:8/214: chown d2/c6 164827 1 2023-12-09T02:34:48.745 INFO:tasks.workunit.client.0.smithi088.stdout:2/206: rename d6/d8/d1f/d22/d29 to d6/d8/d4e 0 2023-12-09T02:34:48.746 INFO:tasks.workunit.client.0.smithi088.stdout:1/231: creat d8/d3d/f4f x:0 0 0 2023-12-09T02:34:48.746 INFO:tasks.workunit.client.0.smithi088.stdout:1/232: read - d8/d3d/f4f zero size 2023-12-09T02:34:48.746 INFO:tasks.workunit.client.0.smithi088.stdout:1/233: fdatasync d8/d27/f2b 0 2023-12-09T02:34:48.746 INFO:tasks.workunit.client.0.smithi088.stdout:2/207: dread f1 [0,4194304] 0 2023-12-09T02:34:48.746 INFO:tasks.workunit.client.0.smithi088.stdout:6/203: dwrite d16/d1b/f1e [0,4194304] 0 2023-12-09T02:34:48.747 INFO:tasks.workunit.client.0.smithi088.stdout:3/145: dread d1/f5 [0,4194304] 0 2023-12-09T02:34:48.747 INFO:tasks.workunit.client.0.smithi088.stdout:3/146: write d1/d2/d24/f2e [505956,98986] 0 2023-12-09T02:34:48.748 INFO:tasks.workunit.client.0.smithi088.stdout:8/215: rename d2/f52 to d2/d9/d46/f55 0 2023-12-09T02:34:48.748 INFO:tasks.workunit.client.0.smithi088.stdout:8/216: fdatasync d2/d2b/f2e 0 2023-12-09T02:34:48.749 INFO:tasks.workunit.client.0.smithi088.stdout:1/234: getdents d8/d1b 0 2023-12-09T02:34:48.755 INFO:tasks.workunit.client.0.smithi088.stdout:3/147: link d1/d12/f18 d1/d2/f32 0 2023-12-09T02:34:48.756 INFO:tasks.workunit.client.0.smithi088.stdout:8/217: truncate d2/f8 295774 0 2023-12-09T02:34:48.757 INFO:tasks.workunit.client.0.smithi088.stdout:8/218: stat d2/d9/d13/d15/f26 0 2023-12-09T02:34:48.757 INFO:tasks.workunit.client.0.smithi088.stdout:8/219: fdatasync d2/d9/d13/d15/f4b 0 2023-12-09T02:34:48.758 INFO:tasks.workunit.client.0.smithi088.stdout:1/235: mkdir d8/d1c/d50 0 2023-12-09T02:34:48.758 INFO:tasks.workunit.client.0.smithi088.stdout:1/236: readlink d8/d27/l46 0 2023-12-09T02:34:48.760 INFO:tasks.workunit.client.0.smithi088.stdout:8/220: rename d2/d9/d13/d1c/d3b/f45 to d2/d9/d13/f56 0 2023-12-09T02:34:48.760 INFO:tasks.workunit.client.0.smithi088.stdout:1/237: getdents d8/d3d/d44 0 2023-12-09T02:34:48.760 INFO:tasks.workunit.client.0.smithi088.stdout:1/238: truncate d8/d1b/d1d/f4d 134426 0 2023-12-09T02:34:48.761 INFO:tasks.workunit.client.0.smithi088.stdout:4/183: sync 2023-12-09T02:34:48.761 INFO:tasks.workunit.client.0.smithi088.stdout:9/153: sync 2023-12-09T02:34:48.762 INFO:tasks.workunit.client.0.smithi088.stdout:8/221: creat d2/d9/d1a/f57 x:0 0 0 2023-12-09T02:34:48.765 INFO:tasks.workunit.client.0.smithi088.stdout:1/239: rename d8/fb to d8/d3d/f51 0 2023-12-09T02:34:48.765 INFO:tasks.workunit.client.0.smithi088.stdout:1/240: chown d8/d1b/d1d 236 1 2023-12-09T02:34:48.766 INFO:tasks.workunit.client.0.smithi088.stdout:4/184: creat d3/dc/d1d/d40/f41 x:0 0 0 2023-12-09T02:34:48.766 INFO:tasks.workunit.client.0.smithi088.stdout:4/185: chown d3/dc/f28 108 1 2023-12-09T02:34:48.767 INFO:tasks.workunit.client.0.smithi088.stdout:8/222: mknod d2/c58 0 2023-12-09T02:34:48.767 INFO:tasks.workunit.client.0.smithi088.stdout:8/223: chown d2/d9/d13/d15 919979 1 2023-12-09T02:34:48.767 INFO:tasks.workunit.client.0.smithi088.stdout:8/224: write d2/f41 [872989,10111] 0 2023-12-09T02:34:48.767 INFO:tasks.workunit.client.0.smithi088.stdout:8/225: chown d2/d9/d13/d1c/d3b 58031527 1 2023-12-09T02:34:48.770 INFO:tasks.workunit.client.0.smithi088.stdout:9/154: dread df/f13 [0,4194304] 0 2023-12-09T02:34:48.770 INFO:tasks.workunit.client.0.smithi088.stdout:4/186: getdents d3/d1f 0 2023-12-09T02:34:48.772 INFO:tasks.workunit.client.0.smithi088.stdout:1/241: symlink d8/l52 0 2023-12-09T02:34:48.772 INFO:tasks.workunit.client.0.smithi088.stdout:1/242: write d8/d3d/f4f [363759,121658] 0 2023-12-09T02:34:48.772 INFO:tasks.workunit.client.0.smithi088.stdout:1/243: readlink d8/d1c/d31/l3c 0 2023-12-09T02:34:48.772 INFO:tasks.workunit.client.0.smithi088.stdout:9/155: creat df/d29/d2f/f34 x:0 0 0 2023-12-09T02:34:48.774 INFO:tasks.workunit.client.0.smithi088.stdout:4/187: symlink d3/d1f/d37/l42 0 2023-12-09T02:34:48.774 INFO:tasks.workunit.client.0.smithi088.stdout:4/188: read - d3/f9 zero size 2023-12-09T02:34:48.774 INFO:tasks.workunit.client.0.smithi088.stdout:2/208: dwrite d6/d8/f1d [0,4194304] 0 2023-12-09T02:34:48.774 INFO:tasks.workunit.client.0.smithi088.stdout:2/209: stat d6/d20 0 2023-12-09T02:34:48.777 INFO:tasks.workunit.client.0.smithi088.stdout:9/156: creat df/d20/d30/f35 x:0 0 0 2023-12-09T02:34:48.778 INFO:tasks.workunit.client.0.smithi088.stdout:9/157: write df/f13 [4084475,56238] 0 2023-12-09T02:34:48.779 INFO:tasks.workunit.client.0.smithi088.stdout:4/189: mkdir d3/dc/d43 0 2023-12-09T02:34:48.782 INFO:tasks.workunit.client.0.smithi088.stdout:5/160: dread d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:48.787 INFO:tasks.workunit.client.0.smithi088.stdout:4/190: rename d3/dc/d1d/c32 to d3/dc/d1d/d40/c44 0 2023-12-09T02:34:48.787 INFO:tasks.workunit.client.0.smithi088.stdout:4/191: chown d3/dc/d43 624121 1 2023-12-09T02:34:48.788 INFO:tasks.workunit.client.0.smithi088.stdout:5/161: rmdir d3/d15/de/d10/d18 39 2023-12-09T02:34:48.792 INFO:tasks.workunit.client.0.smithi088.stdout:5/162: mknod d3/d15/dc/d11/c3a 0 2023-12-09T02:34:48.794 INFO:tasks.workunit.client.0.smithi088.stdout:5/163: symlink d3/d8/l3b 0 2023-12-09T02:34:48.794 INFO:tasks.workunit.client.0.smithi088.stdout:6/204: write d16/d1b/f1e [4221252,94432] 0 2023-12-09T02:34:48.795 INFO:tasks.workunit.client.0.smithi088.stdout:3/148: dwrite d1/d2/d6/f11 [0,4194304] 0 2023-12-09T02:34:48.808 INFO:tasks.workunit.client.0.smithi088.stdout:1/244: dwrite d8/d1c/f28 [4194304,4194304] 0 2023-12-09T02:34:48.814 INFO:tasks.workunit.client.0.smithi088.stdout:1/245: mkdir d8/d53 0 2023-12-09T02:34:48.815 INFO:tasks.workunit.client.0.smithi088.stdout:1/246: write d8/d27/f2b [921426,7899] 0 2023-12-09T02:34:48.817 INFO:tasks.workunit.client.0.smithi088.stdout:1/247: mknod d8/c54 0 2023-12-09T02:34:48.817 INFO:tasks.workunit.client.0.smithi088.stdout:1/248: write d8/d1c/f28 [8391152,8537] 0 2023-12-09T02:34:48.817 INFO:tasks.workunit.client.0.smithi088.stdout:1/249: dread - d8/d1b/f41 zero size 2023-12-09T02:34:48.817 INFO:tasks.workunit.client.0.smithi088.stdout:1/250: stat d8/d1c/l21 0 2023-12-09T02:34:48.817 INFO:tasks.workunit.client.0.smithi088.stdout:1/251: creat d8/d53/f55 x:0 0 0 2023-12-09T02:34:48.819 INFO:tasks.workunit.client.0.smithi088.stdout:7/235: sync 2023-12-09T02:34:48.819 INFO:tasks.workunit.client.0.smithi088.stdout:0/181: sync 2023-12-09T02:34:48.820 INFO:tasks.workunit.client.0.smithi088.stdout:8/226: dwrite d2/d9/d13/d1c/f3a [0,4194304] 0 2023-12-09T02:34:48.820 INFO:tasks.workunit.client.0.smithi088.stdout:8/227: truncate d2/d9/f4d 342013 0 2023-12-09T02:34:48.820 INFO:tasks.workunit.client.0.smithi088.stdout:9/158: dwrite df/d19/f2a [0,4194304] 0 2023-12-09T02:34:48.820 INFO:tasks.workunit.client.0.smithi088.stdout:4/192: dwrite d3/dc/d1d/f3f [0,4194304] 0 2023-12-09T02:34:48.821 INFO:tasks.workunit.client.0.smithi088.stdout:4/193: write d3/dc/f11 [5142255,122601] 0 2023-12-09T02:34:48.821 INFO:tasks.workunit.client.0.smithi088.stdout:0/182: creat df/d28/f3b x:0 0 0 2023-12-09T02:34:48.821 INFO:tasks.workunit.client.0.smithi088.stdout:2/210: dwrite d6/d13/f1e [0,4194304] 0 2023-12-09T02:34:48.821 INFO:tasks.workunit.client.0.smithi088.stdout:7/236: creat dc/d1b/f50 x:0 0 0 2023-12-09T02:34:48.825 INFO:tasks.workunit.client.0.smithi088.stdout:9/159: link fc df/d19/f36 0 2023-12-09T02:34:48.829 INFO:tasks.workunit.client.0.smithi088.stdout:4/194: symlink d3/dc/d18/l45 0 2023-12-09T02:34:48.829 INFO:tasks.workunit.client.0.smithi088.stdout:8/228: dread f1 [4194304,4194304] 0 2023-12-09T02:34:48.829 INFO:tasks.workunit.client.0.smithi088.stdout:8/229: chown d2/d9/d13/d15/l38 101910837 1 2023-12-09T02:34:48.831 INFO:tasks.workunit.client.0.smithi088.stdout:2/211: mknod d6/c4f 0 2023-12-09T02:34:48.831 INFO:tasks.workunit.client.0.smithi088.stdout:2/212: truncate d6/fd 1370880 0 2023-12-09T02:34:48.832 INFO:tasks.workunit.client.0.smithi088.stdout:9/160: rename df/d19/f36 to df/d29/d2f/f37 0 2023-12-09T02:34:48.833 INFO:tasks.workunit.client.0.smithi088.stdout:4/195: unlink d3/dc/d18/f27 0 2023-12-09T02:34:48.834 INFO:tasks.workunit.client.0.smithi088.stdout:0/183: mkdir df/d10/d22/d2d/d3c 0 2023-12-09T02:34:48.834 INFO:tasks.workunit.client.0.smithi088.stdout:2/213: creat d6/d8/d4e/d3c/f50 x:0 0 0 2023-12-09T02:34:48.834 INFO:tasks.workunit.client.0.smithi088.stdout:9/161: mknod df/d20/c38 0 2023-12-09T02:34:48.835 INFO:tasks.workunit.client.0.smithi088.stdout:4/196: symlink d3/dc/d1d/d3c/l46 0 2023-12-09T02:34:48.835 INFO:tasks.workunit.client.0.smithi088.stdout:0/184: dread - df/d10/f24 zero size 2023-12-09T02:34:48.835 INFO:tasks.workunit.client.0.smithi088.stdout:0/185: write f2 [429072,70581] 0 2023-12-09T02:34:48.835 INFO:tasks.workunit.client.0.smithi088.stdout:0/186: rename df/d28 to df/d28/d3d 22 2023-12-09T02:34:48.836 INFO:tasks.workunit.client.0.smithi088.stdout:2/214: mknod d6/d20/d3d/c51 0 2023-12-09T02:34:48.836 INFO:tasks.workunit.client.0.smithi088.stdout:2/215: chown d6/d8/l9 4003 1 2023-12-09T02:34:48.837 INFO:tasks.workunit.client.0.smithi088.stdout:2/216: creat d6/d8/d1f/d22/f52 x:0 0 0 2023-12-09T02:34:48.838 INFO:tasks.workunit.client.0.smithi088.stdout:2/217: creat d6/d8/d4e/d3c/f53 x:0 0 0 2023-12-09T02:34:48.839 INFO:tasks.workunit.client.0.smithi088.stdout:2/218: mkdir d6/d8/d54 0 2023-12-09T02:34:48.839 INFO:tasks.workunit.client.0.smithi088.stdout:0/187: dread df/f25 [0,4194304] 0 2023-12-09T02:34:48.840 INFO:tasks.workunit.client.0.smithi088.stdout:0/188: readlink df/d10/l18 0 2023-12-09T02:34:48.842 INFO:tasks.workunit.client.0.smithi088.stdout:5/164: dwrite d3/d15/dc/d11/f21 [0,4194304] 0 2023-12-09T02:34:48.843 INFO:tasks.workunit.client.0.smithi088.stdout:5/165: creat d3/d15/f3c x:0 0 0 2023-12-09T02:34:48.843 INFO:tasks.workunit.client.0.smithi088.stdout:5/166: write d3/d15/de/d10/d18/d19/d1b/f36 [232723,62548] 0 2023-12-09T02:34:48.844 INFO:tasks.workunit.client.0.smithi088.stdout:3/149: dwrite d1/fa [0,4194304] 0 2023-12-09T02:34:48.846 INFO:tasks.workunit.client.0.smithi088.stdout:2/219: write d6/d8/f10 [3239310,92993] 0 2023-12-09T02:34:48.846 INFO:tasks.workunit.client.0.smithi088.stdout:2/220: readlink d6/d8/l9 0 2023-12-09T02:34:48.846 INFO:tasks.workunit.client.0.smithi088.stdout:3/150: mkdir d1/d9/dc/d33 0 2023-12-09T02:34:48.847 INFO:tasks.workunit.client.0.smithi088.stdout:6/205: dwrite d16/d1b/d25/f32 [0,4194304] 0 2023-12-09T02:34:48.847 INFO:tasks.workunit.client.0.smithi088.stdout:2/221: creat d6/f55 x:0 0 0 2023-12-09T02:34:48.848 INFO:tasks.workunit.client.0.smithi088.stdout:3/151: symlink d1/d2/d24/l34 0 2023-12-09T02:34:48.848 INFO:tasks.workunit.client.0.smithi088.stdout:3/152: stat d1/d2/d24/f2e 0 2023-12-09T02:34:48.848 INFO:tasks.workunit.client.0.smithi088.stdout:3/153: stat d1/d2/d22 0 2023-12-09T02:34:48.848 INFO:tasks.workunit.client.0.smithi088.stdout:3/154: fsync d1/d2/f13 0 2023-12-09T02:34:48.848 INFO:tasks.workunit.client.0.smithi088.stdout:9/162: dwrite df/d29/d2f/f34 [0,4194304] 0 2023-12-09T02:34:48.849 INFO:tasks.workunit.client.0.smithi088.stdout:7/237: dwrite dc/f43 [0,4194304] 0 2023-12-09T02:34:48.849 INFO:tasks.workunit.client.0.smithi088.stdout:5/167: dread d3/d15/de/d10/d18/d19/d1b/f1c [0,4194304] 0 2023-12-09T02:34:48.849 INFO:tasks.workunit.client.0.smithi088.stdout:5/168: stat d3/d15/de/d10/d18/d19/d1b/f1c 0 2023-12-09T02:34:48.849 INFO:tasks.workunit.client.0.smithi088.stdout:5/169: chown d3/d15/de 60201589 1 2023-12-09T02:34:48.850 INFO:tasks.workunit.client.0.smithi088.stdout:6/206: mkdir d16/d1b/d2c/d3f/d41 0 2023-12-09T02:34:48.852 INFO:tasks.workunit.client.0.smithi088.stdout:3/155: mknod d1/d2/d15/c35 0 2023-12-09T02:34:48.854 INFO:tasks.workunit.client.0.smithi088.stdout:8/230: dread d2/f41 [0,4194304] 0 2023-12-09T02:34:48.856 INFO:tasks.workunit.client.0.smithi088.stdout:0/189: dread fb [0,4194304] 0 2023-12-09T02:34:48.857 INFO:tasks.workunit.client.0.smithi088.stdout:5/170: write d3/d8/f9 [2151497,106119] 0 2023-12-09T02:34:48.857 INFO:tasks.workunit.client.0.smithi088.stdout:5/171: fsync d3/d15/dc/d11/f21 0 2023-12-09T02:34:48.857 INFO:tasks.workunit.client.0.smithi088.stdout:5/172: getdents d3/d15/dc/d14 0 2023-12-09T02:34:48.857 INFO:tasks.workunit.client.0.smithi088.stdout:5/173: readlink d3/d15/de/d10/d18/d19/d20/l38 0 2023-12-09T02:34:48.857 INFO:tasks.workunit.client.0.smithi088.stdout:5/174: write d3/d15/dc/d11/f21 [4356625,84510] 0 2023-12-09T02:34:48.862 INFO:tasks.workunit.client.0.smithi088.stdout:9/163: symlink df/d20/d30/l39 0 2023-12-09T02:34:48.862 INFO:tasks.workunit.client.0.smithi088.stdout:6/207: mknod d16/d35/d36/c42 0 2023-12-09T02:34:48.862 INFO:tasks.workunit.client.0.smithi088.stdout:8/231: rename d2/f29 to d2/d9/d46/d49/f59 0 2023-12-09T02:34:48.862 INFO:tasks.workunit.client.0.smithi088.stdout:8/232: fsync d2/d9/f10 0 2023-12-09T02:34:48.863 INFO:tasks.workunit.client.0.smithi088.stdout:0/190: mknod df/c3e 0 2023-12-09T02:34:48.863 INFO:tasks.workunit.client.0.smithi088.stdout:0/191: getdents df/d28/d33 0 2023-12-09T02:34:48.865 INFO:tasks.workunit.client.0.smithi088.stdout:5/175: creat d3/f3d x:0 0 0 2023-12-09T02:34:48.866 INFO:tasks.workunit.client.0.smithi088.stdout:4/197: write d3/dc/d1d/f3f [4942334,39689] 0 2023-12-09T02:34:48.866 INFO:tasks.workunit.client.0.smithi088.stdout:4/198: write d3/dc/d1d/f36 [480703,110037] 0 2023-12-09T02:34:48.866 INFO:tasks.workunit.client.0.smithi088.stdout:4/199: write d3/dc/d1d/f36 [1450741,5580] 0 2023-12-09T02:34:48.866 INFO:tasks.workunit.client.0.smithi088.stdout:4/200: dread - d3/dc/d18/d29/f3b zero size 2023-12-09T02:34:48.868 INFO:tasks.workunit.client.0.smithi088.stdout:1/252: dwrite d8/d27/f2b [0,4194304] 0 2023-12-09T02:34:48.868 INFO:tasks.workunit.client.0.smithi088.stdout:6/208: creat d16/d1b/d2c/d3f/d41/f43 x:0 0 0 2023-12-09T02:34:48.868 INFO:tasks.workunit.client.0.smithi088.stdout:6/209: fdatasync d16/d1b/f22 0 2023-12-09T02:34:48.870 INFO:tasks.workunit.client.0.smithi088.stdout:8/233: creat d2/d9/d13/d1c/f5a x:0 0 0 2023-12-09T02:34:48.870 INFO:tasks.workunit.client.0.smithi088.stdout:8/234: fsync d2/d9/d13/d15/f18 0 2023-12-09T02:34:48.871 INFO:tasks.workunit.client.0.smithi088.stdout:0/192: symlink df/d10/d22/l3f 0 2023-12-09T02:34:48.871 INFO:tasks.workunit.client.0.smithi088.stdout:2/222: dread d6/d8/f10 [0,4194304] 0 2023-12-09T02:34:48.871 INFO:tasks.workunit.client.0.smithi088.stdout:0/193: chown df/d37 586283 1 2023-12-09T02:34:48.872 INFO:tasks.workunit.client.0.smithi088.stdout:5/176: mkdir d3/d15/de/d2c/d3e 0 2023-12-09T02:34:48.872 INFO:tasks.workunit.client.0.smithi088.stdout:5/177: truncate d3/f24 839996 0 2023-12-09T02:34:48.874 INFO:tasks.workunit.client.0.smithi088.stdout:9/164: link df/d29/d2f/f37 df/d29/d2f/f3a 0 2023-12-09T02:34:48.874 INFO:tasks.workunit.client.0.smithi088.stdout:4/201: dread d3/d1f/f2b [0,4194304] 0 2023-12-09T02:34:48.874 INFO:tasks.workunit.client.0.smithi088.stdout:4/202: chown d3/dc/d1d/f36 528 1 2023-12-09T02:34:48.875 INFO:tasks.workunit.client.0.smithi088.stdout:1/253: rmdir d8 39 2023-12-09T02:34:48.877 INFO:tasks.workunit.client.0.smithi088.stdout:5/178: truncate d3/d15/de/f17 3561411 0 2023-12-09T02:34:48.878 INFO:tasks.workunit.client.0.smithi088.stdout:2/223: write f1 [12745,11239] 0 2023-12-09T02:34:48.878 INFO:tasks.workunit.client.0.smithi088.stdout:0/194: dread df/d10/d22/f27 [0,4194304] 0 2023-12-09T02:34:48.879 INFO:tasks.workunit.client.0.smithi088.stdout:0/195: chown f2 18552 1 2023-12-09T02:34:48.879 INFO:tasks.workunit.client.0.smithi088.stdout:4/203: mknod d3/dc/c47 0 2023-12-09T02:34:48.880 INFO:tasks.workunit.client.0.smithi088.stdout:7/238: dwrite dc/d1b/f2b [0,4194304] 0 2023-12-09T02:34:48.882 INFO:tasks.workunit.client.0.smithi088.stdout:7/239: write dc/d1b/d32/d38/f49 [2456539,104057] 0 2023-12-09T02:34:48.883 INFO:tasks.workunit.client.0.smithi088.stdout:1/254: symlink d8/d1c/l56 0 2023-12-09T02:34:48.885 INFO:tasks.workunit.client.0.smithi088.stdout:2/224: mknod d6/d13/d42/c56 0 2023-12-09T02:34:48.886 INFO:tasks.workunit.client.0.smithi088.stdout:3/156: dwrite d1/d2/f2f [0,4194304] 0 2023-12-09T02:34:48.886 INFO:tasks.workunit.client.0.smithi088.stdout:0/196: rename df/d10/d22/c2a to df/d10/d22/c40 0 2023-12-09T02:34:48.887 INFO:tasks.workunit.client.0.smithi088.stdout:8/235: dwrite d2/d9/d13/f19 [0,4194304] 0 2023-12-09T02:34:48.887 INFO:tasks.workunit.client.0.smithi088.stdout:4/204: creat d3/dc/f48 x:0 0 0 2023-12-09T02:34:48.887 INFO:tasks.workunit.client.0.smithi088.stdout:4/205: chown d3/dc/f48 972 1 2023-12-09T02:34:48.887 INFO:tasks.workunit.client.0.smithi088.stdout:8/236: write d2/d9/d13/f19 [3599804,55974] 0 2023-12-09T02:34:48.888 INFO:tasks.workunit.client.0.smithi088.stdout:8/237: write d2/d9/d13/f19 [2661355,84526] 0 2023-12-09T02:34:48.889 INFO:tasks.workunit.client.0.smithi088.stdout:1/255: dread f3 [8388608,4194304] 0 2023-12-09T02:34:48.890 INFO:tasks.workunit.client.0.smithi088.stdout:7/240: creat dc/d1b/d32/d38/f51 x:0 0 0 2023-12-09T02:34:48.890 INFO:tasks.workunit.client.0.smithi088.stdout:7/241: chown dc/d1b/d32/l4c 26959 1 2023-12-09T02:34:48.891 INFO:tasks.workunit.client.0.smithi088.stdout:1/256: dread d8/f34 [0,4194304] 0 2023-12-09T02:34:48.892 INFO:tasks.workunit.client.0.smithi088.stdout:7/242: write dc/f43 [3781324,119008] 0 2023-12-09T02:34:48.892 INFO:tasks.workunit.client.0.smithi088.stdout:2/225: creat d6/d8/d4e/f57 x:0 0 0 2023-12-09T02:34:48.892 INFO:tasks.workunit.client.0.smithi088.stdout:7/243: fdatasync dc/f15 0 2023-12-09T02:34:48.892 INFO:tasks.workunit.client.0.smithi088.stdout:6/210: getdents d16/d1b/d2c/d3f 0 2023-12-09T02:34:48.893 INFO:tasks.workunit.client.0.smithi088.stdout:9/165: dwrite df/d29/d2f/f37 [4194304,4194304] 0 2023-12-09T02:34:48.893 INFO:tasks.workunit.client.0.smithi088.stdout:6/211: write f9 [457862,82947] 0 2023-12-09T02:34:48.895 INFO:tasks.workunit.client.0.smithi088.stdout:3/157: rename d1/d2/f13 to d1/d2/d6/f36 0 2023-12-09T02:34:48.896 INFO:tasks.workunit.client.0.smithi088.stdout:3/158: write d1/d2/f2f [3082044,74449] 0 2023-12-09T02:34:48.899 INFO:tasks.workunit.client.0.smithi088.stdout:4/206: creat d3/d1f/f49 x:0 0 0 2023-12-09T02:34:48.901 INFO:tasks.workunit.client.0.smithi088.stdout:8/238: link d2/d9/d1a/l3f d2/d9/d46/l5b 0 2023-12-09T02:34:48.902 INFO:tasks.workunit.client.0.smithi088.stdout:1/257: mknod d8/d3d/c57 0 2023-12-09T02:34:48.906 INFO:tasks.workunit.client.0.smithi088.stdout:9/166: symlink df/d29/d2f/l3b 0 2023-12-09T02:34:48.907 INFO:tasks.workunit.client.0.smithi088.stdout:7/244: dread dc/d1b/d32/d38/f49 [0,4194304] 0 2023-12-09T02:34:48.907 INFO:tasks.workunit.client.0.smithi088.stdout:9/167: write df/d19/f12 [616803,84169] 0 2023-12-09T02:34:48.908 INFO:tasks.workunit.client.0.smithi088.stdout:2/226: rename d6/d8/d1f/f2f to d6/d8/d4e/d47/f58 0 2023-12-09T02:34:48.909 INFO:tasks.workunit.client.0.smithi088.stdout:0/197: symlink df/d10/l41 0 2023-12-09T02:34:48.910 INFO:tasks.workunit.client.0.smithi088.stdout:0/198: write f6 [41036,107748] 0 2023-12-09T02:34:48.910 INFO:tasks.workunit.client.0.smithi088.stdout:3/159: creat d1/d9/f37 x:0 0 0 2023-12-09T02:34:48.912 INFO:tasks.workunit.client.0.smithi088.stdout:4/207: dwrite d3/dc/f12 [0,4194304] 0 2023-12-09T02:34:48.912 INFO:tasks.workunit.client.0.smithi088.stdout:4/208: fsync d3/fd 0 2023-12-09T02:34:48.913 INFO:tasks.workunit.client.0.smithi088.stdout:4/209: read d3/dc/d1d/f3f [521014,30995] 0 2023-12-09T02:34:48.913 INFO:tasks.workunit.client.0.smithi088.stdout:3/160: write d1/d2/d6/f36 [3729922,94846] 0 2023-12-09T02:34:48.915 INFO:tasks.workunit.client.0.smithi088.stdout:1/258: symlink d8/d53/l58 0 2023-12-09T02:34:48.915 INFO:tasks.workunit.client.0.smithi088.stdout:1/259: write d8/f34 [1190275,10539] 0 2023-12-09T02:34:48.917 INFO:tasks.workunit.client.0.smithi088.stdout:7/245: link dc/d21/c24 dc/d1b/d32/d38/c52 0 2023-12-09T02:34:48.918 INFO:tasks.workunit.client.0.smithi088.stdout:9/168: creat df/d29/d2f/f3c x:0 0 0 2023-12-09T02:34:48.919 INFO:tasks.workunit.client.0.smithi088.stdout:3/161: dread d1/f25 [0,4194304] 0 2023-12-09T02:34:48.920 INFO:tasks.workunit.client.0.smithi088.stdout:6/212: rename d16/l33 to d16/d35/d36/l44 0 2023-12-09T02:34:48.920 INFO:tasks.workunit.client.0.smithi088.stdout:6/213: dread - d16/f39 zero size 2023-12-09T02:34:48.921 INFO:tasks.workunit.client.0.smithi088.stdout:2/227: link d6/d13/l34 d6/d13/d18/l59 0 2023-12-09T02:34:48.922 INFO:tasks.workunit.client.0.smithi088.stdout:5/179: write d3/d15/de/f17 [246383,45398] 0 2023-12-09T02:34:48.923 INFO:tasks.workunit.client.0.smithi088.stdout:4/210: mkdir d3/dc/d18/d29/d4a 0 2023-12-09T02:34:48.925 INFO:tasks.workunit.client.0.smithi088.stdout:7/246: mknod dc/d21/c53 0 2023-12-09T02:34:48.925 INFO:tasks.workunit.client.0.smithi088.stdout:0/199: dwrite df/d10/f36 [0,4194304] 0 2023-12-09T02:34:48.926 INFO:tasks.workunit.client.0.smithi088.stdout:9/169: rename df/f14 to df/f3d 0 2023-12-09T02:34:48.926 INFO:tasks.workunit.client.0.smithi088.stdout:9/170: dread - df/d19/f1f zero size 2023-12-09T02:34:48.928 INFO:tasks.workunit.client.0.smithi088.stdout:3/162: link d1/f1c d1/d9/d2b/f38 0 2023-12-09T02:34:48.929 INFO:tasks.workunit.client.0.smithi088.stdout:6/214: symlink d16/d1b/d2c/d3f/d41/l45 0 2023-12-09T02:34:48.930 INFO:tasks.workunit.client.0.smithi088.stdout:2/228: rmdir d6/d8/d4e/d47 39 2023-12-09T02:34:48.933 INFO:tasks.workunit.client.0.smithi088.stdout:5/180: symlink d3/d15/dc/d11/l3f 0 2023-12-09T02:34:48.933 INFO:tasks.workunit.client.0.smithi088.stdout:5/181: write d3/d15/d2e/f39 [363616,31464] 0 2023-12-09T02:34:48.934 INFO:tasks.workunit.client.0.smithi088.stdout:4/211: creat d3/dc/d1d/d3c/f4b x:0 0 0 2023-12-09T02:34:48.936 INFO:tasks.workunit.client.0.smithi088.stdout:1/260: mkdir d8/d59 0 2023-12-09T02:34:48.936 INFO:tasks.workunit.client.0.smithi088.stdout:1/261: truncate d8/d3d/f4f 1515895 0 2023-12-09T02:34:48.937 INFO:tasks.workunit.client.0.smithi088.stdout:7/247: mknod dc/d21/c54 0 2023-12-09T02:34:48.937 INFO:tasks.workunit.client.0.smithi088.stdout:8/239: rmdir d2 39 2023-12-09T02:34:48.943 INFO:tasks.workunit.client.0.smithi088.stdout:4/212: dread d3/dc/d18/d29/f38 [0,4194304] 0 2023-12-09T02:34:48.943 INFO:tasks.workunit.client.0.smithi088.stdout:4/213: readlink d3/d1f/d37/l42 0 2023-12-09T02:34:48.943 INFO:tasks.workunit.client.0.smithi088.stdout:4/214: chown d3/c19 13829420 1 2023-12-09T02:34:48.948 INFO:tasks.workunit.client.0.smithi088.stdout:9/171: creat df/d20/f3e x:0 0 0 2023-12-09T02:34:48.948 INFO:tasks.workunit.client.0.smithi088.stdout:3/163: creat d1/d2/d22/f39 x:0 0 0 2023-12-09T02:34:48.949 INFO:tasks.workunit.client.0.smithi088.stdout:6/215: creat d16/d35/f46 x:0 0 0 2023-12-09T02:34:48.950 INFO:tasks.workunit.client.0.smithi088.stdout:2/229: mknod d6/d20/d3d/c5a 0 2023-12-09T02:34:48.950 INFO:tasks.workunit.client.0.smithi088.stdout:2/230: read - d6/d13/d18/f48 zero size 2023-12-09T02:34:48.952 INFO:tasks.workunit.client.0.smithi088.stdout:5/182: creat d3/d15/de/f40 x:0 0 0 2023-12-09T02:34:48.952 INFO:tasks.workunit.client.0.smithi088.stdout:5/183: getdents d3/d15/de/d2c/d3e 0 2023-12-09T02:34:48.952 INFO:tasks.workunit.client.0.smithi088.stdout:5/184: stat d3/d15 0 2023-12-09T02:34:48.952 INFO:tasks.workunit.client.0.smithi088.stdout:5/185: chown d3/d15/de/d10/l1a 1435 1 2023-12-09T02:34:48.952 INFO:tasks.workunit.client.0.smithi088.stdout:5/186: write d3/d15/f1f [61275,48683] 0 2023-12-09T02:34:48.953 INFO:tasks.workunit.client.0.smithi088.stdout:1/262: creat d8/d1c/f5a x:0 0 0 2023-12-09T02:34:48.953 INFO:tasks.workunit.client.0.smithi088.stdout:1/263: chown d8/d1c/d50 1032629 1 2023-12-09T02:34:48.954 INFO:tasks.workunit.client.0.smithi088.stdout:7/248: creat dc/d1b/d32/f55 x:0 0 0 2023-12-09T02:34:48.956 INFO:tasks.workunit.client.0.smithi088.stdout:4/215: creat d3/f4c x:0 0 0 2023-12-09T02:34:48.969 INFO:tasks.workunit.client.0.smithi088.stdout:5/187: dwrite d3/d15/d2e/f39 [0,4194304] 0 2023-12-09T02:34:48.970 INFO:tasks.workunit.client.0.smithi088.stdout:3/164: creat d1/d2/d15/f3a x:0 0 0 2023-12-09T02:34:48.971 INFO:tasks.workunit.client.0.smithi088.stdout:9/172: mkdir df/d20/d30/d3f 0 2023-12-09T02:34:48.973 INFO:tasks.workunit.client.0.smithi088.stdout:7/249: dwrite dc/d21/f4a [0,4194304] 0 2023-12-09T02:34:48.973 INFO:tasks.workunit.client.0.smithi088.stdout:7/250: chown c3 5 1 2023-12-09T02:34:48.977 INFO:tasks.workunit.client.0.smithi088.stdout:6/216: link d16/d1b/l3c d16/d1b/d2c/d3f/d41/l47 0 2023-12-09T02:34:48.977 INFO:tasks.workunit.client.0.smithi088.stdout:6/217: write d16/d1b/d2c/d3f/d41/f43 [537757,13248] 0 2023-12-09T02:34:48.979 INFO:tasks.workunit.client.0.smithi088.stdout:2/231: link d6/d8/f30 d6/d8/d4e/d3c/f5b 0 2023-12-09T02:34:48.980 INFO:tasks.workunit.client.0.smithi088.stdout:1/264: creat d8/d1c/d31/f5b x:0 0 0 2023-12-09T02:34:48.981 INFO:tasks.workunit.client.0.smithi088.stdout:4/216: rmdir d3/dc/d1d/d3c 39 2023-12-09T02:34:48.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/217: fsync d3/f4c 0 2023-12-09T02:34:48.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/218: write d3/dc/d18/d29/f3b [722475,63497] 0 2023-12-09T02:34:48.982 INFO:tasks.workunit.client.0.smithi088.stdout:1/265: write d8/f1a [2496147,114128] 0 2023-12-09T02:34:48.983 INFO:tasks.workunit.client.0.smithi088.stdout:5/188: getdents d3/d15 0 2023-12-09T02:34:48.985 INFO:tasks.workunit.client.0.smithi088.stdout:3/165: symlink d1/l3b 0 2023-12-09T02:34:48.986 INFO:tasks.workunit.client.0.smithi088.stdout:3/166: chown d1/d9/d2b 7 1 2023-12-09T02:34:48.986 INFO:tasks.workunit.client.0.smithi088.stdout:3/167: chown d1/d9/dc/d33 976 1 2023-12-09T02:34:48.986 INFO:tasks.workunit.client.0.smithi088.stdout:3/168: fsync d1/d2/d6/f11 0 2023-12-09T02:34:48.987 INFO:tasks.workunit.client.0.smithi088.stdout:1/266: read d8/f1a [882307,79807] 0 2023-12-09T02:34:48.987 INFO:tasks.workunit.client.0.smithi088.stdout:1/267: write d8/d1b/f41 [56390,129404] 0 2023-12-09T02:34:48.987 INFO:tasks.workunit.client.0.smithi088.stdout:1/268: truncate f4 299391 0 2023-12-09T02:34:48.988 INFO:tasks.workunit.client.0.smithi088.stdout:9/173: unlink df/d19/f12 0 2023-12-09T02:34:48.989 INFO:tasks.workunit.client.0.smithi088.stdout:9/174: write df/d29/d2f/f3c [512053,128505] 0 2023-12-09T02:34:48.991 INFO:tasks.workunit.client.0.smithi088.stdout:7/251: truncate dc/d1b/d32/d38/d1e/f23 3910228 0 2023-12-09T02:34:48.992 INFO:tasks.workunit.client.0.smithi088.stdout:5/189: dread d3/d15/dc/d11/f21 [0,4194304] 0 2023-12-09T02:34:48.993 INFO:tasks.workunit.client.0.smithi088.stdout:6/218: link f9 d16/d1b/d2c/f48 0 2023-12-09T02:34:48.994 INFO:tasks.workunit.client.0.smithi088.stdout:4/219: creat d3/d1f/f4d x:0 0 0 2023-12-09T02:34:48.995 INFO:tasks.workunit.client.0.smithi088.stdout:5/190: dread d3/d15/de/d10/d18/d19/d1b/f1c [0,4194304] 0 2023-12-09T02:34:48.996 INFO:tasks.workunit.client.0.smithi088.stdout:1/269: creat d8/f5c x:0 0 0 2023-12-09T02:34:48.996 INFO:tasks.workunit.client.0.smithi088.stdout:1/270: stat d8/d1c/d31/c37 0 2023-12-09T02:34:48.998 INFO:tasks.workunit.client.0.smithi088.stdout:0/200: dwrite df/d10/f1e [0,4194304] 0 2023-12-09T02:34:48.998 INFO:tasks.workunit.client.0.smithi088.stdout:2/232: dwrite d6/d8/d4e/d3c/f50 [0,4194304] 0 2023-12-09T02:34:48.998 INFO:tasks.workunit.client.0.smithi088.stdout:0/201: fdatasync df/d10/d22/f27 0 2023-12-09T02:34:48.998 INFO:tasks.workunit.client.0.smithi088.stdout:2/233: readlink d6/d8/l24 0 2023-12-09T02:34:48.998 INFO:tasks.workunit.client.0.smithi088.stdout:6/219: link d16/c38 d16/d35/c49 0 2023-12-09T02:34:48.999 INFO:tasks.workunit.client.0.smithi088.stdout:5/191: mkdir d3/d15/de/d2c/d3e/d41 0 2023-12-09T02:34:48.999 INFO:tasks.workunit.client.0.smithi088.stdout:5/192: stat d3/d15/d2e 0 2023-12-09T02:34:48.999 INFO:tasks.workunit.client.0.smithi088.stdout:6/220: write f10 [397487,13430] 0 2023-12-09T02:34:48.999 INFO:tasks.workunit.client.0.smithi088.stdout:6/221: fsync d16/d1b/d25/f32 0 2023-12-09T02:34:49.002 INFO:tasks.workunit.client.0.smithi088.stdout:1/271: mkdir d8/d3d/d5d 0 2023-12-09T02:34:49.005 INFO:tasks.workunit.client.0.smithi088.stdout:0/202: symlink df/d10/d22/d2d/d3c/l42 0 2023-12-09T02:34:49.008 INFO:tasks.workunit.client.0.smithi088.stdout:6/222: dread f9 [0,4194304] 0 2023-12-09T02:34:49.008 INFO:tasks.workunit.client.0.smithi088.stdout:6/223: chown d16/d35/d36 13450 1 2023-12-09T02:34:49.009 INFO:tasks.workunit.client.0.smithi088.stdout:2/234: mknod d6/d20/d3a/c5c 0 2023-12-09T02:34:49.009 INFO:tasks.workunit.client.0.smithi088.stdout:2/235: write d6/d13/d18/f28 [1253293,6700] 0 2023-12-09T02:34:49.012 INFO:tasks.workunit.client.0.smithi088.stdout:5/193: dread d3/d15/de/f17 [0,4194304] 0 2023-12-09T02:34:49.014 INFO:tasks.workunit.client.0.smithi088.stdout:1/272: creat d8/d27/f5e x:0 0 0 2023-12-09T02:34:49.014 INFO:tasks.workunit.client.0.smithi088.stdout:4/220: dwrite d3/d1f/f4d [0,4194304] 0 2023-12-09T02:34:49.015 INFO:tasks.workunit.client.0.smithi088.stdout:1/273: write d8/d1b/f20 [57999,48017] 0 2023-12-09T02:34:49.016 INFO:tasks.workunit.client.0.smithi088.stdout:0/203: mkdir df/d28/d43 0 2023-12-09T02:34:49.016 INFO:tasks.workunit.client.0.smithi088.stdout:6/224: symlink d16/d1b/d2c/l4a 0 2023-12-09T02:34:49.017 INFO:tasks.workunit.client.0.smithi088.stdout:2/236: creat d6/f5d x:0 0 0 2023-12-09T02:34:49.020 INFO:tasks.workunit.client.0.smithi088.stdout:5/194: rename d3/d15/dc/d11 to d3/d15/de/d10/d18/d19/d1b/d35/d42 0 2023-12-09T02:34:49.020 INFO:tasks.workunit.client.0.smithi088.stdout:6/225: dread f15 [0,4194304] 0 2023-12-09T02:34:49.023 INFO:tasks.workunit.client.0.smithi088.stdout:4/221: unlink d3/cf 0 2023-12-09T02:34:49.025 INFO:tasks.workunit.client.0.smithi088.stdout:1/274: mknod d8/d3d/d44/c5f 0 2023-12-09T02:34:49.025 INFO:tasks.workunit.client.0.smithi088.stdout:1/275: readlink d8/d1b/d1d/l2f 0 2023-12-09T02:34:49.026 INFO:tasks.workunit.client.0.smithi088.stdout:0/204: link df/f21 df/d10/d22/d2d/d3c/f44 0 2023-12-09T02:34:49.027 INFO:tasks.workunit.client.0.smithi088.stdout:2/237: mknod d6/d13/d42/c5e 0 2023-12-09T02:34:49.029 INFO:tasks.workunit.client.0.smithi088.stdout:6/226: link d16/d1b/d2c/f48 d16/d1b/d2c/d3f/d41/f4b 0 2023-12-09T02:34:49.030 INFO:tasks.workunit.client.0.smithi088.stdout:4/222: truncate d3/f6 1874528 0 2023-12-09T02:34:49.032 INFO:tasks.workunit.client.0.smithi088.stdout:0/205: unlink df/d10/f36 0 2023-12-09T02:34:49.034 INFO:tasks.workunit.client.0.smithi088.stdout:2/238: rmdir d6/d8 39 2023-12-09T02:34:49.035 INFO:tasks.workunit.client.0.smithi088.stdout:6/227: mknod d16/d35/d36/c4c 0 2023-12-09T02:34:49.036 INFO:tasks.workunit.client.0.smithi088.stdout:4/223: rename d3/c19 to d3/dc/d18/d29/d4a/c4e 0 2023-12-09T02:34:49.036 INFO:tasks.workunit.client.0.smithi088.stdout:1/276: dread d8/d1b/f20 [0,4194304] 0 2023-12-09T02:34:49.037 INFO:tasks.workunit.client.0.smithi088.stdout:6/228: dread d16/f1c [0,4194304] 0 2023-12-09T02:34:49.037 INFO:tasks.workunit.client.0.smithi088.stdout:2/239: link d6/d20/c2d d6/d8/c5f 0 2023-12-09T02:34:49.037 INFO:tasks.workunit.client.0.smithi088.stdout:6/229: fdatasync f15 0 2023-12-09T02:34:49.038 INFO:tasks.workunit.client.0.smithi088.stdout:2/240: write d6/d8/f30 [924528,99462] 0 2023-12-09T02:34:49.040 INFO:tasks.workunit.client.0.smithi088.stdout:1/277: rmdir d8/d1b/d1d 39 2023-12-09T02:34:49.040 INFO:tasks.workunit.client.0.smithi088.stdout:1/278: write d8/d1b/d1d/f4d [156542,123817] 0 2023-12-09T02:34:49.041 INFO:tasks.workunit.client.0.smithi088.stdout:2/241: dread d6/d8/d1f/d22/f2b [0,4194304] 0 2023-12-09T02:34:49.041 INFO:tasks.workunit.client.0.smithi088.stdout:2/242: write d6/f5d [567624,47329] 0 2023-12-09T02:34:49.041 INFO:tasks.workunit.client.0.smithi088.stdout:2/243: write d6/d8/d4e/f57 [519052,48427] 0 2023-12-09T02:34:49.042 INFO:tasks.workunit.client.0.smithi088.stdout:6/230: creat d16/d1b/d2c/d3f/d41/f4d x:0 0 0 2023-12-09T02:34:49.042 INFO:tasks.workunit.client.0.smithi088.stdout:0/206: dread f6 [4194304,4194304] 0 2023-12-09T02:34:49.042 INFO:tasks.workunit.client.0.smithi088.stdout:0/207: fsync df/f2c 0 2023-12-09T02:34:49.042 INFO:tasks.workunit.client.0.smithi088.stdout:5/195: write d3/d15/d2e/f39 [4636757,118433] 0 2023-12-09T02:34:49.044 INFO:tasks.workunit.client.0.smithi088.stdout:1/279: symlink d8/d3d/d44/d49/l60 0 2023-12-09T02:34:49.045 INFO:tasks.workunit.client.0.smithi088.stdout:2/244: mknod d6/d8/d54/c60 0 2023-12-09T02:34:49.045 INFO:tasks.workunit.client.0.smithi088.stdout:2/245: write d6/f55 [178231,120838] 0 2023-12-09T02:34:49.046 INFO:tasks.workunit.client.0.smithi088.stdout:2/246: write d6/d20/f3e [356441,34634] 0 2023-12-09T02:34:49.048 INFO:tasks.workunit.client.0.smithi088.stdout:6/231: link c7 d16/d35/d36/c4e 0 2023-12-09T02:34:49.048 INFO:tasks.workunit.client.0.smithi088.stdout:6/232: readlink d16/d35/d36/l44 0 2023-12-09T02:34:49.048 INFO:tasks.workunit.client.0.smithi088.stdout:6/233: fsync d16/d1b/f1d 0 2023-12-09T02:34:49.048 INFO:tasks.workunit.client.0.smithi088.stdout:2/247: dread d6/d8/d1f/d22/f2b [0,4194304] 0 2023-12-09T02:34:49.049 INFO:tasks.workunit.client.0.smithi088.stdout:0/208: getdents df/d10/d22/d2d/d2e 0 2023-12-09T02:34:49.049 INFO:tasks.workunit.client.0.smithi088.stdout:0/209: readlink df/d10/d22/d2d/d3c/l42 0 2023-12-09T02:34:49.049 INFO:tasks.workunit.client.0.smithi088.stdout:0/210: write df/d28/f3b [193963,130948] 0 2023-12-09T02:34:49.051 INFO:tasks.workunit.client.0.smithi088.stdout:5/196: unlink d3/d15/f3c 0 2023-12-09T02:34:49.056 INFO:tasks.workunit.client.0.smithi088.stdout:2/248: dread d6/d8/f1a [0,4194304] 0 2023-12-09T02:34:49.056 INFO:tasks.workunit.client.0.smithi088.stdout:2/249: stat d6/d8/d4e/d47 0 2023-12-09T02:34:49.060 INFO:tasks.workunit.client.0.smithi088.stdout:1/280: creat d8/f61 x:0 0 0 2023-12-09T02:34:49.060 INFO:tasks.workunit.client.0.smithi088.stdout:1/281: write d8/d1c/f3b [748868,61192] 0 2023-12-09T02:34:49.060 INFO:tasks.workunit.client.0.smithi088.stdout:1/282: fdatasync d8/d3d/f51 0 2023-12-09T02:34:49.067 INFO:tasks.workunit.client.0.smithi088.stdout:6/234: rename lc to d16/d1b/d25/l4f 0 2023-12-09T02:34:49.067 INFO:tasks.workunit.client.0.smithi088.stdout:6/235: readlink d16/d35/d36/l44 0 2023-12-09T02:34:49.067 INFO:tasks.workunit.client.0.smithi088.stdout:6/236: fdatasync f12 0 2023-12-09T02:34:49.067 INFO:tasks.workunit.client.0.smithi088.stdout:4/224: getdents d3 0 2023-12-09T02:34:49.067 INFO:tasks.workunit.client.0.smithi088.stdout:4/225: dread - d3/f39 zero size 2023-12-09T02:34:49.069 INFO:tasks.workunit.client.0.smithi088.stdout:0/211: symlink df/l45 0 2023-12-09T02:34:49.070 INFO:tasks.workunit.client.0.smithi088.stdout:5/197: creat d3/d15/de/d10/d18/d19/d20/f43 x:0 0 0 2023-12-09T02:34:49.070 INFO:tasks.workunit.client.0.smithi088.stdout:5/198: write d3/d15/de/f26 [1031516,42271] 0 2023-12-09T02:34:49.072 INFO:tasks.workunit.client.0.smithi088.stdout:1/283: rename d8/d27/d40/l48 to d8/d3d/d5d/l62 0 2023-12-09T02:34:49.072 INFO:tasks.workunit.client.0.smithi088.stdout:1/284: write d8/d53/f55 [82189,3117] 0 2023-12-09T02:34:49.073 INFO:tasks.workunit.client.0.smithi088.stdout:1/285: fsync d8/d3d/f51 0 2023-12-09T02:34:49.074 INFO:tasks.workunit.client.0.smithi088.stdout:6/237: mknod d16/d1b/d2c/c50 0 2023-12-09T02:34:49.074 INFO:tasks.workunit.client.0.smithi088.stdout:2/250: dwrite d6/d20/f3e [0,4194304] 0 2023-12-09T02:34:49.075 INFO:tasks.workunit.client.0.smithi088.stdout:6/238: read fa [1802158,55387] 0 2023-12-09T02:34:49.075 INFO:tasks.workunit.client.0.smithi088.stdout:4/226: getdents d3/dc 0 2023-12-09T02:34:49.077 INFO:tasks.workunit.client.0.smithi088.stdout:0/212: creat df/d28/d43/f46 x:0 0 0 2023-12-09T02:34:49.078 INFO:tasks.workunit.client.0.smithi088.stdout:1/286: mknod d8/d3d/d44/d49/c63 0 2023-12-09T02:34:49.080 INFO:tasks.workunit.client.0.smithi088.stdout:4/227: getdents d3/dc/d1d 0 2023-12-09T02:34:49.081 INFO:tasks.workunit.client.0.smithi088.stdout:4/228: fsync d3/f4c 0 2023-12-09T02:34:49.082 INFO:tasks.workunit.client.0.smithi088.stdout:0/213: creat df/d10/d22/d2d/d3c/f47 x:0 0 0 2023-12-09T02:34:49.085 INFO:tasks.workunit.client.0.smithi088.stdout:0/214: creat df/d28/d34/f48 x:0 0 0 2023-12-09T02:34:49.087 INFO:tasks.workunit.client.0.smithi088.stdout:5/199: dwrite d3/d15/f1f [0,4194304] 0 2023-12-09T02:34:49.091 INFO:tasks.workunit.client.0.smithi088.stdout:8/240: sync 2023-12-09T02:34:49.091 INFO:tasks.workunit.client.0.smithi088.stdout:8/241: dread - d2/d9/f27 zero size 2023-12-09T02:34:49.094 INFO:tasks.workunit.client.0.smithi088.stdout:5/200: rename d3/d15/d2e/f39 to d3/d15/de/d2c/f44 0 2023-12-09T02:34:49.102 INFO:tasks.workunit.client.0.smithi088.stdout:0/215: dread df/f21 [0,4194304] 0 2023-12-09T02:34:49.102 INFO:tasks.workunit.client.0.smithi088.stdout:8/242: creat d2/d9/d13/d1c/f5c x:0 0 0 2023-12-09T02:34:49.102 INFO:tasks.workunit.client.0.smithi088.stdout:8/243: chown d2/d9/d13/f19 8 1 2023-12-09T02:34:49.102 INFO:tasks.workunit.client.0.smithi088.stdout:0/216: creat df/d28/d43/f49 x:0 0 0 2023-12-09T02:34:49.103 INFO:tasks.workunit.client.0.smithi088.stdout:8/244: link d2/d9/d13/l53 d2/d9/d46/d49/l5d 0 2023-12-09T02:34:49.104 INFO:tasks.workunit.client.0.smithi088.stdout:0/217: symlink df/d28/d43/l4a 0 2023-12-09T02:34:49.105 INFO:tasks.workunit.client.0.smithi088.stdout:8/245: mknod d2/d9/d13/c5e 0 2023-12-09T02:34:49.106 INFO:tasks.workunit.client.0.smithi088.stdout:0/218: creat df/d10/d22/d2d/f4b x:0 0 0 2023-12-09T02:34:49.108 INFO:tasks.workunit.client.0.smithi088.stdout:8/246: mkdir d2/d9/d13/d1c/d5f 0 2023-12-09T02:34:49.109 INFO:tasks.workunit.client.0.smithi088.stdout:0/219: read - df/d10/f31 zero size 2023-12-09T02:34:49.109 INFO:tasks.workunit.client.0.smithi088.stdout:0/220: write df/d28/d43/f46 [529642,89425] 0 2023-12-09T02:34:49.112 INFO:tasks.workunit.client.0.smithi088.stdout:0/221: rename df/d10/l18 to df/d28/d34/l4c 0 2023-12-09T02:34:49.112 INFO:tasks.workunit.client.0.smithi088.stdout:0/222: fsync f6 0 2023-12-09T02:34:49.121 INFO:tasks.workunit.client.0.smithi088.stdout:8/247: dread f0 [0,4194304] 0 2023-12-09T02:34:49.121 INFO:tasks.workunit.client.0.smithi088.stdout:8/248: chown d2/d9/l1e 61441 1 2023-12-09T02:34:49.123 INFO:tasks.workunit.client.0.smithi088.stdout:2/251: dwrite d6/d8/d4e/f57 [0,4194304] 0 2023-12-09T02:34:49.123 INFO:tasks.workunit.client.0.smithi088.stdout:6/239: dwrite d16/d1b/f1d [0,4194304] 0 2023-12-09T02:34:49.123 INFO:tasks.workunit.client.0.smithi088.stdout:6/240: chown l3 50 1 2023-12-09T02:34:49.123 INFO:tasks.workunit.client.0.smithi088.stdout:6/241: readlink l8 0 2023-12-09T02:34:49.124 INFO:tasks.workunit.client.0.smithi088.stdout:8/249: rename d2/f24 to d2/d9/d46/d49/f60 0 2023-12-09T02:34:49.125 INFO:tasks.workunit.client.0.smithi088.stdout:1/287: dwrite d8/d1b/f33 [0,4194304] 0 2023-12-09T02:34:49.125 INFO:tasks.workunit.client.0.smithi088.stdout:5/201: dwrite d3/f24 [0,4194304] 0 2023-12-09T02:34:49.129 INFO:tasks.workunit.client.0.smithi088.stdout:8/250: creat d2/d9/d46/f61 x:0 0 0 2023-12-09T02:34:49.131 INFO:tasks.workunit.client.0.smithi088.stdout:6/242: dread f12 [0,4194304] 0 2023-12-09T02:34:49.132 INFO:tasks.workunit.client.0.smithi088.stdout:6/243: stat d16/d1b/d2c/l4a 0 2023-12-09T02:34:49.132 INFO:tasks.workunit.client.0.smithi088.stdout:6/244: fdatasync fb 0 2023-12-09T02:34:49.137 INFO:tasks.workunit.client.0.smithi088.stdout:5/202: rename d3/d15/de/d10/d18/d19/d1b/f36 to d3/f45 0 2023-12-09T02:34:49.137 INFO:tasks.workunit.client.0.smithi088.stdout:0/223: rmdir df/d10/d22/d2d 39 2023-12-09T02:34:49.137 INFO:tasks.workunit.client.0.smithi088.stdout:8/251: dread d2/d9/f3c [0,4194304] 0 2023-12-09T02:34:49.138 INFO:tasks.workunit.client.0.smithi088.stdout:1/288: creat d8/d1b/f64 x:0 0 0 2023-12-09T02:34:49.140 INFO:tasks.workunit.client.0.smithi088.stdout:6/245: creat d16/d1b/f51 x:0 0 0 2023-12-09T02:34:49.140 INFO:tasks.workunit.client.0.smithi088.stdout:6/246: chown d16/d1b/d2c/l2f 827687403 1 2023-12-09T02:34:49.140 INFO:tasks.workunit.client.0.smithi088.stdout:6/247: write d16/d1b/f22 [297920,23303] 0 2023-12-09T02:34:49.141 INFO:tasks.workunit.client.0.smithi088.stdout:5/203: mknod d3/d15/de/d10/d18/c46 0 2023-12-09T02:34:49.141 INFO:tasks.workunit.client.0.smithi088.stdout:5/204: chown d3/d15/de/d10/d18 246 1 2023-12-09T02:34:49.142 INFO:tasks.workunit.client.0.smithi088.stdout:0/224: mknod df/d37/c4d 0 2023-12-09T02:34:49.143 INFO:tasks.workunit.client.0.smithi088.stdout:2/252: dwrite d6/d13/d18/f19 [0,4194304] 0 2023-12-09T02:34:49.145 INFO:tasks.workunit.client.0.smithi088.stdout:1/289: creat d8/d3d/d44/d49/f65 x:0 0 0 2023-12-09T02:34:49.145 INFO:tasks.workunit.client.0.smithi088.stdout:1/290: write d8/d1c/d31/f5b [196796,20070] 0 2023-12-09T02:34:49.146 INFO:tasks.workunit.client.0.smithi088.stdout:6/248: creat d16/d35/d36/f52 x:0 0 0 2023-12-09T02:34:49.149 INFO:tasks.workunit.client.0.smithi088.stdout:8/252: rename d2/d9/d46 to d2/d9/d1a/d62 0 2023-12-09T02:34:49.150 INFO:tasks.workunit.client.0.smithi088.stdout:8/253: read d2/d9/d13/d15/f2d [176365,99495] 0 2023-12-09T02:34:49.152 INFO:tasks.workunit.client.0.smithi088.stdout:3/169: sync 2023-12-09T02:34:49.158 INFO:tasks.workunit.client.0.smithi088.stdout:2/253: rename d6/d8/d1f/d22/f2b to d6/d20/d3d/f61 0 2023-12-09T02:34:49.159 INFO:tasks.workunit.client.0.smithi088.stdout:8/254: truncate f1 3971523 0 2023-12-09T02:34:49.161 INFO:tasks.workunit.client.0.smithi088.stdout:8/255: rmdir d2/d9/d13/d15 39 2023-12-09T02:34:49.161 INFO:tasks.workunit.client.0.smithi088.stdout:8/256: truncate d2/d9/d1a/d62/f61 304522 0 2023-12-09T02:34:49.163 INFO:tasks.workunit.client.0.smithi088.stdout:8/257: symlink d2/d9/d13/d1c/l63 0 2023-12-09T02:34:49.164 INFO:tasks.workunit.client.0.smithi088.stdout:6/249: rmdir d16/d35 39 2023-12-09T02:34:49.165 INFO:tasks.workunit.client.0.smithi088.stdout:6/250: stat d16/c18 0 2023-12-09T02:34:49.165 INFO:tasks.workunit.client.0.smithi088.stdout:6/251: fsync d16/d1b/d2c/f2d 0 2023-12-09T02:34:49.165 INFO:tasks.workunit.client.0.smithi088.stdout:6/252: fdatasync d16/f2b 0 2023-12-09T02:34:49.166 INFO:tasks.workunit.client.0.smithi088.stdout:6/253: fdatasync d16/f21 0 2023-12-09T02:34:49.166 INFO:tasks.workunit.client.0.smithi088.stdout:6/254: fsync d16/d1b/d2c/d3f/d41/f4b 0 2023-12-09T02:34:49.166 INFO:tasks.workunit.client.0.smithi088.stdout:6/255: fsync d16/d1b/d25/f32 0 2023-12-09T02:34:49.167 INFO:tasks.workunit.client.0.smithi088.stdout:8/258: dread d2/f8 [0,4194304] 0 2023-12-09T02:34:49.167 INFO:tasks.workunit.client.0.smithi088.stdout:8/259: write d2/d9/d13/d1c/f5c [893299,103845] 0 2023-12-09T02:34:49.167 INFO:tasks.workunit.client.0.smithi088.stdout:8/260: chown d2/d9/d1a/d62/l5b 164663 1 2023-12-09T02:34:49.167 INFO:tasks.workunit.client.0.smithi088.stdout:8/261: chown d2/d9/d13/d15 1729 1 2023-12-09T02:34:49.167 INFO:tasks.workunit.client.0.smithi088.stdout:8/262: fsync d2/d9/d13/f19 0 2023-12-09T02:34:49.168 INFO:tasks.workunit.client.0.smithi088.stdout:6/256: unlink fa 0 2023-12-09T02:34:49.168 INFO:tasks.workunit.client.0.smithi088.stdout:6/257: readlink d16/d1b/d2c/l2f 0 2023-12-09T02:34:49.168 INFO:tasks.workunit.client.0.smithi088.stdout:7/252: sync 2023-12-09T02:34:49.168 INFO:tasks.workunit.client.0.smithi088.stdout:9/175: sync 2023-12-09T02:34:49.169 INFO:tasks.workunit.client.0.smithi088.stdout:3/170: dwrite d1/d2/d15/f3a [0,4194304] 0 2023-12-09T02:34:49.169 INFO:tasks.workunit.client.0.smithi088.stdout:8/263: link d2/d9/f10 d2/d9/d13/d1c/f64 0 2023-12-09T02:34:49.171 INFO:tasks.workunit.client.0.smithi088.stdout:5/205: dwrite d3/f45 [0,4194304] 0 2023-12-09T02:34:49.172 INFO:tasks.workunit.client.0.smithi088.stdout:1/291: dwrite d8/d1c/d31/f4e [0,4194304] 0 2023-12-09T02:34:49.172 INFO:tasks.workunit.client.0.smithi088.stdout:6/258: getdents d16/d1b/d2c/d3f/d41 0 2023-12-09T02:34:49.172 INFO:tasks.workunit.client.0.smithi088.stdout:1/292: write d8/d1b/f2e [401624,94038] 0 2023-12-09T02:34:49.172 INFO:tasks.workunit.client.0.smithi088.stdout:1/293: truncate d8/f3e 1233769 0 2023-12-09T02:34:49.173 INFO:tasks.workunit.client.0.smithi088.stdout:1/294: getdents d8/d59 0 2023-12-09T02:34:49.173 INFO:tasks.workunit.client.0.smithi088.stdout:1/295: dread f4 [0,4194304] 0 2023-12-09T02:34:49.173 INFO:tasks.workunit.client.0.smithi088.stdout:7/253: getdents dc/d1b/d32/d3e 0 2023-12-09T02:34:49.175 INFO:tasks.workunit.client.0.smithi088.stdout:9/176: getdents df/d20/d30 0 2023-12-09T02:34:49.176 INFO:tasks.workunit.client.0.smithi088.stdout:9/177: dread df/d29/d2f/f3c [0,4194304] 0 2023-12-09T02:34:49.184 INFO:tasks.workunit.client.0.smithi088.stdout:3/171: unlink d1/d2/d15/l1a 0 2023-12-09T02:34:49.184 INFO:tasks.workunit.client.0.smithi088.stdout:5/206: dread d3/f45 [0,4194304] 0 2023-12-09T02:34:49.184 INFO:tasks.workunit.client.0.smithi088.stdout:6/259: mkdir d16/d35/d36/d53 0 2023-12-09T02:34:49.185 INFO:tasks.workunit.client.0.smithi088.stdout:1/296: mkdir d8/d27/d66 0 2023-12-09T02:34:49.186 INFO:tasks.workunit.client.0.smithi088.stdout:7/254: rmdir dc/d1b/d32/d38 39 2023-12-09T02:34:49.189 INFO:tasks.workunit.client.0.smithi088.stdout:6/260: rename d16/d35/c37 to d16/d1b/c54 0 2023-12-09T02:34:49.191 INFO:tasks.workunit.client.0.smithi088.stdout:1/297: link d8/f1a d8/d1b/d1d/f67 0 2023-12-09T02:34:49.194 INFO:tasks.workunit.client.0.smithi088.stdout:7/255: rename dc/d1b/c22 to dc/c56 0 2023-12-09T02:34:49.197 INFO:tasks.workunit.client.0.smithi088.stdout:1/298: creat d8/d27/d40/f68 x:0 0 0 2023-12-09T02:34:49.197 INFO:tasks.workunit.client.0.smithi088.stdout:1/299: chown f4 1576935 1 2023-12-09T02:34:49.197 INFO:tasks.workunit.client.0.smithi088.stdout:8/264: dwrite d2/d9/f4d [0,4194304] 0 2023-12-09T02:34:49.198 INFO:tasks.workunit.client.0.smithi088.stdout:1/300: write d8/d27/f2a [4476326,74890] 0 2023-12-09T02:34:49.200 INFO:tasks.workunit.client.0.smithi088.stdout:5/207: dread d3/f24 [0,4194304] 0 2023-12-09T02:34:49.200 INFO:tasks.workunit.client.0.smithi088.stdout:9/178: dwrite df/d29/d2f/f34 [0,4194304] 0 2023-12-09T02:34:49.200 INFO:tasks.workunit.client.0.smithi088.stdout:9/179: fsync df/d29/d2f/f34 0 2023-12-09T02:34:49.201 INFO:tasks.workunit.client.0.smithi088.stdout:7/256: truncate dc/f43 4081552 0 2023-12-09T02:34:49.201 INFO:tasks.workunit.client.0.smithi088.stdout:7/257: write dc/d1b/d32/f48 [210661,13686] 0 2023-12-09T02:34:49.207 INFO:tasks.workunit.client.0.smithi088.stdout:8/265: mkdir d2/d9/d1a/d65 0 2023-12-09T02:34:49.208 INFO:tasks.workunit.client.0.smithi088.stdout:8/266: truncate d2/d9/d13/d15/f4b 931581 0 2023-12-09T02:34:49.208 INFO:tasks.workunit.client.0.smithi088.stdout:8/267: write d2/d9/d13/d1c/f5c [1205865,77728] 0 2023-12-09T02:34:49.209 INFO:tasks.workunit.client.0.smithi088.stdout:9/180: dread df/f1a [0,4194304] 0 2023-12-09T02:34:49.210 INFO:tasks.workunit.client.0.smithi088.stdout:9/181: write df/f1a [3601275,3228] 0 2023-12-09T02:34:49.212 INFO:tasks.workunit.client.0.smithi088.stdout:5/208: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d42/d47 0 2023-12-09T02:34:49.213 INFO:tasks.workunit.client.0.smithi088.stdout:1/301: dread d8/d1b/f33 [0,4194304] 0 2023-12-09T02:34:49.213 INFO:tasks.workunit.client.0.smithi088.stdout:7/258: creat dc/d1b/f57 x:0 0 0 2023-12-09T02:34:49.214 INFO:tasks.workunit.client.0.smithi088.stdout:7/259: stat dc/d1b/d32/d38/l37 0 2023-12-09T02:34:49.214 INFO:tasks.workunit.client.0.smithi088.stdout:8/268: getdents d2/d2b 0 2023-12-09T02:34:49.214 INFO:tasks.workunit.client.0.smithi088.stdout:3/172: dwrite d1/fa [0,4194304] 0 2023-12-09T02:34:49.216 INFO:tasks.workunit.client.0.smithi088.stdout:6/261: dwrite d16/d1b/f22 [0,4194304] 0 2023-12-09T02:34:49.216 INFO:tasks.workunit.client.0.smithi088.stdout:9/182: mknod df/d29/d2f/c40 0 2023-12-09T02:34:49.217 INFO:tasks.workunit.client.0.smithi088.stdout:5/209: mkdir d3/d15/de/d10/d48 0 2023-12-09T02:34:49.217 INFO:tasks.workunit.client.0.smithi088.stdout:5/210: truncate d3/d15/dc/f2d 698405 0 2023-12-09T02:34:49.217 INFO:tasks.workunit.client.0.smithi088.stdout:9/183: write df/f13 [3048842,64581] 0 2023-12-09T02:34:49.218 INFO:tasks.workunit.client.0.smithi088.stdout:1/302: creat d8/d3d/d5d/f69 x:0 0 0 2023-12-09T02:34:49.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/260: creat dc/d21/f58 x:0 0 0 2023-12-09T02:34:49.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/261: dread - dc/d1b/f50 zero size 2023-12-09T02:34:49.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/262: fdatasync dc/d1b/d32/d38/f1d 0 2023-12-09T02:34:49.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/263: chown l8 2591492 1 2023-12-09T02:34:49.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/264: readlink dc/d1b/l26 0 2023-12-09T02:34:49.220 INFO:tasks.workunit.client.0.smithi088.stdout:8/269: symlink d2/d9/d1a/d62/l66 0 2023-12-09T02:34:49.226 INFO:tasks.workunit.client.0.smithi088.stdout:9/184: rename l9 to df/d29/l41 0 2023-12-09T02:34:49.226 INFO:tasks.workunit.client.0.smithi088.stdout:9/185: readlink df/d29/d2f/l3b 0 2023-12-09T02:34:49.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:48 smithi088 ceph-mon[112028]: pgmap v192: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 8.7 MiB/s rd, 20 MiB/s wr, 389 op/s 2023-12-09T02:34:49.230 INFO:tasks.workunit.client.0.smithi088.stdout:1/303: truncate d8/d3d/f51 11137381 0 2023-12-09T02:34:49.231 INFO:tasks.workunit.client.0.smithi088.stdout:8/270: creat d2/d9/d1a/d65/f67 x:0 0 0 2023-12-09T02:34:49.231 INFO:tasks.workunit.client.0.smithi088.stdout:8/271: chown d2/d9/d13/d15/c36 2140928486 1 2023-12-09T02:34:49.234 INFO:tasks.workunit.client.0.smithi088.stdout:4/229: sync 2023-12-09T02:34:49.237 INFO:tasks.workunit.client.0.smithi088.stdout:5/211: dwrite d3/d15/de/f17 [0,4194304] 0 2023-12-09T02:34:49.242 INFO:tasks.workunit.client.0.smithi088.stdout:1/304: creat d8/d1b/f6a x:0 0 0 2023-12-09T02:34:49.244 INFO:tasks.workunit.client.0.smithi088.stdout:5/212: write d3/d15/de/d2c/f44 [434292,107631] 0 2023-12-09T02:34:49.245 INFO:tasks.workunit.client.0.smithi088.stdout:8/272: creat d2/d9/d13/d15/f68 x:0 0 0 2023-12-09T02:34:49.245 INFO:tasks.workunit.client.0.smithi088.stdout:8/273: chown d2/d9/d13/d15/l38 37578114 1 2023-12-09T02:34:49.245 INFO:tasks.workunit.client.0.smithi088.stdout:8/274: chown d2/d9/d1a/d62/d49/f60 261 1 2023-12-09T02:34:49.247 INFO:tasks.workunit.client.0.smithi088.stdout:4/230: creat d3/d1f/f4f x:0 0 0 2023-12-09T02:34:49.247 INFO:tasks.workunit.client.0.smithi088.stdout:7/265: rmdir dc 39 2023-12-09T02:34:49.247 INFO:tasks.workunit.client.0.smithi088.stdout:7/266: chown dc/d1b/d32/d38/f49 262 1 2023-12-09T02:34:49.247 INFO:tasks.workunit.client.0.smithi088.stdout:7/267: readlink dc/d1b/d32/l4c 0 2023-12-09T02:34:49.248 INFO:tasks.workunit.client.0.smithi088.stdout:1/305: getdents d8/d1c/d31 0 2023-12-09T02:34:49.248 INFO:tasks.workunit.client.0.smithi088.stdout:1/306: read - d8/d27/f5e zero size 2023-12-09T02:34:49.248 INFO:tasks.workunit.client.0.smithi088.stdout:1/307: fdatasync d8/d1b/f2e 0 2023-12-09T02:34:49.249 INFO:tasks.workunit.client.0.smithi088.stdout:1/308: stat d8/d3d/d44/d49/f65 0 2023-12-09T02:34:49.251 INFO:tasks.workunit.client.0.smithi088.stdout:8/275: mknod d2/d9/d13/d15/c69 0 2023-12-09T02:34:49.251 INFO:tasks.workunit.client.0.smithi088.stdout:8/276: write d2/d9/d1a/d62/d49/f59 [796306,47123] 0 2023-12-09T02:34:49.252 INFO:tasks.workunit.client.0.smithi088.stdout:8/277: write d2/d9/d13/f19 [4733073,24262] 0 2023-12-09T02:34:49.252 INFO:tasks.workunit.client.0.smithi088.stdout:8/278: chown d2/d9/d13/d15/f4b 358794578 1 2023-12-09T02:34:49.252 INFO:tasks.workunit.client.0.smithi088.stdout:8/279: dread - d2/d2b/f2e zero size 2023-12-09T02:34:49.253 INFO:tasks.workunit.client.0.smithi088.stdout:4/231: getdents d3/dc/d1d/d40 0 2023-12-09T02:34:49.253 INFO:tasks.workunit.client.0.smithi088.stdout:6/262: dwrite d16/d1b/d2c/d3f/d41/f4d [0,4194304] 0 2023-12-09T02:34:49.255 INFO:tasks.workunit.client.0.smithi088.stdout:8/280: mknod d2/c6a 0 2023-12-09T02:34:49.258 INFO:tasks.workunit.client.0.smithi088.stdout:7/268: mknod dc/d1b/d32/d38/d1e/c59 0 2023-12-09T02:34:49.259 INFO:tasks.workunit.client.0.smithi088.stdout:9/186: dwrite df/f1b [0,4194304] 0 2023-12-09T02:34:49.260 INFO:tasks.workunit.client.0.smithi088.stdout:8/281: mknod d2/d2b/c6b 0 2023-12-09T02:34:49.262 INFO:tasks.workunit.client.0.smithi088.stdout:6/263: dread d16/d1b/d25/f32 [0,4194304] 0 2023-12-09T02:34:49.264 INFO:tasks.workunit.client.0.smithi088.stdout:8/282: mknod d2/c6c 0 2023-12-09T02:34:49.265 INFO:tasks.workunit.client.0.smithi088.stdout:0/225: sync 2023-12-09T02:34:49.265 INFO:tasks.workunit.client.0.smithi088.stdout:0/226: truncate df/d10/d22/d2d/f4b 204739 0 2023-12-09T02:34:49.265 INFO:tasks.workunit.client.0.smithi088.stdout:0/227: fsync df/f25 0 2023-12-09T02:34:49.268 INFO:tasks.workunit.client.0.smithi088.stdout:8/283: rename d2/c12 to d2/d9/d13/c6d 0 2023-12-09T02:34:49.269 INFO:tasks.workunit.client.0.smithi088.stdout:0/228: dread df/d28/d43/f46 [0,4194304] 0 2023-12-09T02:34:49.269 INFO:tasks.workunit.client.0.smithi088.stdout:8/284: rmdir d2/d9/d1a/d62 39 2023-12-09T02:34:49.271 INFO:tasks.workunit.client.0.smithi088.stdout:0/229: creat df/d28/d33/f4e x:0 0 0 2023-12-09T02:34:49.272 INFO:tasks.workunit.client.0.smithi088.stdout:9/187: dread df/d29/d2f/f3a [4194304,4194304] 0 2023-12-09T02:34:49.272 INFO:tasks.workunit.client.0.smithi088.stdout:9/188: fdatasync df/d20/d30/f35 0 2023-12-09T02:34:49.273 INFO:tasks.workunit.client.0.smithi088.stdout:0/230: creat df/d28/d43/f4f x:0 0 0 2023-12-09T02:34:49.273 INFO:tasks.workunit.client.0.smithi088.stdout:8/285: read d2/d9/d1a/d62/f47 [1611038,64672] 0 2023-12-09T02:34:49.274 INFO:tasks.workunit.client.0.smithi088.stdout:0/231: truncate df/f21 640625 0 2023-12-09T02:34:49.275 INFO:tasks.workunit.client.0.smithi088.stdout:8/286: mkdir d2/d9/d13/d15/d6e 0 2023-12-09T02:34:49.277 INFO:tasks.workunit.client.0.smithi088.stdout:9/189: write df/d19/f2a [2130871,55418] 0 2023-12-09T02:34:49.277 INFO:tasks.workunit.client.0.smithi088.stdout:9/190: truncate df/d29/f33 789836 0 2023-12-09T02:34:49.278 INFO:tasks.workunit.client.0.smithi088.stdout:9/191: mkdir df/d20/d30/d3f/d42 0 2023-12-09T02:34:49.279 INFO:tasks.workunit.client.0.smithi088.stdout:9/192: write df/d19/f23 [466035,66908] 0 2023-12-09T02:34:49.280 INFO:tasks.workunit.client.0.smithi088.stdout:9/193: creat df/d20/d30/f43 x:0 0 0 2023-12-09T02:34:49.280 INFO:tasks.workunit.client.0.smithi088.stdout:8/287: dread d2/d9/d13/d1c/f64 [0,4194304] 0 2023-12-09T02:34:49.281 INFO:tasks.workunit.client.0.smithi088.stdout:4/232: dwrite d3/dc/f14 [0,4194304] 0 2023-12-09T02:34:49.281 INFO:tasks.workunit.client.0.smithi088.stdout:9/194: write df/f13 [1636644,112811] 0 2023-12-09T02:34:49.281 INFO:tasks.workunit.client.0.smithi088.stdout:9/195: write df/f1b [4929378,98070] 0 2023-12-09T02:34:49.281 INFO:tasks.workunit.client.0.smithi088.stdout:8/288: getdents d2/d9/d1a 0 2023-12-09T02:34:49.284 INFO:tasks.workunit.client.0.smithi088.stdout:4/233: creat d3/dc/d1d/d40/f50 x:0 0 0 2023-12-09T02:34:49.284 INFO:tasks.workunit.client.0.smithi088.stdout:7/269: dwrite dc/d1b/d32/d38/f17 [4194304,4194304] 0 2023-12-09T02:34:49.284 INFO:tasks.workunit.client.0.smithi088.stdout:7/270: dread - dc/d1b/f4f zero size 2023-12-09T02:34:49.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/264: dwrite d16/d35/f46 [0,4194304] 0 2023-12-09T02:34:49.285 INFO:tasks.workunit.client.0.smithi088.stdout:9/196: rename df/d29/d2f/l3b to df/d19/l44 0 2023-12-09T02:34:49.286 INFO:tasks.workunit.client.0.smithi088.stdout:9/197: read - df/d20/d30/f43 zero size 2023-12-09T02:34:49.287 INFO:tasks.workunit.client.0.smithi088.stdout:8/289: truncate d2/d9/f3c 589823 0 2023-12-09T02:34:49.287 INFO:tasks.workunit.client.0.smithi088.stdout:8/290: fsync d2/d9/f51 0 2023-12-09T02:34:49.288 INFO:tasks.workunit.client.0.smithi088.stdout:8/291: write d2/d9/d13/d1c/f64 [473343,58796] 0 2023-12-09T02:34:49.288 INFO:tasks.workunit.client.0.smithi088.stdout:4/234: truncate d3/dc/d18/d29/f3b 576264 0 2023-12-09T02:34:49.289 INFO:tasks.workunit.client.0.smithi088.stdout:4/235: write d3/fd [5032021,99237] 0 2023-12-09T02:34:49.291 INFO:tasks.workunit.client.0.smithi088.stdout:7/271: truncate dc/d1b/f2b 3237254 0 2023-12-09T02:34:49.291 INFO:tasks.workunit.client.0.smithi088.stdout:7/272: chown dc/d21/c24 132560 1 2023-12-09T02:34:49.294 INFO:tasks.workunit.client.0.smithi088.stdout:6/265: mknod d16/d35/d36/c55 0 2023-12-09T02:34:49.294 INFO:tasks.workunit.client.0.smithi088.stdout:6/266: write d16/d1b/d2c/f48 [2643698,85720] 0 2023-12-09T02:34:49.295 INFO:tasks.workunit.client.0.smithi088.stdout:9/198: rename df/f18 to df/d20/d30/d3f/d42/f45 0 2023-12-09T02:34:49.298 INFO:tasks.workunit.client.0.smithi088.stdout:0/232: dwrite df/d10/f29 [0,4194304] 0 2023-12-09T02:34:49.300 INFO:tasks.workunit.client.0.smithi088.stdout:4/236: creat d3/dc/d1d/d3c/f51 x:0 0 0 2023-12-09T02:34:49.300 INFO:tasks.workunit.client.0.smithi088.stdout:4/237: dread - d3/d1f/f4f zero size 2023-12-09T02:34:49.302 INFO:tasks.workunit.client.0.smithi088.stdout:7/273: creat dc/d1b/d32/d3e/f5a x:0 0 0 2023-12-09T02:34:49.309 INFO:tasks.workunit.client.0.smithi088.stdout:8/292: dwrite d2/d9/d13/d15/f2d [0,4194304] 0 2023-12-09T02:34:49.309 INFO:tasks.workunit.client.0.smithi088.stdout:8/293: chown d2/d9/d1a/d62/f4f 12 1 2023-12-09T02:34:49.310 INFO:tasks.workunit.client.0.smithi088.stdout:9/199: link df/d29/f33 df/d20/d30/d3f/d42/f46 0 2023-12-09T02:34:49.315 INFO:tasks.workunit.client.0.smithi088.stdout:0/233: symlink df/d28/l50 0 2023-12-09T02:34:49.315 INFO:tasks.workunit.client.0.smithi088.stdout:0/234: chown l5 28 1 2023-12-09T02:34:49.315 INFO:tasks.workunit.client.0.smithi088.stdout:6/267: dwrite d16/d1b/d25/f3b [0,4194304] 0 2023-12-09T02:34:49.316 INFO:tasks.workunit.client.0.smithi088.stdout:4/238: unlink d3/dc/d1d/l1e 0 2023-12-09T02:34:49.318 INFO:tasks.workunit.client.0.smithi088.stdout:6/268: dread d16/d1b/f1f [0,4194304] 0 2023-12-09T02:34:49.318 INFO:tasks.workunit.client.0.smithi088.stdout:6/269: dread - d16/d1b/d25/f3d zero size 2023-12-09T02:34:49.318 INFO:tasks.workunit.client.0.smithi088.stdout:6/270: truncate d16/d1b/f51 422241 0 2023-12-09T02:34:49.318 INFO:tasks.workunit.client.0.smithi088.stdout:7/274: symlink dc/l5b 0 2023-12-09T02:34:49.321 INFO:tasks.workunit.client.0.smithi088.stdout:8/294: rmdir d2/d9/d13 39 2023-12-09T02:34:49.321 INFO:tasks.workunit.client.0.smithi088.stdout:8/295: chown d2/d9/d1a/d62/d49/f60 126409 1 2023-12-09T02:34:49.322 INFO:tasks.workunit.client.0.smithi088.stdout:9/200: creat df/d19/f47 x:0 0 0 2023-12-09T02:34:49.323 INFO:tasks.workunit.client.0.smithi088.stdout:0/235: dread fc [0,4194304] 0 2023-12-09T02:34:49.327 INFO:tasks.workunit.client.0.smithi088.stdout:4/239: getdents d3/dc/d18 0 2023-12-09T02:34:49.327 INFO:tasks.workunit.client.0.smithi088.stdout:4/240: chown d3/f4c 88169621 1 2023-12-09T02:34:49.331 INFO:tasks.workunit.client.0.smithi088.stdout:7/275: creat dc/d1b/f5c x:0 0 0 2023-12-09T02:34:49.333 INFO:tasks.workunit.client.0.smithi088.stdout:7/276: dread dc/d1b/d32/f48 [0,4194304] 0 2023-12-09T02:34:49.336 INFO:tasks.workunit.client.0.smithi088.stdout:4/241: creat d3/dc/d43/f52 x:0 0 0 2023-12-09T02:34:49.337 INFO:tasks.workunit.client.0.smithi088.stdout:6/271: truncate d16/f1c 87063 0 2023-12-09T02:34:49.338 INFO:tasks.workunit.client.0.smithi088.stdout:9/201: rename df/d20/d30/d3f/d42 to df/d20/d30/d3f/d48 0 2023-12-09T02:34:49.339 INFO:tasks.workunit.client.0.smithi088.stdout:7/277: mkdir dc/d1b/d32/d5d 0 2023-12-09T02:34:49.339 INFO:tasks.workunit.client.0.smithi088.stdout:7/278: getdents dc/d1b/d32/d5d 0 2023-12-09T02:34:49.339 INFO:tasks.workunit.client.0.smithi088.stdout:7/279: dread - dc/d1b/d32/d3e/f5a zero size 2023-12-09T02:34:49.341 INFO:tasks.workunit.client.0.smithi088.stdout:6/272: write d16/d35/f46 [2508733,70092] 0 2023-12-09T02:34:49.342 INFO:tasks.workunit.client.0.smithi088.stdout:4/242: rename d3/d1f/l21 to d3/dc/d18/l53 0 2023-12-09T02:34:49.344 INFO:tasks.workunit.client.0.smithi088.stdout:4/243: truncate d3/dc/f10 693500 0 2023-12-09T02:34:49.344 INFO:tasks.workunit.client.0.smithi088.stdout:4/244: dread - d3/dc/d1d/d40/f50 zero size 2023-12-09T02:34:49.347 INFO:tasks.workunit.client.0.smithi088.stdout:9/202: dread df/f1a [0,4194304] 0 2023-12-09T02:34:49.347 INFO:tasks.workunit.client.0.smithi088.stdout:4/245: getdents d3/dc/d18/d29/d4a 0 2023-12-09T02:34:49.347 INFO:tasks.workunit.client.0.smithi088.stdout:4/246: dread - d3/f39 zero size 2023-12-09T02:34:49.348 INFO:tasks.workunit.client.0.smithi088.stdout:2/254: sync 2023-12-09T02:34:49.349 INFO:tasks.workunit.client.0.smithi088.stdout:2/255: readlink d6/d13/d18/l3f 0 2023-12-09T02:34:49.349 INFO:tasks.workunit.client.0.smithi088.stdout:8/296: dwrite d2/d9/d1a/d62/f61 [0,4194304] 0 2023-12-09T02:34:49.349 INFO:tasks.workunit.client.0.smithi088.stdout:0/236: dwrite df/d28/d43/f46 [0,4194304] 0 2023-12-09T02:34:49.356 INFO:tasks.workunit.client.0.smithi088.stdout:4/247: rename d3/dc/f20 to d3/dc/d1d/d40/f54 0 2023-12-09T02:34:49.356 INFO:tasks.workunit.client.0.smithi088.stdout:4/248: write d3/d1f/f49 [923176,45413] 0 2023-12-09T02:34:49.356 INFO:tasks.workunit.client.0.smithi088.stdout:4/249: chown d3/f4c 3043 1 2023-12-09T02:34:49.357 INFO:tasks.workunit.client.0.smithi088.stdout:4/250: stat d3/d1f/f4f 0 2023-12-09T02:34:49.357 INFO:tasks.workunit.client.0.smithi088.stdout:2/256: symlink d6/d8/d54/l62 0 2023-12-09T02:34:49.358 INFO:tasks.workunit.client.0.smithi088.stdout:6/273: dwrite d16/d1b/d25/f32 [0,4194304] 0 2023-12-09T02:34:49.361 INFO:tasks.workunit.client.0.smithi088.stdout:8/297: symlink d2/d9/d1a/d65/l6f 0 2023-12-09T02:34:49.365 INFO:tasks.workunit.client.0.smithi088.stdout:4/251: creat d3/d1f/f55 x:0 0 0 2023-12-09T02:34:49.366 INFO:tasks.workunit.client.0.smithi088.stdout:2/257: getdents d6/d20/d3d 0 2023-12-09T02:34:49.366 INFO:tasks.workunit.client.0.smithi088.stdout:2/258: readlink d6/d8/l24 0 2023-12-09T02:34:49.366 INFO:tasks.workunit.client.0.smithi088.stdout:2/259: write d6/d8/d1f/d22/f38 [531428,7355] 0 2023-12-09T02:34:49.367 INFO:tasks.workunit.client.0.smithi088.stdout:6/274: mkdir d16/d1b/d56 0 2023-12-09T02:34:49.367 INFO:tasks.workunit.client.0.smithi088.stdout:6/275: chown d16/d35/d36/l44 770 1 2023-12-09T02:34:49.368 INFO:tasks.workunit.client.0.smithi088.stdout:0/237: dwrite f4 [4194304,4194304] 0 2023-12-09T02:34:49.368 INFO:tasks.workunit.client.0.smithi088.stdout:6/276: write f11 [2332418,37290] 0 2023-12-09T02:34:49.368 INFO:tasks.workunit.client.0.smithi088.stdout:6/277: getdents d16/d1b/d2c/d3f 0 2023-12-09T02:34:49.369 INFO:tasks.workunit.client.0.smithi088.stdout:7/280: dwrite dc/f47 [0,4194304] 0 2023-12-09T02:34:49.369 INFO:tasks.workunit.client.0.smithi088.stdout:7/281: chown dc/d1b/d32/d38/c4d 63 1 2023-12-09T02:34:49.369 INFO:tasks.workunit.client.0.smithi088.stdout:7/282: write dc/d1b/d32/d38/f1d [1155140,56097] 0 2023-12-09T02:34:49.369 INFO:tasks.workunit.client.0.smithi088.stdout:9/203: rmdir df 39 2023-12-09T02:34:49.369 INFO:tasks.workunit.client.0.smithi088.stdout:8/298: mkdir d2/d9/d70 0 2023-12-09T02:34:49.370 INFO:tasks.workunit.client.0.smithi088.stdout:4/252: mknod d3/dc/d18/c56 0 2023-12-09T02:34:49.371 INFO:tasks.workunit.client.0.smithi088.stdout:2/260: symlink d6/d8/d1f/d22/l63 0 2023-12-09T02:34:49.371 INFO:tasks.workunit.client.0.smithi088.stdout:4/253: write f1 [2069310,37585] 0 2023-12-09T02:34:49.380 INFO:tasks.workunit.client.0.smithi088.stdout:0/238: mknod df/d28/d34/c51 0 2023-12-09T02:34:49.383 INFO:tasks.workunit.client.0.smithi088.stdout:6/278: unlink d16/d1b/f1f 0 2023-12-09T02:34:49.386 INFO:tasks.workunit.client.0.smithi088.stdout:7/283: creat dc/d1b/d32/f5e x:0 0 0 2023-12-09T02:34:49.387 INFO:tasks.workunit.client.0.smithi088.stdout:9/204: mknod df/d20/d30/d3f/d48/c49 0 2023-12-09T02:34:49.389 INFO:tasks.workunit.client.0.smithi088.stdout:8/299: link d2/d9/d13/d15/c36 d2/d9/d13/d15/d6e/c71 0 2023-12-09T02:34:49.389 INFO:tasks.workunit.client.0.smithi088.stdout:8/300: write d2/d9/f51 [4384727,54033] 0 2023-12-09T02:34:49.389 INFO:tasks.workunit.client.0.smithi088.stdout:8/301: chown d2/d9/d13/d1c 282963254 1 2023-12-09T02:34:49.389 INFO:tasks.workunit.client.0.smithi088.stdout:2/261: mkdir d6/d8/d4e/d64 0 2023-12-09T02:34:49.389 INFO:tasks.workunit.client.0.smithi088.stdout:2/262: chown d6/d8/d1f/d22/l63 2606 1 2023-12-09T02:34:49.391 INFO:tasks.workunit.client.0.smithi088.stdout:4/254: link f0 d3/dc/d1d/f57 0 2023-12-09T02:34:49.393 INFO:tasks.workunit.client.0.smithi088.stdout:0/239: creat df/d10/d22/d2d/f52 x:0 0 0 2023-12-09T02:34:49.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/279: mknod d16/d35/d36/d53/c57 0 2023-12-09T02:34:49.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/280: truncate fb 1555030 0 2023-12-09T02:34:49.395 INFO:tasks.workunit.client.0.smithi088.stdout:6/281: chown l13 53850093 1 2023-12-09T02:34:49.395 INFO:tasks.workunit.client.0.smithi088.stdout:6/282: stat d16/d35/f46 0 2023-12-09T02:34:49.395 INFO:tasks.workunit.client.0.smithi088.stdout:7/284: creat dc/d1b/d32/d38/d1e/f5f x:0 0 0 2023-12-09T02:34:49.396 INFO:tasks.workunit.client.0.smithi088.stdout:9/205: mknod df/d20/c4a 0 2023-12-09T02:34:49.398 INFO:tasks.workunit.client.0.smithi088.stdout:8/302: mknod d2/c72 0 2023-12-09T02:34:49.399 INFO:tasks.workunit.client.0.smithi088.stdout:4/255: mknod d3/dc/d43/c58 0 2023-12-09T02:34:49.400 INFO:tasks.workunit.client.0.smithi088.stdout:0/240: symlink df/d28/d43/l53 0 2023-12-09T02:34:49.402 INFO:tasks.workunit.client.0.smithi088.stdout:7/285: creat dc/d1b/d32/d38/d1e/f60 x:0 0 0 2023-12-09T02:34:49.402 INFO:tasks.workunit.client.0.smithi088.stdout:7/286: dread - dc/d21/f58 zero size 2023-12-09T02:34:49.402 INFO:tasks.workunit.client.0.smithi088.stdout:3/173: sync 2023-12-09T02:34:49.402 INFO:tasks.workunit.client.0.smithi088.stdout:5/213: sync 2023-12-09T02:34:49.402 INFO:tasks.workunit.client.0.smithi088.stdout:3/174: stat d1/d2/d15/f3a 0 2023-12-09T02:34:49.402 INFO:tasks.workunit.client.0.smithi088.stdout:0/241: write fc [1797807,97278] 0 2023-12-09T02:34:49.402 INFO:tasks.workunit.client.0.smithi088.stdout:2/263: dread d6/d8/f1d [0,4194304] 0 2023-12-09T02:34:49.404 INFO:tasks.workunit.client.0.smithi088.stdout:9/206: rename df/d20/c38 to df/d20/d30/c4b 0 2023-12-09T02:34:49.404 INFO:tasks.workunit.client.0.smithi088.stdout:9/207: chown df/d19/c22 15206156 1 2023-12-09T02:34:49.406 INFO:tasks.workunit.client.0.smithi088.stdout:8/303: mknod d2/d9/d13/d1c/d3b/c73 0 2023-12-09T02:34:49.407 INFO:tasks.workunit.client.0.smithi088.stdout:4/256: rmdir d3/dc/d18/d29/d4a 39 2023-12-09T02:34:49.410 INFO:tasks.workunit.client.0.smithi088.stdout:3/175: symlink d1/d2/d6/l3c 0 2023-12-09T02:34:49.412 INFO:tasks.workunit.client.0.smithi088.stdout:9/208: mkdir df/d20/d4c 0 2023-12-09T02:34:49.414 INFO:tasks.workunit.client.0.smithi088.stdout:8/304: mkdir d2/d9/d13/d1c/d74 0 2023-12-09T02:34:49.414 INFO:tasks.workunit.client.0.smithi088.stdout:8/305: chown d2/d9/d13/f2f 1730212 1 2023-12-09T02:34:49.416 INFO:tasks.workunit.client.0.smithi088.stdout:4/257: creat d3/dc/d1d/d40/f59 x:0 0 0 2023-12-09T02:34:49.418 INFO:tasks.workunit.client.0.smithi088.stdout:3/176: link d1/d9/c1e d1/d12/c3d 0 2023-12-09T02:34:49.418 INFO:tasks.workunit.client.0.smithi088.stdout:3/177: write d1/f5 [5026379,51195] 0 2023-12-09T02:34:49.419 INFO:tasks.workunit.client.0.smithi088.stdout:0/242: truncate df/d10/f15 3557812 0 2023-12-09T02:34:49.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:48 smithi161 ceph-mon[121170]: pgmap v192: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 8.7 MiB/s rd, 20 MiB/s wr, 389 op/s 2023-12-09T02:34:49.420 INFO:tasks.workunit.client.0.smithi088.stdout:9/209: symlink df/d20/d4c/l4d 0 2023-12-09T02:34:49.420 INFO:tasks.workunit.client.0.smithi088.stdout:9/210: write df/f3d [1505098,2905] 0 2023-12-09T02:34:49.421 INFO:tasks.workunit.client.0.smithi088.stdout:9/211: stat df/d19/f1e 0 2023-12-09T02:34:49.421 INFO:tasks.workunit.client.0.smithi088.stdout:9/212: chown df/d19/f1f 0 1 2023-12-09T02:34:49.421 INFO:tasks.workunit.client.0.smithi088.stdout:6/283: dwrite d16/d1b/f1e [0,4194304] 0 2023-12-09T02:34:49.422 INFO:tasks.workunit.client.0.smithi088.stdout:8/306: creat d2/d9/d13/d15/d6e/f75 x:0 0 0 2023-12-09T02:34:49.424 INFO:tasks.workunit.client.0.smithi088.stdout:4/258: mknod d3/dc/d1d/d3c/c5a 0 2023-12-09T02:34:49.426 INFO:tasks.workunit.client.0.smithi088.stdout:5/214: dwrite d3/f45 [0,4194304] 0 2023-12-09T02:34:49.427 INFO:tasks.workunit.client.0.smithi088.stdout:3/178: getdents d1 0 2023-12-09T02:34:49.427 INFO:tasks.workunit.client.0.smithi088.stdout:3/179: chown d1/d2/d6/ff 175318774 1 2023-12-09T02:34:49.427 INFO:tasks.workunit.client.0.smithi088.stdout:3/180: fdatasync d1/d9/f37 0 2023-12-09T02:34:49.429 INFO:tasks.workunit.client.0.smithi088.stdout:6/284: symlink d16/d35/d36/l58 0 2023-12-09T02:34:49.429 INFO:tasks.workunit.client.0.smithi088.stdout:1/309: sync 2023-12-09T02:34:49.430 INFO:tasks.workunit.client.0.smithi088.stdout:6/285: write f12 [3431276,127980] 0 2023-12-09T02:34:49.430 INFO:tasks.workunit.client.0.smithi088.stdout:6/286: fsync d16/d1b/d2c/f48 0 2023-12-09T02:34:49.430 INFO:tasks.workunit.client.0.smithi088.stdout:6/287: write d16/d1b/d25/f40 [214899,41704] 0 2023-12-09T02:34:49.435 INFO:tasks.workunit.client.0.smithi088.stdout:8/307: truncate f1 2838707 0 2023-12-09T02:34:49.437 INFO:tasks.workunit.client.0.smithi088.stdout:8/308: write f0 [167431,3265] 0 2023-12-09T02:34:49.437 INFO:tasks.workunit.client.0.smithi088.stdout:4/259: rmdir d3/d1f 39 2023-12-09T02:34:49.438 INFO:tasks.workunit.client.0.smithi088.stdout:4/260: chown d3/dc/d18/c56 679714130 1 2023-12-09T02:34:49.438 INFO:tasks.workunit.client.0.smithi088.stdout:4/261: chown d3/dc/d1d/d3c/c5a 167299946 1 2023-12-09T02:34:49.441 INFO:tasks.workunit.client.0.smithi088.stdout:7/287: truncate dc/d1b/d32/d38/f1d 45471 0 2023-12-09T02:34:49.441 INFO:tasks.workunit.client.0.smithi088.stdout:5/215: mkdir d3/d15/d2e/d49 0 2023-12-09T02:34:49.441 INFO:tasks.workunit.client.0.smithi088.stdout:5/216: write d3/f45 [4604679,45175] 0 2023-12-09T02:34:49.442 INFO:tasks.workunit.client.0.smithi088.stdout:3/181: rename d1/d2/d31 to d1/d3e 0 2023-12-09T02:34:49.444 INFO:tasks.workunit.client.0.smithi088.stdout:9/213: dwrite fc [4194304,4194304] 0 2023-12-09T02:34:49.444 INFO:tasks.workunit.client.0.smithi088.stdout:9/214: chown df/d19 152811789 1 2023-12-09T02:34:49.444 INFO:tasks.workunit.client.0.smithi088.stdout:9/215: readlink df/d20/d30/l39 0 2023-12-09T02:34:49.444 INFO:tasks.workunit.client.0.smithi088.stdout:9/216: fdatasync df/d29/d2f/f34 0 2023-12-09T02:34:49.444 INFO:tasks.workunit.client.0.smithi088.stdout:6/288: write d16/f31 [1332233,88089] 0 2023-12-09T02:34:49.444 INFO:tasks.workunit.client.0.smithi088.stdout:8/309: mkdir d2/d9/d1a/d62/d76 0 2023-12-09T02:34:49.445 INFO:tasks.workunit.client.0.smithi088.stdout:4/262: getdents d3/dc/d18/d29 0 2023-12-09T02:34:49.445 INFO:tasks.workunit.client.0.smithi088.stdout:4/263: write d3/f9 [243006,127125] 0 2023-12-09T02:34:49.448 INFO:tasks.workunit.client.0.smithi088.stdout:7/288: creat dc/d21/f61 x:0 0 0 2023-12-09T02:34:49.448 INFO:tasks.workunit.client.0.smithi088.stdout:7/289: chown dc/d21/f45 98602560 1 2023-12-09T02:34:49.448 INFO:tasks.workunit.client.0.smithi088.stdout:0/243: dwrite df/d10/d22/d2d/d3c/f47 [0,4194304] 0 2023-12-09T02:34:49.448 INFO:tasks.workunit.client.0.smithi088.stdout:5/217: truncate d3/d15/de/d10/d18/d19/d20/f27 604875 0 2023-12-09T02:34:49.449 INFO:tasks.workunit.client.0.smithi088.stdout:5/218: readlink d3/d15/l2f 0 2023-12-09T02:34:49.451 INFO:tasks.workunit.client.0.smithi088.stdout:1/310: rename d8/f1a to d8/d3d/d44/f6b 0 2023-12-09T02:34:49.451 INFO:tasks.workunit.client.0.smithi088.stdout:5/219: write d3/d15/de/d2c/f44 [707637,21205] 0 2023-12-09T02:34:49.451 INFO:tasks.workunit.client.0.smithi088.stdout:3/182: write d1/d2/d24/f2e [828166,71763] 0 2023-12-09T02:34:49.455 INFO:tasks.workunit.client.0.smithi088.stdout:9/217: mkdir df/d20/d30/d4e 0 2023-12-09T02:34:49.458 INFO:tasks.workunit.client.0.smithi088.stdout:6/289: link d16/d35/d36/c4e d16/d35/d36/c59 0 2023-12-09T02:34:49.461 INFO:tasks.workunit.client.0.smithi088.stdout:4/264: link d3/d1f/f3a d3/dc/d43/f5b 0 2023-12-09T02:34:49.461 INFO:tasks.workunit.client.0.smithi088.stdout:4/265: write d3/dc/d1d/d40/f41 [194040,81267] 0 2023-12-09T02:34:49.461 INFO:tasks.workunit.client.0.smithi088.stdout:8/310: dwrite d2/fa [0,4194304] 0 2023-12-09T02:34:49.462 INFO:tasks.workunit.client.0.smithi088.stdout:7/290: creat dc/d1b/d32/d3e/f62 x:0 0 0 2023-12-09T02:34:49.465 INFO:tasks.workunit.client.0.smithi088.stdout:0/244: creat df/d10/d22/f54 x:0 0 0 2023-12-09T02:34:49.466 INFO:tasks.workunit.client.0.smithi088.stdout:0/245: fdatasync fb 0 2023-12-09T02:34:49.471 INFO:tasks.workunit.client.0.smithi088.stdout:6/290: rmdir d16/d1b 39 2023-12-09T02:34:49.471 INFO:tasks.workunit.client.0.smithi088.stdout:1/311: dwrite d8/d1c/f5a [0,4194304] 0 2023-12-09T02:34:49.472 INFO:tasks.workunit.client.0.smithi088.stdout:9/218: dwrite df/f2c [0,4194304] 0 2023-12-09T02:34:49.473 INFO:tasks.workunit.client.0.smithi088.stdout:4/266: unlink f2 0 2023-12-09T02:34:49.478 INFO:tasks.workunit.client.0.smithi088.stdout:8/311: link d2/d9/d1a/d62/f4c d2/d9/d13/d1c/d74/f77 0 2023-12-09T02:34:49.479 INFO:tasks.workunit.client.0.smithi088.stdout:7/291: mknod dc/c63 0 2023-12-09T02:34:49.479 INFO:tasks.workunit.client.0.smithi088.stdout:7/292: write dc/d1b/d32/f34 [1833069,36851] 0 2023-12-09T02:34:49.479 INFO:tasks.workunit.client.0.smithi088.stdout:7/293: fsync dc/f47 0 2023-12-09T02:34:49.483 INFO:tasks.workunit.client.0.smithi088.stdout:0/246: getdents df/d10/d22/d2d/d3c 0 2023-12-09T02:34:49.483 INFO:tasks.workunit.client.0.smithi088.stdout:0/247: readlink df/d28/l50 0 2023-12-09T02:34:49.483 INFO:tasks.workunit.client.0.smithi088.stdout:0/248: truncate df/d28/d34/f48 88118 0 2023-12-09T02:34:49.485 INFO:tasks.workunit.client.0.smithi088.stdout:3/183: link d1/d9/d2b/f38 d1/d2/d6/f3f 0 2023-12-09T02:34:49.486 INFO:tasks.workunit.client.0.smithi088.stdout:6/291: chown d16/d1b/f1d 313563 1 2023-12-09T02:34:49.486 INFO:tasks.workunit.client.0.smithi088.stdout:6/292: truncate f14 1866367 0 2023-12-09T02:34:49.486 INFO:tasks.workunit.client.0.smithi088.stdout:1/312: dwrite d8/d1c/f5a [0,4194304] 0 2023-12-09T02:34:49.494 INFO:tasks.workunit.client.0.smithi088.stdout:9/219: rename df/l25 to df/d20/d30/d3f/d48/l4f 0 2023-12-09T02:34:49.495 INFO:tasks.workunit.client.0.smithi088.stdout:0/249: dwrite df/d10/f31 [0,4194304] 0 2023-12-09T02:34:49.496 INFO:tasks.workunit.client.0.smithi088.stdout:4/267: rmdir d3/dc/d1d/d3c 39 2023-12-09T02:34:49.499 INFO:tasks.workunit.client.0.smithi088.stdout:8/312: symlink d2/l78 0 2023-12-09T02:34:49.499 INFO:tasks.workunit.client.0.smithi088.stdout:8/313: stat d2/d9/d1a/d62/d76 0 2023-12-09T02:34:49.502 INFO:tasks.workunit.client.0.smithi088.stdout:7/294: symlink dc/d1b/d32/d3e/l64 0 2023-12-09T02:34:49.505 INFO:tasks.workunit.client.0.smithi088.stdout:3/184: symlink d1/d2/d6/l40 0 2023-12-09T02:34:49.507 INFO:tasks.workunit.client.0.smithi088.stdout:6/293: unlink d16/d1b/d25/f32 0 2023-12-09T02:34:49.507 INFO:tasks.workunit.client.0.smithi088.stdout:6/294: chown d16/d1b/d25/f3d 737777 1 2023-12-09T02:34:49.509 INFO:tasks.workunit.client.0.smithi088.stdout:1/313: getdents d8/d1c 0 2023-12-09T02:34:49.509 INFO:tasks.workunit.client.0.smithi088.stdout:1/314: stat d8/d1c/d31/c42 0 2023-12-09T02:34:49.514 INFO:tasks.workunit.client.0.smithi088.stdout:9/220: mkdir df/d50 0 2023-12-09T02:34:49.518 INFO:tasks.workunit.client.0.smithi088.stdout:3/185: rename d1/d9/dc to d1/d9/d2b/d41 0 2023-12-09T02:34:49.519 INFO:tasks.workunit.client.0.smithi088.stdout:6/295: mknod d16/d35/d36/c5a 0 2023-12-09T02:34:49.519 INFO:tasks.workunit.client.0.smithi088.stdout:0/250: dwrite df/d28/d43/f49 [0,4194304] 0 2023-12-09T02:34:49.520 INFO:tasks.workunit.client.0.smithi088.stdout:1/315: mkdir d8/d1c/d50/d6c 0 2023-12-09T02:34:49.520 INFO:tasks.workunit.client.0.smithi088.stdout:1/316: read - d8/f61 zero size 2023-12-09T02:34:49.521 INFO:tasks.workunit.client.0.smithi088.stdout:9/221: mknod df/d29/c51 0 2023-12-09T02:34:49.523 INFO:tasks.workunit.client.0.smithi088.stdout:6/296: mknod d16/d35/d36/c5b 0 2023-12-09T02:34:49.524 INFO:tasks.workunit.client.0.smithi088.stdout:3/186: dread d1/f1c [0,4194304] 0 2023-12-09T02:34:49.526 INFO:tasks.workunit.client.0.smithi088.stdout:3/187: read d1/d2/d15/f3a [1220326,111021] 0 2023-12-09T02:34:49.527 INFO:tasks.workunit.client.0.smithi088.stdout:1/317: rmdir d8/d1b/d1d 39 2023-12-09T02:34:49.527 INFO:tasks.workunit.client.0.smithi088.stdout:4/268: dwrite d3/d1f/f25 [0,4194304] 0 2023-12-09T02:34:49.527 INFO:tasks.workunit.client.0.smithi088.stdout:1/318: write f2 [3991695,49650] 0 2023-12-09T02:34:49.529 INFO:tasks.workunit.client.0.smithi088.stdout:9/222: mkdir df/d20/d30/d52 0 2023-12-09T02:34:49.534 INFO:tasks.workunit.client.0.smithi088.stdout:8/314: dwrite d2/f41 [0,4194304] 0 2023-12-09T02:34:49.537 INFO:tasks.workunit.client.0.smithi088.stdout:1/319: unlink l1 0 2023-12-09T02:34:49.538 INFO:tasks.workunit.client.0.smithi088.stdout:9/223: mknod df/d29/d2f/c53 0 2023-12-09T02:34:49.540 INFO:tasks.workunit.client.0.smithi088.stdout:3/188: unlink d1/f5 0 2023-12-09T02:34:49.541 INFO:tasks.workunit.client.0.smithi088.stdout:3/189: write d1/d9/d2b/f38 [3415265,101071] 0 2023-12-09T02:34:49.541 INFO:tasks.workunit.client.0.smithi088.stdout:9/224: dread df/d19/f23 [0,4194304] 0 2023-12-09T02:34:49.541 INFO:tasks.workunit.client.0.smithi088.stdout:9/225: dread - df/d20/d30/f43 zero size 2023-12-09T02:34:49.541 INFO:tasks.workunit.client.0.smithi088.stdout:9/226: stat df/c21 0 2023-12-09T02:34:49.542 INFO:tasks.workunit.client.0.smithi088.stdout:3/190: write d1/d2/d6/f36 [2567252,57903] 0 2023-12-09T02:34:49.542 INFO:tasks.workunit.client.0.smithi088.stdout:3/191: truncate d1/d9/d2b/f38 3565546 0 2023-12-09T02:34:49.542 INFO:tasks.workunit.client.0.smithi088.stdout:3/192: stat d1/d9/d2b 0 2023-12-09T02:34:49.542 INFO:tasks.workunit.client.0.smithi088.stdout:3/193: stat d1/d9/d2b/d41 0 2023-12-09T02:34:49.543 INFO:tasks.workunit.client.0.smithi088.stdout:8/315: creat d2/d9/d1a/d62/d76/f79 x:0 0 0 2023-12-09T02:34:49.544 INFO:tasks.workunit.client.0.smithi088.stdout:8/316: read f1 [1033329,13123] 0 2023-12-09T02:34:49.544 INFO:tasks.workunit.client.0.smithi088.stdout:1/320: mkdir d8/d1b/d6d 0 2023-12-09T02:34:49.545 INFO:tasks.workunit.client.0.smithi088.stdout:4/269: dwrite d3/f16 [0,4194304] 0 2023-12-09T02:34:49.546 INFO:tasks.workunit.client.0.smithi088.stdout:0/251: dwrite df/d10/d22/d2d/d3c/f47 [0,4194304] 0 2023-12-09T02:34:49.546 INFO:tasks.workunit.client.0.smithi088.stdout:0/252: stat f4 0 2023-12-09T02:34:49.547 INFO:tasks.workunit.client.0.smithi088.stdout:9/227: mkdir df/d20/d30/d54 0 2023-12-09T02:34:49.547 INFO:tasks.workunit.client.0.smithi088.stdout:9/228: stat df/d29/d2f 0 2023-12-09T02:34:49.548 INFO:tasks.workunit.client.0.smithi088.stdout:3/194: creat d1/d9/d2b/d41/d33/f42 x:0 0 0 2023-12-09T02:34:49.550 INFO:tasks.workunit.client.0.smithi088.stdout:8/317: symlink d2/d9/d1a/d62/l7a 0 2023-12-09T02:34:49.550 INFO:tasks.workunit.client.0.smithi088.stdout:1/321: creat d8/d1c/d31/f6e x:0 0 0 2023-12-09T02:34:49.556 INFO:tasks.workunit.client.0.smithi088.stdout:0/253: creat df/d28/d43/f55 x:0 0 0 2023-12-09T02:34:49.557 INFO:tasks.workunit.client.0.smithi088.stdout:0/254: read df/f2c [6985219,54362] 0 2023-12-09T02:34:49.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/229: mkdir df/d20/d30/d4e/d55 0 2023-12-09T02:34:49.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/230: chown df/d20 1144 1 2023-12-09T02:34:49.558 INFO:tasks.workunit.client.0.smithi088.stdout:3/195: mkdir d1/d2/d22/d43 0 2023-12-09T02:34:49.559 INFO:tasks.workunit.client.0.smithi088.stdout:3/196: truncate d1/d2/f32 4242626 0 2023-12-09T02:34:49.559 INFO:tasks.workunit.client.0.smithi088.stdout:8/318: mknod d2/d9/c7b 0 2023-12-09T02:34:49.559 INFO:tasks.workunit.client.0.smithi088.stdout:8/319: chown f0 15 1 2023-12-09T02:34:49.561 INFO:tasks.workunit.client.0.smithi088.stdout:1/322: mknod d8/d1b/c6f 0 2023-12-09T02:34:49.562 INFO:tasks.workunit.client.0.smithi088.stdout:0/255: creat df/d28/d33/f56 x:0 0 0 2023-12-09T02:34:49.562 INFO:tasks.workunit.client.0.smithi088.stdout:9/231: truncate df/d19/f23 514295 0 2023-12-09T02:34:49.565 INFO:tasks.workunit.client.0.smithi088.stdout:1/323: creat d8/d1c/d50/d6c/f70 x:0 0 0 2023-12-09T02:34:49.565 INFO:tasks.workunit.client.0.smithi088.stdout:9/232: creat df/d20/d4c/f56 x:0 0 0 2023-12-09T02:34:49.566 INFO:tasks.workunit.client.0.smithi088.stdout:9/233: write df/d20/d30/d3f/d48/f45 [1083992,72939] 0 2023-12-09T02:34:49.567 INFO:tasks.workunit.client.0.smithi088.stdout:9/234: symlink df/d20/d30/d3f/l57 0 2023-12-09T02:34:49.578 INFO:tasks.workunit.client.0.smithi088.stdout:9/235: dread f7 [0,4194304] 0 2023-12-09T02:34:49.578 INFO:tasks.workunit.client.0.smithi088.stdout:2/264: sync 2023-12-09T02:34:49.579 INFO:tasks.workunit.client.0.smithi088.stdout:9/236: creat df/d50/f58 x:0 0 0 2023-12-09T02:34:49.595 INFO:tasks.workunit.client.0.smithi088.stdout:9/237: dread df/f1c [0,4194304] 0 2023-12-09T02:34:49.596 INFO:tasks.workunit.client.0.smithi088.stdout:9/238: link df/d20/c27 df/d20/c59 0 2023-12-09T02:34:49.596 INFO:tasks.workunit.client.0.smithi088.stdout:9/239: getdents df/d29/d2f 0 2023-12-09T02:34:49.597 INFO:tasks.workunit.client.0.smithi088.stdout:9/240: read df/d29/d2f/f3c [298746,45876] 0 2023-12-09T02:34:49.597 INFO:tasks.workunit.client.0.smithi088.stdout:9/241: chown cd 343 1 2023-12-09T02:34:49.598 INFO:tasks.workunit.client.0.smithi088.stdout:9/242: mkdir df/d20/d30/d4e/d55/d5a 0 2023-12-09T02:34:49.598 INFO:tasks.workunit.client.0.smithi088.stdout:9/243: mkdir df/d20/d5b 0 2023-12-09T02:34:49.604 INFO:tasks.workunit.client.0.smithi088.stdout:0/256: dwrite df/f25 [0,4194304] 0 2023-12-09T02:34:49.604 INFO:tasks.workunit.client.0.smithi088.stdout:8/320: dwrite d2/d9/d1a/d62/f4c [0,4194304] 0 2023-12-09T02:34:49.604 INFO:tasks.workunit.client.0.smithi088.stdout:8/321: stat d2/d2b 0 2023-12-09T02:34:49.604 INFO:tasks.workunit.client.0.smithi088.stdout:1/324: dwrite d8/d1b/f2e [0,4194304] 0 2023-12-09T02:34:49.604 INFO:tasks.workunit.client.0.smithi088.stdout:3/197: dwrite d1/d2/d24/f2e [0,4194304] 0 2023-12-09T02:34:49.604 INFO:tasks.workunit.client.0.smithi088.stdout:2/265: dwrite d6/d13/f1e [0,4194304] 0 2023-12-09T02:34:49.604 INFO:tasks.workunit.client.0.smithi088.stdout:2/266: chown d6/d8/d1f/f3b 3441 1 2023-12-09T02:34:49.608 INFO:tasks.workunit.client.0.smithi088.stdout:0/257: unlink df/c1d 0 2023-12-09T02:34:49.613 INFO:tasks.workunit.client.0.smithi088.stdout:1/325: write d8/f38 [19612,99103] 0 2023-12-09T02:34:49.615 INFO:tasks.workunit.client.0.smithi088.stdout:3/198: fsync d1/fa 0 2023-12-09T02:34:49.616 INFO:tasks.workunit.client.0.smithi088.stdout:8/322: dwrite d2/f8 [0,4194304] 0 2023-12-09T02:34:49.616 INFO:tasks.workunit.client.0.smithi088.stdout:2/267: getdents d6/d8/d4e/d3c 0 2023-12-09T02:34:49.618 INFO:tasks.workunit.client.0.smithi088.stdout:1/326: creat d8/d59/f71 x:0 0 0 2023-12-09T02:34:49.623 INFO:tasks.workunit.client.0.smithi088.stdout:8/323: rename d2/d2b/c6b to d2/d9/d13/d1c/c7c 0 2023-12-09T02:34:49.625 INFO:tasks.workunit.client.0.smithi088.stdout:1/327: truncate d8/d1b/d1d/f2d 467431 0 2023-12-09T02:34:49.627 INFO:tasks.workunit.client.0.smithi088.stdout:1/328: creat d8/d1c/d50/f72 x:0 0 0 2023-12-09T02:34:49.628 INFO:tasks.workunit.client.0.smithi088.stdout:2/268: dread f0 [0,4194304] 0 2023-12-09T02:34:49.628 INFO:tasks.workunit.client.0.smithi088.stdout:2/269: write d6/d8/d1f/d22/f38 [1347256,54900] 0 2023-12-09T02:34:49.628 INFO:tasks.workunit.client.0.smithi088.stdout:1/329: symlink d8/d3d/d44/l73 0 2023-12-09T02:34:49.628 INFO:tasks.workunit.client.0.smithi088.stdout:1/330: readlink d8/d27/l46 0 2023-12-09T02:34:49.628 INFO:tasks.workunit.client.0.smithi088.stdout:1/331: readlink d8/d1c/l24 0 2023-12-09T02:34:49.630 INFO:tasks.workunit.client.0.smithi088.stdout:1/332: symlink d8/d3d/l74 0 2023-12-09T02:34:49.637 INFO:tasks.workunit.client.0.smithi088.stdout:3/199: dwrite d1/fa [4194304,4194304] 0 2023-12-09T02:34:49.644 INFO:tasks.workunit.client.0.smithi088.stdout:3/200: dread d1/d2/f32 [0,4194304] 0 2023-12-09T02:34:49.652 INFO:tasks.workunit.client.0.smithi088.stdout:2/270: dwrite d6/d20/d3d/f4a [0,4194304] 0 2023-12-09T02:34:49.659 INFO:tasks.workunit.client.0.smithi088.stdout:2/271: dread d6/f55 [0,4194304] 0 2023-12-09T02:34:49.660 INFO:tasks.workunit.client.0.smithi088.stdout:5/220: sync 2023-12-09T02:34:49.660 INFO:tasks.workunit.client.0.smithi088.stdout:2/272: unlink d6/d20/c44 0 2023-12-09T02:34:49.661 INFO:tasks.workunit.client.0.smithi088.stdout:2/273: read f1 [118797,68840] 0 2023-12-09T02:34:49.661 INFO:tasks.workunit.client.0.smithi088.stdout:5/221: creat d3/d15/de/d10/d18/f4a x:0 0 0 2023-12-09T02:34:49.662 INFO:tasks.workunit.client.0.smithi088.stdout:2/274: creat d6/d8/d54/f65 x:0 0 0 2023-12-09T02:34:49.662 INFO:tasks.workunit.client.0.smithi088.stdout:5/222: mknod d3/d15/c4b 0 2023-12-09T02:34:49.663 INFO:tasks.workunit.client.0.smithi088.stdout:2/275: creat d6/d8/d4e/d64/f66 x:0 0 0 2023-12-09T02:34:49.663 INFO:tasks.workunit.client.0.smithi088.stdout:2/276: write d6/d20/f23 [1682900,129175] 0 2023-12-09T02:34:49.664 INFO:tasks.workunit.client.0.smithi088.stdout:2/277: symlink d6/d20/d3d/l67 0 2023-12-09T02:34:49.666 INFO:tasks.workunit.client.0.smithi088.stdout:5/223: dread d3/d15/de/d10/d18/d19/d1b/d35/d42/f21 [0,4194304] 0 2023-12-09T02:34:49.666 INFO:tasks.workunit.client.0.smithi088.stdout:1/333: dwrite d8/f34 [0,4194304] 0 2023-12-09T02:34:49.666 INFO:tasks.workunit.client.0.smithi088.stdout:5/224: stat d3/d15/dc/c30 0 2023-12-09T02:34:49.667 INFO:tasks.workunit.client.0.smithi088.stdout:2/278: dread d6/f5d [0,4194304] 0 2023-12-09T02:34:49.667 INFO:tasks.workunit.client.0.smithi088.stdout:2/279: fsync d6/d13/f15 0 2023-12-09T02:34:49.667 INFO:tasks.workunit.client.0.smithi088.stdout:3/201: dwrite d1/d2/d22/f39 [0,4194304] 0 2023-12-09T02:34:49.667 INFO:tasks.workunit.client.0.smithi088.stdout:3/202: chown d1/d9/c28 1471809 1 2023-12-09T02:34:49.667 INFO:tasks.workunit.client.0.smithi088.stdout:5/225: write d3/d15/de/d10/d18/d19/d20/f27 [503635,125894] 0 2023-12-09T02:34:49.667 INFO:tasks.workunit.client.0.smithi088.stdout:5/226: write d3/f45 [3539273,47940] 0 2023-12-09T02:34:49.670 INFO:tasks.workunit.client.0.smithi088.stdout:1/334: truncate f3 2934034 0 2023-12-09T02:34:49.672 INFO:tasks.workunit.client.0.smithi088.stdout:2/280: mkdir d6/d8/d1f/d22/d68 0 2023-12-09T02:34:49.672 INFO:tasks.workunit.client.0.smithi088.stdout:2/281: chown d6/d20 29884945 1 2023-12-09T02:34:49.675 INFO:tasks.workunit.client.0.smithi088.stdout:3/203: creat d1/d2/d22/d43/f44 x:0 0 0 2023-12-09T02:34:49.676 INFO:tasks.workunit.client.0.smithi088.stdout:1/335: mkdir d8/d27/d75 0 2023-12-09T02:34:49.676 INFO:tasks.workunit.client.0.smithi088.stdout:5/227: dread d3/d15/de/f17 [0,4194304] 0 2023-12-09T02:34:49.677 INFO:tasks.workunit.client.0.smithi088.stdout:2/282: mkdir d6/d20/d69 0 2023-12-09T02:34:49.677 INFO:tasks.workunit.client.0.smithi088.stdout:2/283: chown d6/d13/f15 651302 1 2023-12-09T02:34:49.677 INFO:tasks.workunit.client.0.smithi088.stdout:2/284: fdatasync d6/d20/f43 0 2023-12-09T02:34:49.679 INFO:tasks.workunit.client.0.smithi088.stdout:3/204: write d1/d12/f18 [4010915,27818] 0 2023-12-09T02:34:49.679 INFO:tasks.workunit.client.0.smithi088.stdout:1/336: creat d8/d27/d40/f76 x:0 0 0 2023-12-09T02:34:49.683 INFO:tasks.workunit.client.0.smithi088.stdout:5/228: dread d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:49.686 INFO:tasks.workunit.client.0.smithi088.stdout:2/285: symlink d6/d13/l6a 0 2023-12-09T02:34:49.694 INFO:tasks.workunit.client.0.smithi088.stdout:5/229: dread d3/d15/f1f [0,4194304] 0 2023-12-09T02:34:49.695 INFO:tasks.workunit.client.0.smithi088.stdout:5/230: mknod d3/c4c 0 2023-12-09T02:34:49.699 INFO:tasks.workunit.client.0.smithi088.stdout:3/205: dwrite d1/d2/d15/f3a [0,4194304] 0 2023-12-09T02:34:49.703 INFO:tasks.workunit.client.0.smithi088.stdout:3/206: rename d1/d12 to d1/d2/d24/d45 0 2023-12-09T02:34:49.704 INFO:tasks.workunit.client.0.smithi088.stdout:3/207: readlink d1/l1f 0 2023-12-09T02:34:49.704 INFO:tasks.workunit.client.0.smithi088.stdout:3/208: fdatasync d1/d2/d24/d45/f18 0 2023-12-09T02:34:49.706 INFO:tasks.workunit.client.0.smithi088.stdout:3/209: creat d1/d2/d2d/f46 x:0 0 0 2023-12-09T02:34:49.706 INFO:tasks.workunit.client.0.smithi088.stdout:3/210: readlink d1/l8 0 2023-12-09T02:34:49.706 INFO:tasks.workunit.client.0.smithi088.stdout:3/211: write d1/d2/d22/d43/f44 [980300,66911] 0 2023-12-09T02:34:49.708 INFO:tasks.workunit.client.0.smithi088.stdout:3/212: link d1/d2/d6/f36 d1/d2/d24/d45/f47 0 2023-12-09T02:34:49.708 INFO:tasks.workunit.client.0.smithi088.stdout:3/213: dread - d1/d9/f37 zero size 2023-12-09T02:34:49.711 INFO:tasks.workunit.client.0.smithi088.stdout:1/337: dwrite d8/f34 [0,4194304] 0 2023-12-09T02:34:49.711 INFO:tasks.workunit.client.0.smithi088.stdout:5/231: dwrite d3/f3d [0,4194304] 0 2023-12-09T02:34:49.711 INFO:tasks.workunit.client.0.smithi088.stdout:5/232: read - d3/d15/de/d10/d18/d19/d20/f43 zero size 2023-12-09T02:34:49.713 INFO:tasks.workunit.client.0.smithi088.stdout:1/338: link d8/d59/f71 d8/d27/d40/f77 0 2023-12-09T02:34:49.713 INFO:tasks.workunit.client.0.smithi088.stdout:1/339: write d8/d1c/d31/f39 [469473,83069] 0 2023-12-09T02:34:49.715 INFO:tasks.workunit.client.0.smithi088.stdout:5/233: symlink d3/d15/de/d10/l4d 0 2023-12-09T02:34:49.717 INFO:tasks.workunit.client.0.smithi088.stdout:1/340: rename d8/d1b/d1d/f2d to d8/d1c/d50/f78 0 2023-12-09T02:34:49.717 INFO:tasks.workunit.client.0.smithi088.stdout:1/341: chown d8/d1b/f2e 11587 1 2023-12-09T02:34:49.718 INFO:tasks.workunit.client.0.smithi088.stdout:5/234: creat d3/d15/de/d10/d18/f4e x:0 0 0 2023-12-09T02:34:49.718 INFO:tasks.workunit.client.0.smithi088.stdout:5/235: chown d3/d15/de/d2c/d3e 20 1 2023-12-09T02:34:49.722 INFO:tasks.workunit.client.0.smithi088.stdout:5/236: creat d3/d15/d2e/d49/f4f x:0 0 0 2023-12-09T02:34:49.722 INFO:tasks.workunit.client.0.smithi088.stdout:5/237: stat d3 0 2023-12-09T02:34:49.722 INFO:tasks.workunit.client.0.smithi088.stdout:5/238: chown d3/d15/de/d2c/f44 39853 1 2023-12-09T02:34:49.722 INFO:tasks.workunit.client.0.smithi088.stdout:5/239: fsync d3/f3d 0 2023-12-09T02:34:49.722 INFO:tasks.workunit.client.0.smithi088.stdout:5/240: symlink d3/d15/de/d10/d18/l50 0 2023-12-09T02:34:49.725 INFO:tasks.workunit.client.0.smithi088.stdout:6/297: sync 2023-12-09T02:34:49.725 INFO:tasks.workunit.client.0.smithi088.stdout:7/295: sync 2023-12-09T02:34:49.725 INFO:tasks.workunit.client.0.smithi088.stdout:4/270: sync 2023-12-09T02:34:49.725 INFO:tasks.workunit.client.0.smithi088.stdout:7/296: fsync fb 0 2023-12-09T02:34:49.729 INFO:tasks.workunit.client.0.smithi088.stdout:6/298: rename d16/d35/d36/c5b to d16/c5c 0 2023-12-09T02:34:49.731 INFO:tasks.workunit.client.0.smithi088.stdout:7/297: rename dc/d1b/l20 to dc/d1b/d32/d38/l65 0 2023-12-09T02:34:49.733 INFO:tasks.workunit.client.0.smithi088.stdout:7/298: mkdir dc/d1b/d66 0 2023-12-09T02:34:49.734 INFO:tasks.workunit.client.0.smithi088.stdout:3/214: dwrite d1/d2/d6/ff [0,4194304] 0 2023-12-09T02:34:49.735 INFO:tasks.workunit.client.0.smithi088.stdout:7/299: rename dc/c56 to dc/c67 0 2023-12-09T02:34:49.735 INFO:tasks.workunit.client.0.smithi088.stdout:7/300: fsync dc/d1b/d32/f3c 0 2023-12-09T02:34:49.736 INFO:tasks.workunit.client.0.smithi088.stdout:4/271: dread d3/dc/d1d/f3f [0,4194304] 0 2023-12-09T02:34:49.736 INFO:tasks.workunit.client.0.smithi088.stdout:7/301: mknod dc/d21/c68 0 2023-12-09T02:34:49.736 INFO:tasks.workunit.client.0.smithi088.stdout:7/302: stat dc/d21/c54 0 2023-12-09T02:34:49.737 INFO:tasks.workunit.client.0.smithi088.stdout:4/272: getdents d3/dc/d43 0 2023-12-09T02:34:49.739 INFO:tasks.workunit.client.0.smithi088.stdout:7/303: creat dc/d1b/d32/d5d/f69 x:0 0 0 2023-12-09T02:34:49.739 INFO:tasks.workunit.client.0.smithi088.stdout:7/304: chown dc/d1b/d32/d38/d1e/c59 438541 1 2023-12-09T02:34:49.740 INFO:tasks.workunit.client.0.smithi088.stdout:4/273: mknod d3/d1f/d37/c5c 0 2023-12-09T02:34:49.741 INFO:tasks.workunit.client.0.smithi088.stdout:7/305: symlink dc/d1b/d32/d5d/l6a 0 2023-12-09T02:34:49.741 INFO:tasks.workunit.client.0.smithi088.stdout:7/306: chown dc/d1b/d32/d38 29892864 1 2023-12-09T02:34:49.741 INFO:tasks.workunit.client.0.smithi088.stdout:7/307: dread - dc/d1b/d32/d38/f44 zero size 2023-12-09T02:34:49.742 INFO:tasks.workunit.client.0.smithi088.stdout:4/274: symlink d3/l5d 0 2023-12-09T02:34:49.743 INFO:tasks.workunit.client.0.smithi088.stdout:7/308: mkdir dc/d21/d6b 0 2023-12-09T02:34:49.745 INFO:tasks.workunit.client.0.smithi088.stdout:1/342: dwrite d8/d59/f71 [0,4194304] 0 2023-12-09T02:34:49.746 INFO:tasks.workunit.client.0.smithi088.stdout:4/275: dread d3/dc/d1d/f36 [0,4194304] 0 2023-12-09T02:34:49.747 INFO:tasks.workunit.client.0.smithi088.stdout:4/276: truncate d3/dc/d1d/d40/f50 733901 0 2023-12-09T02:34:49.748 INFO:tasks.workunit.client.0.smithi088.stdout:1/343: mkdir d8/d27/d66/d79 0 2023-12-09T02:34:49.748 INFO:tasks.workunit.client.0.smithi088.stdout:1/344: write d8/d1c/d50/d6c/f70 [319623,33802] 0 2023-12-09T02:34:49.749 INFO:tasks.workunit.client.0.smithi088.stdout:5/241: dwrite d3/d15/de/d10/d18/d19/d20/f27 [0,4194304] 0 2023-12-09T02:34:49.749 INFO:tasks.workunit.client.0.smithi088.stdout:1/345: write d8/d1c/f28 [171808,17504] 0 2023-12-09T02:34:49.750 INFO:tasks.workunit.client.0.smithi088.stdout:1/346: write d8/d3d/f4f [911684,35375] 0 2023-12-09T02:34:49.751 INFO:tasks.workunit.client.0.smithi088.stdout:4/277: mknod d3/d1f/c5e 0 2023-12-09T02:34:49.758 INFO:tasks.workunit.client.0.smithi088.stdout:3/215: dwrite d1/d2/f2f [0,4194304] 0 2023-12-09T02:34:49.758 INFO:tasks.workunit.client.0.smithi088.stdout:3/216: dread - d1/d2/d2d/f46 zero size 2023-12-09T02:34:49.761 INFO:tasks.workunit.client.0.smithi088.stdout:7/309: dread dc/f43 [0,4194304] 0 2023-12-09T02:34:49.761 INFO:tasks.workunit.client.0.smithi088.stdout:7/310: fdatasync dc/d1b/d32/d38/d1e/f60 0 2023-12-09T02:34:49.764 INFO:tasks.workunit.client.0.smithi088.stdout:7/311: symlink dc/d1b/d32/l6c 0 2023-12-09T02:34:49.764 INFO:tasks.workunit.client.0.smithi088.stdout:7/312: chown l7 109651005 1 2023-12-09T02:34:49.765 INFO:tasks.workunit.client.0.smithi088.stdout:7/313: mkdir dc/d21/d6b/d6d 0 2023-12-09T02:34:49.767 INFO:tasks.workunit.client.0.smithi088.stdout:7/314: creat dc/d1b/f6e x:0 0 0 2023-12-09T02:34:49.767 INFO:tasks.workunit.client.0.smithi088.stdout:7/315: write dc/d1b/d32/f5e [651340,15273] 0 2023-12-09T02:34:49.771 INFO:tasks.workunit.client.0.smithi088.stdout:1/347: write d8/d27/d40/f77 [4132597,62009] 0 2023-12-09T02:34:49.771 INFO:tasks.workunit.client.0.smithi088.stdout:1/348: getdents d8/d27/d75 0 2023-12-09T02:34:49.772 INFO:tasks.workunit.client.0.smithi088.stdout:4/278: dwrite d3/dc/d1d/d40/f59 [0,4194304] 0 2023-12-09T02:34:49.772 INFO:tasks.workunit.client.0.smithi088.stdout:4/279: write d3/f6 [2819751,11562] 0 2023-12-09T02:34:49.776 INFO:tasks.workunit.client.0.smithi088.stdout:1/349: unlink d8/d3d/d5d/f69 0 2023-12-09T02:34:49.780 INFO:tasks.workunit.client.0.smithi088.stdout:9/244: sync 2023-12-09T02:34:49.780 INFO:tasks.workunit.client.0.smithi088.stdout:0/258: sync 2023-12-09T02:34:49.780 INFO:tasks.workunit.client.0.smithi088.stdout:0/259: dread - df/d10/d22/d2d/f52 zero size 2023-12-09T02:34:49.780 INFO:tasks.workunit.client.0.smithi088.stdout:9/245: getdents df/d20/d30/d54 0 2023-12-09T02:34:49.781 INFO:tasks.workunit.client.0.smithi088.stdout:0/260: rename df/d28/d43/f55 to df/f57 0 2023-12-09T02:34:49.781 INFO:tasks.workunit.client.0.smithi088.stdout:0/261: chown df/d28/l2f 3 1 2023-12-09T02:34:49.787 INFO:tasks.workunit.client.0.smithi088.stdout:9/246: rename df/d19 to df/d20/d30/d54/d5c 0 2023-12-09T02:34:49.788 INFO:tasks.workunit.client.0.smithi088.stdout:5/242: dwrite d3/d15/de/f17 [0,4194304] 0 2023-12-09T02:34:49.788 INFO:tasks.workunit.client.0.smithi088.stdout:5/243: fsync d3/f45 0 2023-12-09T02:34:49.788 INFO:tasks.workunit.client.0.smithi088.stdout:5/244: write d3/f24 [5067090,42335] 0 2023-12-09T02:34:49.788 INFO:tasks.workunit.client.0.smithi088.stdout:9/247: link df/d20/d30/c4b df/d20/d5b/c5d 0 2023-12-09T02:34:49.788 INFO:tasks.workunit.client.0.smithi088.stdout:0/262: rmdir df 39 2023-12-09T02:34:49.789 INFO:tasks.workunit.client.0.smithi088.stdout:3/217: dwrite d1/d2/d22/f39 [0,4194304] 0 2023-12-09T02:34:49.789 INFO:tasks.workunit.client.0.smithi088.stdout:3/218: chown d1/d2/d24/l2a 174 1 2023-12-09T02:34:49.789 INFO:tasks.workunit.client.0.smithi088.stdout:3/219: write d1/d2/f32 [2161156,46319] 0 2023-12-09T02:34:49.790 INFO:tasks.workunit.client.0.smithi088.stdout:5/245: mkdir d3/d15/de/d10/d51 0 2023-12-09T02:34:49.791 INFO:tasks.workunit.client.0.smithi088.stdout:9/248: rmdir df/d20/d30/d4e/d55/d5a 0 2023-12-09T02:34:49.791 INFO:tasks.workunit.client.0.smithi088.stdout:9/249: write df/d20/d30/f43 [970575,881] 0 2023-12-09T02:34:49.792 INFO:tasks.workunit.client.0.smithi088.stdout:0/263: symlink df/d28/d34/l58 0 2023-12-09T02:34:49.792 INFO:tasks.workunit.client.0.smithi088.stdout:0/264: chown df/l1c 228012129 1 2023-12-09T02:34:49.792 INFO:tasks.workunit.client.0.smithi088.stdout:0/265: truncate df/d28/d33/f4e 304394 0 2023-12-09T02:34:49.794 INFO:tasks.workunit.client.0.smithi088.stdout:3/220: creat d1/d9/d2b/f48 x:0 0 0 2023-12-09T02:34:49.795 INFO:tasks.workunit.client.0.smithi088.stdout:5/246: mknod d3/d15/de/d10/d18/d19/d1b/d35/d42/d47/c52 0 2023-12-09T02:34:49.795 INFO:tasks.workunit.client.0.smithi088.stdout:5/247: getdents d3/d15/de/d10/d51 0 2023-12-09T02:34:49.795 INFO:tasks.workunit.client.0.smithi088.stdout:9/250: truncate df/f13 723948 0 2023-12-09T02:34:49.796 INFO:tasks.workunit.client.0.smithi088.stdout:0/266: getdents df/d10 0 2023-12-09T02:34:49.797 INFO:tasks.workunit.client.0.smithi088.stdout:4/280: dwrite d3/dc/d18/d29/f3b [0,4194304] 0 2023-12-09T02:34:49.797 INFO:tasks.workunit.client.0.smithi088.stdout:4/281: readlink d3/dc/d18/l53 0 2023-12-09T02:34:49.797 INFO:tasks.workunit.client.0.smithi088.stdout:4/282: chown d3/l3e 6794 1 2023-12-09T02:34:49.797 INFO:tasks.workunit.client.0.smithi088.stdout:1/350: dwrite d8/f3e [0,4194304] 0 2023-12-09T02:34:49.797 INFO:tasks.workunit.client.0.smithi088.stdout:3/221: mkdir d1/d9/d2b/d41/d33/d49 0 2023-12-09T02:34:49.797 INFO:tasks.workunit.client.0.smithi088.stdout:3/222: write d1/d9/d2b/d41/d33/f42 [1001888,34241] 0 2023-12-09T02:34:49.798 INFO:tasks.workunit.client.0.smithi088.stdout:5/248: creat d3/d15/de/d10/d18/d19/d20/f53 x:0 0 0 2023-12-09T02:34:49.798 INFO:tasks.workunit.client.0.smithi088.stdout:1/351: write d8/d1c/f28 [7633299,36149] 0 2023-12-09T02:34:49.798 INFO:tasks.workunit.client.0.smithi088.stdout:1/352: write d8/d3d/d44/f6b [5465440,65140] 0 2023-12-09T02:34:49.800 INFO:tasks.workunit.client.0.smithi088.stdout:9/251: rename df/f1b to df/d20/d30/d3f/d48/f5e 0 2023-12-09T02:34:49.801 INFO:tasks.workunit.client.0.smithi088.stdout:0/267: symlink df/d10/d22/d2d/l59 0 2023-12-09T02:34:49.805 INFO:tasks.workunit.client.0.smithi088.stdout:4/283: mknod d3/dc/d1d/c5f 0 2023-12-09T02:34:49.805 INFO:tasks.workunit.client.0.smithi088.stdout:4/284: truncate d3/dc/d18/d29/f3d 546956 0 2023-12-09T02:34:49.813 INFO:tasks.workunit.client.0.smithi088.stdout:5/249: unlink d3/d15/de/d10/d18/d19/d1b/d35/d42/f28 0 2023-12-09T02:34:49.813 INFO:tasks.workunit.client.0.smithi088.stdout:5/250: fdatasync d3/d8/f9 0 2023-12-09T02:34:49.817 INFO:tasks.workunit.client.0.smithi088.stdout:1/353: symlink d8/d1c/d31/l7a 0 2023-12-09T02:34:49.818 INFO:tasks.workunit.client.0.smithi088.stdout:4/285: truncate d3/d1f/f25 3185147 0 2023-12-09T02:34:49.820 INFO:tasks.workunit.client.0.smithi088.stdout:1/354: symlink d8/d27/l7b 0 2023-12-09T02:34:49.821 INFO:tasks.workunit.client.0.smithi088.stdout:4/286: getdents d3/dc 0 2023-12-09T02:34:49.822 INFO:tasks.workunit.client.0.smithi088.stdout:1/355: truncate d8/f34 302070 0 2023-12-09T02:34:49.822 INFO:tasks.workunit.client.0.smithi088.stdout:1/356: dread - d8/d27/d40/f4b zero size 2023-12-09T02:34:49.824 INFO:tasks.workunit.client.0.smithi088.stdout:4/287: creat d3/dc/d18/d29/f60 x:0 0 0 2023-12-09T02:34:49.824 INFO:tasks.workunit.client.0.smithi088.stdout:4/288: read d3/dc/d1d/d40/f41 [259114,118588] 0 2023-12-09T02:34:49.824 INFO:tasks.workunit.client.0.smithi088.stdout:4/289: dread - d3/d1f/f55 zero size 2023-12-09T02:34:49.824 INFO:tasks.workunit.client.0.smithi088.stdout:4/290: dread - d3/d1f/f55 zero size 2023-12-09T02:34:49.824 INFO:tasks.workunit.client.0.smithi088.stdout:4/291: write d3/d1f/f4d [4698438,20962] 0 2023-12-09T02:34:49.824 INFO:tasks.workunit.client.0.smithi088.stdout:8/324: sync 2023-12-09T02:34:49.825 INFO:tasks.workunit.client.0.smithi088.stdout:1/357: getdents d8/d1b 0 2023-12-09T02:34:49.827 INFO:tasks.workunit.client.0.smithi088.stdout:4/292: rmdir d3/dc/d18/d29/d4a 39 2023-12-09T02:34:49.828 INFO:tasks.workunit.client.0.smithi088.stdout:1/358: mkdir d8/d1b/d6d/d7c 0 2023-12-09T02:34:49.835 INFO:tasks.workunit.client.0.smithi088.stdout:9/252: dwrite df/d29/f33 [0,4194304] 0 2023-12-09T02:34:49.837 INFO:tasks.workunit.client.0.smithi088.stdout:5/251: dread d3/d15/de/d2c/f44 [0,4194304] 0 2023-12-09T02:34:49.837 INFO:tasks.workunit.client.0.smithi088.stdout:5/252: write d3/d15/d2e/d49/f4f [244893,122481] 0 2023-12-09T02:34:49.837 INFO:tasks.workunit.client.0.smithi088.stdout:5/253: chown d3/d15/d2e/d49/f4f 14 1 2023-12-09T02:34:49.841 INFO:tasks.workunit.client.0.smithi088.stdout:5/254: mknod d3/d15/c54 0 2023-12-09T02:34:49.841 INFO:tasks.workunit.client.0.smithi088.stdout:5/255: getdents d3/d15/de/d2c/d3e/d41 0 2023-12-09T02:34:49.841 INFO:tasks.workunit.client.0.smithi088.stdout:5/256: chown d3/d15/dc/c30 32383 1 2023-12-09T02:34:49.841 INFO:tasks.workunit.client.0.smithi088.stdout:5/257: creat d3/d15/d2e/f55 x:0 0 0 2023-12-09T02:34:49.842 INFO:tasks.workunit.client.0.smithi088.stdout:5/258: read d3/d15/d2e/d49/f4f [227179,51260] 0 2023-12-09T02:34:49.842 INFO:tasks.workunit.client.0.smithi088.stdout:5/259: fdatasync d3/d15/de/d10/d18/d19/d1b/f1c 0 2023-12-09T02:34:49.842 INFO:tasks.workunit.client.0.smithi088.stdout:5/260: stat d3/f3d 0 2023-12-09T02:34:49.843 INFO:tasks.workunit.client.0.smithi088.stdout:3/223: dwrite d1/d2/d24/f2e [0,4194304] 0 2023-12-09T02:34:49.843 INFO:tasks.workunit.client.0.smithi088.stdout:0/268: dwrite df/f21 [0,4194304] 0 2023-12-09T02:34:49.846 INFO:tasks.workunit.client.0.smithi088.stdout:5/261: write d3/f3d [4136479,20635] 0 2023-12-09T02:34:49.854 INFO:tasks.workunit.client.0.smithi088.stdout:0/269: creat df/d28/d33/f5a x:0 0 0 2023-12-09T02:34:49.855 INFO:tasks.workunit.client.0.smithi088.stdout:5/262: creat d3/d8/f56 x:0 0 0 2023-12-09T02:34:49.855 INFO:tasks.workunit.client.0.smithi088.stdout:5/263: dread - d3/d15/de/d10/d18/f4e zero size 2023-12-09T02:34:49.857 INFO:tasks.workunit.client.0.smithi088.stdout:5/264: unlink d3/d15/de/c2b 0 2023-12-09T02:34:49.857 INFO:tasks.workunit.client.0.smithi088.stdout:5/265: truncate d3/d15/d2e/f55 105831 0 2023-12-09T02:34:49.859 INFO:tasks.workunit.client.0.smithi088.stdout:5/266: rmdir d3/d15/de/d2c/d3e/d41 0 2023-12-09T02:34:49.859 INFO:tasks.workunit.client.0.smithi088.stdout:5/267: write d3/d15/de/f17 [5195302,117309] 0 2023-12-09T02:34:49.864 INFO:tasks.workunit.client.0.smithi088.stdout:8/325: dwrite d2/d9/d1a/d62/d76/f79 [0,4194304] 0 2023-12-09T02:34:49.866 INFO:tasks.workunit.client.0.smithi088.stdout:8/326: creat d2/d9/d1a/f7d x:0 0 0 2023-12-09T02:34:49.867 INFO:tasks.workunit.client.0.smithi088.stdout:8/327: truncate d2/d9/d1a/d62/f4f 43518 0 2023-12-09T02:34:49.867 INFO:tasks.workunit.client.0.smithi088.stdout:8/328: chown d2/d9/d13/f1d 684937891 1 2023-12-09T02:34:49.867 INFO:tasks.workunit.client.0.smithi088.stdout:8/329: stat d2/d9/d1a/d62/f47 0 2023-12-09T02:34:49.868 INFO:tasks.workunit.client.0.smithi088.stdout:0/270: dwrite df/f2c [4194304,4194304] 0 2023-12-09T02:34:49.868 INFO:tasks.workunit.client.0.smithi088.stdout:3/224: dwrite d1/d2/d15/f27 [0,4194304] 0 2023-12-09T02:34:49.869 INFO:tasks.workunit.client.0.smithi088.stdout:1/359: dwrite d8/d53/f55 [0,4194304] 0 2023-12-09T02:34:49.869 INFO:tasks.workunit.client.0.smithi088.stdout:1/360: fsync d8/d3d/f4f 0 2023-12-09T02:34:49.869 INFO:tasks.workunit.client.0.smithi088.stdout:4/293: dwrite d3/f4 [0,4194304] 0 2023-12-09T02:34:49.869 INFO:tasks.workunit.client.0.smithi088.stdout:4/294: chown d3/dc/d18 794563415 1 2023-12-09T02:34:49.871 INFO:tasks.workunit.client.0.smithi088.stdout:3/225: rename d1/d9/d2b to d1/d2/d6/d4a 0 2023-12-09T02:34:49.871 INFO:tasks.workunit.client.0.smithi088.stdout:3/226: fdatasync d1/d2/d6/f3f 0 2023-12-09T02:34:49.872 INFO:tasks.workunit.client.0.smithi088.stdout:0/271: write df/f21 [3455644,65446] 0 2023-12-09T02:34:49.873 INFO:tasks.workunit.client.0.smithi088.stdout:0/272: dread df/d10/d22/f27 [0,4194304] 0 2023-12-09T02:34:49.874 INFO:tasks.workunit.client.0.smithi088.stdout:1/361: mknod d8/d1b/d6d/c7d 0 2023-12-09T02:34:49.880 INFO:tasks.workunit.client.0.smithi088.stdout:4/295: unlink d3/dc/f1a 0 2023-12-09T02:34:49.881 INFO:tasks.workunit.client.0.smithi088.stdout:7/316: sync 2023-12-09T02:34:49.882 INFO:tasks.workunit.client.0.smithi088.stdout:2/286: sync 2023-12-09T02:34:49.882 INFO:tasks.workunit.client.0.smithi088.stdout:6/299: sync 2023-12-09T02:34:49.882 INFO:tasks.workunit.client.0.smithi088.stdout:7/317: chown dc/d1b/f50 0 1 2023-12-09T02:34:49.882 INFO:tasks.workunit.client.0.smithi088.stdout:0/273: mkdir df/d10/d22/d5b 0 2023-12-09T02:34:49.883 INFO:tasks.workunit.client.0.smithi088.stdout:3/227: dread d1/d2/d15/f2c [0,4194304] 0 2023-12-09T02:34:49.883 INFO:tasks.workunit.client.0.smithi088.stdout:3/228: chown d1/d2/d6/d4a/f38 96 1 2023-12-09T02:34:49.883 INFO:tasks.workunit.client.0.smithi088.stdout:6/300: write f9 [383408,67546] 0 2023-12-09T02:34:49.884 INFO:tasks.workunit.client.0.smithi088.stdout:6/301: chown d16/d35/d36/l44 2969 1 2023-12-09T02:34:49.884 INFO:tasks.workunit.client.0.smithi088.stdout:1/362: rename d8/d3d/d44/d49/l60 to d8/d1c/l7e 0 2023-12-09T02:34:49.884 INFO:tasks.workunit.client.0.smithi088.stdout:1/363: write d8/d1c/f5a [865987,95398] 0 2023-12-09T02:34:49.885 INFO:tasks.workunit.client.0.smithi088.stdout:2/287: symlink d6/d8/d4e/d3c/l6b 0 2023-12-09T02:34:49.886 INFO:tasks.workunit.client.0.smithi088.stdout:7/318: creat dc/d1b/d66/f6f x:0 0 0 2023-12-09T02:34:49.886 INFO:tasks.workunit.client.0.smithi088.stdout:7/319: read - dc/d1b/f57 zero size 2023-12-09T02:34:49.887 INFO:tasks.workunit.client.0.smithi088.stdout:1/364: creat d8/d1c/d50/f7f x:0 0 0 2023-12-09T02:34:49.888 INFO:tasks.workunit.client.0.smithi088.stdout:2/288: mknod d6/d8/d1f/d22/c6c 0 2023-12-09T02:34:49.889 INFO:tasks.workunit.client.0.smithi088.stdout:5/268: rmdir d3/d15/de 39 2023-12-09T02:34:49.890 INFO:tasks.workunit.client.0.smithi088.stdout:7/320: creat dc/d1b/f70 x:0 0 0 2023-12-09T02:34:49.892 INFO:tasks.workunit.client.0.smithi088.stdout:1/365: creat d8/d1b/d6d/f80 x:0 0 0 2023-12-09T02:34:49.892 INFO:tasks.workunit.client.0.smithi088.stdout:2/289: truncate d6/d8/f1d 276388 0 2023-12-09T02:34:49.894 INFO:tasks.workunit.client.0.smithi088.stdout:5/269: truncate d3/d8/f9 33664 0 2023-12-09T02:34:49.898 INFO:tasks.workunit.client.0.smithi088.stdout:7/321: creat dc/d1b/d32/f71 x:0 0 0 2023-12-09T02:34:49.898 INFO:tasks.workunit.client.0.smithi088.stdout:1/366: creat d8/d53/f81 x:0 0 0 2023-12-09T02:34:49.899 INFO:tasks.workunit.client.0.smithi088.stdout:2/290: creat d6/d8/f6d x:0 0 0 2023-12-09T02:34:49.901 INFO:tasks.workunit.client.0.smithi088.stdout:5/270: unlink d3/d15/de/d10/d18/d19/d20/f53 0 2023-12-09T02:34:49.903 INFO:tasks.workunit.client.0.smithi088.stdout:2/291: write d6/d8/d1f/d22/f40 [1560852,90018] 0 2023-12-09T02:34:49.903 INFO:tasks.workunit.client.0.smithi088.stdout:2/292: chown d6/d8/d1f/f3b 6 1 2023-12-09T02:34:49.904 INFO:tasks.workunit.client.0.smithi088.stdout:7/322: mkdir dc/d1b/d72 0 2023-12-09T02:34:49.906 INFO:tasks.workunit.client.0.smithi088.stdout:5/271: rmdir d3/d15/de 39 2023-12-09T02:34:49.909 INFO:tasks.workunit.client.0.smithi088.stdout:5/272: truncate d3/d15/de/d2c/f44 958358 0 2023-12-09T02:34:49.935 INFO:tasks.workunit.client.0.smithi088.stdout:4/296: dwrite d3/dc/d1d/d40/f50 [0,4194304] 0 2023-12-09T02:34:49.935 INFO:tasks.workunit.client.0.smithi088.stdout:2/293: dwrite d6/fd [0,4194304] 0 2023-12-09T02:34:49.935 INFO:tasks.workunit.client.0.smithi088.stdout:0/274: dwrite df/d10/f24 [0,4194304] 0 2023-12-09T02:34:49.935 INFO:tasks.workunit.client.0.smithi088.stdout:3/229: dwrite d1/d2/d15/f2c [0,4194304] 0 2023-12-09T02:34:49.936 INFO:tasks.workunit.client.0.smithi088.stdout:6/302: dwrite d16/f1c [0,4194304] 0 2023-12-09T02:34:49.936 INFO:tasks.workunit.client.0.smithi088.stdout:1/367: rmdir d8/d3d/d44/d49 39 2023-12-09T02:34:49.938 INFO:tasks.workunit.client.0.smithi088.stdout:2/294: write f0 [3884020,44098] 0 2023-12-09T02:34:49.938 INFO:tasks.workunit.client.0.smithi088.stdout:2/295: truncate d6/d20/d3d/f61 1321864 0 2023-12-09T02:34:49.941 INFO:tasks.workunit.client.0.smithi088.stdout:4/297: dread d3/dc/f12 [0,4194304] 0 2023-12-09T02:34:49.945 INFO:tasks.workunit.client.0.smithi088.stdout:0/275: mknod df/d10/c5c 0 2023-12-09T02:34:49.950 INFO:tasks.workunit.client.0.smithi088.stdout:0/276: dread df/d28/f3b [0,4194304] 0 2023-12-09T02:34:49.951 INFO:tasks.workunit.client.0.smithi088.stdout:6/303: creat d16/d35/f5d x:0 0 0 2023-12-09T02:34:49.952 INFO:tasks.workunit.client.0.smithi088.stdout:1/368: mkdir d8/d3d/d5d/d82 0 2023-12-09T02:34:49.954 INFO:tasks.workunit.client.0.smithi088.stdout:4/298: creat d3/dc/f61 x:0 0 0 2023-12-09T02:34:49.955 INFO:tasks.workunit.client.0.smithi088.stdout:2/296: dwrite f4 [0,4194304] 0 2023-12-09T02:34:49.956 INFO:tasks.workunit.client.0.smithi088.stdout:5/273: link d3/d8/f9 d3/d15/de/d10/d18/f57 0 2023-12-09T02:34:49.957 INFO:tasks.workunit.client.0.smithi088.stdout:1/369: mkdir d8/d27/d83 0 2023-12-09T02:34:49.959 INFO:tasks.workunit.client.0.smithi088.stdout:4/299: unlink d3/dc/d1d/f36 0 2023-12-09T02:34:49.960 INFO:tasks.workunit.client.0.smithi088.stdout:2/297: symlink d6/d8/d1f/d22/l6e 0 2023-12-09T02:34:49.962 INFO:tasks.workunit.client.0.smithi088.stdout:1/370: creat d8/d27/f84 x:0 0 0 2023-12-09T02:34:49.965 INFO:tasks.workunit.client.0.smithi088.stdout:4/300: dread d3/dc/d18/d29/f3b [0,4194304] 0 2023-12-09T02:34:49.965 INFO:tasks.workunit.client.0.smithi088.stdout:4/301: readlink d3/dc/d18/l1c 0 2023-12-09T02:34:49.966 INFO:tasks.workunit.client.0.smithi088.stdout:1/371: creat d8/d27/d75/f85 x:0 0 0 2023-12-09T02:34:49.967 INFO:tasks.workunit.client.0.smithi088.stdout:4/302: truncate d3/dc/d18/d29/f38 2961770 0 2023-12-09T02:34:49.967 INFO:tasks.workunit.client.0.smithi088.stdout:4/303: write d3/dc/d18/d29/f60 [572877,24745] 0 2023-12-09T02:34:49.968 INFO:tasks.workunit.client.0.smithi088.stdout:1/372: truncate d8/d27/d40/f77 2382810 0 2023-12-09T02:34:49.970 INFO:tasks.workunit.client.0.smithi088.stdout:4/304: creat d3/dc/d18/d29/d4a/f62 x:0 0 0 2023-12-09T02:34:49.970 INFO:tasks.workunit.client.0.smithi088.stdout:4/305: chown d3/dc/d18/d29/c34 1 1 2023-12-09T02:34:49.971 INFO:tasks.workunit.client.0.smithi088.stdout:1/373: creat d8/d1c/f86 x:0 0 0 2023-12-09T02:34:49.971 INFO:tasks.workunit.client.0.smithi088.stdout:1/374: write d8/f38 [719203,77512] 0 2023-12-09T02:34:49.973 INFO:tasks.workunit.client.0.smithi088.stdout:1/375: dread d8/d1c/d50/d6c/f70 [0,4194304] 0 2023-12-09T02:34:49.973 INFO:tasks.workunit.client.0.smithi088.stdout:5/274: dwrite d3/d15/de/d10/d18/d19/d1b/f34 [0,4194304] 0 2023-12-09T02:34:49.973 INFO:tasks.workunit.client.0.smithi088.stdout:5/275: fdatasync d3/d8/f9 0 2023-12-09T02:34:49.973 INFO:tasks.workunit.client.0.smithi088.stdout:4/306: link d3/d1f/c5e d3/dc/d1d/d3c/c63 0 2023-12-09T02:34:49.973 INFO:tasks.workunit.client.0.smithi088.stdout:4/307: write d3/d1f/f4f [213072,100501] 0 2023-12-09T02:34:49.974 INFO:tasks.workunit.client.0.smithi088.stdout:1/376: creat d8/f87 x:0 0 0 2023-12-09T02:34:49.978 INFO:tasks.workunit.client.0.smithi088.stdout:4/308: symlink d3/dc/d18/d29/d4a/l64 0 2023-12-09T02:34:49.979 INFO:tasks.workunit.client.0.smithi088.stdout:1/377: creat d8/d3d/f88 x:0 0 0 2023-12-09T02:34:49.980 INFO:tasks.workunit.client.0.smithi088.stdout:1/378: fdatasync d8/d1c/d50/d6c/f70 0 2023-12-09T02:34:49.980 INFO:tasks.workunit.client.0.smithi088.stdout:1/379: chown d8/d1b/f41 359 1 2023-12-09T02:34:49.980 INFO:tasks.workunit.client.0.smithi088.stdout:9/253: sync 2023-12-09T02:34:49.980 INFO:tasks.workunit.client.0.smithi088.stdout:8/330: sync 2023-12-09T02:34:49.980 INFO:tasks.workunit.client.0.smithi088.stdout:9/254: dread - df/d20/d4c/f56 zero size 2023-12-09T02:34:49.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/309: unlink d3/l3e 0 2023-12-09T02:34:49.984 INFO:tasks.workunit.client.0.smithi088.stdout:2/298: rmdir d6 39 2023-12-09T02:34:49.984 INFO:tasks.workunit.client.0.smithi088.stdout:2/299: chown d6/d13/d18/f32 4999 1 2023-12-09T02:34:49.984 INFO:tasks.workunit.client.0.smithi088.stdout:2/300: fsync d6/d13/f1e 0 2023-12-09T02:34:49.985 INFO:tasks.workunit.client.0.smithi088.stdout:1/380: creat d8/d53/f89 x:0 0 0 2023-12-09T02:34:49.988 INFO:tasks.workunit.client.0.smithi088.stdout:4/310: mkdir d3/d65 0 2023-12-09T02:34:49.989 INFO:tasks.workunit.client.0.smithi088.stdout:5/276: dwrite d3/d15/d2e/d49/f4f [0,4194304] 0 2023-12-09T02:34:49.992 INFO:tasks.workunit.client.0.smithi088.stdout:1/381: unlink d8/d27/f2a 0 2023-12-09T02:34:49.992 INFO:tasks.workunit.client.0.smithi088.stdout:4/311: creat d3/dc/d1d/d40/f66 x:0 0 0 2023-12-09T02:34:49.992 INFO:tasks.workunit.client.0.smithi088.stdout:4/312: fdatasync d3/dc/d18/d29/f60 0 2023-12-09T02:34:49.997 INFO:tasks.workunit.client.0.smithi088.stdout:5/277: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d58 0 2023-12-09T02:34:49.999 INFO:tasks.workunit.client.0.smithi088.stdout:4/313: rename d3/dc/d1d/d40/f66 to d3/d1f/f67 0 2023-12-09T02:34:50.003 INFO:tasks.workunit.client.0.smithi088.stdout:5/278: symlink d3/d15/dc/l59 0 2023-12-09T02:34:50.003 INFO:tasks.workunit.client.0.smithi088.stdout:4/314: link d3/dc/d1d/d3c/l46 d3/l68 0 2023-12-09T02:34:50.004 INFO:tasks.workunit.client.0.smithi088.stdout:5/279: creat d3/d15/de/d10/d48/f5a x:0 0 0 2023-12-09T02:34:50.005 INFO:tasks.workunit.client.0.smithi088.stdout:5/280: creat d3/d15/f5b x:0 0 0 2023-12-09T02:34:50.006 INFO:tasks.workunit.client.0.smithi088.stdout:5/281: mkdir d3/d15/d2e/d5c 0 2023-12-09T02:34:50.007 INFO:tasks.workunit.client.0.smithi088.stdout:5/282: symlink d3/d15/de/d10/d18/d19/d20/l5d 0 2023-12-09T02:34:50.007 INFO:tasks.workunit.client.0.smithi088.stdout:5/283: truncate d3/d15/de/d10/d18/d19/d1b/d35/d42/f21 5098908 0 2023-12-09T02:34:50.008 INFO:tasks.workunit.client.0.smithi088.stdout:5/284: chown d3/d15/de/d10/d18/f4a 624764258 1 2023-12-09T02:34:50.011 INFO:tasks.workunit.client.0.smithi088.stdout:5/285: truncate d3/d15/d2e/f55 80365 0 2023-12-09T02:34:50.012 INFO:tasks.workunit.client.0.smithi088.stdout:5/286: creat d3/d15/de/d10/d18/d19/d1b/d35/d42/f5e x:0 0 0 2023-12-09T02:34:50.012 INFO:tasks.workunit.client.0.smithi088.stdout:5/287: fdatasync d3/d15/de/f40 0 2023-12-09T02:34:50.013 INFO:tasks.workunit.client.0.smithi088.stdout:5/288: creat d3/d15/de/d10/d48/f5f x:0 0 0 2023-12-09T02:34:50.013 INFO:tasks.workunit.client.0.smithi088.stdout:5/289: mkdir d3/d15/dc/d60 0 2023-12-09T02:34:50.014 INFO:tasks.workunit.client.0.smithi088.stdout:5/290: dread d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:50.015 INFO:tasks.workunit.client.0.smithi088.stdout:5/291: write d3/d15/de/d10/d18/f4a [860449,606] 0 2023-12-09T02:34:50.016 INFO:tasks.workunit.client.0.smithi088.stdout:5/292: rmdir d3/d15/de/d2c/d3e 0 2023-12-09T02:34:50.017 INFO:tasks.workunit.client.0.smithi088.stdout:5/293: dread d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:50.019 INFO:tasks.workunit.client.0.smithi088.stdout:5/294: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d61 0 2023-12-09T02:34:50.019 INFO:tasks.workunit.client.0.smithi088.stdout:8/331: dwrite d2/d9/d1a/d62/f61 [0,4194304] 0 2023-12-09T02:34:50.019 INFO:tasks.workunit.client.0.smithi088.stdout:8/332: write d2/f28 [731919,77481] 0 2023-12-09T02:34:50.019 INFO:tasks.workunit.client.0.smithi088.stdout:9/255: dwrite df/d20/d30/d54/d5c/f47 [0,4194304] 0 2023-12-09T02:34:50.020 INFO:tasks.workunit.client.0.smithi088.stdout:5/295: symlink d3/d15/de/l62 0 2023-12-09T02:34:50.021 INFO:tasks.workunit.client.0.smithi088.stdout:2/301: dwrite d6/d8/d1f/d22/f38 [0,4194304] 0 2023-12-09T02:34:50.021 INFO:tasks.workunit.client.0.smithi088.stdout:2/302: stat d6/d8/d4e/d3c/f53 0 2023-12-09T02:34:50.021 INFO:tasks.workunit.client.0.smithi088.stdout:8/333: write d2/d9/d13/d15/f18 [383769,79022] 0 2023-12-09T02:34:50.022 INFO:tasks.workunit.client.0.smithi088.stdout:4/315: dwrite d3/f39 [0,4194304] 0 2023-12-09T02:34:50.022 INFO:tasks.workunit.client.0.smithi088.stdout:4/316: stat d3/dc/d18/d29/f3d 0 2023-12-09T02:34:50.022 INFO:tasks.workunit.client.0.smithi088.stdout:4/317: dread - d3/d1f/f55 zero size 2023-12-09T02:34:50.023 INFO:tasks.workunit.client.0.smithi088.stdout:9/256: creat df/d20/f5f x:0 0 0 2023-12-09T02:34:50.023 INFO:tasks.workunit.client.0.smithi088.stdout:9/257: write df/f13 [925325,99108] 0 2023-12-09T02:34:50.028 INFO:tasks.workunit.client.0.smithi088.stdout:8/334: link d2/d9/d1a/d62/l66 d2/d9/d13/d1c/d74/l7e 0 2023-12-09T02:34:50.033 INFO:tasks.workunit.client.0.smithi088.stdout:7/323: sync 2023-12-09T02:34:50.033 INFO:tasks.workunit.client.0.smithi088.stdout:4/318: symlink d3/dc/d18/d29/l69 0 2023-12-09T02:34:50.033 INFO:tasks.workunit.client.0.smithi088.stdout:4/319: fsync d3/dc/d18/d29/f60 0 2023-12-09T02:34:50.035 INFO:tasks.workunit.client.0.smithi088.stdout:9/258: rename df/d20/d30/d54 to df/d20/d30/d60 0 2023-12-09T02:34:50.035 INFO:tasks.workunit.client.0.smithi088.stdout:9/259: dread - df/d20/d30/f35 zero size 2023-12-09T02:34:50.035 INFO:tasks.workunit.client.0.smithi088.stdout:9/260: chown df/d20/f3e 3 1 2023-12-09T02:34:50.035 INFO:tasks.workunit.client.0.smithi088.stdout:5/296: dread d3/f45 [0,4194304] 0 2023-12-09T02:34:50.035 INFO:tasks.workunit.client.0.smithi088.stdout:2/303: dread d6/d13/f15 [0,4194304] 0 2023-12-09T02:34:50.038 INFO:tasks.workunit.client.0.smithi088.stdout:8/335: dread f0 [0,4194304] 0 2023-12-09T02:34:50.038 INFO:tasks.workunit.client.0.smithi088.stdout:9/261: creat df/d20/d30/d4e/d55/f61 x:0 0 0 2023-12-09T02:34:50.047 INFO:tasks.workunit.client.0.smithi088.stdout:2/304: creat d6/d8/d4e/d3c/f6f x:0 0 0 2023-12-09T02:34:50.047 INFO:tasks.workunit.client.0.smithi088.stdout:7/324: mknod dc/d1b/d32/d38/d1e/c73 0 2023-12-09T02:34:50.047 INFO:tasks.workunit.client.0.smithi088.stdout:8/336: rmdir d2/d9/d1a/d62 39 2023-12-09T02:34:50.047 INFO:tasks.workunit.client.0.smithi088.stdout:5/297: write d3/d15/d2e/f55 [477633,49279] 0 2023-12-09T02:34:50.047 INFO:tasks.workunit.client.0.smithi088.stdout:5/298: dread - d3/d15/f5b zero size 2023-12-09T02:34:50.047 INFO:tasks.workunit.client.0.smithi088.stdout:2/305: link f4 d6/d13/d42/f70 0 2023-12-09T02:34:50.047 INFO:tasks.workunit.client.0.smithi088.stdout:8/337: rmdir d2/d9/d13/d15/d6e 39 2023-12-09T02:34:50.048 INFO:tasks.workunit.client.0.smithi088.stdout:8/338: creat d2/d9/d1a/d62/f7f x:0 0 0 2023-12-09T02:34:50.050 INFO:tasks.workunit.client.0.smithi088.stdout:8/339: mknod d2/d9/d1a/c80 0 2023-12-09T02:34:50.050 INFO:tasks.workunit.client.0.smithi088.stdout:8/340: fdatasync f1 0 2023-12-09T02:34:50.057 INFO:tasks.workunit.client.0.smithi088.stdout:2/306: dread d6/d13/d42/f70 [0,4194304] 0 2023-12-09T02:34:50.058 INFO:tasks.workunit.client.0.smithi088.stdout:7/325: dread dc/d21/f1a [0,4194304] 0 2023-12-09T02:34:50.058 INFO:tasks.workunit.client.0.smithi088.stdout:7/326: chown dc/d21/f4a 1288408 1 2023-12-09T02:34:50.058 INFO:tasks.workunit.client.0.smithi088.stdout:7/327: chown fb 146 1 2023-12-09T02:34:50.059 INFO:tasks.workunit.client.0.smithi088.stdout:7/328: creat dc/f74 x:0 0 0 2023-12-09T02:34:50.059 INFO:tasks.workunit.client.0.smithi088.stdout:7/329: write dc/d1b/d32/f3c [1862761,74794] 0 2023-12-09T02:34:50.061 INFO:tasks.workunit.client.0.smithi088.stdout:7/330: unlink dc/d1b/d32/d38/d1e/c73 0 2023-12-09T02:34:50.062 INFO:tasks.workunit.client.0.smithi088.stdout:2/307: dread d6/f1c [0,4194304] 0 2023-12-09T02:34:50.062 INFO:tasks.workunit.client.0.smithi088.stdout:2/308: read - d6/d13/d18/f32 zero size 2023-12-09T02:34:50.063 INFO:tasks.workunit.client.0.smithi088.stdout:2/309: read d6/d8/d1f/d22/f38 [3581761,4929] 0 2023-12-09T02:34:50.063 INFO:tasks.workunit.client.0.smithi088.stdout:2/310: creat d6/d13/d42/f71 x:0 0 0 2023-12-09T02:34:50.063 INFO:tasks.workunit.client.0.smithi088.stdout:2/311: dread - d6/d8/d4e/d47/f58 zero size 2023-12-09T02:34:50.064 INFO:tasks.workunit.client.0.smithi088.stdout:2/312: chown d6/d13/f1e 12462000 1 2023-12-09T02:34:50.064 INFO:tasks.workunit.client.0.smithi088.stdout:2/313: rmdir d6/d20 39 2023-12-09T02:34:50.065 INFO:tasks.workunit.client.0.smithi088.stdout:2/314: creat d6/d8/d1f/d22/f72 x:0 0 0 2023-12-09T02:34:50.065 INFO:tasks.workunit.client.0.smithi088.stdout:2/315: mkdir d6/d8/d73 0 2023-12-09T02:34:50.066 INFO:tasks.workunit.client.0.smithi088.stdout:3/230: sync 2023-12-09T02:34:50.066 INFO:tasks.workunit.client.0.smithi088.stdout:0/277: sync 2023-12-09T02:34:50.066 INFO:tasks.workunit.client.0.smithi088.stdout:6/304: sync 2023-12-09T02:34:50.066 INFO:tasks.workunit.client.0.smithi088.stdout:0/278: write df/d10/f29 [4432550,7929] 0 2023-12-09T02:34:50.069 INFO:tasks.workunit.client.0.smithi088.stdout:2/316: creat d6/d8/d4e/f74 x:0 0 0 2023-12-09T02:34:50.069 INFO:tasks.workunit.client.0.smithi088.stdout:2/317: fdatasync d6/d13/f33 0 2023-12-09T02:34:50.069 INFO:tasks.workunit.client.0.smithi088.stdout:6/305: mknod d16/d1b/d2c/c5e 0 2023-12-09T02:34:50.069 INFO:tasks.workunit.client.0.smithi088.stdout:9/262: dwrite df/d29/d2f/f37 [0,4194304] 0 2023-12-09T02:34:50.070 INFO:tasks.workunit.client.0.smithi088.stdout:6/306: truncate f10 77199 0 2023-12-09T02:34:50.071 INFO:tasks.workunit.client.0.smithi088.stdout:5/299: dwrite d3/d15/de/d10/d18/d19/d1b/f32 [0,4194304] 0 2023-12-09T02:34:50.071 INFO:tasks.workunit.client.0.smithi088.stdout:5/300: fsync d3/d15/de/d2c/f44 0 2023-12-09T02:34:50.071 INFO:tasks.workunit.client.0.smithi088.stdout:7/331: dread dc/d1b/d32/d38/d1e/f23 [0,4194304] 0 2023-12-09T02:34:50.073 INFO:tasks.workunit.client.0.smithi088.stdout:6/307: mkdir d16/d1b/d25/d5f 0 2023-12-09T02:34:50.073 INFO:tasks.workunit.client.0.smithi088.stdout:9/263: creat df/d20/d30/d60/f62 x:0 0 0 2023-12-09T02:34:50.074 INFO:tasks.workunit.client.0.smithi088.stdout:4/320: dwrite f0 [0,4194304] 0 2023-12-09T02:34:50.074 INFO:tasks.workunit.client.0.smithi088.stdout:4/321: chown d3/dc/d18/l1c 676833 1 2023-12-09T02:34:50.078 INFO:tasks.workunit.client.0.smithi088.stdout:5/301: rmdir d3/d15/d2e/d5c 0 2023-12-09T02:34:50.080 INFO:tasks.workunit.client.0.smithi088.stdout:2/318: dread d6/d13/d18/f19 [0,4194304] 0 2023-12-09T02:34:50.081 INFO:tasks.workunit.client.0.smithi088.stdout:2/319: write d6/d8/d4e/d3c/f50 [2326700,13221] 0 2023-12-09T02:34:50.081 INFO:tasks.workunit.client.0.smithi088.stdout:2/320: truncate d6/d13/d18/f32 561610 0 2023-12-09T02:34:50.082 INFO:tasks.workunit.client.0.smithi088.stdout:2/321: read d6/d20/f23 [1532472,55729] 0 2023-12-09T02:34:50.082 INFO:tasks.workunit.client.0.smithi088.stdout:2/322: dread - d6/d8/f6d zero size 2023-12-09T02:34:50.082 INFO:tasks.workunit.client.0.smithi088.stdout:7/332: mknod dc/d1b/d32/d38/c75 0 2023-12-09T02:34:50.083 INFO:tasks.workunit.client.0.smithi088.stdout:6/308: mkdir d16/d1b/d2c/d60 0 2023-12-09T02:34:50.083 INFO:tasks.workunit.client.0.smithi088.stdout:9/264: dread f7 [8388608,4194304] 0 2023-12-09T02:34:50.083 INFO:tasks.workunit.client.0.smithi088.stdout:4/322: dread d3/f4 [4194304,4194304] 0 2023-12-09T02:34:50.084 INFO:tasks.workunit.client.0.smithi088.stdout:4/323: write d3/dc/d43/f5b [179479,59332] 0 2023-12-09T02:34:50.084 INFO:tasks.workunit.client.0.smithi088.stdout:5/302: mknod d3/d15/de/d10/d18/d19/d1b/d35/d61/c63 0 2023-12-09T02:34:50.085 INFO:tasks.workunit.client.0.smithi088.stdout:2/323: creat d6/d8/d4e/d64/f75 x:0 0 0 2023-12-09T02:34:50.087 INFO:tasks.workunit.client.0.smithi088.stdout:7/333: mkdir dc/d21/d6b/d6d/d76 0 2023-12-09T02:34:50.088 INFO:tasks.workunit.client.0.smithi088.stdout:3/231: dwrite d1/d2/d15/f27 [0,4194304] 0 2023-12-09T02:34:50.088 INFO:tasks.workunit.client.0.smithi088.stdout:9/265: mkdir df/d50/d63 0 2023-12-09T02:34:50.092 INFO:tasks.workunit.client.0.smithi088.stdout:4/324: rename d3/fd to d3/dc/d18/d29/d4a/f6a 0 2023-12-09T02:34:50.092 INFO:tasks.workunit.client.0.smithi088.stdout:4/325: fdatasync d3/dc/f10 0 2023-12-09T02:34:50.092 INFO:tasks.workunit.client.0.smithi088.stdout:4/326: fdatasync d3/dc/d18/d29/d4a/f6a 0 2023-12-09T02:34:50.092 INFO:tasks.workunit.client.0.smithi088.stdout:3/232: write d1/d2/f2f [2610309,72101] 0 2023-12-09T02:34:50.092 INFO:tasks.workunit.client.0.smithi088.stdout:3/233: chown d1/d9/f37 92853580 1 2023-12-09T02:34:50.092 INFO:tasks.workunit.client.0.smithi088.stdout:5/303: mknod d3/d15/de/d10/d18/d19/c64 0 2023-12-09T02:34:50.094 INFO:tasks.workunit.client.0.smithi088.stdout:7/334: rmdir dc/d21/d6b 39 2023-12-09T02:34:50.094 INFO:tasks.workunit.client.0.smithi088.stdout:7/335: dread - dc/d21/f61 zero size 2023-12-09T02:34:50.098 INFO:tasks.workunit.client.0.smithi088.stdout:4/327: symlink d3/l6b 0 2023-12-09T02:34:50.098 INFO:tasks.workunit.client.0.smithi088.stdout:6/309: dwrite d16/d35/d36/f52 [0,4194304] 0 2023-12-09T02:34:50.098 INFO:tasks.workunit.client.0.smithi088.stdout:1/382: sync 2023-12-09T02:34:50.099 INFO:tasks.workunit.client.0.smithi088.stdout:3/234: symlink d1/d9/l4b 0 2023-12-09T02:34:50.101 INFO:tasks.workunit.client.0.smithi088.stdout:7/336: link dc/d21/c54 dc/d1b/d72/c77 0 2023-12-09T02:34:50.101 INFO:tasks.workunit.client.0.smithi088.stdout:7/337: truncate dc/d1b/d32/d38/d1e/f23 4217051 0 2023-12-09T02:34:50.106 INFO:tasks.workunit.client.0.smithi088.stdout:4/328: unlink d3/dc/d18/l30 0 2023-12-09T02:34:50.106 INFO:tasks.workunit.client.0.smithi088.stdout:4/329: read - d3/d1f/f55 zero size 2023-12-09T02:34:50.107 INFO:tasks.workunit.client.0.smithi088.stdout:7/338: creat dc/d21/d6b/f78 x:0 0 0 2023-12-09T02:34:50.108 INFO:tasks.workunit.client.0.smithi088.stdout:6/310: rename d16/f2b to d16/d1b/d2c/d3f/f61 0 2023-12-09T02:34:50.110 INFO:tasks.workunit.client.0.smithi088.stdout:7/339: unlink dc/d21/f45 0 2023-12-09T02:34:50.112 INFO:tasks.workunit.client.0.smithi088.stdout:7/340: unlink dc/d1b/f50 0 2023-12-09T02:34:50.112 INFO:tasks.workunit.client.0.smithi088.stdout:7/341: truncate dc/d1b/f4b 257889 0 2023-12-09T02:34:50.113 INFO:tasks.workunit.client.0.smithi088.stdout:6/311: rename d16/d35/d36/d53 to d16/d62 0 2023-12-09T02:34:50.113 INFO:tasks.workunit.client.0.smithi088.stdout:6/312: chown fb 1 1 2023-12-09T02:34:50.113 INFO:tasks.workunit.client.0.smithi088.stdout:7/342: symlink dc/l79 0 2023-12-09T02:34:50.114 INFO:tasks.workunit.client.0.smithi088.stdout:6/313: chown d16/f39 209 1 2023-12-09T02:34:50.114 INFO:tasks.workunit.client.0.smithi088.stdout:7/343: mknod dc/d1b/c7a 0 2023-12-09T02:34:50.115 INFO:tasks.workunit.client.0.smithi088.stdout:6/314: mkdir d16/d1b/d25/d5f/d63 0 2023-12-09T02:34:50.115 INFO:tasks.workunit.client.0.smithi088.stdout:6/315: readlink d16/d35/d36/l44 0 2023-12-09T02:34:50.115 INFO:tasks.workunit.client.0.smithi088.stdout:6/316: chown d16/d1b/d25/d5f 436 1 2023-12-09T02:34:50.116 INFO:tasks.workunit.client.0.smithi088.stdout:7/344: creat dc/d1b/d32/d3e/f7b x:0 0 0 2023-12-09T02:34:50.116 INFO:tasks.workunit.client.0.smithi088.stdout:7/345: dread - dc/d1b/f6e zero size 2023-12-09T02:34:50.121 INFO:tasks.workunit.client.0.smithi088.stdout:9/266: dwrite df/f1a [0,4194304] 0 2023-12-09T02:34:50.122 INFO:tasks.workunit.client.0.smithi088.stdout:4/330: dread d3/d1f/f2b [0,4194304] 0 2023-12-09T02:34:50.123 INFO:tasks.workunit.client.0.smithi088.stdout:9/267: link df/d20/d30/d60/d5c/c22 df/d20/c64 0 2023-12-09T02:34:50.125 INFO:tasks.workunit.client.0.smithi088.stdout:4/331: rename d3/c24 to d3/dc/d43/c6c 0 2023-12-09T02:34:50.126 INFO:tasks.workunit.client.0.smithi088.stdout:5/304: dwrite d3/d15/de/d10/d18/f4e [0,4194304] 0 2023-12-09T02:34:50.127 INFO:tasks.workunit.client.0.smithi088.stdout:5/305: stat d3/d15/de/d10/d18/d19/d1b 0 2023-12-09T02:34:50.127 INFO:tasks.workunit.client.0.smithi088.stdout:4/332: link d3/dc/f14 d3/d65/f6d 0 2023-12-09T02:34:50.127 INFO:tasks.workunit.client.0.smithi088.stdout:4/333: write d3/d1f/f67 [94443,20703] 0 2023-12-09T02:34:50.127 INFO:tasks.workunit.client.0.smithi088.stdout:4/334: chown d3/f4 26315299 1 2023-12-09T02:34:50.131 INFO:tasks.workunit.client.0.smithi088.stdout:5/306: unlink d3/d15/de/d10/d18/d19/d1b/d35/d42/l3f 0 2023-12-09T02:34:50.131 INFO:tasks.workunit.client.0.smithi088.stdout:5/307: fsync d3/d15/f5b 0 2023-12-09T02:34:50.131 INFO:tasks.workunit.client.0.smithi088.stdout:5/308: dread - d3/d15/de/d10/d18/d19/d20/f43 zero size 2023-12-09T02:34:50.131 INFO:tasks.workunit.client.0.smithi088.stdout:5/309: dread - d3/d8/f56 zero size 2023-12-09T02:34:50.131 INFO:tasks.workunit.client.0.smithi088.stdout:4/335: creat d3/dc/d18/d29/f6e x:0 0 0 2023-12-09T02:34:50.141 INFO:tasks.workunit.client.0.smithi088.stdout:2/324: dwrite d6/d8/d4e/d3c/f53 [0,4194304] 0 2023-12-09T02:34:50.141 INFO:tasks.workunit.client.0.smithi088.stdout:5/310: truncate d3/d15/de/d10/d18/f4e 517436 0 2023-12-09T02:34:50.142 INFO:tasks.workunit.client.0.smithi088.stdout:1/383: dwrite d8/d1c/f5a [4194304,4194304] 0 2023-12-09T02:34:50.143 INFO:tasks.workunit.client.0.smithi088.stdout:7/346: dwrite dc/d1b/d32/f3c [0,4194304] 0 2023-12-09T02:34:50.143 INFO:tasks.workunit.client.0.smithi088.stdout:3/235: dwrite d1/d2/d22/d43/f44 [0,4194304] 0 2023-12-09T02:34:50.144 INFO:tasks.workunit.client.0.smithi088.stdout:2/325: creat d6/d13/f76 x:0 0 0 2023-12-09T02:34:50.151 INFO:tasks.workunit.client.0.smithi088.stdout:7/347: rmdir dc/d21/d6b/d6d 39 2023-12-09T02:34:50.151 INFO:tasks.workunit.client.0.smithi088.stdout:5/311: dread d3/d15/d2e/d49/f4f [0,4194304] 0 2023-12-09T02:34:50.151 INFO:tasks.workunit.client.0.smithi088.stdout:9/268: dwrite df/d20/d30/d3f/d48/f46 [0,4194304] 0 2023-12-09T02:34:50.153 INFO:tasks.workunit.client.0.smithi088.stdout:4/336: dwrite d3/dc/f61 [0,4194304] 0 2023-12-09T02:34:50.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/236: rmdir d1/d2 39 2023-12-09T02:34:50.156 INFO:tasks.workunit.client.0.smithi088.stdout:2/326: mkdir d6/d8/d77 0 2023-12-09T02:34:50.157 INFO:tasks.workunit.client.0.smithi088.stdout:7/348: symlink dc/d21/d6b/l7c 0 2023-12-09T02:34:50.157 INFO:tasks.workunit.client.0.smithi088.stdout:7/349: truncate dc/d1b/d32/d38/d1e/f60 676480 0 2023-12-09T02:34:50.158 INFO:tasks.workunit.client.0.smithi088.stdout:1/384: dwrite d8/d1c/f5a [4194304,4194304] 0 2023-12-09T02:34:50.158 INFO:tasks.workunit.client.0.smithi088.stdout:1/385: rename d8/d3d to d8/d3d/d8a 22 2023-12-09T02:34:50.158 INFO:tasks.workunit.client.0.smithi088.stdout:5/312: symlink d3/l65 0 2023-12-09T02:34:50.160 INFO:tasks.workunit.client.0.smithi088.stdout:9/269: creat df/d20/d30/d3f/d48/f65 x:0 0 0 2023-12-09T02:34:50.160 INFO:tasks.workunit.client.0.smithi088.stdout:9/270: fdatasync f7 0 2023-12-09T02:34:50.162 INFO:tasks.workunit.client.0.smithi088.stdout:4/337: creat d3/d65/f6f x:0 0 0 2023-12-09T02:34:50.162 INFO:tasks.workunit.client.0.smithi088.stdout:4/338: chown d3/d1f 757 1 2023-12-09T02:34:50.162 INFO:tasks.workunit.client.0.smithi088.stdout:9/271: write df/d20/d30/d60/d5c/f1e [294075,99575] 0 2023-12-09T02:34:50.164 INFO:tasks.workunit.client.0.smithi088.stdout:3/237: symlink d1/d2/d6/d4a/d41/d33/l4c 0 2023-12-09T02:34:50.164 INFO:tasks.workunit.client.0.smithi088.stdout:3/238: fsync d1/d2/d15/f27 0 2023-12-09T02:34:50.164 INFO:tasks.workunit.client.0.smithi088.stdout:2/327: mkdir d6/d8/d73/d78 0 2023-12-09T02:34:50.166 INFO:tasks.workunit.client.0.smithi088.stdout:1/386: creat d8/d3d/d5d/f8b x:0 0 0 2023-12-09T02:34:50.167 INFO:tasks.workunit.client.0.smithi088.stdout:1/387: write d8/d27/d40/f68 [336537,77256] 0 2023-12-09T02:34:50.169 INFO:tasks.workunit.client.0.smithi088.stdout:9/272: creat df/d20/d30/d60/d5c/f66 x:0 0 0 2023-12-09T02:34:50.169 INFO:tasks.workunit.client.0.smithi088.stdout:9/273: chown df/d20/d30/d4e/d55 67103472 1 2023-12-09T02:34:50.169 INFO:tasks.workunit.client.0.smithi088.stdout:0/279: sync 2023-12-09T02:34:50.169 INFO:tasks.workunit.client.0.smithi088.stdout:8/341: sync 2023-12-09T02:34:50.170 INFO:tasks.workunit.client.0.smithi088.stdout:3/239: creat d1/d2/d24/f4d x:0 0 0 2023-12-09T02:34:50.171 INFO:tasks.workunit.client.0.smithi088.stdout:5/313: dwrite d3/f3d [0,4194304] 0 2023-12-09T02:34:50.171 INFO:tasks.workunit.client.0.smithi088.stdout:0/280: write df/d10/d22/d2d/d3c/f44 [3427738,58336] 0 2023-12-09T02:34:50.171 INFO:tasks.workunit.client.0.smithi088.stdout:0/281: fdatasync df/d10/d22/f27 0 2023-12-09T02:34:50.172 INFO:tasks.workunit.client.0.smithi088.stdout:2/328: creat d6/d13/f79 x:0 0 0 2023-12-09T02:34:50.172 INFO:tasks.workunit.client.0.smithi088.stdout:2/329: chown d6/d8/d4e/f74 1085433 1 2023-12-09T02:34:50.172 INFO:tasks.workunit.client.0.smithi088.stdout:2/330: read d6/d8/f30 [514808,56650] 0 2023-12-09T02:34:50.173 INFO:tasks.workunit.client.0.smithi088.stdout:9/274: getdents df/d20/d30/d4e/d55 0 2023-12-09T02:34:50.175 INFO:tasks.workunit.client.0.smithi088.stdout:3/240: symlink d1/d2/d2d/l4e 0 2023-12-09T02:34:50.175 INFO:tasks.workunit.client.0.smithi088.stdout:3/241: dread - d1/d2/d2d/f46 zero size 2023-12-09T02:34:50.180 INFO:tasks.workunit.client.0.smithi088.stdout:0/282: creat df/d10/d22/d5b/f5d x:0 0 0 2023-12-09T02:34:50.180 INFO:tasks.workunit.client.0.smithi088.stdout:0/283: fdatasync df/d10/f15 0 2023-12-09T02:34:50.180 INFO:tasks.workunit.client.0.smithi088.stdout:0/284: stat df/d28/d34 0 2023-12-09T02:34:50.182 INFO:tasks.workunit.client.0.smithi088.stdout:1/388: truncate d8/d1b/d1d/f67 3725392 0 2023-12-09T02:34:50.184 INFO:tasks.workunit.client.0.smithi088.stdout:9/275: symlink df/d20/d30/d52/l67 0 2023-12-09T02:34:50.185 INFO:tasks.workunit.client.0.smithi088.stdout:3/242: rmdir d1/d2/d24 39 2023-12-09T02:34:50.185 INFO:tasks.workunit.client.0.smithi088.stdout:3/243: fsync d1/d2/d24/f4d 0 2023-12-09T02:34:50.186 INFO:tasks.workunit.client.0.smithi088.stdout:0/285: creat df/d10/d22/d2d/f5e x:0 0 0 2023-12-09T02:34:50.186 INFO:tasks.workunit.client.0.smithi088.stdout:0/286: dread - df/d10/d22/d2d/f52 zero size 2023-12-09T02:34:50.186 INFO:tasks.workunit.client.0.smithi088.stdout:0/287: readlink df/d28/d34/l58 0 2023-12-09T02:34:50.187 INFO:tasks.workunit.client.0.smithi088.stdout:1/389: creat d8/f8c x:0 0 0 2023-12-09T02:34:50.188 INFO:tasks.workunit.client.0.smithi088.stdout:9/276: link df/d20/d30/d3f/d48/f46 df/d50/f68 0 2023-12-09T02:34:50.189 INFO:tasks.workunit.client.0.smithi088.stdout:3/244: creat d1/d2/d6/d4a/d41/d33/d49/f4f x:0 0 0 2023-12-09T02:34:50.189 INFO:tasks.workunit.client.0.smithi088.stdout:1/390: mknod d8/d27/d75/c8d 0 2023-12-09T02:34:50.189 INFO:tasks.workunit.client.0.smithi088.stdout:1/391: stat f4 0 2023-12-09T02:34:50.191 INFO:tasks.workunit.client.0.smithi088.stdout:9/277: rename df/d20/d30/d3f/d48/c49 to df/d20/d30/d60/d5c/c69 0 2023-12-09T02:34:50.192 INFO:tasks.workunit.client.0.smithi088.stdout:2/331: dwrite d6/d8/d1f/d22/f72 [0,4194304] 0 2023-12-09T02:34:50.193 INFO:tasks.workunit.client.0.smithi088.stdout:3/245: rename d1/d2/c1d to d1/d2/d22/d43/c50 0 2023-12-09T02:34:50.194 INFO:tasks.workunit.client.0.smithi088.stdout:1/392: dread d8/d59/f71 [0,4194304] 0 2023-12-09T02:34:50.195 INFO:tasks.workunit.client.0.smithi088.stdout:2/332: rmdir d6/d8/d1f 39 2023-12-09T02:34:50.196 INFO:tasks.workunit.client.0.smithi088.stdout:2/333: write d6/d8/d1f/d22/f52 [329661,99307] 0 2023-12-09T02:34:50.198 INFO:tasks.workunit.client.0.smithi088.stdout:9/278: rename f7 to df/d29/f6a 0 2023-12-09T02:34:50.200 INFO:tasks.workunit.client.0.smithi088.stdout:3/246: creat d1/d2/f51 x:0 0 0 2023-12-09T02:34:50.201 INFO:tasks.workunit.client.0.smithi088.stdout:1/393: dread d8/d1b/f33 [0,4194304] 0 2023-12-09T02:34:50.202 INFO:tasks.workunit.client.0.smithi088.stdout:9/279: rename df/d20/d30/d3f/d48/l4f to df/d20/d30/d60/d5c/l6b 0 2023-12-09T02:34:50.203 INFO:tasks.workunit.client.0.smithi088.stdout:9/280: dread - df/d50/f58 zero size 2023-12-09T02:34:50.207 INFO:tasks.workunit.client.0.smithi088.stdout:0/288: dwrite df/f30 [0,4194304] 0 2023-12-09T02:34:50.208 INFO:tasks.workunit.client.0.smithi088.stdout:0/289: read df/d28/d34/f48 [12848,98504] 0 2023-12-09T02:34:50.211 INFO:tasks.workunit.client.0.smithi088.stdout:0/290: mkdir df/d10/d22/d5f 0 2023-12-09T02:34:50.212 INFO:tasks.workunit.client.0.smithi088.stdout:0/291: truncate df/d28/d43/f49 3274258 0 2023-12-09T02:34:50.215 INFO:tasks.workunit.client.0.smithi088.stdout:0/292: symlink df/d10/d22/d2d/d3c/l60 0 2023-12-09T02:34:50.215 INFO:tasks.workunit.client.0.smithi088.stdout:0/293: readlink df/d10/d22/d2d/d3c/l42 0 2023-12-09T02:34:50.217 INFO:tasks.workunit.client.0.smithi088.stdout:2/334: dwrite f1 [0,4194304] 0 2023-12-09T02:34:50.218 INFO:tasks.workunit.client.0.smithi088.stdout:0/294: write f4 [4550015,117123] 0 2023-12-09T02:34:50.223 INFO:tasks.workunit.client.0.smithi088.stdout:2/335: link d6/d8/l24 d6/d8/d4e/d47/l7a 0 2023-12-09T02:34:50.223 INFO:tasks.workunit.client.0.smithi088.stdout:2/336: readlink d6/d8/d54/l62 0 2023-12-09T02:34:50.230 INFO:tasks.workunit.client.0.smithi088.stdout:9/281: dwrite df/d20/f5f [0,4194304] 0 2023-12-09T02:34:50.230 INFO:tasks.workunit.client.0.smithi088.stdout:3/247: dwrite d1/d2/d6/d4a/d41/d33/f42 [0,4194304] 0 2023-12-09T02:34:50.231 INFO:tasks.workunit.client.0.smithi088.stdout:9/282: mknod df/d20/d30/d3f/d48/c6c 0 2023-12-09T02:34:50.233 INFO:tasks.workunit.client.0.smithi088.stdout:2/337: dread d6/fd [0,4194304] 0 2023-12-09T02:34:50.233 INFO:tasks.workunit.client.0.smithi088.stdout:2/338: truncate d6/d13/d18/f32 1359297 0 2023-12-09T02:34:50.234 INFO:tasks.workunit.client.0.smithi088.stdout:3/248: creat d1/d2/d6/d4a/d41/d33/d49/f52 x:0 0 0 2023-12-09T02:34:50.238 INFO:tasks.workunit.client.0.smithi088.stdout:0/295: dwrite df/f30 [0,4194304] 0 2023-12-09T02:34:50.238 INFO:tasks.workunit.client.0.smithi088.stdout:1/394: dwrite d8/f38 [0,4194304] 0 2023-12-09T02:34:50.239 INFO:tasks.workunit.client.0.smithi088.stdout:1/395: getdents d8/d3d/d5d/d82 0 2023-12-09T02:34:50.241 INFO:tasks.workunit.client.0.smithi088.stdout:0/296: symlink df/d10/d22/l61 0 2023-12-09T02:34:50.241 INFO:tasks.workunit.client.0.smithi088.stdout:0/297: readlink df/d28/d34/l4c 0 2023-12-09T02:34:50.244 INFO:tasks.workunit.client.0.smithi088.stdout:1/396: creat d8/d27/d40/f8e x:0 0 0 2023-12-09T02:34:50.246 INFO:tasks.workunit.client.0.smithi088.stdout:0/298: link df/d28/d34/c51 df/d37/c62 0 2023-12-09T02:34:50.246 INFO:tasks.workunit.client.0.smithi088.stdout:0/299: stat df/d10/d22/d2d/d3c/l42 0 2023-12-09T02:34:50.249 INFO:tasks.workunit.client.0.smithi088.stdout:0/300: symlink df/d10/d22/d2d/d2e/l63 0 2023-12-09T02:34:50.249 INFO:tasks.workunit.client.0.smithi088.stdout:0/301: dread - df/d28/d33/f5a zero size 2023-12-09T02:34:50.251 INFO:tasks.workunit.client.0.smithi088.stdout:0/302: rename df/d28/l2f to df/d37/l64 0 2023-12-09T02:34:50.252 INFO:tasks.workunit.client.0.smithi088.stdout:3/249: dwrite d1/d2/d6/d4a/d41/d33/d49/f52 [0,4194304] 0 2023-12-09T02:34:50.252 INFO:tasks.workunit.client.0.smithi088.stdout:3/250: fsync d1/d2/d6/d4a/d41/d33/d49/f4f 0 2023-12-09T02:34:50.253 INFO:tasks.workunit.client.0.smithi088.stdout:2/339: dwrite d6/d8/f1a [0,4194304] 0 2023-12-09T02:34:50.254 INFO:tasks.workunit.client.0.smithi088.stdout:3/251: getdents d1 0 2023-12-09T02:34:50.256 INFO:tasks.workunit.client.0.smithi088.stdout:2/340: stat d6/d8/c5f 0 2023-12-09T02:34:50.256 INFO:tasks.workunit.client.0.smithi088.stdout:2/341: dread - d6/d8/d4e/d47/f58 zero size 2023-12-09T02:34:50.256 INFO:tasks.workunit.client.0.smithi088.stdout:2/342: stat d6/d20/d69 0 2023-12-09T02:34:50.257 INFO:tasks.workunit.client.0.smithi088.stdout:3/252: getdents d1/d2/d6/d4a 0 2023-12-09T02:34:50.258 INFO:tasks.workunit.client.0.smithi088.stdout:1/397: truncate d8/f38 4185237 0 2023-12-09T02:34:50.258 INFO:tasks.workunit.client.0.smithi088.stdout:2/343: rmdir d6/d13/d18 39 2023-12-09T02:34:50.260 INFO:tasks.workunit.client.0.smithi088.stdout:3/253: creat d1/d2/d6/d4a/f53 x:0 0 0 2023-12-09T02:34:50.260 INFO:tasks.workunit.client.0.smithi088.stdout:3/254: readlink d1/d2/d6/l3c 0 2023-12-09T02:34:50.260 INFO:tasks.workunit.client.0.smithi088.stdout:3/255: readlink d1/d2/d6/l40 0 2023-12-09T02:34:50.261 INFO:tasks.workunit.client.0.smithi088.stdout:0/303: dread df/f30 [0,4194304] 0 2023-12-09T02:34:50.261 INFO:tasks.workunit.client.0.smithi088.stdout:1/398: getdents d8/d27/d40 0 2023-12-09T02:34:50.262 INFO:tasks.workunit.client.0.smithi088.stdout:3/256: read d1/fa [1338906,91404] 0 2023-12-09T02:34:50.262 INFO:tasks.workunit.client.0.smithi088.stdout:3/257: truncate d1/d2/d6/d4a/f48 700325 0 2023-12-09T02:34:50.263 INFO:tasks.workunit.client.0.smithi088.stdout:2/344: truncate d6/f1c 1822657 0 2023-12-09T02:34:50.264 INFO:tasks.workunit.client.0.smithi088.stdout:2/345: mknod d6/d8/d4e/d47/c7b 0 2023-12-09T02:34:50.265 INFO:tasks.workunit.client.0.smithi088.stdout:2/346: fsync d6/d13/f76 0 2023-12-09T02:34:50.266 INFO:tasks.workunit.client.0.smithi088.stdout:6/317: sync 2023-12-09T02:34:50.266 INFO:tasks.workunit.client.0.smithi088.stdout:7/350: sync 2023-12-09T02:34:50.268 INFO:tasks.workunit.client.0.smithi088.stdout:6/318: link d16/d35/d36/c5a d16/d35/c64 0 2023-12-09T02:34:50.270 INFO:tasks.workunit.client.0.smithi088.stdout:7/351: rename dc/d21/f4e to dc/d1b/d32/d3e/f7d 0 2023-12-09T02:34:50.270 INFO:tasks.workunit.client.0.smithi088.stdout:7/352: write dc/d21/d6b/f78 [845132,6131] 0 2023-12-09T02:34:50.271 INFO:tasks.workunit.client.0.smithi088.stdout:6/319: mkdir d16/d35/d65 0 2023-12-09T02:34:50.272 INFO:tasks.workunit.client.0.smithi088.stdout:7/353: creat dc/d21/d6b/d6d/f7e x:0 0 0 2023-12-09T02:34:50.272 INFO:tasks.workunit.client.0.smithi088.stdout:7/354: truncate dc/d1b/d32/d38/d1e/f39 1370517 0 2023-12-09T02:34:50.273 INFO:tasks.workunit.client.0.smithi088.stdout:6/320: mkdir d16/d1b/d56/d66 0 2023-12-09T02:34:50.274 INFO:tasks.workunit.client.0.smithi088.stdout:7/355: mkdir dc/d21/d7f 0 2023-12-09T02:34:50.274 INFO:tasks.workunit.client.0.smithi088.stdout:7/356: chown dc/d1b/f4b 1488416346 1 2023-12-09T02:34:50.275 INFO:tasks.workunit.client.0.smithi088.stdout:6/321: link l3 d16/d35/d36/l67 0 2023-12-09T02:34:50.275 INFO:tasks.workunit.client.0.smithi088.stdout:0/304: dwrite df/d10/d22/d2d/f4b [0,4194304] 0 2023-12-09T02:34:50.277 INFO:tasks.workunit.client.0.smithi088.stdout:7/357: creat dc/d21/d6b/f80 x:0 0 0 2023-12-09T02:34:50.277 INFO:tasks.workunit.client.0.smithi088.stdout:7/358: write dc/d21/f58 [699959,55273] 0 2023-12-09T02:34:50.277 INFO:tasks.workunit.client.0.smithi088.stdout:3/258: dread d1/d2/d24/d45/f47 [0,4194304] 0 2023-12-09T02:34:50.277 INFO:tasks.workunit.client.0.smithi088.stdout:3/259: write d1/d2/d6/d4a/d41/d33/d49/f4f [366080,117893] 0 2023-12-09T02:34:50.277 INFO:tasks.workunit.client.0.smithi088.stdout:3/260: chown d1/d2/d6/d4a/d41/c23 36 1 2023-12-09T02:34:50.277 INFO:tasks.workunit.client.0.smithi088.stdout:3/261: readlink d1/l3b 0 2023-12-09T02:34:50.277 INFO:tasks.workunit.client.0.smithi088.stdout:3/262: chown d1/d9/c21 4 1 2023-12-09T02:34:50.277 INFO:tasks.workunit.client.0.smithi088.stdout:6/322: creat d16/d1b/d25/d5f/f68 x:0 0 0 2023-12-09T02:34:50.280 INFO:tasks.workunit.client.0.smithi088.stdout:3/263: creat d1/d2/d6/d4a/d41/d33/d49/f54 x:0 0 0 2023-12-09T02:34:50.281 INFO:tasks.workunit.client.0.smithi088.stdout:6/323: creat d16/d35/d65/f69 x:0 0 0 2023-12-09T02:34:50.281 INFO:tasks.workunit.client.0.smithi088.stdout:6/324: readlink d16/d1b/l24 0 2023-12-09T02:34:50.281 INFO:tasks.workunit.client.0.smithi088.stdout:6/325: readlink d16/d35/d36/l58 0 2023-12-09T02:34:50.283 INFO:tasks.workunit.client.0.smithi088.stdout:6/326: creat d16/d35/f6a x:0 0 0 2023-12-09T02:34:50.283 INFO:tasks.workunit.client.0.smithi088.stdout:6/327: stat d16/d35/d65 0 2023-12-09T02:34:50.283 INFO:tasks.workunit.client.0.smithi088.stdout:6/328: chown d16/d35/d36/c5a 8780501 1 2023-12-09T02:34:50.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/329: creat d16/d35/d36/f6b x:0 0 0 2023-12-09T02:34:50.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/330: chown fb 8091 1 2023-12-09T02:34:50.285 INFO:tasks.workunit.client.0.smithi088.stdout:3/264: dread d1/d2/f32 [0,4194304] 0 2023-12-09T02:34:50.286 INFO:tasks.workunit.client.0.smithi088.stdout:3/265: truncate d1/d2/d15/f27 1892915 0 2023-12-09T02:34:50.287 INFO:tasks.workunit.client.0.smithi088.stdout:3/266: creat d1/d2/f55 x:0 0 0 2023-12-09T02:34:50.289 INFO:tasks.workunit.client.0.smithi088.stdout:3/267: symlink d1/d2/d6/l56 0 2023-12-09T02:34:50.289 INFO:tasks.workunit.client.0.smithi088.stdout:3/268: stat d1/d2/d22/d43/c50 0 2023-12-09T02:34:50.290 INFO:tasks.workunit.client.0.smithi088.stdout:3/269: symlink d1/d2/d6/d4a/d41/d33/l57 0 2023-12-09T02:34:50.292 INFO:tasks.workunit.client.0.smithi088.stdout:1/399: dwrite d8/d3d/d44/d49/f65 [0,4194304] 0 2023-12-09T02:34:50.293 INFO:tasks.workunit.client.0.smithi088.stdout:3/270: mkdir d1/d58 0 2023-12-09T02:34:50.296 INFO:tasks.workunit.client.0.smithi088.stdout:0/305: dwrite df/d28/f3b [0,4194304] 0 2023-12-09T02:34:50.297 INFO:tasks.workunit.client.0.smithi088.stdout:3/271: truncate d1/d2/d6/f11 3291447 0 2023-12-09T02:34:50.298 INFO:tasks.workunit.client.0.smithi088.stdout:7/359: dwrite dc/d1b/f57 [0,4194304] 0 2023-12-09T02:34:50.299 INFO:tasks.workunit.client.0.smithi088.stdout:1/400: symlink d8/d1c/l8f 0 2023-12-09T02:34:50.301 INFO:tasks.workunit.client.0.smithi088.stdout:3/272: stat d1/d2/d24/d45/c3d 0 2023-12-09T02:34:50.301 INFO:tasks.workunit.client.0.smithi088.stdout:3/273: readlink d1/d2/d6/l40 0 2023-12-09T02:34:50.301 INFO:tasks.workunit.client.0.smithi088.stdout:3/274: dread - d1/d2/d6/d4a/d41/d33/d49/f54 zero size 2023-12-09T02:34:50.303 INFO:tasks.workunit.client.0.smithi088.stdout:6/331: dwrite d16/d1b/d2c/d3f/d41/f4b [0,4194304] 0 2023-12-09T02:34:50.304 INFO:tasks.workunit.client.0.smithi088.stdout:7/360: rmdir dc/d21 39 2023-12-09T02:34:50.307 INFO:tasks.workunit.client.0.smithi088.stdout:6/332: dread d16/d1b/d2c/d3f/d41/f43 [0,4194304] 0 2023-12-09T02:34:50.308 INFO:tasks.workunit.client.0.smithi088.stdout:6/333: chown c5 1473 1 2023-12-09T02:34:50.309 INFO:tasks.workunit.client.0.smithi088.stdout:3/275: dread d1/d2/f2f [0,4194304] 0 2023-12-09T02:34:50.314 INFO:tasks.workunit.client.0.smithi088.stdout:6/334: creat d16/d1b/d56/f6c x:0 0 0 2023-12-09T02:34:50.314 INFO:tasks.workunit.client.0.smithi088.stdout:6/335: chown d16/d1b/d25/d5f/d63 635384 1 2023-12-09T02:34:50.316 INFO:tasks.workunit.client.0.smithi088.stdout:3/276: rmdir d1/d2/d6 39 2023-12-09T02:34:50.317 INFO:tasks.workunit.client.0.smithi088.stdout:3/277: read d1/d2/d6/f36 [2458304,11538] 0 2023-12-09T02:34:50.318 INFO:tasks.workunit.client.0.smithi088.stdout:3/278: symlink d1/d3e/l59 0 2023-12-09T02:34:50.320 INFO:tasks.workunit.client.0.smithi088.stdout:3/279: getdents d1/d2/d22/d43 0 2023-12-09T02:34:50.322 INFO:tasks.workunit.client.0.smithi088.stdout:3/280: truncate d1/d2/d24/d45/f18 646019 0 2023-12-09T02:34:50.328 INFO:tasks.workunit.client.0.smithi088.stdout:3/281: dread d1/d2/d22/d43/f44 [0,4194304] 0 2023-12-09T02:34:50.329 INFO:tasks.workunit.client.0.smithi088.stdout:3/282: link d1/d2/d22/d43/c50 d1/d2/d6/c5a 0 2023-12-09T02:34:50.330 INFO:tasks.workunit.client.0.smithi088.stdout:3/283: getdents d1/d2 0 2023-12-09T02:34:50.330 INFO:tasks.workunit.client.0.smithi088.stdout:3/284: write d1/d2/d6/d4a/d41/d33/d49/f4f [1225898,87546] 0 2023-12-09T02:34:50.331 INFO:tasks.workunit.client.0.smithi088.stdout:7/361: dwrite dc/d1b/d32/d38/f49 [4194304,4194304] 0 2023-12-09T02:34:50.331 INFO:tasks.workunit.client.0.smithi088.stdout:7/362: write dc/d1b/d32/d3e/f5a [917625,110425] 0 2023-12-09T02:34:50.331 INFO:tasks.workunit.client.0.smithi088.stdout:6/336: dwrite f10 [0,4194304] 0 2023-12-09T02:34:50.332 INFO:tasks.workunit.client.0.smithi088.stdout:3/285: creat d1/d2/d6/d4a/f5b x:0 0 0 2023-12-09T02:34:50.337 INFO:tasks.workunit.client.0.smithi088.stdout:7/363: creat dc/d1b/f81 x:0 0 0 2023-12-09T02:34:50.337 INFO:tasks.workunit.client.0.smithi088.stdout:3/286: dread d1/f1c [0,4194304] 0 2023-12-09T02:34:50.339 INFO:tasks.workunit.client.0.smithi088.stdout:7/364: mkdir dc/d1b/d82 0 2023-12-09T02:34:50.340 INFO:tasks.workunit.client.0.smithi088.stdout:3/287: mknod d1/d2/d24/c5c 0 2023-12-09T02:34:50.341 INFO:tasks.workunit.client.0.smithi088.stdout:7/365: mknod dc/d1b/d32/c83 0 2023-12-09T02:34:50.352 INFO:tasks.workunit.client.0.smithi088.stdout:4/339: sync 2023-12-09T02:34:50.352 INFO:tasks.workunit.client.0.smithi088.stdout:4/340: fsync d3/d1f/f67 0 2023-12-09T02:34:50.353 INFO:tasks.workunit.client.0.smithi088.stdout:4/341: link d3/f39 d3/f70 0 2023-12-09T02:34:50.353 INFO:tasks.workunit.client.0.smithi088.stdout:4/342: write f1 [4727268,77878] 0 2023-12-09T02:34:50.355 INFO:tasks.workunit.client.0.smithi088.stdout:4/343: rmdir d3/d65 39 2023-12-09T02:34:50.357 INFO:tasks.workunit.client.0.smithi088.stdout:8/342: sync 2023-12-09T02:34:50.357 INFO:tasks.workunit.client.0.smithi088.stdout:8/343: chown d2/d9/d13/d1c/f3a 3244 1 2023-12-09T02:34:50.357 INFO:tasks.workunit.client.0.smithi088.stdout:8/344: write f0 [2944628,23874] 0 2023-12-09T02:34:50.358 INFO:tasks.workunit.client.0.smithi088.stdout:4/344: creat d3/dc/d1d/f71 x:0 0 0 2023-12-09T02:34:50.358 INFO:tasks.workunit.client.0.smithi088.stdout:6/337: dwrite d16/d35/f46 [4194304,4194304] 0 2023-12-09T02:34:50.359 INFO:tasks.workunit.client.0.smithi088.stdout:8/345: creat d2/d9/d13/d15/f81 x:0 0 0 2023-12-09T02:34:50.359 INFO:tasks.workunit.client.0.smithi088.stdout:8/346: fdatasync d2/fa 0 2023-12-09T02:34:50.360 INFO:tasks.workunit.client.0.smithi088.stdout:4/345: mknod d3/dc/d43/c72 0 2023-12-09T02:34:50.360 INFO:tasks.workunit.client.0.smithi088.stdout:6/338: read d16/d1b/f22 [1699571,33624] 0 2023-12-09T02:34:50.360 INFO:tasks.workunit.client.0.smithi088.stdout:8/347: link d2/d9/d13/d15/d6e/c71 d2/c82 0 2023-12-09T02:34:50.361 INFO:tasks.workunit.client.0.smithi088.stdout:8/348: mkdir d2/d9/d13/d1c/d5f/d83 0 2023-12-09T02:34:50.361 INFO:tasks.workunit.client.0.smithi088.stdout:8/349: chown d2/d2b/f2e 83430932 1 2023-12-09T02:34:50.361 INFO:tasks.workunit.client.0.smithi088.stdout:8/350: dread - d2/d9/d13/d1c/f5a zero size 2023-12-09T02:34:50.362 INFO:tasks.workunit.client.0.smithi088.stdout:8/351: mkdir d2/d9/d13/d1c/d5f/d84 0 2023-12-09T02:34:50.364 INFO:tasks.workunit.client.0.smithi088.stdout:3/288: dwrite d1/d2/d6/d4a/d41/d33/d49/f54 [0,4194304] 0 2023-12-09T02:34:50.364 INFO:tasks.workunit.client.0.smithi088.stdout:8/352: mkdir d2/d9/d1a/d62/d76/d85 0 2023-12-09T02:34:50.365 INFO:tasks.workunit.client.0.smithi088.stdout:6/339: read f14 [508139,42614] 0 2023-12-09T02:34:50.365 INFO:tasks.workunit.client.0.smithi088.stdout:6/340: fdatasync d16/d1b/d25/f40 0 2023-12-09T02:34:50.365 INFO:tasks.workunit.client.0.smithi088.stdout:6/341: stat d16/d1b/d2c/d3f/d41/f4d 0 2023-12-09T02:34:50.365 INFO:tasks.workunit.client.0.smithi088.stdout:6/342: readlink l8 0 2023-12-09T02:34:50.369 INFO:tasks.workunit.client.0.smithi088.stdout:8/353: write d2/d9/d13/f2f [1291993,107232] 0 2023-12-09T02:34:50.369 INFO:tasks.workunit.client.0.smithi088.stdout:8/354: write d2/d9/d13/d15/f26 [379943,55373] 0 2023-12-09T02:34:50.369 INFO:tasks.workunit.client.0.smithi088.stdout:3/289: write d1/d2/d6/d4a/d41/d33/d49/f52 [1458580,46261] 0 2023-12-09T02:34:50.371 INFO:tasks.workunit.client.0.smithi088.stdout:7/366: dwrite f2 [0,4194304] 0 2023-12-09T02:34:50.371 INFO:tasks.workunit.client.0.smithi088.stdout:6/343: dread f11 [0,4194304] 0 2023-12-09T02:34:50.371 INFO:tasks.workunit.client.0.smithi088.stdout:6/344: readlink d16/d1b/d2c/d3f/d41/l47 0 2023-12-09T02:34:50.371 INFO:tasks.workunit.client.0.smithi088.stdout:6/345: chown l8 474495423 1 2023-12-09T02:34:50.372 INFO:tasks.workunit.client.0.smithi088.stdout:8/355: creat d2/d9/d13/d1c/d74/f86 x:0 0 0 2023-12-09T02:34:50.372 INFO:tasks.workunit.client.0.smithi088.stdout:8/356: dread - d2/d9/d13/d1c/f5a zero size 2023-12-09T02:34:50.375 INFO:tasks.workunit.client.0.smithi088.stdout:3/290: rename d1/f25 to d1/d2/d22/d43/f5d 0 2023-12-09T02:34:50.375 INFO:tasks.workunit.client.0.smithi088.stdout:3/291: readlink d1/d2/d6/l3c 0 2023-12-09T02:34:50.375 INFO:tasks.workunit.client.0.smithi088.stdout:6/346: write f9 [3229211,32633] 0 2023-12-09T02:34:50.376 INFO:tasks.workunit.client.0.smithi088.stdout:7/367: creat dc/d1b/d82/f84 x:0 0 0 2023-12-09T02:34:50.377 INFO:tasks.workunit.client.0.smithi088.stdout:4/346: dwrite d3/dc/f11 [0,4194304] 0 2023-12-09T02:34:50.378 INFO:tasks.workunit.client.0.smithi088.stdout:4/347: fsync d3/dc/f11 0 2023-12-09T02:34:50.378 INFO:tasks.workunit.client.0.smithi088.stdout:4/348: write d3/dc/d1d/d3c/f51 [723970,10430] 0 2023-12-09T02:34:50.378 INFO:tasks.workunit.client.0.smithi088.stdout:6/347: mknod d16/d1b/d2c/d60/c6d 0 2023-12-09T02:34:50.379 INFO:tasks.workunit.client.0.smithi088.stdout:7/368: symlink dc/d1b/d66/l85 0 2023-12-09T02:34:50.380 INFO:tasks.workunit.client.0.smithi088.stdout:9/283: sync 2023-12-09T02:34:50.381 INFO:tasks.workunit.client.0.smithi088.stdout:9/284: write df/d20/d30/f35 [721726,89959] 0 2023-12-09T02:34:50.381 INFO:tasks.workunit.client.0.smithi088.stdout:9/285: stat df/d20/d30/d60/d5c 0 2023-12-09T02:34:50.383 INFO:tasks.workunit.client.0.smithi088.stdout:4/349: rename d3/dc/d18/d29/d4a to d3/d65/d73 0 2023-12-09T02:34:50.384 INFO:tasks.workunit.client.0.smithi088.stdout:2/347: sync 2023-12-09T02:34:50.384 INFO:tasks.workunit.client.0.smithi088.stdout:5/314: sync 2023-12-09T02:34:50.386 INFO:tasks.workunit.client.0.smithi088.stdout:6/348: rmdir d16/d1b/d25 39 2023-12-09T02:34:50.387 INFO:tasks.workunit.client.0.smithi088.stdout:8/357: dwrite d2/f3 [0,4194304] 0 2023-12-09T02:34:50.388 INFO:tasks.workunit.client.0.smithi088.stdout:8/358: read d2/d9/d1a/f1f [42421,80032] 0 2023-12-09T02:34:50.389 INFO:tasks.workunit.client.0.smithi088.stdout:9/286: rmdir df/d20/d30/d60 39 2023-12-09T02:34:50.391 INFO:tasks.workunit.client.0.smithi088.stdout:4/350: creat d3/d65/f74 x:0 0 0 2023-12-09T02:34:50.391 INFO:tasks.workunit.client.0.smithi088.stdout:4/351: chown d3/dc/d1d/f71 10622 1 2023-12-09T02:34:50.392 INFO:tasks.workunit.client.0.smithi088.stdout:5/315: rename d3/d15/de/d10/c25 to d3/d15/de/c66 0 2023-12-09T02:34:50.393 INFO:tasks.workunit.client.0.smithi088.stdout:2/348: mknod d6/d8/d1f/d22/c7c 0 2023-12-09T02:34:50.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/349: getdents d16/d1b 0 2023-12-09T02:34:50.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/350: write d16/d1b/d25/f3d [831364,107179] 0 2023-12-09T02:34:50.399 INFO:tasks.workunit.client.0.smithi088.stdout:8/359: truncate d2/d9/d1a/f1f 216226 0 2023-12-09T02:34:50.399 INFO:tasks.workunit.client.0.smithi088.stdout:8/360: chown d2/d9/d13/d1c/d74/f86 0 1 2023-12-09T02:34:50.399 INFO:tasks.workunit.client.0.smithi088.stdout:8/361: stat d2/d9/d13/d15/l38 0 2023-12-09T02:34:50.399 INFO:tasks.workunit.client.0.smithi088.stdout:8/362: fsync d2/fa 0 2023-12-09T02:34:50.400 INFO:tasks.workunit.client.0.smithi088.stdout:4/352: symlink d3/d1f/d37/l75 0 2023-12-09T02:34:50.400 INFO:tasks.workunit.client.0.smithi088.stdout:9/287: dread df/f2c [0,4194304] 0 2023-12-09T02:34:50.401 INFO:tasks.workunit.client.0.smithi088.stdout:5/316: getdents d3/d15/de/d10/d18/d19/d1b/d35/d42 0 2023-12-09T02:34:50.402 INFO:tasks.workunit.client.0.smithi088.stdout:3/292: dwrite d1/d2/d6/f36 [0,4194304] 0 2023-12-09T02:34:50.402 INFO:tasks.workunit.client.0.smithi088.stdout:2/349: symlink d6/d20/d69/l7d 0 2023-12-09T02:34:50.402 INFO:tasks.workunit.client.0.smithi088.stdout:2/350: stat d6/d8/d1f/d22/l63 0 2023-12-09T02:34:50.404 INFO:tasks.workunit.client.0.smithi088.stdout:4/353: creat d3/f76 x:0 0 0 2023-12-09T02:34:50.407 INFO:tasks.workunit.client.0.smithi088.stdout:9/288: link df/f17 df/d20/d30/f6d 0 2023-12-09T02:34:50.408 INFO:tasks.workunit.client.0.smithi088.stdout:7/369: dwrite dc/d1b/d32/d38/f17 [4194304,4194304] 0 2023-12-09T02:34:50.408 INFO:tasks.workunit.client.0.smithi088.stdout:7/370: readlink dc/d1b/d32/l4c 0 2023-12-09T02:34:50.408 INFO:tasks.workunit.client.0.smithi088.stdout:7/371: write dc/d1b/f81 [52727,48280] 0 2023-12-09T02:34:50.408 INFO:tasks.workunit.client.0.smithi088.stdout:7/372: fdatasync f2 0 2023-12-09T02:34:50.408 INFO:tasks.workunit.client.0.smithi088.stdout:3/293: mknod d1/d3e/c5e 0 2023-12-09T02:34:50.410 INFO:tasks.workunit.client.0.smithi088.stdout:2/351: rename d6/d8/d1f/d22/c4d to d6/d20/d3d/c7e 0 2023-12-09T02:34:50.412 INFO:tasks.workunit.client.0.smithi088.stdout:4/354: symlink d3/dc/d43/l77 0 2023-12-09T02:34:50.413 INFO:tasks.workunit.client.0.smithi088.stdout:6/351: dwrite f12 [0,4194304] 0 2023-12-09T02:34:50.413 INFO:tasks.workunit.client.0.smithi088.stdout:9/289: truncate df/d20/d30/f6d 783762 0 2023-12-09T02:34:50.414 INFO:tasks.workunit.client.0.smithi088.stdout:0/306: sync 2023-12-09T02:34:50.414 INFO:tasks.workunit.client.0.smithi088.stdout:1/401: sync 2023-12-09T02:34:50.415 INFO:tasks.workunit.client.0.smithi088.stdout:3/294: symlink d1/d2/d6/d4a/d41/d33/d49/l5f 0 2023-12-09T02:34:50.422 INFO:tasks.workunit.client.0.smithi088.stdout:8/363: truncate d2/f3 3382668 0 2023-12-09T02:34:50.422 INFO:tasks.workunit.client.0.smithi088.stdout:2/352: rename d6/d8/d4e/d3c/f5b to d6/d8/d1f/d22/d68/f7f 0 2023-12-09T02:34:50.422 INFO:tasks.workunit.client.0.smithi088.stdout:2/353: fsync d6/d8/d4e/f74 0 2023-12-09T02:34:50.422 INFO:tasks.workunit.client.0.smithi088.stdout:2/354: write d6/d13/f1e [5119034,1165] 0 2023-12-09T02:34:50.423 INFO:tasks.workunit.client.0.smithi088.stdout:2/355: read - d6/f12 zero size 2023-12-09T02:34:50.423 INFO:tasks.workunit.client.0.smithi088.stdout:6/352: creat d16/d1b/d25/d5f/f6e x:0 0 0 2023-12-09T02:34:50.423 INFO:tasks.workunit.client.0.smithi088.stdout:3/295: dread d1/d2/d6/f3f [0,4194304] 0 2023-12-09T02:34:50.423 INFO:tasks.workunit.client.0.smithi088.stdout:0/307: mknod df/d10/d22/d5f/c65 0 2023-12-09T02:34:50.424 INFO:tasks.workunit.client.0.smithi088.stdout:1/402: creat d8/d1b/d6d/d7c/f90 x:0 0 0 2023-12-09T02:34:50.425 INFO:tasks.workunit.client.0.smithi088.stdout:8/364: mknod d2/d9/d1a/d62/c87 0 2023-12-09T02:34:50.428 INFO:tasks.workunit.client.0.smithi088.stdout:6/353: mkdir d16/d62/d6f 0 2023-12-09T02:34:50.431 INFO:tasks.workunit.client.0.smithi088.stdout:3/296: mknod d1/d2/d22/d43/c60 0 2023-12-09T02:34:50.433 INFO:tasks.workunit.client.0.smithi088.stdout:1/403: creat d8/d27/d66/f91 x:0 0 0 2023-12-09T02:34:50.434 INFO:tasks.workunit.client.0.smithi088.stdout:8/365: dread d2/d9/d13/d1c/f64 [0,4194304] 0 2023-12-09T02:34:50.434 INFO:tasks.workunit.client.0.smithi088.stdout:5/317: dwrite d3/d15/f5b [0,4194304] 0 2023-12-09T02:34:50.438 INFO:tasks.workunit.client.0.smithi088.stdout:1/404: link d8/d53/f89 d8/d1b/d6d/f92 0 2023-12-09T02:34:50.439 INFO:tasks.workunit.client.0.smithi088.stdout:8/366: creat d2/d9/d13/f88 x:0 0 0 2023-12-09T02:34:50.439 INFO:tasks.workunit.client.0.smithi088.stdout:6/354: mkdir d16/d70 0 2023-12-09T02:34:50.439 INFO:tasks.workunit.client.0.smithi088.stdout:6/355: read - d16/d1b/d25/d5f/f6e zero size 2023-12-09T02:34:50.441 INFO:tasks.workunit.client.0.smithi088.stdout:9/290: dwrite df/d29/d2f/f3a [0,4194304] 0 2023-12-09T02:34:50.441 INFO:tasks.workunit.client.0.smithi088.stdout:9/291: fdatasync df/d20/d30/d3f/d48/f46 0 2023-12-09T02:34:50.442 INFO:tasks.workunit.client.0.smithi088.stdout:1/405: mknod d8/d27/d40/c93 0 2023-12-09T02:34:50.442 INFO:tasks.workunit.client.0.smithi088.stdout:0/308: dread df/d10/f29 [0,4194304] 0 2023-12-09T02:34:50.442 INFO:tasks.workunit.client.0.smithi088.stdout:6/356: rmdir d16/d35/d65 39 2023-12-09T02:34:50.443 INFO:tasks.workunit.client.0.smithi088.stdout:6/357: truncate d16/d1b/d25/f27 1722846 0 2023-12-09T02:34:50.444 INFO:tasks.workunit.client.0.smithi088.stdout:9/292: creat df/d20/d30/d3f/d48/f6e x:0 0 0 2023-12-09T02:34:50.444 INFO:tasks.workunit.client.0.smithi088.stdout:9/293: write df/d50/f58 [714909,22610] 0 2023-12-09T02:34:50.444 INFO:tasks.workunit.client.0.smithi088.stdout:1/406: mknod d8/d3d/d5d/d82/c94 0 2023-12-09T02:34:50.445 INFO:tasks.workunit.client.0.smithi088.stdout:9/294: symlink df/d20/d30/d4e/l6f 0 2023-12-09T02:34:50.446 INFO:tasks.workunit.client.0.smithi088.stdout:9/295: link df/d20/d4c/l4d df/d50/l70 0 2023-12-09T02:34:50.447 INFO:tasks.workunit.client.0.smithi088.stdout:9/296: mkdir df/d20/d4c/d71 0 2023-12-09T02:34:50.448 INFO:tasks.workunit.client.0.smithi088.stdout:9/297: symlink df/d29/l72 0 2023-12-09T02:34:50.454 INFO:tasks.workunit.client.0.smithi088.stdout:7/373: dwrite f2 [0,4194304] 0 2023-12-09T02:34:50.455 INFO:tasks.workunit.client.0.smithi088.stdout:4/355: dwrite d3/dc/f61 [0,4194304] 0 2023-12-09T02:34:50.456 INFO:tasks.workunit.client.0.smithi088.stdout:7/374: unlink dc/d1b/f2b 0 2023-12-09T02:34:50.456 INFO:tasks.workunit.client.0.smithi088.stdout:3/297: dread d1/d2/d6/d4a/d41/d33/d49/f4f [0,4194304] 0 2023-12-09T02:34:50.457 INFO:tasks.workunit.client.0.smithi088.stdout:0/309: dread df/d10/f24 [0,4194304] 0 2023-12-09T02:34:50.457 INFO:tasks.workunit.client.0.smithi088.stdout:2/356: dwrite d6/f39 [0,4194304] 0 2023-12-09T02:34:50.459 INFO:tasks.workunit.client.0.smithi088.stdout:9/298: dread df/d20/d30/f35 [0,4194304] 0 2023-12-09T02:34:50.460 INFO:tasks.workunit.client.0.smithi088.stdout:9/299: write df/f1a [2064272,94355] 0 2023-12-09T02:34:50.462 INFO:tasks.workunit.client.0.smithi088.stdout:1/407: dread d8/f3e [0,4194304] 0 2023-12-09T02:34:50.463 INFO:tasks.workunit.client.0.smithi088.stdout:0/310: dread df/f30 [0,4194304] 0 2023-12-09T02:34:50.463 INFO:tasks.workunit.client.0.smithi088.stdout:0/311: fdatasync fb 0 2023-12-09T02:34:50.463 INFO:tasks.workunit.client.0.smithi088.stdout:0/312: write df/f57 [942670,102958] 0 2023-12-09T02:34:50.463 INFO:tasks.workunit.client.0.smithi088.stdout:0/313: chown df/l1c 200344 1 2023-12-09T02:34:50.464 INFO:tasks.workunit.client.0.smithi088.stdout:7/375: link dc/d21/c54 dc/d21/d6b/d6d/c86 0 2023-12-09T02:34:50.464 INFO:tasks.workunit.client.0.smithi088.stdout:4/356: dread d3/dc/d18/d29/f3b [0,4194304] 0 2023-12-09T02:34:50.464 INFO:tasks.workunit.client.0.smithi088.stdout:4/357: chown d3/d1f 468069424 1 2023-12-09T02:34:50.464 INFO:tasks.workunit.client.0.smithi088.stdout:4/358: readlink d3/l5d 0 2023-12-09T02:34:50.464 INFO:tasks.workunit.client.0.smithi088.stdout:3/298: rmdir d1/d2/d6/d4a/d41/d33/d49 39 2023-12-09T02:34:50.467 INFO:tasks.workunit.client.0.smithi088.stdout:6/358: dread f9 [0,4194304] 0 2023-12-09T02:34:50.478 INFO:tasks.workunit.client.0.smithi088.stdout:2/357: link d6/d8/d1f/d22/c2e d6/d8/d4e/d3c/c80 0 2023-12-09T02:34:50.478 INFO:tasks.workunit.client.0.smithi088.stdout:2/358: chown d6/d8/d1f/d22/d68/f7f 5072139 1 2023-12-09T02:34:50.481 INFO:tasks.workunit.client.0.smithi088.stdout:1/408: rename d8/d1c/d31 to d8/d3d/d5d/d95 0 2023-12-09T02:34:50.481 INFO:tasks.workunit.client.0.smithi088.stdout:1/409: truncate f4 646517 0 2023-12-09T02:34:50.481 INFO:tasks.workunit.client.0.smithi088.stdout:2/359: read d6/d8/d4e/d3c/f53 [2665324,105574] 0 2023-12-09T02:34:50.482 INFO:tasks.workunit.client.0.smithi088.stdout:4/359: rmdir d3/d1f 39 2023-12-09T02:34:50.484 INFO:tasks.workunit.client.0.smithi088.stdout:1/410: read d8/d3d/d44/d49/f65 [2956911,38351] 0 2023-12-09T02:34:50.484 INFO:tasks.workunit.client.0.smithi088.stdout:7/376: mknod dc/d21/d7f/c87 0 2023-12-09T02:34:50.486 INFO:tasks.workunit.client.0.smithi088.stdout:3/299: unlink d1/d2/d24/l2a 0 2023-12-09T02:34:50.488 INFO:tasks.workunit.client.0.smithi088.stdout:4/360: symlink d3/dc/d1d/d3c/l78 0 2023-12-09T02:34:50.491 INFO:tasks.workunit.client.0.smithi088.stdout:7/377: symlink dc/l88 0 2023-12-09T02:34:50.491 INFO:tasks.workunit.client.0.smithi088.stdout:7/378: dread - dc/d1b/f5c zero size 2023-12-09T02:34:50.491 INFO:tasks.workunit.client.0.smithi088.stdout:0/314: dwrite df/d10/f24 [0,4194304] 0 2023-12-09T02:34:50.491 INFO:tasks.workunit.client.0.smithi088.stdout:0/315: truncate df/d28/d33/f56 239265 0 2023-12-09T02:34:50.493 INFO:tasks.workunit.client.0.smithi088.stdout:4/361: creat d3/d65/f79 x:0 0 0 2023-12-09T02:34:50.494 INFO:tasks.workunit.client.0.smithi088.stdout:7/379: mkdir dc/d1b/d89 0 2023-12-09T02:34:50.495 INFO:tasks.workunit.client.0.smithi088.stdout:9/300: dwrite df/d20/d30/f43 [0,4194304] 0 2023-12-09T02:34:50.497 INFO:tasks.workunit.client.0.smithi088.stdout:7/380: symlink dc/d21/l8a 0 2023-12-09T02:34:50.497 INFO:tasks.workunit.client.0.smithi088.stdout:3/300: write d1/d2/d6/f36 [3280922,36272] 0 2023-12-09T02:34:50.498 INFO:tasks.workunit.client.0.smithi088.stdout:0/316: write df/d10/f1e [1320345,82415] 0 2023-12-09T02:34:50.498 INFO:tasks.workunit.client.0.smithi088.stdout:0/317: chown df/c12 10417679 1 2023-12-09T02:34:50.498 INFO:tasks.workunit.client.0.smithi088.stdout:0/318: chown df/d10/l26 0 1 2023-12-09T02:34:50.501 INFO:tasks.workunit.client.0.smithi088.stdout:9/301: creat df/d50/d63/f73 x:0 0 0 2023-12-09T02:34:50.501 INFO:tasks.workunit.client.0.smithi088.stdout:6/359: dwrite f9 [0,4194304] 0 2023-12-09T02:34:50.501 INFO:tasks.workunit.client.0.smithi088.stdout:6/360: fdatasync fb 0 2023-12-09T02:34:50.504 INFO:tasks.workunit.client.0.smithi088.stdout:7/381: creat dc/d21/d7f/f8b x:0 0 0 2023-12-09T02:34:50.504 INFO:tasks.workunit.client.0.smithi088.stdout:0/319: symlink df/d10/d22/d5f/l66 0 2023-12-09T02:34:50.505 INFO:tasks.workunit.client.0.smithi088.stdout:3/301: link d1/d2/d6/ff d1/d58/f61 0 2023-12-09T02:34:50.505 INFO:tasks.workunit.client.0.smithi088.stdout:0/320: chown l5 10352 1 2023-12-09T02:34:50.505 INFO:tasks.workunit.client.0.smithi088.stdout:2/360: dwrite d6/d13/d18/f36 [0,4194304] 0 2023-12-09T02:34:50.507 INFO:tasks.workunit.client.0.smithi088.stdout:6/361: unlink d16/d35/d36/f52 0 2023-12-09T02:34:50.507 INFO:tasks.workunit.client.0.smithi088.stdout:6/362: readlink d16/d1b/l24 0 2023-12-09T02:34:50.507 INFO:tasks.workunit.client.0.smithi088.stdout:6/363: write d16/d1b/f1d [4370525,107366] 0 2023-12-09T02:34:50.508 INFO:tasks.workunit.client.0.smithi088.stdout:7/382: creat dc/d21/f8c x:0 0 0 2023-12-09T02:34:50.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/321: creat df/f67 x:0 0 0 2023-12-09T02:34:50.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/322: readlink df/d37/l64 0 2023-12-09T02:34:50.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/323: readlink df/d28/d34/l58 0 2023-12-09T02:34:50.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/324: chown df/d10/d22/f54 204 1 2023-12-09T02:34:50.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/325: dread - df/d10/d22/d2d/f52 zero size 2023-12-09T02:34:50.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/326: write df/d10/d22/f54 [399994,34088] 0 2023-12-09T02:34:50.511 INFO:tasks.workunit.client.0.smithi088.stdout:3/302: mkdir d1/d2/d15/d62 0 2023-12-09T02:34:50.514 INFO:tasks.workunit.client.0.smithi088.stdout:3/303: dread d1/f1c [0,4194304] 0 2023-12-09T02:34:50.514 INFO:tasks.workunit.client.0.smithi088.stdout:2/361: dread d6/d13/d18/f28 [0,4194304] 0 2023-12-09T02:34:50.517 INFO:tasks.workunit.client.0.smithi088.stdout:1/411: dwrite d8/d1b/f20 [0,4194304] 0 2023-12-09T02:34:50.517 INFO:tasks.workunit.client.0.smithi088.stdout:1/412: fsync d8/f3e 0 2023-12-09T02:34:50.522 INFO:tasks.workunit.client.0.smithi088.stdout:7/383: creat dc/d1b/d72/f8d x:0 0 0 2023-12-09T02:34:50.524 INFO:tasks.workunit.client.0.smithi088.stdout:2/362: mknod d6/d8/d4e/c81 0 2023-12-09T02:34:50.524 INFO:tasks.workunit.client.0.smithi088.stdout:9/302: fsync df/d50/d63/f73 0 2023-12-09T02:34:50.526 INFO:tasks.workunit.client.0.smithi088.stdout:1/413: creat d8/d1b/d1d/f96 x:0 0 0 2023-12-09T02:34:50.529 INFO:tasks.workunit.client.0.smithi088.stdout:7/384: creat dc/d1b/d66/f8e x:0 0 0 2023-12-09T02:34:50.530 INFO:tasks.workunit.client.0.smithi088.stdout:1/414: truncate d8/d53/f55 3785128 0 2023-12-09T02:34:50.532 INFO:tasks.workunit.client.0.smithi088.stdout:9/303: dread df/f1c [0,4194304] 0 2023-12-09T02:34:50.533 INFO:tasks.workunit.client.0.smithi088.stdout:1/415: link d8/d27/d40/f4b d8/d1b/d6d/f97 0 2023-12-09T02:34:50.533 INFO:tasks.workunit.client.0.smithi088.stdout:1/416: chown d8/d27/d75/f85 3 1 2023-12-09T02:34:50.533 INFO:tasks.workunit.client.0.smithi088.stdout:1/417: dread - d8/d27/d66/f91 zero size 2023-12-09T02:34:50.534 INFO:tasks.workunit.client.0.smithi088.stdout:9/304: mknod df/d20/d4c/c74 0 2023-12-09T02:34:50.534 INFO:tasks.workunit.client.0.smithi088.stdout:9/305: write df/d20/d30/d60/d5c/f66 [329794,25031] 0 2023-12-09T02:34:50.536 INFO:tasks.workunit.client.0.smithi088.stdout:1/418: mkdir d8/d3d/d5d/d95/d98 0 2023-12-09T02:34:50.537 INFO:tasks.workunit.client.0.smithi088.stdout:3/304: dwrite d1/d2/d6/d4a/f38 [0,4194304] 0 2023-12-09T02:34:50.538 INFO:tasks.workunit.client.0.smithi088.stdout:3/305: chown d1/d2/d6/c5a 959697 1 2023-12-09T02:34:50.538 INFO:tasks.workunit.client.0.smithi088.stdout:0/327: dwrite df/d10/f24 [0,4194304] 0 2023-12-09T02:34:50.538 INFO:tasks.workunit.client.0.smithi088.stdout:6/364: dwrite d16/d1b/d2c/f2d [0,4194304] 0 2023-12-09T02:34:50.538 INFO:tasks.workunit.client.0.smithi088.stdout:2/363: dread d6/d8/d1f/d22/f40 [0,4194304] 0 2023-12-09T02:34:50.538 INFO:tasks.workunit.client.0.smithi088.stdout:0/328: readlink df/d10/d22/l61 0 2023-12-09T02:34:50.539 INFO:tasks.workunit.client.0.smithi088.stdout:6/365: chown d16/d35/f46 480 1 2023-12-09T02:34:50.539 INFO:tasks.workunit.client.0.smithi088.stdout:1/419: link d8/d1c/f29 d8/d27/d66/d79/f99 0 2023-12-09T02:34:50.539 INFO:tasks.workunit.client.0.smithi088.stdout:8/367: sync 2023-12-09T02:34:50.539 INFO:tasks.workunit.client.0.smithi088.stdout:5/318: sync 2023-12-09T02:34:50.542 INFO:tasks.workunit.client.0.smithi088.stdout:6/366: truncate d16/d35/f46 435870 0 2023-12-09T02:34:50.544 INFO:tasks.workunit.client.0.smithi088.stdout:1/420: truncate d8/d3d/f4f 1191902 0 2023-12-09T02:34:50.544 INFO:tasks.workunit.client.0.smithi088.stdout:7/385: rmdir dc/d1b/d72 39 2023-12-09T02:34:50.544 INFO:tasks.workunit.client.0.smithi088.stdout:1/421: fsync d8/f8c 0 2023-12-09T02:34:50.544 INFO:tasks.workunit.client.0.smithi088.stdout:0/329: mknod df/d10/d22/d5f/c68 0 2023-12-09T02:34:50.544 INFO:tasks.workunit.client.0.smithi088.stdout:0/330: chown df/d28/d33 356 1 2023-12-09T02:34:50.544 INFO:tasks.workunit.client.0.smithi088.stdout:3/306: dread d1/d2/d6/d4a/d41/d33/d49/f52 [0,4194304] 0 2023-12-09T02:34:50.546 INFO:tasks.workunit.client.0.smithi088.stdout:8/368: rmdir d2/d9/d13/d1c/d5f/d83 0 2023-12-09T02:34:50.547 INFO:tasks.workunit.client.0.smithi088.stdout:5/319: truncate d3/d15/de/d10/d18/d19/d1b/f34 3885731 0 2023-12-09T02:34:50.547 INFO:tasks.workunit.client.0.smithi088.stdout:8/369: dread d2/d9/d13/d15/f26 [0,4194304] 0 2023-12-09T02:34:50.549 INFO:tasks.workunit.client.0.smithi088.stdout:6/367: unlink l8 0 2023-12-09T02:34:50.549 INFO:tasks.workunit.client.0.smithi088.stdout:6/368: stat d16/d1b/d2c 0 2023-12-09T02:34:50.549 INFO:tasks.workunit.client.0.smithi088.stdout:6/369: truncate d16/d1b/d25/d5f/f68 796651 0 2023-12-09T02:34:50.549 INFO:tasks.workunit.client.0.smithi088.stdout:5/320: dread d3/d15/de/d2c/f44 [0,4194304] 0 2023-12-09T02:34:50.553 INFO:tasks.workunit.client.0.smithi088.stdout:1/422: mkdir d8/d27/d9a 0 2023-12-09T02:34:50.553 INFO:tasks.workunit.client.0.smithi088.stdout:1/423: truncate d8/d1b/d6d/f80 90192 0 2023-12-09T02:34:50.553 INFO:tasks.workunit.client.0.smithi088.stdout:1/424: fsync d8/d1b/f6a 0 2023-12-09T02:34:50.553 INFO:tasks.workunit.client.0.smithi088.stdout:1/425: fdatasync d8/d1b/d1d/f67 0 2023-12-09T02:34:50.553 INFO:tasks.workunit.client.0.smithi088.stdout:1/426: readlink d8/d3d/d5d/d95/l3c 0 2023-12-09T02:34:50.554 INFO:tasks.workunit.client.0.smithi088.stdout:0/331: rename fb to df/d10/f69 0 2023-12-09T02:34:50.555 INFO:tasks.workunit.client.0.smithi088.stdout:3/307: creat d1/d2/d6/d4a/d41/d33/f63 x:0 0 0 2023-12-09T02:34:50.557 INFO:tasks.workunit.client.0.smithi088.stdout:8/370: creat d2/d9/d13/d1c/f89 x:0 0 0 2023-12-09T02:34:50.558 INFO:tasks.workunit.client.0.smithi088.stdout:7/386: link dc/d1b/d66/f8e dc/d21/f8f 0 2023-12-09T02:34:50.561 INFO:tasks.workunit.client.0.smithi088.stdout:5/321: rename d3/d15/de/d10/d48 to d3/d15/de/d10/d18/d19/d1b/d35/d58/d67 0 2023-12-09T02:34:50.564 INFO:tasks.workunit.client.0.smithi088.stdout:6/370: dwrite d16/d1b/d25/f27 [0,4194304] 0 2023-12-09T02:34:50.564 INFO:tasks.workunit.client.0.smithi088.stdout:6/371: dread - d16/d35/f6a zero size 2023-12-09T02:34:50.564 INFO:tasks.workunit.client.0.smithi088.stdout:6/372: chown d16/d1b/d25/c3e 1004 1 2023-12-09T02:34:50.565 INFO:tasks.workunit.client.0.smithi088.stdout:3/308: rmdir d1/d2/d15/d62 0 2023-12-09T02:34:50.566 INFO:tasks.workunit.client.0.smithi088.stdout:3/309: dread d1/d2/d6/d4a/f48 [0,4194304] 0 2023-12-09T02:34:50.568 INFO:tasks.workunit.client.0.smithi088.stdout:8/371: rename d2/cf to d2/d9/c8a 0 2023-12-09T02:34:50.570 INFO:tasks.workunit.client.0.smithi088.stdout:5/322: symlink d3/d15/de/d10/d18/d19/d1b/d35/d42/l68 0 2023-12-09T02:34:50.577 INFO:tasks.workunit.client.0.smithi088.stdout:6/373: mkdir d16/d1b/d71 0 2023-12-09T02:34:50.579 INFO:tasks.workunit.client.0.smithi088.stdout:3/310: symlink d1/d9/l64 0 2023-12-09T02:34:50.582 INFO:tasks.workunit.client.0.smithi088.stdout:5/323: creat d3/d15/de/d10/d18/d19/d1b/d35/f69 x:0 0 0 2023-12-09T02:34:50.582 INFO:tasks.workunit.client.0.smithi088.stdout:5/324: write d3/d15/dc/f2d [570112,54410] 0 2023-12-09T02:34:50.583 INFO:tasks.workunit.client.0.smithi088.stdout:3/311: rename d1/d2/d6/l56 to d1/d9/l65 0 2023-12-09T02:34:50.584 INFO:tasks.workunit.client.0.smithi088.stdout:5/325: write d3/f3d [2705409,47198] 0 2023-12-09T02:34:50.584 INFO:tasks.workunit.client.0.smithi088.stdout:3/312: write d1/d2/d15/f3a [3971583,75142] 0 2023-12-09T02:34:50.587 INFO:tasks.workunit.client.0.smithi088.stdout:5/326: creat d3/d15/de/d10/d18/d19/d1b/d35/d42/d47/f6a x:0 0 0 2023-12-09T02:34:50.589 INFO:tasks.workunit.client.0.smithi088.stdout:5/327: mknod d3/d15/de/d10/c6b 0 2023-12-09T02:34:50.590 INFO:tasks.workunit.client.0.smithi088.stdout:5/328: symlink d3/d15/de/d2c/l6c 0 2023-12-09T02:34:50.593 INFO:tasks.workunit.client.0.smithi088.stdout:1/427: dwrite d8/f3e [0,4194304] 0 2023-12-09T02:34:50.593 INFO:tasks.workunit.client.0.smithi088.stdout:1/428: chown d8/d1c/d50 131268 1 2023-12-09T02:34:50.593 INFO:tasks.workunit.client.0.smithi088.stdout:1/429: write d8/d1b/d6d/f97 [856340,63134] 0 2023-12-09T02:34:50.595 INFO:tasks.workunit.client.0.smithi088.stdout:5/329: mknod d3/d15/de/d10/d18/d19/d1b/d35/c6d 0 2023-12-09T02:34:50.596 INFO:tasks.workunit.client.0.smithi088.stdout:0/332: dwrite df/d28/d33/f5a [0,4194304] 0 2023-12-09T02:34:50.599 INFO:tasks.workunit.client.0.smithi088.stdout:5/330: creat d3/d15/de/d10/f6e x:0 0 0 2023-12-09T02:34:50.599 INFO:tasks.workunit.client.0.smithi088.stdout:5/331: readlink d3/d8/l12 0 2023-12-09T02:34:50.600 INFO:tasks.workunit.client.0.smithi088.stdout:5/332: mknod d3/d15/dc/c6f 0 2023-12-09T02:34:50.601 INFO:tasks.workunit.client.0.smithi088.stdout:7/387: dwrite dc/d1b/d32/d3e/f62 [0,4194304] 0 2023-12-09T02:34:50.602 INFO:tasks.workunit.client.0.smithi088.stdout:7/388: stat dc/d1b/d32/d38/c2a 0 2023-12-09T02:34:50.602 INFO:tasks.workunit.client.0.smithi088.stdout:7/389: chown dc/d21/f61 1 1 2023-12-09T02:34:50.602 INFO:tasks.workunit.client.0.smithi088.stdout:7/390: fdatasync dc/d1b/f70 0 2023-12-09T02:34:50.602 INFO:tasks.workunit.client.0.smithi088.stdout:8/372: dwrite d2/d9/f10 [0,4194304] 0 2023-12-09T02:34:50.603 INFO:tasks.workunit.client.0.smithi088.stdout:5/333: mkdir d3/d15/de/d10/d51/d70 0 2023-12-09T02:34:50.603 INFO:tasks.workunit.client.0.smithi088.stdout:5/334: fdatasync d3/d15/de/d10/d18/d19/d1b/f34 0 2023-12-09T02:34:50.603 INFO:tasks.workunit.client.0.smithi088.stdout:5/335: fdatasync d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/f5a 0 2023-12-09T02:34:50.606 INFO:tasks.workunit.client.0.smithi088.stdout:6/374: dwrite d16/f39 [0,4194304] 0 2023-12-09T02:34:50.606 INFO:tasks.workunit.client.0.smithi088.stdout:3/313: dwrite d1/d58/f61 [4194304,4194304] 0 2023-12-09T02:34:50.607 INFO:tasks.workunit.client.0.smithi088.stdout:6/375: dread fb [0,4194304] 0 2023-12-09T02:34:50.610 INFO:tasks.workunit.client.0.smithi088.stdout:7/391: creat dc/d1b/d32/d5d/f90 x:0 0 0 2023-12-09T02:34:50.616 INFO:tasks.workunit.client.0.smithi088.stdout:5/336: mknod d3/d15/de/d10/d18/d19/d20/c71 0 2023-12-09T02:34:50.620 INFO:tasks.workunit.client.0.smithi088.stdout:6/376: mknod d16/d35/d36/c72 0 2023-12-09T02:34:50.622 INFO:tasks.workunit.client.0.smithi088.stdout:7/392: mkdir dc/d1b/d91 0 2023-12-09T02:34:50.623 INFO:tasks.workunit.client.0.smithi088.stdout:7/393: write dc/d1b/d32/f48 [804779,93272] 0 2023-12-09T02:34:50.623 INFO:tasks.workunit.client.0.smithi088.stdout:6/377: creat d16/d35/d65/f73 x:0 0 0 2023-12-09T02:34:50.626 INFO:tasks.workunit.client.0.smithi088.stdout:6/378: creat d16/d1b/d2c/d60/f74 x:0 0 0 2023-12-09T02:34:50.626 INFO:tasks.workunit.client.0.smithi088.stdout:6/379: dread - d16/d35/d65/f69 zero size 2023-12-09T02:34:50.628 INFO:tasks.workunit.client.0.smithi088.stdout:6/380: readlink d16/d1b/d25/l2e 0 2023-12-09T02:34:50.630 INFO:tasks.workunit.client.0.smithi088.stdout:1/430: dwrite d8/d1b/f41 [0,4194304] 0 2023-12-09T02:34:50.634 INFO:tasks.workunit.client.0.smithi088.stdout:1/431: getdents d8/d1b/d1d 0 2023-12-09T02:34:50.635 INFO:tasks.workunit.client.0.smithi088.stdout:8/373: dwrite d2/d9/f3c [0,4194304] 0 2023-12-09T02:34:50.635 INFO:tasks.workunit.client.0.smithi088.stdout:3/314: dwrite d1/d2/d6/d4a/d41/d33/d49/f54 [0,4194304] 0 2023-12-09T02:34:50.636 INFO:tasks.workunit.client.0.smithi088.stdout:3/315: dread d1/d2/d24/d45/f18 [0,4194304] 0 2023-12-09T02:34:50.637 INFO:tasks.workunit.client.0.smithi088.stdout:1/432: creat d8/d27/d66/d79/f9b x:0 0 0 2023-12-09T02:34:50.637 INFO:tasks.workunit.client.0.smithi088.stdout:5/337: dwrite d3/d15/f5b [0,4194304] 0 2023-12-09T02:34:50.641 INFO:tasks.workunit.client.0.smithi088.stdout:5/338: dread d3/d15/d2e/d49/f4f [0,4194304] 0 2023-12-09T02:34:50.642 INFO:tasks.workunit.client.0.smithi088.stdout:8/374: link d2/f54 d2/d9/f8b 0 2023-12-09T02:34:50.642 INFO:tasks.workunit.client.0.smithi088.stdout:8/375: write d2/d9/d13/d15/f26 [134243,22685] 0 2023-12-09T02:34:50.643 INFO:tasks.workunit.client.0.smithi088.stdout:4/362: sync 2023-12-09T02:34:50.643 INFO:tasks.workunit.client.0.smithi088.stdout:5/339: write d3/d15/de/d10/d18/f4a [72402,41628] 0 2023-12-09T02:34:50.644 INFO:tasks.workunit.client.0.smithi088.stdout:8/376: dread d2/d9/d1a/f25 [0,4194304] 0 2023-12-09T02:34:50.644 INFO:tasks.workunit.client.0.smithi088.stdout:8/377: chown d2/f41 4 1 2023-12-09T02:34:50.646 INFO:tasks.workunit.client.0.smithi088.stdout:3/316: truncate d1/d2/d6/d4a/f38 2721271 0 2023-12-09T02:34:50.648 INFO:tasks.workunit.client.0.smithi088.stdout:4/363: creat d3/dc/d1d/d3c/f7a x:0 0 0 2023-12-09T02:34:50.649 INFO:tasks.workunit.client.0.smithi088.stdout:5/340: mknod d3/d15/de/d10/d18/d19/d1b/d35/d61/c72 0 2023-12-09T02:34:50.650 INFO:tasks.workunit.client.0.smithi088.stdout:8/378: rename d2/fa to d2/d9/d1a/d62/d76/d85/f8c 0 2023-12-09T02:34:50.651 INFO:tasks.workunit.client.0.smithi088.stdout:5/341: mkdir d3/d15/de/d73 0 2023-12-09T02:34:50.652 INFO:tasks.workunit.client.0.smithi088.stdout:5/342: readlink d3/d15/l1e 0 2023-12-09T02:34:50.653 INFO:tasks.workunit.client.0.smithi088.stdout:3/317: rename d1/d2/d22/d43 to d1/d2/d2d/d66 0 2023-12-09T02:34:50.653 INFO:tasks.workunit.client.0.smithi088.stdout:4/364: write d3/dc/f11 [3920947,22042] 0 2023-12-09T02:34:50.653 INFO:tasks.workunit.client.0.smithi088.stdout:5/343: dread d3/d15/de/d2c/f44 [0,4194304] 0 2023-12-09T02:34:50.654 INFO:tasks.workunit.client.0.smithi088.stdout:8/379: unlink f0 0 2023-12-09T02:34:50.655 INFO:tasks.workunit.client.0.smithi088.stdout:3/318: creat d1/d2/d15/f67 x:0 0 0 2023-12-09T02:34:50.656 INFO:tasks.workunit.client.0.smithi088.stdout:9/306: sync 2023-12-09T02:34:50.657 INFO:tasks.workunit.client.0.smithi088.stdout:4/365: rename d3/d65/d73 to d3/dc/d18/d7b 0 2023-12-09T02:34:50.657 INFO:tasks.workunit.client.0.smithi088.stdout:4/366: readlink d3/d1f/l26 0 2023-12-09T02:34:50.657 INFO:tasks.workunit.client.0.smithi088.stdout:4/367: read - d3/f76 zero size 2023-12-09T02:34:50.658 INFO:tasks.workunit.client.0.smithi088.stdout:5/344: mknod d3/d15/de/d10/d18/d19/c74 0 2023-12-09T02:34:50.658 INFO:tasks.workunit.client.0.smithi088.stdout:5/345: fdatasync d3/d15/de/f17 0 2023-12-09T02:34:50.658 INFO:tasks.workunit.client.0.smithi088.stdout:5/346: dread - d3/d15/de/d10/d18/d19/d1b/d35/d42/f5e zero size 2023-12-09T02:34:50.658 INFO:tasks.workunit.client.0.smithi088.stdout:5/347: readlink d3/d15/de/d10/l4d 0 2023-12-09T02:34:50.658 INFO:tasks.workunit.client.0.smithi088.stdout:4/368: write d3/f16 [1318711,129537] 0 2023-12-09T02:34:50.658 INFO:tasks.workunit.client.0.smithi088.stdout:4/369: write d3/d1f/f25 [3738547,80301] 0 2023-12-09T02:34:50.659 INFO:tasks.workunit.client.0.smithi088.stdout:8/380: mknod d2/d9/d13/d1c/d5f/c8d 0 2023-12-09T02:34:50.660 INFO:tasks.workunit.client.0.smithi088.stdout:9/307: unlink df/d20/d30/d60/d5c/c69 0 2023-12-09T02:34:50.660 INFO:tasks.workunit.client.0.smithi088.stdout:9/308: fdatasync df/f2c 0 2023-12-09T02:34:50.662 INFO:tasks.workunit.client.0.smithi088.stdout:7/394: dwrite dc/f15 [4194304,4194304] 0 2023-12-09T02:34:50.662 INFO:tasks.workunit.client.0.smithi088.stdout:4/370: write f1 [3251886,2100] 0 2023-12-09T02:34:50.662 INFO:tasks.workunit.client.0.smithi088.stdout:3/319: rename d1/d2/d22/f39 to d1/d58/f68 0 2023-12-09T02:34:50.662 INFO:tasks.workunit.client.0.smithi088.stdout:3/320: truncate d1/d2/f51 954806 0 2023-12-09T02:34:50.664 INFO:tasks.workunit.client.0.smithi088.stdout:6/381: dwrite d16/f1c [0,4194304] 0 2023-12-09T02:34:50.666 INFO:tasks.workunit.client.0.smithi088.stdout:1/433: dwrite d8/d1b/d6d/d7c/f90 [0,4194304] 0 2023-12-09T02:34:50.666 INFO:tasks.workunit.client.0.smithi088.stdout:1/434: dread - d8/d27/f5e zero size 2023-12-09T02:34:50.668 INFO:tasks.workunit.client.0.smithi088.stdout:9/309: dread df/f1c [0,4194304] 0 2023-12-09T02:34:50.668 INFO:tasks.workunit.client.0.smithi088.stdout:9/310: read df/d20/d30/d3f/d48/f5e [5025215,109610] 0 2023-12-09T02:34:50.668 INFO:tasks.workunit.client.0.smithi088.stdout:1/435: dread d8/d27/d40/f77 [0,4194304] 0 2023-12-09T02:34:50.669 INFO:tasks.workunit.client.0.smithi088.stdout:8/381: truncate d2/d9/d1a/d62/f4c 126568 0 2023-12-09T02:34:50.670 INFO:tasks.workunit.client.0.smithi088.stdout:7/395: creat dc/d1b/d32/d3e/f92 x:0 0 0 2023-12-09T02:34:50.672 INFO:tasks.workunit.client.0.smithi088.stdout:3/321: link d1/d2/d24/f4d d1/d2/d6/f69 0 2023-12-09T02:34:50.672 INFO:tasks.workunit.client.0.smithi088.stdout:3/322: fsync d1/d2/d15/f2c 0 2023-12-09T02:34:50.673 INFO:tasks.workunit.client.0.smithi088.stdout:3/323: write d1/d2/d6/d4a/d41/d33/d49/f52 [3210708,29815] 0 2023-12-09T02:34:50.676 INFO:tasks.workunit.client.0.smithi088.stdout:7/396: dread dc/d1b/d32/d38/d1e/f23 [0,4194304] 0 2023-12-09T02:34:50.676 INFO:tasks.workunit.client.0.smithi088.stdout:7/397: dread - dc/d1b/d32/d3e/f92 zero size 2023-12-09T02:34:50.677 INFO:tasks.workunit.client.0.smithi088.stdout:7/398: write dc/f74 [855500,67207] 0 2023-12-09T02:34:50.679 INFO:tasks.workunit.client.0.smithi088.stdout:3/324: write d1/d58/f61 [1637510,82498] 0 2023-12-09T02:34:50.684 INFO:tasks.workunit.client.0.smithi088.stdout:6/382: mkdir d16/d70/d75 0 2023-12-09T02:34:50.686 INFO:tasks.workunit.client.0.smithi088.stdout:5/348: rmdir d3/d15/de/d10 39 2023-12-09T02:34:50.688 INFO:tasks.workunit.client.0.smithi088.stdout:6/383: write d16/d1b/f22 [117826,85950] 0 2023-12-09T02:34:50.689 INFO:tasks.workunit.client.0.smithi088.stdout:1/436: link d8/d3d/d44/d49/c63 d8/d27/d9a/c9c 0 2023-12-09T02:34:50.689 INFO:tasks.workunit.client.0.smithi088.stdout:1/437: write d8/d3d/d5d/d95/f5b [397133,82646] 0 2023-12-09T02:34:50.691 INFO:tasks.workunit.client.0.smithi088.stdout:8/382: link d2/d2b/c43 d2/c8e 0 2023-12-09T02:34:50.691 INFO:tasks.workunit.client.0.smithi088.stdout:8/383: write d2/d9/d1a/d62/f55 [202080,66291] 0 2023-12-09T02:34:50.691 INFO:tasks.workunit.client.0.smithi088.stdout:8/384: stat d2/d9/d13/d1c/d5f/d84 0 2023-12-09T02:34:50.692 INFO:tasks.workunit.client.0.smithi088.stdout:3/325: symlink d1/d58/l6a 0 2023-12-09T02:34:50.693 INFO:tasks.workunit.client.0.smithi088.stdout:3/326: write d1/d2/d24/d45/f18 [454174,116933] 0 2023-12-09T02:34:50.693 INFO:tasks.workunit.client.0.smithi088.stdout:3/327: readlink d1/d2/d6/d4a/d41/d33/d49/l5f 0 2023-12-09T02:34:50.694 INFO:tasks.workunit.client.0.smithi088.stdout:6/384: creat d16/d35/f76 x:0 0 0 2023-12-09T02:34:50.694 INFO:tasks.workunit.client.0.smithi088.stdout:1/438: mknod d8/d1b/d6d/c9d 0 2023-12-09T02:34:50.697 INFO:tasks.workunit.client.0.smithi088.stdout:8/385: unlink d2/d9/d13/f88 0 2023-12-09T02:34:50.698 INFO:tasks.workunit.client.0.smithi088.stdout:8/386: dread - d2/d9/d1a/d62/f7f zero size 2023-12-09T02:34:50.698 INFO:tasks.workunit.client.0.smithi088.stdout:9/311: dwrite df/d20/d4c/f56 [0,4194304] 0 2023-12-09T02:34:50.698 INFO:tasks.workunit.client.0.smithi088.stdout:9/312: readlink df/d20/d30/d52/l67 0 2023-12-09T02:34:50.698 INFO:tasks.workunit.client.0.smithi088.stdout:6/385: symlink d16/d62/l77 0 2023-12-09T02:34:50.698 INFO:tasks.workunit.client.0.smithi088.stdout:1/439: mknod d8/d1b/d1d/c9e 0 2023-12-09T02:34:50.701 INFO:tasks.workunit.client.0.smithi088.stdout:1/440: mknod d8/d27/d40/c9f 0 2023-12-09T02:34:50.711 INFO:tasks.workunit.client.0.smithi088.stdout:7/399: dwrite dc/d1b/d32/d38/f49 [4194304,4194304] 0 2023-12-09T02:34:50.712 INFO:tasks.workunit.client.0.smithi088.stdout:8/387: write d2/d9/d13/d1c/d74/f77 [396716,105264] 0 2023-12-09T02:34:50.713 INFO:tasks.workunit.client.0.smithi088.stdout:7/400: mkdir dc/d21/d6b/d93 0 2023-12-09T02:34:50.714 INFO:tasks.workunit.client.0.smithi088.stdout:7/401: chown dc/f47 0 1 2023-12-09T02:34:50.714 INFO:tasks.workunit.client.0.smithi088.stdout:5/349: dwrite d3/d8/f56 [0,4194304] 0 2023-12-09T02:34:50.715 INFO:tasks.workunit.client.0.smithi088.stdout:8/388: mkdir d2/d9/d70/d8f 0 2023-12-09T02:34:50.720 INFO:tasks.workunit.client.0.smithi088.stdout:7/402: rename dc/d1b/d32/d5d/f90 to dc/d1b/d89/f94 0 2023-12-09T02:34:50.720 INFO:tasks.workunit.client.0.smithi088.stdout:5/350: symlink d3/d15/dc/l75 0 2023-12-09T02:34:50.720 INFO:tasks.workunit.client.0.smithi088.stdout:2/364: sync 2023-12-09T02:34:50.720 INFO:tasks.workunit.client.0.smithi088.stdout:0/333: sync 2023-12-09T02:34:50.720 INFO:tasks.workunit.client.0.smithi088.stdout:0/334: write df/f57 [1283038,123861] 0 2023-12-09T02:34:50.721 INFO:tasks.workunit.client.0.smithi088.stdout:8/389: unlink d2/d9/l44 0 2023-12-09T02:34:50.723 INFO:tasks.workunit.client.0.smithi088.stdout:2/365: unlink d6/d8/d1f/d22/f2c 0 2023-12-09T02:34:50.724 INFO:tasks.workunit.client.0.smithi088.stdout:0/335: stat df/d37/l64 0 2023-12-09T02:34:50.724 INFO:tasks.workunit.client.0.smithi088.stdout:0/336: write df/d28/d43/f4f [964154,107050] 0 2023-12-09T02:34:50.726 INFO:tasks.workunit.client.0.smithi088.stdout:8/390: unlink d2/d9/d13/d1c/d3b/l4a 0 2023-12-09T02:34:50.729 INFO:tasks.workunit.client.0.smithi088.stdout:2/366: mkdir d6/d20/d3a/d82 0 2023-12-09T02:34:50.730 INFO:tasks.workunit.client.0.smithi088.stdout:2/367: creat d6/d20/d3d/f83 x:0 0 0 2023-12-09T02:34:50.733 INFO:tasks.workunit.client.0.smithi088.stdout:2/368: mkdir d6/d20/d3a/d84 0 2023-12-09T02:34:50.733 INFO:tasks.workunit.client.0.smithi088.stdout:2/369: read - d6/f12 zero size 2023-12-09T02:34:50.737 INFO:tasks.workunit.client.0.smithi088.stdout:2/370: unlink f3 0 2023-12-09T02:34:50.737 INFO:tasks.workunit.client.0.smithi088.stdout:2/371: chown d6/d8/d1f/d22/d68 60211 1 2023-12-09T02:34:50.737 INFO:tasks.workunit.client.0.smithi088.stdout:6/386: getdents d16/d62 0 2023-12-09T02:34:50.740 INFO:tasks.workunit.client.0.smithi088.stdout:8/391: dread f1 [0,4194304] 0 2023-12-09T02:34:50.740 INFO:tasks.workunit.client.0.smithi088.stdout:0/337: dread df/d10/f24 [0,4194304] 0 2023-12-09T02:34:50.742 INFO:tasks.workunit.client.0.smithi088.stdout:8/392: creat d2/d9/d13/d1c/d5f/f90 x:0 0 0 2023-12-09T02:34:50.742 INFO:tasks.workunit.client.0.smithi088.stdout:8/393: stat d2/d9/d1a/d62/f4f 0 2023-12-09T02:34:50.743 INFO:tasks.workunit.client.0.smithi088.stdout:0/338: getdents df/d10/d22/d2d 0 2023-12-09T02:34:50.744 INFO:tasks.workunit.client.0.smithi088.stdout:8/394: mknod d2/d9/c91 0 2023-12-09T02:34:50.744 INFO:tasks.workunit.client.0.smithi088.stdout:0/339: truncate df/d10/d22/f27 843943 0 2023-12-09T02:34:50.745 INFO:tasks.workunit.client.0.smithi088.stdout:8/395: mknod d2/d9/d13/c92 0 2023-12-09T02:34:50.745 INFO:tasks.workunit.client.0.smithi088.stdout:8/396: chown d2/c5 4357 1 2023-12-09T02:34:50.746 INFO:tasks.workunit.client.0.smithi088.stdout:8/397: chown d2/d9/f8b 99510 1 2023-12-09T02:34:50.746 INFO:tasks.workunit.client.0.smithi088.stdout:8/398: write d2/d9/d1a/d62/f7f [127965,13809] 0 2023-12-09T02:34:50.746 INFO:tasks.workunit.client.0.smithi088.stdout:0/340: mkdir df/d10/d22/d2d/d6a 0 2023-12-09T02:34:50.747 INFO:tasks.workunit.client.0.smithi088.stdout:8/399: dread d2/d9/d1a/d62/f4f [0,4194304] 0 2023-12-09T02:34:50.747 INFO:tasks.workunit.client.0.smithi088.stdout:8/400: dread - d2/f54 zero size 2023-12-09T02:34:50.747 INFO:tasks.workunit.client.0.smithi088.stdout:3/328: dwrite d1/fa [0,4194304] 0 2023-12-09T02:34:50.747 INFO:tasks.workunit.client.0.smithi088.stdout:0/341: write f4 [6666,130835] 0 2023-12-09T02:34:50.750 INFO:tasks.workunit.client.0.smithi088.stdout:1/441: dwrite d8/d27/d40/f68 [0,4194304] 0 2023-12-09T02:34:50.750 INFO:tasks.workunit.client.0.smithi088.stdout:5/351: dwrite d3/d15/de/d10/d18/d19/d1b/f32 [0,4194304] 0 2023-12-09T02:34:50.750 INFO:tasks.workunit.client.0.smithi088.stdout:5/352: chown d3/d15/de/d10/d18/d19/d1b/d35/d61 15 1 2023-12-09T02:34:50.750 INFO:tasks.workunit.client.0.smithi088.stdout:7/403: dwrite dc/d1b/d32/d3e/f7d [0,4194304] 0 2023-12-09T02:34:50.750 INFO:tasks.workunit.client.0.smithi088.stdout:3/329: creat d1/d2/d2d/f6b x:0 0 0 2023-12-09T02:34:50.751 INFO:tasks.workunit.client.0.smithi088.stdout:0/342: mknod df/d10/d22/d2d/d2e/c6b 0 2023-12-09T02:34:50.752 INFO:tasks.workunit.client.0.smithi088.stdout:9/313: dwrite df/d20/d30/d60/d5c/f1f [0,4194304] 0 2023-12-09T02:34:50.754 INFO:tasks.workunit.client.0.smithi088.stdout:7/404: dread dc/f74 [0,4194304] 0 2023-12-09T02:34:50.754 INFO:tasks.workunit.client.0.smithi088.stdout:8/401: dread d2/d9/d1a/d62/d76/d85/f8c [0,4194304] 0 2023-12-09T02:34:50.756 INFO:tasks.workunit.client.0.smithi088.stdout:5/353: creat d3/d15/d2e/f76 x:0 0 0 2023-12-09T02:34:50.757 INFO:tasks.workunit.client.0.smithi088.stdout:8/402: read d2/f3 [1651633,80627] 0 2023-12-09T02:34:50.759 INFO:tasks.workunit.client.0.smithi088.stdout:6/387: dwrite d16/d1b/d25/f3b [0,4194304] 0 2023-12-09T02:34:50.759 INFO:tasks.workunit.client.0.smithi088.stdout:8/403: write d2/d9/d1a/f1f [214538,58701] 0 2023-12-09T02:34:50.759 INFO:tasks.workunit.client.0.smithi088.stdout:8/404: chown d2/d9/d13/d1c/f89 2255362 1 2023-12-09T02:34:50.759 INFO:tasks.workunit.client.0.smithi088.stdout:8/405: readlink d2/d2b/l50 0 2023-12-09T02:34:50.765 INFO:tasks.workunit.client.0.smithi088.stdout:0/343: creat df/d28/f6c x:0 0 0 2023-12-09T02:34:50.772 INFO:tasks.workunit.client.0.smithi088.stdout:3/330: dwrite d1/d2/d2d/f6b [0,4194304] 0 2023-12-09T02:34:50.774 INFO:tasks.workunit.client.0.smithi088.stdout:9/314: creat df/d20/d4c/f75 x:0 0 0 2023-12-09T02:34:50.776 INFO:tasks.workunit.client.0.smithi088.stdout:7/405: mknod dc/d1b/d32/d3e/c95 0 2023-12-09T02:34:50.776 INFO:tasks.workunit.client.0.smithi088.stdout:7/406: getdents dc/d21/d6b/d6d/d76 0 2023-12-09T02:34:50.776 INFO:tasks.workunit.client.0.smithi088.stdout:6/388: getdents d16/d1b/d2c/d3f 0 2023-12-09T02:34:50.778 INFO:tasks.workunit.client.0.smithi088.stdout:7/407: dread dc/f74 [0,4194304] 0 2023-12-09T02:34:50.778 INFO:tasks.workunit.client.0.smithi088.stdout:7/408: readlink dc/d1b/d32/d3e/l64 0 2023-12-09T02:34:50.778 INFO:tasks.workunit.client.0.smithi088.stdout:7/409: dread - dc/d1b/d66/f6f zero size 2023-12-09T02:34:50.778 INFO:tasks.workunit.client.0.smithi088.stdout:8/406: stat d2/d9/d1a/d62/l5b 0 2023-12-09T02:34:50.778 INFO:tasks.workunit.client.0.smithi088.stdout:8/407: truncate d2/d9/d13/d1c/f20 736880 0 2023-12-09T02:34:50.778 INFO:tasks.workunit.client.0.smithi088.stdout:8/408: truncate d2/d9/d1a/f57 1016910 0 2023-12-09T02:34:50.778 INFO:tasks.workunit.client.0.smithi088.stdout:8/409: write d2/d9/d13/d1c/d74/f86 [309552,8939] 0 2023-12-09T02:34:50.779 INFO:tasks.workunit.client.0.smithi088.stdout:8/410: dread d2/f11 [0,4194304] 0 2023-12-09T02:34:50.780 INFO:tasks.workunit.client.0.smithi088.stdout:3/331: creat d1/f6c x:0 0 0 2023-12-09T02:34:50.781 INFO:tasks.workunit.client.0.smithi088.stdout:9/315: mknod df/d50/c76 0 2023-12-09T02:34:50.783 INFO:tasks.workunit.client.0.smithi088.stdout:3/332: creat d1/d2/d22/f6d x:0 0 0 2023-12-09T02:34:50.786 INFO:tasks.workunit.client.0.smithi088.stdout:9/316: symlink df/d20/d5b/l77 0 2023-12-09T02:34:50.786 INFO:tasks.workunit.client.0.smithi088.stdout:6/389: dread d16/d1b/f1e [0,4194304] 0 2023-12-09T02:34:50.786 INFO:tasks.workunit.client.0.smithi088.stdout:9/317: write df/d20/d30/d3f/d48/f6e [309573,71883] 0 2023-12-09T02:34:50.787 INFO:tasks.workunit.client.0.smithi088.stdout:5/354: dwrite d3/d15/de/d10/d18/d19/d1b/d35/d42/f21 [0,4194304] 0 2023-12-09T02:34:50.787 INFO:tasks.workunit.client.0.smithi088.stdout:3/333: link d1/d2/d24/f4d d1/d2/d2d/d66/f6e 0 2023-12-09T02:34:50.788 INFO:tasks.workunit.client.0.smithi088.stdout:0/344: dwrite df/f2c [8388608,4194304] 0 2023-12-09T02:34:50.791 INFO:tasks.workunit.client.0.smithi088.stdout:6/390: rename d16/c5c to d16/d35/d36/c78 0 2023-12-09T02:34:50.791 INFO:tasks.workunit.client.0.smithi088.stdout:6/391: readlink d16/d35/d36/l58 0 2023-12-09T02:34:50.792 INFO:tasks.workunit.client.0.smithi088.stdout:9/318: mknod df/d29/d2f/c78 0 2023-12-09T02:34:50.792 INFO:tasks.workunit.client.0.smithi088.stdout:9/319: chown df/d20/d30/d3f/d48 744442 1 2023-12-09T02:34:50.792 INFO:tasks.workunit.client.0.smithi088.stdout:9/320: write df/d20/d30/d4e/d55/f61 [319667,110642] 0 2023-12-09T02:34:50.792 INFO:tasks.workunit.client.0.smithi088.stdout:9/321: fdatasync df/d29/f6a 0 2023-12-09T02:34:50.793 INFO:tasks.workunit.client.0.smithi088.stdout:5/355: link d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/f5f d3/d15/d2e/f77 0 2023-12-09T02:34:50.795 INFO:tasks.workunit.client.0.smithi088.stdout:0/345: mknod df/d10/d22/d2d/c6d 0 2023-12-09T02:34:50.795 INFO:tasks.workunit.client.0.smithi088.stdout:0/346: write df/d10/d22/d2d/f4b [5203712,102277] 0 2023-12-09T02:34:50.797 INFO:tasks.workunit.client.0.smithi088.stdout:6/392: rename d16/d35/d36/c55 to d16/d70/d75/c79 0 2023-12-09T02:34:50.797 INFO:tasks.workunit.client.0.smithi088.stdout:6/393: write d16/d1b/d2c/d60/f74 [643304,85747] 0 2023-12-09T02:34:50.797 INFO:tasks.workunit.client.0.smithi088.stdout:6/394: write d16/d1b/f1d [5246152,49192] 0 2023-12-09T02:34:50.798 INFO:tasks.workunit.client.0.smithi088.stdout:9/322: rmdir df/d20/d30/d3f/d48 39 2023-12-09T02:34:50.798 INFO:tasks.workunit.client.0.smithi088.stdout:9/323: chown df/d20/f5f 1403059 1 2023-12-09T02:34:50.798 INFO:tasks.workunit.client.0.smithi088.stdout:9/324: read df/d20/d30/d4e/d55/f61 [62749,9772] 0 2023-12-09T02:34:50.800 INFO:tasks.workunit.client.0.smithi088.stdout:7/410: dwrite dc/d1b/d32/d3e/f7b [0,4194304] 0 2023-12-09T02:34:50.801 INFO:tasks.workunit.client.0.smithi088.stdout:5/356: creat d3/d15/de/d10/f78 x:0 0 0 2023-12-09T02:34:50.801 INFO:tasks.workunit.client.0.smithi088.stdout:8/411: dwrite d2/d9/d1a/f25 [0,4194304] 0 2023-12-09T02:34:50.801 INFO:tasks.workunit.client.0.smithi088.stdout:5/357: dread - d3/d15/d2e/f76 zero size 2023-12-09T02:34:50.802 INFO:tasks.workunit.client.0.smithi088.stdout:5/358: write d3/f3d [2376931,72443] 0 2023-12-09T02:34:50.802 INFO:tasks.workunit.client.0.smithi088.stdout:5/359: write d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/f5a [598124,79205] 0 2023-12-09T02:34:50.803 INFO:tasks.workunit.client.0.smithi088.stdout:0/347: creat df/d10/d22/f6e x:0 0 0 2023-12-09T02:34:50.805 INFO:tasks.workunit.client.0.smithi088.stdout:6/395: mknod d16/d70/c7a 0 2023-12-09T02:34:50.805 INFO:tasks.workunit.client.0.smithi088.stdout:6/396: fdatasync d16/d1b/d2c/d3f/d41/f43 0 2023-12-09T02:34:50.805 INFO:tasks.workunit.client.0.smithi088.stdout:6/397: chown d16/d62 5 1 2023-12-09T02:34:50.805 INFO:tasks.workunit.client.0.smithi088.stdout:4/371: sync 2023-12-09T02:34:50.806 INFO:tasks.workunit.client.0.smithi088.stdout:9/325: creat df/d20/d30/d52/f79 x:0 0 0 2023-12-09T02:34:50.818 INFO:tasks.workunit.client.0.smithi088.stdout:0/348: rename df/d10/d22/d2d/f52 to df/d10/d22/f6f 0 2023-12-09T02:34:50.818 INFO:tasks.workunit.client.0.smithi088.stdout:0/349: truncate f2 949927 0 2023-12-09T02:34:50.825 INFO:tasks.workunit.client.0.smithi088.stdout:9/326: getdents df/d50 0 2023-12-09T02:34:50.825 INFO:tasks.workunit.client.0.smithi088.stdout:9/327: write df/d20/f3e [204718,45909] 0 2023-12-09T02:34:50.825 INFO:tasks.workunit.client.0.smithi088.stdout:0/350: mkdir df/d37/d70 0 2023-12-09T02:34:50.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/351: unlink ca 0 2023-12-09T02:34:50.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/352: write df/d28/d33/f5a [4207606,104650] 0 2023-12-09T02:34:50.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/353: chown df/l19 476746 1 2023-12-09T02:34:50.831 INFO:tasks.workunit.client.0.smithi088.stdout:0/354: unlink df/l45 0 2023-12-09T02:34:50.831 INFO:tasks.workunit.client.0.smithi088.stdout:6/398: dread d16/d1b/d25/f27 [0,4194304] 0 2023-12-09T02:34:50.831 INFO:tasks.workunit.client.0.smithi088.stdout:7/411: dwrite dc/d1b/d82/f84 [0,4194304] 0 2023-12-09T02:34:50.832 INFO:tasks.workunit.client.0.smithi088.stdout:6/399: rename d16/d35/d36/c72 to d16/d70/d75/c7b 0 2023-12-09T02:34:50.833 INFO:tasks.workunit.client.0.smithi088.stdout:0/355: creat df/d10/d22/d5b/f71 x:0 0 0 2023-12-09T02:34:50.833 INFO:tasks.workunit.client.0.smithi088.stdout:0/356: readlink df/d10/d22/l23 0 2023-12-09T02:34:50.838 INFO:tasks.workunit.client.0.smithi088.stdout:9/328: dread df/d20/d30/d60/d5c/f47 [0,4194304] 0 2023-12-09T02:34:50.838 INFO:tasks.workunit.client.0.smithi088.stdout:9/329: write df/d20/d30/d60/d5c/f26 [1033124,99418] 0 2023-12-09T02:34:50.840 INFO:tasks.workunit.client.0.smithi088.stdout:4/372: dwrite d3/dc/d1d/d3c/f4b [0,4194304] 0 2023-12-09T02:34:50.841 INFO:tasks.workunit.client.0.smithi088.stdout:5/360: dwrite d3/f24 [4194304,4194304] 0 2023-12-09T02:34:50.844 INFO:tasks.workunit.client.0.smithi088.stdout:7/412: dread fb [0,4194304] 0 2023-12-09T02:34:50.844 INFO:tasks.workunit.client.0.smithi088.stdout:7/413: write dc/d1b/d32/d38/f44 [763818,55419] 0 2023-12-09T02:34:50.845 INFO:tasks.workunit.client.0.smithi088.stdout:4/373: unlink d3/dc/d43/c72 0 2023-12-09T02:34:50.846 INFO:tasks.workunit.client.0.smithi088.stdout:9/330: dread df/f2c [0,4194304] 0 2023-12-09T02:34:50.847 INFO:tasks.workunit.client.0.smithi088.stdout:5/361: rename d3/d15/de/d10/l4d to d3/d15/de/d10/d51/d70/l79 0 2023-12-09T02:34:50.848 INFO:tasks.workunit.client.0.smithi088.stdout:7/414: symlink dc/d21/d6b/d6d/d76/l96 0 2023-12-09T02:34:50.849 INFO:tasks.workunit.client.0.smithi088.stdout:4/374: mknod d3/dc/d1d/d3c/c7c 0 2023-12-09T02:34:50.850 INFO:tasks.workunit.client.0.smithi088.stdout:5/362: symlink d3/d15/de/d10/d51/l7a 0 2023-12-09T02:34:50.853 INFO:tasks.workunit.client.0.smithi088.stdout:4/375: truncate d3/d1f/f2b 2475138 0 2023-12-09T02:34:50.853 INFO:tasks.workunit.client.0.smithi088.stdout:4/376: write d3/f4c [431586,72708] 0 2023-12-09T02:34:50.854 INFO:tasks.workunit.client.0.smithi088.stdout:5/363: creat d3/d15/de/f7b x:0 0 0 2023-12-09T02:34:50.855 INFO:tasks.workunit.client.0.smithi088.stdout:4/377: mkdir d3/dc/d7d 0 2023-12-09T02:34:50.856 INFO:tasks.workunit.client.0.smithi088.stdout:5/364: mknod d3/d15/de/d10/d18/d19/c7c 0 2023-12-09T02:34:50.857 INFO:tasks.workunit.client.0.smithi088.stdout:4/378: symlink d3/l7e 0 2023-12-09T02:34:50.858 INFO:tasks.workunit.client.0.smithi088.stdout:5/365: link d3/d15/de/d10/d18/d19/d1b/d35/d61/c72 d3/d15/de/d10/d18/d19/d1b/d35/d42/c7d 0 2023-12-09T02:34:50.860 INFO:tasks.workunit.client.0.smithi088.stdout:4/379: rmdir d3/d65 39 2023-12-09T02:34:50.862 INFO:tasks.workunit.client.0.smithi088.stdout:5/366: creat d3/d15/de/d10/d18/d19/d1b/f7e x:0 0 0 2023-12-09T02:34:50.863 INFO:tasks.workunit.client.0.smithi088.stdout:5/367: mkdir d3/d15/de/d10/d51/d7f 0 2023-12-09T02:34:50.864 INFO:tasks.workunit.client.0.smithi088.stdout:6/400: dwrite d16/d1b/d2c/d3f/d41/f4b [0,4194304] 0 2023-12-09T02:34:50.866 INFO:tasks.workunit.client.0.smithi088.stdout:6/401: mknod d16/d35/d36/c7c 0 2023-12-09T02:34:50.866 INFO:tasks.workunit.client.0.smithi088.stdout:6/402: chown d16/d35/d36/f6b 5794 1 2023-12-09T02:34:50.866 INFO:tasks.workunit.client.0.smithi088.stdout:6/403: chown d16/d35/d36/l44 1 1 2023-12-09T02:34:50.866 INFO:tasks.workunit.client.0.smithi088.stdout:6/404: truncate d16/d35/f6a 140264 0 2023-12-09T02:34:50.867 INFO:tasks.workunit.client.0.smithi088.stdout:0/357: dwrite df/f67 [0,4194304] 0 2023-12-09T02:34:50.868 INFO:tasks.workunit.client.0.smithi088.stdout:5/368: fsync d3/f3d 0 2023-12-09T02:34:50.868 INFO:tasks.workunit.client.0.smithi088.stdout:5/369: dread - d3/d15/de/d10/d18/d19/d1b/d35/d42/f5e zero size 2023-12-09T02:34:50.868 INFO:tasks.workunit.client.0.smithi088.stdout:7/415: dwrite dc/d1b/d32/d38/f51 [0,4194304] 0 2023-12-09T02:34:50.871 INFO:tasks.workunit.client.0.smithi088.stdout:0/358: symlink df/d10/d22/l72 0 2023-12-09T02:34:50.872 INFO:tasks.workunit.client.0.smithi088.stdout:7/416: mkdir dc/d1b/d32/d3e/d97 0 2023-12-09T02:34:50.873 INFO:tasks.workunit.client.0.smithi088.stdout:7/417: chown dc/c67 2857919 1 2023-12-09T02:34:50.873 INFO:tasks.workunit.client.0.smithi088.stdout:7/418: chown dc/d21/f58 15938 1 2023-12-09T02:34:50.876 INFO:tasks.workunit.client.0.smithi088.stdout:0/359: mknod df/d28/d34/c73 0 2023-12-09T02:34:50.877 INFO:tasks.workunit.client.0.smithi088.stdout:0/360: chown df/d10/d22/d2d/d3c 7624731 1 2023-12-09T02:34:50.878 INFO:tasks.workunit.client.0.smithi088.stdout:7/419: getdents dc/d1b 0 2023-12-09T02:34:50.881 INFO:tasks.workunit.client.0.smithi088.stdout:0/361: link df/d10/d22/d5b/f5d df/d10/d22/f74 0 2023-12-09T02:34:50.881 INFO:tasks.workunit.client.0.smithi088.stdout:0/362: fsync df/f21 0 2023-12-09T02:34:50.881 INFO:tasks.workunit.client.0.smithi088.stdout:0/363: chown df/d10/d22/d2d/d3c/f47 2002 1 2023-12-09T02:34:50.887 INFO:tasks.workunit.client.0.smithi088.stdout:9/331: dwrite df/d20/d30/d60/d5c/f26 [0,4194304] 0 2023-12-09T02:34:50.887 INFO:tasks.workunit.client.0.smithi088.stdout:6/405: dwrite d16/d35/f46 [0,4194304] 0 2023-12-09T02:34:50.889 INFO:tasks.workunit.client.0.smithi088.stdout:9/332: symlink df/d20/d5b/l7a 0 2023-12-09T02:34:50.889 INFO:tasks.workunit.client.0.smithi088.stdout:5/370: dwrite d3/d15/de/d10/f6e [0,4194304] 0 2023-12-09T02:34:50.889 INFO:tasks.workunit.client.0.smithi088.stdout:0/364: dread fc [0,4194304] 0 2023-12-09T02:34:50.890 INFO:tasks.workunit.client.0.smithi088.stdout:4/380: read d3/d65/f6d [2409063,112900] 0 2023-12-09T02:34:50.892 INFO:tasks.workunit.client.0.smithi088.stdout:5/371: creat d3/d15/de/d10/f80 x:0 0 0 2023-12-09T02:34:50.893 INFO:tasks.workunit.client.0.smithi088.stdout:0/365: mknod df/d37/d70/c75 0 2023-12-09T02:34:50.895 INFO:tasks.workunit.client.0.smithi088.stdout:4/381: symlink d3/dc/d18/l7f 0 2023-12-09T02:34:50.898 INFO:tasks.workunit.client.0.smithi088.stdout:4/382: creat d3/d65/f80 x:0 0 0 2023-12-09T02:34:50.900 INFO:tasks.workunit.client.0.smithi088.stdout:0/366: dread fc [0,4194304] 0 2023-12-09T02:34:50.900 INFO:tasks.workunit.client.0.smithi088.stdout:0/367: symlink df/d28/d33/l76 0 2023-12-09T02:34:50.901 INFO:tasks.workunit.client.0.smithi088.stdout:0/368: mkdir df/d28/d43/d77 0 2023-12-09T02:34:50.902 INFO:tasks.workunit.client.0.smithi088.stdout:0/369: rename df/l1c to df/d10/l78 0 2023-12-09T02:34:50.904 INFO:tasks.workunit.client.0.smithi088.stdout:0/370: read f4 [3449892,32977] 0 2023-12-09T02:34:50.905 INFO:tasks.workunit.client.0.smithi088.stdout:9/333: dwrite df/f2c [0,4194304] 0 2023-12-09T02:34:50.905 INFO:tasks.workunit.client.0.smithi088.stdout:9/334: chown df/c21 23 1 2023-12-09T02:34:50.905 INFO:tasks.workunit.client.0.smithi088.stdout:6/406: dwrite d16/d1b/d2c/d3f/d41/f43 [0,4194304] 0 2023-12-09T02:34:50.905 INFO:tasks.workunit.client.0.smithi088.stdout:6/407: chown d16/d35/d36/c5a 246 1 2023-12-09T02:34:50.905 INFO:tasks.workunit.client.0.smithi088.stdout:0/371: truncate df/d10/f24 3506963 0 2023-12-09T02:34:50.907 INFO:tasks.workunit.client.0.smithi088.stdout:0/372: write df/d10/f31 [909282,85665] 0 2023-12-09T02:34:50.909 INFO:tasks.workunit.client.0.smithi088.stdout:9/335: rename df/d20/d5b/l77 to df/d50/l7b 0 2023-12-09T02:34:50.910 INFO:tasks.workunit.client.0.smithi088.stdout:9/336: mkdir df/d20/d4c/d71/d7c 0 2023-12-09T02:34:50.911 INFO:tasks.workunit.client.0.smithi088.stdout:9/337: fsync df/d29/d2f/f3a 0 2023-12-09T02:34:50.911 INFO:tasks.workunit.client.0.smithi088.stdout:9/338: write df/f1a [5071308,41190] 0 2023-12-09T02:34:50.915 INFO:tasks.workunit.client.0.smithi088.stdout:2/372: sync 2023-12-09T02:34:50.915 INFO:tasks.workunit.client.0.smithi088.stdout:1/442: sync 2023-12-09T02:34:50.915 INFO:tasks.workunit.client.0.smithi088.stdout:3/334: sync 2023-12-09T02:34:50.915 INFO:tasks.workunit.client.0.smithi088.stdout:1/443: chown d8/d27/d40/f8e 4 1 2023-12-09T02:34:50.915 INFO:tasks.workunit.client.0.smithi088.stdout:1/444: write f3 [3573347,44243] 0 2023-12-09T02:34:50.917 INFO:tasks.workunit.client.0.smithi088.stdout:1/445: write d8/d1b/f41 [3770786,80449] 0 2023-12-09T02:34:50.918 INFO:tasks.workunit.client.0.smithi088.stdout:9/339: dread df/d20/d30/d60/d5c/f47 [0,4194304] 0 2023-12-09T02:34:50.918 INFO:tasks.workunit.client.0.smithi088.stdout:9/340: chown df/c2b 1 1 2023-12-09T02:34:50.918 INFO:tasks.workunit.client.0.smithi088.stdout:9/341: chown df/d29/f2d 216180 1 2023-12-09T02:34:50.918 INFO:tasks.workunit.client.0.smithi088.stdout:9/342: fdatasync df/d20/d30/d3f/d48/f45 0 2023-12-09T02:34:50.918 INFO:tasks.workunit.client.0.smithi088.stdout:9/343: read - df/d50/d63/f73 zero size 2023-12-09T02:34:50.920 INFO:tasks.workunit.client.0.smithi088.stdout:6/408: dread d16/d1b/f1d [0,4194304] 0 2023-12-09T02:34:50.921 INFO:tasks.workunit.client.0.smithi088.stdout:9/344: creat df/d50/f7d x:0 0 0 2023-12-09T02:34:50.923 INFO:tasks.workunit.client.0.smithi088.stdout:1/446: truncate d8/d3d/f51 2988927 0 2023-12-09T02:34:50.925 INFO:tasks.workunit.client.0.smithi088.stdout:1/447: rename d8/d3d/d5d/d82/c94 to d8/d3d/ca0 0 2023-12-09T02:34:50.928 INFO:tasks.workunit.client.0.smithi088.stdout:1/448: creat d8/d3d/d44/fa1 x:0 0 0 2023-12-09T02:34:50.937 INFO:tasks.workunit.client.0.smithi088.stdout:1/449: read d8/d1b/d6d/d7c/f90 [3108441,47395] 0 2023-12-09T02:34:50.938 INFO:tasks.workunit.client.0.smithi088.stdout:1/450: truncate d8/d1b/f2e 258519 0 2023-12-09T02:34:50.938 INFO:tasks.workunit.client.0.smithi088.stdout:1/451: readlink d8/d1c/l56 0 2023-12-09T02:34:50.939 INFO:tasks.workunit.client.0.smithi088.stdout:1/452: mkdir d8/d1b/d6d/da2 0 2023-12-09T02:34:50.940 INFO:tasks.workunit.client.0.smithi088.stdout:9/345: write fc [4505543,67214] 0 2023-12-09T02:34:50.940 INFO:tasks.workunit.client.0.smithi088.stdout:1/453: rename d8/d27/d40/f68 to d8/d27/d9a/fa3 0 2023-12-09T02:34:50.942 INFO:tasks.workunit.client.0.smithi088.stdout:9/346: creat df/d20/d5b/f7e x:0 0 0 2023-12-09T02:34:50.942 INFO:tasks.workunit.client.0.smithi088.stdout:9/347: chown df/d20/d30/d60/d5c/l6b 1901685 1 2023-12-09T02:34:50.943 INFO:tasks.workunit.client.0.smithi088.stdout:1/454: mkdir d8/d3d/d44/da4 0 2023-12-09T02:34:50.945 INFO:tasks.workunit.client.0.smithi088.stdout:1/455: mkdir d8/d27/d40/da5 0 2023-12-09T02:34:50.945 INFO:tasks.workunit.client.0.smithi088.stdout:1/456: getdents d8/d1b/d6d/da2 0 2023-12-09T02:34:50.945 INFO:tasks.workunit.client.0.smithi088.stdout:1/457: fsync d8/d3d/f88 0 2023-12-09T02:34:50.945 INFO:tasks.workunit.client.0.smithi088.stdout:1/458: readlink d8/d1b/l43 0 2023-12-09T02:34:50.946 INFO:tasks.workunit.client.0.smithi088.stdout:1/459: rmdir d8/d27/d40 39 2023-12-09T02:34:50.946 INFO:tasks.workunit.client.0.smithi088.stdout:1/460: write d8/d1c/f86 [42935,53081] 0 2023-12-09T02:34:50.946 INFO:tasks.workunit.client.0.smithi088.stdout:1/461: read f4 [386029,109846] 0 2023-12-09T02:34:50.947 INFO:tasks.workunit.client.0.smithi088.stdout:1/462: truncate d8/d3d/d5d/d95/f4e 3127404 0 2023-12-09T02:34:50.947 INFO:tasks.workunit.client.0.smithi088.stdout:1/463: write d8/d27/d66/f91 [87389,83527] 0 2023-12-09T02:34:50.948 INFO:tasks.workunit.client.0.smithi088.stdout:6/409: dwrite d16/d1b/d2c/d3f/d41/f43 [0,4194304] 0 2023-12-09T02:34:50.948 INFO:tasks.workunit.client.0.smithi088.stdout:6/410: dread - d16/d1b/d56/f6c zero size 2023-12-09T02:34:50.948 INFO:tasks.workunit.client.0.smithi088.stdout:1/464: mknod d8/d27/d40/da5/ca6 0 2023-12-09T02:34:50.950 INFO:tasks.workunit.client.0.smithi088.stdout:3/335: dwrite d1/d58/f61 [4194304,4194304] 0 2023-12-09T02:34:50.950 INFO:tasks.workunit.client.0.smithi088.stdout:6/411: creat d16/d70/d75/f7d x:0 0 0 2023-12-09T02:34:50.951 INFO:tasks.workunit.client.0.smithi088.stdout:1/465: rmdir d8/d1b 39 2023-12-09T02:34:50.957 INFO:tasks.workunit.client.0.smithi088.stdout:3/336: rename d1/d2 to d1/d9/d6f 0 2023-12-09T02:34:50.957 INFO:tasks.workunit.client.0.smithi088.stdout:3/337: chown d1/d9/d6f/d6 30040 1 2023-12-09T02:34:50.958 INFO:tasks.workunit.client.0.smithi088.stdout:3/338: chown d1/d9/d6f 464013477 1 2023-12-09T02:34:50.958 INFO:tasks.workunit.client.0.smithi088.stdout:1/466: dread d8/d3d/f4f [0,4194304] 0 2023-12-09T02:34:50.958 INFO:tasks.workunit.client.0.smithi088.stdout:1/467: fsync f4 0 2023-12-09T02:34:50.961 INFO:tasks.workunit.client.0.smithi088.stdout:6/412: rename d16/d1b/d2c/c5e to d16/d1b/d71/c7e 0 2023-12-09T02:34:50.961 INFO:tasks.workunit.client.0.smithi088.stdout:6/413: stat d16/d1b/f1e 0 2023-12-09T02:34:50.961 INFO:tasks.workunit.client.0.smithi088.stdout:6/414: fsync d16/d1b/f1e 0 2023-12-09T02:34:50.961 INFO:tasks.workunit.client.0.smithi088.stdout:6/415: truncate d16/d1b/f51 916626 0 2023-12-09T02:34:50.961 INFO:tasks.workunit.client.0.smithi088.stdout:6/416: write fb [1095961,125095] 0 2023-12-09T02:34:50.963 INFO:tasks.workunit.client.0.smithi088.stdout:1/468: creat d8/d27/d40/fa7 x:0 0 0 2023-12-09T02:34:50.966 INFO:tasks.workunit.client.0.smithi088.stdout:6/417: creat d16/d1b/d25/d5f/d63/f7f x:0 0 0 2023-12-09T02:34:50.967 INFO:tasks.workunit.client.0.smithi088.stdout:1/469: write d8/d27/d66/d79/f99 [2188535,86856] 0 2023-12-09T02:34:50.967 INFO:tasks.workunit.client.0.smithi088.stdout:6/418: mkdir d16/d1b/d2c/d3f/d41/d80 0 2023-12-09T02:34:50.969 INFO:tasks.workunit.client.0.smithi088.stdout:1/470: link d8/d3d/d5d/d95/f6e d8/d3d/d5d/d95/fa8 0 2023-12-09T02:34:50.970 INFO:tasks.workunit.client.0.smithi088.stdout:6/419: creat d16/d1b/d2c/d3f/d41/d80/f81 x:0 0 0 2023-12-09T02:34:50.970 INFO:tasks.workunit.client.0.smithi088.stdout:9/348: dwrite df/d20/d4c/f75 [0,4194304] 0 2023-12-09T02:34:50.971 INFO:tasks.workunit.client.0.smithi088.stdout:1/471: truncate d8/f3e 2854165 0 2023-12-09T02:34:50.972 INFO:tasks.workunit.client.0.smithi088.stdout:3/339: dwrite d1/d9/d6f/d6/d4a/d41/d33/d49/f4f [0,4194304] 0 2023-12-09T02:34:50.973 INFO:tasks.workunit.client.0.smithi088.stdout:6/420: mkdir d16/d1b/d25/d5f/d82 0 2023-12-09T02:34:50.973 INFO:tasks.workunit.client.0.smithi088.stdout:6/421: chown d16/f39 2089 1 2023-12-09T02:34:50.976 INFO:tasks.workunit.client.0.smithi088.stdout:9/349: rename df/d20/d30/d4e/d55/f61 to df/d50/d63/f7f 0 2023-12-09T02:34:50.977 INFO:tasks.workunit.client.0.smithi088.stdout:3/340: dread d1/d9/d6f/d15/f27 [0,4194304] 0 2023-12-09T02:34:50.983 INFO:tasks.workunit.client.0.smithi088.stdout:1/472: rename d8/d1c/d50/d6c/f70 to d8/d27/d40/fa9 0 2023-12-09T02:34:50.983 INFO:tasks.workunit.client.0.smithi088.stdout:1/473: stat d8/d1c/d50/f78 0 2023-12-09T02:34:50.984 INFO:tasks.workunit.client.0.smithi088.stdout:6/422: rename d16/d1b/d56/d66 to d16/d1b/d2c/d3f/d83 0 2023-12-09T02:34:50.984 INFO:tasks.workunit.client.0.smithi088.stdout:6/423: chown d16/d1b/d2c/l2f 174 1 2023-12-09T02:34:50.987 INFO:tasks.workunit.client.0.smithi088.stdout:6/424: unlink d16/d1b/d2c/d3f/d41/l47 0 2023-12-09T02:34:50.989 INFO:tasks.workunit.client.0.smithi088.stdout:1/474: unlink d8/d1b/c6f 0 2023-12-09T02:34:50.989 INFO:tasks.workunit.client.0.smithi088.stdout:1/475: chown d8/d27 342342538 1 2023-12-09T02:34:50.991 INFO:tasks.workunit.client.0.smithi088.stdout:1/476: getdents d8/d3d/d44 0 2023-12-09T02:34:50.992 INFO:tasks.workunit.client.0.smithi088.stdout:1/477: creat d8/d27/faa x:0 0 0 2023-12-09T02:34:50.992 INFO:tasks.workunit.client.0.smithi088.stdout:1/478: dread - d8/d27/d40/f76 zero size 2023-12-09T02:34:50.993 INFO:tasks.workunit.client.0.smithi088.stdout:8/412: sync 2023-12-09T02:34:51.000 INFO:tasks.workunit.client.0.smithi088.stdout:6/425: dread d16/d1b/d2c/d3f/d41/f4d [0,4194304] 0 2023-12-09T02:34:51.014 INFO:tasks.workunit.client.0.smithi088.stdout:8/413: dwrite d2/d9/d13/d1c/f3a [0,4194304] 0 2023-12-09T02:34:51.018 INFO:tasks.workunit.client.0.smithi088.stdout:8/414: dread d2/d9/d13/d1c/f5c [0,4194304] 0 2023-12-09T02:34:51.018 INFO:tasks.workunit.client.0.smithi088.stdout:8/415: dread - d2/d2b/f2e zero size 2023-12-09T02:34:51.019 INFO:tasks.workunit.client.0.smithi088.stdout:8/416: mknod d2/d9/d1a/d62/d76/c93 0 2023-12-09T02:34:51.019 INFO:tasks.workunit.client.0.smithi088.stdout:8/417: truncate d2/d9/d1a/f57 1198994 0 2023-12-09T02:34:51.021 INFO:tasks.workunit.client.0.smithi088.stdout:6/426: dwrite d16/d35/f46 [0,4194304] 0 2023-12-09T02:34:51.021 INFO:tasks.workunit.client.0.smithi088.stdout:8/418: creat d2/d9/d70/d8f/f94 x:0 0 0 2023-12-09T02:34:51.021 INFO:tasks.workunit.client.0.smithi088.stdout:8/419: write d2/d9/d13/d15/f2d [1946748,119128] 0 2023-12-09T02:34:51.023 INFO:tasks.workunit.client.0.smithi088.stdout:8/420: write d2/f28 [153278,103692] 0 2023-12-09T02:34:51.023 INFO:tasks.workunit.client.0.smithi088.stdout:8/421: dread - d2/d9/d1a/f7d zero size 2023-12-09T02:34:51.023 INFO:tasks.workunit.client.0.smithi088.stdout:6/427: read f11 [751068,53350] 0 2023-12-09T02:34:51.023 INFO:tasks.workunit.client.0.smithi088.stdout:6/428: write d16/d35/f5d [479078,127808] 0 2023-12-09T02:34:51.023 INFO:tasks.workunit.client.0.smithi088.stdout:6/429: readlink d16/d1b/l3c 0 2023-12-09T02:34:51.024 INFO:tasks.workunit.client.0.smithi088.stdout:8/422: link d2/f28 d2/d9/d1a/d62/f95 0 2023-12-09T02:34:51.025 INFO:tasks.workunit.client.0.smithi088.stdout:8/423: truncate d2/d9/f10 3747514 0 2023-12-09T02:34:51.025 INFO:tasks.workunit.client.0.smithi088.stdout:8/424: fsync d2/d9/d13/d15/f4b 0 2023-12-09T02:34:51.025 INFO:tasks.workunit.client.0.smithi088.stdout:5/372: sync 2023-12-09T02:34:51.026 INFO:tasks.workunit.client.0.smithi088.stdout:7/420: sync 2023-12-09T02:34:51.026 INFO:tasks.workunit.client.0.smithi088.stdout:0/373: sync 2023-12-09T02:34:51.026 INFO:tasks.workunit.client.0.smithi088.stdout:4/383: sync 2023-12-09T02:34:51.026 INFO:tasks.workunit.client.0.smithi088.stdout:7/421: write dc/d1b/d82/f84 [3156614,36072] 0 2023-12-09T02:34:51.026 INFO:tasks.workunit.client.0.smithi088.stdout:7/422: getdents dc/d21/d6b/d93 0 2023-12-09T02:34:51.027 INFO:tasks.workunit.client.0.smithi088.stdout:8/425: getdents d2 0 2023-12-09T02:34:51.027 INFO:tasks.workunit.client.0.smithi088.stdout:0/374: creat df/d28/d43/f79 x:0 0 0 2023-12-09T02:34:51.028 INFO:tasks.workunit.client.0.smithi088.stdout:7/423: stat dc/d1b/d32/d38/c52 0 2023-12-09T02:34:51.029 INFO:tasks.workunit.client.0.smithi088.stdout:8/426: write d2/f41 [2852420,42418] 0 2023-12-09T02:34:51.029 INFO:tasks.workunit.client.0.smithi088.stdout:8/427: chown d2/f3 245195196 1 2023-12-09T02:34:51.029 INFO:tasks.workunit.client.0.smithi088.stdout:7/424: creat dc/d21/d6b/d6d/d76/f98 x:0 0 0 2023-12-09T02:34:51.032 INFO:tasks.workunit.client.0.smithi088.stdout:6/430: dread d16/f1c [0,4194304] 0 2023-12-09T02:34:51.032 INFO:tasks.workunit.client.0.smithi088.stdout:6/431: chown d16/d1b/d2c/f2d 53 1 2023-12-09T02:34:51.032 INFO:tasks.workunit.client.0.smithi088.stdout:5/373: read d3/f24 [3525784,68352] 0 2023-12-09T02:34:51.034 INFO:tasks.workunit.client.0.smithi088.stdout:8/428: mkdir d2/d9/d13/d1c/d5f/d96 0 2023-12-09T02:34:51.035 INFO:tasks.workunit.client.0.smithi088.stdout:7/425: rename dc/d1b/d32/c83 to dc/d21/d6b/d6d/c99 0 2023-12-09T02:34:51.037 INFO:tasks.workunit.client.0.smithi088.stdout:5/374: creat d3/d15/de/d10/d18/d19/d1b/d35/d61/f81 x:0 0 0 2023-12-09T02:34:51.038 INFO:tasks.workunit.client.0.smithi088.stdout:4/384: dread d3/f4 [0,4194304] 0 2023-12-09T02:34:51.038 INFO:tasks.workunit.client.0.smithi088.stdout:7/426: symlink dc/d1b/d72/l9a 0 2023-12-09T02:34:51.038 INFO:tasks.workunit.client.0.smithi088.stdout:7/427: chown dc/d21/l19 10039204 1 2023-12-09T02:34:51.041 INFO:tasks.workunit.client.0.smithi088.stdout:0/375: dread df/d10/d22/d2d/d3c/f47 [0,4194304] 0 2023-12-09T02:34:51.041 INFO:tasks.workunit.client.0.smithi088.stdout:0/376: stat df/d37 0 2023-12-09T02:34:51.044 INFO:tasks.workunit.client.0.smithi088.stdout:4/385: link d3/l5d d3/dc/d18/d29/l81 0 2023-12-09T02:34:51.081 INFO:tasks.workunit.client.0.smithi088.stdout:8/429: dwrite d2/d9/d1a/f1f [0,4194304] 0 2023-12-09T02:34:51.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/428: dwrite dc/d21/f4a [0,4194304] 0 2023-12-09T02:34:51.082 INFO:tasks.workunit.client.0.smithi088.stdout:0/377: dwrite f4 [4194304,4194304] 0 2023-12-09T02:34:51.082 INFO:tasks.workunit.client.0.smithi088.stdout:4/386: dwrite d3/d1f/f3a [0,4194304] 0 2023-12-09T02:34:51.082 INFO:tasks.workunit.client.0.smithi088.stdout:0/378: write f2 [232175,64253] 0 2023-12-09T02:34:51.083 INFO:tasks.workunit.client.0.smithi088.stdout:8/430: creat d2/d9/d1a/d62/d49/f97 x:0 0 0 2023-12-09T02:34:51.083 INFO:tasks.workunit.client.0.smithi088.stdout:8/431: chown d2/d9/d13/d1c/c3d 166352 1 2023-12-09T02:34:51.086 INFO:tasks.workunit.client.0.smithi088.stdout:7/429: mkdir dc/d21/d6b/d9b 0 2023-12-09T02:34:51.086 INFO:tasks.workunit.client.0.smithi088.stdout:8/432: dread f1 [0,4194304] 0 2023-12-09T02:34:51.087 INFO:tasks.workunit.client.0.smithi088.stdout:8/433: read d2/d9/f10 [85414,54230] 0 2023-12-09T02:34:51.088 INFO:tasks.workunit.client.0.smithi088.stdout:4/387: symlink d3/d65/l82 0 2023-12-09T02:34:51.089 INFO:tasks.workunit.client.0.smithi088.stdout:2/373: sync 2023-12-09T02:34:51.089 INFO:tasks.workunit.client.0.smithi088.stdout:2/374: fsync d6/d13/f79 0 2023-12-09T02:34:51.089 INFO:tasks.workunit.client.0.smithi088.stdout:2/375: fsync d6/d13/f76 0 2023-12-09T02:34:51.091 INFO:tasks.workunit.client.0.smithi088.stdout:7/430: symlink dc/d1b/d32/d38/l9c 0 2023-12-09T02:34:51.092 INFO:tasks.workunit.client.0.smithi088.stdout:8/434: truncate d2/d9/d13/f2f 1969653 0 2023-12-09T02:34:51.093 INFO:tasks.workunit.client.0.smithi088.stdout:2/376: symlink d6/l85 0 2023-12-09T02:34:51.094 INFO:tasks.workunit.client.0.smithi088.stdout:7/431: rename dc/d1b/d32/l3a to dc/d1b/d32/l9d 0 2023-12-09T02:34:51.096 INFO:tasks.workunit.client.0.smithi088.stdout:8/435: truncate d2/d9/d13/d15/f2d 2671249 0 2023-12-09T02:34:51.096 INFO:tasks.workunit.client.0.smithi088.stdout:8/436: write d2/d9/d13/d1c/d5f/f90 [67925,107125] 0 2023-12-09T02:34:51.097 INFO:tasks.workunit.client.0.smithi088.stdout:7/432: getdents dc/d1b/d32/d5d 0 2023-12-09T02:34:51.097 INFO:tasks.workunit.client.0.smithi088.stdout:8/437: mkdir d2/d9/d70/d8f/d98 0 2023-12-09T02:34:51.098 INFO:tasks.workunit.client.0.smithi088.stdout:7/433: mknod dc/d1b/d91/c9e 0 2023-12-09T02:34:51.100 INFO:tasks.workunit.client.0.smithi088.stdout:8/438: mkdir d2/d9/d1a/d62/d76/d99 0 2023-12-09T02:34:51.100 INFO:tasks.workunit.client.0.smithi088.stdout:8/439: fdatasync d2/d9/d13/f19 0 2023-12-09T02:34:51.100 INFO:tasks.workunit.client.0.smithi088.stdout:8/440: readlink d2/d9/d1a/d62/l66 0 2023-12-09T02:34:51.100 INFO:tasks.workunit.client.0.smithi088.stdout:8/441: chown d2/d9/d13/d1c/d5f/f90 1592 1 2023-12-09T02:34:51.113 INFO:tasks.workunit.client.0.smithi088.stdout:2/377: dwrite d6/d20/d3d/f83 [0,4194304] 0 2023-12-09T02:34:51.113 INFO:tasks.workunit.client.0.smithi088.stdout:4/388: dwrite d3/dc/d1d/d3c/f7a [0,4194304] 0 2023-12-09T02:34:51.119 INFO:tasks.workunit.client.0.smithi088.stdout:4/389: rename d3/d1f to d3/dc/d43/d83 0 2023-12-09T02:34:51.121 INFO:tasks.workunit.client.0.smithi088.stdout:4/390: link d3/dc/d18/d7b/c4e d3/dc/d43/d83/d37/c84 0 2023-12-09T02:34:51.129 INFO:tasks.workunit.client.0.smithi088.stdout:2/378: dwrite d6/d8/f1d [0,4194304] 0 2023-12-09T02:34:51.130 INFO:tasks.workunit.client.0.smithi088.stdout:2/379: rename d6/d8/d1f/l37 to d6/d8/d4e/l86 0 2023-12-09T02:34:51.130 INFO:tasks.workunit.client.0.smithi088.stdout:2/380: fsync d6/d13/f33 0 2023-12-09T02:34:51.131 INFO:tasks.workunit.client.0.smithi088.stdout:2/381: creat d6/d8/d77/f87 x:0 0 0 2023-12-09T02:34:51.140 INFO:tasks.workunit.client.0.smithi088.stdout:4/391: dwrite d3/f9 [0,4194304] 0 2023-12-09T02:34:51.140 INFO:tasks.workunit.client.0.smithi088.stdout:4/392: chown d3/dc/f14 14339 1 2023-12-09T02:34:51.142 INFO:tasks.workunit.client.0.smithi088.stdout:4/393: symlink d3/dc/d7d/l85 0 2023-12-09T02:34:51.145 INFO:tasks.workunit.client.0.smithi088.stdout:4/394: creat d3/dc/d43/d83/d37/f86 x:0 0 0 2023-12-09T02:34:51.145 INFO:tasks.workunit.client.0.smithi088.stdout:4/395: readlink d3/l68 0 2023-12-09T02:34:51.145 INFO:tasks.workunit.client.0.smithi088.stdout:4/396: fdatasync d3/dc/d18/d29/f38 0 2023-12-09T02:34:51.145 INFO:tasks.workunit.client.0.smithi088.stdout:2/382: dread d6/d13/f1e [0,4194304] 0 2023-12-09T02:34:51.145 INFO:tasks.workunit.client.0.smithi088.stdout:2/383: read - d6/d8/d54/f65 zero size 2023-12-09T02:34:51.146 INFO:tasks.workunit.client.0.smithi088.stdout:2/384: getdents d6/d20/d69 0 2023-12-09T02:34:51.146 INFO:tasks.workunit.client.0.smithi088.stdout:2/385: chown d6/d8/d4e/d47/f58 241166792 1 2023-12-09T02:34:51.147 INFO:tasks.workunit.client.0.smithi088.stdout:2/386: creat d6/d8/d1f/d22/f88 x:0 0 0 2023-12-09T02:34:51.148 INFO:tasks.workunit.client.0.smithi088.stdout:2/387: mkdir d6/d13/d42/d89 0 2023-12-09T02:34:51.149 INFO:tasks.workunit.client.0.smithi088.stdout:2/388: truncate d6/d13/d18/f32 1109277 0 2023-12-09T02:34:51.153 INFO:tasks.workunit.client.0.smithi088.stdout:1/479: sync 2023-12-09T02:34:51.153 INFO:tasks.workunit.client.0.smithi088.stdout:3/341: sync 2023-12-09T02:34:51.153 INFO:tasks.workunit.client.0.smithi088.stdout:6/432: sync 2023-12-09T02:34:51.153 INFO:tasks.workunit.client.0.smithi088.stdout:5/375: sync 2023-12-09T02:34:51.153 INFO:tasks.workunit.client.0.smithi088.stdout:6/433: write d16/d1b/d25/d5f/d63/f7f [602534,93456] 0 2023-12-09T02:34:51.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/342: truncate d1/d9/d6f/d6/f36 2025023 0 2023-12-09T02:34:51.155 INFO:tasks.workunit.client.0.smithi088.stdout:9/350: sync 2023-12-09T02:34:51.155 INFO:tasks.workunit.client.0.smithi088.stdout:5/376: dread d3/d15/d2e/d49/f4f [0,4194304] 0 2023-12-09T02:34:51.156 INFO:tasks.workunit.client.0.smithi088.stdout:1/480: symlink d8/d53/lab 0 2023-12-09T02:34:51.162 INFO:tasks.workunit.client.0.smithi088.stdout:6/434: rename d16/d35/d65/f69 to d16/d35/f84 0 2023-12-09T02:34:51.162 INFO:tasks.workunit.client.0.smithi088.stdout:3/343: truncate d1/d9/d6f/d6/ff 4390621 0 2023-12-09T02:34:51.162 INFO:tasks.workunit.client.0.smithi088.stdout:2/389: dread d6/d8/d4e/d3c/f53 [0,4194304] 0 2023-12-09T02:34:51.162 INFO:tasks.workunit.client.0.smithi088.stdout:2/390: dread - d6/d20/f43 zero size 2023-12-09T02:34:51.162 INFO:tasks.workunit.client.0.smithi088.stdout:2/391: readlink d6/d8/l25 0 2023-12-09T02:34:51.162 INFO:tasks.workunit.client.0.smithi088.stdout:6/435: write d16/d1b/d2c/d3f/d41/f4b [4290587,47025] 0 2023-12-09T02:34:51.162 INFO:tasks.workunit.client.0.smithi088.stdout:9/351: unlink df/d50/l70 0 2023-12-09T02:34:51.163 INFO:tasks.workunit.client.0.smithi088.stdout:6/436: dread d16/d1b/d25/d5f/f68 [0,4194304] 0 2023-12-09T02:34:51.165 INFO:tasks.workunit.client.0.smithi088.stdout:4/397: dwrite d3/dc/d43/d83/f2b [0,4194304] 0 2023-12-09T02:34:51.166 INFO:tasks.workunit.client.0.smithi088.stdout:9/352: write df/f13 [218201,100765] 0 2023-12-09T02:34:51.166 INFO:tasks.workunit.client.0.smithi088.stdout:9/353: write df/d50/d63/f7f [1413063,87339] 0 2023-12-09T02:34:51.167 INFO:tasks.workunit.client.0.smithi088.stdout:3/344: mkdir d1/d9/d6f/d70 0 2023-12-09T02:34:51.167 INFO:tasks.workunit.client.0.smithi088.stdout:2/392: creat d6/d8/d73/d78/f8a x:0 0 0 2023-12-09T02:34:51.167 INFO:tasks.workunit.client.0.smithi088.stdout:2/393: stat d6/d8/l9 0 2023-12-09T02:34:51.171 INFO:tasks.workunit.client.0.smithi088.stdout:4/398: truncate d3/f4 2998444 0 2023-12-09T02:34:51.171 INFO:tasks.workunit.client.0.smithi088.stdout:4/399: chown d3/f76 0 1 2023-12-09T02:34:51.172 INFO:tasks.workunit.client.0.smithi088.stdout:3/345: symlink d1/l71 0 2023-12-09T02:34:51.174 INFO:tasks.workunit.client.0.smithi088.stdout:2/394: rmdir d6/d8/d4e 39 2023-12-09T02:34:51.175 INFO:tasks.workunit.client.0.smithi088.stdout:6/437: rename d16/d1b/d25/c34 to d16/d1b/d56/c85 0 2023-12-09T02:34:51.177 INFO:tasks.workunit.client.0.smithi088.stdout:4/400: link d3/dc/d43/d83/d37/f86 d3/dc/d43/f87 0 2023-12-09T02:34:51.178 INFO:tasks.workunit.client.0.smithi088.stdout:3/346: mkdir d1/d9/d6f/d6/d72 0 2023-12-09T02:34:51.179 INFO:tasks.workunit.client.0.smithi088.stdout:5/377: dwrite d3/f3d [0,4194304] 0 2023-12-09T02:34:51.179 INFO:tasks.workunit.client.0.smithi088.stdout:1/481: dwrite d8/f5c [0,4194304] 0 2023-12-09T02:34:51.179 INFO:tasks.workunit.client.0.smithi088.stdout:1/482: getdents d8/d27/d83 0 2023-12-09T02:34:51.179 INFO:tasks.workunit.client.0.smithi088.stdout:1/483: stat d8/d27/d66/f91 0 2023-12-09T02:34:51.180 INFO:tasks.workunit.client.0.smithi088.stdout:2/395: truncate d6/f1c 110130 0 2023-12-09T02:34:51.180 INFO:tasks.workunit.client.0.smithi088.stdout:2/396: fdatasync d6/d8/d1f/d22/f38 0 2023-12-09T02:34:51.180 INFO:tasks.workunit.client.0.smithi088.stdout:2/397: write d6/f5d [349042,63075] 0 2023-12-09T02:34:51.184 INFO:tasks.workunit.client.0.smithi088.stdout:3/347: mkdir d1/d73 0 2023-12-09T02:34:51.185 INFO:tasks.workunit.client.0.smithi088.stdout:5/378: unlink d3/d15/l1e 0 2023-12-09T02:34:51.185 INFO:tasks.workunit.client.0.smithi088.stdout:0/379: sync 2023-12-09T02:34:51.190 INFO:tasks.workunit.client.0.smithi088.stdout:4/401: dread f1 [0,4194304] 0 2023-12-09T02:34:51.190 INFO:tasks.workunit.client.0.smithi088.stdout:1/484: mkdir d8/d3d/d5d/d95/dac 0 2023-12-09T02:34:51.190 INFO:tasks.workunit.client.0.smithi088.stdout:1/485: fdatasync d8/d1c/d50/f78 0 2023-12-09T02:34:51.190 INFO:tasks.workunit.client.0.smithi088.stdout:1/486: write d8/f87 [512254,8516] 0 2023-12-09T02:34:51.190 INFO:tasks.workunit.client.0.smithi088.stdout:4/402: read d3/dc/d1d/f3f [2381956,65756] 0 2023-12-09T02:34:51.190 INFO:tasks.workunit.client.0.smithi088.stdout:4/403: dread - d3/d65/f6f zero size 2023-12-09T02:34:51.191 INFO:tasks.workunit.client.0.smithi088.stdout:2/398: stat d6/d13/f15 0 2023-12-09T02:34:51.192 INFO:tasks.workunit.client.0.smithi088.stdout:3/348: truncate d1/d9/d6f/d6/f36 1285270 0 2023-12-09T02:34:51.193 INFO:tasks.workunit.client.0.smithi088.stdout:6/438: dwrite d16/d1b/d56/f6c [0,4194304] 0 2023-12-09T02:34:51.193 INFO:tasks.workunit.client.0.smithi088.stdout:6/439: dread - d16/d1b/d2c/d3f/d41/d80/f81 zero size 2023-12-09T02:34:51.194 INFO:tasks.workunit.client.0.smithi088.stdout:5/379: creat d3/d15/de/d10/d51/d7f/f82 x:0 0 0 2023-12-09T02:34:51.194 INFO:tasks.workunit.client.0.smithi088.stdout:5/380: fsync d3/d15/d2e/f55 0 2023-12-09T02:34:51.194 INFO:tasks.workunit.client.0.smithi088.stdout:5/381: read - d3/d15/de/d10/d18/d19/d20/f43 zero size 2023-12-09T02:34:51.194 INFO:tasks.workunit.client.0.smithi088.stdout:5/382: chown d3/d15/d2e/f77 366531889 1 2023-12-09T02:34:51.195 INFO:tasks.workunit.client.0.smithi088.stdout:0/380: symlink df/d37/l7a 0 2023-12-09T02:34:51.195 INFO:tasks.workunit.client.0.smithi088.stdout:0/381: stat df/d10/f31 0 2023-12-09T02:34:51.195 INFO:tasks.workunit.client.0.smithi088.stdout:0/382: write df/d28/d33/f4e [398766,70272] 0 2023-12-09T02:34:51.196 INFO:tasks.workunit.client.0.smithi088.stdout:1/487: getdents d8/d1b/d6d 0 2023-12-09T02:34:51.198 INFO:tasks.workunit.client.0.smithi088.stdout:4/404: getdents d3/dc/d43 0 2023-12-09T02:34:51.201 INFO:tasks.workunit.client.0.smithi088.stdout:2/399: rename d6/d13/l34 to d6/d8/d4e/d64/l8b 0 2023-12-09T02:34:51.203 INFO:tasks.workunit.client.0.smithi088.stdout:3/349: creat d1/d58/f74 x:0 0 0 2023-12-09T02:34:51.207 INFO:tasks.workunit.client.0.smithi088.stdout:5/383: symlink d3/d15/dc/d60/l83 0 2023-12-09T02:34:51.207 INFO:tasks.workunit.client.0.smithi088.stdout:0/383: dread df/d10/f15 [0,4194304] 0 2023-12-09T02:34:51.207 INFO:tasks.workunit.client.0.smithi088.stdout:0/384: chown df/d28/d43/l4a 33968 1 2023-12-09T02:34:51.207 INFO:tasks.workunit.client.0.smithi088.stdout:5/384: dread d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:51.207 INFO:tasks.workunit.client.0.smithi088.stdout:5/385: chown d3/d15/dc 1351433290 1 2023-12-09T02:34:51.207 INFO:tasks.workunit.client.0.smithi088.stdout:5/386: write d3/d15/de/d10/d18/d19/d1b/d35/d42/f5e [471716,37736] 0 2023-12-09T02:34:51.208 INFO:tasks.workunit.client.0.smithi088.stdout:4/405: unlink d3/dc/d1d/d40/f41 0 2023-12-09T02:34:51.209 INFO:tasks.workunit.client.0.smithi088.stdout:2/400: truncate f4 2934372 0 2023-12-09T02:34:51.210 INFO:tasks.workunit.client.0.smithi088.stdout:2/401: fsync d6/d8/d1f/d22/f52 0 2023-12-09T02:34:51.210 INFO:tasks.workunit.client.0.smithi088.stdout:2/402: chown d6/d8/f6d 181925 1 2023-12-09T02:34:51.210 INFO:tasks.workunit.client.0.smithi088.stdout:2/403: write d6/d13/d18/f19 [283854,38911] 0 2023-12-09T02:34:51.210 INFO:tasks.workunit.client.0.smithi088.stdout:2/404: stat d6/d20/d3d/c51 0 2023-12-09T02:34:51.211 INFO:tasks.workunit.client.0.smithi088.stdout:1/488: dwrite d8/d1c/f29 [4194304,4194304] 0 2023-12-09T02:34:51.212 INFO:tasks.workunit.client.0.smithi088.stdout:3/350: mknod d1/d9/d6f/d70/c75 0 2023-12-09T02:34:51.213 INFO:tasks.workunit.client.0.smithi088.stdout:0/385: mknod df/d28/d34/c7b 0 2023-12-09T02:34:51.216 INFO:tasks.workunit.client.0.smithi088.stdout:5/387: rename d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/f5a to d3/d15/de/d10/d18/d19/d1b/d35/d42/f84 0 2023-12-09T02:34:51.222 INFO:tasks.workunit.client.0.smithi088.stdout:2/405: creat d6/d8/d4e/d3c/f8c x:0 0 0 2023-12-09T02:34:51.224 INFO:tasks.workunit.client.0.smithi088.stdout:0/386: getdents df/d10/d22/d5b 0 2023-12-09T02:34:51.225 INFO:tasks.workunit.client.0.smithi088.stdout:5/388: symlink d3/d15/dc/d60/l85 0 2023-12-09T02:34:51.225 INFO:tasks.workunit.client.0.smithi088.stdout:5/389: write d3/d15/de/d10/d18/d19/d1b/d35/d61/f81 [59202,123240] 0 2023-12-09T02:34:51.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:50 smithi088 ceph-mon[112028]: pgmap v193: 65 pgs: 65 active+clean; 550 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 22 MiB/s rd, 53 MiB/s wr, 495 op/s 2023-12-09T02:34:51.227 INFO:tasks.workunit.client.0.smithi088.stdout:2/406: creat d6/d8/d4e/d47/f8d x:0 0 0 2023-12-09T02:34:51.227 INFO:tasks.workunit.client.0.smithi088.stdout:0/387: creat df/d28/d43/f7c x:0 0 0 2023-12-09T02:34:51.228 INFO:tasks.workunit.client.0.smithi088.stdout:5/390: creat d3/d15/de/d10/d51/d7f/f86 x:0 0 0 2023-12-09T02:34:51.228 INFO:tasks.workunit.client.0.smithi088.stdout:5/391: write d3/d15/de/f7b [337768,95351] 0 2023-12-09T02:34:51.230 INFO:tasks.workunit.client.0.smithi088.stdout:2/407: write d6/d13/d18/f36 [1099976,45035] 0 2023-12-09T02:34:51.230 INFO:tasks.workunit.client.0.smithi088.stdout:3/351: dread d1/d9/d6f/d6/ff [0,4194304] 0 2023-12-09T02:34:51.230 INFO:tasks.workunit.client.0.smithi088.stdout:3/352: write d1/d9/d6f/d22/f6d [430947,52334] 0 2023-12-09T02:34:51.231 INFO:tasks.workunit.client.0.smithi088.stdout:0/388: link df/d10/d22/l23 df/d10/d22/l7d 0 2023-12-09T02:34:51.231 INFO:tasks.workunit.client.0.smithi088.stdout:0/389: write df/d10/f69 [4194438,20778] 0 2023-12-09T02:34:51.231 INFO:tasks.workunit.client.0.smithi088.stdout:0/390: write df/f67 [4799243,118447] 0 2023-12-09T02:34:51.234 INFO:tasks.workunit.client.0.smithi088.stdout:2/408: mkdir d6/d20/d3a/d84/d8e 0 2023-12-09T02:34:51.235 INFO:tasks.workunit.client.0.smithi088.stdout:3/353: write d1/d9/d6f/d6/f11 [769723,129596] 0 2023-12-09T02:34:51.236 INFO:tasks.workunit.client.0.smithi088.stdout:4/406: dwrite d3/d65/f6f [0,4194304] 0 2023-12-09T02:34:51.236 INFO:tasks.workunit.client.0.smithi088.stdout:0/391: creat df/d10/d22/d2d/d2e/f7e x:0 0 0 2023-12-09T02:34:51.237 INFO:tasks.workunit.client.0.smithi088.stdout:1/489: dwrite d8/d1b/f33 [0,4194304] 0 2023-12-09T02:34:51.238 INFO:tasks.workunit.client.0.smithi088.stdout:2/409: symlink d6/d13/l8f 0 2023-12-09T02:34:51.240 INFO:tasks.workunit.client.0.smithi088.stdout:4/407: mkdir d3/dc/d88 0 2023-12-09T02:34:51.242 INFO:tasks.workunit.client.0.smithi088.stdout:0/392: symlink df/d10/d22/d5f/l7f 0 2023-12-09T02:34:51.248 INFO:tasks.workunit.client.0.smithi088.stdout:1/490: unlink d8/d3d/d5d/d95/fa8 0 2023-12-09T02:34:51.249 INFO:tasks.workunit.client.0.smithi088.stdout:4/408: truncate d3/dc/d1d/f57 124467 0 2023-12-09T02:34:51.250 INFO:tasks.workunit.client.0.smithi088.stdout:5/392: rmdir d3/d15/de 39 2023-12-09T02:34:51.251 INFO:tasks.workunit.client.0.smithi088.stdout:0/393: mknod df/d10/c80 0 2023-12-09T02:34:51.253 INFO:tasks.workunit.client.0.smithi088.stdout:4/409: creat d3/f89 x:0 0 0 2023-12-09T02:34:51.254 INFO:tasks.workunit.client.0.smithi088.stdout:1/491: unlink d8/c9 0 2023-12-09T02:34:51.254 INFO:tasks.workunit.client.0.smithi088.stdout:1/492: write d8/d1b/d1d/f4d [313137,80093] 0 2023-12-09T02:34:51.258 INFO:tasks.workunit.client.0.smithi088.stdout:4/410: write d3/dc/d18/d29/f3b [4133936,117675] 0 2023-12-09T02:34:51.260 INFO:tasks.workunit.client.0.smithi088.stdout:2/410: dwrite d6/d20/f3e [0,4194304] 0 2023-12-09T02:34:51.262 INFO:tasks.workunit.client.0.smithi088.stdout:4/411: truncate d3/dc/d1d/d40/f59 1879400 0 2023-12-09T02:34:51.262 INFO:tasks.workunit.client.0.smithi088.stdout:7/434: sync 2023-12-09T02:34:51.262 INFO:tasks.workunit.client.0.smithi088.stdout:8/442: sync 2023-12-09T02:34:51.262 INFO:tasks.workunit.client.0.smithi088.stdout:2/411: write d6/f5d [305903,70105] 0 2023-12-09T02:34:51.262 INFO:tasks.workunit.client.0.smithi088.stdout:7/435: fdatasync dc/d21/f8c 0 2023-12-09T02:34:51.262 INFO:tasks.workunit.client.0.smithi088.stdout:7/436: rename dc/d1b/d32/d3e to dc/d1b/d32/d3e/d9f 22 2023-12-09T02:34:51.263 INFO:tasks.workunit.client.0.smithi088.stdout:0/394: dread df/f30 [0,4194304] 0 2023-12-09T02:34:51.263 INFO:tasks.workunit.client.0.smithi088.stdout:5/393: dread d3/d15/de/d10/d18/d19/d1b/f32 [0,4194304] 0 2023-12-09T02:34:51.263 INFO:tasks.workunit.client.0.smithi088.stdout:5/394: write d3/d15/de/d10/d51/d7f/f82 [758440,36207] 0 2023-12-09T02:34:51.263 INFO:tasks.workunit.client.0.smithi088.stdout:5/395: write d3/d15/de/d10/d18/d19/d1b/d35/d42/f84 [319893,81741] 0 2023-12-09T02:34:51.264 INFO:tasks.workunit.client.0.smithi088.stdout:5/396: dread d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:51.265 INFO:tasks.workunit.client.0.smithi088.stdout:5/397: dread d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:51.265 INFO:tasks.workunit.client.0.smithi088.stdout:8/443: mkdir d2/d9/d1a/d62/d9a 0 2023-12-09T02:34:51.265 INFO:tasks.workunit.client.0.smithi088.stdout:0/395: dread df/d28/d43/f4f [0,4194304] 0 2023-12-09T02:34:51.266 INFO:tasks.workunit.client.0.smithi088.stdout:2/412: creat d6/d20/f90 x:0 0 0 2023-12-09T02:34:51.266 INFO:tasks.workunit.client.0.smithi088.stdout:2/413: dread - d6/d20/f43 zero size 2023-12-09T02:34:51.268 INFO:tasks.workunit.client.0.smithi088.stdout:7/437: link dc/d1b/d32/d38/c2d dc/d1b/d32/d5d/ca0 0 2023-12-09T02:34:51.269 INFO:tasks.workunit.client.0.smithi088.stdout:2/414: write d6/d13/f15 [792768,81959] 0 2023-12-09T02:34:51.270 INFO:tasks.workunit.client.0.smithi088.stdout:1/493: dwrite d8/d53/f81 [0,4194304] 0 2023-12-09T02:34:51.270 INFO:tasks.workunit.client.0.smithi088.stdout:5/398: symlink d3/l87 0 2023-12-09T02:34:51.270 INFO:tasks.workunit.client.0.smithi088.stdout:2/415: dread d6/d8/f10 [0,4194304] 0 2023-12-09T02:34:51.270 INFO:tasks.workunit.client.0.smithi088.stdout:2/416: stat d6/d8/d4e/c81 0 2023-12-09T02:34:51.272 INFO:tasks.workunit.client.0.smithi088.stdout:8/444: mkdir d2/d9/d70/d8f/d98/d9b 0 2023-12-09T02:34:51.272 INFO:tasks.workunit.client.0.smithi088.stdout:8/445: write d2/d9/d13/d15/f26 [764324,110152] 0 2023-12-09T02:34:51.272 INFO:tasks.workunit.client.0.smithi088.stdout:8/446: read - d2/f54 zero size 2023-12-09T02:34:51.275 INFO:tasks.workunit.client.0.smithi088.stdout:1/494: creat d8/d27/fad x:0 0 0 2023-12-09T02:34:51.275 INFO:tasks.workunit.client.0.smithi088.stdout:5/399: mkdir d3/d15/d2e/d49/d88 0 2023-12-09T02:34:51.276 INFO:tasks.workunit.client.0.smithi088.stdout:2/417: link d6/d8/d4e/f74 d6/d20/d3a/f91 0 2023-12-09T02:34:51.277 INFO:tasks.workunit.client.0.smithi088.stdout:8/447: getdents d2/d9/d13/d1c/d74 0 2023-12-09T02:34:51.278 INFO:tasks.workunit.client.0.smithi088.stdout:5/400: symlink d3/d15/dc/l89 0 2023-12-09T02:34:51.279 INFO:tasks.workunit.client.0.smithi088.stdout:2/418: symlink d6/d20/d3a/d82/l92 0 2023-12-09T02:34:51.281 INFO:tasks.workunit.client.0.smithi088.stdout:8/448: rmdir d2/d9/d13 39 2023-12-09T02:34:51.283 INFO:tasks.workunit.client.0.smithi088.stdout:5/401: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a 0 2023-12-09T02:34:51.283 INFO:tasks.workunit.client.0.smithi088.stdout:5/402: chown d3/d15/de/d10/d18/d19/d20/l5d 303923492 1 2023-12-09T02:34:51.283 INFO:tasks.workunit.client.0.smithi088.stdout:5/403: dread - d3/d15/de/d10/f80 zero size 2023-12-09T02:34:51.283 INFO:tasks.workunit.client.0.smithi088.stdout:2/419: stat d6/d8/d1f/d22/c2e 0 2023-12-09T02:34:51.286 INFO:tasks.workunit.client.0.smithi088.stdout:7/438: dread dc/d1b/d32/d38/f17 [0,4194304] 0 2023-12-09T02:34:51.286 INFO:tasks.workunit.client.0.smithi088.stdout:0/396: dwrite df/d10/d22/d5b/f71 [0,4194304] 0 2023-12-09T02:34:51.286 INFO:tasks.workunit.client.0.smithi088.stdout:8/449: creat d2/d9/d1a/d62/d76/d85/f9c x:0 0 0 2023-12-09T02:34:51.286 INFO:tasks.workunit.client.0.smithi088.stdout:8/450: stat d2/c21 0 2023-12-09T02:34:51.288 INFO:tasks.workunit.client.0.smithi088.stdout:5/404: unlink d3/d15/dc/d60/l85 0 2023-12-09T02:34:51.291 INFO:tasks.workunit.client.0.smithi088.stdout:0/397: getdents df/d28/d43 0 2023-12-09T02:34:51.293 INFO:tasks.workunit.client.0.smithi088.stdout:1/495: dwrite d8/d27/d66/d79/f9b [0,4194304] 0 2023-12-09T02:34:51.293 INFO:tasks.workunit.client.0.smithi088.stdout:1/496: truncate d8/d27/d40/fa9 734654 0 2023-12-09T02:34:51.296 INFO:tasks.workunit.client.0.smithi088.stdout:5/405: getdents d3/d15/de/d10/d51/d70 0 2023-12-09T02:34:51.296 INFO:tasks.workunit.client.0.smithi088.stdout:5/406: chown d3/d15/de/d10/d18/d19/d1b/d35/d42/f84 15 1 2023-12-09T02:34:51.296 INFO:tasks.workunit.client.0.smithi088.stdout:5/407: readlink d3/d15/de/d10/d51/l7a 0 2023-12-09T02:34:51.296 INFO:tasks.workunit.client.0.smithi088.stdout:5/408: truncate d3/d15/de/d10/d18/d19/d1b/f7e 954081 0 2023-12-09T02:34:51.298 INFO:tasks.workunit.client.0.smithi088.stdout:7/439: dread dc/f15 [4194304,4194304] 0 2023-12-09T02:34:51.298 INFO:tasks.workunit.client.0.smithi088.stdout:7/440: write dc/d1b/f6e [436130,80723] 0 2023-12-09T02:34:51.298 INFO:tasks.workunit.client.0.smithi088.stdout:7/441: fdatasync dc/d1b/d32/d38/f1d 0 2023-12-09T02:34:51.298 INFO:tasks.workunit.client.0.smithi088.stdout:4/412: dwrite d3/dc/f48 [0,4194304] 0 2023-12-09T02:34:51.300 INFO:tasks.workunit.client.0.smithi088.stdout:0/398: dread df/d10/f31 [0,4194304] 0 2023-12-09T02:34:51.302 INFO:tasks.workunit.client.0.smithi088.stdout:0/399: write df/d10/f24 [2593561,28346] 0 2023-12-09T02:34:51.302 INFO:tasks.workunit.client.0.smithi088.stdout:0/400: truncate df/d28/d43/f7c 997987 0 2023-12-09T02:34:51.302 INFO:tasks.workunit.client.0.smithi088.stdout:0/401: truncate df/f57 2258080 0 2023-12-09T02:34:51.304 INFO:tasks.workunit.client.0.smithi088.stdout:5/409: getdents d3/d15/de/d10/d18/d19/d1b/d35/d42/d47 0 2023-12-09T02:34:51.308 INFO:tasks.workunit.client.0.smithi088.stdout:7/442: creat dc/d21/d7f/fa1 x:0 0 0 2023-12-09T02:34:51.309 INFO:tasks.workunit.client.0.smithi088.stdout:4/413: rmdir d3/dc/d1d/d3c 39 2023-12-09T02:34:51.311 INFO:tasks.workunit.client.0.smithi088.stdout:0/402: mkdir df/d28/d33/d81 0 2023-12-09T02:34:51.312 INFO:tasks.workunit.client.0.smithi088.stdout:5/410: mknod d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/c8b 0 2023-12-09T02:34:51.312 INFO:tasks.workunit.client.0.smithi088.stdout:8/451: dwrite d2/d9/d13/d1c/f3a [0,4194304] 0 2023-12-09T02:34:51.313 INFO:tasks.workunit.client.0.smithi088.stdout:7/443: symlink dc/d1b/d32/d3e/d97/la2 0 2023-12-09T02:34:51.314 INFO:tasks.workunit.client.0.smithi088.stdout:8/452: write d2/d9/d13/d1c/f64 [1003382,41364] 0 2023-12-09T02:34:51.314 INFO:tasks.workunit.client.0.smithi088.stdout:4/414: truncate d3/f70 3844338 0 2023-12-09T02:34:51.315 INFO:tasks.workunit.client.0.smithi088.stdout:0/403: write df/d28/f3b [1184435,102951] 0 2023-12-09T02:34:51.315 INFO:tasks.workunit.client.0.smithi088.stdout:0/404: stat df/d10/d22/d2d 0 2023-12-09T02:34:51.315 INFO:tasks.workunit.client.0.smithi088.stdout:4/415: read d3/dc/d43/d83/f4f [22463,81959] 0 2023-12-09T02:34:51.315 INFO:tasks.workunit.client.0.smithi088.stdout:8/453: write d2/d9/d1a/d62/f47 [2349767,108515] 0 2023-12-09T02:34:51.316 INFO:tasks.workunit.client.0.smithi088.stdout:8/454: dread - d2/d2b/f2e zero size 2023-12-09T02:34:51.316 INFO:tasks.workunit.client.0.smithi088.stdout:1/497: dwrite d8/d1c/d50/f78 [0,4194304] 0 2023-12-09T02:34:51.318 INFO:tasks.workunit.client.0.smithi088.stdout:5/411: rename d3/d15/c54 to d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/c8c 0 2023-12-09T02:34:51.319 INFO:tasks.workunit.client.0.smithi088.stdout:9/354: sync 2023-12-09T02:34:51.319 INFO:tasks.workunit.client.0.smithi088.stdout:3/354: sync 2023-12-09T02:34:51.320 INFO:tasks.workunit.client.0.smithi088.stdout:3/355: dread d1/d9/d6f/d6/d4a/f48 [0,4194304] 0 2023-12-09T02:34:51.320 INFO:tasks.workunit.client.0.smithi088.stdout:3/356: stat d1/d9/d6f/d2d 0 2023-12-09T02:34:51.321 INFO:tasks.workunit.client.0.smithi088.stdout:8/455: creat d2/d9/d1a/d65/f9d x:0 0 0 2023-12-09T02:34:51.323 INFO:tasks.workunit.client.0.smithi088.stdout:1/498: symlink d8/d3d/d5d/d95/lae 0 2023-12-09T02:34:51.323 INFO:tasks.workunit.client.0.smithi088.stdout:1/499: fdatasync d8/d27/d40/fa7 0 2023-12-09T02:34:51.323 INFO:tasks.workunit.client.0.smithi088.stdout:1/500: dread - d8/d27/d40/f8e zero size 2023-12-09T02:34:51.323 INFO:tasks.workunit.client.0.smithi088.stdout:1/501: write d8/d1b/d6d/f92 [165421,82375] 0 2023-12-09T02:34:51.323 INFO:tasks.workunit.client.0.smithi088.stdout:6/440: sync 2023-12-09T02:34:51.323 INFO:tasks.workunit.client.0.smithi088.stdout:5/412: creat d3/d8/f8d x:0 0 0 2023-12-09T02:34:51.324 INFO:tasks.workunit.client.0.smithi088.stdout:1/502: write d8/d1c/f5a [2849338,6373] 0 2023-12-09T02:34:51.325 INFO:tasks.workunit.client.0.smithi088.stdout:3/357: creat d1/d9/d6f/d6/d72/f76 x:0 0 0 2023-12-09T02:34:51.329 INFO:tasks.workunit.client.0.smithi088.stdout:8/456: mkdir d2/d9/d13/d1c/d9e 0 2023-12-09T02:34:51.331 INFO:tasks.workunit.client.0.smithi088.stdout:1/503: dread d8/d27/f2b [0,4194304] 0 2023-12-09T02:34:51.332 INFO:tasks.workunit.client.0.smithi088.stdout:6/441: mknod d16/d1b/d2c/d3f/d41/d80/c86 0 2023-12-09T02:34:51.334 INFO:tasks.workunit.client.0.smithi088.stdout:5/413: mkdir d3/d15/de/d73/d8e 0 2023-12-09T02:34:51.338 INFO:tasks.workunit.client.0.smithi088.stdout:3/358: symlink d1/d9/d6f/d6/d72/l77 0 2023-12-09T02:34:51.338 INFO:tasks.workunit.client.0.smithi088.stdout:3/359: chown d1/d9/d6f/d24/c5c 9394 1 2023-12-09T02:34:51.340 INFO:tasks.workunit.client.0.smithi088.stdout:8/457: rename d2/d9/d13/d1c/d74 to d2/d9/d13/d15/d6e/d9f 0 2023-12-09T02:34:51.341 INFO:tasks.workunit.client.0.smithi088.stdout:1/504: creat d8/d3d/d5d/faf x:0 0 0 2023-12-09T02:34:51.341 INFO:tasks.workunit.client.0.smithi088.stdout:1/505: readlink d8/d1c/l21 0 2023-12-09T02:34:51.341 INFO:tasks.workunit.client.0.smithi088.stdout:6/442: mkdir d16/d62/d87 0 2023-12-09T02:34:51.344 INFO:tasks.workunit.client.0.smithi088.stdout:8/458: unlink d2/l40 0 2023-12-09T02:34:51.344 INFO:tasks.workunit.client.0.smithi088.stdout:8/459: stat d2/d9/d1a/d62/d49 0 2023-12-09T02:34:51.345 INFO:tasks.workunit.client.0.smithi088.stdout:8/460: read d2/d9/d1a/d62/d76/d85/f8c [1272991,101266] 0 2023-12-09T02:34:51.345 INFO:tasks.workunit.client.0.smithi088.stdout:8/461: chown d2/f54 386334 1 2023-12-09T02:34:51.345 INFO:tasks.workunit.client.0.smithi088.stdout:8/462: chown d2/d9/d13/d15/c36 28 1 2023-12-09T02:34:51.345 INFO:tasks.workunit.client.0.smithi088.stdout:8/463: getdents d2/d2b 0 2023-12-09T02:34:51.345 INFO:tasks.workunit.client.0.smithi088.stdout:8/464: chown d2/d9/d13/f56 22 1 2023-12-09T02:34:51.347 INFO:tasks.workunit.client.0.smithi088.stdout:8/465: creat d2/d9/d13/d15/fa0 x:0 0 0 2023-12-09T02:34:51.347 INFO:tasks.workunit.client.0.smithi088.stdout:8/466: write d2/d9/d13/f56 [124824,31346] 0 2023-12-09T02:34:51.359 INFO:tasks.workunit.client.0.smithi088.stdout:6/443: dread d16/f21 [0,4194304] 0 2023-12-09T02:34:51.360 INFO:tasks.workunit.client.0.smithi088.stdout:6/444: truncate d16/d1b/f1e 5233784 0 2023-12-09T02:34:51.370 INFO:tasks.workunit.client.0.smithi088.stdout:4/416: dwrite d3/dc/f61 [0,4194304] 0 2023-12-09T02:34:51.370 INFO:tasks.workunit.client.0.smithi088.stdout:5/414: dwrite d3/d15/f5b [4194304,4194304] 0 2023-12-09T02:34:51.372 INFO:tasks.workunit.client.0.smithi088.stdout:4/417: unlink d3/dc/d43/d83/d37/f86 0 2023-12-09T02:34:51.372 INFO:tasks.workunit.client.0.smithi088.stdout:9/355: dwrite df/d20/d30/d3f/d48/f5e [4194304,4194304] 0 2023-12-09T02:34:51.372 INFO:tasks.workunit.client.0.smithi088.stdout:0/405: dwrite df/d10/f24 [0,4194304] 0 2023-12-09T02:34:51.372 INFO:tasks.workunit.client.0.smithi088.stdout:0/406: fsync df/f57 0 2023-12-09T02:34:51.372 INFO:tasks.workunit.client.0.smithi088.stdout:0/407: chown df/d10/d22/l23 680 1 2023-12-09T02:34:51.372 INFO:tasks.workunit.client.0.smithi088.stdout:8/467: dwrite d2/d9/d13/d15/d6e/d9f/f77 [0,4194304] 0 2023-12-09T02:34:51.373 INFO:tasks.workunit.client.0.smithi088.stdout:1/506: dwrite d8/f5c [0,4194304] 0 2023-12-09T02:34:51.373 INFO:tasks.workunit.client.0.smithi088.stdout:4/418: write d3/dc/d43/f87 [742699,105078] 0 2023-12-09T02:34:51.374 INFO:tasks.workunit.client.0.smithi088.stdout:5/415: dread d3/f24 [0,4194304] 0 2023-12-09T02:34:51.374 INFO:tasks.workunit.client.0.smithi088.stdout:5/416: stat d3/d15/d2e/d49 0 2023-12-09T02:34:51.375 INFO:tasks.workunit.client.0.smithi088.stdout:4/419: read d3/dc/d43/f5b [1937388,61391] 0 2023-12-09T02:34:51.378 INFO:tasks.workunit.client.0.smithi088.stdout:0/408: truncate df/d10/d22/d2d/f4b 2496748 0 2023-12-09T02:34:51.381 INFO:tasks.workunit.client.0.smithi088.stdout:6/445: dwrite d16/d1b/d25/f40 [0,4194304] 0 2023-12-09T02:34:51.381 INFO:tasks.workunit.client.0.smithi088.stdout:1/507: symlink d8/d1b/d6d/lb0 0 2023-12-09T02:34:51.382 INFO:tasks.workunit.client.0.smithi088.stdout:8/468: creat d2/d9/d1a/d62/fa1 x:0 0 0 2023-12-09T02:34:51.384 INFO:tasks.workunit.client.0.smithi088.stdout:5/417: creat d3/d15/de/d73/f8f x:0 0 0 2023-12-09T02:34:51.389 INFO:tasks.workunit.client.0.smithi088.stdout:1/508: creat d8/d27/d66/fb1 x:0 0 0 2023-12-09T02:34:51.391 INFO:tasks.workunit.client.0.smithi088.stdout:8/469: creat d2/d9/d13/d15/d6e/fa2 x:0 0 0 2023-12-09T02:34:51.393 INFO:tasks.workunit.client.0.smithi088.stdout:0/409: dread df/d10/f15 [0,4194304] 0 2023-12-09T02:34:51.393 INFO:tasks.workunit.client.0.smithi088.stdout:5/418: link d3/d15/de/d10/f78 d3/d15/de/d10/d18/d19/d1b/d35/d42/f90 0 2023-12-09T02:34:51.393 INFO:tasks.workunit.client.0.smithi088.stdout:5/419: fsync d3/d15/de/d2c/f44 0 2023-12-09T02:34:51.394 INFO:tasks.workunit.client.0.smithi088.stdout:5/420: readlink d3/d15/de/d2c/l6c 0 2023-12-09T02:34:51.394 INFO:tasks.workunit.client.0.smithi088.stdout:8/470: symlink d2/d9/d1a/d62/d76/d85/la3 0 2023-12-09T02:34:51.396 INFO:tasks.workunit.client.0.smithi088.stdout:0/410: truncate df/d10/f31 396709 0 2023-12-09T02:34:51.396 INFO:tasks.workunit.client.0.smithi088.stdout:0/411: chown df/d10/d22/d5f 7 1 2023-12-09T02:34:51.398 INFO:tasks.workunit.client.0.smithi088.stdout:8/471: creat d2/d9/d13/d1c/d5f/fa4 x:0 0 0 2023-12-09T02:34:51.398 INFO:tasks.workunit.client.0.smithi088.stdout:6/446: rmdir d16/d1b/d2c/d3f/d41/d80 39 2023-12-09T02:34:51.398 INFO:tasks.workunit.client.0.smithi088.stdout:9/356: dwrite df/d50/d63/f73 [0,4194304] 0 2023-12-09T02:34:51.399 INFO:tasks.workunit.client.0.smithi088.stdout:5/421: dread d3/f24 [0,4194304] 0 2023-12-09T02:34:51.399 INFO:tasks.workunit.client.0.smithi088.stdout:4/420: dwrite d3/dc/d1d/d40/f54 [0,4194304] 0 2023-12-09T02:34:51.399 INFO:tasks.workunit.client.0.smithi088.stdout:8/472: mknod d2/d9/d13/d1c/d3b/ca5 0 2023-12-09T02:34:51.401 INFO:tasks.workunit.client.0.smithi088.stdout:1/509: dread d8/d27/d66/d79/f9b [0,4194304] 0 2023-12-09T02:34:51.403 INFO:tasks.workunit.client.0.smithi088.stdout:9/357: creat df/d50/d63/f80 x:0 0 0 2023-12-09T02:34:51.403 INFO:tasks.workunit.client.0.smithi088.stdout:9/358: truncate df/d20/d30/d3f/d48/f65 90175 0 2023-12-09T02:34:51.404 INFO:tasks.workunit.client.0.smithi088.stdout:1/510: write d8/d1c/f29 [2793269,8112] 0 2023-12-09T02:34:51.404 INFO:tasks.workunit.client.0.smithi088.stdout:1/511: chown d8/d3d/d5d/d95/l3c 3814759 1 2023-12-09T02:34:51.404 INFO:tasks.workunit.client.0.smithi088.stdout:5/422: creat d3/d15/dc/d60/f91 x:0 0 0 2023-12-09T02:34:51.407 INFO:tasks.workunit.client.0.smithi088.stdout:4/421: symlink d3/dc/d7d/l8a 0 2023-12-09T02:34:51.407 INFO:tasks.workunit.client.0.smithi088.stdout:4/422: fdatasync d3/d65/f6d 0 2023-12-09T02:34:51.408 INFO:tasks.workunit.client.0.smithi088.stdout:8/473: symlink d2/d9/d1a/d62/d76/la6 0 2023-12-09T02:34:51.409 INFO:tasks.workunit.client.0.smithi088.stdout:6/447: truncate d16/d1b/d25/f3d 731984 0 2023-12-09T02:34:51.411 INFO:tasks.workunit.client.0.smithi088.stdout:9/359: creat df/d20/d30/d52/f81 x:0 0 0 2023-12-09T02:34:51.412 INFO:tasks.workunit.client.0.smithi088.stdout:9/360: read df/d50/d63/f7f [1128933,68412] 0 2023-12-09T02:34:51.414 INFO:tasks.workunit.client.0.smithi088.stdout:1/512: rmdir d8/d27/d9a 39 2023-12-09T02:34:51.416 INFO:tasks.workunit.client.0.smithi088.stdout:6/448: rmdir d16/d1b/d71 39 2023-12-09T02:34:51.418 INFO:tasks.workunit.client.0.smithi088.stdout:9/361: creat df/d50/d63/f82 x:0 0 0 2023-12-09T02:34:51.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:50 smithi161 ceph-mon[121170]: pgmap v193: 65 pgs: 65 active+clean; 550 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 22 MiB/s rd, 53 MiB/s wr, 495 op/s 2023-12-09T02:34:51.421 INFO:tasks.workunit.client.0.smithi088.stdout:9/362: unlink lb 0 2023-12-09T02:34:51.421 INFO:tasks.workunit.client.0.smithi088.stdout:9/363: fdatasync df/f17 0 2023-12-09T02:34:51.421 INFO:tasks.workunit.client.0.smithi088.stdout:6/449: dread d16/d1b/d25/d5f/d63/f7f [0,4194304] 0 2023-12-09T02:34:51.422 INFO:tasks.workunit.client.0.smithi088.stdout:5/423: dwrite d3/d15/de/d10/d18/d19/d1b/f32 [0,4194304] 0 2023-12-09T02:34:51.422 INFO:tasks.workunit.client.0.smithi088.stdout:5/424: chown d3/d15/de/d10/d18/d19/d20/f27 2735 1 2023-12-09T02:34:51.422 INFO:tasks.workunit.client.0.smithi088.stdout:5/425: truncate d3/d15/de/d10/d18/d19/d1b/d35/d42/f90 936096 0 2023-12-09T02:34:51.426 INFO:tasks.workunit.client.0.smithi088.stdout:5/426: mknod d3/c92 0 2023-12-09T02:34:51.427 INFO:tasks.workunit.client.0.smithi088.stdout:2/420: sync 2023-12-09T02:34:51.429 INFO:tasks.workunit.client.0.smithi088.stdout:2/421: getdents d6/d8/d54 0 2023-12-09T02:34:51.431 INFO:tasks.workunit.client.0.smithi088.stdout:9/364: rmdir df/d20/d30/d4e/d55 0 2023-12-09T02:34:51.432 INFO:tasks.workunit.client.0.smithi088.stdout:2/422: mknod d6/d8/d73/c93 0 2023-12-09T02:34:51.432 INFO:tasks.workunit.client.0.smithi088.stdout:2/423: chown d6/l7 131128999 1 2023-12-09T02:34:51.433 INFO:tasks.workunit.client.0.smithi088.stdout:0/412: write df/d10/d22/d2d/f4b [1432798,3719] 0 2023-12-09T02:34:51.433 INFO:tasks.workunit.client.0.smithi088.stdout:0/413: chown f6 0 1 2023-12-09T02:34:51.433 INFO:tasks.workunit.client.0.smithi088.stdout:9/365: creat df/d20/d4c/d71/f83 x:0 0 0 2023-12-09T02:34:51.436 INFO:tasks.workunit.client.0.smithi088.stdout:2/424: unlink d6/d13/d42/f70 0 2023-12-09T02:34:51.436 INFO:tasks.workunit.client.0.smithi088.stdout:2/425: stat d6/fd 0 2023-12-09T02:34:51.440 INFO:tasks.workunit.client.0.smithi088.stdout:8/474: dwrite d2/d9/d13/d1c/f5c [0,4194304] 0 2023-12-09T02:34:51.440 INFO:tasks.workunit.client.0.smithi088.stdout:9/366: mkdir df/d20/d4c/d84 0 2023-12-09T02:34:51.440 INFO:tasks.workunit.client.0.smithi088.stdout:6/450: dwrite d16/d1b/f22 [0,4194304] 0 2023-12-09T02:34:51.440 INFO:tasks.workunit.client.0.smithi088.stdout:6/451: fdatasync d16/d35/d36/f6b 0 2023-12-09T02:34:51.444 INFO:tasks.workunit.client.0.smithi088.stdout:9/367: link df/d20/d30/d60/d5c/f66 df/d20/d30/d52/f85 0 2023-12-09T02:34:51.444 INFO:tasks.workunit.client.0.smithi088.stdout:8/475: read d2/d9/d13/d15/f2d [853761,102441] 0 2023-12-09T02:34:51.448 INFO:tasks.workunit.client.0.smithi088.stdout:8/476: link d2/f8 d2/d9/fa7 0 2023-12-09T02:34:51.452 INFO:tasks.workunit.client.0.smithi088.stdout:8/477: rmdir d2/d9/d13/d1c/d9e 0 2023-12-09T02:34:51.453 INFO:tasks.workunit.client.0.smithi088.stdout:8/478: fsync d2/d9/d13/d1c/f5c 0 2023-12-09T02:34:51.456 INFO:tasks.workunit.client.0.smithi088.stdout:5/427: dwrite d3/f45 [0,4194304] 0 2023-12-09T02:34:51.456 INFO:tasks.workunit.client.0.smithi088.stdout:6/452: write d16/f39 [1748734,17162] 0 2023-12-09T02:34:51.458 INFO:tasks.workunit.client.0.smithi088.stdout:6/453: creat d16/d1b/d2c/f88 x:0 0 0 2023-12-09T02:34:51.458 INFO:tasks.workunit.client.0.smithi088.stdout:8/479: dread f1 [0,4194304] 0 2023-12-09T02:34:51.464 INFO:tasks.workunit.client.0.smithi088.stdout:8/480: dread d2/d9/d1a/d62/d49/f60 [0,4194304] 0 2023-12-09T02:34:51.467 INFO:tasks.workunit.client.0.smithi088.stdout:8/481: mkdir d2/d9/d70/d8f/da8 0 2023-12-09T02:34:51.471 INFO:tasks.workunit.client.0.smithi088.stdout:9/368: dwrite df/f17 [0,4194304] 0 2023-12-09T02:34:51.472 INFO:tasks.workunit.client.0.smithi088.stdout:0/414: dwrite df/d10/d22/d2d/d3c/f47 [0,4194304] 0 2023-12-09T02:34:51.476 INFO:tasks.workunit.client.0.smithi088.stdout:2/426: dwrite d6/d8/d1f/d22/f40 [0,4194304] 0 2023-12-09T02:34:51.479 INFO:tasks.workunit.client.0.smithi088.stdout:9/369: creat df/d50/f86 x:0 0 0 2023-12-09T02:34:51.479 INFO:tasks.workunit.client.0.smithi088.stdout:0/415: symlink df/d10/l82 0 2023-12-09T02:34:51.481 INFO:tasks.workunit.client.0.smithi088.stdout:2/427: mkdir d6/d20/d3a/d94 0 2023-12-09T02:34:51.483 INFO:tasks.workunit.client.0.smithi088.stdout:0/416: unlink df/d28/d33/l76 0 2023-12-09T02:34:51.483 INFO:tasks.workunit.client.0.smithi088.stdout:9/370: dread df/f3d [0,4194304] 0 2023-12-09T02:34:51.484 INFO:tasks.workunit.client.0.smithi088.stdout:2/428: link d6/d13/l6a d6/d8/d73/d78/l95 0 2023-12-09T02:34:51.485 INFO:tasks.workunit.client.0.smithi088.stdout:2/429: write d6/d8/f46 [357887,10096] 0 2023-12-09T02:34:51.485 INFO:tasks.workunit.client.0.smithi088.stdout:9/371: dread df/f3d [0,4194304] 0 2023-12-09T02:34:51.485 INFO:tasks.workunit.client.0.smithi088.stdout:2/430: truncate d6/d8/d1f/f3b 2442161 0 2023-12-09T02:34:51.486 INFO:tasks.workunit.client.0.smithi088.stdout:9/372: dread df/d20/d30/d3f/d48/f65 [0,4194304] 0 2023-12-09T02:34:51.487 INFO:tasks.workunit.client.0.smithi088.stdout:2/431: truncate d6/f39 2630096 0 2023-12-09T02:34:51.487 INFO:tasks.workunit.client.0.smithi088.stdout:9/373: write df/d20/d30/d60/d5c/f1e [215167,107499] 0 2023-12-09T02:34:51.487 INFO:tasks.workunit.client.0.smithi088.stdout:9/374: fsync df/f13 0 2023-12-09T02:34:51.488 INFO:tasks.workunit.client.0.smithi088.stdout:2/432: truncate d6/d13/d18/f36 2325560 0 2023-12-09T02:34:51.491 INFO:tasks.workunit.client.0.smithi088.stdout:6/454: dwrite f15 [0,4194304] 0 2023-12-09T02:34:51.491 INFO:tasks.workunit.client.0.smithi088.stdout:2/433: mknod d6/c96 0 2023-12-09T02:34:51.491 INFO:tasks.workunit.client.0.smithi088.stdout:2/434: read - d6/d8/d73/d78/f8a zero size 2023-12-09T02:34:51.491 INFO:tasks.workunit.client.0.smithi088.stdout:2/435: chown d6/d8/d73/d78 1035683 1 2023-12-09T02:34:51.491 INFO:tasks.workunit.client.0.smithi088.stdout:2/436: truncate d6/d13/f76 487960 0 2023-12-09T02:34:51.491 INFO:tasks.workunit.client.0.smithi088.stdout:8/482: dwrite d2/d9/d13/d15/d6e/d9f/f77 [0,4194304] 0 2023-12-09T02:34:51.492 INFO:tasks.workunit.client.0.smithi088.stdout:6/455: write d16/d1b/d2c/f48 [1864337,69824] 0 2023-12-09T02:34:51.494 INFO:tasks.workunit.client.0.smithi088.stdout:5/428: dwrite d3/d15/dc/f2d [0,4194304] 0 2023-12-09T02:34:51.495 INFO:tasks.workunit.client.0.smithi088.stdout:2/437: rename d6/d20/d3a/d84/d8e to d6/d20/d3d/d97 0 2023-12-09T02:34:51.500 INFO:tasks.workunit.client.0.smithi088.stdout:8/483: creat d2/d2b/fa9 x:0 0 0 2023-12-09T02:34:51.503 INFO:tasks.workunit.client.0.smithi088.stdout:7/444: sync 2023-12-09T02:34:51.503 INFO:tasks.workunit.client.0.smithi088.stdout:7/445: fsync dc/d1b/f5c 0 2023-12-09T02:34:51.509 INFO:tasks.workunit.client.0.smithi088.stdout:2/438: mknod d6/d8/d4e/d47/c98 0 2023-12-09T02:34:51.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/417: dwrite df/d28/d34/f48 [0,4194304] 0 2023-12-09T02:34:51.512 INFO:tasks.workunit.client.0.smithi088.stdout:3/360: sync 2023-12-09T02:34:51.512 INFO:tasks.workunit.client.0.smithi088.stdout:7/446: truncate dc/d1b/d32/d38/d1e/f39 940910 0 2023-12-09T02:34:51.512 INFO:tasks.workunit.client.0.smithi088.stdout:7/447: dread - dc/d1b/d32/f71 zero size 2023-12-09T02:34:51.516 INFO:tasks.workunit.client.0.smithi088.stdout:3/361: rename d1/d9/d6f/d6/d4a/d41/d33/d49/l5f to d1/d58/l78 0 2023-12-09T02:34:51.517 INFO:tasks.workunit.client.0.smithi088.stdout:7/448: link dc/d21/c53 dc/d1b/d32/d38/ca3 0 2023-12-09T02:34:51.517 INFO:tasks.workunit.client.0.smithi088.stdout:3/362: getdents d1/d9/d6f/d70 0 2023-12-09T02:34:51.522 INFO:tasks.workunit.client.0.smithi088.stdout:3/363: symlink d1/d9/d6f/d6/d4a/d41/d33/l79 0 2023-12-09T02:34:51.522 INFO:tasks.workunit.client.0.smithi088.stdout:3/364: read - d1/d9/d6f/d6/d4a/f5b zero size 2023-12-09T02:34:51.522 INFO:tasks.workunit.client.0.smithi088.stdout:9/375: dwrite df/d20/d4c/f56 [0,4194304] 0 2023-12-09T02:34:51.522 INFO:tasks.workunit.client.0.smithi088.stdout:9/376: chown df/d20/d30/d60/d5c/l28 24624 1 2023-12-09T02:34:51.523 INFO:tasks.workunit.client.0.smithi088.stdout:3/365: creat d1/d9/d6f/d2d/d66/f7a x:0 0 0 2023-12-09T02:34:51.523 INFO:tasks.workunit.client.0.smithi088.stdout:3/366: dread - d1/d9/d6f/d15/f67 zero size 2023-12-09T02:34:51.531 INFO:tasks.workunit.client.0.smithi088.stdout:6/456: dwrite d16/d1b/d2c/f2d [0,4194304] 0 2023-12-09T02:34:51.531 INFO:tasks.workunit.client.0.smithi088.stdout:6/457: truncate d16/d1b/d25/d5f/f6e 652085 0 2023-12-09T02:34:51.531 INFO:tasks.workunit.client.0.smithi088.stdout:5/429: dwrite d3/d15/de/d10/d18/f4a [0,4194304] 0 2023-12-09T02:34:51.532 INFO:tasks.workunit.client.0.smithi088.stdout:8/484: dwrite d2/d9/d1a/d62/d49/f60 [0,4194304] 0 2023-12-09T02:34:51.533 INFO:tasks.workunit.client.0.smithi088.stdout:8/485: write d2/d9/d13/d1c/f32 [86354,47856] 0 2023-12-09T02:34:51.533 INFO:tasks.workunit.client.0.smithi088.stdout:0/418: dwrite df/d10/d22/f54 [0,4194304] 0 2023-12-09T02:34:51.535 INFO:tasks.workunit.client.0.smithi088.stdout:6/458: rmdir d16/d1b/d25/d5f/d82 0 2023-12-09T02:34:51.537 INFO:tasks.workunit.client.0.smithi088.stdout:5/430: symlink d3/d15/de/d10/d18/d19/d1b/d35/d42/d47/l93 0 2023-12-09T02:34:51.543 INFO:tasks.workunit.client.0.smithi088.stdout:6/459: link d16/d35/d36/c5a d16/d1b/d25/d5f/c89 0 2023-12-09T02:34:51.545 INFO:tasks.workunit.client.0.smithi088.stdout:4/423: sync 2023-12-09T02:34:51.546 INFO:tasks.workunit.client.0.smithi088.stdout:5/431: symlink d3/d15/dc/d60/l94 0 2023-12-09T02:34:51.548 INFO:tasks.workunit.client.0.smithi088.stdout:5/432: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d58/d95 0 2023-12-09T02:34:51.550 INFO:tasks.workunit.client.0.smithi088.stdout:4/424: symlink d3/dc/d43/l8b 0 2023-12-09T02:34:51.550 INFO:tasks.workunit.client.0.smithi088.stdout:1/513: sync 2023-12-09T02:34:51.550 INFO:tasks.workunit.client.0.smithi088.stdout:9/377: dwrite df/d20/d30/d52/f79 [0,4194304] 0 2023-12-09T02:34:51.551 INFO:tasks.workunit.client.0.smithi088.stdout:5/433: mknod d3/d15/dc/d14/c96 0 2023-12-09T02:34:51.554 INFO:tasks.workunit.client.0.smithi088.stdout:7/449: rename dc/d1b/d32 to dc/d21/d6b/d6d/da4 0 2023-12-09T02:34:51.557 INFO:tasks.workunit.client.0.smithi088.stdout:5/434: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d61/d97 0 2023-12-09T02:34:51.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/378: write df/d50/d63/f73 [3311603,2533] 0 2023-12-09T02:34:51.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/379: write df/d20/f3e [816505,26832] 0 2023-12-09T02:34:51.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/380: stat df/d20/d30/f43 0 2023-12-09T02:34:51.558 INFO:tasks.workunit.client.0.smithi088.stdout:4/425: mkdir d3/dc/d43/d8c 0 2023-12-09T02:34:51.559 INFO:tasks.workunit.client.0.smithi088.stdout:3/367: rename d1/d9/d6f/d2d/d66/f44 to d1/d9/d6f/d6/f7b 0 2023-12-09T02:34:51.560 INFO:tasks.workunit.client.0.smithi088.stdout:9/381: read df/d20/d4c/f75 [3913407,98860] 0 2023-12-09T02:34:51.560 INFO:tasks.workunit.client.0.smithi088.stdout:7/450: symlink dc/d21/d6b/d6d/da4/d5d/la5 0 2023-12-09T02:34:51.561 INFO:tasks.workunit.client.0.smithi088.stdout:5/435: creat d3/d15/de/d10/d18/d19/d1b/d35/d42/d47/f98 x:0 0 0 2023-12-09T02:34:51.561 INFO:tasks.workunit.client.0.smithi088.stdout:0/419: dwrite df/d10/d22/d2d/d3c/f47 [0,4194304] 0 2023-12-09T02:34:51.562 INFO:tasks.workunit.client.0.smithi088.stdout:6/460: dwrite d16/d35/f76 [0,4194304] 0 2023-12-09T02:34:51.564 INFO:tasks.workunit.client.0.smithi088.stdout:4/426: mkdir d3/dc/d18/d8d 0 2023-12-09T02:34:51.566 INFO:tasks.workunit.client.0.smithi088.stdout:8/486: rename d2/d9/d13/d1c/f89 to d2/d9/d13/d1c/d5f/d84/faa 0 2023-12-09T02:34:51.566 INFO:tasks.workunit.client.0.smithi088.stdout:8/487: stat d2/d2b 0 2023-12-09T02:34:51.566 INFO:tasks.workunit.client.0.smithi088.stdout:3/368: rmdir d1/d9/d6f/d6 39 2023-12-09T02:34:51.566 INFO:tasks.workunit.client.0.smithi088.stdout:3/369: dread - d1/d9/d6f/d2d/f46 zero size 2023-12-09T02:34:51.568 INFO:tasks.workunit.client.0.smithi088.stdout:7/451: rename dc/d21/d6b/d6d/da4/d38/l27 to dc/d21/d6b/d6d/da4/d38/la6 0 2023-12-09T02:34:51.569 INFO:tasks.workunit.client.0.smithi088.stdout:7/452: fsync dc/d21/d6b/f78 0 2023-12-09T02:34:51.569 INFO:tasks.workunit.client.0.smithi088.stdout:5/436: write d3/d15/de/f26 [1381222,114825] 0 2023-12-09T02:34:51.570 INFO:tasks.workunit.client.0.smithi088.stdout:7/453: dread dc/d21/d6b/d6d/da4/d38/f1d [0,4194304] 0 2023-12-09T02:34:51.570 INFO:tasks.workunit.client.0.smithi088.stdout:7/454: dread - dc/d1b/d72/f8d zero size 2023-12-09T02:34:51.571 INFO:tasks.workunit.client.0.smithi088.stdout:0/420: link df/d28/d33/f56 df/d10/d22/d2d/d2e/f83 0 2023-12-09T02:34:51.575 INFO:tasks.workunit.client.0.smithi088.stdout:6/461: mkdir d16/d62/d87/d8a 0 2023-12-09T02:34:51.575 INFO:tasks.workunit.client.0.smithi088.stdout:6/462: chown d16/d1b/d2c 137 1 2023-12-09T02:34:51.575 INFO:tasks.workunit.client.0.smithi088.stdout:6/463: write f9 [5343989,24983] 0 2023-12-09T02:34:51.576 INFO:tasks.workunit.client.0.smithi088.stdout:8/488: dread d2/d9/d13/d15/f18 [0,4194304] 0 2023-12-09T02:34:51.577 INFO:tasks.workunit.client.0.smithi088.stdout:4/427: creat d3/dc/d7d/f8e x:0 0 0 2023-12-09T02:34:51.580 INFO:tasks.workunit.client.0.smithi088.stdout:1/514: rename d8/d59/f71 to d8/d1c/d50/d6c/fb2 0 2023-12-09T02:34:51.580 INFO:tasks.workunit.client.0.smithi088.stdout:1/515: chown d8/d27/d9a/fa3 29 1 2023-12-09T02:34:51.580 INFO:tasks.workunit.client.0.smithi088.stdout:3/370: symlink d1/d9/d6f/d24/l7c 0 2023-12-09T02:34:51.581 INFO:tasks.workunit.client.0.smithi088.stdout:7/455: readlink dc/d21/d6b/d6d/da4/d38/d1e/l28 0 2023-12-09T02:34:51.583 INFO:tasks.workunit.client.0.smithi088.stdout:0/421: symlink df/d28/d34/l84 0 2023-12-09T02:34:51.583 INFO:tasks.workunit.client.0.smithi088.stdout:3/371: write d1/d58/f61 [972885,96883] 0 2023-12-09T02:34:51.585 INFO:tasks.workunit.client.0.smithi088.stdout:6/464: unlink d16/d35/d36/c5a 0 2023-12-09T02:34:51.587 INFO:tasks.workunit.client.0.smithi088.stdout:5/437: dwrite d3/d15/de/d10/d18/d19/d1b/d35/d42/f90 [0,4194304] 0 2023-12-09T02:34:51.587 INFO:tasks.workunit.client.0.smithi088.stdout:8/489: link d2/d9/d1a/d62/d76/d85/f8c d2/d9/d13/d15/fab 0 2023-12-09T02:34:51.587 INFO:tasks.workunit.client.0.smithi088.stdout:8/490: fdatasync d2/d2b/f2e 0 2023-12-09T02:34:51.587 INFO:tasks.workunit.client.0.smithi088.stdout:9/382: dwrite df/f1c [4194304,4194304] 0 2023-12-09T02:34:51.587 INFO:tasks.workunit.client.0.smithi088.stdout:5/438: write d3/d15/de/d10/d18/d19/d1b/f7e [878709,106716] 0 2023-12-09T02:34:51.588 INFO:tasks.workunit.client.0.smithi088.stdout:4/428: chown d3/dc/d43/d83/f2b 63485 1 2023-12-09T02:34:51.588 INFO:tasks.workunit.client.0.smithi088.stdout:4/429: write d3/f89 [367796,78106] 0 2023-12-09T02:34:51.589 INFO:tasks.workunit.client.0.smithi088.stdout:1/516: link d8/d1c/d50/f7f d8/d1b/fb3 0 2023-12-09T02:34:51.590 INFO:tasks.workunit.client.0.smithi088.stdout:7/456: creat dc/d21/d6b/d6d/da4/d38/fa7 x:0 0 0 2023-12-09T02:34:51.592 INFO:tasks.workunit.client.0.smithi088.stdout:0/422: symlink df/l85 0 2023-12-09T02:34:51.592 INFO:tasks.workunit.client.0.smithi088.stdout:0/423: fsync df/d10/d22/d2d/d3c/f44 0 2023-12-09T02:34:51.594 INFO:tasks.workunit.client.0.smithi088.stdout:5/439: dread d3/d15/de/d10/d18/d19/d20/f27 [0,4194304] 0 2023-12-09T02:34:51.594 INFO:tasks.workunit.client.0.smithi088.stdout:5/440: stat d3/d15/de/d10/d18/d19/d20/c71 0 2023-12-09T02:34:51.594 INFO:tasks.workunit.client.0.smithi088.stdout:3/372: rmdir d1/d9/d6f/d24 39 2023-12-09T02:34:51.594 INFO:tasks.workunit.client.0.smithi088.stdout:3/373: chown d1/d9/d6f/d24/l7c 769 1 2023-12-09T02:34:51.594 INFO:tasks.workunit.client.0.smithi088.stdout:3/374: fdatasync d1/d9/d6f/d6/f7b 0 2023-12-09T02:34:51.594 INFO:tasks.workunit.client.0.smithi088.stdout:3/375: truncate d1/d9/d6f/d24/f4d 230795 0 2023-12-09T02:34:51.594 INFO:tasks.workunit.client.0.smithi088.stdout:3/376: fdatasync d1/d9/d6f/f2f 0 2023-12-09T02:34:51.595 INFO:tasks.workunit.client.0.smithi088.stdout:6/465: symlink d16/d35/l8b 0 2023-12-09T02:34:51.597 INFO:tasks.workunit.client.0.smithi088.stdout:6/466: read d16/f1c [2804119,7953] 0 2023-12-09T02:34:51.597 INFO:tasks.workunit.client.0.smithi088.stdout:6/467: chown d16/d70/d75/c7b 265864 1 2023-12-09T02:34:51.599 INFO:tasks.workunit.client.0.smithi088.stdout:6/468: write d16/d1b/f1d [3078077,90221] 0 2023-12-09T02:34:51.600 INFO:tasks.workunit.client.0.smithi088.stdout:6/469: chown d16/d35/d36 0 1 2023-12-09T02:34:51.600 INFO:tasks.workunit.client.0.smithi088.stdout:6/470: write d16/d1b/d25/d5f/f68 [1312967,52029] 0 2023-12-09T02:34:51.600 INFO:tasks.workunit.client.0.smithi088.stdout:6/471: chown l3 19 1 2023-12-09T02:34:51.604 INFO:tasks.workunit.client.0.smithi088.stdout:8/491: rename f1 to d2/d2b/fac 0 2023-12-09T02:34:51.606 INFO:tasks.workunit.client.0.smithi088.stdout:9/383: mknod df/d29/d2f/c87 0 2023-12-09T02:34:51.610 INFO:tasks.workunit.client.0.smithi088.stdout:1/517: link d8/d1c/d50/d6c/fb2 d8/d3d/d5d/d95/dac/fb4 0 2023-12-09T02:34:51.610 INFO:tasks.workunit.client.0.smithi088.stdout:1/518: stat d8/d1b/c22 0 2023-12-09T02:34:51.612 INFO:tasks.workunit.client.0.smithi088.stdout:7/457: link dc/d1b/l26 dc/d1b/d89/la8 0 2023-12-09T02:34:51.612 INFO:tasks.workunit.client.0.smithi088.stdout:0/424: symlink df/d28/d33/d81/l86 0 2023-12-09T02:34:51.614 INFO:tasks.workunit.client.0.smithi088.stdout:5/441: creat d3/d15/de/d10/d18/f99 x:0 0 0 2023-12-09T02:34:51.614 INFO:tasks.workunit.client.0.smithi088.stdout:9/384: dread df/d20/d30/d60/d5c/f26 [0,4194304] 0 2023-12-09T02:34:51.617 INFO:tasks.workunit.client.0.smithi088.stdout:6/472: dwrite d16/f31 [0,4194304] 0 2023-12-09T02:34:51.619 INFO:tasks.workunit.client.0.smithi088.stdout:9/385: read df/d20/d30/f6d [3815234,39735] 0 2023-12-09T02:34:51.622 INFO:tasks.workunit.client.0.smithi088.stdout:4/430: rename d3/dc/d1d/d3c/c5a to d3/c8f 0 2023-12-09T02:34:51.623 INFO:tasks.workunit.client.0.smithi088.stdout:8/492: creat d2/d9/d13/d15/fad x:0 0 0 2023-12-09T02:34:51.623 INFO:tasks.workunit.client.0.smithi088.stdout:8/493: dread - d2/d9/d13/d15/fad zero size 2023-12-09T02:34:51.624 INFO:tasks.workunit.client.0.smithi088.stdout:7/458: truncate dc/d21/d6b/d6d/da4/d3e/f5a 210611 0 2023-12-09T02:34:51.626 INFO:tasks.workunit.client.0.smithi088.stdout:6/473: truncate d16/d1b/d2c/f2d 2919573 0 2023-12-09T02:34:51.630 INFO:tasks.workunit.client.0.smithi088.stdout:2/439: sync 2023-12-09T02:34:51.630 INFO:tasks.workunit.client.0.smithi088.stdout:1/519: dwrite d8/d3d/d44/d49/f65 [4194304,4194304] 0 2023-12-09T02:34:51.631 INFO:tasks.workunit.client.0.smithi088.stdout:5/442: dwrite d3/d15/d2e/f77 [0,4194304] 0 2023-12-09T02:34:51.631 INFO:tasks.workunit.client.0.smithi088.stdout:0/425: rename f2 to df/d10/d22/d5f/f87 0 2023-12-09T02:34:51.633 INFO:tasks.workunit.client.0.smithi088.stdout:7/459: creat dc/d1b/d66/fa9 x:0 0 0 2023-12-09T02:34:51.634 INFO:tasks.workunit.client.0.smithi088.stdout:6/474: mkdir d16/d62/d87/d8a/d8c 0 2023-12-09T02:34:51.635 INFO:tasks.workunit.client.0.smithi088.stdout:2/440: mkdir d6/d20/d3a/d82/d99 0 2023-12-09T02:34:51.638 INFO:tasks.workunit.client.0.smithi088.stdout:1/520: link d8/d1b/d6d/c7d d8/d3d/d5d/d95/d98/cb5 0 2023-12-09T02:34:51.640 INFO:tasks.workunit.client.0.smithi088.stdout:4/431: dwrite d3/dc/f11 [4194304,4194304] 0 2023-12-09T02:34:51.640 INFO:tasks.workunit.client.0.smithi088.stdout:4/432: fdatasync d3/dc/d1d/f71 0 2023-12-09T02:34:51.640 INFO:tasks.workunit.client.0.smithi088.stdout:4/433: chown d3/f89 935413 1 2023-12-09T02:34:51.640 INFO:tasks.workunit.client.0.smithi088.stdout:1/521: dread d8/d3d/d5d/d95/dac/fb4 [0,4194304] 0 2023-12-09T02:34:51.641 INFO:tasks.workunit.client.0.smithi088.stdout:1/522: write d8/d1c/d50/d6c/fb2 [1905291,35814] 0 2023-12-09T02:34:51.641 INFO:tasks.workunit.client.0.smithi088.stdout:5/443: mkdir d3/d15/de/d73/d8e/d9a 0 2023-12-09T02:34:51.643 INFO:tasks.workunit.client.0.smithi088.stdout:9/386: rename df/d20/d30/d52/f85 to df/d50/d63/f88 0 2023-12-09T02:34:51.643 INFO:tasks.workunit.client.0.smithi088.stdout:0/426: creat df/d37/d70/f88 x:0 0 0 2023-12-09T02:34:51.643 INFO:tasks.workunit.client.0.smithi088.stdout:9/387: dread - df/d20/d30/d52/f81 zero size 2023-12-09T02:34:51.643 INFO:tasks.workunit.client.0.smithi088.stdout:9/388: truncate df/f1c 9022646 0 2023-12-09T02:34:51.645 INFO:tasks.workunit.client.0.smithi088.stdout:6/475: mknod d16/d1b/d2c/d3f/d41/c8d 0 2023-12-09T02:34:51.650 INFO:tasks.workunit.client.0.smithi088.stdout:2/441: rmdir d6/d8/d1f/d22 39 2023-12-09T02:34:51.650 INFO:tasks.workunit.client.0.smithi088.stdout:2/442: stat d6/d20/d3a/d82/l92 0 2023-12-09T02:34:51.650 INFO:tasks.workunit.client.0.smithi088.stdout:1/523: dread f2 [0,4194304] 0 2023-12-09T02:34:51.650 INFO:tasks.workunit.client.0.smithi088.stdout:2/443: fdatasync d6/f39 0 2023-12-09T02:34:51.652 INFO:tasks.workunit.client.0.smithi088.stdout:2/444: read d6/d20/d3d/f83 [3161900,22471] 0 2023-12-09T02:34:51.652 INFO:tasks.workunit.client.0.smithi088.stdout:2/445: dread - d6/d13/d18/f48 zero size 2023-12-09T02:34:51.656 INFO:tasks.workunit.client.0.smithi088.stdout:8/494: rename d2/c21 to d2/d9/d13/d1c/d3b/cae 0 2023-12-09T02:34:51.656 INFO:tasks.workunit.client.0.smithi088.stdout:8/495: dread - d2/d9/d13/d1c/f5a zero size 2023-12-09T02:34:51.657 INFO:tasks.workunit.client.0.smithi088.stdout:8/496: dread - d2/d9/d13/d1c/d5f/d84/faa zero size 2023-12-09T02:34:51.665 INFO:tasks.workunit.client.0.smithi088.stdout:7/460: rename dc/d21/d6b/d6d/da4/d38/l41 to dc/d21/d6b/d6d/da4/d3e/d97/laa 0 2023-12-09T02:34:51.666 INFO:tasks.workunit.client.0.smithi088.stdout:1/524: write d8/d1b/f20 [2307063,50738] 0 2023-12-09T02:34:51.666 INFO:tasks.workunit.client.0.smithi088.stdout:1/525: stat d8/d3d/d5d/d95/c37 0 2023-12-09T02:34:51.666 INFO:tasks.workunit.client.0.smithi088.stdout:9/389: dread df/d20/d30/d60/d5c/f1f [0,4194304] 0 2023-12-09T02:34:51.666 INFO:tasks.workunit.client.0.smithi088.stdout:9/390: read - df/d29/f2d zero size 2023-12-09T02:34:51.666 INFO:tasks.workunit.client.0.smithi088.stdout:9/391: chown df/d20/d30/d60/d5c/f2a 29253 1 2023-12-09T02:34:51.667 INFO:tasks.workunit.client.0.smithi088.stdout:7/461: creat dc/d1b/d66/fab x:0 0 0 2023-12-09T02:34:51.670 INFO:tasks.workunit.client.0.smithi088.stdout:9/392: creat df/d20/d30/f89 x:0 0 0 2023-12-09T02:34:51.670 INFO:tasks.workunit.client.0.smithi088.stdout:1/526: dread d8/d27/f2b [0,4194304] 0 2023-12-09T02:34:51.671 INFO:tasks.workunit.client.0.smithi088.stdout:0/427: rename cd to df/d10/d22/d2d/c89 0 2023-12-09T02:34:51.674 INFO:tasks.workunit.client.0.smithi088.stdout:1/527: symlink d8/lb6 0 2023-12-09T02:34:51.674 INFO:tasks.workunit.client.0.smithi088.stdout:1/528: chown d8/d27/d9a/c9c 271 1 2023-12-09T02:34:51.676 INFO:tasks.workunit.client.0.smithi088.stdout:9/393: dread df/d50/f58 [0,4194304] 0 2023-12-09T02:34:51.676 INFO:tasks.workunit.client.0.smithi088.stdout:9/394: chown df 130642801 1 2023-12-09T02:34:51.677 INFO:tasks.workunit.client.0.smithi088.stdout:4/434: dwrite d3/f70 [0,4194304] 0 2023-12-09T02:34:51.678 INFO:tasks.workunit.client.0.smithi088.stdout:9/395: rename df/d50/f68 to df/d20/d4c/d84/f8a 0 2023-12-09T02:34:51.679 INFO:tasks.workunit.client.0.smithi088.stdout:9/396: readlink df/l15 0 2023-12-09T02:34:51.679 INFO:tasks.workunit.client.0.smithi088.stdout:1/529: write d8/d1b/f41 [3106023,46515] 0 2023-12-09T02:34:51.679 INFO:tasks.workunit.client.0.smithi088.stdout:1/530: rename d8 to d8/d3d/d5d/d95/dac/db7 22 2023-12-09T02:34:51.679 INFO:tasks.workunit.client.0.smithi088.stdout:5/444: dwrite d3/d15/de/d10/d18/d19/d1b/f1c [0,4194304] 0 2023-12-09T02:34:51.680 INFO:tasks.workunit.client.0.smithi088.stdout:1/531: chown d8/d1b/d6d/lb0 16 1 2023-12-09T02:34:51.680 INFO:tasks.workunit.client.0.smithi088.stdout:4/435: creat d3/dc/d1d/d40/f90 x:0 0 0 2023-12-09T02:34:51.680 INFO:tasks.workunit.client.0.smithi088.stdout:4/436: write d3/f9 [4595907,101100] 0 2023-12-09T02:34:51.682 INFO:tasks.workunit.client.0.smithi088.stdout:3/377: sync 2023-12-09T02:34:51.682 INFO:tasks.workunit.client.0.smithi088.stdout:3/378: fdatasync d1/d9/d6f/f51 0 2023-12-09T02:34:51.682 INFO:tasks.workunit.client.0.smithi088.stdout:4/437: mknod d3/dc/d18/d8d/c91 0 2023-12-09T02:34:51.682 INFO:tasks.workunit.client.0.smithi088.stdout:4/438: readlink d3/dc/d43/d83/l2f 0 2023-12-09T02:34:51.682 INFO:tasks.workunit.client.0.smithi088.stdout:9/397: dread df/d20/d30/d60/d5c/f26 [0,4194304] 0 2023-12-09T02:34:51.682 INFO:tasks.workunit.client.0.smithi088.stdout:3/379: truncate d1/d9/d6f/d6/d4a/d41/d33/d49/f52 1697567 0 2023-12-09T02:34:51.687 INFO:tasks.workunit.client.0.smithi088.stdout:2/446: dwrite d6/d8/d54/f65 [0,4194304] 0 2023-12-09T02:34:51.688 INFO:tasks.workunit.client.0.smithi088.stdout:1/532: rmdir d8/d27/d83 0 2023-12-09T02:34:51.688 INFO:tasks.workunit.client.0.smithi088.stdout:1/533: chown d8/d27/d40/da5 821582 1 2023-12-09T02:34:51.692 INFO:tasks.workunit.client.0.smithi088.stdout:2/447: getdents d6/d20/d3a 0 2023-12-09T02:34:51.692 INFO:tasks.workunit.client.0.smithi088.stdout:8/497: dwrite d2/d9/d13/d1c/d5f/fa4 [0,4194304] 0 2023-12-09T02:34:51.693 INFO:tasks.workunit.client.0.smithi088.stdout:8/498: read d2/d9/d13/f56 [265425,20826] 0 2023-12-09T02:34:51.694 INFO:tasks.workunit.client.0.smithi088.stdout:1/534: rename f4 to d8/d59/fb8 0 2023-12-09T02:34:51.696 INFO:tasks.workunit.client.0.smithi088.stdout:4/439: dread d3/dc/d18/d7b/f6a [0,4194304] 0 2023-12-09T02:34:51.696 INFO:tasks.workunit.client.0.smithi088.stdout:4/440: chown d3/dc/d43/d83/f3a 40003039 1 2023-12-09T02:34:51.698 INFO:tasks.workunit.client.0.smithi088.stdout:8/499: creat d2/d9/d13/d15/faf x:0 0 0 2023-12-09T02:34:51.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/500: mknod d2/d9/d13/cb0 0 2023-12-09T02:34:51.704 INFO:tasks.workunit.client.0.smithi088.stdout:2/448: dread f0 [0,4194304] 0 2023-12-09T02:34:51.705 INFO:tasks.workunit.client.0.smithi088.stdout:2/449: unlink d6/d13/d18/l59 0 2023-12-09T02:34:51.705 INFO:tasks.workunit.client.0.smithi088.stdout:4/441: write d3/dc/f61 [2533255,52272] 0 2023-12-09T02:34:51.706 INFO:tasks.workunit.client.0.smithi088.stdout:8/501: write d2/f8 [1842231,86924] 0 2023-12-09T02:34:51.706 INFO:tasks.workunit.client.0.smithi088.stdout:2/450: mkdir d6/d20/d9a 0 2023-12-09T02:34:51.706 INFO:tasks.workunit.client.0.smithi088.stdout:4/442: fdatasync d3/dc/d43/f87 0 2023-12-09T02:34:51.707 INFO:tasks.workunit.client.0.smithi088.stdout:4/443: write d3/f4 [2428515,5010] 0 2023-12-09T02:34:51.707 INFO:tasks.workunit.client.0.smithi088.stdout:4/444: readlink d3/dc/d43/d83/l2f 0 2023-12-09T02:34:51.707 INFO:tasks.workunit.client.0.smithi088.stdout:4/445: fsync d3/dc/d7d/f8e 0 2023-12-09T02:34:51.707 INFO:tasks.workunit.client.0.smithi088.stdout:8/502: symlink d2/d9/d70/lb1 0 2023-12-09T02:34:51.708 INFO:tasks.workunit.client.0.smithi088.stdout:2/451: creat d6/d8/d4e/d47/f9b x:0 0 0 2023-12-09T02:34:51.709 INFO:tasks.workunit.client.0.smithi088.stdout:4/446: mknod d3/dc/d1d/d3c/c92 0 2023-12-09T02:34:51.709 INFO:tasks.workunit.client.0.smithi088.stdout:0/428: dwrite df/d10/d22/d2d/d3c/f47 [4194304,4194304] 0 2023-12-09T02:34:51.709 INFO:tasks.workunit.client.0.smithi088.stdout:0/429: fsync df/f2c 0 2023-12-09T02:34:51.714 INFO:tasks.workunit.client.0.smithi088.stdout:2/452: creat d6/d8/d1f/d22/d68/f9c x:0 0 0 2023-12-09T02:34:51.714 INFO:tasks.workunit.client.0.smithi088.stdout:4/447: truncate d3/dc/d43/f52 519195 0 2023-12-09T02:34:51.717 INFO:tasks.workunit.client.0.smithi088.stdout:1/535: rmdir d8/d59 39 2023-12-09T02:34:51.717 INFO:tasks.workunit.client.0.smithi088.stdout:1/536: chown d8/d27/d40/c93 1555820918 1 2023-12-09T02:34:51.718 INFO:tasks.workunit.client.0.smithi088.stdout:0/430: creat df/d10/d22/d2d/f8a x:0 0 0 2023-12-09T02:34:51.718 INFO:tasks.workunit.client.0.smithi088.stdout:7/462: dwrite dc/d21/d6b/d6d/da4/d38/f49 [0,4194304] 0 2023-12-09T02:34:51.719 INFO:tasks.workunit.client.0.smithi088.stdout:5/445: dwrite d3/d15/de/d10/d18/f99 [0,4194304] 0 2023-12-09T02:34:51.719 INFO:tasks.workunit.client.0.smithi088.stdout:5/446: readlink d3/l87 0 2023-12-09T02:34:51.719 INFO:tasks.workunit.client.0.smithi088.stdout:5/447: write d3/d8/f9 [288589,25121] 0 2023-12-09T02:34:51.719 INFO:tasks.workunit.client.0.smithi088.stdout:3/380: dwrite d1/f1c [0,4194304] 0 2023-12-09T02:34:51.719 INFO:tasks.workunit.client.0.smithi088.stdout:9/398: dwrite df/d20/d4c/d71/f83 [0,4194304] 0 2023-12-09T02:34:51.719 INFO:tasks.workunit.client.0.smithi088.stdout:5/448: write d3/f24 [448616,24411] 0 2023-12-09T02:34:51.720 INFO:tasks.workunit.client.0.smithi088.stdout:5/449: dread - d3/d15/dc/d60/f91 zero size 2023-12-09T02:34:51.720 INFO:tasks.workunit.client.0.smithi088.stdout:5/450: chown d3/d15/de 13 1 2023-12-09T02:34:51.720 INFO:tasks.workunit.client.0.smithi088.stdout:2/453: unlink d6/d13/d18/l3f 0 2023-12-09T02:34:51.720 INFO:tasks.workunit.client.0.smithi088.stdout:4/448: rmdir d3/dc/d43 39 2023-12-09T02:34:51.721 INFO:tasks.workunit.client.0.smithi088.stdout:3/381: dread d1/d9/d6f/d6/d4a/d41/d33/d49/f52 [0,4194304] 0 2023-12-09T02:34:51.721 INFO:tasks.workunit.client.0.smithi088.stdout:3/382: write d1/d9/d6f/d2d/d66/f7a [326471,110028] 0 2023-12-09T02:34:51.721 INFO:tasks.workunit.client.0.smithi088.stdout:3/383: fdatasync d1/d9/d6f/d2d/d66/f6e 0 2023-12-09T02:34:51.721 INFO:tasks.workunit.client.0.smithi088.stdout:3/384: chown d1/d9/d6f/l20 48620 1 2023-12-09T02:34:51.722 INFO:tasks.workunit.client.0.smithi088.stdout:1/537: mkdir d8/d3d/d5d/d95/dac/db9 0 2023-12-09T02:34:51.722 INFO:tasks.workunit.client.0.smithi088.stdout:1/538: fsync d8/d27/d66/d79/f9b 0 2023-12-09T02:34:51.723 INFO:tasks.workunit.client.0.smithi088.stdout:0/431: link df/d10/c39 df/c8b 0 2023-12-09T02:34:51.727 INFO:tasks.workunit.client.0.smithi088.stdout:0/432: write df/d28/d34/f48 [637610,107642] 0 2023-12-09T02:34:51.727 INFO:tasks.workunit.client.0.smithi088.stdout:0/433: dread - df/d10/d22/f6f zero size 2023-12-09T02:34:51.727 INFO:tasks.workunit.client.0.smithi088.stdout:0/434: write df/d10/d22/f74 [164431,80090] 0 2023-12-09T02:34:51.728 INFO:tasks.workunit.client.0.smithi088.stdout:8/503: rmdir d2 39 2023-12-09T02:34:51.730 INFO:tasks.workunit.client.0.smithi088.stdout:7/463: dread dc/d21/f4a [0,4194304] 0 2023-12-09T02:34:51.731 INFO:tasks.workunit.client.0.smithi088.stdout:7/464: fdatasync dc/d21/d6b/d6d/da4/f55 0 2023-12-09T02:34:51.732 INFO:tasks.workunit.client.0.smithi088.stdout:8/504: read d2/d9/fa7 [515026,23440] 0 2023-12-09T02:34:51.732 INFO:tasks.workunit.client.0.smithi088.stdout:8/505: chown d2/d9/d13/d1c/f20 6838 1 2023-12-09T02:34:51.735 INFO:tasks.workunit.client.0.smithi088.stdout:7/465: read dc/d1b/d82/f84 [148249,45840] 0 2023-12-09T02:34:51.741 INFO:tasks.workunit.client.0.smithi088.stdout:9/399: link df/d50/f86 df/d20/d4c/d71/d7c/f8b 0 2023-12-09T02:34:51.742 INFO:tasks.workunit.client.0.smithi088.stdout:3/385: symlink d1/d9/l7d 0 2023-12-09T02:34:51.742 INFO:tasks.workunit.client.0.smithi088.stdout:3/386: write d1/d9/d6f/d6/f36 [1340640,122332] 0 2023-12-09T02:34:51.743 INFO:tasks.workunit.client.0.smithi088.stdout:0/435: unlink df/d37/d70/f88 0 2023-12-09T02:34:51.744 INFO:tasks.workunit.client.0.smithi088.stdout:9/400: read df/f1a [681418,98887] 0 2023-12-09T02:34:51.744 INFO:tasks.workunit.client.0.smithi088.stdout:9/401: chown df/d20/d30/d3f/d48/f46 102470 1 2023-12-09T02:34:51.745 INFO:tasks.workunit.client.0.smithi088.stdout:8/506: unlink d2/d9/d13/d1c/d5f/c8d 0 2023-12-09T02:34:51.745 INFO:tasks.workunit.client.0.smithi088.stdout:8/507: fdatasync d2/d2b/fac 0 2023-12-09T02:34:51.747 INFO:tasks.workunit.client.0.smithi088.stdout:7/466: creat dc/d21/d6b/d6d/da4/d5d/fac x:0 0 0 2023-12-09T02:34:51.747 INFO:tasks.workunit.client.0.smithi088.stdout:3/387: rmdir d1/d9/d6f 39 2023-12-09T02:34:51.747 INFO:tasks.workunit.client.0.smithi088.stdout:9/402: truncate df/d20/d30/d3f/d48/f5e 6454152 0 2023-12-09T02:34:51.747 INFO:tasks.workunit.client.0.smithi088.stdout:8/508: dread d2/d9/d13/d1c/f32 [0,4194304] 0 2023-12-09T02:34:51.748 INFO:tasks.workunit.client.0.smithi088.stdout:3/388: rmdir d1/d9/d6f/d6/d4a/d41/d33 39 2023-12-09T02:34:51.749 INFO:tasks.workunit.client.0.smithi088.stdout:0/436: dread df/d10/f29 [0,4194304] 0 2023-12-09T02:34:51.750 INFO:tasks.workunit.client.0.smithi088.stdout:9/403: rename df/d20/d30/d60/d5c/f66 to df/d20/d5b/f8c 0 2023-12-09T02:34:51.750 INFO:tasks.workunit.client.0.smithi088.stdout:9/404: dread - df/d50/d63/f80 zero size 2023-12-09T02:34:51.751 INFO:tasks.workunit.client.0.smithi088.stdout:9/405: stat df/d20/d4c/f56 0 2023-12-09T02:34:51.751 INFO:tasks.workunit.client.0.smithi088.stdout:9/406: fdatasync df/d50/d63/f73 0 2023-12-09T02:34:51.751 INFO:tasks.workunit.client.0.smithi088.stdout:9/407: readlink df/d50/l7b 0 2023-12-09T02:34:51.753 INFO:tasks.workunit.client.0.smithi088.stdout:8/509: read d2/d9/d1a/f1f [2118328,129871] 0 2023-12-09T02:34:51.753 INFO:tasks.workunit.client.0.smithi088.stdout:8/510: write d2/d2b/fa9 [876981,115633] 0 2023-12-09T02:34:51.753 INFO:tasks.workunit.client.0.smithi088.stdout:2/454: dwrite d6/d20/d3d/f4a [4194304,4194304] 0 2023-12-09T02:34:51.754 INFO:tasks.workunit.client.0.smithi088.stdout:2/455: fdatasync d6/d13/f79 0 2023-12-09T02:34:51.758 INFO:tasks.workunit.client.0.smithi088.stdout:2/456: creat d6/d20/d3a/d94/f9d x:0 0 0 2023-12-09T02:34:51.760 INFO:tasks.workunit.client.0.smithi088.stdout:4/449: dwrite d3/f6 [0,4194304] 0 2023-12-09T02:34:51.760 INFO:tasks.workunit.client.0.smithi088.stdout:5/451: dwrite d3/d15/de/d10/d18/d19/d20/f43 [0,4194304] 0 2023-12-09T02:34:51.760 INFO:tasks.workunit.client.0.smithi088.stdout:1/539: dwrite d8/d3d/f88 [0,4194304] 0 2023-12-09T02:34:51.765 INFO:tasks.workunit.client.0.smithi088.stdout:4/450: mkdir d3/dc/d18/d7b/d93 0 2023-12-09T02:34:51.768 INFO:tasks.workunit.client.0.smithi088.stdout:5/452: creat d3/d15/de/d10/d18/d19/d1b/f9b x:0 0 0 2023-12-09T02:34:51.771 INFO:tasks.workunit.client.0.smithi088.stdout:4/451: dread d3/dc/d18/d29/f60 [0,4194304] 0 2023-12-09T02:34:51.771 INFO:tasks.workunit.client.0.smithi088.stdout:1/540: mkdir d8/d3d/d5d/d95/dac/db9/dba 0 2023-12-09T02:34:51.772 INFO:tasks.workunit.client.0.smithi088.stdout:6/476: sync 2023-12-09T02:34:51.777 INFO:tasks.workunit.client.0.smithi088.stdout:2/457: dread d6/d8/d1f/d22/f40 [0,4194304] 0 2023-12-09T02:34:51.777 INFO:tasks.workunit.client.0.smithi088.stdout:2/458: write d6/d8/d4e/d64/f75 [492553,27780] 0 2023-12-09T02:34:51.777 INFO:tasks.workunit.client.0.smithi088.stdout:5/453: rename d3/f45 to d3/d15/de/d10/d51/d7f/f9c 0 2023-12-09T02:34:51.781 INFO:tasks.workunit.client.0.smithi088.stdout:1/541: creat d8/d27/d75/fbb x:0 0 0 2023-12-09T02:34:51.782 INFO:tasks.workunit.client.0.smithi088.stdout:6/477: fsync d16/d35/f46 0 2023-12-09T02:34:51.783 INFO:tasks.workunit.client.0.smithi088.stdout:7/467: rmdir dc/d21/d6b/d6d/da4/d5d 39 2023-12-09T02:34:51.785 INFO:tasks.workunit.client.0.smithi088.stdout:6/478: creat d16/d62/f8e x:0 0 0 2023-12-09T02:34:51.785 INFO:tasks.workunit.client.0.smithi088.stdout:1/542: dread d8/d1b/d6d/f97 [0,4194304] 0 2023-12-09T02:34:51.785 INFO:tasks.workunit.client.0.smithi088.stdout:1/543: chown d8/d53/f81 60223382 1 2023-12-09T02:34:51.787 INFO:tasks.workunit.client.0.smithi088.stdout:6/479: link d16/d1b/d2c/d3f/d41/l45 d16/d1b/d2c/d60/l8f 0 2023-12-09T02:34:51.787 INFO:tasks.workunit.client.0.smithi088.stdout:9/408: dwrite df/d20/d30/d60/d5c/f26 [0,4194304] 0 2023-12-09T02:34:51.787 INFO:tasks.workunit.client.0.smithi088.stdout:9/409: chown df/d20/d30/l39 26 1 2023-12-09T02:34:51.788 INFO:tasks.workunit.client.0.smithi088.stdout:1/544: creat d8/d1c/fbc x:0 0 0 2023-12-09T02:34:51.788 INFO:tasks.workunit.client.0.smithi088.stdout:0/437: dwrite df/f21 [0,4194304] 0 2023-12-09T02:34:51.789 INFO:tasks.workunit.client.0.smithi088.stdout:6/480: dread d16/d35/f5d [0,4194304] 0 2023-12-09T02:34:51.790 INFO:tasks.workunit.client.0.smithi088.stdout:8/511: dwrite d2/d9/d1a/d62/f7f [0,4194304] 0 2023-12-09T02:34:51.790 INFO:tasks.workunit.client.0.smithi088.stdout:9/410: getdents df/d20/d4c/d71 0 2023-12-09T02:34:51.791 INFO:tasks.workunit.client.0.smithi088.stdout:9/411: write df/d29/d2f/f3a [3041074,123610] 0 2023-12-09T02:34:51.791 INFO:tasks.workunit.client.0.smithi088.stdout:1/545: getdents d8/d3d/d5d/d95 0 2023-12-09T02:34:51.792 INFO:tasks.workunit.client.0.smithi088.stdout:0/438: symlink df/d10/d22/d2d/d2e/l8c 0 2023-12-09T02:34:51.799 INFO:tasks.workunit.client.0.smithi088.stdout:8/512: unlink d2/d9/d1a/d62/f7f 0 2023-12-09T02:34:51.799 INFO:tasks.workunit.client.0.smithi088.stdout:8/513: fdatasync d2/d9/d13/d15/d6e/d9f/f77 0 2023-12-09T02:34:51.799 INFO:tasks.workunit.client.0.smithi088.stdout:5/454: dwrite d3/d15/de/d10/d18/d19/d1b/d35/d42/f21 [0,4194304] 0 2023-12-09T02:34:51.800 INFO:tasks.workunit.client.0.smithi088.stdout:5/455: fsync d3/d8/f8d 0 2023-12-09T02:34:51.802 INFO:tasks.workunit.client.0.smithi088.stdout:1/546: unlink d8/d27/d66/f91 0 2023-12-09T02:34:51.802 INFO:tasks.workunit.client.0.smithi088.stdout:1/547: chown d8/d1b/f33 5 1 2023-12-09T02:34:51.802 INFO:tasks.workunit.client.0.smithi088.stdout:1/548: chown d8/d1c/d50/f72 20489759 1 2023-12-09T02:34:51.802 INFO:tasks.workunit.client.0.smithi088.stdout:0/439: creat df/d10/d22/d2d/f8d x:0 0 0 2023-12-09T02:34:51.803 INFO:tasks.workunit.client.0.smithi088.stdout:4/452: rmdir d3/dc 39 2023-12-09T02:34:51.804 INFO:tasks.workunit.client.0.smithi088.stdout:8/514: creat d2/d9/d13/d1c/d3b/fb2 x:0 0 0 2023-12-09T02:34:51.805 INFO:tasks.workunit.client.0.smithi088.stdout:5/456: rmdir d3/d15/de/d10/d18/d19/d1b/d35/d61/d97 0 2023-12-09T02:34:51.805 INFO:tasks.workunit.client.0.smithi088.stdout:5/457: fsync d3/d15/de/d10/d18/f57 0 2023-12-09T02:34:51.806 INFO:tasks.workunit.client.0.smithi088.stdout:1/549: mknod d8/d59/cbd 0 2023-12-09T02:34:51.807 INFO:tasks.workunit.client.0.smithi088.stdout:0/440: rename df/d28/d34/l84 to df/l8e 0 2023-12-09T02:34:51.807 INFO:tasks.workunit.client.0.smithi088.stdout:5/458: read d3/d15/d2e/f77 [3754338,74108] 0 2023-12-09T02:34:51.809 INFO:tasks.workunit.client.0.smithi088.stdout:1/550: unlink d8/d3d/d5d/l62 0 2023-12-09T02:34:51.810 INFO:tasks.workunit.client.0.smithi088.stdout:8/515: rename d2/d9/d13/d15/d6e/c71 to d2/d2b/cb3 0 2023-12-09T02:34:51.811 INFO:tasks.workunit.client.0.smithi088.stdout:9/412: dwrite df/d20/f3e [0,4194304] 0 2023-12-09T02:34:51.811 INFO:tasks.workunit.client.0.smithi088.stdout:9/413: truncate df/d29/f2d 381990 0 2023-12-09T02:34:51.811 INFO:tasks.workunit.client.0.smithi088.stdout:5/459: mkdir d3/d15/dc/d60/d9d 0 2023-12-09T02:34:51.813 INFO:tasks.workunit.client.0.smithi088.stdout:4/453: unlink d3/dc/d43/f5b 0 2023-12-09T02:34:51.814 INFO:tasks.workunit.client.0.smithi088.stdout:1/551: link d8/d1c/d50/d6c/fb2 d8/d1b/d6d/d7c/fbe 0 2023-12-09T02:34:51.815 INFO:tasks.workunit.client.0.smithi088.stdout:0/441: rename df/d28/d33/d81/l86 to df/d10/d22/l8f 0 2023-12-09T02:34:51.817 INFO:tasks.workunit.client.0.smithi088.stdout:8/516: symlink d2/d9/d13/d15/lb4 0 2023-12-09T02:34:51.818 INFO:tasks.workunit.client.0.smithi088.stdout:6/481: rmdir d16/d62 39 2023-12-09T02:34:51.822 INFO:tasks.workunit.client.0.smithi088.stdout:6/482: dread d16/d1b/d25/f3d [0,4194304] 0 2023-12-09T02:34:51.822 INFO:tasks.workunit.client.0.smithi088.stdout:5/460: creat d3/d15/dc/d60/f9e x:0 0 0 2023-12-09T02:34:51.823 INFO:tasks.workunit.client.0.smithi088.stdout:1/552: link d8/d53/l58 d8/d3d/d44/lbf 0 2023-12-09T02:34:51.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/442: rename df/l32 to df/d10/d22/l90 0 2023-12-09T02:34:51.832 INFO:tasks.workunit.client.0.smithi088.stdout:8/517: link d2/d9/d13/d15/c3e d2/d9/d13/d1c/d5f/d84/cb5 0 2023-12-09T02:34:51.832 INFO:tasks.workunit.client.0.smithi088.stdout:8/518: chown d2/c82 387804 1 2023-12-09T02:34:51.834 INFO:tasks.workunit.client.0.smithi088.stdout:1/553: mkdir d8/d1b/d6d/d7c/dc0 0 2023-12-09T02:34:51.836 INFO:tasks.workunit.client.0.smithi088.stdout:9/414: dwrite df/d20/d30/d3f/d48/f65 [0,4194304] 0 2023-12-09T02:34:51.836 INFO:tasks.workunit.client.0.smithi088.stdout:9/415: fdatasync df/d20/d4c/d71/f83 0 2023-12-09T02:34:51.836 INFO:tasks.workunit.client.0.smithi088.stdout:6/483: dwrite d16/d1b/d25/f3d [0,4194304] 0 2023-12-09T02:34:51.837 INFO:tasks.workunit.client.0.smithi088.stdout:8/519: creat d2/d9/d13/d15/d6e/fb6 x:0 0 0 2023-12-09T02:34:51.839 INFO:tasks.workunit.client.0.smithi088.stdout:1/554: rename d8/d3d/d44/c5f to d8/d1b/d6d/cc1 0 2023-12-09T02:34:51.841 INFO:tasks.workunit.client.0.smithi088.stdout:1/555: dread d8/d1b/f2e [0,4194304] 0 2023-12-09T02:34:51.843 INFO:tasks.workunit.client.0.smithi088.stdout:9/416: mknod df/d29/c8d 0 2023-12-09T02:34:51.844 INFO:tasks.workunit.client.0.smithi088.stdout:0/443: dwrite df/d28/d43/f7c [0,4194304] 0 2023-12-09T02:34:51.844 INFO:tasks.workunit.client.0.smithi088.stdout:0/444: readlink df/d10/d22/l90 0 2023-12-09T02:34:51.848 INFO:tasks.workunit.client.0.smithi088.stdout:6/484: rename d16/d70/d75 to d16/d70/d90 0 2023-12-09T02:34:51.849 INFO:tasks.workunit.client.0.smithi088.stdout:6/485: write f15 [2635435,58900] 0 2023-12-09T02:34:51.850 INFO:tasks.workunit.client.0.smithi088.stdout:8/520: rename d2/d9/d1a/d62/d76/d99 to d2/d9/d1a/d62/d49/db7 0 2023-12-09T02:34:51.850 INFO:tasks.workunit.client.0.smithi088.stdout:8/521: truncate d2/f54 176755 0 2023-12-09T02:34:51.850 INFO:tasks.workunit.client.0.smithi088.stdout:8/522: chown d2/d9/d1a/f25 669925915 1 2023-12-09T02:34:51.850 INFO:tasks.workunit.client.0.smithi088.stdout:9/417: rmdir df/d29/d2f 39 2023-12-09T02:34:51.854 INFO:tasks.workunit.client.0.smithi088.stdout:6/486: fsync d16/d35/f84 0 2023-12-09T02:34:51.855 INFO:tasks.workunit.client.0.smithi088.stdout:6/487: dread d16/d35/f5d [0,4194304] 0 2023-12-09T02:34:51.858 INFO:tasks.workunit.client.0.smithi088.stdout:1/556: rename d8/d27/d40/f77 to d8/d27/d9a/fc2 0 2023-12-09T02:34:51.860 INFO:tasks.workunit.client.0.smithi088.stdout:8/523: creat d2/d9/d1a/d62/d49/fb8 x:0 0 0 2023-12-09T02:34:51.861 INFO:tasks.workunit.client.0.smithi088.stdout:9/418: truncate df/d20/f5f 2683084 0 2023-12-09T02:34:51.863 INFO:tasks.workunit.client.0.smithi088.stdout:0/445: rename df/f30 to df/d28/d43/d77/f91 0 2023-12-09T02:34:51.864 INFO:tasks.workunit.client.0.smithi088.stdout:8/524: mkdir d2/db9 0 2023-12-09T02:34:51.864 INFO:tasks.workunit.client.0.smithi088.stdout:8/525: truncate d2/d9/d13/d15/f4b 1188834 0 2023-12-09T02:34:51.866 INFO:tasks.workunit.client.0.smithi088.stdout:9/419: creat df/d20/d4c/f8e x:0 0 0 2023-12-09T02:34:51.868 INFO:tasks.workunit.client.0.smithi088.stdout:1/557: rename d8/d3d/d5d/d95/f6e to d8/d3d/d44/fc3 0 2023-12-09T02:34:51.868 INFO:tasks.workunit.client.0.smithi088.stdout:1/558: write f3 [3753045,114879] 0 2023-12-09T02:34:51.868 INFO:tasks.workunit.client.0.smithi088.stdout:1/559: truncate d8/d53/f81 5116000 0 2023-12-09T02:34:51.868 INFO:tasks.workunit.client.0.smithi088.stdout:0/446: truncate df/d10/f1e 89440 0 2023-12-09T02:34:51.870 INFO:tasks.workunit.client.0.smithi088.stdout:3/389: sync 2023-12-09T02:34:51.870 INFO:tasks.workunit.client.0.smithi088.stdout:6/488: dwrite d16/d1b/d2c/d3f/d41/f43 [0,4194304] 0 2023-12-09T02:34:51.871 INFO:tasks.workunit.client.0.smithi088.stdout:9/420: unlink df/d20/d4c/d84/f8a 0 2023-12-09T02:34:51.872 INFO:tasks.workunit.client.0.smithi088.stdout:1/560: creat d8/d1b/fc4 x:0 0 0 2023-12-09T02:34:51.874 INFO:tasks.workunit.client.0.smithi088.stdout:0/447: mknod df/d10/d22/d5f/c92 0 2023-12-09T02:34:51.875 INFO:tasks.workunit.client.0.smithi088.stdout:3/390: creat d1/d9/d6f/d2d/d66/f7e x:0 0 0 2023-12-09T02:34:51.880 INFO:tasks.workunit.client.0.smithi088.stdout:8/526: rmdir d2/d9/d1a/d62/d49/db7 0 2023-12-09T02:34:51.880 INFO:tasks.workunit.client.0.smithi088.stdout:8/527: fsync d2/d9/d1a/f7d 0 2023-12-09T02:34:51.882 INFO:tasks.workunit.client.0.smithi088.stdout:2/459: sync 2023-12-09T02:34:51.882 INFO:tasks.workunit.client.0.smithi088.stdout:2/460: write d6/d8/f46 [527490,65253] 0 2023-12-09T02:34:51.885 INFO:tasks.workunit.client.0.smithi088.stdout:1/561: mkdir d8/d1c/d50/dc5 0 2023-12-09T02:34:51.888 INFO:tasks.workunit.client.0.smithi088.stdout:3/391: unlink d1/d9/d6f/d6/f69 0 2023-12-09T02:34:51.888 INFO:tasks.workunit.client.0.smithi088.stdout:9/421: dwrite df/d50/d63/f7f [0,4194304] 0 2023-12-09T02:34:51.888 INFO:tasks.workunit.client.0.smithi088.stdout:9/422: write df/d20/d5b/f7e [439918,35488] 0 2023-12-09T02:34:51.888 INFO:tasks.workunit.client.0.smithi088.stdout:9/423: write df/d20/d30/f35 [1821598,111811] 0 2023-12-09T02:34:51.890 INFO:tasks.workunit.client.0.smithi088.stdout:2/461: symlink d6/d20/d3a/d82/l9e 0 2023-12-09T02:34:51.892 INFO:tasks.workunit.client.0.smithi088.stdout:6/489: rmdir d16/d35/d36 39 2023-12-09T02:34:51.894 INFO:tasks.workunit.client.0.smithi088.stdout:1/562: creat d8/d3d/d5d/d95/dac/fc6 x:0 0 0 2023-12-09T02:34:51.899 INFO:tasks.workunit.client.0.smithi088.stdout:3/392: unlink d1/d9/d6f/d2d/d66/c60 0 2023-12-09T02:34:51.900 INFO:tasks.workunit.client.0.smithi088.stdout:9/424: symlink df/d20/l8f 0 2023-12-09T02:34:51.902 INFO:tasks.workunit.client.0.smithi088.stdout:2/462: rename d6/d13/d42/c56 to d6/d20/d9a/c9f 0 2023-12-09T02:34:51.902 INFO:tasks.workunit.client.0.smithi088.stdout:2/463: read - d6/d8/d4e/f74 zero size 2023-12-09T02:34:51.903 INFO:tasks.workunit.client.0.smithi088.stdout:1/563: mkdir d8/d1b/d1d/dc7 0 2023-12-09T02:34:51.903 INFO:tasks.workunit.client.0.smithi088.stdout:1/564: readlink d8/d53/lab 0 2023-12-09T02:34:51.905 INFO:tasks.workunit.client.0.smithi088.stdout:3/393: rename d1/d9/d6f/d24 to d1/d9/d6f/d22/d7f 0 2023-12-09T02:34:51.907 INFO:tasks.workunit.client.0.smithi088.stdout:1/565: link d8/d3d/c57 d8/d1b/d6d/cc8 0 2023-12-09T02:34:51.908 INFO:tasks.workunit.client.0.smithi088.stdout:2/464: rename d6/l7 to d6/d8/d4e/d3c/la0 0 2023-12-09T02:34:51.909 INFO:tasks.workunit.client.0.smithi088.stdout:9/425: dread df/f1c [0,4194304] 0 2023-12-09T02:34:51.910 INFO:tasks.workunit.client.0.smithi088.stdout:3/394: creat d1/d9/d6f/d22/d7f/d45/f80 x:0 0 0 2023-12-09T02:34:51.910 INFO:tasks.workunit.client.0.smithi088.stdout:3/395: chown d1/d9/d6f/d6/d4a/d41 11076169 1 2023-12-09T02:34:51.911 INFO:tasks.workunit.client.0.smithi088.stdout:3/396: read d1/d9/d6f/d6/f3f [2655127,25461] 0 2023-12-09T02:34:51.911 INFO:tasks.workunit.client.0.smithi088.stdout:2/465: mknod d6/d8/d1f/d22/d68/ca1 0 2023-12-09T02:34:51.911 INFO:tasks.workunit.client.0.smithi088.stdout:2/466: fsync d6/d8/d4e/d3c/f8c 0 2023-12-09T02:34:51.912 INFO:tasks.workunit.client.0.smithi088.stdout:7/468: sync 2023-12-09T02:34:51.912 INFO:tasks.workunit.client.0.smithi088.stdout:4/454: sync 2023-12-09T02:34:51.912 INFO:tasks.workunit.client.0.smithi088.stdout:5/461: sync 2023-12-09T02:34:51.912 INFO:tasks.workunit.client.0.smithi088.stdout:4/455: chown d3/dc/f12 455730292 1 2023-12-09T02:34:51.912 INFO:tasks.workunit.client.0.smithi088.stdout:9/426: unlink ce 0 2023-12-09T02:34:51.913 INFO:tasks.workunit.client.0.smithi088.stdout:9/427: chown df/l24 10344965 1 2023-12-09T02:34:51.913 INFO:tasks.workunit.client.0.smithi088.stdout:9/428: fdatasync df/d50/d63/f82 0 2023-12-09T02:34:51.914 INFO:tasks.workunit.client.0.smithi088.stdout:3/397: truncate d1/d9/d6f/d2d/d66/f5d 4183331 0 2023-12-09T02:34:51.916 INFO:tasks.workunit.client.0.smithi088.stdout:2/467: mkdir d6/d8/d4e/da2 0 2023-12-09T02:34:51.916 INFO:tasks.workunit.client.0.smithi088.stdout:2/468: chown d6/d8/d4e/f74 465 1 2023-12-09T02:34:51.916 INFO:tasks.workunit.client.0.smithi088.stdout:6/490: dwrite d16/d1b/d2c/d60/f74 [0,4194304] 0 2023-12-09T02:34:51.923 INFO:tasks.workunit.client.0.smithi088.stdout:7/469: rename dc/d21/d6b/d6d/da4/d5d/f69 to dc/d21/d6b/d6d/fad 0 2023-12-09T02:34:51.923 INFO:tasks.workunit.client.0.smithi088.stdout:4/456: getdents d3/dc/d1d/d3c 0 2023-12-09T02:34:51.923 INFO:tasks.workunit.client.0.smithi088.stdout:7/470: chown dc/d21/d6b/d6d/da4/d38/d1e/l42 1082261 1 2023-12-09T02:34:51.923 INFO:tasks.workunit.client.0.smithi088.stdout:4/457: chown f0 134089444 1 2023-12-09T02:34:51.923 INFO:tasks.workunit.client.0.smithi088.stdout:4/458: chown d3 486 1 2023-12-09T02:34:51.923 INFO:tasks.workunit.client.0.smithi088.stdout:9/429: creat df/d20/d4c/f90 x:0 0 0 2023-12-09T02:34:51.923 INFO:tasks.workunit.client.0.smithi088.stdout:9/430: getdents df/d20/d4c/d71 0 2023-12-09T02:34:51.924 INFO:tasks.workunit.client.0.smithi088.stdout:9/431: dread - df/d50/d63/f80 zero size 2023-12-09T02:34:51.924 INFO:tasks.workunit.client.0.smithi088.stdout:5/462: write d3/d15/de/d10/d18/f4a [2043358,61704] 0 2023-12-09T02:34:51.924 INFO:tasks.workunit.client.0.smithi088.stdout:5/463: chown d3/d15/dc/l75 22493 1 2023-12-09T02:34:51.924 INFO:tasks.workunit.client.0.smithi088.stdout:2/469: dread d6/d8/d1f/d22/f40 [0,4194304] 0 2023-12-09T02:34:51.924 INFO:tasks.workunit.client.0.smithi088.stdout:2/470: fdatasync d6/d8/d1f/d22/d68/f9c 0 2023-12-09T02:34:51.924 INFO:tasks.workunit.client.0.smithi088.stdout:2/471: readlink d6/d8/l25 0 2023-12-09T02:34:51.924 INFO:tasks.workunit.client.0.smithi088.stdout:2/472: readlink d6/d8/l9 0 2023-12-09T02:34:51.924 INFO:tasks.workunit.client.0.smithi088.stdout:7/471: write dc/f15 [5734169,74418] 0 2023-12-09T02:34:51.924 INFO:tasks.workunit.client.0.smithi088.stdout:3/398: unlink d1/d58/l78 0 2023-12-09T02:34:51.925 INFO:tasks.workunit.client.0.smithi088.stdout:4/459: write d3/dc/f14 [2566382,8041] 0 2023-12-09T02:34:51.925 INFO:tasks.workunit.client.0.smithi088.stdout:4/460: truncate d3/dc/d1d/d40/f59 2808489 0 2023-12-09T02:34:51.925 INFO:tasks.workunit.client.0.smithi088.stdout:4/461: truncate d3/dc/d1d/d3c/f51 1310989 0 2023-12-09T02:34:51.925 INFO:tasks.workunit.client.0.smithi088.stdout:4/462: write d3/dc/f10 [1679456,108505] 0 2023-12-09T02:34:51.926 INFO:tasks.workunit.client.0.smithi088.stdout:9/432: write fc [5419673,83755] 0 2023-12-09T02:34:51.926 INFO:tasks.workunit.client.0.smithi088.stdout:4/463: dread d3/dc/d18/d29/f60 [0,4194304] 0 2023-12-09T02:34:51.926 INFO:tasks.workunit.client.0.smithi088.stdout:1/566: dwrite d8/f15 [0,4194304] 0 2023-12-09T02:34:51.929 INFO:tasks.workunit.client.0.smithi088.stdout:6/491: getdents d16/d62/d87/d8a 0 2023-12-09T02:34:51.929 INFO:tasks.workunit.client.0.smithi088.stdout:2/473: creat d6/d13/d42/fa3 x:0 0 0 2023-12-09T02:34:51.932 INFO:tasks.workunit.client.0.smithi088.stdout:7/472: rename dc/d21/d6b/d6d/da4/d38/ca3 to dc/d1b/d91/cae 0 2023-12-09T02:34:51.933 INFO:tasks.workunit.client.0.smithi088.stdout:9/433: dread df/d20/d30/d60/d5c/f26 [0,4194304] 0 2023-12-09T02:34:51.933 INFO:tasks.workunit.client.0.smithi088.stdout:9/434: fsync df/d20/d30/d3f/d48/f65 0 2023-12-09T02:34:51.945 INFO:tasks.workunit.client.0.smithi088.stdout:3/399: rmdir d1/d9 39 2023-12-09T02:34:51.948 INFO:tasks.workunit.client.0.smithi088.stdout:2/474: symlink d6/d8/d77/la4 0 2023-12-09T02:34:51.949 INFO:tasks.workunit.client.0.smithi088.stdout:6/492: symlink d16/d1b/d71/l91 0 2023-12-09T02:34:51.952 INFO:tasks.workunit.client.0.smithi088.stdout:1/567: dwrite d8/d1b/f6a [0,4194304] 0 2023-12-09T02:34:51.952 INFO:tasks.workunit.client.0.smithi088.stdout:1/568: stat d8/d27/d66 0 2023-12-09T02:34:51.952 INFO:tasks.workunit.client.0.smithi088.stdout:7/473: rename dc/d21/d6b/l7c to dc/d21/d6b/d9b/laf 0 2023-12-09T02:34:51.952 INFO:tasks.workunit.client.0.smithi088.stdout:7/474: chown dc/d21/d6b/d6d/da4/d38/d1e/c59 1916864 1 2023-12-09T02:34:51.952 INFO:tasks.workunit.client.0.smithi088.stdout:4/464: dwrite d3/dc/d18/d7b/f62 [0,4194304] 0 2023-12-09T02:34:51.954 INFO:tasks.workunit.client.0.smithi088.stdout:3/400: mkdir d1/d9/d6f/d22/d7f/d81 0 2023-12-09T02:34:51.954 INFO:tasks.workunit.client.0.smithi088.stdout:5/464: dwrite d3/d15/de/d10/d18/d19/d20/f43 [4194304,4194304] 0 2023-12-09T02:34:51.954 INFO:tasks.workunit.client.0.smithi088.stdout:5/465: fdatasync d3/d15/de/d10/f6e 0 2023-12-09T02:34:51.954 INFO:tasks.workunit.client.0.smithi088.stdout:5/466: readlink d3/d15/dc/l75 0 2023-12-09T02:34:51.954 INFO:tasks.workunit.client.0.smithi088.stdout:9/435: dwrite df/d20/d4c/d71/d7c/f8b [0,4194304] 0 2023-12-09T02:34:51.957 INFO:tasks.workunit.client.0.smithi088.stdout:1/569: rmdir d8/d59 39 2023-12-09T02:34:51.958 INFO:tasks.workunit.client.0.smithi088.stdout:7/475: mknod dc/d21/d6b/cb0 0 2023-12-09T02:34:51.958 INFO:tasks.workunit.client.0.smithi088.stdout:7/476: chown dc/d21/c24 2720 1 2023-12-09T02:34:51.960 INFO:tasks.workunit.client.0.smithi088.stdout:1/570: dread d8/d1b/d6d/d7c/fbe [0,4194304] 0 2023-12-09T02:34:51.968 INFO:tasks.workunit.client.0.smithi088.stdout:4/465: symlink d3/dc/d7d/l94 0 2023-12-09T02:34:51.968 INFO:tasks.workunit.client.0.smithi088.stdout:4/466: stat d3/f6 0 2023-12-09T02:34:51.969 INFO:tasks.workunit.client.0.smithi088.stdout:5/467: dread d3/f24 [0,4194304] 0 2023-12-09T02:34:51.969 INFO:tasks.workunit.client.0.smithi088.stdout:5/468: dread - d3/d15/dc/d60/f91 zero size 2023-12-09T02:34:51.970 INFO:tasks.workunit.client.0.smithi088.stdout:3/401: link d1/d9/d6f/f51 d1/d3e/f82 0 2023-12-09T02:34:51.974 INFO:tasks.workunit.client.0.smithi088.stdout:1/571: mkdir d8/d1c/dc9 0 2023-12-09T02:34:51.977 INFO:tasks.workunit.client.0.smithi088.stdout:4/467: rename d3/dc/d1d/d3c to d3/dc/d43/d8c/d95 0 2023-12-09T02:34:51.979 INFO:tasks.workunit.client.0.smithi088.stdout:5/469: creat d3/d15/de/d73/d8e/f9f x:0 0 0 2023-12-09T02:34:51.982 INFO:tasks.workunit.client.0.smithi088.stdout:5/470: creat d3/d15/de/d10/d18/d19/fa0 x:0 0 0 2023-12-09T02:34:51.982 INFO:tasks.workunit.client.0.smithi088.stdout:5/471: chown d3/d15/de/d10/d18/d19/d1b/f32 1043 1 2023-12-09T02:34:51.985 INFO:tasks.workunit.client.0.smithi088.stdout:9/436: dread df/d20/d30/d3f/d48/f5e [0,4194304] 0 2023-12-09T02:34:51.988 INFO:tasks.workunit.client.0.smithi088.stdout:4/468: dread d3/dc/f11 [0,4194304] 0 2023-12-09T02:34:52.020 INFO:tasks.workunit.client.0.smithi088.stdout:6/493: dwrite d16/d1b/f51 [0,4194304] 0 2023-12-09T02:34:52.023 INFO:tasks.workunit.client.0.smithi088.stdout:6/494: write d16/d1b/f1d [3616872,42356] 0 2023-12-09T02:34:52.024 INFO:tasks.workunit.client.0.smithi088.stdout:6/495: mknod d16/d1b/d25/d5f/c92 0 2023-12-09T02:34:52.029 INFO:tasks.workunit.client.0.smithi088.stdout:6/496: dread d16/f1c [0,4194304] 0 2023-12-09T02:34:52.030 INFO:tasks.workunit.client.0.smithi088.stdout:2/475: dwrite d6/d8/d4e/d47/f9b [0,4194304] 0 2023-12-09T02:34:52.030 INFO:tasks.workunit.client.0.smithi088.stdout:3/402: dwrite d1/d9/d6f/d6/f11 [0,4194304] 0 2023-12-09T02:34:52.030 INFO:tasks.workunit.client.0.smithi088.stdout:1/572: dwrite d8/d3d/d5d/f8b [0,4194304] 0 2023-12-09T02:34:52.030 INFO:tasks.workunit.client.0.smithi088.stdout:7/477: dwrite dc/f43 [4194304,4194304] 0 2023-12-09T02:34:52.031 INFO:tasks.workunit.client.0.smithi088.stdout:5/472: dwrite d3/d15/de/f17 [0,4194304] 0 2023-12-09T02:34:52.031 INFO:tasks.workunit.client.0.smithi088.stdout:5/473: write d3/d15/dc/d60/f9e [548063,28822] 0 2023-12-09T02:34:52.031 INFO:tasks.workunit.client.0.smithi088.stdout:5/474: stat d3/d15/dc/d60/l83 0 2023-12-09T02:34:52.031 INFO:tasks.workunit.client.0.smithi088.stdout:4/469: dwrite d3/f9 [0,4194304] 0 2023-12-09T02:34:52.031 INFO:tasks.workunit.client.0.smithi088.stdout:4/470: chown d3/dc/c47 9279 1 2023-12-09T02:34:52.031 INFO:tasks.workunit.client.0.smithi088.stdout:4/471: chown d3/dc/d18/l1c 2 1 2023-12-09T02:34:52.032 INFO:tasks.workunit.client.0.smithi088.stdout:9/437: dwrite df/d50/d63/f82 [0,4194304] 0 2023-12-09T02:34:52.032 INFO:tasks.workunit.client.0.smithi088.stdout:9/438: chown df/d20/d30/d52/f81 109430 1 2023-12-09T02:34:52.034 INFO:tasks.workunit.client.0.smithi088.stdout:5/475: dread d3/d15/de/d10/d18/d19/d20/f27 [0,4194304] 0 2023-12-09T02:34:52.036 INFO:tasks.workunit.client.0.smithi088.stdout:9/439: write df/d20/d4c/d71/d7c/f8b [257911,31024] 0 2023-12-09T02:34:52.036 INFO:tasks.workunit.client.0.smithi088.stdout:9/440: chown df/d20/d4c/l4d 176 1 2023-12-09T02:34:52.036 INFO:tasks.workunit.client.0.smithi088.stdout:2/476: creat d6/d8/d1f/d22/d68/fa5 x:0 0 0 2023-12-09T02:34:52.036 INFO:tasks.workunit.client.0.smithi088.stdout:9/441: write df/d20/d30/d52/f81 [322822,52786] 0 2023-12-09T02:34:52.036 INFO:tasks.workunit.client.0.smithi088.stdout:0/448: sync 2023-12-09T02:34:52.037 INFO:tasks.workunit.client.0.smithi088.stdout:0/449: write df/d10/d22/f27 [241794,44675] 0 2023-12-09T02:34:52.037 INFO:tasks.workunit.client.0.smithi088.stdout:0/450: fsync df/d10/d22/d5b/f71 0 2023-12-09T02:34:52.037 INFO:tasks.workunit.client.0.smithi088.stdout:6/497: write d16/d1b/d56/f6c [335728,14159] 0 2023-12-09T02:34:52.040 INFO:tasks.workunit.client.0.smithi088.stdout:2/477: write d6/d8/d1f/d22/f40 [2313620,72710] 0 2023-12-09T02:34:52.043 INFO:tasks.workunit.client.0.smithi088.stdout:2/478: dread d6/d8/d4e/d64/f75 [0,4194304] 0 2023-12-09T02:34:52.043 INFO:tasks.workunit.client.0.smithi088.stdout:2/479: chown f1 3636273 1 2023-12-09T02:34:52.043 INFO:tasks.workunit.client.0.smithi088.stdout:2/480: dread - d6/d13/d18/f48 zero size 2023-12-09T02:34:52.043 INFO:tasks.workunit.client.0.smithi088.stdout:2/481: chown d6/d13/f79 6267 1 2023-12-09T02:34:52.045 INFO:tasks.workunit.client.0.smithi088.stdout:1/573: creat d8/d1c/d50/fca x:0 0 0 2023-12-09T02:34:52.046 INFO:tasks.workunit.client.0.smithi088.stdout:7/478: mkdir dc/d21/db1 0 2023-12-09T02:34:52.051 INFO:tasks.workunit.client.0.smithi088.stdout:5/476: creat d3/d15/de/d10/d51/d70/fa1 x:0 0 0 2023-12-09T02:34:52.055 INFO:tasks.workunit.client.0.smithi088.stdout:8/528: sync 2023-12-09T02:34:52.055 INFO:tasks.workunit.client.0.smithi088.stdout:2/482: rename f0 to d6/d8/d54/fa6 0 2023-12-09T02:34:52.056 INFO:tasks.workunit.client.0.smithi088.stdout:8/529: write d2/d2b/fac [2287782,112164] 0 2023-12-09T02:34:52.057 INFO:tasks.workunit.client.0.smithi088.stdout:3/403: dwrite d1/d9/d6f/d2d/f46 [0,4194304] 0 2023-12-09T02:34:52.058 INFO:tasks.workunit.client.0.smithi088.stdout:5/477: creat d3/d15/de/d10/d18/fa2 x:0 0 0 2023-12-09T02:34:52.058 INFO:tasks.workunit.client.0.smithi088.stdout:5/478: fdatasync d3/d15/de/d10/d18/d19/d1b/d35/d42/f84 0 2023-12-09T02:34:52.058 INFO:tasks.workunit.client.0.smithi088.stdout:5/479: truncate d3/d15/de/f7b 1147595 0 2023-12-09T02:34:52.058 INFO:tasks.workunit.client.0.smithi088.stdout:4/472: dwrite d3/dc/f28 [0,4194304] 0 2023-12-09T02:34:52.059 INFO:tasks.workunit.client.0.smithi088.stdout:6/498: mknod d16/d35/c93 0 2023-12-09T02:34:52.059 INFO:tasks.workunit.client.0.smithi088.stdout:6/499: fdatasync d16/d1b/d2c/f2d 0 2023-12-09T02:34:52.060 INFO:tasks.workunit.client.0.smithi088.stdout:6/500: write d16/d1b/d2c/d3f/d41/f43 [3141334,92052] 0 2023-12-09T02:34:52.060 INFO:tasks.workunit.client.0.smithi088.stdout:7/479: rename dc/d1b/d66/fa9 to dc/d21/d6b/d6d/da4/d3e/fb2 0 2023-12-09T02:34:52.060 INFO:tasks.workunit.client.0.smithi088.stdout:7/480: read - dc/d21/d6b/d6d/da4/d3e/f92 zero size 2023-12-09T02:34:52.060 INFO:tasks.workunit.client.0.smithi088.stdout:2/483: mknod d6/d8/d54/ca7 0 2023-12-09T02:34:52.065 INFO:tasks.workunit.client.0.smithi088.stdout:3/404: dread d1/d58/f68 [0,4194304] 0 2023-12-09T02:34:52.065 INFO:tasks.workunit.client.0.smithi088.stdout:4/473: link d3/f39 d3/dc/f96 0 2023-12-09T02:34:52.070 INFO:tasks.workunit.client.0.smithi088.stdout:1/574: dwrite d8/f19 [0,4194304] 0 2023-12-09T02:34:52.070 INFO:tasks.workunit.client.0.smithi088.stdout:1/575: chown d8/d1c/d50 12713023 1 2023-12-09T02:34:52.072 INFO:tasks.workunit.client.0.smithi088.stdout:1/576: write d8/f15 [3935439,126840] 0 2023-12-09T02:34:52.072 INFO:tasks.workunit.client.0.smithi088.stdout:1/577: chown d8/lb6 4 1 2023-12-09T02:34:52.072 INFO:tasks.workunit.client.0.smithi088.stdout:1/578: stat d8/d27/fad 0 2023-12-09T02:34:52.073 INFO:tasks.workunit.client.0.smithi088.stdout:4/474: dread d3/dc/d43/d83/f25 [0,4194304] 0 2023-12-09T02:34:52.074 INFO:tasks.workunit.client.0.smithi088.stdout:6/501: creat d16/f94 x:0 0 0 2023-12-09T02:34:52.074 INFO:tasks.workunit.client.0.smithi088.stdout:4/475: read d3/dc/d18/d29/f60 [11638,53566] 0 2023-12-09T02:34:52.077 INFO:tasks.workunit.client.0.smithi088.stdout:8/530: rename d2/d9/d13/d15/fad to d2/d9/d13/d15/d6e/d9f/fba 0 2023-12-09T02:34:52.077 INFO:tasks.workunit.client.0.smithi088.stdout:8/531: stat d2/d9/d13/d1c 0 2023-12-09T02:34:52.077 INFO:tasks.workunit.client.0.smithi088.stdout:8/532: write d2/d9/d13/d15/f18 [4198567,103040] 0 2023-12-09T02:34:52.077 INFO:tasks.workunit.client.0.smithi088.stdout:7/481: creat dc/d21/d6b/fb3 x:0 0 0 2023-12-09T02:34:52.079 INFO:tasks.workunit.client.0.smithi088.stdout:2/484: mknod d6/d8/d77/ca8 0 2023-12-09T02:34:52.079 INFO:tasks.workunit.client.0.smithi088.stdout:2/485: write d6/d13/f33 [902302,97492] 0 2023-12-09T02:34:52.080 INFO:tasks.workunit.client.0.smithi088.stdout:3/405: mkdir d1/d9/d6f/d6/d83 0 2023-12-09T02:34:52.086 INFO:tasks.workunit.client.0.smithi088.stdout:4/476: creat d3/dc/d1d/f97 x:0 0 0 2023-12-09T02:34:52.086 INFO:tasks.workunit.client.0.smithi088.stdout:5/480: rename d3/d15/f5b to d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/fa3 0 2023-12-09T02:34:52.088 INFO:tasks.workunit.client.0.smithi088.stdout:8/533: creat d2/d9/d1a/d65/fbb x:0 0 0 2023-12-09T02:34:52.089 INFO:tasks.workunit.client.0.smithi088.stdout:2/486: mkdir d6/d20/da9 0 2023-12-09T02:34:52.089 INFO:tasks.workunit.client.0.smithi088.stdout:2/487: write d6/d8/d1f/d22/f52 [691324,120338] 0 2023-12-09T02:34:52.091 INFO:tasks.workunit.client.0.smithi088.stdout:6/502: rename d16/d1b/d25/d5f/c89 to d16/d1b/d2c/c95 0 2023-12-09T02:34:52.091 INFO:tasks.workunit.client.0.smithi088.stdout:5/481: symlink d3/d15/de/d10/d51/d7f/la4 0 2023-12-09T02:34:52.093 INFO:tasks.workunit.client.0.smithi088.stdout:2/488: creat d6/d8/d1f/faa x:0 0 0 2023-12-09T02:34:52.093 INFO:tasks.workunit.client.0.smithi088.stdout:8/534: write d2/d9/d1a/d62/d76/d85/f8c [3204118,6348] 0 2023-12-09T02:34:52.096 INFO:tasks.workunit.client.0.smithi088.stdout:3/406: dwrite d1/d9/d6f/d15/f27 [0,4194304] 0 2023-12-09T02:34:52.096 INFO:tasks.workunit.client.0.smithi088.stdout:7/482: rename dc/d21/d6b/d6d/c86 to dc/d21/d6b/d6d/da4/d3e/d97/cb4 0 2023-12-09T02:34:52.096 INFO:tasks.workunit.client.0.smithi088.stdout:7/483: fdatasync dc/d21/f61 0 2023-12-09T02:34:52.097 INFO:tasks.workunit.client.0.smithi088.stdout:3/407: write d1/d9/d6f/d6/ff [1620654,1747] 0 2023-12-09T02:34:52.099 INFO:tasks.workunit.client.0.smithi088.stdout:8/535: symlink d2/d9/d1a/d65/lbc 0 2023-12-09T02:34:52.101 INFO:tasks.workunit.client.0.smithi088.stdout:2/489: rename d6/d20/f90 to d6/d8/fab 0 2023-12-09T02:34:52.102 INFO:tasks.workunit.client.0.smithi088.stdout:7/484: truncate dc/d1b/f57 2359290 0 2023-12-09T02:34:52.105 INFO:tasks.workunit.client.0.smithi088.stdout:4/477: dwrite d3/dc/d1d/d40/f59 [0,4194304] 0 2023-12-09T02:34:52.105 INFO:tasks.workunit.client.0.smithi088.stdout:8/536: creat d2/d9/d1a/d62/d76/d85/fbd x:0 0 0 2023-12-09T02:34:52.106 INFO:tasks.workunit.client.0.smithi088.stdout:8/537: write d2/d9/d1a/d62/f61 [2237504,9473] 0 2023-12-09T02:34:52.107 INFO:tasks.workunit.client.0.smithi088.stdout:5/482: dwrite d3/d15/de/d10/d18/d19/d1b/d35/d42/f5e [0,4194304] 0 2023-12-09T02:34:52.107 INFO:tasks.workunit.client.0.smithi088.stdout:6/503: rename d16/d1b/c29 to d16/d35/d65/c96 0 2023-12-09T02:34:52.107 INFO:tasks.workunit.client.0.smithi088.stdout:6/504: truncate d16/d1b/d2c/f88 1036778 0 2023-12-09T02:34:52.108 INFO:tasks.workunit.client.0.smithi088.stdout:2/490: truncate d6/d8/f46 332166 0 2023-12-09T02:34:52.108 INFO:tasks.workunit.client.0.smithi088.stdout:2/491: readlink d6/d8/d4e/d47/l7a 0 2023-12-09T02:34:52.110 INFO:tasks.workunit.client.0.smithi088.stdout:7/485: creat dc/d21/d6b/d6d/fb5 x:0 0 0 2023-12-09T02:34:52.111 INFO:tasks.workunit.client.0.smithi088.stdout:8/538: dread d2/d9/d13/d15/f26 [0,4194304] 0 2023-12-09T02:34:52.111 INFO:tasks.workunit.client.0.smithi088.stdout:4/478: getdents d3/dc/d43/d83 0 2023-12-09T02:34:52.118 INFO:tasks.workunit.client.0.smithi088.stdout:8/539: dread d2/d9/d13/d15/f2d [0,4194304] 0 2023-12-09T02:34:52.119 INFO:tasks.workunit.client.0.smithi088.stdout:3/408: rename d1/d9/d6f/d22/d7f/c29 to d1/d9/d6f/d6/c84 0 2023-12-09T02:34:52.121 INFO:tasks.workunit.client.0.smithi088.stdout:2/492: getdents d6/d8/d4e/d64 0 2023-12-09T02:34:52.121 INFO:tasks.workunit.client.0.smithi088.stdout:2/493: stat d6/d8/d54/fa6 0 2023-12-09T02:34:52.121 INFO:tasks.workunit.client.0.smithi088.stdout:7/486: creat dc/d21/d6b/fb6 x:0 0 0 2023-12-09T02:34:52.122 INFO:tasks.workunit.client.0.smithi088.stdout:4/479: stat d3/dc/d43/d83/d37/c84 0 2023-12-09T02:34:52.123 INFO:tasks.workunit.client.0.smithi088.stdout:4/480: write d3/f4 [924199,13305] 0 2023-12-09T02:34:52.124 INFO:tasks.workunit.client.0.smithi088.stdout:5/483: dwrite d3/d15/de/d10/d51/d7f/f86 [0,4194304] 0 2023-12-09T02:34:52.124 INFO:tasks.workunit.client.0.smithi088.stdout:6/505: rename d16/d70 to d16/d35/d36/d97 0 2023-12-09T02:34:52.126 INFO:tasks.workunit.client.0.smithi088.stdout:3/409: truncate d1/d9/d6f/d6/f3f 1412553 0 2023-12-09T02:34:52.127 INFO:tasks.workunit.client.0.smithi088.stdout:6/506: write d16/f39 [2396750,74990] 0 2023-12-09T02:34:52.128 INFO:tasks.workunit.client.0.smithi088.stdout:2/494: unlink d6/d8/d4e/f74 0 2023-12-09T02:34:52.128 INFO:tasks.workunit.client.0.smithi088.stdout:2/495: chown d6/f1c 295 1 2023-12-09T02:34:52.128 INFO:tasks.workunit.client.0.smithi088.stdout:2/496: write d6/d8/d1f/d22/f40 [5166126,16656] 0 2023-12-09T02:34:52.130 INFO:tasks.workunit.client.0.smithi088.stdout:7/487: symlink dc/d21/d6b/d93/lb7 0 2023-12-09T02:34:52.134 INFO:tasks.workunit.client.0.smithi088.stdout:5/484: mkdir d3/d15/de/d10/d18/da5 0 2023-12-09T02:34:52.134 INFO:tasks.workunit.client.0.smithi088.stdout:5/485: chown d3/d15/de/d10/d18/d19/d1b/d35/d42/d47/c52 326591 1 2023-12-09T02:34:52.136 INFO:tasks.workunit.client.0.smithi088.stdout:4/481: rename d3/dc/d18/d29/f38 to d3/dc/d43/d83/d37/f98 0 2023-12-09T02:34:52.137 INFO:tasks.workunit.client.0.smithi088.stdout:3/410: mkdir d1/d9/d6f/d22/d7f/d81/d85 0 2023-12-09T02:34:52.141 INFO:tasks.workunit.client.0.smithi088.stdout:6/507: rename d16/d35/d36/d97/c7a to d16/d62/d87/d8a/d8c/c98 0 2023-12-09T02:34:52.144 INFO:tasks.workunit.client.0.smithi088.stdout:4/482: mkdir d3/dc/d43/d8c/d99 0 2023-12-09T02:34:52.144 INFO:tasks.workunit.client.0.smithi088.stdout:3/411: symlink d1/d9/d6f/d22/l86 0 2023-12-09T02:34:52.144 INFO:tasks.workunit.client.0.smithi088.stdout:8/540: dwrite d2/f54 [0,4194304] 0 2023-12-09T02:34:52.145 INFO:tasks.workunit.client.0.smithi088.stdout:8/541: write d2/d9/d13/d15/f26 [1504223,9513] 0 2023-12-09T02:34:52.145 INFO:tasks.workunit.client.0.smithi088.stdout:6/508: creat d16/f99 x:0 0 0 2023-12-09T02:34:52.145 INFO:tasks.workunit.client.0.smithi088.stdout:6/509: chown f15 111660 1 2023-12-09T02:34:52.146 INFO:tasks.workunit.client.0.smithi088.stdout:4/483: rmdir d3/dc/d18/d8d 39 2023-12-09T02:34:52.146 INFO:tasks.workunit.client.0.smithi088.stdout:7/488: dread dc/f47 [0,4194304] 0 2023-12-09T02:34:52.147 INFO:tasks.workunit.client.0.smithi088.stdout:7/489: write dc/d1b/f6e [1426445,23874] 0 2023-12-09T02:34:52.147 INFO:tasks.workunit.client.0.smithi088.stdout:3/412: truncate d1/d3e/f82 704078 0 2023-12-09T02:34:52.147 INFO:tasks.workunit.client.0.smithi088.stdout:7/490: dread dc/d21/d6b/d6d/da4/d38/d1e/f60 [0,4194304] 0 2023-12-09T02:34:52.147 INFO:tasks.workunit.client.0.smithi088.stdout:7/491: chown dc/d21/d6b/d6d/da4/d38/d1e/l28 0 1 2023-12-09T02:34:52.148 INFO:tasks.workunit.client.0.smithi088.stdout:8/542: dread d2/d9/d13/d1c/d5f/f90 [0,4194304] 0 2023-12-09T02:34:52.149 INFO:tasks.workunit.client.0.smithi088.stdout:6/510: mknod d16/d62/d6f/c9a 0 2023-12-09T02:34:52.149 INFO:tasks.workunit.client.0.smithi088.stdout:4/484: rmdir d3/dc/d43/d8c/d95 39 2023-12-09T02:34:52.151 INFO:tasks.workunit.client.0.smithi088.stdout:7/492: unlink dc/d21/d6b/d6d/da4/d3e/f7d 0 2023-12-09T02:34:52.152 INFO:tasks.workunit.client.0.smithi088.stdout:7/493: read dc/f15 [7872896,37192] 0 2023-12-09T02:34:52.152 INFO:tasks.workunit.client.0.smithi088.stdout:8/543: mkdir d2/d9/d70/d8f/da8/dbe 0 2023-12-09T02:34:52.153 INFO:tasks.workunit.client.0.smithi088.stdout:4/485: rename d3/dc/d18/d7b/d93 to d3/dc/d43/d8c/d9a 0 2023-12-09T02:34:52.154 INFO:tasks.workunit.client.0.smithi088.stdout:7/494: symlink dc/d21/d6b/d93/lb8 0 2023-12-09T02:34:52.154 INFO:tasks.workunit.client.0.smithi088.stdout:8/544: getdents d2/d9/d13/d1c 0 2023-12-09T02:34:52.156 INFO:tasks.workunit.client.0.smithi088.stdout:4/486: creat d3/dc/d43/d8c/f9b x:0 0 0 2023-12-09T02:34:52.156 INFO:tasks.workunit.client.0.smithi088.stdout:4/487: readlink d3/dc/d18/d7b/l64 0 2023-12-09T02:34:52.156 INFO:tasks.workunit.client.0.smithi088.stdout:4/488: fdatasync d3/dc/d43/d83/f2b 0 2023-12-09T02:34:52.157 INFO:tasks.workunit.client.0.smithi088.stdout:5/486: dwrite d3/d15/de/d10/f78 [0,4194304] 0 2023-12-09T02:34:52.157 INFO:tasks.workunit.client.0.smithi088.stdout:5/487: stat d3/d15/de/d10/d18/c46 0 2023-12-09T02:34:52.157 INFO:tasks.workunit.client.0.smithi088.stdout:4/489: creat d3/dc/d43/d8c/d95/f9c x:0 0 0 2023-12-09T02:34:52.161 INFO:tasks.workunit.client.0.smithi088.stdout:5/488: rename d3/d15/de/d10/d18/d19/d1b/d35/d42/f90 to d3/d15/de/d10/d18/d19/d1b/d35/d42/fa6 0 2023-12-09T02:34:52.163 INFO:tasks.workunit.client.0.smithi088.stdout:4/490: creat d3/dc/d1d/f9d x:0 0 0 2023-12-09T02:34:52.164 INFO:tasks.workunit.client.0.smithi088.stdout:4/491: fsync d3/dc/d43/d83/f25 0 2023-12-09T02:34:52.164 INFO:tasks.workunit.client.0.smithi088.stdout:6/511: dread d16/d1b/d2c/d3f/d41/f4b [0,4194304] 0 2023-12-09T02:34:52.165 INFO:tasks.workunit.client.0.smithi088.stdout:5/489: creat d3/fa7 x:0 0 0 2023-12-09T02:34:52.165 INFO:tasks.workunit.client.0.smithi088.stdout:7/495: dread dc/d21/d6b/d6d/da4/d38/ff [0,4194304] 0 2023-12-09T02:34:52.166 INFO:tasks.workunit.client.0.smithi088.stdout:6/512: symlink d16/d1b/d2c/d3f/l9b 0 2023-12-09T02:34:52.167 INFO:tasks.workunit.client.0.smithi088.stdout:5/490: mkdir d3/d15/de/d10/d18/d19/d1b/da8 0 2023-12-09T02:34:52.168 INFO:tasks.workunit.client.0.smithi088.stdout:4/492: dread d3/f4 [0,4194304] 0 2023-12-09T02:34:52.168 INFO:tasks.workunit.client.0.smithi088.stdout:4/493: fsync d3/dc/d18/d29/f60 0 2023-12-09T02:34:52.169 INFO:tasks.workunit.client.0.smithi088.stdout:7/496: rmdir dc/d21/d6b/d6d/da4/d38 39 2023-12-09T02:34:52.171 INFO:tasks.workunit.client.0.smithi088.stdout:5/491: unlink d3/d15/de/d10/d18/d19/d1b/d35/d42/d47/f6a 0 2023-12-09T02:34:52.174 INFO:tasks.workunit.client.0.smithi088.stdout:5/492: dread d3/d15/de/d10/d51/d7f/f82 [0,4194304] 0 2023-12-09T02:34:52.176 INFO:tasks.workunit.client.0.smithi088.stdout:7/497: mkdir dc/d21/d6b/d6d/d76/db9 0 2023-12-09T02:34:52.176 INFO:tasks.workunit.client.0.smithi088.stdout:7/498: fdatasync dc/d1b/d82/f84 0 2023-12-09T02:34:52.179 INFO:tasks.workunit.client.0.smithi088.stdout:3/413: getdents d1/d9/d6f/d22/d7f/d81 0 2023-12-09T02:34:52.181 INFO:tasks.workunit.client.0.smithi088.stdout:5/493: unlink d3/d15/de/d10/d18/d19/d20/l33 0 2023-12-09T02:34:52.181 INFO:tasks.workunit.client.0.smithi088.stdout:5/494: chown d3/d15/de/c66 2895090 1 2023-12-09T02:34:52.182 INFO:tasks.workunit.client.0.smithi088.stdout:3/414: mknod d1/d73/c87 0 2023-12-09T02:34:52.182 INFO:tasks.workunit.client.0.smithi088.stdout:3/415: truncate d1/d9/f37 330408 0 2023-12-09T02:34:52.183 INFO:tasks.workunit.client.0.smithi088.stdout:5/495: link d3/d15/dc/f2d d3/d15/de/d2c/fa9 0 2023-12-09T02:34:52.183 INFO:tasks.workunit.client.0.smithi088.stdout:5/496: readlink d3/d15/l2f 0 2023-12-09T02:34:52.183 INFO:tasks.workunit.client.0.smithi088.stdout:7/499: dread dc/d21/d6b/d6d/da4/f3c [0,4194304] 0 2023-12-09T02:34:52.184 INFO:tasks.workunit.client.0.smithi088.stdout:7/500: chown dc/d1b/d82/f84 3838337 1 2023-12-09T02:34:52.184 INFO:tasks.workunit.client.0.smithi088.stdout:7/501: truncate fb 5105552 0 2023-12-09T02:34:52.185 INFO:tasks.workunit.client.0.smithi088.stdout:3/416: rename d1/d9/d6f/d15/f2c to d1/d9/d6f/d22/d7f/d45/f88 0 2023-12-09T02:34:52.185 INFO:tasks.workunit.client.0.smithi088.stdout:7/502: rmdir dc/d21/d6b/d6d/da4/d38 39 2023-12-09T02:34:52.187 INFO:tasks.workunit.client.0.smithi088.stdout:7/503: mknod dc/d1b/d89/cba 0 2023-12-09T02:34:52.190 INFO:tasks.workunit.client.0.smithi088.stdout:7/504: mkdir dc/d21/d6b/dbb 0 2023-12-09T02:34:52.190 INFO:tasks.workunit.client.0.smithi088.stdout:7/505: write dc/f74 [1896384,111490] 0 2023-12-09T02:34:52.190 INFO:tasks.workunit.client.0.smithi088.stdout:9/442: sync 2023-12-09T02:34:52.190 INFO:tasks.workunit.client.0.smithi088.stdout:0/451: sync 2023-12-09T02:34:52.190 INFO:tasks.workunit.client.0.smithi088.stdout:1/579: sync 2023-12-09T02:34:52.190 INFO:tasks.workunit.client.0.smithi088.stdout:1/580: fsync d8/d27/d66/fb1 0 2023-12-09T02:34:52.191 INFO:tasks.workunit.client.0.smithi088.stdout:6/513: dwrite f14 [0,4194304] 0 2023-12-09T02:34:52.191 INFO:tasks.workunit.client.0.smithi088.stdout:6/514: write d16/d1b/f26 [512069,96585] 0 2023-12-09T02:34:52.191 INFO:tasks.workunit.client.0.smithi088.stdout:7/506: unlink dc/d21/f8f 0 2023-12-09T02:34:52.194 INFO:tasks.workunit.client.0.smithi088.stdout:9/443: rename df/d20/d4c/d71/d7c to df/d20/d5b/d91 0 2023-12-09T02:34:52.196 INFO:tasks.workunit.client.0.smithi088.stdout:6/515: mkdir d16/d1b/d2c/d3f/d9c 0 2023-12-09T02:34:52.197 INFO:tasks.workunit.client.0.smithi088.stdout:4/494: dwrite d3/dc/d1d/f3f [4194304,4194304] 0 2023-12-09T02:34:52.198 INFO:tasks.workunit.client.0.smithi088.stdout:4/495: read d3/dc/f28 [3222713,36595] 0 2023-12-09T02:34:52.199 INFO:tasks.workunit.client.0.smithi088.stdout:1/581: write d8/d27/d9a/fa3 [3931044,113380] 0 2023-12-09T02:34:52.199 INFO:tasks.workunit.client.0.smithi088.stdout:1/582: stat d8/f15 0 2023-12-09T02:34:52.203 INFO:tasks.workunit.client.0.smithi088.stdout:9/444: creat df/d29/f92 x:0 0 0 2023-12-09T02:34:52.205 INFO:tasks.workunit.client.0.smithi088.stdout:4/496: rename d3/dc/d43/d83/f4d to d3/dc/f9e 0 2023-12-09T02:34:52.209 INFO:tasks.workunit.client.0.smithi088.stdout:1/583: rmdir d8/d3d/d5d/d95/dac/db9/dba 0 2023-12-09T02:34:52.210 INFO:tasks.workunit.client.0.smithi088.stdout:1/584: write d8/d27/d40/f76 [616347,82661] 0 2023-12-09T02:34:52.212 INFO:tasks.workunit.client.0.smithi088.stdout:1/585: write d8/d3d/d5d/d95/f3f [633281,128074] 0 2023-12-09T02:34:52.214 INFO:tasks.workunit.client.0.smithi088.stdout:1/586: mkdir d8/d3d/d44/da4/dcb 0 2023-12-09T02:34:52.214 INFO:tasks.workunit.client.0.smithi088.stdout:1/587: fsync d8/d3d/d5d/d95/f39 0 2023-12-09T02:34:52.214 INFO:tasks.workunit.client.0.smithi088.stdout:6/516: dread d16/d1b/f51 [0,4194304] 0 2023-12-09T02:34:52.215 INFO:tasks.workunit.client.0.smithi088.stdout:1/588: chown d8/c16 1238502461 1 2023-12-09T02:34:52.215 INFO:tasks.workunit.client.0.smithi088.stdout:1/589: write d8/d53/f89 [992756,5591] 0 2023-12-09T02:34:52.220 INFO:tasks.workunit.client.0.smithi088.stdout:1/590: unlink d8/d59/cbd 0 2023-12-09T02:34:52.220 INFO:tasks.workunit.client.0.smithi088.stdout:6/517: readlink d16/d35/l3a 0 2023-12-09T02:34:52.220 INFO:tasks.workunit.client.0.smithi088.stdout:1/591: chown d8/d3d/d5d/d95/dac/fc6 1 1 2023-12-09T02:34:52.220 INFO:tasks.workunit.client.0.smithi088.stdout:1/592: dread - d8/d3d/d5d/faf zero size 2023-12-09T02:34:52.222 INFO:tasks.workunit.client.0.smithi088.stdout:6/518: rmdir d16/d62/d87/d8a/d8c 39 2023-12-09T02:34:52.225 INFO:tasks.workunit.client.0.smithi088.stdout:5/497: dwrite d3/d15/de/d10/d18/d19/d1b/d35/d42/f21 [0,4194304] 0 2023-12-09T02:34:52.225 INFO:tasks.workunit.client.0.smithi088.stdout:6/519: link d16/f31 d16/d1b/d2c/d3f/d83/f9d 0 2023-12-09T02:34:52.225 INFO:tasks.workunit.client.0.smithi088.stdout:6/520: stat d16/d35/d36/c7c 0 2023-12-09T02:34:52.225 INFO:tasks.workunit.client.0.smithi088.stdout:6/521: chown d16/d1b/d25 0 1 2023-12-09T02:34:52.225 INFO:tasks.workunit.client.0.smithi088.stdout:6/522: chown d16/d1b/d2c/d3f/d41 67671 1 2023-12-09T02:34:52.227 INFO:tasks.workunit.client.0.smithi088.stdout:5/498: creat d3/d15/de/d2c/faa x:0 0 0 2023-12-09T02:34:52.229 INFO:tasks.workunit.client.0.smithi088.stdout:5/499: mknod d3/d15/cab 0 2023-12-09T02:34:52.229 INFO:tasks.workunit.client.0.smithi088.stdout:5/500: readlink d3/d15/dc/l75 0 2023-12-09T02:34:52.229 INFO:tasks.workunit.client.0.smithi088.stdout:5/501: chown d3/d15/de/d2c/f44 0 1 2023-12-09T02:34:52.229 INFO:tasks.workunit.client.0.smithi088.stdout:5/502: chown d3/d15/dc/c6f 166905500 1 2023-12-09T02:34:52.229 INFO:tasks.workunit.client.0.smithi088.stdout:5/503: chown d3/d15/de/d2c/l6c 1 1 2023-12-09T02:34:52.229 INFO:tasks.workunit.client.0.smithi088.stdout:0/452: dwrite df/d10/d22/f6e [0,4194304] 0 2023-12-09T02:34:52.230 INFO:tasks.workunit.client.0.smithi088.stdout:5/504: creat d3/d15/de/d10/d18/d19/d20/fac x:0 0 0 2023-12-09T02:34:52.234 INFO:tasks.workunit.client.0.smithi088.stdout:0/453: creat df/d10/f93 x:0 0 0 2023-12-09T02:34:52.235 INFO:tasks.workunit.client.0.smithi088.stdout:5/505: unlink d3/d15/de/d10/d18/d19/d1b/f34 0 2023-12-09T02:34:52.236 INFO:tasks.workunit.client.0.smithi088.stdout:0/454: link df/l8e df/d10/d22/d2d/d3c/l94 0 2023-12-09T02:34:52.238 INFO:tasks.workunit.client.0.smithi088.stdout:5/506: rename c0 to d3/d15/de/d73/cad 0 2023-12-09T02:34:52.238 INFO:tasks.workunit.client.0.smithi088.stdout:5/507: chown d3/d15/de/d10/d18/d19/d1b/d35/d61/c72 22655665 1 2023-12-09T02:34:52.243 INFO:tasks.workunit.client.0.smithi088.stdout:4/497: dwrite d3/dc/d18/d29/f60 [0,4194304] 0 2023-12-09T02:34:52.243 INFO:tasks.workunit.client.0.smithi088.stdout:9/445: dwrite df/f2c [4194304,4194304] 0 2023-12-09T02:34:52.243 INFO:tasks.workunit.client.0.smithi088.stdout:5/508: dread d3/d15/de/f7b [0,4194304] 0 2023-12-09T02:34:52.244 INFO:tasks.workunit.client.0.smithi088.stdout:7/507: dwrite dc/d1b/d66/f8e [0,4194304] 0 2023-12-09T02:34:52.244 INFO:tasks.workunit.client.0.smithi088.stdout:7/508: dread - dc/d1b/f70 zero size 2023-12-09T02:34:52.245 INFO:tasks.workunit.client.0.smithi088.stdout:1/593: dwrite d8/d1b/d6d/f80 [0,4194304] 0 2023-12-09T02:34:52.245 INFO:tasks.workunit.client.0.smithi088.stdout:4/498: mkdir d3/dc/d1d/d40/d9f 0 2023-12-09T02:34:52.247 INFO:tasks.workunit.client.0.smithi088.stdout:9/446: rename df/d20/d30/d60/d5c/f26 to df/d29/d2f/f93 0 2023-12-09T02:34:52.247 INFO:tasks.workunit.client.0.smithi088.stdout:9/447: write df/d20/d5b/f8c [273504,45544] 0 2023-12-09T02:34:52.248 INFO:tasks.workunit.client.0.smithi088.stdout:5/509: symlink d3/d15/de/lae 0 2023-12-09T02:34:52.260 INFO:tasks.workunit.client.0.smithi088.stdout:1/594: creat d8/d27/d75/fcc x:0 0 0 2023-12-09T02:34:52.261 INFO:tasks.workunit.client.0.smithi088.stdout:4/499: creat d3/dc/d18/d29/fa0 x:0 0 0 2023-12-09T02:34:52.261 INFO:tasks.workunit.client.0.smithi088.stdout:4/500: truncate d3/dc/d1d/d40/f90 313024 0 2023-12-09T02:34:52.261 INFO:tasks.workunit.client.0.smithi088.stdout:4/501: chown f1 356 1 2023-12-09T02:34:52.261 INFO:tasks.workunit.client.0.smithi088.stdout:4/502: fdatasync d3/dc/d43/d83/f67 0 2023-12-09T02:34:52.262 INFO:tasks.workunit.client.0.smithi088.stdout:7/509: rename dc/d21/c11 to dc/d1b/d82/cbc 0 2023-12-09T02:34:52.262 INFO:tasks.workunit.client.0.smithi088.stdout:7/510: stat dc/d21/d6b/d6d/da4/f48 0 2023-12-09T02:34:52.262 INFO:tasks.workunit.client.0.smithi088.stdout:7/511: dread - dc/d21/d7f/f8b zero size 2023-12-09T02:34:52.263 INFO:tasks.workunit.client.0.smithi088.stdout:9/448: truncate df/d29/d2f/f3a 2697662 0 2023-12-09T02:34:52.265 INFO:tasks.workunit.client.0.smithi088.stdout:5/510: symlink d3/d15/de/d10/d51/laf 0 2023-12-09T02:34:52.265 INFO:tasks.workunit.client.0.smithi088.stdout:5/511: chown d3/d8 150610208 1 2023-12-09T02:34:52.266 INFO:tasks.workunit.client.0.smithi088.stdout:1/595: creat d8/d1b/d6d/d7c/fcd x:0 0 0 2023-12-09T02:34:52.266 INFO:tasks.workunit.client.0.smithi088.stdout:1/596: read - d8/d1c/d50/f72 zero size 2023-12-09T02:34:52.267 INFO:tasks.workunit.client.0.smithi088.stdout:4/503: creat d3/dc/d1d/d40/fa1 x:0 0 0 2023-12-09T02:34:52.267 INFO:tasks.workunit.client.0.smithi088.stdout:5/512: dread d3/d15/de/d10/d18/d19/d1b/d35/d42/f84 [0,4194304] 0 2023-12-09T02:34:52.268 INFO:tasks.workunit.client.0.smithi088.stdout:7/512: creat dc/d21/d6b/d9b/fbd x:0 0 0 2023-12-09T02:34:52.268 INFO:tasks.workunit.client.0.smithi088.stdout:5/513: write d3/d15/de/d10/d18/d19/d20/f43 [5556220,11782] 0 2023-12-09T02:34:52.269 INFO:tasks.workunit.client.0.smithi088.stdout:9/449: mknod df/d20/d30/d3f/d48/c94 0 2023-12-09T02:34:52.269 INFO:tasks.workunit.client.0.smithi088.stdout:1/597: mknod d8/d1b/d6d/cce 0 2023-12-09T02:34:52.269 INFO:tasks.workunit.client.0.smithi088.stdout:1/598: chown d8 104 1 2023-12-09T02:34:52.272 INFO:tasks.workunit.client.0.smithi088.stdout:7/513: truncate dc/d21/d6b/d6d/da4/d38/ff 2837074 0 2023-12-09T02:34:52.272 INFO:tasks.workunit.client.0.smithi088.stdout:4/504: write d3/dc/d43/d83/f3a [3079034,79058] 0 2023-12-09T02:34:52.272 INFO:tasks.workunit.client.0.smithi088.stdout:4/505: read - d3/dc/d43/d83/f55 zero size 2023-12-09T02:34:52.273 INFO:tasks.workunit.client.0.smithi088.stdout:5/514: symlink d3/d15/de/d73/d8e/d9a/lb0 0 2023-12-09T02:34:52.273 INFO:tasks.workunit.client.0.smithi088.stdout:1/599: mknod d8/d1c/dc9/ccf 0 2023-12-09T02:34:52.274 INFO:tasks.workunit.client.0.smithi088.stdout:1/600: chown d8/f19 386 1 2023-12-09T02:34:52.275 INFO:tasks.workunit.client.0.smithi088.stdout:7/514: unlink dc/d21/d6b/d6d/da4/d38/la6 0 2023-12-09T02:34:52.276 INFO:tasks.workunit.client.0.smithi088.stdout:4/506: mknod d3/dc/d43/d8c/d9a/ca2 0 2023-12-09T02:34:52.278 INFO:tasks.workunit.client.0.smithi088.stdout:5/515: creat d3/d15/de/d10/d18/da5/fb1 x:0 0 0 2023-12-09T02:34:52.280 INFO:tasks.workunit.client.0.smithi088.stdout:1/601: mknod d8/d1b/d6d/cd0 0 2023-12-09T02:34:52.282 INFO:tasks.workunit.client.0.smithi088.stdout:4/507: unlink d3/dc/d43/d83/f2b 0 2023-12-09T02:34:52.282 INFO:tasks.workunit.client.0.smithi088.stdout:9/450: dwrite df/d20/d5b/f8c [0,4194304] 0 2023-12-09T02:34:52.282 INFO:tasks.workunit.client.0.smithi088.stdout:8/545: sync 2023-12-09T02:34:52.282 INFO:tasks.workunit.client.0.smithi088.stdout:2/497: sync 2023-12-09T02:34:52.283 INFO:tasks.workunit.client.0.smithi088.stdout:4/508: chown d3/dc/d43/d83/d37/f98 10371689 1 2023-12-09T02:34:52.284 INFO:tasks.workunit.client.0.smithi088.stdout:5/516: mkdir d3/d15/dc/d60/db2 0 2023-12-09T02:34:52.285 INFO:tasks.workunit.client.0.smithi088.stdout:1/602: rename d8/d3d/d5d/d95/c37 to d8/d1c/d50/d6c/cd1 0 2023-12-09T02:34:52.290 INFO:tasks.workunit.client.0.smithi088.stdout:9/451: link df/f1a df/d20/d5b/f95 0 2023-12-09T02:34:52.290 INFO:tasks.workunit.client.0.smithi088.stdout:9/452: write df/d29/d2f/f3c [426390,99917] 0 2023-12-09T02:34:52.291 INFO:tasks.workunit.client.0.smithi088.stdout:8/546: symlink d2/d9/d1a/d62/d49/lbf 0 2023-12-09T02:34:52.292 INFO:tasks.workunit.client.0.smithi088.stdout:5/517: getdents d3/d15/de/d10/d18/d19/d1b/d35 0 2023-12-09T02:34:52.293 INFO:tasks.workunit.client.0.smithi088.stdout:1/603: symlink d8/d3d/d5d/d82/ld2 0 2023-12-09T02:34:52.295 INFO:tasks.workunit.client.0.smithi088.stdout:2/498: dread d6/d13/f1e [0,4194304] 0 2023-12-09T02:34:52.295 INFO:tasks.workunit.client.0.smithi088.stdout:2/499: fsync d6/d8/d73/d78/f8a 0 2023-12-09T02:34:52.295 INFO:tasks.workunit.client.0.smithi088.stdout:5/518: link d3/d15/de/d10/d18/d19/d20/f43 d3/d15/de/d73/d8e/d9a/fb3 0 2023-12-09T02:34:52.295 INFO:tasks.workunit.client.0.smithi088.stdout:5/519: dread - d3/d15/de/f40 zero size 2023-12-09T02:34:52.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/604: truncate d8/d3d/d5d/f8b 1509828 0 2023-12-09T02:34:52.297 INFO:tasks.workunit.client.0.smithi088.stdout:2/500: truncate d6/d8/d4e/f57 680016 0 2023-12-09T02:34:52.299 INFO:tasks.workunit.client.0.smithi088.stdout:8/547: dread d2/d9/d13/d15/fab [0,4194304] 0 2023-12-09T02:34:52.299 INFO:tasks.workunit.client.0.smithi088.stdout:1/605: creat d8/d27/d40/da5/fd3 x:0 0 0 2023-12-09T02:34:52.301 INFO:tasks.workunit.client.0.smithi088.stdout:8/548: creat d2/d9/fc0 x:0 0 0 2023-12-09T02:34:52.302 INFO:tasks.workunit.client.0.smithi088.stdout:1/606: unlink d8/d3d/d5d/d95/f4e 0 2023-12-09T02:34:52.302 INFO:tasks.workunit.client.0.smithi088.stdout:1/607: fsync d8/d1c/fbc 0 2023-12-09T02:34:52.303 INFO:tasks.workunit.client.0.smithi088.stdout:6/523: sync 2023-12-09T02:34:52.303 INFO:tasks.workunit.client.0.smithi088.stdout:3/417: sync 2023-12-09T02:34:52.303 INFO:tasks.workunit.client.0.smithi088.stdout:3/418: stat d1/d9/d6f/d22/d7f/d45/c3d 0 2023-12-09T02:34:52.304 INFO:tasks.workunit.client.0.smithi088.stdout:1/608: creat d8/d27/d40/da5/fd4 x:0 0 0 2023-12-09T02:34:52.308 INFO:tasks.workunit.client.0.smithi088.stdout:8/549: write d2/d9/d1a/f57 [497262,110554] 0 2023-12-09T02:34:52.308 INFO:tasks.workunit.client.0.smithi088.stdout:8/550: fdatasync d2/d9/d13/d15/faf 0 2023-12-09T02:34:52.308 INFO:tasks.workunit.client.0.smithi088.stdout:3/419: mkdir d1/d73/d89 0 2023-12-09T02:34:52.308 INFO:tasks.workunit.client.0.smithi088.stdout:3/420: fsync d1/d9/d6f/d22/d7f/d45/f80 0 2023-12-09T02:34:52.311 INFO:tasks.workunit.client.0.smithi088.stdout:3/421: unlink d1/d3e/f82 0 2023-12-09T02:34:52.314 INFO:tasks.workunit.client.0.smithi088.stdout:3/422: link d1/d9/d6f/d6/f11 d1/d9/d6f/d22/f8a 0 2023-12-09T02:34:52.314 INFO:tasks.workunit.client.0.smithi088.stdout:1/609: write d8/d3d/f4f [176480,63521] 0 2023-12-09T02:34:52.314 INFO:tasks.workunit.client.0.smithi088.stdout:1/610: write d8/d53/f89 [1730423,73332] 0 2023-12-09T02:34:52.315 INFO:tasks.workunit.client.0.smithi088.stdout:5/520: rename d3/d15/de/d73/d8e to d3/d15/de/d10/d51/db4 0 2023-12-09T02:34:52.317 INFO:tasks.workunit.client.0.smithi088.stdout:5/521: getdents d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a 0 2023-12-09T02:34:52.319 INFO:tasks.workunit.client.0.smithi088.stdout:5/522: rmdir d3/d15/de/d10/d18/d19/d1b/d35 39 2023-12-09T02:34:52.319 INFO:tasks.workunit.client.0.smithi088.stdout:5/523: fsync d3/fa7 0 2023-12-09T02:34:52.319 INFO:tasks.workunit.client.0.smithi088.stdout:5/524: truncate d3/d8/f9 360398 0 2023-12-09T02:34:52.319 INFO:tasks.workunit.client.0.smithi088.stdout:5/525: getdents d3/d15/de/d10/d18/d19/d1b/d35 0 2023-12-09T02:34:52.320 INFO:tasks.workunit.client.0.smithi088.stdout:5/526: symlink d3/d15/de/d10/d51/d7f/lb5 0 2023-12-09T02:34:52.322 INFO:tasks.workunit.client.0.smithi088.stdout:5/527: link d3/d15/f1f d3/d15/dc/d60/d9d/fb6 0 2023-12-09T02:34:52.327 INFO:tasks.workunit.client.0.smithi088.stdout:3/423: dread d1/d9/d6f/d22/f8a [0,4194304] 0 2023-12-09T02:34:52.329 INFO:tasks.workunit.client.0.smithi088.stdout:3/424: mkdir d1/d9/d6f/d6/d8b 0 2023-12-09T02:34:52.329 INFO:tasks.workunit.client.0.smithi088.stdout:3/425: write d1/d9/d6f/d15/f27 [4448497,125763] 0 2023-12-09T02:34:52.330 INFO:tasks.workunit.client.0.smithi088.stdout:3/426: creat d1/d9/d6f/d6/d83/f8c x:0 0 0 2023-12-09T02:34:52.339 INFO:tasks.workunit.client.0.smithi088.stdout:6/524: dwrite d16/d1b/d2c/f48 [4194304,4194304] 0 2023-12-09T02:34:52.340 INFO:tasks.workunit.client.0.smithi088.stdout:1/611: dwrite d8/d1c/d50/d6c/fb2 [0,4194304] 0 2023-12-09T02:34:52.340 INFO:tasks.workunit.client.0.smithi088.stdout:5/528: dwrite d3/d15/de/d10/d18/d19/d1b/f7e [0,4194304] 0 2023-12-09T02:34:52.344 INFO:tasks.workunit.client.0.smithi088.stdout:6/525: truncate d16/d1b/f26 338974 0 2023-12-09T02:34:52.344 INFO:tasks.workunit.client.0.smithi088.stdout:3/427: dread d1/d9/d6f/d15/f3a [0,4194304] 0 2023-12-09T02:34:52.347 INFO:tasks.workunit.client.0.smithi088.stdout:5/529: symlink d3/d15/de/d10/d51/db4/lb7 0 2023-12-09T02:34:52.347 INFO:tasks.workunit.client.0.smithi088.stdout:5/530: stat d3/d15/de 0 2023-12-09T02:34:52.348 INFO:tasks.workunit.client.0.smithi088.stdout:3/428: link d1/d9/d6f/d22/d7f/d45/c3d d1/d9/d6f/d6/d4a/d41/d33/c8d 0 2023-12-09T02:34:52.350 INFO:tasks.workunit.client.0.smithi088.stdout:5/531: creat d3/d15/de/d10/d18/da5/fb8 x:0 0 0 2023-12-09T02:34:52.352 INFO:tasks.workunit.client.0.smithi088.stdout:3/429: rename d1/d9/d6f/d6/d4a/d41/d33/c8d to d1/d9/d6f/d6/d4a/d41/c8e 0 2023-12-09T02:34:52.352 INFO:tasks.workunit.client.0.smithi088.stdout:3/430: stat d1/d9/d6f/d22/d7f/d45/f18 0 2023-12-09T02:34:52.354 INFO:tasks.workunit.client.0.smithi088.stdout:5/532: symlink d3/d15/de/d10/d18/d19/d1b/d35/d61/lb9 0 2023-12-09T02:34:52.354 INFO:tasks.workunit.client.0.smithi088.stdout:5/533: getdents d3/d15/de/d10/d18/d19/d1b/da8 0 2023-12-09T02:34:52.354 INFO:tasks.workunit.client.0.smithi088.stdout:5/534: chown d3/d15/de/d10/d18/d19/d20/f43 6287080 1 2023-12-09T02:34:52.356 INFO:tasks.workunit.client.0.smithi088.stdout:3/431: creat d1/d9/d6f/d6/d4a/d41/d33/f8f x:0 0 0 2023-12-09T02:34:52.358 INFO:tasks.workunit.client.0.smithi088.stdout:3/432: symlink d1/d9/d6f/d22/d7f/d81/d85/l90 0 2023-12-09T02:34:52.358 INFO:tasks.workunit.client.0.smithi088.stdout:0/455: sync 2023-12-09T02:34:52.362 INFO:tasks.workunit.client.0.smithi088.stdout:0/456: creat df/d28/f95 x:0 0 0 2023-12-09T02:34:52.362 INFO:tasks.workunit.client.0.smithi088.stdout:3/433: link d1/d9/l65 d1/d9/d6f/d6/d8b/l91 0 2023-12-09T02:34:52.362 INFO:tasks.workunit.client.0.smithi088.stdout:3/434: chown d1/fa 30373107 1 2023-12-09T02:34:52.365 INFO:tasks.workunit.client.0.smithi088.stdout:0/457: mkdir df/d10/d22/d2d/d96 0 2023-12-09T02:34:52.367 INFO:tasks.workunit.client.0.smithi088.stdout:0/458: mkdir df/d37/d97 0 2023-12-09T02:34:52.368 INFO:tasks.workunit.client.0.smithi088.stdout:0/459: read f6 [4804526,85220] 0 2023-12-09T02:34:52.369 INFO:tasks.workunit.client.0.smithi088.stdout:0/460: creat df/d37/d70/f98 x:0 0 0 2023-12-09T02:34:52.370 INFO:tasks.workunit.client.0.smithi088.stdout:0/461: creat df/d10/d22/d2d/d2e/f99 x:0 0 0 2023-12-09T02:34:52.372 INFO:tasks.workunit.client.0.smithi088.stdout:0/462: link df/d37/d70/c75 df/d10/d22/c9a 0 2023-12-09T02:34:52.373 INFO:tasks.workunit.client.0.smithi088.stdout:0/463: truncate df/f2c 10826123 0 2023-12-09T02:34:52.373 INFO:tasks.workunit.client.0.smithi088.stdout:0/464: fdatasync df/d10/f24 0 2023-12-09T02:34:52.377 INFO:tasks.workunit.client.0.smithi088.stdout:0/465: write df/d10/d22/f6e [863083,97985] 0 2023-12-09T02:34:52.377 INFO:tasks.workunit.client.0.smithi088.stdout:0/466: fsync df/d28/d43/f7c 0 2023-12-09T02:34:52.379 INFO:tasks.workunit.client.0.smithi088.stdout:0/467: mknod df/d28/d33/c9b 0 2023-12-09T02:34:52.382 INFO:tasks.workunit.client.0.smithi088.stdout:1/612: dwrite d8/d1b/d6d/f92 [0,4194304] 0 2023-12-09T02:34:52.384 INFO:tasks.workunit.client.0.smithi088.stdout:5/535: dwrite d3/d15/de/d10/d18/d19/d1b/f9b [0,4194304] 0 2023-12-09T02:34:52.384 INFO:tasks.workunit.client.0.smithi088.stdout:1/613: mknod d8/d1b/d6d/d7c/cd5 0 2023-12-09T02:34:52.384 INFO:tasks.workunit.client.0.smithi088.stdout:1/614: chown d8/d1b/d1d/dc7 3046 1 2023-12-09T02:34:52.384 INFO:tasks.workunit.client.0.smithi088.stdout:1/615: chown d8/d3d/l74 792 1 2023-12-09T02:34:52.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/536: link d3/d15/dc/d14/c96 d3/d15/de/d10/d18/d19/d1b/cba 0 2023-12-09T02:34:52.387 INFO:tasks.workunit.client.0.smithi088.stdout:1/616: mknod d8/d27/d66/d79/cd6 0 2023-12-09T02:34:52.387 INFO:tasks.workunit.client.0.smithi088.stdout:1/617: chown d8/d27/d40/fa7 5 1 2023-12-09T02:34:52.389 INFO:tasks.workunit.client.0.smithi088.stdout:6/526: dwrite d16/d1b/d56/f6c [0,4194304] 0 2023-12-09T02:34:52.403 INFO:tasks.workunit.client.0.smithi088.stdout:0/468: dwrite df/d10/d22/f54 [0,4194304] 0 2023-12-09T02:34:52.404 INFO:tasks.workunit.client.0.smithi088.stdout:0/469: link df/d28/d33/f56 df/d28/d33/f9c 0 2023-12-09T02:34:52.405 INFO:tasks.workunit.client.0.smithi088.stdout:3/435: dwrite d1/d9/d6f/d6/d4a/d41/d33/f63 [0,4194304] 0 2023-12-09T02:34:52.406 INFO:tasks.workunit.client.0.smithi088.stdout:3/436: dread - d1/d9/d6f/d6/d4a/f5b zero size 2023-12-09T02:34:52.406 INFO:tasks.workunit.client.0.smithi088.stdout:3/437: chown d1/d9/d6f/d6/l40 2396 1 2023-12-09T02:34:52.406 INFO:tasks.workunit.client.0.smithi088.stdout:3/438: chown d1/d9/d6f/d6/d72/f76 463569 1 2023-12-09T02:34:52.406 INFO:tasks.workunit.client.0.smithi088.stdout:0/470: mknod df/d37/c9d 0 2023-12-09T02:34:52.409 INFO:tasks.workunit.client.0.smithi088.stdout:5/537: dwrite d3/d15/de/d10/d18/d19/d1b/f9b [0,4194304] 0 2023-12-09T02:34:52.410 INFO:tasks.workunit.client.0.smithi088.stdout:3/439: unlink d1/d9/d6f/f2f 0 2023-12-09T02:34:52.414 INFO:tasks.workunit.client.0.smithi088.stdout:3/440: unlink d1/d9/d6f/d6/d4a/d41/d33/f8f 0 2023-12-09T02:34:52.414 INFO:tasks.workunit.client.0.smithi088.stdout:5/538: write d3/d15/de/d10/d18/d19/d1b/f32 [1869966,106919] 0 2023-12-09T02:34:52.417 INFO:tasks.workunit.client.0.smithi088.stdout:6/527: dwrite d16/d1b/d2c/d3f/d41/f4b [4194304,4194304] 0 2023-12-09T02:34:52.419 INFO:tasks.workunit.client.0.smithi088.stdout:6/528: symlink d16/d1b/d56/l9e 0 2023-12-09T02:34:52.422 INFO:tasks.workunit.client.0.smithi088.stdout:7/515: sync 2023-12-09T02:34:52.423 INFO:tasks.workunit.client.0.smithi088.stdout:4/509: sync 2023-12-09T02:34:52.423 INFO:tasks.workunit.client.0.smithi088.stdout:9/453: sync 2023-12-09T02:34:52.423 INFO:tasks.workunit.client.0.smithi088.stdout:9/454: chown df/d29/d2f/c78 260617 1 2023-12-09T02:34:52.424 INFO:tasks.workunit.client.0.smithi088.stdout:7/516: dread dc/d21/d6b/d6d/da4/d3e/f5a [0,4194304] 0 2023-12-09T02:34:52.424 INFO:tasks.workunit.client.0.smithi088.stdout:7/517: dread - dc/d21/d6b/d6d/da4/d3e/fb2 zero size 2023-12-09T02:34:52.424 INFO:tasks.workunit.client.0.smithi088.stdout:4/510: creat d3/dc/d43/d8c/fa3 x:0 0 0 2023-12-09T02:34:52.424 INFO:tasks.workunit.client.0.smithi088.stdout:9/455: stat df/d29/f33 0 2023-12-09T02:34:52.425 INFO:tasks.workunit.client.0.smithi088.stdout:7/518: link c3 dc/d21/d6b/d93/cbe 0 2023-12-09T02:34:52.425 INFO:tasks.workunit.client.0.smithi088.stdout:7/519: write dc/d21/d6b/d6d/fb5 [410114,106277] 0 2023-12-09T02:34:52.425 INFO:tasks.workunit.client.0.smithi088.stdout:7/520: truncate dc/d21/d6b/d6d/da4/d5d/fac 317948 0 2023-12-09T02:34:52.427 INFO:tasks.workunit.client.0.smithi088.stdout:4/511: truncate d3/dc/d43/d8c/d95/f7a 744990 0 2023-12-09T02:34:52.427 INFO:tasks.workunit.client.0.smithi088.stdout:9/456: symlink df/d20/d30/d3f/d48/l96 0 2023-12-09T02:34:52.427 INFO:tasks.workunit.client.0.smithi088.stdout:7/521: creat dc/d21/d6b/d9b/fbf x:0 0 0 2023-12-09T02:34:52.429 INFO:tasks.workunit.client.0.smithi088.stdout:9/457: unlink df/d50/d63/f88 0 2023-12-09T02:34:52.429 INFO:tasks.workunit.client.0.smithi088.stdout:5/539: dread d3/d15/de/d10/d18/d19/d1b/f32 [0,4194304] 0 2023-12-09T02:34:52.430 INFO:tasks.workunit.client.0.smithi088.stdout:9/458: mkdir df/d20/d4c/d97 0 2023-12-09T02:34:52.436 INFO:tasks.workunit.client.0.smithi088.stdout:0/471: dwrite df/d28/d33/f5a [0,4194304] 0 2023-12-09T02:34:52.440 INFO:tasks.workunit.client.0.smithi088.stdout:4/512: dread d3/dc/f96 [0,4194304] 0 2023-12-09T02:34:52.441 INFO:tasks.workunit.client.0.smithi088.stdout:0/472: read df/d10/d22/d2d/d3c/f47 [7160492,84919] 0 2023-12-09T02:34:52.441 INFO:tasks.workunit.client.0.smithi088.stdout:5/540: dread d3/f3d [0,4194304] 0 2023-12-09T02:34:52.441 INFO:tasks.workunit.client.0.smithi088.stdout:4/513: mkdir d3/dc/d18/d29/da4 0 2023-12-09T02:34:52.442 INFO:tasks.workunit.client.0.smithi088.stdout:4/514: chown d3/dc/f96 454853547 1 2023-12-09T02:34:52.442 INFO:tasks.workunit.client.0.smithi088.stdout:4/515: chown d3/dc/d18/d29/l81 34072972 1 2023-12-09T02:34:52.442 INFO:tasks.workunit.client.0.smithi088.stdout:0/473: rename df/f21 to df/d10/f9e 0 2023-12-09T02:34:52.443 INFO:tasks.workunit.client.0.smithi088.stdout:5/541: getdents d3/d15/de/d10/d51/d7f 0 2023-12-09T02:34:52.444 INFO:tasks.workunit.client.0.smithi088.stdout:4/516: creat d3/dc/d43/d8c/fa5 x:0 0 0 2023-12-09T02:34:52.445 INFO:tasks.workunit.client.0.smithi088.stdout:6/529: dwrite d16/f99 [0,4194304] 0 2023-12-09T02:34:52.445 INFO:tasks.workunit.client.0.smithi088.stdout:0/474: creat df/d28/f9f x:0 0 0 2023-12-09T02:34:52.446 INFO:tasks.workunit.client.0.smithi088.stdout:0/475: chown df/d28/d34/l4c 850 1 2023-12-09T02:34:52.446 INFO:tasks.workunit.client.0.smithi088.stdout:5/542: creat d3/d15/de/d10/d51/d70/fbb x:0 0 0 2023-12-09T02:34:52.448 INFO:tasks.workunit.client.0.smithi088.stdout:4/517: truncate d3/f39 2308548 0 2023-12-09T02:34:52.449 INFO:tasks.workunit.client.0.smithi088.stdout:9/459: dread df/d20/d4c/f56 [0,4194304] 0 2023-12-09T02:34:52.449 INFO:tasks.workunit.client.0.smithi088.stdout:9/460: write df/d20/d30/d52/f81 [1089050,46462] 0 2023-12-09T02:34:52.449 INFO:tasks.workunit.client.0.smithi088.stdout:7/522: dwrite dc/d1b/f4f [0,4194304] 0 2023-12-09T02:34:52.450 INFO:tasks.workunit.client.0.smithi088.stdout:7/523: stat dc/d1b/d66/fab 0 2023-12-09T02:34:52.451 INFO:tasks.workunit.client.0.smithi088.stdout:0/476: truncate df/d10/d22/d2d/d3c/f44 9026 0 2023-12-09T02:34:52.451 INFO:tasks.workunit.client.0.smithi088.stdout:0/477: truncate df/d10/d22/d2d/f8a 323084 0 2023-12-09T02:34:52.451 INFO:tasks.workunit.client.0.smithi088.stdout:0/478: chown df/d10/d22/d2d/d2e/f7e 3 1 2023-12-09T02:34:52.452 INFO:tasks.workunit.client.0.smithi088.stdout:5/543: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d58/d95/dbc 0 2023-12-09T02:34:52.452 INFO:tasks.workunit.client.0.smithi088.stdout:5/544: chown d3/d8 12 1 2023-12-09T02:34:52.452 INFO:tasks.workunit.client.0.smithi088.stdout:5/545: stat d3/d15/de/d10/d18/d19/d1b/d35/d58/d95 0 2023-12-09T02:34:52.458 INFO:tasks.workunit.client.0.smithi088.stdout:9/461: getdents df/d20/d30/d4e 0 2023-12-09T02:34:52.460 INFO:tasks.workunit.client.0.smithi088.stdout:7/524: mknod dc/d21/d6b/d93/cc0 0 2023-12-09T02:34:52.462 INFO:tasks.workunit.client.0.smithi088.stdout:6/530: link d16/d1b/d25/c3e d16/d62/d87/c9f 0 2023-12-09T02:34:52.462 INFO:tasks.workunit.client.0.smithi088.stdout:0/479: rmdir df/d28/d33 39 2023-12-09T02:34:52.466 INFO:tasks.workunit.client.0.smithi088.stdout:5/546: rename d3/d15/c4b to d3/d15/de/d2c/cbd 0 2023-12-09T02:34:52.469 INFO:tasks.workunit.client.0.smithi088.stdout:9/462: link df/d20/d30/d60/d5c/l1d df/d20/d4c/d97/l98 0 2023-12-09T02:34:52.471 INFO:tasks.workunit.client.0.smithi088.stdout:7/525: rmdir dc/d21/d6b/d6d 39 2023-12-09T02:34:52.471 INFO:tasks.workunit.client.0.smithi088.stdout:4/518: dwrite d3/dc/f12 [4194304,4194304] 0 2023-12-09T02:34:52.472 INFO:tasks.workunit.client.0.smithi088.stdout:6/531: creat d16/d1b/d56/fa0 x:0 0 0 2023-12-09T02:34:52.472 INFO:tasks.workunit.client.0.smithi088.stdout:6/532: stat d16/d1b/d2c/d3f/d41/d80/f81 0 2023-12-09T02:34:52.474 INFO:tasks.workunit.client.0.smithi088.stdout:5/547: rename d3/d15/de/d10/d51/db4/lb7 to d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/lbe 0 2023-12-09T02:34:52.475 INFO:tasks.workunit.client.0.smithi088.stdout:7/526: mkdir dc/d21/d6b/d6d/dc1 0 2023-12-09T02:34:52.476 INFO:tasks.workunit.client.0.smithi088.stdout:7/527: read dc/d21/d6b/d6d/fb5 [272019,70503] 0 2023-12-09T02:34:52.476 INFO:tasks.workunit.client.0.smithi088.stdout:7/528: dread - dc/d21/d7f/f8b zero size 2023-12-09T02:34:52.480 INFO:tasks.workunit.client.0.smithi088.stdout:4/519: link d3/dc/d1d/d40/c44 d3/dc/d18/ca6 0 2023-12-09T02:34:52.480 INFO:tasks.workunit.client.0.smithi088.stdout:0/480: dwrite df/d10/d22/d2d/d2e/f83 [0,4194304] 0 2023-12-09T02:34:52.483 INFO:tasks.workunit.client.0.smithi088.stdout:5/548: creat d3/d15/de/d10/d18/d19/fbf x:0 0 0 2023-12-09T02:34:52.483 INFO:tasks.workunit.client.0.smithi088.stdout:5/549: truncate d3/d15/de/d10/d51/d7f/f86 4658137 0 2023-12-09T02:34:52.483 INFO:tasks.workunit.client.0.smithi088.stdout:5/550: stat d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/fa3 0 2023-12-09T02:34:52.483 INFO:tasks.workunit.client.0.smithi088.stdout:5/551: readlink d3/d15/dc/l89 0 2023-12-09T02:34:52.485 INFO:tasks.workunit.client.0.smithi088.stdout:7/529: symlink dc/d21/d6b/d6d/da4/d3e/lc2 0 2023-12-09T02:34:52.485 INFO:tasks.workunit.client.0.smithi088.stdout:7/530: fdatasync dc/d1b/f70 0 2023-12-09T02:34:52.486 INFO:tasks.workunit.client.0.smithi088.stdout:4/520: symlink d3/dc/d7d/la7 0 2023-12-09T02:34:52.491 INFO:tasks.workunit.client.0.smithi088.stdout:5/552: unlink d3/d15/de/d10/f80 0 2023-12-09T02:34:52.492 INFO:tasks.workunit.client.0.smithi088.stdout:6/533: dwrite d16/f1c [0,4194304] 0 2023-12-09T02:34:52.494 INFO:tasks.workunit.client.0.smithi088.stdout:7/531: unlink dc/d21/d6b/d6d/da4/d38/d1e/l28 0 2023-12-09T02:34:52.494 INFO:tasks.workunit.client.0.smithi088.stdout:4/521: creat d3/dc/d43/d8c/d99/fa8 x:0 0 0 2023-12-09T02:34:52.495 INFO:tasks.workunit.client.0.smithi088.stdout:2/501: sync 2023-12-09T02:34:52.495 INFO:tasks.workunit.client.0.smithi088.stdout:2/502: chown d6/d13/d18/f19 205169 1 2023-12-09T02:34:52.495 INFO:tasks.workunit.client.0.smithi088.stdout:2/503: fdatasync d6/f55 0 2023-12-09T02:34:52.496 INFO:tasks.workunit.client.0.smithi088.stdout:2/504: write d6/d13/d18/f19 [937022,20469] 0 2023-12-09T02:34:52.498 INFO:tasks.workunit.client.0.smithi088.stdout:7/532: rename dc/d21/d6b/f78 to dc/fc3 0 2023-12-09T02:34:52.499 INFO:tasks.workunit.client.0.smithi088.stdout:4/522: truncate d3/d65/f74 986231 0 2023-12-09T02:34:52.500 INFO:tasks.workunit.client.0.smithi088.stdout:6/534: dread d16/d1b/d2c/d60/f74 [0,4194304] 0 2023-12-09T02:34:52.502 INFO:tasks.workunit.client.0.smithi088.stdout:2/505: rmdir d6/d8/d1f 39 2023-12-09T02:34:52.503 INFO:tasks.workunit.client.0.smithi088.stdout:4/523: mkdir d3/dc/d18/da9 0 2023-12-09T02:34:52.504 INFO:tasks.workunit.client.0.smithi088.stdout:2/506: creat d6/d20/d3d/fac x:0 0 0 2023-12-09T02:34:52.506 INFO:tasks.workunit.client.0.smithi088.stdout:6/535: mknod d16/d62/d6f/ca1 0 2023-12-09T02:34:52.506 INFO:tasks.workunit.client.0.smithi088.stdout:6/536: fdatasync d16/d35/d36/d97/d90/f7d 0 2023-12-09T02:34:52.506 INFO:tasks.workunit.client.0.smithi088.stdout:7/533: dread dc/d1b/d82/f84 [0,4194304] 0 2023-12-09T02:34:52.506 INFO:tasks.workunit.client.0.smithi088.stdout:7/534: dread - dc/d21/d6b/d6d/fad zero size 2023-12-09T02:34:52.507 INFO:tasks.workunit.client.0.smithi088.stdout:6/537: creat d16/d1b/d56/fa2 x:0 0 0 2023-12-09T02:34:52.507 INFO:tasks.workunit.client.0.smithi088.stdout:4/524: write d3/dc/d43/d83/d37/f98 [21578,61969] 0 2023-12-09T02:34:52.507 INFO:tasks.workunit.client.0.smithi088.stdout:4/525: dread - d3/f76 zero size 2023-12-09T02:34:52.507 INFO:tasks.workunit.client.0.smithi088.stdout:7/535: mkdir dc/d1b/d72/dc4 0 2023-12-09T02:34:52.507 INFO:tasks.workunit.client.0.smithi088.stdout:7/536: rename dc to dc/d21/d6b/d6d/dc5 22 2023-12-09T02:34:52.507 INFO:tasks.workunit.client.0.smithi088.stdout:6/538: fsync d16/d35/f6a 0 2023-12-09T02:34:52.508 INFO:tasks.workunit.client.0.smithi088.stdout:4/526: rmdir d3/dc/d18 39 2023-12-09T02:34:52.508 INFO:tasks.workunit.client.0.smithi088.stdout:0/481: dwrite df/d10/d22/f6e [4194304,4194304] 0 2023-12-09T02:34:52.509 INFO:tasks.workunit.client.0.smithi088.stdout:7/537: unlink dc/d21/d6b/d6d/c99 0 2023-12-09T02:34:52.514 INFO:tasks.workunit.client.0.smithi088.stdout:5/553: dwrite d3/d15/de/d10/d18/da5/fb8 [0,4194304] 0 2023-12-09T02:34:52.514 INFO:tasks.workunit.client.0.smithi088.stdout:2/507: dread d6/d8/f1a [0,4194304] 0 2023-12-09T02:34:52.518 INFO:tasks.workunit.client.0.smithi088.stdout:5/554: dread d3/d15/de/d10/d18/f57 [0,4194304] 0 2023-12-09T02:34:52.582 INFO:tasks.workunit.client.0.smithi088.stdout:6/539: rename d16/d35/d65/f73 to d16/d35/d36/fa3 0 2023-12-09T02:34:52.582 INFO:tasks.workunit.client.0.smithi088.stdout:6/540: dread d16/d35/f5d [0,4194304] 0 2023-12-09T02:34:52.583 INFO:tasks.workunit.client.0.smithi088.stdout:6/541: dread - d16/d1b/d2c/d3f/f61 zero size 2023-12-09T02:34:52.583 INFO:tasks.workunit.client.0.smithi088.stdout:4/527: mkdir d3/dc/d43/d8c/d95/daa 0 2023-12-09T02:34:52.583 INFO:tasks.workunit.client.0.smithi088.stdout:4/528: write d3/dc/d43/d8c/fa5 [191524,15571] 0 2023-12-09T02:34:52.583 INFO:tasks.workunit.client.0.smithi088.stdout:4/529: chown d3/dc/d7d/f8e 6808 1 2023-12-09T02:34:52.590 INFO:tasks.workunit.client.0.smithi088.stdout:7/538: dwrite dc/d21/d7f/f8b [0,4194304] 0 2023-12-09T02:34:52.590 INFO:tasks.workunit.client.0.smithi088.stdout:7/539: chown dc/d21/d6b/d6d/f7e 7 1 2023-12-09T02:34:52.590 INFO:tasks.workunit.client.0.smithi088.stdout:7/540: stat dc/d21/f8c 0 2023-12-09T02:34:52.590 INFO:tasks.workunit.client.0.smithi088.stdout:0/482: dwrite df/d10/f29 [0,4194304] 0 2023-12-09T02:34:52.616 INFO:tasks.workunit.client.0.smithi088.stdout:5/555: creat d3/d15/de/d10/d18/d19/d1b/d35/d58/d95/fc0 x:0 0 0 2023-12-09T02:34:52.616 INFO:tasks.workunit.client.0.smithi088.stdout:1/618: sync 2023-12-09T02:34:52.616 INFO:tasks.workunit.client.0.smithi088.stdout:8/551: sync 2023-12-09T02:34:52.616 INFO:tasks.workunit.client.0.smithi088.stdout:3/441: sync 2023-12-09T02:34:52.616 INFO:tasks.workunit.client.0.smithi088.stdout:8/552: dread - d2/d9/d1a/d62/d49/fb8 zero size 2023-12-09T02:34:52.616 INFO:tasks.workunit.client.0.smithi088.stdout:2/508: dread f4 [0,4194304] 0 2023-12-09T02:34:52.617 INFO:tasks.workunit.client.0.smithi088.stdout:4/530: mkdir d3/dc/d18/dab 0 2023-12-09T02:34:52.617 INFO:tasks.workunit.client.0.smithi088.stdout:4/531: truncate d3/dc/d43/d8c/d95/f9c 604459 0 2023-12-09T02:34:52.624 INFO:tasks.workunit.client.0.smithi088.stdout:0/483: getdents df/d28/d33 0 2023-12-09T02:34:52.626 INFO:tasks.workunit.client.0.smithi088.stdout:5/556: getdents d3/d15/dc/d60/d9d 0 2023-12-09T02:34:52.627 INFO:tasks.workunit.client.0.smithi088.stdout:1/619: dread d8/d27/d9a/fa3 [0,4194304] 0 2023-12-09T02:34:52.627 INFO:tasks.workunit.client.0.smithi088.stdout:1/620: readlink d8/d1c/l56 0 2023-12-09T02:34:52.627 INFO:tasks.workunit.client.0.smithi088.stdout:1/621: write d8/d1c/d50/f7f [950327,93058] 0 2023-12-09T02:34:52.627 INFO:tasks.workunit.client.0.smithi088.stdout:5/557: write d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/f5f [2436046,42673] 0 2023-12-09T02:34:52.627 INFO:tasks.workunit.client.0.smithi088.stdout:5/558: chown d3/d15/de/d10/d18/da5 1756142495 1 2023-12-09T02:34:52.627 INFO:tasks.workunit.client.0.smithi088.stdout:8/553: creat d2/d9/fc1 x:0 0 0 2023-12-09T02:34:52.628 INFO:tasks.workunit.client.0.smithi088.stdout:2/509: unlink d6/d8/d4e/d47/f8d 0 2023-12-09T02:34:52.628 INFO:tasks.workunit.client.0.smithi088.stdout:2/510: write d6/d13/d18/f32 [2114680,15023] 0 2023-12-09T02:34:52.628 INFO:tasks.workunit.client.0.smithi088.stdout:2/511: chown d6/d20/c2d 0 1 2023-12-09T02:34:52.628 INFO:tasks.workunit.client.0.smithi088.stdout:2/512: readlink d6/d8/d4e/d64/l8b 0 2023-12-09T02:34:52.629 INFO:tasks.workunit.client.0.smithi088.stdout:4/532: truncate d3/dc/d18/d29/f3b 2269078 0 2023-12-09T02:34:52.630 INFO:tasks.workunit.client.0.smithi088.stdout:0/484: mkdir df/d10/d22/da0 0 2023-12-09T02:34:52.630 INFO:tasks.workunit.client.0.smithi088.stdout:1/622: mknod d8/d3d/d44/d49/cd7 0 2023-12-09T02:34:52.633 INFO:tasks.workunit.client.0.smithi088.stdout:1/623: fsync d8/d1b/fb3 0 2023-12-09T02:34:52.633 INFO:tasks.workunit.client.0.smithi088.stdout:1/624: fdatasync d8/d1c/d50/f78 0 2023-12-09T02:34:52.633 INFO:tasks.workunit.client.0.smithi088.stdout:1/625: dread - d8/d3d/d5d/faf zero size 2023-12-09T02:34:52.634 INFO:tasks.workunit.client.0.smithi088.stdout:3/442: dwrite d1/d9/d6f/d6/d4a/f53 [0,4194304] 0 2023-12-09T02:34:52.634 INFO:tasks.workunit.client.0.smithi088.stdout:6/542: dread d16/d35/f76 [0,4194304] 0 2023-12-09T02:34:52.634 INFO:tasks.workunit.client.0.smithi088.stdout:3/443: chown d1/d73 1308 1 2023-12-09T02:34:52.634 INFO:tasks.workunit.client.0.smithi088.stdout:8/554: mkdir d2/d9/d70/d8f/dc2 0 2023-12-09T02:34:52.634 INFO:tasks.workunit.client.0.smithi088.stdout:5/559: symlink d3/d15/de/d10/d18/d19/d1b/d35/d58/d95/dbc/lc1 0 2023-12-09T02:34:52.634 INFO:tasks.workunit.client.0.smithi088.stdout:5/560: chown d3/d15/de/d10/d18/f4e 821 1 2023-12-09T02:34:52.634 INFO:tasks.workunit.client.0.smithi088.stdout:5/561: fdatasync d3/d15/de/d10/d18/da5/fb1 0 2023-12-09T02:34:52.635 INFO:tasks.workunit.client.0.smithi088.stdout:0/485: write df/d28/d34/f48 [790236,127467] 0 2023-12-09T02:34:52.635 INFO:tasks.workunit.client.0.smithi088.stdout:0/486: chown df/d10/f69 13459235 1 2023-12-09T02:34:52.635 INFO:tasks.workunit.client.0.smithi088.stdout:0/487: dread - df/d10/d22/f6f zero size 2023-12-09T02:34:52.635 INFO:tasks.workunit.client.0.smithi088.stdout:8/555: write d2/d9/d13/d1c/f3a [3822262,72272] 0 2023-12-09T02:34:52.640 INFO:tasks.workunit.client.0.smithi088.stdout:0/488: dread df/f57 [0,4194304] 0 2023-12-09T02:34:52.641 INFO:tasks.workunit.client.0.smithi088.stdout:4/533: creat d3/fac x:0 0 0 2023-12-09T02:34:52.641 INFO:tasks.workunit.client.0.smithi088.stdout:1/626: rmdir d8/d27 39 2023-12-09T02:34:52.641 INFO:tasks.workunit.client.0.smithi088.stdout:1/627: read - d8/d1b/d6d/d7c/fcd zero size 2023-12-09T02:34:52.641 INFO:tasks.workunit.client.0.smithi088.stdout:3/444: dread d1/d9/d6f/d6/f11 [0,4194304] 0 2023-12-09T02:34:52.642 INFO:tasks.workunit.client.0.smithi088.stdout:4/534: write d3/f39 [1579275,96705] 0 2023-12-09T02:34:52.642 INFO:tasks.workunit.client.0.smithi088.stdout:4/535: readlink d3/dc/d18/d29/l81 0 2023-12-09T02:34:52.643 INFO:tasks.workunit.client.0.smithi088.stdout:9/463: sync 2023-12-09T02:34:52.644 INFO:tasks.workunit.client.0.smithi088.stdout:2/513: mkdir d6/d20/d3a/d94/dad 0 2023-12-09T02:34:52.645 INFO:tasks.workunit.client.0.smithi088.stdout:3/445: dread d1/d9/f37 [0,4194304] 0 2023-12-09T02:34:52.645 INFO:tasks.workunit.client.0.smithi088.stdout:0/489: symlink df/d10/d22/d2d/la1 0 2023-12-09T02:34:52.648 INFO:tasks.workunit.client.0.smithi088.stdout:2/514: dread d6/d20/d3d/f61 [0,4194304] 0 2023-12-09T02:34:52.648 INFO:tasks.workunit.client.0.smithi088.stdout:2/515: fsync d6/d13/f15 0 2023-12-09T02:34:52.648 INFO:tasks.workunit.client.0.smithi088.stdout:2/516: dread - d6/d8/d1f/d22/d68/fa5 zero size 2023-12-09T02:34:52.648 INFO:tasks.workunit.client.0.smithi088.stdout:0/490: dread df/d10/f1e [0,4194304] 0 2023-12-09T02:34:52.648 INFO:tasks.workunit.client.0.smithi088.stdout:0/491: write df/d10/d22/d2d/d2e/f7e [280193,121905] 0 2023-12-09T02:34:52.648 INFO:tasks.workunit.client.0.smithi088.stdout:1/628: symlink d8/d3d/d5d/ld8 0 2023-12-09T02:34:52.651 INFO:tasks.workunit.client.0.smithi088.stdout:4/536: mknod d3/dc/d1d/d40/d9f/cad 0 2023-12-09T02:34:52.652 INFO:tasks.workunit.client.0.smithi088.stdout:9/464: truncate df/d20/d5b/d91/f8b 3363860 0 2023-12-09T02:34:52.653 INFO:tasks.workunit.client.0.smithi088.stdout:3/446: symlink d1/d3e/l92 0 2023-12-09T02:34:52.655 INFO:tasks.workunit.client.0.smithi088.stdout:2/517: creat d6/d20/d69/fae x:0 0 0 2023-12-09T02:34:52.656 INFO:tasks.workunit.client.0.smithi088.stdout:4/537: dread d3/f4 [0,4194304] 0 2023-12-09T02:34:52.656 INFO:tasks.workunit.client.0.smithi088.stdout:0/492: mknod df/d28/ca2 0 2023-12-09T02:34:52.656 INFO:tasks.workunit.client.0.smithi088.stdout:1/629: dread d8/d1c/f28 [4194304,4194304] 0 2023-12-09T02:34:52.657 INFO:tasks.workunit.client.0.smithi088.stdout:9/465: write df/d29/f6a [254581,97438] 0 2023-12-09T02:34:52.658 INFO:tasks.workunit.client.0.smithi088.stdout:4/538: creat d3/dc/d43/fae x:0 0 0 2023-12-09T02:34:52.658 INFO:tasks.workunit.client.0.smithi088.stdout:0/493: read df/d28/d33/f9c [434545,71972] 0 2023-12-09T02:34:52.658 INFO:tasks.workunit.client.0.smithi088.stdout:0/494: fdatasync df/d28/d43/f4f 0 2023-12-09T02:34:52.659 INFO:tasks.workunit.client.0.smithi088.stdout:2/518: creat d6/d20/d3a/d84/faf x:0 0 0 2023-12-09T02:34:52.659 INFO:tasks.workunit.client.0.smithi088.stdout:2/519: chown d6/d8/f10 62 1 2023-12-09T02:34:52.660 INFO:tasks.workunit.client.0.smithi088.stdout:9/466: getdents df/d50 0 2023-12-09T02:34:52.661 INFO:tasks.workunit.client.0.smithi088.stdout:3/447: dread d1/d9/d6f/d6/f36 [0,4194304] 0 2023-12-09T02:34:52.662 INFO:tasks.workunit.client.0.smithi088.stdout:4/539: link d3/dc/d43/d83/c5e d3/dc/d18/d29/da4/caf 0 2023-12-09T02:34:52.662 INFO:tasks.workunit.client.0.smithi088.stdout:0/495: creat df/fa3 x:0 0 0 2023-12-09T02:34:52.663 INFO:tasks.workunit.client.0.smithi088.stdout:1/630: mkdir d8/dd9 0 2023-12-09T02:34:52.664 INFO:tasks.workunit.client.0.smithi088.stdout:3/448: link d1/d9/d6f/d22/d7f/l7c d1/d9/d6f/d2d/d66/l93 0 2023-12-09T02:34:52.667 INFO:tasks.workunit.client.0.smithi088.stdout:5/562: dwrite d3/d15/de/d10/d18/d19/d1b/f1c [0,4194304] 0 2023-12-09T02:34:52.667 INFO:tasks.workunit.client.0.smithi088.stdout:5/563: truncate d3/d8/f8d 941311 0 2023-12-09T02:34:52.667 INFO:tasks.workunit.client.0.smithi088.stdout:6/543: dwrite d16/d35/d36/f6b [0,4194304] 0 2023-12-09T02:34:52.667 INFO:tasks.workunit.client.0.smithi088.stdout:3/449: write d1/d9/d6f/d6/d4a/d41/d33/f63 [4046262,118970] 0 2023-12-09T02:34:52.668 INFO:tasks.workunit.client.0.smithi088.stdout:0/496: mknod df/d10/d22/d2d/ca4 0 2023-12-09T02:34:52.668 INFO:tasks.workunit.client.0.smithi088.stdout:2/520: rename d6/d8/d1f/d22/d68/f9c to d6/d20/d3a/fb0 0 2023-12-09T02:34:52.668 INFO:tasks.workunit.client.0.smithi088.stdout:6/544: dread d16/d1b/f26 [0,4194304] 0 2023-12-09T02:34:52.673 INFO:tasks.workunit.client.0.smithi088.stdout:3/450: getdents d1/d73 0 2023-12-09T02:34:52.673 INFO:tasks.workunit.client.0.smithi088.stdout:3/451: fdatasync d1/d9/d6f/d6/f7b 0 2023-12-09T02:34:52.676 INFO:tasks.workunit.client.0.smithi088.stdout:0/497: rename df/d10/d22/l23 to df/d10/d22/la5 0 2023-12-09T02:34:52.676 INFO:tasks.workunit.client.0.smithi088.stdout:0/498: read - df/fa3 zero size 2023-12-09T02:34:52.676 INFO:tasks.workunit.client.0.smithi088.stdout:0/499: truncate df/d28/d33/f56 4566978 0 2023-12-09T02:34:52.676 INFO:tasks.workunit.client.0.smithi088.stdout:0/500: getdents df/d10/d22/d2d/d96 0 2023-12-09T02:34:52.678 INFO:tasks.workunit.client.0.smithi088.stdout:2/521: symlink d6/d8/d73/d78/lb1 0 2023-12-09T02:34:52.678 INFO:tasks.workunit.client.0.smithi088.stdout:1/631: dwrite d8/d3d/f51 [0,4194304] 0 2023-12-09T02:34:52.680 INFO:tasks.workunit.client.0.smithi088.stdout:3/452: link d1/d9/d6f/d22/d7f/d45/f80 d1/d9/d6f/d22/d7f/d81/f94 0 2023-12-09T02:34:52.680 INFO:tasks.workunit.client.0.smithi088.stdout:5/564: dread d3/d15/de/d10/d18/da5/fb8 [0,4194304] 0 2023-12-09T02:34:52.681 INFO:tasks.workunit.client.0.smithi088.stdout:2/522: mkdir d6/d20/d69/db2 0 2023-12-09T02:34:52.682 INFO:tasks.workunit.client.0.smithi088.stdout:2/523: write d6/d20/d3d/f4a [4139991,51239] 0 2023-12-09T02:34:52.685 INFO:tasks.workunit.client.0.smithi088.stdout:4/540: rmdir d3/dc/d43 39 2023-12-09T02:34:52.685 INFO:tasks.workunit.client.0.smithi088.stdout:4/541: readlink d3/dc/d7d/l85 0 2023-12-09T02:34:52.687 INFO:tasks.workunit.client.0.smithi088.stdout:6/545: dwrite d16/d1b/d25/f27 [0,4194304] 0 2023-12-09T02:34:52.687 INFO:tasks.workunit.client.0.smithi088.stdout:6/546: dread - d16/d62/f8e zero size 2023-12-09T02:34:52.688 INFO:tasks.workunit.client.0.smithi088.stdout:1/632: rename d8/d53/lab to d8/d1b/d6d/d7c/dc0/lda 0 2023-12-09T02:34:52.690 INFO:tasks.workunit.client.0.smithi088.stdout:3/453: creat d1/d9/d6f/d6/d8b/f95 x:0 0 0 2023-12-09T02:34:52.691 INFO:tasks.workunit.client.0.smithi088.stdout:5/565: creat d3/d15/de/d10/d18/fc2 x:0 0 0 2023-12-09T02:34:52.694 INFO:tasks.workunit.client.0.smithi088.stdout:2/524: mkdir d6/d13/db3 0 2023-12-09T02:34:52.697 INFO:tasks.workunit.client.0.smithi088.stdout:1/633: getdents d8/d27/d40 0 2023-12-09T02:34:52.699 INFO:tasks.workunit.client.0.smithi088.stdout:3/454: creat d1/d9/d6f/d22/f96 x:0 0 0 2023-12-09T02:34:52.699 INFO:tasks.workunit.client.0.smithi088.stdout:3/455: readlink d1/d9/l4b 0 2023-12-09T02:34:52.699 INFO:tasks.workunit.client.0.smithi088.stdout:3/456: chown d1/d9/d6f/d15/f27 223446 1 2023-12-09T02:34:52.700 INFO:tasks.workunit.client.0.smithi088.stdout:1/634: read d8/d1c/f5a [64157,90817] 0 2023-12-09T02:34:52.700 INFO:tasks.workunit.client.0.smithi088.stdout:4/542: mkdir d3/d65/db0 0 2023-12-09T02:34:52.700 INFO:tasks.workunit.client.0.smithi088.stdout:4/543: dread - d3/dc/d18/d29/f6e zero size 2023-12-09T02:34:52.701 INFO:tasks.workunit.client.0.smithi088.stdout:3/457: unlink d1/d9/c1e 0 2023-12-09T02:34:52.702 INFO:tasks.workunit.client.0.smithi088.stdout:0/501: dwrite df/d28/d33/f5a [4194304,4194304] 0 2023-12-09T02:34:52.702 INFO:tasks.workunit.client.0.smithi088.stdout:0/502: chown df/d10/d22/l90 5327 1 2023-12-09T02:34:52.707 INFO:tasks.workunit.client.0.smithi088.stdout:0/503: read df/d10/f29 [1252441,79149] 0 2023-12-09T02:34:52.707 INFO:tasks.workunit.client.0.smithi088.stdout:0/504: fsync df/d10/d22/d2d/f8d 0 2023-12-09T02:34:52.707 INFO:tasks.workunit.client.0.smithi088.stdout:0/505: write df/d28/d33/f56 [5443107,56230] 0 2023-12-09T02:34:52.709 INFO:tasks.workunit.client.0.smithi088.stdout:0/506: write df/d10/d22/d2d/f4b [1600114,32188] 0 2023-12-09T02:34:52.710 INFO:tasks.workunit.client.0.smithi088.stdout:6/547: dread d16/d1b/d25/f3d [0,4194304] 0 2023-12-09T02:34:52.711 INFO:tasks.workunit.client.0.smithi088.stdout:7/541: sync 2023-12-09T02:34:52.714 INFO:tasks.workunit.client.0.smithi088.stdout:6/548: unlink f11 0 2023-12-09T02:34:52.732 INFO:tasks.workunit.client.0.smithi088.stdout:5/566: dwrite d3/d15/de/d10/d18/f4e [0,4194304] 0 2023-12-09T02:34:52.732 INFO:tasks.workunit.client.0.smithi088.stdout:5/567: readlink d3/d15/de/d10/d51/d70/l79 0 2023-12-09T02:34:52.736 INFO:tasks.workunit.client.0.smithi088.stdout:2/525: dwrite d6/d8/d54/fa6 [0,4194304] 0 2023-12-09T02:34:52.736 INFO:tasks.workunit.client.0.smithi088.stdout:0/507: dwrite f6 [0,4194304] 0 2023-12-09T02:34:52.736 INFO:tasks.workunit.client.0.smithi088.stdout:1/635: dwrite d8/f19 [4194304,4194304] 0 2023-12-09T02:34:52.739 INFO:tasks.workunit.client.0.smithi088.stdout:2/526: mkdir d6/d20/d69/db2/db4 0 2023-12-09T02:34:52.739 INFO:tasks.workunit.client.0.smithi088.stdout:2/527: stat d6/d13/f76 0 2023-12-09T02:34:52.743 INFO:tasks.workunit.client.0.smithi088.stdout:2/528: read d6/f39 [173012,83845] 0 2023-12-09T02:34:52.744 INFO:tasks.workunit.client.0.smithi088.stdout:1/636: creat d8/d3d/fdb x:0 0 0 2023-12-09T02:34:52.746 INFO:tasks.workunit.client.0.smithi088.stdout:1/637: mkdir d8/d27/d66/d79/ddc 0 2023-12-09T02:34:52.748 INFO:tasks.workunit.client.0.smithi088.stdout:1/638: truncate d8/d1c/f28 3621728 0 2023-12-09T02:34:52.748 INFO:tasks.workunit.client.0.smithi088.stdout:1/639: chown d8/d1c/l8f 199726891 1 2023-12-09T02:34:52.749 INFO:tasks.workunit.client.0.smithi088.stdout:1/640: symlink d8/d59/ldd 0 2023-12-09T02:34:52.752 INFO:tasks.workunit.client.0.smithi088.stdout:1/641: dread d8/f87 [0,4194304] 0 2023-12-09T02:34:52.756 INFO:tasks.workunit.client.0.smithi088.stdout:5/568: dwrite d3/d15/de/d10/d18/d19/d1b/f1c [0,4194304] 0 2023-12-09T02:34:52.756 INFO:tasks.workunit.client.0.smithi088.stdout:5/569: chown d3/l65 612900863 1 2023-12-09T02:34:52.764 INFO:tasks.workunit.client.0.smithi088.stdout:2/529: dwrite d6/d8/d4e/d64/f75 [0,4194304] 0 2023-12-09T02:34:52.767 INFO:tasks.workunit.client.0.smithi088.stdout:2/530: creat d6/d8/d4e/d3c/fb5 x:0 0 0 2023-12-09T02:34:52.768 INFO:tasks.workunit.client.0.smithi088.stdout:2/531: creat d6/d13/db3/fb6 x:0 0 0 2023-12-09T02:34:52.768 INFO:tasks.workunit.client.0.smithi088.stdout:2/532: getdents d6/d20/d69/db2/db4 0 2023-12-09T02:34:52.773 INFO:tasks.workunit.client.0.smithi088.stdout:2/533: dread d6/d8/d1f/d22/f40 [0,4194304] 0 2023-12-09T02:34:52.773 INFO:tasks.workunit.client.0.smithi088.stdout:2/534: dread - d6/d8/fab zero size 2023-12-09T02:34:52.777 INFO:tasks.workunit.client.0.smithi088.stdout:0/508: dwrite df/d37/d70/f98 [0,4194304] 0 2023-12-09T02:34:52.778 INFO:tasks.workunit.client.0.smithi088.stdout:1/642: dwrite d8/d3d/d44/d49/f65 [4194304,4194304] 0 2023-12-09T02:34:52.781 INFO:tasks.workunit.client.0.smithi088.stdout:0/509: creat df/d28/d43/d77/fa6 x:0 0 0 2023-12-09T02:34:52.784 INFO:tasks.workunit.client.0.smithi088.stdout:1/643: rename d8/d3d/c47 to d8/d3d/d5d/d82/cde 0 2023-12-09T02:34:52.785 INFO:tasks.workunit.client.0.smithi088.stdout:1/644: mkdir d8/d1b/d1d/ddf 0 2023-12-09T02:34:52.786 INFO:tasks.workunit.client.0.smithi088.stdout:1/645: mknod d8/d59/ce0 0 2023-12-09T02:34:52.788 INFO:tasks.workunit.client.0.smithi088.stdout:9/467: sync 2023-12-09T02:34:52.788 INFO:tasks.workunit.client.0.smithi088.stdout:8/556: sync 2023-12-09T02:34:52.788 INFO:tasks.workunit.client.0.smithi088.stdout:8/557: chown d2/d9/d1a/d62/d9a 1 1 2023-12-09T02:34:52.788 INFO:tasks.workunit.client.0.smithi088.stdout:8/558: chown d2/d9/l16 248394898 1 2023-12-09T02:34:52.789 INFO:tasks.workunit.client.0.smithi088.stdout:9/468: creat df/d20/f99 x:0 0 0 2023-12-09T02:34:52.790 INFO:tasks.workunit.client.0.smithi088.stdout:9/469: rmdir df/d20/d30/d52 39 2023-12-09T02:34:52.790 INFO:tasks.workunit.client.0.smithi088.stdout:8/559: dread d2/f28 [0,4194304] 0 2023-12-09T02:34:52.790 INFO:tasks.workunit.client.0.smithi088.stdout:8/560: chown d2/d9/d13/d15/faf 1338 1 2023-12-09T02:34:52.790 INFO:tasks.workunit.client.0.smithi088.stdout:8/561: read - d2/d9/d1a/d62/d76/d85/f9c zero size 2023-12-09T02:34:52.791 INFO:tasks.workunit.client.0.smithi088.stdout:9/470: creat df/d20/d30/d3f/d48/f9a x:0 0 0 2023-12-09T02:34:52.792 INFO:tasks.workunit.client.0.smithi088.stdout:9/471: symlink df/d20/d4c/d84/l9b 0 2023-12-09T02:34:52.793 INFO:tasks.workunit.client.0.smithi088.stdout:9/472: read df/f1a [2163194,18060] 0 2023-12-09T02:34:52.795 INFO:tasks.workunit.client.0.smithi088.stdout:9/473: unlink df/d20/d30/f89 0 2023-12-09T02:34:52.795 INFO:tasks.workunit.client.0.smithi088.stdout:8/562: dread d2/d9/d13/d15/fab [0,4194304] 0 2023-12-09T02:34:52.795 INFO:tasks.workunit.client.0.smithi088.stdout:1/646: dread f3 [0,4194304] 0 2023-12-09T02:34:52.795 INFO:tasks.workunit.client.0.smithi088.stdout:8/563: read - d2/d9/d1a/d65/fbb zero size 2023-12-09T02:34:52.796 INFO:tasks.workunit.client.0.smithi088.stdout:1/647: chown d8/d3d/d5d/d95 5 1 2023-12-09T02:34:52.796 INFO:tasks.workunit.client.0.smithi088.stdout:1/648: write d8/d1b/d6d/d7c/fbe [5068499,27128] 0 2023-12-09T02:34:52.796 INFO:tasks.workunit.client.0.smithi088.stdout:1/649: chown d8/d3d/d5d/d82 15 1 2023-12-09T02:34:52.796 INFO:tasks.workunit.client.0.smithi088.stdout:9/474: write df/d20/d30/d3f/d48/f45 [753853,85382] 0 2023-12-09T02:34:52.797 INFO:tasks.workunit.client.0.smithi088.stdout:1/650: mknod d8/d1c/dc9/ce1 0 2023-12-09T02:34:52.797 INFO:tasks.workunit.client.0.smithi088.stdout:1/651: write d8/d3d/d44/fc3 [851978,114676] 0 2023-12-09T02:34:52.798 INFO:tasks.workunit.client.0.smithi088.stdout:1/652: mkdir d8/d3d/d44/da4/dcb/de2 0 2023-12-09T02:34:52.799 INFO:tasks.workunit.client.0.smithi088.stdout:1/653: stat d8/d27/l4a 0 2023-12-09T02:34:52.801 INFO:tasks.workunit.client.0.smithi088.stdout:1/654: truncate d8/d3d/d5d/d95/dac/fb4 4103816 0 2023-12-09T02:34:52.802 INFO:tasks.workunit.client.0.smithi088.stdout:8/564: dread d2/d9/d13/f19 [0,4194304] 0 2023-12-09T02:34:52.808 INFO:tasks.workunit.client.0.smithi088.stdout:8/565: rename d2/d9/d13/d1c/c7c to d2/cc3 0 2023-12-09T02:34:52.810 INFO:tasks.workunit.client.0.smithi088.stdout:8/566: unlink d2/d9/d13/d1c/d3b/ca5 0 2023-12-09T02:34:52.811 INFO:tasks.workunit.client.0.smithi088.stdout:8/567: mkdir d2/d9/d13/d1c/d5f/dc4 0 2023-12-09T02:34:52.811 INFO:tasks.workunit.client.0.smithi088.stdout:8/568: fdatasync d2/d9/d13/d1c/f5a 0 2023-12-09T02:34:52.812 INFO:tasks.workunit.client.0.smithi088.stdout:8/569: creat d2/d9/d13/d15/fc5 x:0 0 0 2023-12-09T02:34:52.817 INFO:tasks.workunit.client.0.smithi088.stdout:9/475: dwrite df/d20/d30/d3f/d48/f45 [0,4194304] 0 2023-12-09T02:34:52.819 INFO:tasks.workunit.client.0.smithi088.stdout:9/476: symlink df/d29/d2f/l9c 0 2023-12-09T02:34:52.820 INFO:tasks.workunit.client.0.smithi088.stdout:9/477: mknod df/d20/d30/d60/c9d 0 2023-12-09T02:34:52.821 INFO:tasks.workunit.client.0.smithi088.stdout:9/478: truncate df/d20/d30/d3f/d48/f46 1469433 0 2023-12-09T02:34:52.825 INFO:tasks.workunit.client.0.smithi088.stdout:1/655: dwrite d8/d1b/f6a [0,4194304] 0 2023-12-09T02:34:52.827 INFO:tasks.workunit.client.0.smithi088.stdout:1/656: rmdir d8/d1c/d50 39 2023-12-09T02:34:52.827 INFO:tasks.workunit.client.0.smithi088.stdout:8/570: dwrite d2/d9/d13/f2f [0,4194304] 0 2023-12-09T02:34:52.833 INFO:tasks.workunit.client.0.smithi088.stdout:9/479: dread df/d50/d63/f73 [0,4194304] 0 2023-12-09T02:34:52.833 INFO:tasks.workunit.client.0.smithi088.stdout:9/480: chown df/d29/f6a 0 1 2023-12-09T02:34:52.833 INFO:tasks.workunit.client.0.smithi088.stdout:1/657: unlink d8/d3d/d44/fa1 0 2023-12-09T02:34:52.835 INFO:tasks.workunit.client.0.smithi088.stdout:8/571: rename d2/d9/d13/d15/f26 to d2/d9/d70/d8f/fc6 0 2023-12-09T02:34:52.836 INFO:tasks.workunit.client.0.smithi088.stdout:9/481: mknod df/d29/d2f/c9e 0 2023-12-09T02:34:52.837 INFO:tasks.workunit.client.0.smithi088.stdout:9/482: write df/d29/d2f/f93 [4927811,84191] 0 2023-12-09T02:34:52.838 INFO:tasks.workunit.client.0.smithi088.stdout:1/658: mkdir d8/d3d/d44/da4/dcb/de3 0 2023-12-09T02:34:52.840 INFO:tasks.workunit.client.0.smithi088.stdout:8/572: rename d2/d9/d13/d15/d6e/f75 to d2/d9/d13/d15/fc7 0 2023-12-09T02:34:52.841 INFO:tasks.workunit.client.0.smithi088.stdout:9/483: getdents df/d20/d5b/d91 0 2023-12-09T02:34:52.842 INFO:tasks.workunit.client.0.smithi088.stdout:1/659: creat d8/d1b/d6d/da2/fe4 x:0 0 0 2023-12-09T02:34:52.843 INFO:tasks.workunit.client.0.smithi088.stdout:8/573: creat d2/d9/d1a/d62/fc8 x:0 0 0 2023-12-09T02:34:52.844 INFO:tasks.workunit.client.0.smithi088.stdout:8/574: read d2/d9/f4d [4304646,53339] 0 2023-12-09T02:34:52.844 INFO:tasks.workunit.client.0.smithi088.stdout:9/484: symlink df/d20/d30/d60/d5c/l9f 0 2023-12-09T02:34:52.844 INFO:tasks.workunit.client.0.smithi088.stdout:9/485: fsync df/d20/d5b/f95 0 2023-12-09T02:34:52.846 INFO:tasks.workunit.client.0.smithi088.stdout:8/575: link d2/d9/d1a/d62/d49/l5d d2/d9/d13/d1c/d3b/lc9 0 2023-12-09T02:34:52.846 INFO:tasks.workunit.client.0.smithi088.stdout:8/576: write d2/d9/d1a/d62/f55 [946111,114988] 0 2023-12-09T02:34:52.846 INFO:tasks.workunit.client.0.smithi088.stdout:8/577: getdents d2/d9/d13/d1c/d5f/d96 0 2023-12-09T02:34:52.847 INFO:tasks.workunit.client.0.smithi088.stdout:9/486: mknod df/d20/d4c/d84/ca0 0 2023-12-09T02:34:52.847 INFO:tasks.workunit.client.0.smithi088.stdout:9/487: stat df/d20/d30/f43 0 2023-12-09T02:34:52.847 INFO:tasks.workunit.client.0.smithi088.stdout:3/458: sync 2023-12-09T02:34:52.847 INFO:tasks.workunit.client.0.smithi088.stdout:4/544: sync 2023-12-09T02:34:52.847 INFO:tasks.workunit.client.0.smithi088.stdout:4/545: dread - d3/f76 zero size 2023-12-09T02:34:52.847 INFO:tasks.workunit.client.0.smithi088.stdout:4/546: write d3/dc/f9e [5451491,41126] 0 2023-12-09T02:34:52.847 INFO:tasks.workunit.client.0.smithi088.stdout:8/578: mknod d2/db9/cca 0 2023-12-09T02:34:52.850 INFO:tasks.workunit.client.0.smithi088.stdout:3/459: creat d1/d3e/f97 x:0 0 0 2023-12-09T02:34:52.850 INFO:tasks.workunit.client.0.smithi088.stdout:3/460: fdatasync d1/d3e/f97 0 2023-12-09T02:34:52.850 INFO:tasks.workunit.client.0.smithi088.stdout:3/461: chown d1/d9/d6f/d6 1 1 2023-12-09T02:34:52.850 INFO:tasks.workunit.client.0.smithi088.stdout:1/660: dread d8/d1b/f6a [0,4194304] 0 2023-12-09T02:34:52.851 INFO:tasks.workunit.client.0.smithi088.stdout:1/661: dread - d8/f8c zero size 2023-12-09T02:34:52.851 INFO:tasks.workunit.client.0.smithi088.stdout:4/547: creat d3/dc/d43/d8c/d95/fb1 x:0 0 0 2023-12-09T02:34:52.853 INFO:tasks.workunit.client.0.smithi088.stdout:8/579: creat d2/d9/d1a/d65/fcb x:0 0 0 2023-12-09T02:34:52.854 INFO:tasks.workunit.client.0.smithi088.stdout:3/462: getdents d1/d9/d6f/d6/d4a/d41 0 2023-12-09T02:34:52.855 INFO:tasks.workunit.client.0.smithi088.stdout:1/662: creat d8/d3d/d44/da4/dcb/de3/fe5 x:0 0 0 2023-12-09T02:34:52.856 INFO:tasks.workunit.client.0.smithi088.stdout:8/580: creat d2/d9/d70/fcc x:0 0 0 2023-12-09T02:34:52.856 INFO:tasks.workunit.client.0.smithi088.stdout:8/581: read - d2/d9/d13/d15/f81 zero size 2023-12-09T02:34:52.856 INFO:tasks.workunit.client.0.smithi088.stdout:8/582: readlink d2/d9/d13/d15/l38 0 2023-12-09T02:34:52.857 INFO:tasks.workunit.client.0.smithi088.stdout:8/583: symlink d2/d9/d70/d8f/lcd 0 2023-12-09T02:34:52.860 INFO:tasks.workunit.client.0.smithi088.stdout:4/548: write d3/dc/f14 [2121213,36206] 0 2023-12-09T02:34:52.861 INFO:tasks.workunit.client.0.smithi088.stdout:4/549: truncate d3/dc/d1d/d40/f59 2214163 0 2023-12-09T02:34:52.864 INFO:tasks.workunit.client.0.smithi088.stdout:4/550: chown d3/dc/d43/l77 8220266 1 2023-12-09T02:34:52.864 INFO:tasks.workunit.client.0.smithi088.stdout:4/551: write d3/dc/d43/d8c/f9b [208945,13439] 0 2023-12-09T02:34:52.865 INFO:tasks.workunit.client.0.smithi088.stdout:4/552: getdents d3/dc/d1d/d40 0 2023-12-09T02:34:52.865 INFO:tasks.workunit.client.0.smithi088.stdout:9/488: dwrite df/d29/f33 [0,4194304] 0 2023-12-09T02:34:52.867 INFO:tasks.workunit.client.0.smithi088.stdout:1/663: dread d8/d3d/d5d/d95/dac/fb4 [0,4194304] 0 2023-12-09T02:34:52.867 INFO:tasks.workunit.client.0.smithi088.stdout:1/664: chown d8/f5c 3526905 1 2023-12-09T02:34:52.867 INFO:tasks.workunit.client.0.smithi088.stdout:1/665: fdatasync d8/d3d/d5d/d95/dac/fb4 0 2023-12-09T02:34:52.867 INFO:tasks.workunit.client.0.smithi088.stdout:1/666: dread - d8/d27/fad zero size 2023-12-09T02:34:52.867 INFO:tasks.workunit.client.0.smithi088.stdout:1/667: dread - d8/d3d/fdb zero size 2023-12-09T02:34:52.867 INFO:tasks.workunit.client.0.smithi088.stdout:1/668: write d8/d1b/d6d/d7c/fcd [793617,103294] 0 2023-12-09T02:34:52.867 INFO:tasks.workunit.client.0.smithi088.stdout:4/553: mknod d3/dc/d43/d8c/d9a/cb2 0 2023-12-09T02:34:52.868 INFO:tasks.workunit.client.0.smithi088.stdout:4/554: truncate d3/dc/d43/d8c/d95/fb1 772352 0 2023-12-09T02:34:52.872 INFO:tasks.workunit.client.0.smithi088.stdout:9/489: symlink df/d29/d2f/la1 0 2023-12-09T02:34:52.873 INFO:tasks.workunit.client.0.smithi088.stdout:3/463: dwrite d1/d9/d6f/d22/d7f/d45/f88 [0,4194304] 0 2023-12-09T02:34:52.873 INFO:tasks.workunit.client.0.smithi088.stdout:3/464: readlink d1/d9/l14 0 2023-12-09T02:34:52.873 INFO:tasks.workunit.client.0.smithi088.stdout:3/465: readlink d1/d9/l7d 0 2023-12-09T02:34:52.874 INFO:tasks.workunit.client.0.smithi088.stdout:4/555: rename d3/dc/d43/d83/l26 to d3/dc/d43/d83/d37/lb3 0 2023-12-09T02:34:52.875 INFO:tasks.workunit.client.0.smithi088.stdout:9/490: mkdir df/d29/d2f/da2 0 2023-12-09T02:34:52.876 INFO:tasks.workunit.client.0.smithi088.stdout:1/669: unlink d8/c11 0 2023-12-09T02:34:52.877 INFO:tasks.workunit.client.0.smithi088.stdout:3/466: symlink d1/d9/d6f/d22/d7f/d81/d85/l98 0 2023-12-09T02:34:52.877 INFO:tasks.workunit.client.0.smithi088.stdout:3/467: chown d1/d9/d6f/f32 5777009 1 2023-12-09T02:34:52.878 INFO:tasks.workunit.client.0.smithi088.stdout:4/556: truncate d3/f6 2728663 0 2023-12-09T02:34:52.879 INFO:tasks.workunit.client.0.smithi088.stdout:1/670: mknod d8/d1b/d6d/da2/ce6 0 2023-12-09T02:34:52.879 INFO:tasks.workunit.client.0.smithi088.stdout:1/671: chown d8/d59/ldd 3519 1 2023-12-09T02:34:52.880 INFO:tasks.workunit.client.0.smithi088.stdout:3/468: rmdir d1/d9/d6f/d6/d72 39 2023-12-09T02:34:52.882 INFO:tasks.workunit.client.0.smithi088.stdout:1/672: creat d8/d1b/d1d/dc7/fe7 x:0 0 0 2023-12-09T02:34:52.883 INFO:tasks.workunit.client.0.smithi088.stdout:7/542: sync 2023-12-09T02:34:52.885 INFO:tasks.workunit.client.0.smithi088.stdout:4/557: mknod d3/d65/cb4 0 2023-12-09T02:34:52.886 INFO:tasks.workunit.client.0.smithi088.stdout:1/673: creat d8/d27/d75/fe8 x:0 0 0 2023-12-09T02:34:52.887 INFO:tasks.workunit.client.0.smithi088.stdout:4/558: truncate d3/dc/d18/d7b/f62 1355449 0 2023-12-09T02:34:52.889 INFO:tasks.workunit.client.0.smithi088.stdout:9/491: dwrite df/d20/d30/d60/d5c/f23 [0,4194304] 0 2023-12-09T02:34:52.890 INFO:tasks.workunit.client.0.smithi088.stdout:1/674: rename d8/d1b/d1d/l2f to d8/d3d/d44/le9 0 2023-12-09T02:34:52.892 INFO:tasks.workunit.client.0.smithi088.stdout:4/559: rmdir d3/dc/d1d 39 2023-12-09T02:34:52.896 INFO:tasks.workunit.client.0.smithi088.stdout:1/675: creat d8/d1b/d1d/ddf/fea x:0 0 0 2023-12-09T02:34:52.897 INFO:tasks.workunit.client.0.smithi088.stdout:4/560: creat d3/dc/d43/d8c/fb5 x:0 0 0 2023-12-09T02:34:52.897 INFO:tasks.workunit.client.0.smithi088.stdout:4/561: truncate d3/dc/d43/d8c/fb5 135682 0 2023-12-09T02:34:52.897 INFO:tasks.workunit.client.0.smithi088.stdout:4/562: write d3/f70 [2208849,126443] 0 2023-12-09T02:34:52.898 INFO:tasks.workunit.client.0.smithi088.stdout:1/676: creat d8/d59/feb x:0 0 0 2023-12-09T02:34:52.899 INFO:tasks.workunit.client.0.smithi088.stdout:9/492: write df/d20/d5b/f8c [1989977,22272] 0 2023-12-09T02:34:52.899 INFO:tasks.workunit.client.0.smithi088.stdout:9/493: write df/d29/f6a [2865489,92712] 0 2023-12-09T02:34:52.900 INFO:tasks.workunit.client.0.smithi088.stdout:9/494: readlink df/d20/l8f 0 2023-12-09T02:34:52.900 INFO:tasks.workunit.client.0.smithi088.stdout:9/495: dread - df/d20/d30/d3f/d48/f9a zero size 2023-12-09T02:34:52.900 INFO:tasks.workunit.client.0.smithi088.stdout:1/677: unlink d8/d1b/d6d/da2/ce6 0 2023-12-09T02:34:52.900 INFO:tasks.workunit.client.0.smithi088.stdout:1/678: fsync f2 0 2023-12-09T02:34:52.900 INFO:tasks.workunit.client.0.smithi088.stdout:1/679: fsync d8/d27/d9a/fa3 0 2023-12-09T02:34:52.900 INFO:tasks.workunit.client.0.smithi088.stdout:4/563: write d3/dc/d43/d83/d37/f98 [1712431,62646] 0 2023-12-09T02:34:52.901 INFO:tasks.workunit.client.0.smithi088.stdout:9/496: mkdir df/d50/da3 0 2023-12-09T02:34:52.901 INFO:tasks.workunit.client.0.smithi088.stdout:9/497: chown df/d20/d4c/d84/l9b 744 1 2023-12-09T02:34:52.901 INFO:tasks.workunit.client.0.smithi088.stdout:9/498: chown df/d50/d63/f80 125160 1 2023-12-09T02:34:52.901 INFO:tasks.workunit.client.0.smithi088.stdout:4/564: write d3/dc/d43/d8c/d95/f4b [203398,60309] 0 2023-12-09T02:34:52.901 INFO:tasks.workunit.client.0.smithi088.stdout:4/565: truncate d3/dc/d1d/f9d 817618 0 2023-12-09T02:34:52.901 INFO:tasks.workunit.client.0.smithi088.stdout:1/680: symlink d8/d3d/d5d/d82/lec 0 2023-12-09T02:34:52.903 INFO:tasks.workunit.client.0.smithi088.stdout:9/499: creat df/d20/d30/d3f/d48/fa4 x:0 0 0 2023-12-09T02:34:52.903 INFO:tasks.workunit.client.0.smithi088.stdout:9/500: readlink df/d20/d30/d52/l67 0 2023-12-09T02:34:52.903 INFO:tasks.workunit.client.0.smithi088.stdout:9/501: readlink df/d20/d30/d60/d5c/l6b 0 2023-12-09T02:34:52.904 INFO:tasks.workunit.client.0.smithi088.stdout:7/543: dwrite dc/d21/d6b/d9b/fbf [0,4194304] 0 2023-12-09T02:34:52.904 INFO:tasks.workunit.client.0.smithi088.stdout:3/469: dwrite d1/d9/d6f/f51 [0,4194304] 0 2023-12-09T02:34:52.905 INFO:tasks.workunit.client.0.smithi088.stdout:4/566: mknod d3/dc/d7d/cb6 0 2023-12-09T02:34:52.905 INFO:tasks.workunit.client.0.smithi088.stdout:4/567: write d3/dc/d43/d83/f49 [1533292,128297] 0 2023-12-09T02:34:52.906 INFO:tasks.workunit.client.0.smithi088.stdout:1/681: mkdir d8/d1b/d6d/d7c/ded 0 2023-12-09T02:34:52.906 INFO:tasks.workunit.client.0.smithi088.stdout:1/682: dread - d8/d27/d75/f85 zero size 2023-12-09T02:34:52.907 INFO:tasks.workunit.client.0.smithi088.stdout:9/502: creat df/d20/d4c/d71/fa5 x:0 0 0 2023-12-09T02:34:52.909 INFO:tasks.workunit.client.0.smithi088.stdout:7/544: symlink dc/d21/d6b/d6d/da4/lc6 0 2023-12-09T02:34:52.910 INFO:tasks.workunit.client.0.smithi088.stdout:4/568: dread d3/f70 [0,4194304] 0 2023-12-09T02:34:52.918 INFO:tasks.workunit.client.0.smithi088.stdout:3/470: getdents d1/d9/d6f/d22/d7f 0 2023-12-09T02:34:52.920 INFO:tasks.workunit.client.0.smithi088.stdout:1/683: mknod d8/d27/d75/cee 0 2023-12-09T02:34:52.921 INFO:tasks.workunit.client.0.smithi088.stdout:7/545: unlink dc/d21/d7f/c87 0 2023-12-09T02:34:52.924 INFO:tasks.workunit.client.0.smithi088.stdout:4/569: mkdir d3/dc/d43/d8c/d95/daa/db7 0 2023-12-09T02:34:52.924 INFO:tasks.workunit.client.0.smithi088.stdout:1/684: symlink d8/d59/lef 0 2023-12-09T02:34:52.924 INFO:tasks.workunit.client.0.smithi088.stdout:1/685: chown d8/d27/d9a/c9c 96269 1 2023-12-09T02:34:52.925 INFO:tasks.workunit.client.0.smithi088.stdout:9/503: dwrite df/d20/d30/d3f/d48/f6e [0,4194304] 0 2023-12-09T02:34:52.926 INFO:tasks.workunit.client.0.smithi088.stdout:1/686: getdents d8/d1c/dc9 0 2023-12-09T02:34:52.927 INFO:tasks.workunit.client.0.smithi088.stdout:9/504: write df/d50/d63/f73 [3976568,80230] 0 2023-12-09T02:34:52.929 INFO:tasks.workunit.client.0.smithi088.stdout:1/687: truncate d8/d1c/d50/f78 1071853 0 2023-12-09T02:34:52.929 INFO:tasks.workunit.client.0.smithi088.stdout:1/688: chown d8/d1c/l21 55213233 1 2023-12-09T02:34:52.931 INFO:tasks.workunit.client.0.smithi088.stdout:9/505: mknod df/d20/ca6 0 2023-12-09T02:34:52.931 INFO:tasks.workunit.client.0.smithi088.stdout:1/689: mkdir d8/d3d/df0 0 2023-12-09T02:34:52.931 INFO:tasks.workunit.client.0.smithi088.stdout:0/510: sync 2023-12-09T02:34:52.931 INFO:tasks.workunit.client.0.smithi088.stdout:6/549: sync 2023-12-09T02:34:52.931 INFO:tasks.workunit.client.0.smithi088.stdout:5/570: sync 2023-12-09T02:34:52.933 INFO:tasks.workunit.client.0.smithi088.stdout:2/535: sync 2023-12-09T02:34:52.933 INFO:tasks.workunit.client.0.smithi088.stdout:9/506: truncate df/d20/d5b/f8c 3787833 0 2023-12-09T02:34:52.933 INFO:tasks.workunit.client.0.smithi088.stdout:1/690: stat d8/d27/d9a/c9c 0 2023-12-09T02:34:52.934 INFO:tasks.workunit.client.0.smithi088.stdout:0/511: symlink df/d37/la7 0 2023-12-09T02:34:52.934 INFO:tasks.workunit.client.0.smithi088.stdout:0/512: chown df/d10/d22/d2d/f4b 6440 1 2023-12-09T02:34:52.934 INFO:tasks.workunit.client.0.smithi088.stdout:0/513: fsync df/d10/d22/d2d/d2e/f99 0 2023-12-09T02:34:52.934 INFO:tasks.workunit.client.0.smithi088.stdout:0/514: chown df/d10/d22/f6f 416888 1 2023-12-09T02:34:52.934 INFO:tasks.workunit.client.0.smithi088.stdout:6/550: mkdir d16/d62/d6f/da4 0 2023-12-09T02:34:52.936 INFO:tasks.workunit.client.0.smithi088.stdout:2/536: rmdir d6/d20/da9 0 2023-12-09T02:34:52.936 INFO:tasks.workunit.client.0.smithi088.stdout:2/537: dread - d6/d13/d42/fa3 zero size 2023-12-09T02:34:52.937 INFO:tasks.workunit.client.0.smithi088.stdout:1/691: mknod d8/d3d/cf1 0 2023-12-09T02:34:52.938 INFO:tasks.workunit.client.0.smithi088.stdout:9/507: mkdir df/d20/d30/d3f/d48/da7 0 2023-12-09T02:34:52.939 INFO:tasks.workunit.client.0.smithi088.stdout:0/515: symlink df/d28/d33/la8 0 2023-12-09T02:34:52.939 INFO:tasks.workunit.client.0.smithi088.stdout:0/516: write df/d10/d22/d5f/f87 [1763637,38373] 0 2023-12-09T02:34:52.939 INFO:tasks.workunit.client.0.smithi088.stdout:0/517: readlink df/d10/d22/d2d/d2e/l63 0 2023-12-09T02:34:52.941 INFO:tasks.workunit.client.0.smithi088.stdout:1/692: rename d8/dd9 to d8/d1b/d6d/df2 0 2023-12-09T02:34:52.941 INFO:tasks.workunit.client.0.smithi088.stdout:3/471: dwrite d1/d9/d6f/d6/d4a/d41/d33/d49/f52 [0,4194304] 0 2023-12-09T02:34:52.941 INFO:tasks.workunit.client.0.smithi088.stdout:3/472: write d1/d9/d6f/d2d/d66/f5d [5118562,124000] 0 2023-12-09T02:34:52.942 INFO:tasks.workunit.client.0.smithi088.stdout:0/518: mknod df/d10/d22/d5f/ca9 0 2023-12-09T02:34:52.943 INFO:tasks.workunit.client.0.smithi088.stdout:6/551: mknod d16/d1b/d25/ca5 0 2023-12-09T02:34:52.944 INFO:tasks.workunit.client.0.smithi088.stdout:9/508: rename df/d20/d4c/f75 to df/d20/d4c/d84/fa8 0 2023-12-09T02:34:52.945 INFO:tasks.workunit.client.0.smithi088.stdout:1/693: truncate d8/d1c/f29 7379585 0 2023-12-09T02:34:52.946 INFO:tasks.workunit.client.0.smithi088.stdout:3/473: getdents d1/d9/d6f/d6/d72 0 2023-12-09T02:34:52.946 INFO:tasks.workunit.client.0.smithi088.stdout:3/474: dread - d1/d9/d6f/f55 zero size 2023-12-09T02:34:52.948 INFO:tasks.workunit.client.0.smithi088.stdout:5/571: dread d3/d15/de/d10/d18/d19/d1b/d35/d42/fa6 [0,4194304] 0 2023-12-09T02:34:52.950 INFO:tasks.workunit.client.0.smithi088.stdout:6/552: creat d16/fa6 x:0 0 0 2023-12-09T02:34:52.950 INFO:tasks.workunit.client.0.smithi088.stdout:9/509: truncate df/d50/d63/f82 1748797 0 2023-12-09T02:34:52.952 INFO:tasks.workunit.client.0.smithi088.stdout:1/694: mknod d8/d1c/cf3 0 2023-12-09T02:34:52.952 INFO:tasks.workunit.client.0.smithi088.stdout:7/546: dwrite dc/d1b/f70 [0,4194304] 0 2023-12-09T02:34:52.952 INFO:tasks.workunit.client.0.smithi088.stdout:3/475: creat d1/d9/d6f/d6/f99 x:0 0 0 2023-12-09T02:34:52.953 INFO:tasks.workunit.client.0.smithi088.stdout:5/572: rmdir d3/d15/dc/d60 39 2023-12-09T02:34:52.955 INFO:tasks.workunit.client.0.smithi088.stdout:1/695: symlink d8/d27/d9a/lf4 0 2023-12-09T02:34:52.955 INFO:tasks.workunit.client.0.smithi088.stdout:9/510: write df/d29/f6a [3116223,78186] 0 2023-12-09T02:34:52.959 INFO:tasks.workunit.client.0.smithi088.stdout:2/538: dwrite d6/d13/d18/f48 [0,4194304] 0 2023-12-09T02:34:52.960 INFO:tasks.workunit.client.0.smithi088.stdout:4/570: dwrite d3/dc/d7d/f8e [0,4194304] 0 2023-12-09T02:34:52.960 INFO:tasks.workunit.client.0.smithi088.stdout:7/547: unlink dc/c35 0 2023-12-09T02:34:52.960 INFO:tasks.workunit.client.0.smithi088.stdout:7/548: fsync dc/f18 0 2023-12-09T02:34:52.961 INFO:tasks.workunit.client.0.smithi088.stdout:7/549: stat dc/d21/d6b/d6d/da4/d38/c4d 0 2023-12-09T02:34:52.961 INFO:tasks.workunit.client.0.smithi088.stdout:8/584: sync 2023-12-09T02:34:52.961 INFO:tasks.workunit.client.0.smithi088.stdout:8/585: dread - d2/d9/d13/d15/d6e/fa2 zero size 2023-12-09T02:34:52.962 INFO:tasks.workunit.client.0.smithi088.stdout:3/476: symlink d1/d9/d6f/d6/d8b/l9a 0 2023-12-09T02:34:52.963 INFO:tasks.workunit.client.0.smithi088.stdout:6/553: dread f12 [0,4194304] 0 2023-12-09T02:34:52.963 INFO:tasks.workunit.client.0.smithi088.stdout:6/554: truncate d16/d1b/d56/fa0 630118 0 2023-12-09T02:34:52.963 INFO:tasks.workunit.client.0.smithi088.stdout:1/696: symlink d8/d59/lf5 0 2023-12-09T02:34:52.965 INFO:tasks.workunit.client.0.smithi088.stdout:1/697: dread d8/d1c/f86 [0,4194304] 0 2023-12-09T02:34:52.969 INFO:tasks.workunit.client.0.smithi088.stdout:2/539: dread - d6/d20/d3a/f91 zero size 2023-12-09T02:34:52.970 INFO:tasks.workunit.client.0.smithi088.stdout:4/571: creat d3/dc/d18/d29/fb8 x:0 0 0 2023-12-09T02:34:52.971 INFO:tasks.workunit.client.0.smithi088.stdout:8/586: creat d2/d9/d13/d1c/d5f/fce x:0 0 0 2023-12-09T02:34:52.972 INFO:tasks.workunit.client.0.smithi088.stdout:5/573: dwrite d3/d15/de/d2c/f44 [0,4194304] 0 2023-12-09T02:34:52.976 INFO:tasks.workunit.client.0.smithi088.stdout:3/477: link d1/d9/d6f/d6/d8b/l91 d1/d9/d6f/d22/d7f/d81/d85/l9b 0 2023-12-09T02:34:52.977 INFO:tasks.workunit.client.0.smithi088.stdout:6/555: truncate f15 2023528 0 2023-12-09T02:34:52.978 INFO:tasks.workunit.client.0.smithi088.stdout:1/698: symlink d8/d27/d66/d79/lf6 0 2023-12-09T02:34:52.980 INFO:tasks.workunit.client.0.smithi088.stdout:0/519: rmdir df 39 2023-12-09T02:34:52.982 INFO:tasks.workunit.client.0.smithi088.stdout:2/540: symlink d6/d8/d4e/d64/lb7 0 2023-12-09T02:34:52.983 INFO:tasks.workunit.client.0.smithi088.stdout:4/572: getdents d3/dc/d43/d8c 0 2023-12-09T02:34:52.985 INFO:tasks.workunit.client.0.smithi088.stdout:8/587: symlink d2/d9/d13/d15/d6e/lcf 0 2023-12-09T02:34:52.985 INFO:tasks.workunit.client.0.smithi088.stdout:8/588: getdents d2/d9/d13/d1c/d5f/d96 0 2023-12-09T02:34:52.987 INFO:tasks.workunit.client.0.smithi088.stdout:3/478: creat d1/d9/d6f/d6/d72/f9c x:0 0 0 2023-12-09T02:34:52.987 INFO:tasks.workunit.client.0.smithi088.stdout:3/479: write d1/d9/d6f/d6/d72/f76 [703770,29222] 0 2023-12-09T02:34:52.989 INFO:tasks.workunit.client.0.smithi088.stdout:6/556: mkdir d16/d62/da7 0 2023-12-09T02:34:52.989 INFO:tasks.workunit.client.0.smithi088.stdout:1/699: mkdir d8/d1c/d50/d6c/df7 0 2023-12-09T02:34:52.990 INFO:tasks.workunit.client.0.smithi088.stdout:0/520: truncate f4 3688896 0 2023-12-09T02:34:52.991 INFO:tasks.workunit.client.0.smithi088.stdout:2/541: mkdir d6/d8/d4e/da2/db8 0 2023-12-09T02:34:52.991 INFO:tasks.workunit.client.0.smithi088.stdout:5/574: dwrite d3/f3d [0,4194304] 0 2023-12-09T02:34:52.992 INFO:tasks.workunit.client.0.smithi088.stdout:4/573: mknod d3/dc/d43/d8c/d95/daa/db7/cb9 0 2023-12-09T02:34:52.994 INFO:tasks.workunit.client.0.smithi088.stdout:3/480: mkdir d1/d3e/d9d 0 2023-12-09T02:34:52.995 INFO:tasks.workunit.client.0.smithi088.stdout:6/557: mknod d16/d35/d36/ca8 0 2023-12-09T02:34:52.997 INFO:tasks.workunit.client.0.smithi088.stdout:1/700: creat d8/d27/d66/d79/ddc/ff8 x:0 0 0 2023-12-09T02:34:52.997 INFO:tasks.workunit.client.0.smithi088.stdout:1/701: dread - d8/d1c/d50/fca zero size 2023-12-09T02:34:52.999 INFO:tasks.workunit.client.0.smithi088.stdout:0/521: rename df/d10/l14 to df/d10/laa 0 2023-12-09T02:34:53.000 INFO:tasks.workunit.client.0.smithi088.stdout:8/589: dread d2/d9/d13/d1c/f64 [0,4194304] 0 2023-12-09T02:34:53.003 INFO:tasks.workunit.client.0.smithi088.stdout:2/542: rename d6/d8/d4e/d64/lb7 to d6/d20/d69/db2/lb9 0 2023-12-09T02:34:53.006 INFO:tasks.workunit.client.0.smithi088.stdout:3/481: unlink d1/d3e/l92 0 2023-12-09T02:34:53.007 INFO:tasks.workunit.client.0.smithi088.stdout:6/558: mkdir d16/d62/da7/da9 0 2023-12-09T02:34:53.007 INFO:tasks.workunit.client.0.smithi088.stdout:6/559: write d16/f21 [3886252,125430] 0 2023-12-09T02:34:53.009 INFO:tasks.workunit.client.0.smithi088.stdout:8/590: mknod d2/d9/d13/d15/d6e/cd0 0 2023-12-09T02:34:53.009 INFO:tasks.workunit.client.0.smithi088.stdout:2/543: write d6/d20/d3d/f4a [111739,22480] 0 2023-12-09T02:34:53.009 INFO:tasks.workunit.client.0.smithi088.stdout:2/544: stat d6/d8/d4e/d3c/c80 0 2023-12-09T02:34:53.009 INFO:tasks.workunit.client.0.smithi088.stdout:2/545: fsync d6/d8/d4e/f57 0 2023-12-09T02:34:53.009 INFO:tasks.workunit.client.0.smithi088.stdout:2/546: chown d6/d8/d54/ca7 128 1 2023-12-09T02:34:53.010 INFO:tasks.workunit.client.0.smithi088.stdout:1/702: rename d8/d1c/dc9/ccf to d8/d3d/d44/da4/dcb/cf9 0 2023-12-09T02:34:53.011 INFO:tasks.workunit.client.0.smithi088.stdout:3/482: write d1/d9/d6f/d22/d7f/d45/f18 [338824,123098] 0 2023-12-09T02:34:53.012 INFO:tasks.workunit.client.0.smithi088.stdout:3/483: fsync d1/d9/d6f/d6/f7b 0 2023-12-09T02:34:53.012 INFO:tasks.workunit.client.0.smithi088.stdout:5/575: dwrite d3/d15/de/f26 [0,4194304] 0 2023-12-09T02:34:53.012 INFO:tasks.workunit.client.0.smithi088.stdout:4/574: dwrite d3/f39 [0,4194304] 0 2023-12-09T02:34:53.013 INFO:tasks.workunit.client.0.smithi088.stdout:6/560: symlink d16/d1b/d71/laa 0 2023-12-09T02:34:53.013 INFO:tasks.workunit.client.0.smithi088.stdout:6/561: chown d16/d1b/d71/l91 8 1 2023-12-09T02:34:53.015 INFO:tasks.workunit.client.0.smithi088.stdout:0/522: rename df/d10/d22/d5f/c68 to df/d10/d22/d2d/d6a/cab 0 2023-12-09T02:34:53.018 INFO:tasks.workunit.client.0.smithi088.stdout:1/703: creat d8/d27/d66/ffa x:0 0 0 2023-12-09T02:34:53.018 INFO:tasks.workunit.client.0.smithi088.stdout:1/704: chown d8/f15 18 1 2023-12-09T02:34:53.020 INFO:tasks.workunit.client.0.smithi088.stdout:3/484: getdents d1/d58 0 2023-12-09T02:34:53.025 INFO:tasks.workunit.client.0.smithi088.stdout:5/576: unlink d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/f5f 0 2023-12-09T02:34:53.025 INFO:tasks.workunit.client.0.smithi088.stdout:5/577: write d3/d15/de/d10/d18/d19/fbf [1000599,23785] 0 2023-12-09T02:34:53.026 INFO:tasks.workunit.client.0.smithi088.stdout:4/575: link d3/dc/d43/d8c/d95/c7c d3/dc/d18/dab/cba 0 2023-12-09T02:34:53.026 INFO:tasks.workunit.client.0.smithi088.stdout:2/547: dwrite d6/d20/f3e [0,4194304] 0 2023-12-09T02:34:53.028 INFO:tasks.workunit.client.0.smithi088.stdout:6/562: getdents d16/d1b/d56 0 2023-12-09T02:34:53.030 INFO:tasks.workunit.client.0.smithi088.stdout:8/591: rename d2/d9/d1a/d62/c87 to d2/d9/d70/d8f/cd1 0 2023-12-09T02:34:53.030 INFO:tasks.workunit.client.0.smithi088.stdout:1/705: stat d8/f15 0 2023-12-09T02:34:53.030 INFO:tasks.workunit.client.0.smithi088.stdout:8/592: write d2/d9/d1a/d62/f4f [350855,26848] 0 2023-12-09T02:34:53.031 INFO:tasks.workunit.client.0.smithi088.stdout:3/485: truncate d1/d9/d6f/f51 1323590 0 2023-12-09T02:34:53.033 INFO:tasks.workunit.client.0.smithi088.stdout:5/578: getdents d3/d15/de/d10/d18/d19/d1b/d35/d42/d47 0 2023-12-09T02:34:53.035 INFO:tasks.workunit.client.0.smithi088.stdout:6/563: rename d16/d35/d36/c42 to d16/d35/d36/cab 0 2023-12-09T02:34:53.036 INFO:tasks.workunit.client.0.smithi088.stdout:6/564: dread d16/d1b/d2c/f88 [0,4194304] 0 2023-12-09T02:34:53.036 INFO:tasks.workunit.client.0.smithi088.stdout:6/565: write d16/f94 [403375,30137] 0 2023-12-09T02:34:53.038 INFO:tasks.workunit.client.0.smithi088.stdout:1/706: rename d8/d27/f84 to d8/d1c/d50/ffb 0 2023-12-09T02:34:53.038 INFO:tasks.workunit.client.0.smithi088.stdout:1/707: fsync d8/d3d/d5d/d95/f39 0 2023-12-09T02:34:53.039 INFO:tasks.workunit.client.0.smithi088.stdout:8/593: link d2/d9/d1a/d65/lbc d2/d9/d70/ld2 0 2023-12-09T02:34:53.039 INFO:tasks.workunit.client.0.smithi088.stdout:5/579: write d3/d15/de/d10/d18/d19/d1b/d35/d42/f5e [977264,56552] 0 2023-12-09T02:34:53.040 INFO:tasks.workunit.client.0.smithi088.stdout:3/486: creat d1/d9/d6f/d2d/d66/f9e x:0 0 0 2023-12-09T02:34:53.041 INFO:tasks.workunit.client.0.smithi088.stdout:1/708: creat d8/d1b/d1d/dc7/ffc x:0 0 0 2023-12-09T02:34:53.041 INFO:tasks.workunit.client.0.smithi088.stdout:2/548: dread d6/d8/f1d [0,4194304] 0 2023-12-09T02:34:53.042 INFO:tasks.workunit.client.0.smithi088.stdout:8/594: getdents d2/d9/d1a/d62/d49 0 2023-12-09T02:34:53.042 INFO:tasks.workunit.client.0.smithi088.stdout:8/595: read - d2/d9/d1a/d62/fc8 zero size 2023-12-09T02:34:53.042 INFO:tasks.workunit.client.0.smithi088.stdout:8/596: fsync d2/d9/d13/d15/f2d 0 2023-12-09T02:34:53.042 INFO:tasks.workunit.client.0.smithi088.stdout:6/566: write d16/d1b/f1d [65826,78301] 0 2023-12-09T02:34:53.043 INFO:tasks.workunit.client.0.smithi088.stdout:4/576: dwrite d3/dc/d18/d7b/f6a [0,4194304] 0 2023-12-09T02:34:53.043 INFO:tasks.workunit.client.0.smithi088.stdout:4/577: dread - d3/dc/d43/d8c/d99/fa8 zero size 2023-12-09T02:34:53.043 INFO:tasks.workunit.client.0.smithi088.stdout:4/578: dread - d3/dc/d1d/f97 zero size 2023-12-09T02:34:53.043 INFO:tasks.workunit.client.0.smithi088.stdout:4/579: fsync d3/dc/d18/d29/f3d 0 2023-12-09T02:34:53.043 INFO:tasks.workunit.client.0.smithi088.stdout:0/523: dwrite df/d10/d22/d2d/d2e/f83 [0,4194304] 0 2023-12-09T02:34:53.044 INFO:tasks.workunit.client.0.smithi088.stdout:5/580: symlink d3/d15/de/d10/d18/lc3 0 2023-12-09T02:34:53.045 INFO:tasks.workunit.client.0.smithi088.stdout:3/487: mknod d1/d9/d6f/d2d/c9f 0 2023-12-09T02:34:53.047 INFO:tasks.workunit.client.0.smithi088.stdout:1/709: unlink d8/d1b/f2e 0 2023-12-09T02:34:53.048 INFO:tasks.workunit.client.0.smithi088.stdout:2/549: symlink d6/d8/d1f/d22/lba 0 2023-12-09T02:34:53.049 INFO:tasks.workunit.client.0.smithi088.stdout:2/550: write d6/f5d [459274,70465] 0 2023-12-09T02:34:53.049 INFO:tasks.workunit.client.0.smithi088.stdout:2/551: fsync d6/d8/f46 0 2023-12-09T02:34:53.049 INFO:tasks.workunit.client.0.smithi088.stdout:8/597: creat d2/d9/d13/d1c/fd3 x:0 0 0 2023-12-09T02:34:53.049 INFO:tasks.workunit.client.0.smithi088.stdout:8/598: dread - d2/d9/d13/d15/d6e/d9f/fba zero size 2023-12-09T02:34:53.051 INFO:tasks.workunit.client.0.smithi088.stdout:6/567: rmdir d16/d35/d65 39 2023-12-09T02:34:53.055 INFO:tasks.workunit.client.0.smithi088.stdout:4/580: dread d3/dc/f28 [0,4194304] 0 2023-12-09T02:34:53.058 INFO:tasks.workunit.client.0.smithi088.stdout:4/581: dread d3/dc/f28 [0,4194304] 0 2023-12-09T02:34:53.062 INFO:tasks.workunit.client.0.smithi088.stdout:1/710: dread d8/d1b/f41 [0,4194304] 0 2023-12-09T02:34:53.066 INFO:tasks.workunit.client.0.smithi088.stdout:0/524: mkdir df/d10/d22/da0/dac 0 2023-12-09T02:34:53.067 INFO:tasks.workunit.client.0.smithi088.stdout:8/599: dwrite d2/d9/d1a/d62/f4c [0,4194304] 0 2023-12-09T02:34:53.068 INFO:tasks.workunit.client.0.smithi088.stdout:5/581: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d58/d95/dbc/dc4 0 2023-12-09T02:34:53.069 INFO:tasks.workunit.client.0.smithi088.stdout:1/711: dread d8/d1c/d50/f78 [0,4194304] 0 2023-12-09T02:34:53.069 INFO:tasks.workunit.client.0.smithi088.stdout:1/712: dread - d8/d1c/fbc zero size 2023-12-09T02:34:53.069 INFO:tasks.workunit.client.0.smithi088.stdout:3/488: unlink d1/d9/d6f/d22/d7f/d45/f18 0 2023-12-09T02:34:53.072 INFO:tasks.workunit.client.0.smithi088.stdout:2/552: creat d6/d13/fbb x:0 0 0 2023-12-09T02:34:53.072 INFO:tasks.workunit.client.0.smithi088.stdout:2/553: write d6/d8/f1d [4668867,38104] 0 2023-12-09T02:34:53.072 INFO:tasks.workunit.client.0.smithi088.stdout:6/568: symlink d16/d35/d65/lac 0 2023-12-09T02:34:53.073 INFO:tasks.workunit.client.0.smithi088.stdout:4/582: mkdir d3/dc/d18/d7b/dbb 0 2023-12-09T02:34:53.074 INFO:tasks.workunit.client.0.smithi088.stdout:8/600: dread d2/d9/d1a/d62/f4f [0,4194304] 0 2023-12-09T02:34:53.080 INFO:tasks.workunit.client.0.smithi088.stdout:0/525: creat df/d10/d22/da0/dac/fad x:0 0 0 2023-12-09T02:34:53.080 INFO:tasks.workunit.client.0.smithi088.stdout:0/526: chown df/d28/f9f 0 1 2023-12-09T02:34:53.083 INFO:tasks.workunit.client.0.smithi088.stdout:1/713: creat d8/d1c/d50/ffd x:0 0 0 2023-12-09T02:34:53.083 INFO:tasks.workunit.client.0.smithi088.stdout:1/714: chown d8/d1b/f41 10621 1 2023-12-09T02:34:53.084 INFO:tasks.workunit.client.0.smithi088.stdout:5/582: dwrite d3/d15/de/d10/d18/d19/d20/f43 [0,4194304] 0 2023-12-09T02:34:53.086 INFO:tasks.workunit.client.0.smithi088.stdout:2/554: rmdir d6/d8/d4e/d47 39 2023-12-09T02:34:53.086 INFO:tasks.workunit.client.0.smithi088.stdout:6/569: mkdir d16/d35/d36/dad 0 2023-12-09T02:34:53.086 INFO:tasks.workunit.client.0.smithi088.stdout:6/570: chown d16/d35/d36/c78 7297 1 2023-12-09T02:34:53.088 INFO:tasks.workunit.client.0.smithi088.stdout:4/583: rename d3/dc/d7d to d3/dc/d18/d7b/dbb/dbc 0 2023-12-09T02:34:53.088 INFO:tasks.workunit.client.0.smithi088.stdout:6/571: write d16/d1b/d25/d5f/d63/f7f [385316,50039] 0 2023-12-09T02:34:53.095 INFO:tasks.workunit.client.0.smithi088.stdout:2/555: mknod d6/d20/d3a/d94/cbc 0 2023-12-09T02:34:53.099 INFO:tasks.workunit.client.0.smithi088.stdout:2/556: dread d6/d8/d1f/d22/f52 [0,4194304] 0 2023-12-09T02:34:53.102 INFO:tasks.workunit.client.0.smithi088.stdout:8/601: dwrite d2/d9/f10 [0,4194304] 0 2023-12-09T02:34:53.104 INFO:tasks.workunit.client.0.smithi088.stdout:6/572: dread d16/d1b/d56/f6c [0,4194304] 0 2023-12-09T02:34:53.117 INFO:tasks.workunit.client.0.smithi088.stdout:6/573: dread d16/d35/f46 [0,4194304] 0 2023-12-09T02:34:53.117 INFO:tasks.workunit.client.0.smithi088.stdout:1/715: dwrite d8/d27/d66/d79/f9b [0,4194304] 0 2023-12-09T02:34:53.117 INFO:tasks.workunit.client.0.smithi088.stdout:6/574: write d16/d1b/d25/d5f/f68 [406267,62381] 0 2023-12-09T02:34:53.118 INFO:tasks.workunit.client.0.smithi088.stdout:3/489: dwrite d1/d9/d6f/d2d/d66/f6e [0,4194304] 0 2023-12-09T02:34:53.118 INFO:tasks.workunit.client.0.smithi088.stdout:3/490: chown d1/d9/d6f/d22/d7f/d45/f88 0 1 2023-12-09T02:34:53.119 INFO:tasks.workunit.client.0.smithi088.stdout:0/527: dwrite df/d37/d70/f98 [0,4194304] 0 2023-12-09T02:34:53.119 INFO:tasks.workunit.client.0.smithi088.stdout:0/528: write df/d10/f15 [4135471,77556] 0 2023-12-09T02:34:53.139 INFO:tasks.workunit.client.0.smithi088.stdout:0/529: dwrite df/d10/d22/d2d/f5e [0,4194304] 0 2023-12-09T02:34:53.141 INFO:tasks.workunit.client.0.smithi088.stdout:6/575: dwrite d16/d1b/d56/fa0 [0,4194304] 0 2023-12-09T02:34:53.141 INFO:tasks.workunit.client.0.smithi088.stdout:6/576: chown d16/d1b 9203847 1 2023-12-09T02:34:53.141 INFO:tasks.workunit.client.0.smithi088.stdout:6/577: getdents d16/d62/d6f/da4 0 2023-12-09T02:34:53.142 INFO:tasks.workunit.client.0.smithi088.stdout:4/584: symlink d3/dc/d43/d8c/d95/daa/db7/lbd 0 2023-12-09T02:34:53.155 INFO:tasks.workunit.client.0.smithi088.stdout:2/557: symlink d6/d20/lbd 0 2023-12-09T02:34:53.155 INFO:tasks.workunit.client.0.smithi088.stdout:2/558: readlink d6/d20/d69/l7d 0 2023-12-09T02:34:53.157 INFO:tasks.workunit.client.0.smithi088.stdout:7/550: sync 2023-12-09T02:34:53.157 INFO:tasks.workunit.client.0.smithi088.stdout:9/511: sync 2023-12-09T02:34:53.157 INFO:tasks.workunit.client.0.smithi088.stdout:7/551: chown dc/d21/d6b/d6d/da4/f55 1519488 1 2023-12-09T02:34:53.157 INFO:tasks.workunit.client.0.smithi088.stdout:9/512: stat df/d29/l72 0 2023-12-09T02:34:53.157 INFO:tasks.workunit.client.0.smithi088.stdout:7/552: dread - dc/d21/d6b/d9b/fbd zero size 2023-12-09T02:34:53.157 INFO:tasks.workunit.client.0.smithi088.stdout:8/602: unlink d2/d9/d13/d15/fab 0 2023-12-09T02:34:53.161 INFO:tasks.workunit.client.0.smithi088.stdout:5/583: rmdir d3/d15/de/d10/d18/d19/d1b 39 2023-12-09T02:34:53.166 INFO:tasks.workunit.client.0.smithi088.stdout:3/491: creat d1/d3e/d9d/fa0 x:0 0 0 2023-12-09T02:34:53.181 INFO:tasks.workunit.client.0.smithi088.stdout:0/530: creat df/d10/d22/d5f/fae x:0 0 0 2023-12-09T02:34:53.186 INFO:tasks.workunit.client.0.smithi088.stdout:0/531: write df/f67 [44879,22609] 0 2023-12-09T02:34:53.187 INFO:tasks.workunit.client.0.smithi088.stdout:6/578: getdents d16/d62 0 2023-12-09T02:34:53.188 INFO:tasks.workunit.client.0.smithi088.stdout:4/585: creat d3/dc/d43/d83/d37/fbe x:0 0 0 2023-12-09T02:34:53.188 INFO:tasks.workunit.client.0.smithi088.stdout:4/586: truncate d3/dc/d1d/f71 122201 0 2023-12-09T02:34:53.190 INFO:tasks.workunit.client.0.smithi088.stdout:2/559: mknod d6/d8/d4e/cbe 0 2023-12-09T02:34:53.191 INFO:tasks.workunit.client.0.smithi088.stdout:9/513: creat df/d20/d30/d3f/fa9 x:0 0 0 2023-12-09T02:34:53.191 INFO:tasks.workunit.client.0.smithi088.stdout:0/532: write df/d10/d22/d2d/d2e/f83 [2370955,1644] 0 2023-12-09T02:34:53.192 INFO:tasks.workunit.client.0.smithi088.stdout:0/533: write df/d10/f69 [4388748,1522] 0 2023-12-09T02:34:53.195 INFO:tasks.workunit.client.0.smithi088.stdout:8/603: dwrite d2/d9/d13/d15/d6e/d9f/fba [0,4194304] 0 2023-12-09T02:34:53.197 INFO:tasks.workunit.client.0.smithi088.stdout:7/553: dwrite dc/d1b/d66/f6f [0,4194304] 0 2023-12-09T02:34:53.197 INFO:tasks.workunit.client.0.smithi088.stdout:7/554: write dc/d21/d6b/d6d/da4/f5e [1487156,19283] 0 2023-12-09T02:34:53.197 INFO:tasks.workunit.client.0.smithi088.stdout:7/555: readlink l7 0 2023-12-09T02:34:53.197 INFO:tasks.workunit.client.0.smithi088.stdout:5/584: dwrite d3/d15/de/d10/d18/d19/d1b/d35/d42/d47/f98 [0,4194304] 0 2023-12-09T02:34:53.199 INFO:tasks.workunit.client.0.smithi088.stdout:5/585: read - d3/d15/de/d10/d18/da5/fb1 zero size 2023-12-09T02:34:53.200 INFO:tasks.workunit.client.0.smithi088.stdout:3/492: dwrite d1/f6c [0,4194304] 0 2023-12-09T02:34:53.200 INFO:tasks.workunit.client.0.smithi088.stdout:4/587: dread d3/dc/d18/d7b/f6a [0,4194304] 0 2023-12-09T02:34:53.200 INFO:tasks.workunit.client.0.smithi088.stdout:4/588: write d3/dc/d43/d8c/d99/fa8 [30985,43952] 0 2023-12-09T02:34:53.200 INFO:tasks.workunit.client.0.smithi088.stdout:4/589: write d3/dc/d43/d83/d37/fbe [513785,102615] 0 2023-12-09T02:34:53.204 INFO:tasks.workunit.client.0.smithi088.stdout:6/579: creat d16/d1b/d25/fae x:0 0 0 2023-12-09T02:34:53.205 INFO:tasks.workunit.client.0.smithi088.stdout:9/514: symlink df/d20/d30/d3f/d48/laa 0 2023-12-09T02:34:53.209 INFO:tasks.workunit.client.0.smithi088.stdout:6/580: write d16/d1b/f51 [1455664,94708] 0 2023-12-09T02:34:53.209 INFO:tasks.workunit.client.0.smithi088.stdout:6/581: chown d16/d1b/d2c/d60/c6d 2857 1 2023-12-09T02:34:53.210 INFO:tasks.workunit.client.0.smithi088.stdout:0/534: unlink df/d28/d34/l58 0 2023-12-09T02:34:53.210 INFO:tasks.workunit.client.0.smithi088.stdout:0/535: fdatasync df/d10/d22/f6e 0 2023-12-09T02:34:53.216 INFO:tasks.workunit.client.0.smithi088.stdout:8/604: creat d2/d9/d13/d1c/d5f/d84/fd4 x:0 0 0 2023-12-09T02:34:53.216 INFO:tasks.workunit.client.0.smithi088.stdout:8/605: dread - d2/d9/d1a/d62/d49/fb8 zero size 2023-12-09T02:34:53.216 INFO:tasks.workunit.client.0.smithi088.stdout:8/606: write d2/d9/d13/f56 [1520227,67655] 0 2023-12-09T02:34:53.216 INFO:tasks.workunit.client.0.smithi088.stdout:8/607: truncate d2/d9/d1a/d65/f67 193372 0 2023-12-09T02:34:53.221 INFO:tasks.workunit.client.0.smithi088.stdout:2/560: dwrite d6/d20/f43 [0,4194304] 0 2023-12-09T02:34:53.221 INFO:tasks.workunit.client.0.smithi088.stdout:2/561: chown d6/d20/d3d/c5a 7 1 2023-12-09T02:34:53.221 INFO:tasks.workunit.client.0.smithi088.stdout:2/562: chown d6/d8/l9 678387 1 2023-12-09T02:34:53.221 INFO:tasks.workunit.client.0.smithi088.stdout:2/563: chown d6/d8/d54/f65 0 1 2023-12-09T02:34:53.223 INFO:tasks.workunit.client.0.smithi088.stdout:4/590: unlink d3/dc/d18/d7b/c4e 0 2023-12-09T02:34:53.225 INFO:tasks.workunit.client.0.smithi088.stdout:9/515: creat df/d20/d30/d3f/fab x:0 0 0 2023-12-09T02:34:53.225 INFO:tasks.workunit.client.0.smithi088.stdout:9/516: write df/d20/d30/d52/f81 [1236334,127161] 0 2023-12-09T02:34:53.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:52 smithi088 ceph-mon[112028]: pgmap v194: 65 pgs: 65 active+clean; 550 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 50 MiB/s wr, 476 op/s 2023-12-09T02:34:53.227 INFO:tasks.workunit.client.0.smithi088.stdout:0/536: mkdir df/d28/d33/daf 0 2023-12-09T02:34:53.230 INFO:tasks.workunit.client.0.smithi088.stdout:8/608: creat d2/d9/d70/d8f/da8/dbe/fd5 x:0 0 0 2023-12-09T02:34:53.233 INFO:tasks.workunit.client.0.smithi088.stdout:7/556: dwrite dc/d21/d6b/d9b/fbd [0,4194304] 0 2023-12-09T02:34:53.234 INFO:tasks.workunit.client.0.smithi088.stdout:5/586: dwrite d3/d15/de/f7b [0,4194304] 0 2023-12-09T02:34:53.234 INFO:tasks.workunit.client.0.smithi088.stdout:6/582: dwrite f14 [0,4194304] 0 2023-12-09T02:34:53.234 INFO:tasks.workunit.client.0.smithi088.stdout:2/564: mkdir d6/d8/d73/d78/dbf 0 2023-12-09T02:34:53.235 INFO:tasks.workunit.client.0.smithi088.stdout:3/493: rmdir d1/d9/d6f/d6/d83 39 2023-12-09T02:34:53.236 INFO:tasks.workunit.client.0.smithi088.stdout:4/591: truncate d3/f39 1042937 0 2023-12-09T02:34:53.236 INFO:tasks.workunit.client.0.smithi088.stdout:9/517: dread df/d29/f33 [0,4194304] 0 2023-12-09T02:34:53.240 INFO:tasks.workunit.client.0.smithi088.stdout:8/609: read d2/d2b/fa9 [121823,41692] 0 2023-12-09T02:34:53.241 INFO:tasks.workunit.client.0.smithi088.stdout:0/537: dread f6 [4194304,4194304] 0 2023-12-09T02:34:53.241 INFO:tasks.workunit.client.0.smithi088.stdout:0/538: fdatasync df/d10/f31 0 2023-12-09T02:34:53.241 INFO:tasks.workunit.client.0.smithi088.stdout:0/539: chown df/d28/d34/c51 106157 1 2023-12-09T02:34:53.241 INFO:tasks.workunit.client.0.smithi088.stdout:0/540: chown df/d10/d22/d2d/f8d 4813 1 2023-12-09T02:34:53.241 INFO:tasks.workunit.client.0.smithi088.stdout:7/557: creat dc/d1b/d72/dc4/fc7 x:0 0 0 2023-12-09T02:34:53.243 INFO:tasks.workunit.client.0.smithi088.stdout:5/587: mknod d3/d15/de/d10/d51/d7f/cc5 0 2023-12-09T02:34:53.244 INFO:tasks.workunit.client.0.smithi088.stdout:6/583: mknod d16/d1b/caf 0 2023-12-09T02:34:53.251 INFO:tasks.workunit.client.0.smithi088.stdout:9/518: dwrite df/d20/d30/d60/d5c/f2a [0,4194304] 0 2023-12-09T02:34:53.251 INFO:tasks.workunit.client.0.smithi088.stdout:8/610: rename d2/d9/d13/d1c/d3b/lc9 to d2/d9/d13/d1c/ld6 0 2023-12-09T02:34:53.253 INFO:tasks.workunit.client.0.smithi088.stdout:0/541: getdents df/d28 0 2023-12-09T02:34:53.255 INFO:tasks.workunit.client.0.smithi088.stdout:7/558: creat dc/d21/d6b/d6d/da4/d38/d1e/fc8 x:0 0 0 2023-12-09T02:34:53.255 INFO:tasks.workunit.client.0.smithi088.stdout:7/559: write dc/d21/d6b/d6d/da4/d38/f44 [1574063,116582] 0 2023-12-09T02:34:53.256 INFO:tasks.workunit.client.0.smithi088.stdout:5/588: mknod d3/d15/de/d10/d18/d19/d1b/d35/cc6 0 2023-12-09T02:34:53.256 INFO:tasks.workunit.client.0.smithi088.stdout:5/589: chown d3/d15/de/d10/d18/d19/d1b/d35/d58/d95/dbc 10761 1 2023-12-09T02:34:53.260 INFO:tasks.workunit.client.0.smithi088.stdout:2/565: rename d6/d20/d3a/d82/l9e to d6/d8/d73/d78/lc0 0 2023-12-09T02:34:53.264 INFO:tasks.workunit.client.0.smithi088.stdout:6/584: dwrite d16/d1b/d2c/d3f/f61 [0,4194304] 0 2023-12-09T02:34:53.264 INFO:tasks.workunit.client.0.smithi088.stdout:6/585: fsync d16/d1b/d56/f6c 0 2023-12-09T02:34:53.264 INFO:tasks.workunit.client.0.smithi088.stdout:9/519: symlink df/d20/d30/d60/d5c/lac 0 2023-12-09T02:34:53.266 INFO:tasks.workunit.client.0.smithi088.stdout:0/542: creat df/d10/d22/d2d/d6a/fb0 x:0 0 0 2023-12-09T02:34:53.266 INFO:tasks.workunit.client.0.smithi088.stdout:0/543: write df/d10/d22/f74 [4996,89695] 0 2023-12-09T02:34:53.269 INFO:tasks.workunit.client.0.smithi088.stdout:0/544: dread df/d28/d33/f56 [4194304,4194304] 0 2023-12-09T02:34:53.269 INFO:tasks.workunit.client.0.smithi088.stdout:0/545: chown df/d10/d22/d2d/d3c/l42 24286 1 2023-12-09T02:34:53.269 INFO:tasks.workunit.client.0.smithi088.stdout:3/494: rename d1/d9/d6f/d22/d7f/f2e to d1/d9/d6f/d6/fa1 0 2023-12-09T02:34:53.274 INFO:tasks.workunit.client.0.smithi088.stdout:6/586: symlink d16/d62/da7/lb0 0 2023-12-09T02:34:53.274 INFO:tasks.workunit.client.0.smithi088.stdout:6/587: readlink d16/d35/d36/l67 0 2023-12-09T02:34:53.278 INFO:tasks.workunit.client.0.smithi088.stdout:9/520: unlink df/d20/d30/d60/d5c/l6b 0 2023-12-09T02:34:53.278 INFO:tasks.workunit.client.0.smithi088.stdout:2/566: dread d6/d8/d54/fa6 [0,4194304] 0 2023-12-09T02:34:53.280 INFO:tasks.workunit.client.0.smithi088.stdout:3/495: dread d1/d9/d6f/d6/d4a/d41/d33/f63 [0,4194304] 0 2023-12-09T02:34:53.280 INFO:tasks.workunit.client.0.smithi088.stdout:3/496: stat d1/d9/d6f/d6/d4a/f5b 0 2023-12-09T02:34:53.281 INFO:tasks.workunit.client.0.smithi088.stdout:7/560: mknod dc/d21/d6b/d6d/da4/d38/d1e/cc9 0 2023-12-09T02:34:53.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/588: dread f15 [0,4194304] 0 2023-12-09T02:34:53.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/589: fsync d16/f31 0 2023-12-09T02:34:53.288 INFO:tasks.workunit.client.0.smithi088.stdout:0/546: dwrite df/d28/d43/f79 [0,4194304] 0 2023-12-09T02:34:53.289 INFO:tasks.workunit.client.0.smithi088.stdout:2/567: creat d6/d8/d4e/da2/fc1 x:0 0 0 2023-12-09T02:34:53.291 INFO:tasks.workunit.client.0.smithi088.stdout:7/561: rmdir dc/d21/d6b/d6d/da4/d5d 39 2023-12-09T02:34:53.292 INFO:tasks.workunit.client.0.smithi088.stdout:7/562: truncate dc/d21/d6b/d6d/da4/d38/d1e/f39 1188645 0 2023-12-09T02:34:53.296 INFO:tasks.workunit.client.0.smithi088.stdout:9/521: dwrite df/d20/d5b/d91/f8b [0,4194304] 0 2023-12-09T02:34:53.296 INFO:tasks.workunit.client.0.smithi088.stdout:0/547: rename df/d10/d22/d2d/c6d to df/d28/cb1 0 2023-12-09T02:34:53.297 INFO:tasks.workunit.client.0.smithi088.stdout:7/563: write dc/d21/d6b/d6d/da4/d3e/f7b [2637507,73035] 0 2023-12-09T02:34:53.299 INFO:tasks.workunit.client.0.smithi088.stdout:3/497: creat d1/d9/d6f/d2d/d66/fa2 x:0 0 0 2023-12-09T02:34:53.305 INFO:tasks.workunit.client.0.smithi088.stdout:9/522: creat df/d20/d30/d60/fad x:0 0 0 2023-12-09T02:34:53.306 INFO:tasks.workunit.client.0.smithi088.stdout:0/548: creat df/d37/fb2 x:0 0 0 2023-12-09T02:34:53.309 INFO:tasks.workunit.client.0.smithi088.stdout:7/564: creat dc/d1b/d72/fca x:0 0 0 2023-12-09T02:34:53.311 INFO:tasks.workunit.client.0.smithi088.stdout:7/565: dread dc/fc3 [0,4194304] 0 2023-12-09T02:34:53.312 INFO:tasks.workunit.client.0.smithi088.stdout:7/566: rmdir dc/d21/d6b/d6d/da4 39 2023-12-09T02:34:53.312 INFO:tasks.workunit.client.0.smithi088.stdout:7/567: read dc/d21/d6b/d6d/da4/f48 [264725,49891] 0 2023-12-09T02:34:53.320 INFO:tasks.workunit.client.0.smithi088.stdout:9/523: dwrite df/d29/d2f/f3c [0,4194304] 0 2023-12-09T02:34:53.323 INFO:tasks.workunit.client.0.smithi088.stdout:9/524: creat df/d20/d30/d3f/d48/fae x:0 0 0 2023-12-09T02:34:53.324 INFO:tasks.workunit.client.0.smithi088.stdout:9/525: symlink df/d20/d30/d52/laf 0 2023-12-09T02:34:53.326 INFO:tasks.workunit.client.0.smithi088.stdout:9/526: link df/d29/d2f/f3a df/d20/d30/d3f/fb0 0 2023-12-09T02:34:53.326 INFO:tasks.workunit.client.0.smithi088.stdout:9/527: symlink df/d50/d63/lb1 0 2023-12-09T02:34:53.328 INFO:tasks.workunit.client.0.smithi088.stdout:9/528: rename df/d20/d30/d60/d5c/l28 to df/d20/d4c/d97/lb2 0 2023-12-09T02:34:53.328 INFO:tasks.workunit.client.0.smithi088.stdout:9/529: fsync df/d20/d5b/f8c 0 2023-12-09T02:34:53.329 INFO:tasks.workunit.client.0.smithi088.stdout:9/530: symlink df/d20/lb3 0 2023-12-09T02:34:53.331 INFO:tasks.workunit.client.0.smithi088.stdout:9/531: symlink df/d20/d30/d3f/d48/da7/lb4 0 2023-12-09T02:34:53.331 INFO:tasks.workunit.client.0.smithi088.stdout:9/532: truncate df/d20/d4c/f90 1032483 0 2023-12-09T02:34:53.337 INFO:tasks.workunit.client.0.smithi088.stdout:9/533: dread df/d29/f6a [0,4194304] 0 2023-12-09T02:34:53.337 INFO:tasks.workunit.client.0.smithi088.stdout:9/534: readlink df/d20/d30/d3f/l57 0 2023-12-09T02:34:53.339 INFO:tasks.workunit.client.0.smithi088.stdout:9/535: dread df/d20/d30/d52/f81 [0,4194304] 0 2023-12-09T02:34:53.340 INFO:tasks.workunit.client.0.smithi088.stdout:9/536: rename df/d29/f92 to df/d20/d5b/fb5 0 2023-12-09T02:34:53.365 INFO:tasks.workunit.client.0.smithi088.stdout:1/716: link d8/d1b/d1d/f4d d8/ffe 0 2023-12-09T02:34:53.366 INFO:tasks.workunit.client.0.smithi088.stdout:9/537: rename fc to df/d20/d30/fb6 0 2023-12-09T02:34:53.370 INFO:tasks.workunit.client.0.smithi088.stdout:7/568: getdents dc/d1b/d72 0 2023-12-09T02:34:53.370 INFO:tasks.workunit.client.0.smithi088.stdout:7/569: truncate dc/d21/d6b/d9b/fbf 4431926 0 2023-12-09T02:34:53.370 INFO:tasks.workunit.client.0.smithi088.stdout:7/570: chown dc/c67 16563914 1 2023-12-09T02:34:53.371 INFO:tasks.workunit.client.0.smithi088.stdout:0/549: creat df/d10/d22/fb3 x:0 0 0 2023-12-09T02:34:53.373 INFO:tasks.workunit.client.0.smithi088.stdout:0/550: dread df/f57 [0,4194304] 0 2023-12-09T02:34:53.373 INFO:tasks.workunit.client.0.smithi088.stdout:0/551: write df/d10/d22/f6f [613302,16039] 0 2023-12-09T02:34:53.374 INFO:tasks.workunit.client.0.smithi088.stdout:0/552: mknod df/d10/d22/d5b/cb4 0 2023-12-09T02:34:53.374 INFO:tasks.workunit.client.0.smithi088.stdout:0/553: chown df/d10/d22/d5f/l7f 12533 1 2023-12-09T02:34:53.374 INFO:tasks.workunit.client.0.smithi088.stdout:0/554: chown df/d10/d22/d2d/d6a/cab 19646 1 2023-12-09T02:34:53.375 INFO:tasks.workunit.client.0.smithi088.stdout:0/555: rename df/d10/d22/f6e to df/d10/d22/d2d/d2e/fb5 0 2023-12-09T02:34:53.376 INFO:tasks.workunit.client.0.smithi088.stdout:0/556: write df/f25 [2570495,77773] 0 2023-12-09T02:34:53.378 INFO:tasks.workunit.client.0.smithi088.stdout:8/611: rmdir d2/d9/d13/d1c 39 2023-12-09T02:34:53.380 INFO:tasks.workunit.client.0.smithi088.stdout:0/557: creat df/d10/d22/d5f/fb6 x:0 0 0 2023-12-09T02:34:53.381 INFO:tasks.workunit.client.0.smithi088.stdout:8/612: creat d2/d9/d70/d8f/dc2/fd7 x:0 0 0 2023-12-09T02:34:53.381 INFO:tasks.workunit.client.0.smithi088.stdout:9/538: rmdir df/d20/d30/d60 39 2023-12-09T02:34:53.381 INFO:tasks.workunit.client.0.smithi088.stdout:9/539: chown df/d20/d30/d60/d5c/f1e 1068 1 2023-12-09T02:34:53.381 INFO:tasks.workunit.client.0.smithi088.stdout:9/540: write df/d20/d30/fb6 [3447328,102491] 0 2023-12-09T02:34:53.382 INFO:tasks.workunit.client.0.smithi088.stdout:0/558: creat df/d10/d22/da0/fb7 x:0 0 0 2023-12-09T02:34:53.384 INFO:tasks.workunit.client.0.smithi088.stdout:4/592: unlink d3/f6 0 2023-12-09T02:34:53.384 INFO:tasks.workunit.client.0.smithi088.stdout:4/593: dread - d3/dc/d18/d29/f6e zero size 2023-12-09T02:34:53.384 INFO:tasks.workunit.client.0.smithi088.stdout:4/594: dread d3/dc/d1d/f71 [0,4194304] 0 2023-12-09T02:34:53.385 INFO:tasks.workunit.client.0.smithi088.stdout:8/613: unlink d2/l4 0 2023-12-09T02:34:53.385 INFO:tasks.workunit.client.0.smithi088.stdout:4/595: dread d3/dc/d43/d8c/fb5 [0,4194304] 0 2023-12-09T02:34:53.385 INFO:tasks.workunit.client.0.smithi088.stdout:8/614: write d2/d9/d13/d15/d6e/d9f/f77 [4285074,96208] 0 2023-12-09T02:34:53.386 INFO:tasks.workunit.client.0.smithi088.stdout:0/559: mkdir df/d37/d70/db8 0 2023-12-09T02:34:53.386 INFO:tasks.workunit.client.0.smithi088.stdout:0/560: fdatasync df/d10/d22/fb3 0 2023-12-09T02:34:53.388 INFO:tasks.workunit.client.0.smithi088.stdout:4/596: getdents d3/dc/d18/d7b 0 2023-12-09T02:34:53.388 INFO:tasks.workunit.client.0.smithi088.stdout:4/597: truncate d3/dc/d1d/f9d 1447385 0 2023-12-09T02:34:53.389 INFO:tasks.workunit.client.0.smithi088.stdout:0/561: rename df/d10/d22/d2d/d3c/f44 to df/d28/d43/d77/fb9 0 2023-12-09T02:34:53.390 INFO:tasks.workunit.client.0.smithi088.stdout:9/541: dread df/d20/d5b/d91/f8b [0,4194304] 0 2023-12-09T02:34:53.390 INFO:tasks.workunit.client.0.smithi088.stdout:9/542: write df/d50/d63/f7f [5138106,80008] 0 2023-12-09T02:34:53.390 INFO:tasks.workunit.client.0.smithi088.stdout:9/543: truncate df/d20/d30/d60/fad 96801 0 2023-12-09T02:34:53.397 INFO:tasks.workunit.client.0.smithi088.stdout:4/598: creat d3/dc/d43/d83/d37/fbf x:0 0 0 2023-12-09T02:34:53.397 INFO:tasks.workunit.client.0.smithi088.stdout:8/615: dread d2/d9/d1a/d62/f4c [0,4194304] 0 2023-12-09T02:34:53.398 INFO:tasks.workunit.client.0.smithi088.stdout:4/599: write d3/dc/f11 [2973937,17324] 0 2023-12-09T02:34:53.398 INFO:tasks.workunit.client.0.smithi088.stdout:4/600: fdatasync d3/dc/d43/d83/f25 0 2023-12-09T02:34:53.402 INFO:tasks.workunit.client.0.smithi088.stdout:9/544: creat df/d20/d4c/d97/fb7 x:0 0 0 2023-12-09T02:34:53.405 INFO:tasks.workunit.client.0.smithi088.stdout:8/616: symlink d2/d9/d70/d8f/da8/dbe/ld8 0 2023-12-09T02:34:53.407 INFO:tasks.workunit.client.0.smithi088.stdout:4/601: link d3/f9 d3/dc/d18/d8d/fc0 0 2023-12-09T02:34:53.413 INFO:tasks.workunit.client.0.smithi088.stdout:9/545: mkdir df/d50/d63/db8 0 2023-12-09T02:34:53.413 INFO:tasks.workunit.client.0.smithi088.stdout:4/602: mkdir d3/d65/db0/dc1 0 2023-12-09T02:34:53.416 INFO:tasks.workunit.client.0.smithi088.stdout:0/562: rename df/d28/d43/d77 to df/d10/d22/dba 0 2023-12-09T02:34:53.417 INFO:tasks.workunit.client.0.smithi088.stdout:0/563: chown df/d28/d34/c73 3239 1 2023-12-09T02:34:53.417 INFO:tasks.workunit.client.0.smithi088.stdout:0/564: dread - df/d10/d22/dba/fa6 zero size 2023-12-09T02:34:53.417 INFO:tasks.workunit.client.0.smithi088.stdout:4/603: truncate d3/d65/f79 478367 0 2023-12-09T02:34:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:52 smithi161 ceph-mon[121170]: pgmap v194: 65 pgs: 65 active+clean; 550 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 50 MiB/s wr, 476 op/s 2023-12-09T02:34:53.421 INFO:tasks.workunit.client.0.smithi088.stdout:0/565: creat df/d10/d22/d5f/fbb x:0 0 0 2023-12-09T02:34:53.421 INFO:tasks.workunit.client.0.smithi088.stdout:0/566: fsync df/f2c 0 2023-12-09T02:34:53.422 INFO:tasks.workunit.client.0.smithi088.stdout:4/604: creat d3/dc/d18/d7b/dbb/dbc/fc2 x:0 0 0 2023-12-09T02:34:53.423 INFO:tasks.workunit.client.0.smithi088.stdout:0/567: rmdir df 39 2023-12-09T02:34:53.425 INFO:tasks.workunit.client.0.smithi088.stdout:5/590: sync 2023-12-09T02:34:53.425 INFO:tasks.workunit.client.0.smithi088.stdout:5/591: write d3/d8/f9 [747228,107567] 0 2023-12-09T02:34:53.426 INFO:tasks.workunit.client.0.smithi088.stdout:5/592: rename d3/d15/de/d10/d18/fc2 to d3/d15/dc/d60/db2/fc7 0 2023-12-09T02:34:53.427 INFO:tasks.workunit.client.0.smithi088.stdout:4/605: write d3/dc/f61 [3001865,42080] 0 2023-12-09T02:34:53.428 INFO:tasks.workunit.client.0.smithi088.stdout:8/617: dwrite d2/d9/f51 [0,4194304] 0 2023-12-09T02:34:53.429 INFO:tasks.workunit.client.0.smithi088.stdout:8/618: truncate d2/d9/d13/d15/d6e/fa2 511697 0 2023-12-09T02:34:53.429 INFO:tasks.workunit.client.0.smithi088.stdout:4/606: rmdir d3/dc/d43/d8c/d9a 39 2023-12-09T02:34:53.430 INFO:tasks.workunit.client.0.smithi088.stdout:9/546: dwrite df/d50/f86 [0,4194304] 0 2023-12-09T02:34:53.430 INFO:tasks.workunit.client.0.smithi088.stdout:9/547: fsync df/f1c 0 2023-12-09T02:34:53.430 INFO:tasks.workunit.client.0.smithi088.stdout:9/548: truncate df/d20/d30/d60/f62 507522 0 2023-12-09T02:34:53.431 INFO:tasks.workunit.client.0.smithi088.stdout:0/568: dread df/d10/d22/d5f/f87 [0,4194304] 0 2023-12-09T02:34:53.431 INFO:tasks.workunit.client.0.smithi088.stdout:0/569: dread - df/d10/f93 zero size 2023-12-09T02:34:53.431 INFO:tasks.workunit.client.0.smithi088.stdout:8/619: creat d2/db9/fd9 x:0 0 0 2023-12-09T02:34:53.431 INFO:tasks.workunit.client.0.smithi088.stdout:0/570: read df/d28/d43/f4f [495510,112132] 0 2023-12-09T02:34:53.431 INFO:tasks.workunit.client.0.smithi088.stdout:0/571: chown df/d28/d33/la8 6070584 1 2023-12-09T02:34:53.432 INFO:tasks.workunit.client.0.smithi088.stdout:4/607: symlink d3/lc3 0 2023-12-09T02:34:53.432 INFO:tasks.workunit.client.0.smithi088.stdout:4/608: write d3/dc/d1d/d40/f50 [4639792,90617] 0 2023-12-09T02:34:53.436 INFO:tasks.workunit.client.0.smithi088.stdout:9/549: rename df/d20/d4c/d71 to df/d20/d30/d60/d5c/db9 0 2023-12-09T02:34:53.437 INFO:tasks.workunit.client.0.smithi088.stdout:9/550: read df/d20/d4c/f56 [2319356,33519] 0 2023-12-09T02:34:53.438 INFO:tasks.workunit.client.0.smithi088.stdout:4/609: mkdir d3/dc/d43/d8c/d95/daa/dc4 0 2023-12-09T02:34:53.439 INFO:tasks.workunit.client.0.smithi088.stdout:0/572: rename df/d10/l82 to df/d28/d43/lbc 0 2023-12-09T02:34:53.440 INFO:tasks.workunit.client.0.smithi088.stdout:9/551: link df/d20/d5b/f7e df/d20/d30/d3f/d48/fba 0 2023-12-09T02:34:53.442 INFO:tasks.workunit.client.0.smithi088.stdout:0/573: rename df/d10/d22/d2d/d6a/cab to df/d10/d22/da0/dac/cbd 0 2023-12-09T02:34:53.444 INFO:tasks.workunit.client.0.smithi088.stdout:4/610: mkdir d3/dc/d43/dc5 0 2023-12-09T02:34:53.444 INFO:tasks.workunit.client.0.smithi088.stdout:9/552: rename df/d20/c59 to df/d20/d5b/cbb 0 2023-12-09T02:34:53.444 INFO:tasks.workunit.client.0.smithi088.stdout:4/611: chown d3/dc/d43/d83/f25 0 1 2023-12-09T02:34:53.446 INFO:tasks.workunit.client.0.smithi088.stdout:9/553: dread df/d20/d30/d52/f81 [0,4194304] 0 2023-12-09T02:34:53.447 INFO:tasks.workunit.client.0.smithi088.stdout:9/554: creat df/d20/d30/d60/fbc x:0 0 0 2023-12-09T02:34:53.452 INFO:tasks.workunit.client.0.smithi088.stdout:8/620: dwrite d2/d9/d1a/d62/d49/f60 [0,4194304] 0 2023-12-09T02:34:53.452 INFO:tasks.workunit.client.0.smithi088.stdout:4/612: dread d3/dc/d43/d83/d37/f98 [0,4194304] 0 2023-12-09T02:34:53.454 INFO:tasks.workunit.client.0.smithi088.stdout:8/621: creat d2/d9/d70/d8f/d98/d9b/fda x:0 0 0 2023-12-09T02:34:53.464 INFO:tasks.workunit.client.0.smithi088.stdout:5/593: dwrite d3/d8/f9 [0,4194304] 0 2023-12-09T02:34:53.468 INFO:tasks.workunit.client.0.smithi088.stdout:8/622: dread d2/d9/d13/f1d [0,4194304] 0 2023-12-09T02:34:53.469 INFO:tasks.workunit.client.0.smithi088.stdout:0/574: dwrite df/d28/d33/f4e [0,4194304] 0 2023-12-09T02:34:53.470 INFO:tasks.workunit.client.0.smithi088.stdout:8/623: creat d2/d9/d13/d1c/d5f/d84/fdb x:0 0 0 2023-12-09T02:34:53.478 INFO:tasks.workunit.client.0.smithi088.stdout:9/555: dwrite df/f1a [4194304,4194304] 0 2023-12-09T02:34:53.478 INFO:tasks.workunit.client.0.smithi088.stdout:9/556: chown df/d29/d2f/c40 43 1 2023-12-09T02:34:53.479 INFO:tasks.workunit.client.0.smithi088.stdout:8/624: write d2/d9/f10 [1318647,31753] 0 2023-12-09T02:34:53.479 INFO:tasks.workunit.client.0.smithi088.stdout:9/557: mkdir df/d50/d63/dbd 0 2023-12-09T02:34:53.480 INFO:tasks.workunit.client.0.smithi088.stdout:8/625: truncate d2/f54 846419 0 2023-12-09T02:34:53.481 INFO:tasks.workunit.client.0.smithi088.stdout:8/626: read d2/d9/d70/d8f/fc6 [1321022,52437] 0 2023-12-09T02:34:53.481 INFO:tasks.workunit.client.0.smithi088.stdout:0/575: dread fc [0,4194304] 0 2023-12-09T02:34:53.482 INFO:tasks.workunit.client.0.smithi088.stdout:0/576: write df/d10/d22/f27 [437097,37737] 0 2023-12-09T02:34:53.483 INFO:tasks.workunit.client.0.smithi088.stdout:8/627: creat d2/d9/d1a/d62/d76/d85/fdc x:0 0 0 2023-12-09T02:34:53.483 INFO:tasks.workunit.client.0.smithi088.stdout:0/577: mknod df/d10/d22/d2d/cbe 0 2023-12-09T02:34:53.484 INFO:tasks.workunit.client.0.smithi088.stdout:8/628: mknod d2/d9/d70/cdd 0 2023-12-09T02:34:53.485 INFO:tasks.workunit.client.0.smithi088.stdout:8/629: getdents d2/d9/d13/d15/d6e/d9f 0 2023-12-09T02:34:53.486 INFO:tasks.workunit.client.0.smithi088.stdout:4/613: dwrite d3/d65/f6d [0,4194304] 0 2023-12-09T02:34:53.487 INFO:tasks.workunit.client.0.smithi088.stdout:8/630: mknod d2/d9/d13/d1c/d5f/d96/cde 0 2023-12-09T02:34:53.487 INFO:tasks.workunit.client.0.smithi088.stdout:8/631: stat d2/d9/d1a/d62/d49/lbf 0 2023-12-09T02:34:53.487 INFO:tasks.workunit.client.0.smithi088.stdout:8/632: write d2/d9/d13/f56 [2420569,116146] 0 2023-12-09T02:34:53.487 INFO:tasks.workunit.client.0.smithi088.stdout:5/594: dwrite d3/d15/de/d2c/faa [0,4194304] 0 2023-12-09T02:34:53.496 INFO:tasks.workunit.client.0.smithi088.stdout:8/633: dread d2/d9/d13/d1c/d5f/fa4 [0,4194304] 0 2023-12-09T02:34:53.499 INFO:tasks.workunit.client.0.smithi088.stdout:9/558: rmdir df/d20 39 2023-12-09T02:34:53.507 INFO:tasks.workunit.client.0.smithi088.stdout:0/578: dwrite df/d10/d22/d5f/fb6 [0,4194304] 0 2023-12-09T02:34:53.507 INFO:tasks.workunit.client.0.smithi088.stdout:0/579: chown df/c8b 447033 1 2023-12-09T02:34:53.507 INFO:tasks.workunit.client.0.smithi088.stdout:4/614: dwrite d3/dc/d18/d29/fb8 [0,4194304] 0 2023-12-09T02:34:53.507 INFO:tasks.workunit.client.0.smithi088.stdout:4/615: truncate d3/f89 1296202 0 2023-12-09T02:34:53.508 INFO:tasks.workunit.client.0.smithi088.stdout:4/616: read f1 [1154249,117365] 0 2023-12-09T02:34:53.508 INFO:tasks.workunit.client.0.smithi088.stdout:9/559: dread df/d29/f6a [8388608,4194304] 0 2023-12-09T02:34:53.508 INFO:tasks.workunit.client.0.smithi088.stdout:4/617: write d3/f4c [275087,96494] 0 2023-12-09T02:34:53.509 INFO:tasks.workunit.client.0.smithi088.stdout:4/618: chown d3/f9 1101496 1 2023-12-09T02:34:53.509 INFO:tasks.workunit.client.0.smithi088.stdout:4/619: chown d3/dc/d43/d8c/d99/fa8 856284703 1 2023-12-09T02:34:53.509 INFO:tasks.workunit.client.0.smithi088.stdout:4/620: write d3/dc/d18/d7b/dbb/dbc/f8e [2729729,37616] 0 2023-12-09T02:34:53.509 INFO:tasks.workunit.client.0.smithi088.stdout:0/580: symlink df/d10/d22/d2d/d6a/lbf 0 2023-12-09T02:34:53.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/581: truncate df/d10/d22/f74 877277 0 2023-12-09T02:34:53.514 INFO:tasks.workunit.client.0.smithi088.stdout:4/621: unlink d3/f70 0 2023-12-09T02:34:53.516 INFO:tasks.workunit.client.0.smithi088.stdout:0/582: unlink df/d10/d22/d2d/d3c/l60 0 2023-12-09T02:34:53.516 INFO:tasks.workunit.client.0.smithi088.stdout:4/622: write d3/f39 [1709149,90043] 0 2023-12-09T02:34:53.517 INFO:tasks.workunit.client.0.smithi088.stdout:4/623: rmdir d3/d65 39 2023-12-09T02:34:53.517 INFO:tasks.workunit.client.0.smithi088.stdout:9/560: dread df/f1a [4194304,4194304] 0 2023-12-09T02:34:53.519 INFO:tasks.workunit.client.0.smithi088.stdout:4/624: rename d3/f16 to d3/dc/d43/fc6 0 2023-12-09T02:34:53.519 INFO:tasks.workunit.client.0.smithi088.stdout:9/561: rmdir df/d20/d30/d3f 39 2023-12-09T02:34:53.521 INFO:tasks.workunit.client.0.smithi088.stdout:4/625: mkdir d3/dc/d18/dab/dc7 0 2023-12-09T02:34:53.523 INFO:tasks.workunit.client.0.smithi088.stdout:9/562: rename df/d20/d30/d60/fbc to df/d20/d30/d3f/fbe 0 2023-12-09T02:34:53.523 INFO:tasks.workunit.client.0.smithi088.stdout:6/590: sync 2023-12-09T02:34:53.523 INFO:tasks.workunit.client.0.smithi088.stdout:2/568: sync 2023-12-09T02:34:53.523 INFO:tasks.workunit.client.0.smithi088.stdout:4/626: mkdir d3/dc/d1d/d40/d9f/dc8 0 2023-12-09T02:34:53.525 INFO:tasks.workunit.client.0.smithi088.stdout:9/563: dread df/d50/f58 [0,4194304] 0 2023-12-09T02:34:53.525 INFO:tasks.workunit.client.0.smithi088.stdout:9/564: read - df/d20/d30/d3f/d48/fae zero size 2023-12-09T02:34:53.525 INFO:tasks.workunit.client.0.smithi088.stdout:2/569: mkdir d6/d20/d69/db2/dc2 0 2023-12-09T02:34:53.525 INFO:tasks.workunit.client.0.smithi088.stdout:3/498: sync 2023-12-09T02:34:53.525 INFO:tasks.workunit.client.0.smithi088.stdout:1/717: sync 2023-12-09T02:34:53.525 INFO:tasks.workunit.client.0.smithi088.stdout:7/571: sync 2023-12-09T02:34:53.525 INFO:tasks.workunit.client.0.smithi088.stdout:1/718: chown d8/d3d/d44/fc3 7842 1 2023-12-09T02:34:53.525 INFO:tasks.workunit.client.0.smithi088.stdout:7/572: stat dc/d1b/d66/f8e 0 2023-12-09T02:34:53.526 INFO:tasks.workunit.client.0.smithi088.stdout:6/591: creat d16/d1b/fb1 x:0 0 0 2023-12-09T02:34:53.526 INFO:tasks.workunit.client.0.smithi088.stdout:0/583: dread df/d10/f69 [0,4194304] 0 2023-12-09T02:34:53.526 INFO:tasks.workunit.client.0.smithi088.stdout:2/570: creat d6/d20/fc3 x:0 0 0 2023-12-09T02:34:53.526 INFO:tasks.workunit.client.0.smithi088.stdout:2/571: write d6/d20/d3a/d84/faf [869053,65995] 0 2023-12-09T02:34:53.527 INFO:tasks.workunit.client.0.smithi088.stdout:6/592: dread d16/d35/f5d [0,4194304] 0 2023-12-09T02:34:53.528 INFO:tasks.workunit.client.0.smithi088.stdout:0/584: stat df/d37/c3a 0 2023-12-09T02:34:53.530 INFO:tasks.workunit.client.0.smithi088.stdout:4/627: link d3/dc/f9e d3/dc/d43/d83/d37/fc9 0 2023-12-09T02:34:53.530 INFO:tasks.workunit.client.0.smithi088.stdout:4/628: write d3/dc/d43/fae [959854,100254] 0 2023-12-09T02:34:53.531 INFO:tasks.workunit.client.0.smithi088.stdout:2/572: symlink d6/d8/d1f/d22/d68/lc4 0 2023-12-09T02:34:53.533 INFO:tasks.workunit.client.0.smithi088.stdout:3/499: creat d1/d9/d6f/d15/fa3 x:0 0 0 2023-12-09T02:34:53.535 INFO:tasks.workunit.client.0.smithi088.stdout:0/585: mknod df/d37/d97/cc0 0 2023-12-09T02:34:53.537 INFO:tasks.workunit.client.0.smithi088.stdout:4/629: creat d3/dc/d43/dc5/fca x:0 0 0 2023-12-09T02:34:53.542 INFO:tasks.workunit.client.0.smithi088.stdout:3/500: creat d1/d9/d6f/d6/d8b/fa4 x:0 0 0 2023-12-09T02:34:53.547 INFO:tasks.workunit.client.0.smithi088.stdout:0/586: truncate df/d10/d22/d2d/f5e 3455881 0 2023-12-09T02:34:53.551 INFO:tasks.workunit.client.0.smithi088.stdout:4/630: truncate d3/dc/d43/d83/f25 2459110 0 2023-12-09T02:34:53.551 INFO:tasks.workunit.client.0.smithi088.stdout:4/631: write d3/dc/d43/d8c/fa3 [614644,104345] 0 2023-12-09T02:34:53.553 INFO:tasks.workunit.client.0.smithi088.stdout:3/501: mknod d1/d3e/ca5 0 2023-12-09T02:34:53.554 INFO:tasks.workunit.client.0.smithi088.stdout:0/587: symlink df/d10/d22/d2d/d3c/lc1 0 2023-12-09T02:34:53.554 INFO:tasks.workunit.client.0.smithi088.stdout:0/588: stat df/d10/d22/f54 0 2023-12-09T02:34:53.554 INFO:tasks.workunit.client.0.smithi088.stdout:0/589: chown df/d28/d43/f46 36353 1 2023-12-09T02:34:53.555 INFO:tasks.workunit.client.0.smithi088.stdout:3/502: creat d1/d9/d6f/d6/d72/fa6 x:0 0 0 2023-12-09T02:34:53.555 INFO:tasks.workunit.client.0.smithi088.stdout:2/573: getdents d6/d20 0 2023-12-09T02:34:53.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/565: dwrite df/d20/d5b/fb5 [0,4194304] 0 2023-12-09T02:34:53.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/566: chown df/d20/d5b/cbb 1178605375 1 2023-12-09T02:34:53.557 INFO:tasks.workunit.client.0.smithi088.stdout:0/590: symlink df/d28/d43/lc2 0 2023-12-09T02:34:53.557 INFO:tasks.workunit.client.0.smithi088.stdout:3/503: creat d1/d9/d6f/d6/fa7 x:0 0 0 2023-12-09T02:34:53.558 INFO:tasks.workunit.client.0.smithi088.stdout:2/574: rmdir d6/d8/d1f/d22/d68 39 2023-12-09T02:34:53.560 INFO:tasks.workunit.client.0.smithi088.stdout:4/632: dread d3/dc/f10 [0,4194304] 0 2023-12-09T02:34:53.560 INFO:tasks.workunit.client.0.smithi088.stdout:4/633: truncate d3/dc/d43/d8c/fa5 838160 0 2023-12-09T02:34:53.560 INFO:tasks.workunit.client.0.smithi088.stdout:4/634: write d3/dc/d43/d8c/d95/fb1 [1346250,111203] 0 2023-12-09T02:34:53.560 INFO:tasks.workunit.client.0.smithi088.stdout:0/591: mknod df/d37/d70/db8/cc3 0 2023-12-09T02:34:53.560 INFO:tasks.workunit.client.0.smithi088.stdout:9/567: read df/d29/d2f/f37 [224022,102358] 0 2023-12-09T02:34:53.561 INFO:tasks.workunit.client.0.smithi088.stdout:3/504: truncate d1/d9/d6f/d6/d4a/d41/d33/f42 3518087 0 2023-12-09T02:34:53.561 INFO:tasks.workunit.client.0.smithi088.stdout:3/505: readlink d1/l71 0 2023-12-09T02:34:53.561 INFO:tasks.workunit.client.0.smithi088.stdout:3/506: fsync d1/d9/d6f/d6/d4a/d41/d33/d49/f52 0 2023-12-09T02:34:53.561 INFO:tasks.workunit.client.0.smithi088.stdout:2/575: mknod d6/d8/d4e/d47/cc5 0 2023-12-09T02:34:53.561 INFO:tasks.workunit.client.0.smithi088.stdout:3/507: write d1/d9/d6f/d22/f6d [289607,104279] 0 2023-12-09T02:34:53.562 INFO:tasks.workunit.client.0.smithi088.stdout:2/576: chown d6/d20/d3a/d84/faf 634087086 1 2023-12-09T02:34:53.562 INFO:tasks.workunit.client.0.smithi088.stdout:4/635: mknod d3/dc/d43/d8c/d95/daa/ccb 0 2023-12-09T02:34:53.563 INFO:tasks.workunit.client.0.smithi088.stdout:9/568: creat df/d20/d30/d4e/fbf x:0 0 0 2023-12-09T02:34:53.563 INFO:tasks.workunit.client.0.smithi088.stdout:4/636: stat d3/c8f 0 2023-12-09T02:34:53.565 INFO:tasks.workunit.client.0.smithi088.stdout:9/569: rmdir df/d20/d5b/d91 39 2023-12-09T02:34:53.565 INFO:tasks.workunit.client.0.smithi088.stdout:9/570: chown df/d29/d2f/c53 1944 1 2023-12-09T02:34:53.565 INFO:tasks.workunit.client.0.smithi088.stdout:9/571: fdatasync df/d50/f86 0 2023-12-09T02:34:53.570 INFO:tasks.workunit.client.0.smithi088.stdout:6/593: dwrite d16/d35/d36/f6b [0,4194304] 0 2023-12-09T02:34:53.571 INFO:tasks.workunit.client.0.smithi088.stdout:7/573: dwrite dc/d1b/d66/f6f [0,4194304] 0 2023-12-09T02:34:53.573 INFO:tasks.workunit.client.0.smithi088.stdout:2/577: dread d6/d8/d4e/d3c/f53 [0,4194304] 0 2023-12-09T02:34:53.573 INFO:tasks.workunit.client.0.smithi088.stdout:1/719: dwrite d8/d1c/fbc [0,4194304] 0 2023-12-09T02:34:53.573 INFO:tasks.workunit.client.0.smithi088.stdout:1/720: chown d8/d1b/c26 2 1 2023-12-09T02:34:53.576 INFO:tasks.workunit.client.0.smithi088.stdout:7/574: write dc/d21/d6b/d6d/da4/d38/f17 [5342861,102942] 0 2023-12-09T02:34:53.576 INFO:tasks.workunit.client.0.smithi088.stdout:6/594: write d16/d1b/d25/f3b [1877844,67102] 0 2023-12-09T02:34:53.576 INFO:tasks.workunit.client.0.smithi088.stdout:6/595: write d16/d1b/d25/f3d [4738948,84535] 0 2023-12-09T02:34:53.576 INFO:tasks.workunit.client.0.smithi088.stdout:3/508: dwrite d1/d3e/f97 [0,4194304] 0 2023-12-09T02:34:53.577 INFO:tasks.workunit.client.0.smithi088.stdout:4/637: write d3/dc/d18/d29/f60 [590529,74897] 0 2023-12-09T02:34:53.582 INFO:tasks.workunit.client.0.smithi088.stdout:4/638: dread d3/dc/f9e [4194304,4194304] 0 2023-12-09T02:34:53.586 INFO:tasks.workunit.client.0.smithi088.stdout:3/509: dread d1/d9/d6f/d22/f8a [0,4194304] 0 2023-12-09T02:34:53.586 INFO:tasks.workunit.client.0.smithi088.stdout:3/510: dread - d1/d9/d6f/d6/d72/f9c zero size 2023-12-09T02:34:53.586 INFO:tasks.workunit.client.0.smithi088.stdout:3/511: chown d1/d9/d6f/d6/fa1 1734 1 2023-12-09T02:34:53.589 INFO:tasks.workunit.client.0.smithi088.stdout:1/721: unlink d8/d27/d40/da5/ca6 0 2023-12-09T02:34:53.592 INFO:tasks.workunit.client.0.smithi088.stdout:7/575: mkdir dc/dcb 0 2023-12-09T02:34:53.595 INFO:tasks.workunit.client.0.smithi088.stdout:6/596: unlink d16/d1b/d25/c3e 0 2023-12-09T02:34:53.595 INFO:tasks.workunit.client.0.smithi088.stdout:9/572: dwrite df/d20/d5b/fb5 [0,4194304] 0 2023-12-09T02:34:53.597 INFO:tasks.workunit.client.0.smithi088.stdout:3/512: dread d1/f6c [0,4194304] 0 2023-12-09T02:34:53.597 INFO:tasks.workunit.client.0.smithi088.stdout:3/513: rename d1/d9 to d1/d9/d6f/d6/d8b/da8 22 2023-12-09T02:34:53.598 INFO:tasks.workunit.client.0.smithi088.stdout:6/597: write d16/d35/f76 [532379,66466] 0 2023-12-09T02:34:53.598 INFO:tasks.workunit.client.0.smithi088.stdout:9/573: creat df/d20/d4c/d97/fc0 x:0 0 0 2023-12-09T02:34:53.598 INFO:tasks.workunit.client.0.smithi088.stdout:9/574: fdatasync df/f17 0 2023-12-09T02:34:53.598 INFO:tasks.workunit.client.0.smithi088.stdout:2/578: dwrite d6/f55 [0,4194304] 0 2023-12-09T02:34:53.598 INFO:tasks.workunit.client.0.smithi088.stdout:2/579: dread - d6/d13/f79 zero size 2023-12-09T02:34:53.599 INFO:tasks.workunit.client.0.smithi088.stdout:3/514: creat d1/d9/d6f/d2d/d66/fa9 x:0 0 0 2023-12-09T02:34:53.599 INFO:tasks.workunit.client.0.smithi088.stdout:3/515: chown d1/d9/d6f/d15/f27 266073 1 2023-12-09T02:34:53.599 INFO:tasks.workunit.client.0.smithi088.stdout:3/516: truncate d1/d58/f74 601848 0 2023-12-09T02:34:53.601 INFO:tasks.workunit.client.0.smithi088.stdout:9/575: creat df/d20/d4c/fc1 x:0 0 0 2023-12-09T02:34:53.604 INFO:tasks.workunit.client.0.smithi088.stdout:2/580: readlink d6/d20/d3a/l41 0 2023-12-09T02:34:53.605 INFO:tasks.workunit.client.0.smithi088.stdout:9/576: getdents df/d20/d30/d60 0 2023-12-09T02:34:53.606 INFO:tasks.workunit.client.0.smithi088.stdout:3/517: link d1/d9/d6f/f32 d1/d9/d6f/d6/d4a/d41/d33/faa 0 2023-12-09T02:34:53.608 INFO:tasks.workunit.client.0.smithi088.stdout:6/598: write d16/d1b/f51 [1854891,127693] 0 2023-12-09T02:34:53.608 INFO:tasks.workunit.client.0.smithi088.stdout:6/599: fsync d16/d1b/d2c/d3f/d41/f4d 0 2023-12-09T02:34:53.608 INFO:tasks.workunit.client.0.smithi088.stdout:6/600: readlink d16/d1b/d25/l2e 0 2023-12-09T02:34:53.608 INFO:tasks.workunit.client.0.smithi088.stdout:9/577: creat df/d50/fc2 x:0 0 0 2023-12-09T02:34:53.608 INFO:tasks.workunit.client.0.smithi088.stdout:4/639: dwrite d3/dc/d43/d8c/d95/f7a [0,4194304] 0 2023-12-09T02:34:53.608 INFO:tasks.workunit.client.0.smithi088.stdout:2/581: dread d6/d8/d4e/f57 [0,4194304] 0 2023-12-09T02:34:53.609 INFO:tasks.workunit.client.0.smithi088.stdout:3/518: rmdir d1/d58 39 2023-12-09T02:34:53.609 INFO:tasks.workunit.client.0.smithi088.stdout:6/601: read d16/d35/f76 [2655205,125188] 0 2023-12-09T02:34:53.609 INFO:tasks.workunit.client.0.smithi088.stdout:9/578: mknod df/d29/cc3 0 2023-12-09T02:34:53.610 INFO:tasks.workunit.client.0.smithi088.stdout:5/595: sync 2023-12-09T02:34:53.611 INFO:tasks.workunit.client.0.smithi088.stdout:4/640: creat d3/dc/d18/d7b/fcc x:0 0 0 2023-12-09T02:34:53.611 INFO:tasks.workunit.client.0.smithi088.stdout:4/641: chown d3/dc/d18/d7b/dbb/dbc/cb6 1 1 2023-12-09T02:34:53.612 INFO:tasks.workunit.client.0.smithi088.stdout:2/582: unlink d6/d13/f79 0 2023-12-09T02:34:53.612 INFO:tasks.workunit.client.0.smithi088.stdout:2/583: chown d6/d8/d4e/c4b 520489 1 2023-12-09T02:34:53.613 INFO:tasks.workunit.client.0.smithi088.stdout:5/596: write d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/fa3 [7320612,120349] 0 2023-12-09T02:34:53.614 INFO:tasks.workunit.client.0.smithi088.stdout:1/722: dwrite d8/d27/d40/f76 [0,4194304] 0 2023-12-09T02:34:53.614 INFO:tasks.workunit.client.0.smithi088.stdout:1/723: fdatasync d8/f38 0 2023-12-09T02:34:53.614 INFO:tasks.workunit.client.0.smithi088.stdout:1/724: getdents d8/d1b/d6d/df2 0 2023-12-09T02:34:53.615 INFO:tasks.workunit.client.0.smithi088.stdout:6/602: creat d16/d35/d65/fb2 x:0 0 0 2023-12-09T02:34:53.615 INFO:tasks.workunit.client.0.smithi088.stdout:6/603: chown d16/d1b/d71/laa 4206 1 2023-12-09T02:34:53.616 INFO:tasks.workunit.client.0.smithi088.stdout:9/579: unlink df/d20/d30/d3f/fb0 0 2023-12-09T02:34:53.616 INFO:tasks.workunit.client.0.smithi088.stdout:9/580: stat df/d20/d30/d3f/d48/c94 0 2023-12-09T02:34:53.617 INFO:tasks.workunit.client.0.smithi088.stdout:4/642: symlink d3/dc/d43/d83/lcd 0 2023-12-09T02:34:53.619 INFO:tasks.workunit.client.0.smithi088.stdout:2/584: rename d6/d20/d3d/d97 to d6/d13/dc6 0 2023-12-09T02:34:53.620 INFO:tasks.workunit.client.0.smithi088.stdout:2/585: read d6/f55 [3128848,4077] 0 2023-12-09T02:34:53.624 INFO:tasks.workunit.client.0.smithi088.stdout:1/725: symlink d8/d1b/d1d/lff 0 2023-12-09T02:34:53.624 INFO:tasks.workunit.client.0.smithi088.stdout:1/726: chown d8/d1c/d50/fca 27776 1 2023-12-09T02:34:53.625 INFO:tasks.workunit.client.0.smithi088.stdout:1/727: write d8/d1b/d6d/d7c/fbe [4248526,127449] 0 2023-12-09T02:34:53.625 INFO:tasks.workunit.client.0.smithi088.stdout:3/519: rmdir d1/d9/d6f/d70 39 2023-12-09T02:34:53.626 INFO:tasks.workunit.client.0.smithi088.stdout:6/604: mkdir d16/d62/d6f/db3 0 2023-12-09T02:34:53.627 INFO:tasks.workunit.client.0.smithi088.stdout:9/581: mkdir df/d20/d30/d3f/d48/dc4 0 2023-12-09T02:34:53.627 INFO:tasks.workunit.client.0.smithi088.stdout:7/576: dwrite dc/d21/d6b/f80 [0,4194304] 0 2023-12-09T02:34:53.627 INFO:tasks.workunit.client.0.smithi088.stdout:7/577: chown dc/d21/d6b/d6d/da4/d5d/l6a 375939 1 2023-12-09T02:34:53.627 INFO:tasks.workunit.client.0.smithi088.stdout:7/578: stat dc/dcb 0 2023-12-09T02:34:53.627 INFO:tasks.workunit.client.0.smithi088.stdout:5/597: dwrite d3/d15/de/d10/f6e [0,4194304] 0 2023-12-09T02:34:53.628 INFO:tasks.workunit.client.0.smithi088.stdout:5/598: write d3/d15/de/d10/d18/fa2 [595143,31065] 0 2023-12-09T02:34:53.628 INFO:tasks.workunit.client.0.smithi088.stdout:4/643: mknod d3/dc/d43/d8c/d95/cce 0 2023-12-09T02:34:53.629 INFO:tasks.workunit.client.0.smithi088.stdout:2/586: symlink d6/d20/d3a/d94/lc7 0 2023-12-09T02:34:53.629 INFO:tasks.workunit.client.0.smithi088.stdout:2/587: truncate d6/f1c 1073547 0 2023-12-09T02:34:53.629 INFO:tasks.workunit.client.0.smithi088.stdout:6/605: write d16/f99 [1172963,13952] 0 2023-12-09T02:34:53.629 INFO:tasks.workunit.client.0.smithi088.stdout:6/606: readlink d16/d1b/l24 0 2023-12-09T02:34:53.633 INFO:tasks.workunit.client.0.smithi088.stdout:1/728: rename d8/d3d/f51 to d8/d3d/d44/da4/dcb/f100 0 2023-12-09T02:34:53.633 INFO:tasks.workunit.client.0.smithi088.stdout:1/729: chown d8/d1c/d50/ffd 175778787 1 2023-12-09T02:34:53.634 INFO:tasks.workunit.client.0.smithi088.stdout:1/730: chown d8/d27/d9a/lf4 4 1 2023-12-09T02:34:53.634 INFO:tasks.workunit.client.0.smithi088.stdout:1/731: write d8/d27/d75/f85 [517454,118987] 0 2023-12-09T02:34:53.636 INFO:tasks.workunit.client.0.smithi088.stdout:3/520: mkdir d1/d9/d6f/d2d/dab 0 2023-12-09T02:34:53.636 INFO:tasks.workunit.client.0.smithi088.stdout:9/582: getdents df/d20 0 2023-12-09T02:34:53.642 INFO:tasks.workunit.client.0.smithi088.stdout:4/644: dread d3/dc/f61 [0,4194304] 0 2023-12-09T02:34:53.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/579: creat dc/d21/d6b/dbb/fcc x:0 0 0 2023-12-09T02:34:53.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/580: chown dc/d21/c53 16475591 1 2023-12-09T02:34:53.645 INFO:tasks.workunit.client.0.smithi088.stdout:5/599: link d3/d15/de/d10/l1a d3/d15/dc/d60/db2/lc8 0 2023-12-09T02:34:53.647 INFO:tasks.workunit.client.0.smithi088.stdout:2/588: unlink d6/d8/d1f/d22/lba 0 2023-12-09T02:34:53.648 INFO:tasks.workunit.client.0.smithi088.stdout:2/589: stat d6/d8/d4e/d3c/f8c 0 2023-12-09T02:34:53.648 INFO:tasks.workunit.client.0.smithi088.stdout:6/607: rmdir d16/d62/d87 39 2023-12-09T02:34:53.649 INFO:tasks.workunit.client.0.smithi088.stdout:1/732: dwrite f3 [0,4194304] 0 2023-12-09T02:34:53.649 INFO:tasks.workunit.client.0.smithi088.stdout:3/521: creat d1/d9/d6f/d6/fac x:0 0 0 2023-12-09T02:34:53.650 INFO:tasks.workunit.client.0.smithi088.stdout:9/583: creat df/d20/d30/d3f/d48/dc4/fc5 x:0 0 0 2023-12-09T02:34:53.652 INFO:tasks.workunit.client.0.smithi088.stdout:4/645: rename d3/dc/d18/d7b/f6a to d3/dc/d1d/d40/d9f/fcf 0 2023-12-09T02:34:53.654 INFO:tasks.workunit.client.0.smithi088.stdout:5/600: truncate d3/d15/dc/d60/d9d/fb6 4051354 0 2023-12-09T02:34:53.656 INFO:tasks.workunit.client.0.smithi088.stdout:2/590: getdents d6/d13/d42 0 2023-12-09T02:34:53.658 INFO:tasks.workunit.client.0.smithi088.stdout:7/581: dwrite dc/d21/d6b/d6d/da4/f5e [0,4194304] 0 2023-12-09T02:34:53.659 INFO:tasks.workunit.client.0.smithi088.stdout:7/582: write dc/d21/d6b/d6d/fb5 [91413,24417] 0 2023-12-09T02:34:53.659 INFO:tasks.workunit.client.0.smithi088.stdout:7/583: readlink dc/d21/d6b/d93/lb8 0 2023-12-09T02:34:53.661 INFO:tasks.workunit.client.0.smithi088.stdout:1/733: creat d8/d3d/d44/da4/dcb/de3/f101 x:0 0 0 2023-12-09T02:34:53.661 INFO:tasks.workunit.client.0.smithi088.stdout:3/522: mknod d1/d3e/d9d/cad 0 2023-12-09T02:34:53.663 INFO:tasks.workunit.client.0.smithi088.stdout:9/584: truncate df/f1a 2331846 0 2023-12-09T02:34:53.663 INFO:tasks.workunit.client.0.smithi088.stdout:1/734: write d8/d53/f55 [2768752,113365] 0 2023-12-09T02:34:53.664 INFO:tasks.workunit.client.0.smithi088.stdout:8/634: sync 2023-12-09T02:34:53.664 INFO:tasks.workunit.client.0.smithi088.stdout:0/592: sync 2023-12-09T02:34:53.665 INFO:tasks.workunit.client.0.smithi088.stdout:5/601: unlink d3/d15/de/d10/d18/d19/d1b/d35/d58/d95/fc0 0 2023-12-09T02:34:53.666 INFO:tasks.workunit.client.0.smithi088.stdout:6/608: unlink d16/c18 0 2023-12-09T02:34:53.672 INFO:tasks.workunit.client.0.smithi088.stdout:7/584: mkdir dc/d21/d6b/d6d/dcd 0 2023-12-09T02:34:53.674 INFO:tasks.workunit.client.0.smithi088.stdout:9/585: mkdir df/d20/d30/d60/dc6 0 2023-12-09T02:34:53.674 INFO:tasks.workunit.client.0.smithi088.stdout:4/646: dwrite d3/dc/d43/f52 [0,4194304] 0 2023-12-09T02:34:53.675 INFO:tasks.workunit.client.0.smithi088.stdout:9/586: read df/d20/d5b/f7e [384367,74925] 0 2023-12-09T02:34:53.675 INFO:tasks.workunit.client.0.smithi088.stdout:9/587: readlink df/d20/d30/d4e/l6f 0 2023-12-09T02:34:53.677 INFO:tasks.workunit.client.0.smithi088.stdout:1/735: creat d8/d1b/d1d/ddf/f102 x:0 0 0 2023-12-09T02:34:53.677 INFO:tasks.workunit.client.0.smithi088.stdout:1/736: truncate d8/d1b/d6d/da2/fe4 825098 0 2023-12-09T02:34:53.680 INFO:tasks.workunit.client.0.smithi088.stdout:0/593: truncate f6 6361223 0 2023-12-09T02:34:53.681 INFO:tasks.workunit.client.0.smithi088.stdout:5/602: rename d3/d15/de/d10/d18/d19/d1b/d35/d58/d95/dbc to d3/d15/de/d10/d51/dc9 0 2023-12-09T02:34:53.681 INFO:tasks.workunit.client.0.smithi088.stdout:6/609: dread d16/d1b/d2c/f2d [0,4194304] 0 2023-12-09T02:34:53.681 INFO:tasks.workunit.client.0.smithi088.stdout:6/610: fsync d16/d35/f6a 0 2023-12-09T02:34:53.685 INFO:tasks.workunit.client.0.smithi088.stdout:4/647: mkdir d3/dc/d43/d8c/d9a/dd0 0 2023-12-09T02:34:53.685 INFO:tasks.workunit.client.0.smithi088.stdout:2/591: dwrite d6/d13/db3/fb6 [0,4194304] 0 2023-12-09T02:34:53.685 INFO:tasks.workunit.client.0.smithi088.stdout:2/592: write d6/d8/d1f/d22/f88 [401704,10528] 0 2023-12-09T02:34:53.687 INFO:tasks.workunit.client.0.smithi088.stdout:0/594: mknod df/d10/d22/d2d/cc4 0 2023-12-09T02:34:53.687 INFO:tasks.workunit.client.0.smithi088.stdout:6/611: rmdir d16/d1b/d71 39 2023-12-09T02:34:53.687 INFO:tasks.workunit.client.0.smithi088.stdout:6/612: fdatasync d16/d35/f6a 0 2023-12-09T02:34:53.687 INFO:tasks.workunit.client.0.smithi088.stdout:9/588: mkdir df/d20/dc7 0 2023-12-09T02:34:53.687 INFO:tasks.workunit.client.0.smithi088.stdout:2/593: rmdir d6 39 2023-12-09T02:34:53.688 INFO:tasks.workunit.client.0.smithi088.stdout:9/589: creat df/d20/dc7/fc8 x:0 0 0 2023-12-09T02:34:53.696 INFO:tasks.workunit.client.0.smithi088.stdout:3/523: dwrite d1/d9/d6f/d6/d8b/f95 [0,4194304] 0 2023-12-09T02:34:53.699 INFO:tasks.workunit.client.0.smithi088.stdout:8/635: dwrite d2/d9/d1a/d65/f67 [0,4194304] 0 2023-12-09T02:34:53.701 INFO:tasks.workunit.client.0.smithi088.stdout:7/585: dwrite dc/d1b/f57 [0,4194304] 0 2023-12-09T02:34:53.701 INFO:tasks.workunit.client.0.smithi088.stdout:9/590: dread df/f1c [4194304,4194304] 0 2023-12-09T02:34:53.701 INFO:tasks.workunit.client.0.smithi088.stdout:9/591: fsync df/d20/d30/d52/f81 0 2023-12-09T02:34:53.707 INFO:tasks.workunit.client.0.smithi088.stdout:3/524: rmdir d1/d9/d6f/d6/d4a 39 2023-12-09T02:34:53.713 INFO:tasks.workunit.client.0.smithi088.stdout:3/525: write d1/d9/d6f/d6/f3f [482998,10752] 0 2023-12-09T02:34:53.713 INFO:tasks.workunit.client.0.smithi088.stdout:3/526: getdents d1/d9/d6f/d2d/dab 0 2023-12-09T02:34:53.715 INFO:tasks.workunit.client.0.smithi088.stdout:9/592: mkdir df/d20/d30/d60/dc9 0 2023-12-09T02:34:53.715 INFO:tasks.workunit.client.0.smithi088.stdout:9/593: chown df/d20/d30/d4e/l6f 834 1 2023-12-09T02:34:53.717 INFO:tasks.workunit.client.0.smithi088.stdout:5/603: dwrite d3/d8/f8d [0,4194304] 0 2023-12-09T02:34:53.718 INFO:tasks.workunit.client.0.smithi088.stdout:3/527: dread d1/d9/d6f/f32 [0,4194304] 0 2023-12-09T02:34:53.720 INFO:tasks.workunit.client.0.smithi088.stdout:8/636: rename d2/d2b/l48 to d2/d9/d13/ldf 0 2023-12-09T02:34:53.720 INFO:tasks.workunit.client.0.smithi088.stdout:8/637: fsync d2/d9/d1a/d62/f61 0 2023-12-09T02:34:53.721 INFO:tasks.workunit.client.0.smithi088.stdout:9/594: mkdir df/d20/d30/d60/dca 0 2023-12-09T02:34:53.722 INFO:tasks.workunit.client.0.smithi088.stdout:3/528: rmdir d1/d9/d6f/d6/d4a 39 2023-12-09T02:34:53.723 INFO:tasks.workunit.client.0.smithi088.stdout:4/648: dwrite d3/dc/d43/d83/d37/fc9 [4194304,4194304] 0 2023-12-09T02:34:53.723 INFO:tasks.workunit.client.0.smithi088.stdout:4/649: fsync d3/fac 0 2023-12-09T02:34:53.725 INFO:tasks.workunit.client.0.smithi088.stdout:8/638: creat d2/d9/d70/d8f/d98/d9b/fe0 x:0 0 0 2023-12-09T02:34:53.725 INFO:tasks.workunit.client.0.smithi088.stdout:8/639: dread - d2/d9/d13/d1c/d5f/d84/faa zero size 2023-12-09T02:34:53.725 INFO:tasks.workunit.client.0.smithi088.stdout:7/586: rename dc/d1b/f70 to dc/d21/d6b/d9b/fce 0 2023-12-09T02:34:53.731 INFO:tasks.workunit.client.0.smithi088.stdout:7/587: symlink dc/d21/d6b/d6d/da4/d5d/lcf 0 2023-12-09T02:34:53.731 INFO:tasks.workunit.client.0.smithi088.stdout:8/640: mknod d2/d9/d1a/ce1 0 2023-12-09T02:34:53.731 INFO:tasks.workunit.client.0.smithi088.stdout:8/641: chown d2/d9/d70/d8f/da8/dbe/ld8 37 1 2023-12-09T02:34:53.732 INFO:tasks.workunit.client.0.smithi088.stdout:7/588: unlink l8 0 2023-12-09T02:34:53.733 INFO:tasks.workunit.client.0.smithi088.stdout:8/642: rmdir d2/d9/d13/d1c 39 2023-12-09T02:34:53.733 INFO:tasks.workunit.client.0.smithi088.stdout:8/643: fsync d2/f8 0 2023-12-09T02:34:53.734 INFO:tasks.workunit.client.0.smithi088.stdout:7/589: mknod dc/d21/d6b/cd0 0 2023-12-09T02:34:53.736 INFO:tasks.workunit.client.0.smithi088.stdout:8/644: rename d2/d9/c7b to d2/d9/d13/d15/d6e/d9f/ce2 0 2023-12-09T02:34:53.736 INFO:tasks.workunit.client.0.smithi088.stdout:8/645: dread - d2/d9/fc1 zero size 2023-12-09T02:34:53.737 INFO:tasks.workunit.client.0.smithi088.stdout:7/590: symlink dc/d21/d6b/d6d/da4/d5d/ld1 0 2023-12-09T02:34:53.737 INFO:tasks.workunit.client.0.smithi088.stdout:8/646: write d2/d2b/f2e [184415,714] 0 2023-12-09T02:34:53.737 INFO:tasks.workunit.client.0.smithi088.stdout:7/591: read dc/d21/d6b/d6d/da4/d3e/f62 [3312878,64688] 0 2023-12-09T02:34:53.740 INFO:tasks.workunit.client.0.smithi088.stdout:7/592: mkdir dc/d1b/d91/dd2 0 2023-12-09T02:34:53.742 INFO:tasks.workunit.client.0.smithi088.stdout:0/595: dwrite df/d10/d22/f74 [0,4194304] 0 2023-12-09T02:34:53.742 INFO:tasks.workunit.client.0.smithi088.stdout:2/594: dwrite d6/d8/d73/d78/f8a [0,4194304] 0 2023-12-09T02:34:53.743 INFO:tasks.workunit.client.0.smithi088.stdout:2/595: dread - d6/d8/d1f/d22/d68/fa5 zero size 2023-12-09T02:34:53.743 INFO:tasks.workunit.client.0.smithi088.stdout:7/593: rename dc/d21/d6b/d6d/da4/d38/f1d to dc/d21/d6b/d9b/fd3 0 2023-12-09T02:34:53.743 INFO:tasks.workunit.client.0.smithi088.stdout:7/594: readlink dc/d21/d6b/d6d/da4/d38/l65 0 2023-12-09T02:34:53.743 INFO:tasks.workunit.client.0.smithi088.stdout:7/595: truncate dc/d21/d6b/d6d/da4/d38/fa7 766244 0 2023-12-09T02:34:53.747 INFO:tasks.workunit.client.0.smithi088.stdout:0/596: link df/d28/d33/c9b df/d28/d43/cc5 0 2023-12-09T02:34:53.747 INFO:tasks.workunit.client.0.smithi088.stdout:0/597: stat df/d10/d22/d2d/d3c/l42 0 2023-12-09T02:34:53.749 INFO:tasks.workunit.client.0.smithi088.stdout:2/596: creat d6/d8/fc8 x:0 0 0 2023-12-09T02:34:53.751 INFO:tasks.workunit.client.0.smithi088.stdout:7/596: mknod dc/d1b/d72/cd4 0 2023-12-09T02:34:53.751 INFO:tasks.workunit.client.0.smithi088.stdout:7/597: chown dc/d21/d6b/d6d/da4/d38/l37 0 1 2023-12-09T02:34:53.751 INFO:tasks.workunit.client.0.smithi088.stdout:0/598: creat df/d10/d22/d5f/fc6 x:0 0 0 2023-12-09T02:34:53.755 INFO:tasks.workunit.client.0.smithi088.stdout:2/597: unlink d6/fd 0 2023-12-09T02:34:53.755 INFO:tasks.workunit.client.0.smithi088.stdout:2/598: chown d6/d20/lbd 31510 1 2023-12-09T02:34:53.756 INFO:tasks.workunit.client.0.smithi088.stdout:0/599: link df/d28/l50 df/d28/d33/daf/lc7 0 2023-12-09T02:34:53.756 INFO:tasks.workunit.client.0.smithi088.stdout:0/600: getdents df/d28/d33/d81 0 2023-12-09T02:34:53.756 INFO:tasks.workunit.client.0.smithi088.stdout:0/601: chown df/d10/d22/d2d/d2e/f83 24554 1 2023-12-09T02:34:53.757 INFO:tasks.workunit.client.0.smithi088.stdout:0/602: mkdir df/d28/d34/dc8 0 2023-12-09T02:34:53.759 INFO:tasks.workunit.client.0.smithi088.stdout:0/603: creat df/d10/d22/dba/fc9 x:0 0 0 2023-12-09T02:34:53.763 INFO:tasks.workunit.client.0.smithi088.stdout:0/604: write df/d10/d22/f74 [411532,87793] 0 2023-12-09T02:34:53.767 INFO:tasks.workunit.client.0.smithi088.stdout:9/595: dwrite df/f2c [0,4194304] 0 2023-12-09T02:34:53.767 INFO:tasks.workunit.client.0.smithi088.stdout:9/596: fdatasync df/d20/d4c/f8e 0 2023-12-09T02:34:53.767 INFO:tasks.workunit.client.0.smithi088.stdout:4/650: dwrite d3/dc/d18/d29/fb8 [0,4194304] 0 2023-12-09T02:34:53.773 INFO:tasks.workunit.client.0.smithi088.stdout:3/529: dwrite d1/d9/f1b [0,4194304] 0 2023-12-09T02:34:53.773 INFO:tasks.workunit.client.0.smithi088.stdout:5/604: dwrite d3/d15/de/d10/d18/d19/d1b/d35/d42/d47/f98 [0,4194304] 0 2023-12-09T02:34:53.776 INFO:tasks.workunit.client.0.smithi088.stdout:4/651: write d3/dc/d1d/d40/f54 [1001191,23281] 0 2023-12-09T02:34:53.776 INFO:tasks.workunit.client.0.smithi088.stdout:3/530: unlink d1/d9/d6f/f32 0 2023-12-09T02:34:53.777 INFO:tasks.workunit.client.0.smithi088.stdout:3/531: fsync d1/d9/d6f/d2d/d66/f6e 0 2023-12-09T02:34:53.778 INFO:tasks.workunit.client.0.smithi088.stdout:8/647: dwrite d2/d9/d1a/f1f [0,4194304] 0 2023-12-09T02:34:53.779 INFO:tasks.workunit.client.0.smithi088.stdout:7/598: dwrite dc/d21/d6b/d6d/da4/f5e [0,4194304] 0 2023-12-09T02:34:53.779 INFO:tasks.workunit.client.0.smithi088.stdout:7/599: truncate dc/d1b/f57 4813539 0 2023-12-09T02:34:53.779 INFO:tasks.workunit.client.0.smithi088.stdout:2/599: dwrite d6/d13/d18/f19 [0,4194304] 0 2023-12-09T02:34:53.779 INFO:tasks.workunit.client.0.smithi088.stdout:5/605: truncate d3/d15/de/d10/d18/f4e 3371645 0 2023-12-09T02:34:53.780 INFO:tasks.workunit.client.0.smithi088.stdout:5/606: dread - d3/d15/de/d10/d18/d19/d1b/d35/f69 zero size 2023-12-09T02:34:53.788 INFO:tasks.workunit.client.0.smithi088.stdout:7/600: symlink dc/d21/d6b/ld5 0 2023-12-09T02:34:53.789 INFO:tasks.workunit.client.0.smithi088.stdout:8/648: symlink d2/d9/d70/d8f/le3 0 2023-12-09T02:34:53.792 INFO:tasks.workunit.client.0.smithi088.stdout:2/600: mkdir d6/d8/d4e/dc9 0 2023-12-09T02:34:53.792 INFO:tasks.workunit.client.0.smithi088.stdout:2/601: write d6/d8/f6d [357777,29378] 0 2023-12-09T02:34:53.794 INFO:tasks.workunit.client.0.smithi088.stdout:5/607: symlink d3/d15/de/d10/d18/d19/d1b/lca 0 2023-12-09T02:34:53.796 INFO:tasks.workunit.client.0.smithi088.stdout:9/597: dwrite df/d20/d30/d3f/fab [0,4194304] 0 2023-12-09T02:34:53.796 INFO:tasks.workunit.client.0.smithi088.stdout:9/598: write df/d20/d30/d3f/d48/dc4/fc5 [660656,118969] 0 2023-12-09T02:34:53.797 INFO:tasks.workunit.client.0.smithi088.stdout:7/601: unlink dc/d1b/d72/l9a 0 2023-12-09T02:34:53.799 INFO:tasks.workunit.client.0.smithi088.stdout:8/649: link d2/d9/d1a/d65/f67 d2/d9/d70/d8f/d98/fe4 0 2023-12-09T02:34:53.799 INFO:tasks.workunit.client.0.smithi088.stdout:8/650: chown d2/d9/d70/d8f/d98/fe4 63758 1 2023-12-09T02:34:53.800 INFO:tasks.workunit.client.0.smithi088.stdout:2/602: mknod d6/d8/d1f/cca 0 2023-12-09T02:34:53.800 INFO:tasks.workunit.client.0.smithi088.stdout:5/608: dread d3/d15/de/d10/d18/da5/fb8 [0,4194304] 0 2023-12-09T02:34:53.800 INFO:tasks.workunit.client.0.smithi088.stdout:4/652: dwrite d3/dc/d18/d7b/f62 [0,4194304] 0 2023-12-09T02:34:53.802 INFO:tasks.workunit.client.0.smithi088.stdout:9/599: mknod df/d50/da3/ccb 0 2023-12-09T02:34:53.803 INFO:tasks.workunit.client.0.smithi088.stdout:7/602: mknod dc/d1b/d91/dd2/cd6 0 2023-12-09T02:34:53.803 INFO:tasks.workunit.client.0.smithi088.stdout:7/603: chown dc/d21/f1a 184075712 1 2023-12-09T02:34:53.803 INFO:tasks.workunit.client.0.smithi088.stdout:7/604: truncate dc/d21/d6b/d6d/da4/d38/d1e/fc8 381003 0 2023-12-09T02:34:53.804 INFO:tasks.workunit.client.0.smithi088.stdout:7/605: chown dc/d1b/d89/la8 64851846 1 2023-12-09T02:34:53.804 INFO:tasks.workunit.client.0.smithi088.stdout:3/532: dwrite d1/d9/d6f/d6/f36 [0,4194304] 0 2023-12-09T02:34:53.805 INFO:tasks.workunit.client.0.smithi088.stdout:8/651: truncate d2/d9/d13/d15/f2d 1490381 0 2023-12-09T02:34:53.805 INFO:tasks.workunit.client.0.smithi088.stdout:8/652: fdatasync d2/d9/d1a/d62/f47 0 2023-12-09T02:34:53.805 INFO:tasks.workunit.client.0.smithi088.stdout:8/653: write d2/d9/d13/d15/fc7 [118127,118893] 0 2023-12-09T02:34:53.806 INFO:tasks.workunit.client.0.smithi088.stdout:3/533: write d1/d9/d6f/d6/f7b [3501389,129890] 0 2023-12-09T02:34:53.806 INFO:tasks.workunit.client.0.smithi088.stdout:3/534: read - d1/d3e/d9d/fa0 zero size 2023-12-09T02:34:53.806 INFO:tasks.workunit.client.0.smithi088.stdout:2/603: creat d6/d20/d9a/fcb x:0 0 0 2023-12-09T02:34:53.806 INFO:tasks.workunit.client.0.smithi088.stdout:2/604: chown d6/d8/f1d 3818849 1 2023-12-09T02:34:53.808 INFO:tasks.workunit.client.0.smithi088.stdout:5/609: truncate d3/d15/de/d2c/fa9 2545649 0 2023-12-09T02:34:53.808 INFO:tasks.workunit.client.0.smithi088.stdout:5/610: chown d3/d15/de/d10/d18/d19/d1b/d35/d42/f84 19 1 2023-12-09T02:34:53.809 INFO:tasks.workunit.client.0.smithi088.stdout:9/600: dread df/d50/d63/f82 [0,4194304] 0 2023-12-09T02:34:53.809 INFO:tasks.workunit.client.0.smithi088.stdout:4/653: mkdir d3/dc/d43/d8c/d99/dd1 0 2023-12-09T02:34:53.809 INFO:tasks.workunit.client.0.smithi088.stdout:5/611: write d3/d15/de/d10/d18/d19/d1b/d35/d42/f84 [451242,87546] 0 2023-12-09T02:34:53.809 INFO:tasks.workunit.client.0.smithi088.stdout:6/613: sync 2023-12-09T02:34:53.809 INFO:tasks.workunit.client.0.smithi088.stdout:1/737: sync 2023-12-09T02:34:53.809 INFO:tasks.workunit.client.0.smithi088.stdout:6/614: truncate d16/d1b/d25/d5f/f6e 960960 0 2023-12-09T02:34:53.810 INFO:tasks.workunit.client.0.smithi088.stdout:1/738: write d8/d1c/d50/d6c/fb2 [2007222,72892] 0 2023-12-09T02:34:53.811 INFO:tasks.workunit.client.0.smithi088.stdout:7/606: unlink dc/d21/d6b/d6d/da4/d3e/f7b 0 2023-12-09T02:34:53.811 INFO:tasks.workunit.client.0.smithi088.stdout:7/607: write dc/d21/d6b/d6d/da4/d3e/fb2 [359715,29802] 0 2023-12-09T02:34:53.812 INFO:tasks.workunit.client.0.smithi088.stdout:7/608: fsync dc/d21/d6b/d6d/d76/f98 0 2023-12-09T02:34:53.814 INFO:tasks.workunit.client.0.smithi088.stdout:2/605: dread f1 [0,4194304] 0 2023-12-09T02:34:53.821 INFO:tasks.workunit.client.0.smithi088.stdout:9/601: truncate df/d20/d4c/f56 987611 0 2023-12-09T02:34:53.822 INFO:tasks.workunit.client.0.smithi088.stdout:8/654: dwrite d2/d9/d1a/d65/fcb [0,4194304] 0 2023-12-09T02:34:53.822 INFO:tasks.workunit.client.0.smithi088.stdout:4/654: symlink d3/dc/d43/d8c/d95/daa/dc4/ld2 0 2023-12-09T02:34:53.823 INFO:tasks.workunit.client.0.smithi088.stdout:6/615: mknod d16/d35/d36/d97/cb4 0 2023-12-09T02:34:53.825 INFO:tasks.workunit.client.0.smithi088.stdout:1/739: rename d8/d1c/l56 to d8/d3d/d44/da4/l103 0 2023-12-09T02:34:53.826 INFO:tasks.workunit.client.0.smithi088.stdout:7/609: getdents dc/d21/d6b/d9b 0 2023-12-09T02:34:53.826 INFO:tasks.workunit.client.0.smithi088.stdout:1/740: dread d8/d3d/d5d/d95/f39 [0,4194304] 0 2023-12-09T02:34:53.827 INFO:tasks.workunit.client.0.smithi088.stdout:2/606: mknod d6/d8/d4e/d3c/ccc 0 2023-12-09T02:34:53.828 INFO:tasks.workunit.client.0.smithi088.stdout:2/607: read d6/d8/f1a [4546024,1783] 0 2023-12-09T02:34:53.828 INFO:tasks.workunit.client.0.smithi088.stdout:9/602: creat df/d20/d30/d3f/d48/dc4/fcc x:0 0 0 2023-12-09T02:34:53.828 INFO:tasks.workunit.client.0.smithi088.stdout:9/603: fdatasync df/d20/d30/d60/d5c/db9/fa5 0 2023-12-09T02:34:53.834 INFO:tasks.workunit.client.0.smithi088.stdout:7/610: dread dc/d21/d6b/d6d/da4/d3e/f62 [0,4194304] 0 2023-12-09T02:34:53.839 INFO:tasks.workunit.client.0.smithi088.stdout:3/535: rmdir d1/d9/d6f 39 2023-12-09T02:34:53.839 INFO:tasks.workunit.client.0.smithi088.stdout:3/536: dread - d1/d9/d6f/d6/d72/fa6 zero size 2023-12-09T02:34:53.848 INFO:tasks.workunit.client.0.smithi088.stdout:8/655: mknod d2/d9/d70/d8f/d98/d9b/ce5 0 2023-12-09T02:34:53.849 INFO:tasks.workunit.client.0.smithi088.stdout:4/655: write d3/dc/d43/d83/d37/fbe [1042560,42393] 0 2023-12-09T02:34:53.849 INFO:tasks.workunit.client.0.smithi088.stdout:6/616: creat d16/d1b/d25/d5f/fb5 x:0 0 0 2023-12-09T02:34:53.849 INFO:tasks.workunit.client.0.smithi088.stdout:3/537: dread d1/d9/d6f/d22/f6d [0,4194304] 0 2023-12-09T02:34:53.849 INFO:tasks.workunit.client.0.smithi088.stdout:3/538: stat d1/d9/d6f/d22/f96 0 2023-12-09T02:34:53.849 INFO:tasks.workunit.client.0.smithi088.stdout:2/608: mknod d6/d8/ccd 0 2023-12-09T02:34:53.849 INFO:tasks.workunit.client.0.smithi088.stdout:2/609: truncate d6/d8/f6d 410384 0 2023-12-09T02:34:53.850 INFO:tasks.workunit.client.0.smithi088.stdout:1/741: dwrite d8/d53/f89 [0,4194304] 0 2023-12-09T02:34:53.851 INFO:tasks.workunit.client.0.smithi088.stdout:7/611: rmdir dc/d1b/d72/dc4 39 2023-12-09T02:34:53.851 INFO:tasks.workunit.client.0.smithi088.stdout:7/612: readlink dc/d1b/d89/la8 0 2023-12-09T02:34:53.855 INFO:tasks.workunit.client.0.smithi088.stdout:2/610: dread d6/d8/f1a [0,4194304] 0 2023-12-09T02:34:53.856 INFO:tasks.workunit.client.0.smithi088.stdout:8/656: creat d2/d9/d1a/d62/fe6 x:0 0 0 2023-12-09T02:34:53.856 INFO:tasks.workunit.client.0.smithi088.stdout:1/742: rename d8/d3d/l74 to d8/d27/d40/da5/l104 0 2023-12-09T02:34:53.856 INFO:tasks.workunit.client.0.smithi088.stdout:6/617: mknod d16/d1b/d2c/cb6 0 2023-12-09T02:34:53.858 INFO:tasks.workunit.client.0.smithi088.stdout:2/611: mkdir d6/d20/d69/dce 0 2023-12-09T02:34:53.859 INFO:tasks.workunit.client.0.smithi088.stdout:9/604: dwrite df/f13 [0,4194304] 0 2023-12-09T02:34:53.859 INFO:tasks.workunit.client.0.smithi088.stdout:6/618: write f10 [2815110,17102] 0 2023-12-09T02:34:53.860 INFO:tasks.workunit.client.0.smithi088.stdout:6/619: chown d16/d1b/d56/f6c 6 1 2023-12-09T02:34:53.863 INFO:tasks.workunit.client.0.smithi088.stdout:2/612: write d6/d8/d4e/d3c/f53 [1640144,121596] 0 2023-12-09T02:34:53.864 INFO:tasks.workunit.client.0.smithi088.stdout:8/657: rename d2/d9/d13/d15/f81 to d2/fe7 0 2023-12-09T02:34:53.864 INFO:tasks.workunit.client.0.smithi088.stdout:9/605: mkdir df/d20/d4c/d84/dcd 0 2023-12-09T02:34:53.864 INFO:tasks.workunit.client.0.smithi088.stdout:3/539: creat d1/d9/d6f/d6/d4a/d41/d33/d49/fae x:0 0 0 2023-12-09T02:34:53.865 INFO:tasks.workunit.client.0.smithi088.stdout:2/613: creat d6/d20/d3a/d84/fcf x:0 0 0 2023-12-09T02:34:53.866 INFO:tasks.workunit.client.0.smithi088.stdout:8/658: mkdir d2/d9/d1a/d62/d9a/de8 0 2023-12-09T02:34:53.866 INFO:tasks.workunit.client.0.smithi088.stdout:8/659: write d2/d9/f27 [179230,74360] 0 2023-12-09T02:34:53.868 INFO:tasks.workunit.client.0.smithi088.stdout:9/606: creat df/d20/fce x:0 0 0 2023-12-09T02:34:53.868 INFO:tasks.workunit.client.0.smithi088.stdout:9/607: fsync df/d20/d5b/fb5 0 2023-12-09T02:34:53.868 INFO:tasks.workunit.client.0.smithi088.stdout:3/540: stat d1/d9/d6f/d6/c5a 0 2023-12-09T02:34:53.871 INFO:tasks.workunit.client.0.smithi088.stdout:8/660: truncate d2/d9/d13/d15/f18 4027847 0 2023-12-09T02:34:53.871 INFO:tasks.workunit.client.0.smithi088.stdout:8/661: write d2/d9/d1a/d62/d76/d85/fdc [935447,118036] 0 2023-12-09T02:34:53.873 INFO:tasks.workunit.client.0.smithi088.stdout:9/608: mknod df/d20/d30/d60/dc9/ccf 0 2023-12-09T02:34:53.873 INFO:tasks.workunit.client.0.smithi088.stdout:9/609: chown df/d29/f6a 35784 1 2023-12-09T02:34:53.874 INFO:tasks.workunit.client.0.smithi088.stdout:3/541: creat d1/d9/d6f/d6/d4a/faf x:0 0 0 2023-12-09T02:34:53.875 INFO:tasks.workunit.client.0.smithi088.stdout:3/542: dread d1/d9/f37 [0,4194304] 0 2023-12-09T02:34:53.875 INFO:tasks.workunit.client.0.smithi088.stdout:8/662: mknod d2/d9/d1a/d62/d76/d85/ce9 0 2023-12-09T02:34:53.880 INFO:tasks.workunit.client.0.smithi088.stdout:9/610: link df/d20/d5b/f8c df/d20/d4c/fd0 0 2023-12-09T02:34:53.880 INFO:tasks.workunit.client.0.smithi088.stdout:3/543: link d1/d9/d6f/d2d/d66/l93 d1/d9/d6f/d6/d4a/lb0 0 2023-12-09T02:34:53.882 INFO:tasks.workunit.client.0.smithi088.stdout:9/611: rename df/d20/d30/d3f/d48/dc4/fc5 to df/d20/d30/d60/d5c/db9/fd1 0 2023-12-09T02:34:53.882 INFO:tasks.workunit.client.0.smithi088.stdout:0/605: sync 2023-12-09T02:34:53.883 INFO:tasks.workunit.client.0.smithi088.stdout:3/544: mkdir d1/d3e/d9d/db1 0 2023-12-09T02:34:53.884 INFO:tasks.workunit.client.0.smithi088.stdout:5/612: dwrite d3/d15/dc/f2d [0,4194304] 0 2023-12-09T02:34:53.884 INFO:tasks.workunit.client.0.smithi088.stdout:9/612: mkdir df/d20/d30/d60/dc6/dd2 0 2023-12-09T02:34:53.886 INFO:tasks.workunit.client.0.smithi088.stdout:0/606: truncate df/d28/d34/f48 2004805 0 2023-12-09T02:34:53.886 INFO:tasks.workunit.client.0.smithi088.stdout:0/607: readlink df/l85 0 2023-12-09T02:34:53.886 INFO:tasks.workunit.client.0.smithi088.stdout:0/608: truncate df/d28/f95 1020604 0 2023-12-09T02:34:53.888 INFO:tasks.workunit.client.0.smithi088.stdout:5/613: write d3/d15/de/d10/d18/d19/d1b/f32 [4084170,45264] 0 2023-12-09T02:34:53.889 INFO:tasks.workunit.client.0.smithi088.stdout:7/613: dwrite dc/d1b/d72/dc4/fc7 [0,4194304] 0 2023-12-09T02:34:53.889 INFO:tasks.workunit.client.0.smithi088.stdout:7/614: truncate dc/d21/f8c 840311 0 2023-12-09T02:34:53.890 INFO:tasks.workunit.client.0.smithi088.stdout:3/545: write d1/d9/d6f/d15/f27 [2191283,56348] 0 2023-12-09T02:34:53.894 INFO:tasks.workunit.client.0.smithi088.stdout:7/615: symlink dc/d21/db1/ld7 0 2023-12-09T02:34:53.895 INFO:tasks.workunit.client.0.smithi088.stdout:7/616: dread dc/d21/d6b/d6d/da4/d38/d1e/f60 [0,4194304] 0 2023-12-09T02:34:53.895 INFO:tasks.workunit.client.0.smithi088.stdout:7/617: readlink dc/d21/d6b/d6d/da4/d38/d1e/l42 0 2023-12-09T02:34:53.897 INFO:tasks.workunit.client.0.smithi088.stdout:1/743: dwrite d8/d1c/f5a [4194304,4194304] 0 2023-12-09T02:34:53.897 INFO:tasks.workunit.client.0.smithi088.stdout:3/546: rename d1/d9/d6f/d6/d4a/d41/d33/f42 to d1/d9/d6f/d2d/d66/fb2 0 2023-12-09T02:34:53.899 INFO:tasks.workunit.client.0.smithi088.stdout:5/614: dread d3/f3d [0,4194304] 0 2023-12-09T02:34:53.899 INFO:tasks.workunit.client.0.smithi088.stdout:5/615: fdatasync d3/d15/de/d10/d51/db4/d9a/fb3 0 2023-12-09T02:34:53.899 INFO:tasks.workunit.client.0.smithi088.stdout:4/656: dwrite d3/dc/d43/d83/f55 [0,4194304] 0 2023-12-09T02:34:53.900 INFO:tasks.workunit.client.0.smithi088.stdout:7/618: dread dc/f18 [0,4194304] 0 2023-12-09T02:34:53.900 INFO:tasks.workunit.client.0.smithi088.stdout:6/620: dwrite d16/d1b/d25/d5f/f68 [0,4194304] 0 2023-12-09T02:34:53.900 INFO:tasks.workunit.client.0.smithi088.stdout:1/744: creat d8/d27/f105 x:0 0 0 2023-12-09T02:34:53.900 INFO:tasks.workunit.client.0.smithi088.stdout:1/745: read - d8/d27/d40/f8e zero size 2023-12-09T02:34:53.900 INFO:tasks.workunit.client.0.smithi088.stdout:3/547: write d1/d9/d6f/d6/d4a/d41/d33/d49/f4f [1521470,125111] 0 2023-12-09T02:34:53.900 INFO:tasks.workunit.client.0.smithi088.stdout:5/616: symlink d3/d15/de/d10/d51/d7f/lcb 0 2023-12-09T02:34:53.902 INFO:tasks.workunit.client.0.smithi088.stdout:4/657: mknod d3/dc/d43/d83/cd3 0 2023-12-09T02:34:53.902 INFO:tasks.workunit.client.0.smithi088.stdout:7/619: stat dc/d21/d6b/d6d/da4/d38/l65 0 2023-12-09T02:34:53.904 INFO:tasks.workunit.client.0.smithi088.stdout:6/621: mknod d16/d35/d36/cb7 0 2023-12-09T02:34:53.904 INFO:tasks.workunit.client.0.smithi088.stdout:1/746: stat d8/d27/d40/da5/l104 0 2023-12-09T02:34:53.906 INFO:tasks.workunit.client.0.smithi088.stdout:3/548: rmdir d1/d9/d6f/d22/d7f/d81 39 2023-12-09T02:34:53.906 INFO:tasks.workunit.client.0.smithi088.stdout:5/617: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/dcc 0 2023-12-09T02:34:53.908 INFO:tasks.workunit.client.0.smithi088.stdout:7/620: symlink dc/d21/ld8 0 2023-12-09T02:34:53.908 INFO:tasks.workunit.client.0.smithi088.stdout:7/621: fdatasync dc/d21/d6b/d6d/da4/d5d/fac 0 2023-12-09T02:34:53.908 INFO:tasks.workunit.client.0.smithi088.stdout:7/622: chown dc/d1b/d91/c9e 483836 1 2023-12-09T02:34:53.908 INFO:tasks.workunit.client.0.smithi088.stdout:7/623: fsync dc/d21/d6b/d6d/da4/d38/ff 0 2023-12-09T02:34:53.909 INFO:tasks.workunit.client.0.smithi088.stdout:6/622: creat d16/d62/da7/fb8 x:0 0 0 2023-12-09T02:34:53.909 INFO:tasks.workunit.client.0.smithi088.stdout:7/624: symlink dc/d21/d6b/d9b/ld9 0 2023-12-09T02:34:53.911 INFO:tasks.workunit.client.0.smithi088.stdout:6/623: link d16/d35/f6a d16/d35/d36/d97/d90/fb9 0 2023-12-09T02:34:53.911 INFO:tasks.workunit.client.0.smithi088.stdout:6/624: chown d16/d1b/d56/f6c 396548 1 2023-12-09T02:34:53.911 INFO:tasks.workunit.client.0.smithi088.stdout:6/625: chown d16/d1b/c54 356015 1 2023-12-09T02:34:53.913 INFO:tasks.workunit.client.0.smithi088.stdout:6/626: symlink d16/d1b/d2c/d3f/d41/d80/lba 0 2023-12-09T02:34:53.914 INFO:tasks.workunit.client.0.smithi088.stdout:2/614: dwrite d6/d13/d18/f48 [0,4194304] 0 2023-12-09T02:34:53.915 INFO:tasks.workunit.client.0.smithi088.stdout:8/663: dwrite d2/d9/d13/f2f [0,4194304] 0 2023-12-09T02:34:53.919 INFO:tasks.workunit.client.0.smithi088.stdout:2/615: mkdir d6/d20/d3a/d94/dd0 0 2023-12-09T02:34:53.921 INFO:tasks.workunit.client.0.smithi088.stdout:8/664: creat d2/db9/fea x:0 0 0 2023-12-09T02:34:53.922 INFO:tasks.workunit.client.0.smithi088.stdout:7/625: dread dc/d21/d6b/d9b/fce [0,4194304] 0 2023-12-09T02:34:53.925 INFO:tasks.workunit.client.0.smithi088.stdout:8/665: dread d2/d9/f27 [0,4194304] 0 2023-12-09T02:34:53.929 INFO:tasks.workunit.client.0.smithi088.stdout:2/616: rename d6/d13/d18/f48 to d6/d8/d4e/dc9/fd1 0 2023-12-09T02:34:53.929 INFO:tasks.workunit.client.0.smithi088.stdout:3/549: dread d1/fa [4194304,4194304] 0 2023-12-09T02:34:53.929 INFO:tasks.workunit.client.0.smithi088.stdout:9/613: dwrite df/d20/d30/f35 [0,4194304] 0 2023-12-09T02:34:53.930 INFO:tasks.workunit.client.0.smithi088.stdout:8/666: rmdir d2/d9/d13/d15/d6e/d9f 39 2023-12-09T02:34:53.932 INFO:tasks.workunit.client.0.smithi088.stdout:7/626: rename l4 to dc/d21/d6b/d6d/da4/d38/lda 0 2023-12-09T02:34:53.932 INFO:tasks.workunit.client.0.smithi088.stdout:7/627: chown dc/d1b/d72/fca 3424593 1 2023-12-09T02:34:53.932 INFO:tasks.workunit.client.0.smithi088.stdout:2/617: mknod d6/d20/d9a/cd2 0 2023-12-09T02:34:53.937 INFO:tasks.workunit.client.0.smithi088.stdout:3/550: creat d1/d9/d6f/d22/d7f/d81/d85/fb3 x:0 0 0 2023-12-09T02:34:53.940 INFO:tasks.workunit.client.0.smithi088.stdout:9/614: write df/d29/d2f/f37 [3594071,129340] 0 2023-12-09T02:34:53.940 INFO:tasks.workunit.client.0.smithi088.stdout:9/615: fsync df/f3d 0 2023-12-09T02:34:53.941 INFO:tasks.workunit.client.0.smithi088.stdout:1/747: dwrite d8/f38 [4194304,4194304] 0 2023-12-09T02:34:53.941 INFO:tasks.workunit.client.0.smithi088.stdout:4/658: dwrite d3/d65/f6f [0,4194304] 0 2023-12-09T02:34:53.944 INFO:tasks.workunit.client.0.smithi088.stdout:8/667: rename d2/c6 to d2/d9/d70/d8f/d98/ceb 0 2023-12-09T02:34:53.944 INFO:tasks.workunit.client.0.smithi088.stdout:6/627: dwrite d16/d35/f46 [0,4194304] 0 2023-12-09T02:34:53.944 INFO:tasks.workunit.client.0.smithi088.stdout:6/628: chown d16/d1b/d2c/f88 926737623 1 2023-12-09T02:34:53.946 INFO:tasks.workunit.client.0.smithi088.stdout:5/618: dwrite d3/d15/de/d10/d18/fa2 [0,4194304] 0 2023-12-09T02:34:53.946 INFO:tasks.workunit.client.0.smithi088.stdout:1/748: dread d8/d1b/d6d/d7c/fcd [0,4194304] 0 2023-12-09T02:34:53.947 INFO:tasks.workunit.client.0.smithi088.stdout:7/628: rmdir dc/d1b/d72/dc4 39 2023-12-09T02:34:53.947 INFO:tasks.workunit.client.0.smithi088.stdout:3/551: creat d1/d9/d6f/d15/fb4 x:0 0 0 2023-12-09T02:34:53.948 INFO:tasks.workunit.client.0.smithi088.stdout:9/616: link cd df/d20/cd3 0 2023-12-09T02:34:53.951 INFO:tasks.workunit.client.0.smithi088.stdout:8/668: mkdir d2/d9/d13/d1c/d5f/d96/dec 0 2023-12-09T02:34:53.954 INFO:tasks.workunit.client.0.smithi088.stdout:1/749: getdents d8/d3d/d44/da4/dcb/de3 0 2023-12-09T02:34:53.956 INFO:tasks.workunit.client.0.smithi088.stdout:7/629: symlink dc/d21/d6b/d6d/da4/d3e/d97/ldb 0 2023-12-09T02:34:53.957 INFO:tasks.workunit.client.0.smithi088.stdout:5/619: dread d3/d15/de/d10/d18/f4e [0,4194304] 0 2023-12-09T02:34:53.957 INFO:tasks.workunit.client.0.smithi088.stdout:9/617: read df/d20/d30/d60/d5c/f2a [4143000,113502] 0 2023-12-09T02:34:53.958 INFO:tasks.workunit.client.0.smithi088.stdout:3/552: mknod d1/d9/d6f/d22/d7f/d81/d85/cb5 0 2023-12-09T02:34:53.959 INFO:tasks.workunit.client.0.smithi088.stdout:8/669: unlink d2/c22 0 2023-12-09T02:34:53.960 INFO:tasks.workunit.client.0.smithi088.stdout:2/618: dwrite d6/d8/d4e/d3c/f50 [0,4194304] 0 2023-12-09T02:34:53.960 INFO:tasks.workunit.client.0.smithi088.stdout:4/659: dwrite d3/dc/f12 [0,4194304] 0 2023-12-09T02:34:53.960 INFO:tasks.workunit.client.0.smithi088.stdout:4/660: chown d3/dc/d43/d8c 198 1 2023-12-09T02:34:53.960 INFO:tasks.workunit.client.0.smithi088.stdout:6/629: creat d16/d62/d87/d8a/fbb x:0 0 0 2023-12-09T02:34:53.961 INFO:tasks.workunit.client.0.smithi088.stdout:5/620: rmdir d3/d15/dc/d60/d9d 39 2023-12-09T02:34:53.962 INFO:tasks.workunit.client.0.smithi088.stdout:7/630: dread dc/d21/d6b/d6d/da4/d38/d1e/f39 [0,4194304] 0 2023-12-09T02:34:53.963 INFO:tasks.workunit.client.0.smithi088.stdout:4/661: dread d3/dc/d1d/f9d [0,4194304] 0 2023-12-09T02:34:53.963 INFO:tasks.workunit.client.0.smithi088.stdout:9/618: mknod df/d50/da3/cd4 0 2023-12-09T02:34:53.963 INFO:tasks.workunit.client.0.smithi088.stdout:9/619: dread - df/d50/d63/f80 zero size 2023-12-09T02:34:53.963 INFO:tasks.workunit.client.0.smithi088.stdout:9/620: readlink df/d20/d5b/l7a 0 2023-12-09T02:34:53.963 INFO:tasks.workunit.client.0.smithi088.stdout:9/621: fsync df/d20/d30/d4e/fbf 0 2023-12-09T02:34:53.963 INFO:tasks.workunit.client.0.smithi088.stdout:4/662: write d3/f89 [697127,5053] 0 2023-12-09T02:34:53.964 INFO:tasks.workunit.client.0.smithi088.stdout:3/553: rmdir d1/d3e/d9d 39 2023-12-09T02:34:53.964 INFO:tasks.workunit.client.0.smithi088.stdout:8/670: write d2/d9/d13/d15/d6e/d9f/fba [2953486,82851] 0 2023-12-09T02:34:53.964 INFO:tasks.workunit.client.0.smithi088.stdout:2/619: mkdir d6/d8/d1f/d22/d68/dd3 0 2023-12-09T02:34:53.965 INFO:tasks.workunit.client.0.smithi088.stdout:2/620: stat d6/d20/d3a/d84/fcf 0 2023-12-09T02:34:53.965 INFO:tasks.workunit.client.0.smithi088.stdout:6/630: rename d16/d35/d65 to d16/d35/d65/dbc 22 2023-12-09T02:34:53.967 INFO:tasks.workunit.client.0.smithi088.stdout:5/621: symlink d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/lcd 0 2023-12-09T02:34:54.068 INFO:tasks.workunit.client.0.smithi088.stdout:5/622: write d3/f24 [8596774,75433] 0 2023-12-09T02:34:54.075 INFO:tasks.workunit.client.0.smithi088.stdout:7/631: symlink dc/d21/d6b/d93/ldc 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:4/663: mknod d3/d65/db0/dc1/cd4 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:3/554: dread d1/d9/d6f/d6/d4a/f38 [0,4194304] 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:3/555: readlink d1/d9/l7d 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:8/671: unlink d2/d9/d1a/d62/d76/d85/f8c 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:2/621: rmdir d6/d8/d4e/d3c 39 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:1/750: dwrite d8/d1b/f6a [4194304,4194304] 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:6/631: symlink d16/d1b/d2c/d3f/d9c/lbd 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:6/632: write d16/d35/d36/fa3 [64620,20717] 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:5/623: creat d3/d15/fce x:0 0 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:7/632: symlink dc/d21/d6b/d6d/d76/db9/ldd 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:3/556: dread d1/d9/d6f/d22/d7f/f4d [0,4194304] 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:8/672: mknod d2/d9/d70/d8f/da8/dbe/ced 0 2023-12-09T02:34:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:2/622: link d6/d8/d54/c60 d6/d20/d69/db2/db4/cd4 0 2023-12-09T02:34:54.077 INFO:tasks.workunit.client.0.smithi088.stdout:2/623: chown d6/d20/d69/db2/dc2 258115397 1 2023-12-09T02:34:54.077 INFO:tasks.workunit.client.0.smithi088.stdout:2/624: chown d6/d20/d3d/f61 264153 1 2023-12-09T02:34:54.077 INFO:tasks.workunit.client.0.smithi088.stdout:1/751: creat d8/d3d/f106 x:0 0 0 2023-12-09T02:34:54.077 INFO:tasks.workunit.client.0.smithi088.stdout:1/752: write d8/d1c/f3b [943724,71079] 0 2023-12-09T02:34:54.077 INFO:tasks.workunit.client.0.smithi088.stdout:9/622: dwrite df/d20/d5b/f95 [0,4194304] 0 2023-12-09T02:34:54.077 INFO:tasks.workunit.client.0.smithi088.stdout:5/624: mknod d3/d15/de/d10/d51/dc9/dc4/ccf 0 2023-12-09T02:34:54.077 INFO:tasks.workunit.client.0.smithi088.stdout:5/625: chown d3/d15/dc/c30 1 1 2023-12-09T02:34:54.077 INFO:tasks.workunit.client.0.smithi088.stdout:7/633: mkdir dc/d21/d6b/d6d/da4/d3e/dde 0 2023-12-09T02:34:54.077 INFO:tasks.workunit.client.0.smithi088.stdout:4/664: dwrite d3/f39 [0,4194304] 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:3/557: mknod d1/d9/d6f/d70/cb6 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:3/558: stat d1/d9/d6f/d15 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:3/559: truncate d1/d9/d6f/d6/d83/f8c 590555 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:3/560: truncate d1/d9/f37 1296588 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:2/625: truncate f1 1319531 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:6/633: dread d16/d1b/d25/f27 [0,4194304] 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:5/626: dread d3/d15/de/d10/d18/d19/fbf [0,4194304] 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:6/634: read d16/d1b/f1d [2644032,78219] 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:7/634: mknod dc/d21/d6b/d6d/dc1/cdf 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:9/623: dread df/d20/f5f [0,4194304] 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:3/561: truncate d1/d3e/f97 4042371 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:2/626: rename d6/d8/d4e/d47/c98 to d6/d20/d3a/d84/cd5 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:6/635: stat d16/c20 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:7/635: creat dc/fe0 x:0 0 0 2023-12-09T02:34:54.078 INFO:tasks.workunit.client.0.smithi088.stdout:7/636: readlink dc/d21/d6b/d6d/d76/l96 0 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:7/637: chown dc/d1b/d72/fca 1434 1 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:7/638: chown dc/d21/d6b/d6d/fad 680482 1 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:2/627: dread d6/d20/d3d/f83 [0,4194304] 0 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:2/628: fdatasync d6/d20/d3a/d84/fcf 0 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:2/629: getdents d6/d20/d69/dce 0 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:2/630: dread d6/d20/d3d/f61 [0,4194304] 0 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:2/631: fsync d6/f5d 0 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:2/632: rename d6/d8/d4e/d47 to d6/d8/d4e/d47/dd6 22 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:3/562: mknod d1/d73/cb7 0 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:3/563: truncate d1/d9/d6f/d6/d4a/faf 186155 0 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:7/639: symlink dc/d21/d6b/d6d/d76/le1 0 2023-12-09T02:34:54.079 INFO:tasks.workunit.client.0.smithi088.stdout:2/633: mknod d6/d20/d3a/d94/cd7 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/640: getdents dc/d1b/d91/dd2 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/641: dread dc/d21/d6b/d6d/da4/d38/d1e/fc8 [0,4194304] 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:2/634: symlink d6/d20/d69/db2/db4/ld8 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:2/635: read d6/d8/f30 [162398,89483] 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/642: mkdir dc/dcb/de2 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/643: readlink dc/l79 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:8/673: dwrite d2/d9/d13/d15/d6e/d9f/fba [0,4194304] 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/644: write dc/d21/d6b/d9b/fce [3592533,97186] 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:2/636: creat d6/d20/d3a/fd9 x:0 0 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:2/637: dread - d6/d8/fc8 zero size 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:2/638: truncate d6/d8/d4e/d3c/f8c 521978 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/645: creat dc/d21/d6b/d6d/da4/d3e/d97/fe3 x:0 0 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/646: read dc/d21/d6b/d6d/da4/d38/d1e/f39 [213313,19493] 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/647: stat dc/d21/d6b/d6d/da4/d38/d1e/c46 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/648: write dc/d21/d6b/d6d/da4/f48 [1844347,99273] 0 2023-12-09T02:34:54.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/649: chown dc/d1b/d72/f8d 204682498 1 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/650: write dc/d1b/f81 [347930,92690] 0 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/651: chown dc/d21/d6b/d6d/da4/d3e/f92 1958407 1 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/652: getdents dc/d21/d6b/d6d/da4/d3e/dde 0 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/653: write dc/f47 [4270487,88151] 0 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/654: fsync dc/d21/f61 0 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/655: fsync dc/d1b/d66/f8e 0 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:2/639: symlink d6/d13/d42/lda 0 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:2/640: chown d6/d20/d3a/d82 76758873 1 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:2/641: chown d6/d20/d3d/l67 675520378 1 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/656: write dc/fc3 [236821,83875] 0 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:4/665: dwrite d3/dc/d18/d29/fa0 [0,4194304] 0 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:5/627: dwrite d3/d15/de/d10/d18/f4a [0,4194304] 0 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:9/624: dwrite df/d50/d63/f80 [0,4194304] 0 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:5/628: write d3/d15/de/d10/d18/d19/d1b/d35/d42/d47/f98 [2184907,96181] 0 2023-12-09T02:34:54.081 INFO:tasks.workunit.client.0.smithi088.stdout:6/636: dwrite d16/d1b/d2c/d3f/f61 [0,4194304] 0 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:3/564: dwrite d1/d9/d6f/d2d/d66/f7a [0,4194304] 0 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:6/637: creat d16/d62/d87/fbe x:0 0 0 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:6/638: chown d16/d35/d36/d97/d90 546 1 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:8/674: dwrite d2/d9/d13/d1c/f20 [0,4194304] 0 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:3/565: unlink d1/d9/d6f/d6/f7b 0 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:3/566: dread - d1/d9/d6f/d6/f99 zero size 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:3/567: truncate d1/d9/d6f/d2d/d66/fa9 674647 0 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:3/568: dread d1/f6c [0,4194304] 0 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:3/569: chown d1/d9/d6f/d2d/dab 11817187 1 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:3/570: fsync d1/d9/d6f/d2d/f46 0 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:3/571: rmdir d1/d3e/d9d 39 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:8/675: dread d2/d9/d13/d15/d6e/d9f/f86 [0,4194304] 0 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:0/609: sync 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:0/610: chown df/d10/d22/d5f/fb6 202 1 2023-12-09T02:34:54.082 INFO:tasks.workunit.client.0.smithi088.stdout:3/572: dread d1/d9/d6f/d15/f27 [0,4194304] 0 2023-12-09T02:34:54.083 INFO:tasks.workunit.client.0.smithi088.stdout:3/573: write d1/d9/d6f/d15/fa3 [303836,116660] 0 2023-12-09T02:34:54.083 INFO:tasks.workunit.client.0.smithi088.stdout:3/574: write d1/f6c [3009958,20419] 0 2023-12-09T02:34:54.083 INFO:tasks.workunit.client.0.smithi088.stdout:3/575: dread - d1/d9/d6f/d6/d4a/f5b zero size 2023-12-09T02:34:54.083 INFO:tasks.workunit.client.0.smithi088.stdout:3/576: creat d1/d58/fb8 x:0 0 0 2023-12-09T02:34:54.083 INFO:tasks.workunit.client.0.smithi088.stdout:2/642: dwrite d6/d8/d54/f65 [0,4194304] 0 2023-12-09T02:34:54.083 INFO:tasks.workunit.client.0.smithi088.stdout:4/666: dwrite d3/dc/d1d/f9d [0,4194304] 0 2023-12-09T02:34:54.084 INFO:tasks.workunit.client.0.smithi088.stdout:4/667: rmdir d3/dc/d43/d8c 39 2023-12-09T02:34:54.085 INFO:tasks.workunit.client.0.smithi088.stdout:2/643: rmdir d6/d20/d69/dce 0 2023-12-09T02:34:54.085 INFO:tasks.workunit.client.0.smithi088.stdout:2/644: readlink d6/l85 0 2023-12-09T02:34:54.086 INFO:tasks.workunit.client.0.smithi088.stdout:2/645: truncate d6/d8/d73/d78/f8a 1287604 0 2023-12-09T02:34:54.086 INFO:tasks.workunit.client.0.smithi088.stdout:4/668: dread d3/dc/f10 [0,4194304] 0 2023-12-09T02:34:54.088 INFO:tasks.workunit.client.0.smithi088.stdout:2/646: mkdir d6/d20/d3a/d94/dad/ddb 0 2023-12-09T02:34:54.088 INFO:tasks.workunit.client.0.smithi088.stdout:2/647: write d6/d8/d4e/d3c/fb5 [554662,99168] 0 2023-12-09T02:34:54.088 INFO:tasks.workunit.client.0.smithi088.stdout:2/648: chown d6/d20/d3d/f61 0 1 2023-12-09T02:34:54.088 INFO:tasks.workunit.client.0.smithi088.stdout:7/657: dwrite dc/d21/f8c [0,4194304] 0 2023-12-09T02:34:54.094 INFO:tasks.workunit.client.0.smithi088.stdout:3/577: rename d1/d58 to d1/d9/d6f/d2d/db9 0 2023-12-09T02:34:54.094 INFO:tasks.workunit.client.0.smithi088.stdout:3/578: dread - d1/d3e/d9d/fa0 zero size 2023-12-09T02:34:54.095 INFO:tasks.workunit.client.0.smithi088.stdout:3/579: write d1/d9/d6f/d6/f3f [1426831,59311] 0 2023-12-09T02:34:54.095 INFO:tasks.workunit.client.0.smithi088.stdout:2/649: dread f4 [0,4194304] 0 2023-12-09T02:34:54.096 INFO:tasks.workunit.client.0.smithi088.stdout:3/580: creat d1/d9/d6f/d6/d8b/fba x:0 0 0 2023-12-09T02:34:54.097 INFO:tasks.workunit.client.0.smithi088.stdout:0/611: dwrite df/d28/f3b [0,4194304] 0 2023-12-09T02:34:54.097 INFO:tasks.workunit.client.0.smithi088.stdout:6/639: dwrite d16/d1b/d2c/d3f/d41/d80/f81 [0,4194304] 0 2023-12-09T02:34:54.103 INFO:tasks.workunit.client.0.smithi088.stdout:8/676: dwrite d2/d9/d13/d1c/d5f/fa4 [4194304,4194304] 0 2023-12-09T02:34:54.103 INFO:tasks.workunit.client.0.smithi088.stdout:2/650: truncate d6/d13/f1e 1360247 0 2023-12-09T02:34:54.103 INFO:tasks.workunit.client.0.smithi088.stdout:5/629: dwrite d3/d15/de/d10/d18/d19/d1b/d35/d42/f21 [0,4194304] 0 2023-12-09T02:34:54.103 INFO:tasks.workunit.client.0.smithi088.stdout:0/612: write df/d10/d22/d2d/d2e/fb5 [876903,85735] 0 2023-12-09T02:34:54.104 INFO:tasks.workunit.client.0.smithi088.stdout:8/677: symlink d2/d9/d13/d15/lee 0 2023-12-09T02:34:54.110 INFO:tasks.workunit.client.0.smithi088.stdout:5/630: symlink d3/d15/de/d10/d18/da5/ld0 0 2023-12-09T02:34:54.110 INFO:tasks.workunit.client.0.smithi088.stdout:5/631: readlink d3/d15/de/d10/d51/d70/l79 0 2023-12-09T02:34:54.116 INFO:tasks.workunit.client.0.smithi088.stdout:6/640: dread f9 [0,4194304] 0 2023-12-09T02:34:54.117 INFO:tasks.workunit.client.0.smithi088.stdout:6/641: getdents d16/d1b/d2c/d3f/d41 0 2023-12-09T02:34:54.118 INFO:tasks.workunit.client.0.smithi088.stdout:6/642: creat d16/d35/d36/d97/d90/fbf x:0 0 0 2023-12-09T02:34:54.119 INFO:tasks.workunit.client.0.smithi088.stdout:6/643: creat d16/d35/d65/fc0 x:0 0 0 2023-12-09T02:34:54.120 INFO:tasks.workunit.client.0.smithi088.stdout:0/613: dread df/d28/d43/f79 [0,4194304] 0 2023-12-09T02:34:54.121 INFO:tasks.workunit.client.0.smithi088.stdout:0/614: unlink df/d10/d22/f27 0 2023-12-09T02:34:54.122 INFO:tasks.workunit.client.0.smithi088.stdout:0/615: creat df/d28/d34/dc8/fca x:0 0 0 2023-12-09T02:34:54.122 INFO:tasks.workunit.client.0.smithi088.stdout:0/616: mkdir df/d37/d70/dcb 0 2023-12-09T02:34:54.124 INFO:tasks.workunit.client.0.smithi088.stdout:0/617: creat df/d10/d22/d5b/fcc x:0 0 0 2023-12-09T02:34:54.124 INFO:tasks.workunit.client.0.smithi088.stdout:0/618: write df/d28/d43/f4f [1515113,37027] 0 2023-12-09T02:34:54.124 INFO:tasks.workunit.client.0.smithi088.stdout:0/619: fdatasync df/d37/d70/f98 0 2023-12-09T02:34:54.124 INFO:tasks.workunit.client.0.smithi088.stdout:0/620: write df/d10/d22/d5f/fc6 [1006428,55972] 0 2023-12-09T02:34:54.133 INFO:tasks.workunit.client.0.smithi088.stdout:5/632: dread d3/d15/de/d10/d51/d7f/f86 [0,4194304] 0 2023-12-09T02:34:54.134 INFO:tasks.workunit.client.0.smithi088.stdout:5/633: truncate d3/d15/de/d10/d51/d70/fbb 723083 0 2023-12-09T02:34:54.135 INFO:tasks.workunit.client.0.smithi088.stdout:5/634: symlink d3/d15/de/d10/d18/d19/d1b/d35/ld1 0 2023-12-09T02:34:54.136 INFO:tasks.workunit.client.0.smithi088.stdout:5/635: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d58/dd2 0 2023-12-09T02:34:54.137 INFO:tasks.workunit.client.0.smithi088.stdout:5/636: creat d3/d15/dc/fd3 x:0 0 0 2023-12-09T02:34:54.138 INFO:tasks.workunit.client.0.smithi088.stdout:5/637: mknod d3/d15/de/d10/d18/d19/d1b/cd4 0 2023-12-09T02:34:54.138 INFO:tasks.workunit.client.0.smithi088.stdout:4/669: dwrite d3/f4 [0,4194304] 0 2023-12-09T02:34:54.139 INFO:tasks.workunit.client.0.smithi088.stdout:4/670: chown d3/dc/d43/c6c 581568 1 2023-12-09T02:34:54.140 INFO:tasks.workunit.client.0.smithi088.stdout:4/671: mknod d3/d65/cd5 0 2023-12-09T02:34:54.141 INFO:tasks.workunit.client.0.smithi088.stdout:4/672: write d3/dc/d43/d8c/d95/f9c [482795,40813] 0 2023-12-09T02:34:54.142 INFO:tasks.workunit.client.0.smithi088.stdout:4/673: mknod d3/dc/cd6 0 2023-12-09T02:34:54.142 INFO:tasks.workunit.client.0.smithi088.stdout:4/674: write d3/f9 [4847035,56027] 0 2023-12-09T02:34:54.142 INFO:tasks.workunit.client.0.smithi088.stdout:5/638: dread d3/d15/de/d10/d51/d7f/f82 [0,4194304] 0 2023-12-09T02:34:54.142 INFO:tasks.workunit.client.0.smithi088.stdout:4/675: chown d3/dc/d18/d29/c35 0 1 2023-12-09T02:34:54.144 INFO:tasks.workunit.client.0.smithi088.stdout:5/639: creat d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/fd5 x:0 0 0 2023-12-09T02:34:54.147 INFO:tasks.workunit.client.0.smithi088.stdout:7/658: dwrite dc/fc3 [0,4194304] 0 2023-12-09T02:34:54.147 INFO:tasks.workunit.client.0.smithi088.stdout:3/581: dwrite d1/d9/d6f/d22/f96 [0,4194304] 0 2023-12-09T02:34:54.147 INFO:tasks.workunit.client.0.smithi088.stdout:5/640: mkdir d3/d15/d2e/d49/d88/dd6 0 2023-12-09T02:34:54.150 INFO:tasks.workunit.client.0.smithi088.stdout:7/659: mkdir dc/d1b/de4 0 2023-12-09T02:34:54.150 INFO:tasks.workunit.client.0.smithi088.stdout:7/660: chown dc/d1b/d72/c77 0 1 2023-12-09T02:34:54.150 INFO:tasks.workunit.client.0.smithi088.stdout:7/661: fdatasync dc/d21/d6b/d6d/da4/d38/f49 0 2023-12-09T02:34:54.151 INFO:tasks.workunit.client.0.smithi088.stdout:8/678: dwrite d2/d9/d1a/d62/fc8 [0,4194304] 0 2023-12-09T02:34:54.152 INFO:tasks.workunit.client.0.smithi088.stdout:4/676: dread d3/dc/f96 [0,4194304] 0 2023-12-09T02:34:54.152 INFO:tasks.workunit.client.0.smithi088.stdout:6/644: dwrite d16/d1b/d25/f3b [0,4194304] 0 2023-12-09T02:34:54.152 INFO:tasks.workunit.client.0.smithi088.stdout:2/651: dwrite d6/d8/fc8 [0,4194304] 0 2023-12-09T02:34:54.152 INFO:tasks.workunit.client.0.smithi088.stdout:0/621: dwrite fc [0,4194304] 0 2023-12-09T02:34:54.154 INFO:tasks.workunit.client.0.smithi088.stdout:3/582: mknod d1/d9/d6f/d6/d83/cbb 0 2023-12-09T02:34:54.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/583: write d1/d9/d6f/d6/d72/f76 [297887,85731] 0 2023-12-09T02:34:54.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/584: chown d1/d9/d6f/d6/d83 7577252 1 2023-12-09T02:34:54.155 INFO:tasks.workunit.client.0.smithi088.stdout:5/641: mkdir d3/d15/de/d10/d51/db4/dd7 0 2023-12-09T02:34:54.159 INFO:tasks.workunit.client.0.smithi088.stdout:4/677: mkdir d3/dc/d18/dab/dc7/dd7 0 2023-12-09T02:34:54.159 INFO:tasks.workunit.client.0.smithi088.stdout:4/678: write d3/dc/d1d/f71 [753793,97912] 0 2023-12-09T02:34:54.159 INFO:tasks.workunit.client.0.smithi088.stdout:8/679: mknod d2/d9/d13/d15/d6e/d9f/cef 0 2023-12-09T02:34:54.160 INFO:tasks.workunit.client.0.smithi088.stdout:1/753: sync 2023-12-09T02:34:54.160 INFO:tasks.workunit.client.0.smithi088.stdout:1/754: write d8/d1b/d1d/ddf/fea [883623,119087] 0 2023-12-09T02:34:54.160 INFO:tasks.workunit.client.0.smithi088.stdout:1/755: readlink d8/d1b/l43 0 2023-12-09T02:34:54.160 INFO:tasks.workunit.client.0.smithi088.stdout:1/756: readlink d8/d1b/d6d/lb0 0 2023-12-09T02:34:54.161 INFO:tasks.workunit.client.0.smithi088.stdout:4/679: dread d3/dc/d1d/f57 [0,4194304] 0 2023-12-09T02:34:54.165 INFO:tasks.workunit.client.0.smithi088.stdout:2/652: rmdir d6/d8/d1f/d22 39 2023-12-09T02:34:54.165 INFO:tasks.workunit.client.0.smithi088.stdout:6/645: stat d16/d35/d36/cab 0 2023-12-09T02:34:54.165 INFO:tasks.workunit.client.0.smithi088.stdout:2/653: write d6/d8/f6d [15730,22435] 0 2023-12-09T02:34:54.167 INFO:tasks.workunit.client.0.smithi088.stdout:5/642: mkdir d3/d15/d2e/d49/d88/dd8 0 2023-12-09T02:34:54.167 INFO:tasks.workunit.client.0.smithi088.stdout:5/643: chown d3/d15/de/lae 26743 1 2023-12-09T02:34:54.171 INFO:tasks.workunit.client.0.smithi088.stdout:1/757: rename d8/d27/d66/d79/ddc/ff8 to d8/d3d/d44/da4/f107 0 2023-12-09T02:34:54.171 INFO:tasks.workunit.client.0.smithi088.stdout:1/758: write d8/d27/d75/fcc [109289,126597] 0 2023-12-09T02:34:54.173 INFO:tasks.workunit.client.0.smithi088.stdout:4/680: mkdir d3/dc/d43/dc5/dd8 0 2023-12-09T02:34:54.174 INFO:tasks.workunit.client.0.smithi088.stdout:6/646: unlink l13 0 2023-12-09T02:34:54.177 INFO:tasks.workunit.client.0.smithi088.stdout:3/585: symlink d1/d9/d6f/lbc 0 2023-12-09T02:34:54.178 INFO:tasks.workunit.client.0.smithi088.stdout:2/654: rename d6/d8/d1f/d22/f52 to d6/d8/d73/d78/fdc 0 2023-12-09T02:34:54.179 INFO:tasks.workunit.client.0.smithi088.stdout:1/759: mkdir d8/d1b/d1d/dc7/d108 0 2023-12-09T02:34:54.179 INFO:tasks.workunit.client.0.smithi088.stdout:1/760: write d8/d3d/d5d/d95/dac/fb4 [4273908,115709] 0 2023-12-09T02:34:54.180 INFO:tasks.workunit.client.0.smithi088.stdout:3/586: creat d1/d9/d6f/d22/fbd x:0 0 0 2023-12-09T02:34:54.181 INFO:tasks.workunit.client.0.smithi088.stdout:1/761: getdents d8/d1b/d6d/d7c/dc0 0 2023-12-09T02:34:54.183 INFO:tasks.workunit.client.0.smithi088.stdout:5/644: rename d3/d15/d2e/f77 to d3/d15/de/fd9 0 2023-12-09T02:34:54.185 INFO:tasks.workunit.client.0.smithi088.stdout:1/762: unlink d8/f19 0 2023-12-09T02:34:54.188 INFO:tasks.workunit.client.0.smithi088.stdout:5/645: creat d3/fda x:0 0 0 2023-12-09T02:34:54.190 INFO:tasks.workunit.client.0.smithi088.stdout:4/681: dread d3/dc/d18/d7b/f62 [0,4194304] 0 2023-12-09T02:34:54.190 INFO:tasks.workunit.client.0.smithi088.stdout:2/655: rename d6/d13/d18/f28 to d6/d20/d3a/fdd 0 2023-12-09T02:34:54.190 INFO:tasks.workunit.client.0.smithi088.stdout:1/763: write d8/d1b/f20 [2740513,49612] 0 2023-12-09T02:34:54.192 INFO:tasks.workunit.client.0.smithi088.stdout:4/682: mknod d3/dc/d43/d8c/cd9 0 2023-12-09T02:34:54.194 INFO:tasks.workunit.client.0.smithi088.stdout:5/646: rename d3/d15/de/d10/d18/da5/fb8 to d3/d15/de/d10/d51/db4/dd7/fdb 0 2023-12-09T02:34:54.195 INFO:tasks.workunit.client.0.smithi088.stdout:0/622: dwrite df/d10/f29 [0,4194304] 0 2023-12-09T02:34:54.195 INFO:tasks.workunit.client.0.smithi088.stdout:7/662: dwrite dc/d1b/f5c [0,4194304] 0 2023-12-09T02:34:54.196 INFO:tasks.workunit.client.0.smithi088.stdout:4/683: mkdir d3/dc/d1d/d40/d9f/dc8/dda 0 2023-12-09T02:34:54.196 INFO:tasks.workunit.client.0.smithi088.stdout:9/625: sync 2023-12-09T02:34:54.197 INFO:tasks.workunit.client.0.smithi088.stdout:8/680: dwrite d2/d9/d13/d15/fa0 [0,4194304] 0 2023-12-09T02:34:54.197 INFO:tasks.workunit.client.0.smithi088.stdout:8/681: stat d2/d9/d13/d1c/f5a 0 2023-12-09T02:34:54.197 INFO:tasks.workunit.client.0.smithi088.stdout:8/682: write d2/f41 [4611235,61818] 0 2023-12-09T02:34:54.197 INFO:tasks.workunit.client.0.smithi088.stdout:8/683: truncate d2/d9/d13/d1c/fd3 111082 0 2023-12-09T02:34:54.201 INFO:tasks.workunit.client.0.smithi088.stdout:5/647: unlink d3/d15/de/d10/d51/db4/d9a/fb3 0 2023-12-09T02:34:54.201 INFO:tasks.workunit.client.0.smithi088.stdout:5/648: fsync d3/d15/de/d10/d18/d19/d1b/d35/f69 0 2023-12-09T02:34:54.201 INFO:tasks.workunit.client.0.smithi088.stdout:5/649: readlink d3/d8/l3b 0 2023-12-09T02:34:54.202 INFO:tasks.workunit.client.0.smithi088.stdout:0/623: mknod df/d10/d22/d5f/ccd 0 2023-12-09T02:34:54.207 INFO:tasks.workunit.client.0.smithi088.stdout:7/663: unlink dc/d21/d6b/d6d/da4/d3e/d97/la2 0 2023-12-09T02:34:54.208 INFO:tasks.workunit.client.0.smithi088.stdout:4/684: link d3/dc/d18/d7b/dbb/dbc/f8e d3/dc/d18/da9/fdb 0 2023-12-09T02:34:54.211 INFO:tasks.workunit.client.0.smithi088.stdout:9/626: symlink df/d20/d30/d60/d5c/db9/ld5 0 2023-12-09T02:34:54.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/656: getdents d6/d13/d18 0 2023-12-09T02:34:54.220 INFO:tasks.workunit.client.0.smithi088.stdout:3/587: dwrite d1/d9/d6f/d6/d4a/f38 [0,4194304] 0 2023-12-09T02:34:54.223 INFO:tasks.workunit.client.0.smithi088.stdout:5/650: rename d3/d15/de/f7b to d3/d15/de/d10/d51/d7f/fdc 0 2023-12-09T02:34:54.223 INFO:tasks.workunit.client.0.smithi088.stdout:5/651: write d3/d15/de/d10/d18/d19/d1b/f32 [4710812,77249] 0 2023-12-09T02:34:54.223 INFO:tasks.workunit.client.0.smithi088.stdout:5/652: readlink d3/d15/de/d10/d18/d19/d20/l5d 0 2023-12-09T02:34:54.223 INFO:tasks.workunit.client.0.smithi088.stdout:5/653: dread - d3/d15/de/d10/d51/d70/fa1 zero size 2023-12-09T02:34:54.224 INFO:tasks.workunit.client.0.smithi088.stdout:0/624: getdents df/d10/d22/da0 0 2023-12-09T02:34:54.224 INFO:tasks.workunit.client.0.smithi088.stdout:0/625: dread - df/d28/f9f zero size 2023-12-09T02:34:54.224 INFO:tasks.workunit.client.0.smithi088.stdout:1/764: dwrite d8/d1b/d6d/d7c/fbe [0,4194304] 0 2023-12-09T02:34:54.225 INFO:tasks.workunit.client.0.smithi088.stdout:8/684: dwrite d2/d9/f3c [0,4194304] 0 2023-12-09T02:34:54.225 INFO:tasks.workunit.client.0.smithi088.stdout:7/664: creat dc/fe5 x:0 0 0 2023-12-09T02:34:54.225 INFO:tasks.workunit.client.0.smithi088.stdout:4/685: rmdir d3/dc/d43/d8c 39 2023-12-09T02:34:54.226 INFO:tasks.workunit.client.0.smithi088.stdout:9/627: rmdir df/d29 39 2023-12-09T02:34:54.229 INFO:tasks.workunit.client.0.smithi088.stdout:2/657: mkdir d6/d20/d3a/d94/dad/ddb/dde 0 2023-12-09T02:34:54.229 INFO:tasks.workunit.client.0.smithi088.stdout:2/658: chown d6/d20/d3a/d84/cd5 3654 1 2023-12-09T02:34:54.229 INFO:tasks.workunit.client.0.smithi088.stdout:3/588: symlink d1/d9/d6f/d6/d83/lbe 0 2023-12-09T02:34:54.230 INFO:tasks.workunit.client.0.smithi088.stdout:5/654: symlink d3/d15/de/d10/d18/d19/d1b/da8/ldd 0 2023-12-09T02:34:54.233 INFO:tasks.workunit.client.0.smithi088.stdout:5/655: readlink d3/d15/de/d10/d18/d19/d1b/d35/d42/l23 0 2023-12-09T02:34:54.234 INFO:tasks.workunit.client.0.smithi088.stdout:0/626: rename df/d28/d34/c7b to df/d10/d22/d2d/d96/cce 0 2023-12-09T02:34:54.234 INFO:tasks.workunit.client.0.smithi088.stdout:1/765: creat d8/d59/f109 x:0 0 0 2023-12-09T02:34:54.234 INFO:tasks.workunit.client.0.smithi088.stdout:9/628: dread df/f1a [0,4194304] 0 2023-12-09T02:34:54.234 INFO:tasks.workunit.client.0.smithi088.stdout:9/629: truncate df/d20/d30/d60/d5c/f1f 4465506 0 2023-12-09T02:34:54.235 INFO:tasks.workunit.client.0.smithi088.stdout:8/685: unlink d2/d9/d13/l53 0 2023-12-09T02:34:54.236 INFO:tasks.workunit.client.0.smithi088.stdout:7/665: creat dc/d1b/fe6 x:0 0 0 2023-12-09T02:34:54.237 INFO:tasks.workunit.client.0.smithi088.stdout:4/686: mknod d3/dc/d18/d7b/cdc 0 2023-12-09T02:34:54.238 INFO:tasks.workunit.client.0.smithi088.stdout:2/659: rmdir d6/d8/d4e/dc9 39 2023-12-09T02:34:54.240 INFO:tasks.workunit.client.0.smithi088.stdout:3/589: unlink d1/d9/d6f/d22/d7f/c5c 0 2023-12-09T02:34:54.242 INFO:tasks.workunit.client.0.smithi088.stdout:0/627: rename df/c20 to df/d10/d22/d5f/ccf 0 2023-12-09T02:34:54.243 INFO:tasks.workunit.client.0.smithi088.stdout:1/766: mkdir d8/d1b/d1d/dc7/d108/d10a 0 2023-12-09T02:34:54.244 INFO:tasks.workunit.client.0.smithi088.stdout:9/630: getdents df 0 2023-12-09T02:34:54.244 INFO:tasks.workunit.client.0.smithi088.stdout:9/631: chown df/f13 7424 1 2023-12-09T02:34:54.246 INFO:tasks.workunit.client.0.smithi088.stdout:1/767: dread d8/d3d/d44/fc3 [0,4194304] 0 2023-12-09T02:34:54.246 INFO:tasks.workunit.client.0.smithi088.stdout:1/768: fdatasync d8/d1b/d1d/dc7/fe7 0 2023-12-09T02:34:54.246 INFO:tasks.workunit.client.0.smithi088.stdout:1/769: getdents d8/d27/d40 0 2023-12-09T02:34:54.246 INFO:tasks.workunit.client.0.smithi088.stdout:7/666: creat dc/d21/d6b/d9b/fe7 x:0 0 0 2023-12-09T02:34:54.248 INFO:tasks.workunit.client.0.smithi088.stdout:7/667: dread dc/d1b/f4b [0,4194304] 0 2023-12-09T02:34:54.248 INFO:tasks.workunit.client.0.smithi088.stdout:3/590: mkdir d1/d9/dbf 0 2023-12-09T02:34:54.249 INFO:tasks.workunit.client.0.smithi088.stdout:0/628: mkdir df/dd0 0 2023-12-09T02:34:54.249 INFO:tasks.workunit.client.0.smithi088.stdout:8/686: dread d2/d2b/fac [0,4194304] 0 2023-12-09T02:34:54.250 INFO:tasks.workunit.client.0.smithi088.stdout:9/632: mkdir df/d20/d4c/d84/dd6 0 2023-12-09T02:34:54.251 INFO:tasks.workunit.client.0.smithi088.stdout:9/633: readlink df/d29/d2f/la1 0 2023-12-09T02:34:54.251 INFO:tasks.workunit.client.0.smithi088.stdout:9/634: dread - df/d20/d30/d3f/d48/f9a zero size 2023-12-09T02:34:54.251 INFO:tasks.workunit.client.0.smithi088.stdout:1/770: creat d8/d3d/df0/f10b x:0 0 0 2023-12-09T02:34:54.253 INFO:tasks.workunit.client.0.smithi088.stdout:3/591: creat d1/d9/d6f/d6/d8b/fc0 x:0 0 0 2023-12-09T02:34:54.254 INFO:tasks.workunit.client.0.smithi088.stdout:4/687: rename d3/dc/d43/d83/d37/l42 to d3/ldd 0 2023-12-09T02:34:54.254 INFO:tasks.workunit.client.0.smithi088.stdout:8/687: mkdir d2/d9/d1a/d62/d76/df0 0 2023-12-09T02:34:54.255 INFO:tasks.workunit.client.0.smithi088.stdout:9/635: creat df/d29/d2f/fd7 x:0 0 0 2023-12-09T02:34:54.256 INFO:tasks.workunit.client.0.smithi088.stdout:3/592: link d1/d9/d6f/d6/d72/fa6 d1/d9/d6f/d6/d72/fc1 0 2023-12-09T02:34:54.257 INFO:tasks.workunit.client.0.smithi088.stdout:3/593: fdatasync d1/d9/d6f/d6/d4a/f53 0 2023-12-09T02:34:54.258 INFO:tasks.workunit.client.0.smithi088.stdout:0/629: rename df/d10/d22/d5f/c65 to df/d10/cd1 0 2023-12-09T02:34:54.258 INFO:tasks.workunit.client.0.smithi088.stdout:0/630: fdatasync df/d28/d34/f48 0 2023-12-09T02:34:54.259 INFO:tasks.workunit.client.0.smithi088.stdout:8/688: dread d2/d9/d13/d15/fc7 [0,4194304] 0 2023-12-09T02:34:54.259 INFO:tasks.workunit.client.0.smithi088.stdout:8/689: readlink d2/d9/d70/d8f/lcd 0 2023-12-09T02:34:54.260 INFO:tasks.workunit.client.0.smithi088.stdout:8/690: mknod d2/d9/d70/d8f/d98/cf1 0 2023-12-09T02:34:54.260 INFO:tasks.workunit.client.0.smithi088.stdout:8/691: chown d2/d9/d1a/d62/d49/f59 7 1 2023-12-09T02:34:54.264 INFO:tasks.workunit.client.0.smithi088.stdout:2/660: dwrite d6/d8/d1f/d22/f40 [0,4194304] 0 2023-12-09T02:34:54.264 INFO:tasks.workunit.client.0.smithi088.stdout:2/661: readlink d6/d8/d4e/d64/l8b 0 2023-12-09T02:34:54.265 INFO:tasks.workunit.client.0.smithi088.stdout:8/692: symlink d2/d9/d13/d1c/d3b/lf2 0 2023-12-09T02:34:54.265 INFO:tasks.workunit.client.0.smithi088.stdout:8/693: write d2/d9/d13/d1c/d5f/fa4 [9393512,43832] 0 2023-12-09T02:34:54.265 INFO:tasks.workunit.client.0.smithi088.stdout:1/771: dread d8/d1c/f29 [0,4194304] 0 2023-12-09T02:34:54.268 INFO:tasks.workunit.client.0.smithi088.stdout:2/662: mkdir d6/d20/d69/db2/dc2/ddf 0 2023-12-09T02:34:54.270 INFO:tasks.workunit.client.0.smithi088.stdout:9/636: dread df/f13 [0,4194304] 0 2023-12-09T02:34:54.270 INFO:tasks.workunit.client.0.smithi088.stdout:9/637: read df/d20/d30/d60/d5c/f1f [2880631,104274] 0 2023-12-09T02:34:54.272 INFO:tasks.workunit.client.0.smithi088.stdout:2/663: mknod d6/d8/d73/d78/ce0 0 2023-12-09T02:34:54.272 INFO:tasks.workunit.client.0.smithi088.stdout:2/664: stat d6/d20/d3a/d94/dad/ddb/dde 0 2023-12-09T02:34:54.273 INFO:tasks.workunit.client.0.smithi088.stdout:8/694: unlink d2/d2b/c43 0 2023-12-09T02:34:54.274 INFO:tasks.workunit.client.0.smithi088.stdout:9/638: creat df/d20/d5b/fd8 x:0 0 0 2023-12-09T02:34:54.274 INFO:tasks.workunit.client.0.smithi088.stdout:9/639: fdatasync df/d20/dc7/fc8 0 2023-12-09T02:34:54.274 INFO:tasks.workunit.client.0.smithi088.stdout:8/695: dread d2/d9/d1a/d62/f4f [0,4194304] 0 2023-12-09T02:34:54.275 INFO:tasks.workunit.client.0.smithi088.stdout:2/665: creat d6/fe1 x:0 0 0 2023-12-09T02:34:54.276 INFO:tasks.workunit.client.0.smithi088.stdout:9/640: mknod df/d20/d30/d4e/cd9 0 2023-12-09T02:34:54.278 INFO:tasks.workunit.client.0.smithi088.stdout:9/641: truncate df/f13 857685 0 2023-12-09T02:34:54.278 INFO:tasks.workunit.client.0.smithi088.stdout:9/642: stat df/d20/d4c/d97 0 2023-12-09T02:34:54.281 INFO:tasks.workunit.client.0.smithi088.stdout:9/643: mkdir df/d20/d30/d60/dc9/dda 0 2023-12-09T02:34:54.283 INFO:tasks.workunit.client.0.smithi088.stdout:7/668: dwrite dc/d21/d6b/d6d/da4/d38/fa7 [0,4194304] 0 2023-12-09T02:34:54.283 INFO:tasks.workunit.client.0.smithi088.stdout:7/669: write dc/d21/d6b/fb6 [20274,64200] 0 2023-12-09T02:34:54.283 INFO:tasks.workunit.client.0.smithi088.stdout:9/644: rename df/d20/d30/d52 to df/d20/d30/d60/d5c/ddb 0 2023-12-09T02:34:54.285 INFO:tasks.workunit.client.0.smithi088.stdout:4/688: dwrite d3/dc/d43/fae [0,4194304] 0 2023-12-09T02:34:54.285 INFO:tasks.workunit.client.0.smithi088.stdout:0/631: dwrite df/d28/d33/f4e [0,4194304] 0 2023-12-09T02:34:54.287 INFO:tasks.workunit.client.0.smithi088.stdout:9/645: mknod df/d20/d30/d60/dc9/cdc 0 2023-12-09T02:34:54.288 INFO:tasks.workunit.client.0.smithi088.stdout:9/646: write df/d50/d63/f82 [1418486,775] 0 2023-12-09T02:34:54.291 INFO:tasks.workunit.client.0.smithi088.stdout:3/594: dwrite d1/d9/d6f/d15/fb4 [0,4194304] 0 2023-12-09T02:34:54.292 INFO:tasks.workunit.client.0.smithi088.stdout:4/689: link d3/d65/f6f d3/dc/d18/d7b/dbb/fde 0 2023-12-09T02:34:54.296 INFO:tasks.workunit.client.0.smithi088.stdout:0/632: mkdir df/d10/d22/da0/dd2 0 2023-12-09T02:34:54.296 INFO:tasks.workunit.client.0.smithi088.stdout:0/633: chown df/d28/cb1 1481 1 2023-12-09T02:34:54.296 INFO:tasks.workunit.client.0.smithi088.stdout:0/634: write df/d10/f1e [751434,92526] 0 2023-12-09T02:34:54.298 INFO:tasks.workunit.client.0.smithi088.stdout:9/647: creat df/d29/d2f/da2/fdd x:0 0 0 2023-12-09T02:34:54.298 INFO:tasks.workunit.client.0.smithi088.stdout:9/648: dread - df/d20/d30/d3f/d48/fa4 zero size 2023-12-09T02:34:54.298 INFO:tasks.workunit.client.0.smithi088.stdout:9/649: readlink df/d29/l72 0 2023-12-09T02:34:54.298 INFO:tasks.workunit.client.0.smithi088.stdout:9/650: write df/d20/d5b/f95 [492616,49221] 0 2023-12-09T02:34:54.299 INFO:tasks.workunit.client.0.smithi088.stdout:8/696: dwrite d2/d9/d13/d1c/d5f/fce [0,4194304] 0 2023-12-09T02:34:54.299 INFO:tasks.workunit.client.0.smithi088.stdout:8/697: chown d2/d9/d13/c92 8206088 1 2023-12-09T02:34:54.301 INFO:tasks.workunit.client.0.smithi088.stdout:3/595: rmdir d1/d9/d6f/d22/d7f/d45 39 2023-12-09T02:34:54.303 INFO:tasks.workunit.client.0.smithi088.stdout:2/666: dwrite d6/d8/d4e/dc9/fd1 [0,4194304] 0 2023-12-09T02:34:54.303 INFO:tasks.workunit.client.0.smithi088.stdout:8/698: write d2/d9/d13/d1c/d5f/fce [1950469,115524] 0 2023-12-09T02:34:54.304 INFO:tasks.workunit.client.0.smithi088.stdout:0/635: rename df/d10/d22/d2d/cbe to df/d10/d22/da0/cd3 0 2023-12-09T02:34:54.304 INFO:tasks.workunit.client.0.smithi088.stdout:0/636: stat df/d28/d33/f56 0 2023-12-09T02:34:54.304 INFO:tasks.workunit.client.0.smithi088.stdout:8/699: dread d2/d9/d13/d1c/fd3 [0,4194304] 0 2023-12-09T02:34:54.306 INFO:tasks.workunit.client.0.smithi088.stdout:8/700: write d2/d9/d13/d15/f18 [956647,106344] 0 2023-12-09T02:34:54.309 INFO:tasks.workunit.client.0.smithi088.stdout:9/651: symlink df/d20/d4c/lde 0 2023-12-09T02:34:54.317 INFO:tasks.workunit.client.0.smithi088.stdout:0/637: mknod df/cd4 0 2023-12-09T02:34:54.319 INFO:tasks.workunit.client.0.smithi088.stdout:9/652: link df/d20/d4c/d97/l98 df/d20/d30/ldf 0 2023-12-09T02:34:54.322 INFO:tasks.workunit.client.0.smithi088.stdout:0/638: creat df/d10/d22/d5f/fd5 x:0 0 0 2023-12-09T02:34:54.339 INFO:tasks.workunit.client.0.smithi088.stdout:4/690: dwrite d3/dc/d18/da9/fdb [0,4194304] 0 2023-12-09T02:34:54.339 INFO:tasks.workunit.client.0.smithi088.stdout:4/691: chown d3/dc/d18/d29/f3b 3 1 2023-12-09T02:34:54.339 INFO:tasks.workunit.client.0.smithi088.stdout:9/653: write df/d50/f58 [249970,115082] 0 2023-12-09T02:34:54.342 INFO:tasks.workunit.client.0.smithi088.stdout:8/701: dwrite d2/d9/d13/d1c/d5f/d84/fdb [0,4194304] 0 2023-12-09T02:34:54.342 INFO:tasks.workunit.client.0.smithi088.stdout:9/654: rename df/d20/d30/d3f/d48/dc4/fcc to df/d20/d30/d3f/d48/fe0 0 2023-12-09T02:34:54.343 INFO:tasks.workunit.client.0.smithi088.stdout:4/692: dread d3/dc/d18/d7b/f62 [0,4194304] 0 2023-12-09T02:34:54.344 INFO:tasks.workunit.client.0.smithi088.stdout:0/639: write df/d28/d34/f48 [581747,27025] 0 2023-12-09T02:34:54.344 INFO:tasks.workunit.client.0.smithi088.stdout:0/640: fsync df/d10/d22/f6f 0 2023-12-09T02:34:54.345 INFO:tasks.workunit.client.0.smithi088.stdout:9/655: mknod df/d20/d30/d4e/ce1 0 2023-12-09T02:34:54.345 INFO:tasks.workunit.client.0.smithi088.stdout:9/656: fsync df/d20/d4c/f8e 0 2023-12-09T02:34:54.346 INFO:tasks.workunit.client.0.smithi088.stdout:4/693: mkdir d3/dc/d1d/d40/ddf 0 2023-12-09T02:34:54.346 INFO:tasks.workunit.client.0.smithi088.stdout:2/667: dwrite d6/d20/d9a/fcb [0,4194304] 0 2023-12-09T02:34:54.347 INFO:tasks.workunit.client.0.smithi088.stdout:6/647: sync 2023-12-09T02:34:54.347 INFO:tasks.workunit.client.0.smithi088.stdout:6/648: chown d16/d62/d87/d8a/d8c/c98 19810873 1 2023-12-09T02:34:54.347 INFO:tasks.workunit.client.0.smithi088.stdout:0/641: creat df/d28/d34/fd6 x:0 0 0 2023-12-09T02:34:54.349 INFO:tasks.workunit.client.0.smithi088.stdout:8/702: creat d2/d9/d1a/d62/d76/d85/ff3 x:0 0 0 2023-12-09T02:34:54.350 INFO:tasks.workunit.client.0.smithi088.stdout:9/657: mkdir df/d20/d30/d60/dc9/dda/de2 0 2023-12-09T02:34:54.352 INFO:tasks.workunit.client.0.smithi088.stdout:4/694: link d3/dc/d43/d83/f4f d3/dc/d1d/d40/ddf/fe0 0 2023-12-09T02:34:54.360 INFO:tasks.workunit.client.0.smithi088.stdout:8/703: write d2/d9/d1a/d62/d49/f60 [2019106,118789] 0 2023-12-09T02:34:54.360 INFO:tasks.workunit.client.0.smithi088.stdout:8/704: write d2/d9/d13/d15/f68 [616406,108091] 0 2023-12-09T02:34:54.360 INFO:tasks.workunit.client.0.smithi088.stdout:8/705: read d2/d9/d13/d15/d6e/fa2 [218201,114772] 0 2023-12-09T02:34:54.361 INFO:tasks.workunit.client.0.smithi088.stdout:8/706: write d2/d9/fa7 [2365263,26826] 0 2023-12-09T02:34:54.361 INFO:tasks.workunit.client.0.smithi088.stdout:9/658: unlink df/d20/d30/f6d 0 2023-12-09T02:34:54.362 INFO:tasks.workunit.client.0.smithi088.stdout:9/659: chown df/d20/d30/d4e/ce1 55 1 2023-12-09T02:34:54.362 INFO:tasks.workunit.client.0.smithi088.stdout:9/660: fdatasync df/d20/f3e 0 2023-12-09T02:34:54.364 INFO:tasks.workunit.client.0.smithi088.stdout:4/695: symlink d3/dc/d18/da9/le1 0 2023-12-09T02:34:54.365 INFO:tasks.workunit.client.0.smithi088.stdout:0/642: dread df/d28/d43/f79 [0,4194304] 0 2023-12-09T02:34:54.365 INFO:tasks.workunit.client.0.smithi088.stdout:0/643: read - df/d10/d22/da0/fb7 zero size 2023-12-09T02:34:54.372 INFO:tasks.workunit.client.0.smithi088.stdout:2/668: dwrite d6/d8/f1d [0,4194304] 0 2023-12-09T02:34:54.372 INFO:tasks.workunit.client.0.smithi088.stdout:8/707: write d2/d9/d1a/d62/d49/fb8 [169231,47466] 0 2023-12-09T02:34:54.374 INFO:tasks.workunit.client.0.smithi088.stdout:9/661: link df/d29/cc3 df/d20/d30/d60/dc9/dda/de2/ce3 0 2023-12-09T02:34:54.374 INFO:tasks.workunit.client.0.smithi088.stdout:9/662: dread - df/d20/d30/d60/d5c/db9/fa5 zero size 2023-12-09T02:34:54.376 INFO:tasks.workunit.client.0.smithi088.stdout:4/696: mknod d3/dc/d1d/d40/d9f/dc8/ce2 0 2023-12-09T02:34:54.376 INFO:tasks.workunit.client.0.smithi088.stdout:4/697: write d3/dc/d43/d83/f4f [448761,130183] 0 2023-12-09T02:34:54.376 INFO:tasks.workunit.client.0.smithi088.stdout:4/698: read - d3/dc/d1d/d40/fa1 zero size 2023-12-09T02:34:54.377 INFO:tasks.workunit.client.0.smithi088.stdout:5/656: sync 2023-12-09T02:34:54.378 INFO:tasks.workunit.client.0.smithi088.stdout:6/649: dwrite d16/d1b/d56/fa0 [0,4194304] 0 2023-12-09T02:34:54.378 INFO:tasks.workunit.client.0.smithi088.stdout:0/644: symlink df/d28/d33/daf/ld7 0 2023-12-09T02:34:54.379 INFO:tasks.workunit.client.0.smithi088.stdout:2/669: creat d6/d20/fe2 x:0 0 0 2023-12-09T02:34:54.379 INFO:tasks.workunit.client.0.smithi088.stdout:2/670: chown d6/d13/d42/lda 53189793 1 2023-12-09T02:34:54.379 INFO:tasks.workunit.client.0.smithi088.stdout:2/671: write d6/f5d [196230,62721] 0 2023-12-09T02:34:54.380 INFO:tasks.workunit.client.0.smithi088.stdout:2/672: chown d6/d13/d42/d89 6135 1 2023-12-09T02:34:54.381 INFO:tasks.workunit.client.0.smithi088.stdout:9/663: link df/f1c df/d50/d63/db8/fe4 0 2023-12-09T02:34:54.381 INFO:tasks.workunit.client.0.smithi088.stdout:9/664: stat df/d20/d30/d4e/ce1 0 2023-12-09T02:34:54.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/657: creat d3/d15/d2e/d49/d88/fde x:0 0 0 2023-12-09T02:34:54.393 INFO:tasks.workunit.client.0.smithi088.stdout:0/645: unlink df/d10/d22/d2d/d2e/f83 0 2023-12-09T02:34:54.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/650: symlink d16/d62/d6f/da4/lc1 0 2023-12-09T02:34:54.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/651: readlink d16/d62/da7/lb0 0 2023-12-09T02:34:54.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/652: readlink d16/d1b/d56/l9e 0 2023-12-09T02:34:54.395 INFO:tasks.workunit.client.0.smithi088.stdout:9/665: symlink df/d20/d30/d60/dc9/dda/le5 0 2023-12-09T02:34:54.396 INFO:tasks.workunit.client.0.smithi088.stdout:2/673: dwrite d6/d8/d4e/d47/f9b [0,4194304] 0 2023-12-09T02:34:54.396 INFO:tasks.workunit.client.0.smithi088.stdout:2/674: readlink d6/d8/l9 0 2023-12-09T02:34:54.397 INFO:tasks.workunit.client.0.smithi088.stdout:5/658: mkdir d3/d15/de/d10/d18/d19/d20/ddf 0 2023-12-09T02:34:54.398 INFO:tasks.workunit.client.0.smithi088.stdout:6/653: mkdir d16/d62/d6f/da4/dc2 0 2023-12-09T02:34:54.398 INFO:tasks.workunit.client.0.smithi088.stdout:6/654: write d16/d1b/d25/d5f/fb5 [774153,37435] 0 2023-12-09T02:34:54.398 INFO:tasks.workunit.client.0.smithi088.stdout:6/655: write d16/d1b/d2c/d60/f74 [5053116,14097] 0 2023-12-09T02:34:54.399 INFO:tasks.workunit.client.0.smithi088.stdout:9/666: rmdir df/d20/d30/d60/d5c/db9 39 2023-12-09T02:34:54.399 INFO:tasks.workunit.client.0.smithi088.stdout:9/667: write df/d20/f99 [670331,22091] 0 2023-12-09T02:34:54.401 INFO:tasks.workunit.client.0.smithi088.stdout:2/675: mkdir d6/de3 0 2023-12-09T02:34:54.401 INFO:tasks.workunit.client.0.smithi088.stdout:1/772: sync 2023-12-09T02:34:54.404 INFO:tasks.workunit.client.0.smithi088.stdout:5/659: dread d3/d15/de/d10/d18/d19/d1b/d35/d42/f84 [0,4194304] 0 2023-12-09T02:34:54.404 INFO:tasks.workunit.client.0.smithi088.stdout:9/668: creat df/fe6 x:0 0 0 2023-12-09T02:34:54.404 INFO:tasks.workunit.client.0.smithi088.stdout:1/773: truncate d8/d1b/f41 1366947 0 2023-12-09T02:34:54.404 INFO:tasks.workunit.client.0.smithi088.stdout:1/774: read - d8/d1c/d50/ffb zero size 2023-12-09T02:34:54.407 INFO:tasks.workunit.client.0.smithi088.stdout:9/669: creat df/d20/d30/d60/dc9/dda/fe7 x:0 0 0 2023-12-09T02:34:54.409 INFO:tasks.workunit.client.0.smithi088.stdout:5/660: write d3/d15/de/f26 [4088614,59041] 0 2023-12-09T02:34:54.412 INFO:tasks.workunit.client.0.smithi088.stdout:1/775: rename d8/d59/fb8 to d8/d1b/d1d/ddf/f10c 0 2023-12-09T02:34:54.412 INFO:tasks.workunit.client.0.smithi088.stdout:9/670: rmdir df/d20/d30 39 2023-12-09T02:34:54.413 INFO:tasks.workunit.client.0.smithi088.stdout:5/661: creat d3/d15/de/d10/d18/d19/d1b/fe0 x:0 0 0 2023-12-09T02:34:54.414 INFO:tasks.workunit.client.0.smithi088.stdout:1/776: mkdir d8/d1c/d50/d6c/df7/d10d 0 2023-12-09T02:34:54.414 INFO:tasks.workunit.client.0.smithi088.stdout:1/777: chown d8/d1b/f20 26003837 1 2023-12-09T02:34:54.418 INFO:tasks.workunit.client.0.smithi088.stdout:5/662: stat d3/d15/dc/d14/c96 0 2023-12-09T02:34:54.418 INFO:tasks.workunit.client.0.smithi088.stdout:5/663: chown d3/d15/f1f 20459700 1 2023-12-09T02:34:54.420 INFO:tasks.workunit.client.0.smithi088.stdout:9/671: write df/d20/f3e [518600,11828] 0 2023-12-09T02:34:54.422 INFO:tasks.workunit.client.0.smithi088.stdout:9/672: creat df/d20/d30/d3f/d48/fe8 x:0 0 0 2023-12-09T02:34:54.424 INFO:tasks.workunit.client.0.smithi088.stdout:9/673: symlink df/d20/d30/d3f/d48/da7/le9 0 2023-12-09T02:34:54.431 INFO:tasks.workunit.client.0.smithi088.stdout:9/674: write df/d20/d30/d3f/d48/f6e [651199,60014] 0 2023-12-09T02:34:54.431 INFO:tasks.workunit.client.0.smithi088.stdout:9/675: fdatasync df/d29/d2f/f93 0 2023-12-09T02:34:54.433 INFO:tasks.workunit.client.0.smithi088.stdout:9/676: symlink df/d20/d30/d3f/lea 0 2023-12-09T02:34:54.433 INFO:tasks.workunit.client.0.smithi088.stdout:9/677: fdatasync df/d20/d30/d3f/d48/f65 0 2023-12-09T02:34:54.434 INFO:tasks.workunit.client.0.smithi088.stdout:9/678: unlink df/d20/d30/d60/d5c/ddb/laf 0 2023-12-09T02:34:54.434 INFO:tasks.workunit.client.0.smithi088.stdout:9/679: chown df/d50/d63/f7f 18 1 2023-12-09T02:34:54.435 INFO:tasks.workunit.client.0.smithi088.stdout:9/680: dread df/d29/f2d [0,4194304] 0 2023-12-09T02:34:54.443 INFO:tasks.workunit.client.0.smithi088.stdout:0/646: dwrite df/d10/d22/fb3 [0,4194304] 0 2023-12-09T02:34:54.443 INFO:tasks.workunit.client.0.smithi088.stdout:0/647: readlink df/d28/d43/l4a 0 2023-12-09T02:34:54.443 INFO:tasks.workunit.client.0.smithi088.stdout:0/648: dread - df/d10/d22/d5f/fbb zero size 2023-12-09T02:34:54.443 INFO:tasks.workunit.client.0.smithi088.stdout:0/649: write df/d10/d22/d2d/d6a/fb0 [796056,111767] 0 2023-12-09T02:34:54.443 INFO:tasks.workunit.client.0.smithi088.stdout:4/699: dwrite d3/dc/d43/d83/d37/fbf [0,4194304] 0 2023-12-09T02:34:54.443 INFO:tasks.workunit.client.0.smithi088.stdout:6/656: dwrite d16/d1b/d25/d5f/d63/f7f [0,4194304] 0 2023-12-09T02:34:54.443 INFO:tasks.workunit.client.0.smithi088.stdout:6/657: fdatasync d16/f39 0 2023-12-09T02:34:54.443 INFO:tasks.workunit.client.0.smithi088.stdout:5/664: dwrite d3/d15/de/d10/d18/d19/d20/f27 [0,4194304] 0 2023-12-09T02:34:54.443 INFO:tasks.workunit.client.0.smithi088.stdout:2/676: dwrite d6/d8/d4e/d3c/f8c [0,4194304] 0 2023-12-09T02:34:54.443 INFO:tasks.workunit.client.0.smithi088.stdout:2/677: chown d6/d20/d69/l7d 64 1 2023-12-09T02:34:54.444 INFO:tasks.workunit.client.0.smithi088.stdout:4/700: write d3/dc/d43/d8c/d95/f51 [1148335,30575] 0 2023-12-09T02:34:54.444 INFO:tasks.workunit.client.0.smithi088.stdout:4/701: chown d3/dc/d43/d83/f3a 2073408803 1 2023-12-09T02:34:54.445 INFO:tasks.workunit.client.0.smithi088.stdout:4/702: write d3/dc/d18/d7b/dbb/dbc/f8e [1000371,43528] 0 2023-12-09T02:34:54.450 INFO:tasks.workunit.client.0.smithi088.stdout:0/650: write df/d28/d33/f9c [2566400,12636] 0 2023-12-09T02:34:54.450 INFO:tasks.workunit.client.0.smithi088.stdout:0/651: fsync df/d10/f9e 0 2023-12-09T02:34:54.453 INFO:tasks.workunit.client.0.smithi088.stdout:6/658: getdents d16/d1b 0 2023-12-09T02:34:54.456 INFO:tasks.workunit.client.0.smithi088.stdout:5/665: mknod d3/d15/d2e/d49/d88/dd6/ce1 0 2023-12-09T02:34:54.456 INFO:tasks.workunit.client.0.smithi088.stdout:5/666: chown d3/d15/de/d10/d18/d19/d1b/f32 42 1 2023-12-09T02:34:54.456 INFO:tasks.workunit.client.0.smithi088.stdout:9/681: dwrite df/d20/d30/d60/d5c/db9/fd1 [0,4194304] 0 2023-12-09T02:34:54.456 INFO:tasks.workunit.client.0.smithi088.stdout:9/682: write df/d50/d63/f7f [5469109,16350] 0 2023-12-09T02:34:54.458 INFO:tasks.workunit.client.0.smithi088.stdout:2/678: rmdir d6/d8/d73 39 2023-12-09T02:34:54.458 INFO:tasks.workunit.client.0.smithi088.stdout:4/703: stat d3/dc/d18/d29/da4/caf 0 2023-12-09T02:34:54.460 INFO:tasks.workunit.client.0.smithi088.stdout:0/652: creat df/d10/fd8 x:0 0 0 2023-12-09T02:34:54.460 INFO:tasks.workunit.client.0.smithi088.stdout:0/653: chown df/d28/d33/f4e 41837 1 2023-12-09T02:34:54.461 INFO:tasks.workunit.client.0.smithi088.stdout:6/659: truncate d16/d1b/d2c/d3f/d41/f43 1316048 0 2023-12-09T02:34:54.462 INFO:tasks.workunit.client.0.smithi088.stdout:5/667: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d42/de2 0 2023-12-09T02:34:54.467 INFO:tasks.workunit.client.0.smithi088.stdout:9/683: creat df/d20/d30/d60/d5c/db9/feb x:0 0 0 2023-12-09T02:34:54.468 INFO:tasks.workunit.client.0.smithi088.stdout:9/684: truncate df/d20/d30/d3f/d48/fae 51632 0 2023-12-09T02:34:54.470 INFO:tasks.workunit.client.0.smithi088.stdout:2/679: creat d6/d8/d4e/d64/fe4 x:0 0 0 2023-12-09T02:34:54.473 INFO:tasks.workunit.client.0.smithi088.stdout:0/654: rmdir df/d10/d22/d2d/d6a 39 2023-12-09T02:34:54.477 INFO:tasks.workunit.client.0.smithi088.stdout:2/680: mkdir d6/d20/d3a/d84/de5 0 2023-12-09T02:34:54.478 INFO:tasks.workunit.client.0.smithi088.stdout:2/681: chown d6/d8/d4e/dc9/fd1 5577274 1 2023-12-09T02:34:54.478 INFO:tasks.workunit.client.0.smithi088.stdout:2/682: readlink d6/d8/d4e/d64/l8b 0 2023-12-09T02:34:54.479 INFO:tasks.workunit.client.0.smithi088.stdout:3/596: sync 2023-12-09T02:34:54.480 INFO:tasks.workunit.client.0.smithi088.stdout:7/670: sync 2023-12-09T02:34:54.480 INFO:tasks.workunit.client.0.smithi088.stdout:3/597: getdents d1/d9/d6f/d6/d83 0 2023-12-09T02:34:54.482 INFO:tasks.workunit.client.0.smithi088.stdout:7/671: creat dc/d21/d6b/d6d/da4/d3e/dde/fe8 x:0 0 0 2023-12-09T02:34:54.483 INFO:tasks.workunit.client.0.smithi088.stdout:3/598: mknod d1/d9/d6f/d6/d4a/d41/d33/d49/cc2 0 2023-12-09T02:34:54.488 INFO:tasks.workunit.client.0.smithi088.stdout:2/683: write d6/d20/d3d/f4a [3684005,40820] 0 2023-12-09T02:34:54.488 INFO:tasks.workunit.client.0.smithi088.stdout:2/684: stat d6/de3 0 2023-12-09T02:34:54.488 INFO:tasks.workunit.client.0.smithi088.stdout:3/599: rmdir d1/d9/d6f/d22/d7f/d81 39 2023-12-09T02:34:54.489 INFO:tasks.workunit.client.0.smithi088.stdout:2/685: creat d6/d20/d3a/d84/fe6 x:0 0 0 2023-12-09T02:34:54.490 INFO:tasks.workunit.client.0.smithi088.stdout:3/600: creat d1/d9/d6f/d6/fc3 x:0 0 0 2023-12-09T02:34:54.490 INFO:tasks.workunit.client.0.smithi088.stdout:3/601: getdents d1/d73/d89 0 2023-12-09T02:34:54.491 INFO:tasks.workunit.client.0.smithi088.stdout:3/602: creat d1/d9/d6f/d6/d8b/fc4 x:0 0 0 2023-12-09T02:34:54.492 INFO:tasks.workunit.client.0.smithi088.stdout:3/603: mkdir d1/d9/d6f/d2d/dab/dc5 0 2023-12-09T02:34:54.492 INFO:tasks.workunit.client.0.smithi088.stdout:3/604: write d1/d9/d6f/d2d/d66/fa2 [588855,6200] 0 2023-12-09T02:34:54.495 INFO:tasks.workunit.client.0.smithi088.stdout:6/660: dwrite d16/d1b/d25/f27 [0,4194304] 0 2023-12-09T02:34:54.497 INFO:tasks.workunit.client.0.smithi088.stdout:6/661: mknod d16/d1b/d2c/cc3 0 2023-12-09T02:34:54.497 INFO:tasks.workunit.client.0.smithi088.stdout:6/662: chown d16/d1b/f22 30 1 2023-12-09T02:34:54.507 INFO:tasks.workunit.client.0.smithi088.stdout:4/704: dwrite d3/dc/d1d/f71 [0,4194304] 0 2023-12-09T02:34:54.508 INFO:tasks.workunit.client.0.smithi088.stdout:5/668: dwrite d3/d15/dc/d60/f9e [0,4194304] 0 2023-12-09T02:34:54.508 INFO:tasks.workunit.client.0.smithi088.stdout:5/669: chown d3/d15/dc/l75 77 1 2023-12-09T02:34:54.508 INFO:tasks.workunit.client.0.smithi088.stdout:4/705: write d3/d65/f79 [75864,30264] 0 2023-12-09T02:34:54.509 INFO:tasks.workunit.client.0.smithi088.stdout:7/672: dwrite dc/d21/d6b/d6d/da4/f5e [0,4194304] 0 2023-12-09T02:34:54.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/655: dwrite f6 [4194304,4194304] 0 2023-12-09T02:34:54.511 INFO:tasks.workunit.client.0.smithi088.stdout:9/685: dwrite df/d50/fc2 [0,4194304] 0 2023-12-09T02:34:54.511 INFO:tasks.workunit.client.0.smithi088.stdout:9/686: chown df/d29/l72 55062349 1 2023-12-09T02:34:54.511 INFO:tasks.workunit.client.0.smithi088.stdout:9/687: truncate df/d20/d30/d3f/d48/fe8 985196 0 2023-12-09T02:34:54.511 INFO:tasks.workunit.client.0.smithi088.stdout:9/688: truncate df/d29/d2f/f3a 3728255 0 2023-12-09T02:34:54.511 INFO:tasks.workunit.client.0.smithi088.stdout:9/689: fsync df/d50/d63/db8/fe4 0 2023-12-09T02:34:54.511 INFO:tasks.workunit.client.0.smithi088.stdout:5/670: rmdir d3/d15/de/d10/d18/d19/d1b/d35/d58 39 2023-12-09T02:34:54.512 INFO:tasks.workunit.client.0.smithi088.stdout:4/706: mknod d3/dc/d18/d29/ce3 0 2023-12-09T02:34:54.514 INFO:tasks.workunit.client.0.smithi088.stdout:0/656: rename df/d10/d22/l72 to df/d28/d43/ld9 0 2023-12-09T02:34:54.517 INFO:tasks.workunit.client.0.smithi088.stdout:9/690: truncate df/d20/d30/d60/d5c/f1f 3598756 0 2023-12-09T02:34:54.517 INFO:tasks.workunit.client.0.smithi088.stdout:9/691: write df/d20/d5b/fb5 [4271845,95873] 0 2023-12-09T02:34:54.518 INFO:tasks.workunit.client.0.smithi088.stdout:5/671: link d3/d15/de/d10/d18/da5/fb1 d3/d15/de/d10/d51/db4/dd7/fe3 0 2023-12-09T02:34:54.519 INFO:tasks.workunit.client.0.smithi088.stdout:0/657: mkdir df/d28/d43/dda 0 2023-12-09T02:34:54.519 INFO:tasks.workunit.client.0.smithi088.stdout:2/686: dwrite d6/d8/d4e/d47/f9b [0,4194304] 0 2023-12-09T02:34:54.520 INFO:tasks.workunit.client.0.smithi088.stdout:6/663: dwrite d16/d35/d65/fc0 [0,4194304] 0 2023-12-09T02:34:54.520 INFO:tasks.workunit.client.0.smithi088.stdout:0/658: truncate df/f25 3709971 0 2023-12-09T02:34:54.522 INFO:tasks.workunit.client.0.smithi088.stdout:2/687: rename d6/d8/d1f/d22/d68/ca1 to d6/d20/d3d/ce7 0 2023-12-09T02:34:54.525 INFO:tasks.workunit.client.0.smithi088.stdout:0/659: creat df/d28/d34/dc8/fdb x:0 0 0 2023-12-09T02:34:54.526 INFO:tasks.workunit.client.0.smithi088.stdout:2/688: truncate d6/d13/d18/f32 875860 0 2023-12-09T02:34:54.526 INFO:tasks.workunit.client.0.smithi088.stdout:2/689: chown d6/d8/d4e/da2/db8 25966387 1 2023-12-09T02:34:54.526 INFO:tasks.workunit.client.0.smithi088.stdout:6/664: read d16/d1b/f1e [2769134,35369] 0 2023-12-09T02:34:54.526 INFO:tasks.workunit.client.0.smithi088.stdout:5/672: dread d3/d15/de/d10/d18/d19/d20/f27 [0,4194304] 0 2023-12-09T02:34:54.526 INFO:tasks.workunit.client.0.smithi088.stdout:9/692: fdatasync df/d20/f3e 0 2023-12-09T02:34:54.528 INFO:tasks.workunit.client.0.smithi088.stdout:0/660: unlink df/d28/d33/f56 0 2023-12-09T02:34:54.530 INFO:tasks.workunit.client.0.smithi088.stdout:2/690: mknod d6/d8/d1f/ce8 0 2023-12-09T02:34:54.531 INFO:tasks.workunit.client.0.smithi088.stdout:9/693: write df/d20/d4c/fd0 [675031,67166] 0 2023-12-09T02:34:54.531 INFO:tasks.workunit.client.0.smithi088.stdout:9/694: fdatasync df/d50/d63/f80 0 2023-12-09T02:34:54.531 INFO:tasks.workunit.client.0.smithi088.stdout:6/665: creat d16/d62/d87/d8a/d8c/fc4 x:0 0 0 2023-12-09T02:34:54.531 INFO:tasks.workunit.client.0.smithi088.stdout:6/666: fsync d16/d1b/d2c/d3f/d41/f4b 0 2023-12-09T02:34:54.531 INFO:tasks.workunit.client.0.smithi088.stdout:6/667: readlink d16/d62/da7/lb0 0 2023-12-09T02:34:54.531 INFO:tasks.workunit.client.0.smithi088.stdout:3/605: getdents d1/d9/d6f/d2d/dab 0 2023-12-09T02:34:54.532 INFO:tasks.workunit.client.0.smithi088.stdout:3/606: getdents d1/d9/d6f/d2d/dab/dc5 0 2023-12-09T02:34:54.532 INFO:tasks.workunit.client.0.smithi088.stdout:3/607: truncate d1/d9/d6f/d2d/db9/f74 1300332 0 2023-12-09T02:34:54.532 INFO:tasks.workunit.client.0.smithi088.stdout:5/673: write d3/d15/de/d10/d18/f57 [1981250,21843] 0 2023-12-09T02:34:54.533 INFO:tasks.workunit.client.0.smithi088.stdout:5/674: fdatasync d3/d15/de/d10/d18/d19/d20/f43 0 2023-12-09T02:34:54.534 INFO:tasks.workunit.client.0.smithi088.stdout:2/691: rename d6/d8/d1f/d22/l63 to d6/d8/d73/d78/dbf/le9 0 2023-12-09T02:34:54.534 INFO:tasks.workunit.client.0.smithi088.stdout:2/692: fdatasync d6/d20/d3a/d94/f9d 0 2023-12-09T02:34:54.535 INFO:tasks.workunit.client.0.smithi088.stdout:9/695: getdents df/d20/d30/d3f/d48/da7 0 2023-12-09T02:34:54.537 INFO:tasks.workunit.client.0.smithi088.stdout:9/696: write df/d29/d2f/f3c [2192685,116483] 0 2023-12-09T02:34:54.538 INFO:tasks.workunit.client.0.smithi088.stdout:3/608: creat d1/fc6 x:0 0 0 2023-12-09T02:34:54.538 INFO:tasks.workunit.client.0.smithi088.stdout:3/609: fsync d1/d9/d6f/d6/f11 0 2023-12-09T02:34:54.539 INFO:tasks.workunit.client.0.smithi088.stdout:9/697: read df/d20/d5b/fb5 [860627,78295] 0 2023-12-09T02:34:54.540 INFO:tasks.workunit.client.0.smithi088.stdout:7/673: dwrite dc/d21/d6b/d6d/da4/d3e/fb2 [0,4194304] 0 2023-12-09T02:34:54.540 INFO:tasks.workunit.client.0.smithi088.stdout:7/674: chown dc/d21/d6b/d6d/d76 3230 1 2023-12-09T02:34:54.542 INFO:tasks.workunit.client.0.smithi088.stdout:5/675: rmdir d3/d15/de/d10/d18/d19/d20 39 2023-12-09T02:34:54.542 INFO:tasks.workunit.client.0.smithi088.stdout:5/676: chown d3/d15/de/d10/d18/d19/d1b/d35/d61/lb9 0 1 2023-12-09T02:34:54.543 INFO:tasks.workunit.client.0.smithi088.stdout:2/693: creat d6/d20/d3a/fea x:0 0 0 2023-12-09T02:34:54.543 INFO:tasks.workunit.client.0.smithi088.stdout:2/694: chown d6/d20/d3d/c7e 376464020 1 2023-12-09T02:34:54.552 INFO:tasks.workunit.client.0.smithi088.stdout:3/610: creat d1/d9/fc7 x:0 0 0 2023-12-09T02:34:54.554 INFO:tasks.workunit.client.0.smithi088.stdout:9/698: rename df/d50/f86 to df/d20/d30/d60/fec 0 2023-12-09T02:34:54.565 INFO:tasks.workunit.client.0.smithi088.stdout:4/707: dwrite d3/dc/d18/d7b/dbb/dbc/f8e [0,4194304] 0 2023-12-09T02:34:54.568 INFO:tasks.workunit.client.0.smithi088.stdout:6/668: dwrite d16/d1b/d2c/f88 [0,4194304] 0 2023-12-09T02:34:54.570 INFO:tasks.workunit.client.0.smithi088.stdout:6/669: write d16/f99 [1374194,76288] 0 2023-12-09T02:34:54.570 INFO:tasks.workunit.client.0.smithi088.stdout:6/670: getdents d16/d62/d6f/db3 0 2023-12-09T02:34:54.570 INFO:tasks.workunit.client.0.smithi088.stdout:5/677: mknod d3/d15/de/d10/d51/ce4 0 2023-12-09T02:34:54.574 INFO:tasks.workunit.client.0.smithi088.stdout:6/671: creat d16/d1b/d2c/d3f/fc5 x:0 0 0 2023-12-09T02:34:54.575 INFO:tasks.workunit.client.0.smithi088.stdout:5/678: mknod d3/d15/de/d2c/ce5 0 2023-12-09T02:34:54.577 INFO:tasks.workunit.client.0.smithi088.stdout:6/672: mkdir d16/d35/d36/dc6 0 2023-12-09T02:34:54.578 INFO:tasks.workunit.client.0.smithi088.stdout:5/679: truncate d3/d15/de/d2c/faa 3319363 0 2023-12-09T02:34:54.580 INFO:tasks.workunit.client.0.smithi088.stdout:6/673: rename d16/d62/d87/d8a to d16/d62/d6f/da4/dc2/dc7 0 2023-12-09T02:34:54.580 INFO:tasks.workunit.client.0.smithi088.stdout:6/674: chown d16/d1b/d2c/d3f/d41/d80/lba 1875 1 2023-12-09T02:34:54.592 INFO:tasks.workunit.client.0.smithi088.stdout:2/695: dwrite d6/d8/d1f/d22/d68/f7f [0,4194304] 0 2023-12-09T02:34:54.592 INFO:tasks.workunit.client.0.smithi088.stdout:2/696: write d6/d20/d3a/d94/f9d [851938,54100] 0 2023-12-09T02:34:54.592 INFO:tasks.workunit.client.0.smithi088.stdout:7/675: dwrite dc/d21/f1a [0,4194304] 0 2023-12-09T02:34:54.596 INFO:tasks.workunit.client.0.smithi088.stdout:3/611: dwrite d1/d9/d6f/d22/f6d [0,4194304] 0 2023-12-09T02:34:54.596 INFO:tasks.workunit.client.0.smithi088.stdout:7/676: rename dc/d21/d6b/d6d/da4/d5d/ld1 to dc/d1b/d72/le9 0 2023-12-09T02:34:54.597 INFO:tasks.workunit.client.0.smithi088.stdout:9/699: dwrite df/d20/d30/d3f/d48/fe8 [0,4194304] 0 2023-12-09T02:34:54.597 INFO:tasks.workunit.client.0.smithi088.stdout:4/708: dwrite d3/f89 [0,4194304] 0 2023-12-09T02:34:54.597 INFO:tasks.workunit.client.0.smithi088.stdout:6/675: dread d16/d1b/d25/f40 [0,4194304] 0 2023-12-09T02:34:54.598 INFO:tasks.workunit.client.0.smithi088.stdout:4/709: chown d3/dc/d43/d83/d37/fbe 3490360 1 2023-12-09T02:34:54.598 INFO:tasks.workunit.client.0.smithi088.stdout:4/710: chown d3/dc/d43/d8c/d95 222766399 1 2023-12-09T02:34:54.599 INFO:tasks.workunit.client.0.smithi088.stdout:3/612: rmdir d1/d9/d6f/d2d 39 2023-12-09T02:34:54.600 INFO:tasks.workunit.client.0.smithi088.stdout:7/677: mknod dc/d21/d6b/d6d/da4/d3e/cea 0 2023-12-09T02:34:54.601 INFO:tasks.workunit.client.0.smithi088.stdout:9/700: write df/d20/d30/d3f/d48/f5e [6361305,60913] 0 2023-12-09T02:34:54.601 INFO:tasks.workunit.client.0.smithi088.stdout:9/701: write df/f1a [3020072,73092] 0 2023-12-09T02:34:54.601 INFO:tasks.workunit.client.0.smithi088.stdout:9/702: stat df/d20/d30/d4e/cd9 0 2023-12-09T02:34:54.605 INFO:tasks.workunit.client.0.smithi088.stdout:6/676: symlink d16/d62/d6f/db3/lc8 0 2023-12-09T02:34:54.605 INFO:tasks.workunit.client.0.smithi088.stdout:6/677: chown d16/d1b/d2c/d3f/l9b 176252 1 2023-12-09T02:34:54.605 INFO:tasks.workunit.client.0.smithi088.stdout:6/678: truncate d16/d35/f84 1019818 0 2023-12-09T02:34:54.605 INFO:tasks.workunit.client.0.smithi088.stdout:6/679: stat d16/d1b/d2c/d3f/d41/d80/f81 0 2023-12-09T02:34:54.605 INFO:tasks.workunit.client.0.smithi088.stdout:2/697: dwrite d6/d20/d3d/fac [0,4194304] 0 2023-12-09T02:34:54.606 INFO:tasks.workunit.client.0.smithi088.stdout:4/711: getdents d3/dc/d1d/d40/d9f/dc8 0 2023-12-09T02:34:54.606 INFO:tasks.workunit.client.0.smithi088.stdout:3/613: creat d1/d9/d6f/d22/d7f/d45/fc8 x:0 0 0 2023-12-09T02:34:54.608 INFO:tasks.workunit.client.0.smithi088.stdout:7/678: unlink dc/d21/f1a 0 2023-12-09T02:34:54.610 INFO:tasks.workunit.client.0.smithi088.stdout:8/708: sync 2023-12-09T02:34:54.610 INFO:tasks.workunit.client.0.smithi088.stdout:1/778: sync 2023-12-09T02:34:54.613 INFO:tasks.workunit.client.0.smithi088.stdout:9/703: creat df/d20/d30/d60/d5c/fed x:0 0 0 2023-12-09T02:34:54.614 INFO:tasks.workunit.client.0.smithi088.stdout:9/704: dread df/d20/d4c/f90 [0,4194304] 0 2023-12-09T02:34:54.614 INFO:tasks.workunit.client.0.smithi088.stdout:9/705: write df/d20/d30/d3f/fa9 [450453,10355] 0 2023-12-09T02:34:54.623 INFO:tasks.workunit.client.0.smithi088.stdout:2/698: mkdir d6/d8/deb 0 2023-12-09T02:34:54.623 INFO:tasks.workunit.client.0.smithi088.stdout:2/699: chown d6/d20/d3d/f4a 0 1 2023-12-09T02:34:54.627 INFO:tasks.workunit.client.0.smithi088.stdout:8/709: truncate d2/d9/d13/d1c/f5c 3145661 0 2023-12-09T02:34:54.628 INFO:tasks.workunit.client.0.smithi088.stdout:9/706: mkdir df/d20/d30/d60/dca/dee 0 2023-12-09T02:34:54.629 INFO:tasks.workunit.client.0.smithi088.stdout:6/680: symlink d16/d35/d65/lc9 0 2023-12-09T02:34:54.630 INFO:tasks.workunit.client.0.smithi088.stdout:6/681: fdatasync d16/d1b/d25/d5f/f6e 0 2023-12-09T02:34:54.630 INFO:tasks.workunit.client.0.smithi088.stdout:4/712: mkdir d3/d65/de4 0 2023-12-09T02:34:54.632 INFO:tasks.workunit.client.0.smithi088.stdout:9/707: write df/d20/d30/d3f/d48/f45 [1985213,127646] 0 2023-12-09T02:34:54.632 INFO:tasks.workunit.client.0.smithi088.stdout:3/614: mkdir d1/d9/d6f/d2d/dab/dc5/dc9 0 2023-12-09T02:34:54.632 INFO:tasks.workunit.client.0.smithi088.stdout:8/710: truncate d2/db9/fea 327942 0 2023-12-09T02:34:54.632 INFO:tasks.workunit.client.0.smithi088.stdout:8/711: readlink d2/d9/d13/d1c/l63 0 2023-12-09T02:34:54.632 INFO:tasks.workunit.client.0.smithi088.stdout:8/712: truncate d2/d9/f8b 1693965 0 2023-12-09T02:34:54.633 INFO:tasks.workunit.client.0.smithi088.stdout:6/682: truncate d16/d35/d36/f6b 87216 0 2023-12-09T02:34:54.635 INFO:tasks.workunit.client.0.smithi088.stdout:4/713: creat d3/dc/d18/d29/da4/fe5 x:0 0 0 2023-12-09T02:34:54.637 INFO:tasks.workunit.client.0.smithi088.stdout:3/615: rename d1/d9/d6f/d22/f96 to d1/d9/d6f/d2d/db9/fca 0 2023-12-09T02:34:54.637 INFO:tasks.workunit.client.0.smithi088.stdout:7/679: dwrite dc/d21/d6b/fb3 [0,4194304] 0 2023-12-09T02:34:54.639 INFO:tasks.workunit.client.0.smithi088.stdout:1/779: dwrite d8/d1b/d1d/ddf/fea [0,4194304] 0 2023-12-09T02:34:54.639 INFO:tasks.workunit.client.0.smithi088.stdout:2/700: dwrite d6/d20/d3a/d84/fcf [0,4194304] 0 2023-12-09T02:34:54.639 INFO:tasks.workunit.client.0.smithi088.stdout:2/701: chown d6/d8/d4e 398544647 1 2023-12-09T02:34:54.639 INFO:tasks.workunit.client.0.smithi088.stdout:8/713: mknod d2/d9/d13/d15/cf4 0 2023-12-09T02:34:54.639 INFO:tasks.workunit.client.0.smithi088.stdout:8/714: read - d2/d9/d13/d1c/d3b/fb2 zero size 2023-12-09T02:34:54.639 INFO:tasks.workunit.client.0.smithi088.stdout:8/715: truncate d2/d9/fa7 4619108 0 2023-12-09T02:34:54.639 INFO:tasks.workunit.client.0.smithi088.stdout:6/683: truncate d16/d1b/f1d 2138271 0 2023-12-09T02:34:54.639 INFO:tasks.workunit.client.0.smithi088.stdout:6/684: truncate d16/d35/d36/d97/d90/fb9 675397 0 2023-12-09T02:34:54.643 INFO:tasks.workunit.client.0.smithi088.stdout:4/714: write d3/dc/f11 [144886,92944] 0 2023-12-09T02:34:54.643 INFO:tasks.workunit.client.0.smithi088.stdout:4/715: write d3/dc/d43/d83/f49 [598675,3323] 0 2023-12-09T02:34:54.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/680: creat dc/dcb/de2/feb x:0 0 0 2023-12-09T02:34:54.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/681: readlink dc/d21/l19 0 2023-12-09T02:34:54.647 INFO:tasks.workunit.client.0.smithi088.stdout:2/702: mknod d6/d8/d4e/dc9/cec 0 2023-12-09T02:34:54.648 INFO:tasks.workunit.client.0.smithi088.stdout:9/708: dwrite df/d29/f2d [0,4194304] 0 2023-12-09T02:34:54.649 INFO:tasks.workunit.client.0.smithi088.stdout:8/716: symlink d2/d9/d1a/d62/lf5 0 2023-12-09T02:34:54.650 INFO:tasks.workunit.client.0.smithi088.stdout:6/685: link d16/d35/d36/c59 d16/d62/cca 0 2023-12-09T02:34:54.650 INFO:tasks.workunit.client.0.smithi088.stdout:0/661: sync 2023-12-09T02:34:54.651 INFO:tasks.workunit.client.0.smithi088.stdout:0/662: write df/d37/fb2 [299190,19905] 0 2023-12-09T02:34:54.651 INFO:tasks.workunit.client.0.smithi088.stdout:3/616: unlink d1/d9/d6f/f55 0 2023-12-09T02:34:54.655 INFO:tasks.workunit.client.0.smithi088.stdout:4/716: link d3/dc/d1d/d40/f59 d3/dc/d18/dab/dc7/fe6 0 2023-12-09T02:34:54.656 INFO:tasks.workunit.client.0.smithi088.stdout:1/780: dwrite d8/d1c/f5a [0,4194304] 0 2023-12-09T02:34:54.656 INFO:tasks.workunit.client.0.smithi088.stdout:1/781: fdatasync d8/d3d/d5d/d95/f3f 0 2023-12-09T02:34:54.656 INFO:tasks.workunit.client.0.smithi088.stdout:7/682: mkdir dc/d1b/d72/dec 0 2023-12-09T02:34:54.658 INFO:tasks.workunit.client.0.smithi088.stdout:1/782: write d8/d53/f55 [1629057,14054] 0 2023-12-09T02:34:54.658 INFO:tasks.workunit.client.0.smithi088.stdout:2/703: unlink d6/d13/d42/f71 0 2023-12-09T02:34:54.663 INFO:tasks.workunit.client.0.smithi088.stdout:8/717: mkdir d2/d9/d13/df6 0 2023-12-09T02:34:54.663 INFO:tasks.workunit.client.0.smithi088.stdout:9/709: dread df/d20/d30/d3f/fab [0,4194304] 0 2023-12-09T02:34:54.664 INFO:tasks.workunit.client.0.smithi088.stdout:6/686: creat d16/d1b/d25/d5f/fcb x:0 0 0 2023-12-09T02:34:54.664 INFO:tasks.workunit.client.0.smithi088.stdout:6/687: fsync d16/d1b/f22 0 2023-12-09T02:34:54.665 INFO:tasks.workunit.client.0.smithi088.stdout:0/663: mkdir df/d10/d22/d2d/d2e/ddc 0 2023-12-09T02:34:54.665 INFO:tasks.workunit.client.0.smithi088.stdout:0/664: write df/d10/d22/d2d/f5e [4192368,75361] 0 2023-12-09T02:34:54.671 INFO:tasks.workunit.client.0.smithi088.stdout:3/617: mkdir d1/d9/d6f/d22/d7f/d81/d85/dcb 0 2023-12-09T02:34:54.671 INFO:tasks.workunit.client.0.smithi088.stdout:4/717: creat d3/dc/d43/dc5/dd8/fe7 x:0 0 0 2023-12-09T02:34:54.679 INFO:tasks.workunit.client.0.smithi088.stdout:9/710: mkdir df/d29/d2f/da2/def 0 2023-12-09T02:34:54.683 INFO:tasks.workunit.client.0.smithi088.stdout:0/665: rmdir df/d10/d22/da0/dd2 0 2023-12-09T02:34:54.686 INFO:tasks.workunit.client.0.smithi088.stdout:3/618: creat d1/d9/d6f/d6/d83/fcc x:0 0 0 2023-12-09T02:34:54.686 INFO:tasks.workunit.client.0.smithi088.stdout:3/619: truncate d1/d9/d6f/d6/d4a/f5b 369504 0 2023-12-09T02:34:54.688 INFO:tasks.workunit.client.0.smithi088.stdout:4/718: link d3/dc/d1d/d40/d9f/fcf d3/dc/d18/d29/da4/fe8 0 2023-12-09T02:34:54.690 INFO:tasks.workunit.client.0.smithi088.stdout:8/718: rename d2/c1b to d2/d9/d1a/d62/d76/d85/cf7 0 2023-12-09T02:34:54.693 INFO:tasks.workunit.client.0.smithi088.stdout:0/666: rename df/d10/d22/d2d/la1 to df/ldd 0 2023-12-09T02:34:54.693 INFO:tasks.workunit.client.0.smithi088.stdout:0/667: write df/d28/d34/fd6 [876561,51352] 0 2023-12-09T02:34:54.702 INFO:tasks.workunit.client.0.smithi088.stdout:1/783: dwrite d8/d1b/f41 [0,4194304] 0 2023-12-09T02:34:54.706 INFO:tasks.workunit.client.0.smithi088.stdout:1/784: write d8/d3d/d44/da4/dcb/f100 [1476449,93755] 0 2023-12-09T02:34:54.707 INFO:tasks.workunit.client.0.smithi088.stdout:1/785: creat d8/d1b/d1d/dc7/f10e x:0 0 0 2023-12-09T02:34:54.707 INFO:tasks.workunit.client.0.smithi088.stdout:1/786: dread - d8/d3d/d44/da4/dcb/de3/fe5 zero size 2023-12-09T02:34:54.708 INFO:tasks.workunit.client.0.smithi088.stdout:1/787: mknod d8/d27/d40/da5/c10f 0 2023-12-09T02:34:54.708 INFO:tasks.workunit.client.0.smithi088.stdout:1/788: truncate d8/d1c/d50/f72 654724 0 2023-12-09T02:34:54.719 INFO:tasks.workunit.client.0.smithi088.stdout:2/704: dwrite d6/d8/d54/fa6 [0,4194304] 0 2023-12-09T02:34:54.721 INFO:tasks.workunit.client.0.smithi088.stdout:2/705: truncate d6/d8/d1f/d22/f40 2808956 0 2023-12-09T02:34:54.722 INFO:tasks.workunit.client.0.smithi088.stdout:6/688: rmdir d16/d1b/d25/d5f 39 2023-12-09T02:34:54.722 INFO:tasks.workunit.client.0.smithi088.stdout:6/689: fsync d16/d62/d6f/da4/dc2/dc7/d8c/fc4 0 2023-12-09T02:34:54.722 INFO:tasks.workunit.client.0.smithi088.stdout:6/690: read d16/d35/f76 [2710818,63563] 0 2023-12-09T02:34:54.723 INFO:tasks.workunit.client.0.smithi088.stdout:6/691: rename d16/d62/d87/fbe to d16/d62/d6f/da4/dc2/dc7/d8c/fcc 0 2023-12-09T02:34:54.725 INFO:tasks.workunit.client.0.smithi088.stdout:9/711: dwrite df/fe6 [0,4194304] 0 2023-12-09T02:34:54.725 INFO:tasks.workunit.client.0.smithi088.stdout:6/692: mkdir d16/d1b/d2c/dcd 0 2023-12-09T02:34:54.725 INFO:tasks.workunit.client.0.smithi088.stdout:6/693: fdatasync d16/d62/d6f/da4/dc2/dc7/d8c/fcc 0 2023-12-09T02:34:54.727 INFO:tasks.workunit.client.0.smithi088.stdout:7/683: dwrite dc/d21/d6b/d9b/fd3 [0,4194304] 0 2023-12-09T02:34:54.727 INFO:tasks.workunit.client.0.smithi088.stdout:4/719: dwrite d3/dc/f96 [0,4194304] 0 2023-12-09T02:34:54.728 INFO:tasks.workunit.client.0.smithi088.stdout:2/706: dread d6/d13/f33 [0,4194304] 0 2023-12-09T02:34:54.729 INFO:tasks.workunit.client.0.smithi088.stdout:3/620: dwrite d1/d9/d6f/d22/d7f/d45/f88 [0,4194304] 0 2023-12-09T02:34:54.729 INFO:tasks.workunit.client.0.smithi088.stdout:3/621: truncate d1/d9/d6f/d6/d8b/fba 530164 0 2023-12-09T02:34:54.729 INFO:tasks.workunit.client.0.smithi088.stdout:3/622: chown d1/d9/d6f/d6/d72/fa6 5 1 2023-12-09T02:34:54.729 INFO:tasks.workunit.client.0.smithi088.stdout:6/694: creat d16/fce x:0 0 0 2023-12-09T02:34:54.729 INFO:tasks.workunit.client.0.smithi088.stdout:8/719: dwrite d2/d9/d1a/d62/f61 [0,4194304] 0 2023-12-09T02:34:54.730 INFO:tasks.workunit.client.0.smithi088.stdout:8/720: readlink d2/d9/d70/ld2 0 2023-12-09T02:34:54.730 INFO:tasks.workunit.client.0.smithi088.stdout:8/721: chown d2/d9/d70/d8f/d98/cf1 0 1 2023-12-09T02:34:54.730 INFO:tasks.workunit.client.0.smithi088.stdout:8/722: chown d2/d9/d13/d15/cf4 2889 1 2023-12-09T02:34:54.730 INFO:tasks.workunit.client.0.smithi088.stdout:0/668: dwrite df/d28/d43/f4f [0,4194304] 0 2023-12-09T02:34:54.730 INFO:tasks.workunit.client.0.smithi088.stdout:7/684: creat dc/d1b/de4/fed x:0 0 0 2023-12-09T02:34:54.731 INFO:tasks.workunit.client.0.smithi088.stdout:4/720: mknod d3/dc/d1d/d40/ddf/ce9 0 2023-12-09T02:34:54.732 INFO:tasks.workunit.client.0.smithi088.stdout:2/707: creat d6/d20/d3a/d94/fed x:0 0 0 2023-12-09T02:34:54.734 INFO:tasks.workunit.client.0.smithi088.stdout:3/623: link d1/d9/d6f/d6/d72/l77 d1/d9/d6f/d22/d7f/d81/d85/dcb/lcd 0 2023-12-09T02:34:54.735 INFO:tasks.workunit.client.0.smithi088.stdout:5/680: sync 2023-12-09T02:34:54.741 INFO:tasks.workunit.client.0.smithi088.stdout:0/669: symlink df/lde 0 2023-12-09T02:34:54.743 INFO:tasks.workunit.client.0.smithi088.stdout:7/685: truncate dc/d21/d6b/d6d/fb5 113838 0 2023-12-09T02:34:54.749 INFO:tasks.workunit.client.0.smithi088.stdout:0/670: dread df/d10/f1e [0,4194304] 0 2023-12-09T02:34:54.750 INFO:tasks.workunit.client.0.smithi088.stdout:0/671: readlink df/l8e 0 2023-12-09T02:34:54.752 INFO:tasks.workunit.client.0.smithi088.stdout:9/712: dwrite df/d20/d30/d60/d5c/fed [0,4194304] 0 2023-12-09T02:34:54.756 INFO:tasks.workunit.client.0.smithi088.stdout:4/721: rename d3/f4 to d3/dc/d18/dab/dc7/fea 0 2023-12-09T02:34:54.756 INFO:tasks.workunit.client.0.smithi088.stdout:4/722: write d3/dc/d43/dc5/fca [585423,47423] 0 2023-12-09T02:34:54.756 INFO:tasks.workunit.client.0.smithi088.stdout:2/708: creat d6/d20/d69/db2/dc2/ddf/fee x:0 0 0 2023-12-09T02:34:54.757 INFO:tasks.workunit.client.0.smithi088.stdout:7/686: getdents dc/d21/d6b/d93 0 2023-12-09T02:34:54.758 INFO:tasks.workunit.client.0.smithi088.stdout:0/672: mkdir df/d10/d22/d2d/d2e/ddf 0 2023-12-09T02:34:54.758 INFO:tasks.workunit.client.0.smithi088.stdout:5/681: dwrite d3/d15/de/d10/d18/da5/fb1 [0,4194304] 0 2023-12-09T02:34:54.759 INFO:tasks.workunit.client.0.smithi088.stdout:4/723: dread d3/dc/d43/d83/f49 [0,4194304] 0 2023-12-09T02:34:54.759 INFO:tasks.workunit.client.0.smithi088.stdout:5/682: readlink d3/d15/de/d10/d18/d19/d1b/d35/d42/l23 0 2023-12-09T02:34:54.759 INFO:tasks.workunit.client.0.smithi088.stdout:5/683: stat d3/d15/d2e/d49/d88/dd6 0 2023-12-09T02:34:54.759 INFO:tasks.workunit.client.0.smithi088.stdout:8/723: dwrite d2/d2b/f2e [0,4194304] 0 2023-12-09T02:34:54.759 INFO:tasks.workunit.client.0.smithi088.stdout:0/673: write df/d10/d22/d5b/f71 [611704,110962] 0 2023-12-09T02:34:54.761 INFO:tasks.workunit.client.0.smithi088.stdout:9/713: truncate df/f3d 787252 0 2023-12-09T02:34:54.766 INFO:tasks.workunit.client.0.smithi088.stdout:3/624: rename d1/d9/d6f/d6/d72 to d1/d9/d6f/d2d/dab/dc5/dc9/dce 0 2023-12-09T02:34:54.766 INFO:tasks.workunit.client.0.smithi088.stdout:2/709: truncate d6/d8/d4e/d3c/f8c 951618 0 2023-12-09T02:34:54.766 INFO:tasks.workunit.client.0.smithi088.stdout:3/625: truncate d1/d9/d6f/d2d/dab/dc5/dc9/dce/fc1 124505 0 2023-12-09T02:34:54.769 INFO:tasks.workunit.client.0.smithi088.stdout:5/684: creat d3/d15/de/d10/d51/db4/dd7/fe6 x:0 0 0 2023-12-09T02:34:54.770 INFO:tasks.workunit.client.0.smithi088.stdout:0/674: dread df/d10/d22/d5f/fb6 [0,4194304] 0 2023-12-09T02:34:54.773 INFO:tasks.workunit.client.0.smithi088.stdout:8/724: creat d2/d2b/ff8 x:0 0 0 2023-12-09T02:34:54.773 INFO:tasks.workunit.client.0.smithi088.stdout:8/725: chown d2/d9/d13/cb0 1434449574 1 2023-12-09T02:34:54.773 INFO:tasks.workunit.client.0.smithi088.stdout:2/710: dread d6/f39 [0,4194304] 0 2023-12-09T02:34:54.773 INFO:tasks.workunit.client.0.smithi088.stdout:2/711: readlink d6/d20/d3a/l41 0 2023-12-09T02:34:54.774 INFO:tasks.workunit.client.0.smithi088.stdout:4/724: dwrite d3/dc/d1d/d40/d9f/fcf [0,4194304] 0 2023-12-09T02:34:54.775 INFO:tasks.workunit.client.0.smithi088.stdout:9/714: creat df/d20/d30/d3f/d48/da7/ff0 x:0 0 0 2023-12-09T02:34:54.777 INFO:tasks.workunit.client.0.smithi088.stdout:3/626: creat d1/d9/d6f/d2d/dab/dc5/dc9/fcf x:0 0 0 2023-12-09T02:34:54.778 INFO:tasks.workunit.client.0.smithi088.stdout:5/685: link d3/d8/l3b d3/d15/dc/le7 0 2023-12-09T02:34:54.780 INFO:tasks.workunit.client.0.smithi088.stdout:8/726: creat d2/db9/ff9 x:0 0 0 2023-12-09T02:34:54.783 INFO:tasks.workunit.client.0.smithi088.stdout:2/712: creat d6/d20/d3a/d94/dad/fef x:0 0 0 2023-12-09T02:34:54.787 INFO:tasks.workunit.client.0.smithi088.stdout:5/686: creat d3/fe8 x:0 0 0 2023-12-09T02:34:54.787 INFO:tasks.workunit.client.0.smithi088.stdout:9/715: dread df/d20/d5b/d91/f8b [0,4194304] 0 2023-12-09T02:34:54.788 INFO:tasks.workunit.client.0.smithi088.stdout:0/675: link df/d28/d33/la8 df/d10/d22/d2d/d6a/le0 0 2023-12-09T02:34:54.791 INFO:tasks.workunit.client.0.smithi088.stdout:2/713: creat d6/d20/d3a/ff0 x:0 0 0 2023-12-09T02:34:54.793 INFO:tasks.workunit.client.0.smithi088.stdout:5/687: link d3/d15/de/d10/d18/d19/d1b/d35/d42/c3a d3/d15/d2e/d49/d88/ce9 0 2023-12-09T02:34:54.794 INFO:tasks.workunit.client.0.smithi088.stdout:9/716: mknod df/d20/dc7/cf1 0 2023-12-09T02:34:54.795 INFO:tasks.workunit.client.0.smithi088.stdout:9/717: dread df/d20/d30/d3f/d48/fae [0,4194304] 0 2023-12-09T02:34:54.795 INFO:tasks.workunit.client.0.smithi088.stdout:9/718: chown df/d20 126456 1 2023-12-09T02:34:54.795 INFO:tasks.workunit.client.0.smithi088.stdout:9/719: fsync df/d20/d30/d3f/d48/f6e 0 2023-12-09T02:34:54.796 INFO:tasks.workunit.client.0.smithi088.stdout:0/676: link df/d37/c9d df/ce1 0 2023-12-09T02:34:54.797 INFO:tasks.workunit.client.0.smithi088.stdout:9/720: symlink df/d20/d30/d3f/d48/dc4/lf2 0 2023-12-09T02:34:54.798 INFO:tasks.workunit.client.0.smithi088.stdout:5/688: dread d3/d15/de/f17 [4194304,4194304] 0 2023-12-09T02:34:54.798 INFO:tasks.workunit.client.0.smithi088.stdout:5/689: chown d3/d15/de/lae 116976 1 2023-12-09T02:34:54.800 INFO:tasks.workunit.client.0.smithi088.stdout:0/677: rename df/d10/d22/dba to df/d37/de2 0 2023-12-09T02:34:54.801 INFO:tasks.workunit.client.0.smithi088.stdout:9/721: write df/f2c [2861712,127067] 0 2023-12-09T02:34:54.801 INFO:tasks.workunit.client.0.smithi088.stdout:4/725: dwrite d3/dc/d43/d8c/d95/f4b [0,4194304] 0 2023-12-09T02:34:54.802 INFO:tasks.workunit.client.0.smithi088.stdout:5/690: symlink d3/d15/de/d10/d51/db4/dd7/lea 0 2023-12-09T02:34:54.803 INFO:tasks.workunit.client.0.smithi088.stdout:0/678: creat df/d10/d22/d2d/d96/fe3 x:0 0 0 2023-12-09T02:34:54.804 INFO:tasks.workunit.client.0.smithi088.stdout:3/627: dwrite d1/d9/d6f/d2d/d66/fb2 [0,4194304] 0 2023-12-09T02:34:54.805 INFO:tasks.workunit.client.0.smithi088.stdout:9/722: creat df/d20/d5b/ff3 x:0 0 0 2023-12-09T02:34:54.806 INFO:tasks.workunit.client.0.smithi088.stdout:4/726: creat d3/d65/feb x:0 0 0 2023-12-09T02:34:54.808 INFO:tasks.workunit.client.0.smithi088.stdout:5/691: creat d3/d15/de/d10/d18/d19/d1b/d35/d61/feb x:0 0 0 2023-12-09T02:34:54.808 INFO:tasks.workunit.client.0.smithi088.stdout:8/727: dwrite d2/f8 [0,4194304] 0 2023-12-09T02:34:54.808 INFO:tasks.workunit.client.0.smithi088.stdout:8/728: dread - d2/d9/d1a/d62/d76/d85/fbd zero size 2023-12-09T02:34:54.809 INFO:tasks.workunit.client.0.smithi088.stdout:4/727: read d3/dc/d18/d29/f60 [2699156,79702] 0 2023-12-09T02:34:54.809 INFO:tasks.workunit.client.0.smithi088.stdout:4/728: fdatasync d3/dc/d43/d8c/d99/fa8 0 2023-12-09T02:34:54.810 INFO:tasks.workunit.client.0.smithi088.stdout:0/679: symlink df/d10/le4 0 2023-12-09T02:34:54.810 INFO:tasks.workunit.client.0.smithi088.stdout:4/729: dread d3/d65/f79 [0,4194304] 0 2023-12-09T02:34:54.811 INFO:tasks.workunit.client.0.smithi088.stdout:5/692: write d3/d15/de/d10/d18/f4e [1287887,111630] 0 2023-12-09T02:34:54.812 INFO:tasks.workunit.client.0.smithi088.stdout:3/628: mknod d1/d3e/d9d/cd0 0 2023-12-09T02:34:54.812 INFO:tasks.workunit.client.0.smithi088.stdout:3/629: fsync d1/d9/d6f/d2d/db9/fb8 0 2023-12-09T02:34:54.815 INFO:tasks.workunit.client.0.smithi088.stdout:8/729: rmdir d2/d9/d70/d8f/dc2 39 2023-12-09T02:34:54.817 INFO:tasks.workunit.client.0.smithi088.stdout:4/730: creat d3/dc/d43/dc5/dd8/fec x:0 0 0 2023-12-09T02:34:54.821 INFO:tasks.workunit.client.0.smithi088.stdout:9/723: dwrite df/d20/d5b/fd8 [0,4194304] 0 2023-12-09T02:34:54.822 INFO:tasks.workunit.client.0.smithi088.stdout:5/693: creat d3/d15/de/d10/d51/d7f/fec x:0 0 0 2023-12-09T02:34:54.822 INFO:tasks.workunit.client.0.smithi088.stdout:5/694: dread - d3/d15/de/d10/d51/db4/f9f zero size 2023-12-09T02:34:54.823 INFO:tasks.workunit.client.0.smithi088.stdout:8/730: rmdir d2/d9/d1a/d65 39 2023-12-09T02:34:54.823 INFO:tasks.workunit.client.0.smithi088.stdout:8/731: write d2/d9/d13/d1c/f5a [294886,22847] 0 2023-12-09T02:34:54.826 INFO:tasks.workunit.client.0.smithi088.stdout:0/680: rename df/d28/d33/daf/ld7 to df/d37/le5 0 2023-12-09T02:34:54.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/681: write df/f2c [2282371,86823] 0 2023-12-09T02:34:54.830 INFO:tasks.workunit.client.0.smithi088.stdout:5/695: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d61/ded 0 2023-12-09T02:34:54.831 INFO:tasks.workunit.client.0.smithi088.stdout:8/732: dread d2/d9/d13/d1c/d5f/fce [0,4194304] 0 2023-12-09T02:34:54.832 INFO:tasks.workunit.client.0.smithi088.stdout:9/724: dread df/d20/d30/d3f/d48/fe8 [0,4194304] 0 2023-12-09T02:34:54.833 INFO:tasks.workunit.client.0.smithi088.stdout:5/696: creat d3/d15/de/d73/fee x:0 0 0 2023-12-09T02:34:54.833 INFO:tasks.workunit.client.0.smithi088.stdout:5/697: chown d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/c8b 2 1 2023-12-09T02:34:54.834 INFO:tasks.workunit.client.0.smithi088.stdout:4/731: dwrite d3/dc/d18/d29/f3d [0,4194304] 0 2023-12-09T02:34:54.834 INFO:tasks.workunit.client.0.smithi088.stdout:4/732: readlink d3/dc/d18/l7f 0 2023-12-09T02:34:54.835 INFO:tasks.workunit.client.0.smithi088.stdout:5/698: mkdir d3/d15/d2e/def 0 2023-12-09T02:34:54.841 INFO:tasks.workunit.client.0.smithi088.stdout:5/699: rename d3/d15/dc/d60/db2/fc7 to d3/d15/de/d10/d18/d19/d1b/d35/ff0 0 2023-12-09T02:34:54.841 INFO:tasks.workunit.client.0.smithi088.stdout:5/700: fdatasync d3/d15/dc/d60/f91 0 2023-12-09T02:34:54.842 INFO:tasks.workunit.client.0.smithi088.stdout:5/701: fsync d3/d15/de/d10/d18/d19/d1b/f7e 0 2023-12-09T02:34:54.842 INFO:tasks.workunit.client.0.smithi088.stdout:5/702: readlink d3/d15/de/d10/l1a 0 2023-12-09T02:34:54.843 INFO:tasks.workunit.client.0.smithi088.stdout:5/703: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d42/de2/df1 0 2023-12-09T02:34:54.843 INFO:tasks.workunit.client.0.smithi088.stdout:1/789: sync 2023-12-09T02:34:54.849 INFO:tasks.workunit.client.0.smithi088.stdout:5/704: write d3/d15/de/d2c/f44 [1703808,47730] 0 2023-12-09T02:34:54.849 INFO:tasks.workunit.client.0.smithi088.stdout:5/705: dread - d3/d15/de/d10/d18/d19/d1b/d35/f69 zero size 2023-12-09T02:34:54.858 INFO:tasks.workunit.client.0.smithi088.stdout:8/733: dwrite d2/d2b/ff8 [0,4194304] 0 2023-12-09T02:34:54.858 INFO:tasks.workunit.client.0.smithi088.stdout:8/734: chown d2/d9/f10 0 1 2023-12-09T02:34:54.860 INFO:tasks.workunit.client.0.smithi088.stdout:8/735: symlink d2/d9/d70/d8f/d98/lfa 0 2023-12-09T02:34:54.860 INFO:tasks.workunit.client.0.smithi088.stdout:9/725: dwrite df/f13 [0,4194304] 0 2023-12-09T02:34:54.861 INFO:tasks.workunit.client.0.smithi088.stdout:9/726: stat df/d20/d4c/d97/l98 0 2023-12-09T02:34:54.861 INFO:tasks.workunit.client.0.smithi088.stdout:8/736: dread d2/d9/d13/d15/d6e/fa2 [0,4194304] 0 2023-12-09T02:34:54.862 INFO:tasks.workunit.client.0.smithi088.stdout:8/737: chown d2/d9/d70/d8f/dc2/fd7 181336470 1 2023-12-09T02:34:54.862 INFO:tasks.workunit.client.0.smithi088.stdout:4/733: dwrite d3/f4c [0,4194304] 0 2023-12-09T02:34:54.862 INFO:tasks.workunit.client.0.smithi088.stdout:9/727: creat df/d20/d30/d3f/d48/ff4 x:0 0 0 2023-12-09T02:34:54.862 INFO:tasks.workunit.client.0.smithi088.stdout:5/706: dread d3/d15/de/f26 [0,4194304] 0 2023-12-09T02:34:54.863 INFO:tasks.workunit.client.0.smithi088.stdout:8/738: read d2/d9/d1a/f1f [3052731,64017] 0 2023-12-09T02:34:54.867 INFO:tasks.workunit.client.0.smithi088.stdout:4/734: link d3/dc/d1d/d40/c44 d3/dc/d18/dab/dc7/ced 0 2023-12-09T02:34:54.868 INFO:tasks.workunit.client.0.smithi088.stdout:9/728: rename df/d50/fc2 to df/d20/d30/d60/dc9/dda/de2/ff5 0 2023-12-09T02:34:54.869 INFO:tasks.workunit.client.0.smithi088.stdout:5/707: creat d3/d15/de/d10/d51/d7f/ff2 x:0 0 0 2023-12-09T02:34:54.869 INFO:tasks.workunit.client.0.smithi088.stdout:9/729: write df/d29/d2f/f34 [952199,122779] 0 2023-12-09T02:34:54.869 INFO:tasks.workunit.client.0.smithi088.stdout:4/735: mknod d3/dc/d1d/d40/d9f/dc8/cee 0 2023-12-09T02:34:54.871 INFO:tasks.workunit.client.0.smithi088.stdout:5/708: creat d3/d15/de/d2c/ff3 x:0 0 0 2023-12-09T02:34:54.871 INFO:tasks.workunit.client.0.smithi088.stdout:5/709: chown d3/c92 194385250 1 2023-12-09T02:34:54.871 INFO:tasks.workunit.client.0.smithi088.stdout:5/710: fsync d3/d15/de/fd9 0 2023-12-09T02:34:54.873 INFO:tasks.workunit.client.0.smithi088.stdout:9/730: mkdir df/d20/d30/d60/dc9/dda/de2/df6 0 2023-12-09T02:34:54.873 INFO:tasks.workunit.client.0.smithi088.stdout:6/695: sync 2023-12-09T02:34:54.873 INFO:tasks.workunit.client.0.smithi088.stdout:7/687: sync 2023-12-09T02:34:54.875 INFO:tasks.workunit.client.0.smithi088.stdout:7/688: creat dc/d1b/d72/dec/fee x:0 0 0 2023-12-09T02:34:54.876 INFO:tasks.workunit.client.0.smithi088.stdout:9/731: dread df/d20/d30/d60/d5c/f1e [0,4194304] 0 2023-12-09T02:34:54.876 INFO:tasks.workunit.client.0.smithi088.stdout:9/732: truncate df/d20/d30/d60/d5c/ddb/f81 1473170 0 2023-12-09T02:34:54.877 INFO:tasks.workunit.client.0.smithi088.stdout:8/739: dread d2/d9/d1a/d62/f61 [0,4194304] 0 2023-12-09T02:34:54.878 INFO:tasks.workunit.client.0.smithi088.stdout:9/733: symlink df/d20/d30/lf7 0 2023-12-09T02:34:54.879 INFO:tasks.workunit.client.0.smithi088.stdout:8/740: mkdir d2/d9/d13/d1c/d5f/d96/dec/dfb 0 2023-12-09T02:34:54.880 INFO:tasks.workunit.client.0.smithi088.stdout:9/734: creat df/d20/d30/d60/d5c/db9/ff8 x:0 0 0 2023-12-09T02:34:54.882 INFO:tasks.workunit.client.0.smithi088.stdout:8/741: getdents d2/d9/d13/d1c/d5f/d96 0 2023-12-09T02:34:54.882 INFO:tasks.workunit.client.0.smithi088.stdout:8/742: truncate d2/d9/d1a/d62/d49/fb8 281070 0 2023-12-09T02:34:54.882 INFO:tasks.workunit.client.0.smithi088.stdout:8/743: chown d2/d9/d13/d1c/ld6 370466 1 2023-12-09T02:34:54.883 INFO:tasks.workunit.client.0.smithi088.stdout:8/744: readlink d2/d9/d1a/d65/lbc 0 2023-12-09T02:34:54.883 INFO:tasks.workunit.client.0.smithi088.stdout:8/745: write d2/d9/d13/d15/fc5 [291773,126952] 0 2023-12-09T02:34:54.883 INFO:tasks.workunit.client.0.smithi088.stdout:8/746: readlink d2/d9/d13/ldf 0 2023-12-09T02:34:54.883 INFO:tasks.workunit.client.0.smithi088.stdout:8/747: write d2/d9/d1a/f57 [1789407,54578] 0 2023-12-09T02:34:54.883 INFO:tasks.workunit.client.0.smithi088.stdout:9/735: symlink df/d50/d63/db8/lf9 0 2023-12-09T02:34:54.884 INFO:tasks.workunit.client.0.smithi088.stdout:8/748: rename d2/db9/fea to d2/d9/d70/ffc 0 2023-12-09T02:34:54.884 INFO:tasks.workunit.client.0.smithi088.stdout:5/711: dread d3/d15/de/d10/d18/d19/d1b/d35/d42/f21 [0,4194304] 0 2023-12-09T02:34:54.885 INFO:tasks.workunit.client.0.smithi088.stdout:9/736: mkdir df/d20/d30/d3f/d48/dfa 0 2023-12-09T02:34:54.886 INFO:tasks.workunit.client.0.smithi088.stdout:5/712: creat d3/d15/d2e/ff4 x:0 0 0 2023-12-09T02:34:54.887 INFO:tasks.workunit.client.0.smithi088.stdout:8/749: dread d2/d9/d13/d1c/f5a [0,4194304] 0 2023-12-09T02:34:54.887 INFO:tasks.workunit.client.0.smithi088.stdout:8/750: write d2/d9/d1a/d65/f9d [416989,83454] 0 2023-12-09T02:34:54.887 INFO:tasks.workunit.client.0.smithi088.stdout:7/689: dread dc/d21/d6b/fb3 [0,4194304] 0 2023-12-09T02:34:54.888 INFO:tasks.workunit.client.0.smithi088.stdout:8/751: mkdir d2/d9/d13/d1c/d5f/d84/dfd 0 2023-12-09T02:34:54.888 INFO:tasks.workunit.client.0.smithi088.stdout:8/752: dread - d2/d9/d13/d1c/d5f/d84/fd4 zero size 2023-12-09T02:34:54.889 INFO:tasks.workunit.client.0.smithi088.stdout:7/690: rename dc/d21/d6b/d6d/da4/d38/d1e/fc8 to dc/d21/d7f/fef 0 2023-12-09T02:34:54.890 INFO:tasks.workunit.client.0.smithi088.stdout:4/736: dwrite d3/dc/d1d/f97 [0,4194304] 0 2023-12-09T02:34:54.890 INFO:tasks.workunit.client.0.smithi088.stdout:7/691: mkdir dc/d21/d6b/d6d/d76/df0 0 2023-12-09T02:34:54.890 INFO:tasks.workunit.client.0.smithi088.stdout:7/692: readlink dc/d21/d6b/d6d/da4/d38/lda 0 2023-12-09T02:34:54.893 INFO:tasks.workunit.client.0.smithi088.stdout:4/737: mknod d3/dc/d1d/d40/d9f/dc8/dda/cef 0 2023-12-09T02:34:54.893 INFO:tasks.workunit.client.0.smithi088.stdout:7/693: symlink dc/d21/d6b/d6d/da4/lf1 0 2023-12-09T02:34:54.893 INFO:tasks.workunit.client.0.smithi088.stdout:7/694: write dc/d21/d6b/d6d/da4/d3e/f92 [216492,11974] 0 2023-12-09T02:34:54.893 INFO:tasks.workunit.client.0.smithi088.stdout:4/738: getdents d3/dc/d43/d83/d37 0 2023-12-09T02:34:54.895 INFO:tasks.workunit.client.0.smithi088.stdout:6/696: dwrite d16/d1b/d25/f27 [0,4194304] 0 2023-12-09T02:34:54.895 INFO:tasks.workunit.client.0.smithi088.stdout:4/739: creat d3/dc/d43/d8c/d95/daa/db7/ff0 x:0 0 0 2023-12-09T02:34:54.899 INFO:tasks.workunit.client.0.smithi088.stdout:6/697: mknod d16/ccf 0 2023-12-09T02:34:54.899 INFO:tasks.workunit.client.0.smithi088.stdout:6/698: write d16/d35/f5d [636949,75218] 0 2023-12-09T02:34:54.903 INFO:tasks.workunit.client.0.smithi088.stdout:9/737: dwrite df/d20/d30/d60/d5c/db9/ff8 [0,4194304] 0 2023-12-09T02:34:54.903 INFO:tasks.workunit.client.0.smithi088.stdout:9/738: chown df/d20/d30/d60 2400 1 2023-12-09T02:34:54.919 INFO:tasks.workunit.client.0.smithi088.stdout:4/740: dread d3/dc/d43/d83/d37/fbf [0,4194304] 0 2023-12-09T02:34:54.921 INFO:tasks.workunit.client.0.smithi088.stdout:5/713: dwrite d3/d15/de/d10/d18/d19/d1b/fe0 [0,4194304] 0 2023-12-09T02:34:54.921 INFO:tasks.workunit.client.0.smithi088.stdout:7/695: dread dc/f47 [0,4194304] 0 2023-12-09T02:34:54.921 INFO:tasks.workunit.client.0.smithi088.stdout:7/696: chown dc/d21/d6b/d6d/da4/d38/d1e/cc9 674 1 2023-12-09T02:34:54.923 INFO:tasks.workunit.client.0.smithi088.stdout:5/714: rename d3/d15/de/d10/d18/d19/d1b/d35/d42/de2/df1 to d3/d15/de/d10/d51/db4/df5 0 2023-12-09T02:34:54.925 INFO:tasks.workunit.client.0.smithi088.stdout:7/697: rename dc/f18 to dc/d21/d6b/d6d/d76/df0/ff2 0 2023-12-09T02:34:54.925 INFO:tasks.workunit.client.0.smithi088.stdout:7/698: fdatasync dc/d21/d6b/d6d/da4/f71 0 2023-12-09T02:34:54.926 INFO:tasks.workunit.client.0.smithi088.stdout:5/715: mknod d3/d15/d2e/d49/d88/cf6 0 2023-12-09T02:34:54.927 INFO:tasks.workunit.client.0.smithi088.stdout:8/753: dwrite d2/d9/d13/d1c/d5f/d84/fd4 [0,4194304] 0 2023-12-09T02:34:54.929 INFO:tasks.workunit.client.0.smithi088.stdout:8/754: symlink d2/db9/lfe 0 2023-12-09T02:34:54.931 INFO:tasks.workunit.client.0.smithi088.stdout:8/755: unlink d2/d9/d13/d15/fc5 0 2023-12-09T02:34:54.931 INFO:tasks.workunit.client.0.smithi088.stdout:8/756: dread - d2/d9/d13/d15/d6e/fb6 zero size 2023-12-09T02:34:54.931 INFO:tasks.workunit.client.0.smithi088.stdout:8/757: read - d2/d9/d70/d8f/dc2/fd7 zero size 2023-12-09T02:34:54.932 INFO:tasks.workunit.client.0.smithi088.stdout:8/758: rmdir d2/d9/d70/d8f/da8/dbe 39 2023-12-09T02:34:54.934 INFO:tasks.workunit.client.0.smithi088.stdout:4/741: dread d3/f89 [0,4194304] 0 2023-12-09T02:34:54.934 INFO:tasks.workunit.client.0.smithi088.stdout:4/742: chown d3/dc/d18/d7b/l64 3556 1 2023-12-09T02:34:54.934 INFO:tasks.workunit.client.0.smithi088.stdout:4/743: fsync d3/dc/d43/d8c/d95/fb1 0 2023-12-09T02:34:54.934 INFO:tasks.workunit.client.0.smithi088.stdout:4/744: readlink d3/dc/d43/l8b 0 2023-12-09T02:34:54.934 INFO:tasks.workunit.client.0.smithi088.stdout:4/745: read d3/dc/d18/d29/f60 [3116972,1244] 0 2023-12-09T02:34:54.935 INFO:tasks.workunit.client.0.smithi088.stdout:6/699: dwrite d16/d62/d6f/da4/dc2/dc7/d8c/fc4 [0,4194304] 0 2023-12-09T02:34:54.935 INFO:tasks.workunit.client.0.smithi088.stdout:9/739: dwrite df/d20/d30/d60/d5c/f1e [0,4194304] 0 2023-12-09T02:34:54.935 INFO:tasks.workunit.client.0.smithi088.stdout:4/746: mknod d3/dc/d18/dab/cf1 0 2023-12-09T02:34:54.935 INFO:tasks.workunit.client.0.smithi088.stdout:4/747: chown d3/dc/d1d/f71 106 1 2023-12-09T02:34:54.935 INFO:tasks.workunit.client.0.smithi088.stdout:4/748: chown d3/dc/d43/d8c/d95/l46 1031130495 1 2023-12-09T02:34:54.935 INFO:tasks.workunit.client.0.smithi088.stdout:6/700: write d16/d1b/d25/f27 [843909,11553] 0 2023-12-09T02:34:54.943 INFO:tasks.workunit.client.0.smithi088.stdout:5/716: getdents d3/d15/de/d10/d51/db4 0 2023-12-09T02:34:54.944 INFO:tasks.workunit.client.0.smithi088.stdout:5/717: dread d3/d15/de/d10/d18/d19/d1b/d35/d61/f81 [0,4194304] 0 2023-12-09T02:34:54.946 INFO:tasks.workunit.client.0.smithi088.stdout:9/740: creat df/d20/d4c/d84/dcd/ffb x:0 0 0 2023-12-09T02:34:54.946 INFO:tasks.workunit.client.0.smithi088.stdout:9/741: write df/d20/d30/d60/d5c/db9/f83 [4518047,83329] 0 2023-12-09T02:34:54.950 INFO:tasks.workunit.client.0.smithi088.stdout:9/742: mkdir df/d20/d30/d3f/d48/dc4/dfc 0 2023-12-09T02:34:54.951 INFO:tasks.workunit.client.0.smithi088.stdout:4/749: symlink d3/dc/d43/lf2 0 2023-12-09T02:34:54.951 INFO:tasks.workunit.client.0.smithi088.stdout:4/750: chown d3/dc/d1d/f3f 1374887570 1 2023-12-09T02:34:54.951 INFO:tasks.workunit.client.0.smithi088.stdout:4/751: readlink d3/dc/d18/d7b/dbb/dbc/l94 0 2023-12-09T02:34:54.952 INFO:tasks.workunit.client.0.smithi088.stdout:4/752: mknod d3/dc/d43/dc5/cf3 0 2023-12-09T02:34:54.952 INFO:tasks.workunit.client.0.smithi088.stdout:4/753: chown d3/dc/d1d/c5f 7954 1 2023-12-09T02:34:54.953 INFO:tasks.workunit.client.0.smithi088.stdout:5/718: dread d3/d15/de/d10/d18/f57 [0,4194304] 0 2023-12-09T02:34:54.953 INFO:tasks.workunit.client.0.smithi088.stdout:4/754: creat d3/dc/d1d/ff4 x:0 0 0 2023-12-09T02:34:54.954 INFO:tasks.workunit.client.0.smithi088.stdout:5/719: symlink d3/d15/de/d10/d18/d19/d1b/d35/d58/lf7 0 2023-12-09T02:34:54.956 INFO:tasks.workunit.client.0.smithi088.stdout:5/720: mknod d3/d15/de/d10/d18/d19/d1b/d35/d42/de2/cf8 0 2023-12-09T02:34:54.956 INFO:tasks.workunit.client.0.smithi088.stdout:0/682: sync 2023-12-09T02:34:54.956 INFO:tasks.workunit.client.0.smithi088.stdout:1/790: sync 2023-12-09T02:34:54.956 INFO:tasks.workunit.client.0.smithi088.stdout:3/630: sync 2023-12-09T02:34:54.956 INFO:tasks.workunit.client.0.smithi088.stdout:2/714: sync 2023-12-09T02:34:54.956 INFO:tasks.workunit.client.0.smithi088.stdout:3/631: fsync d1/d9/d6f/d6/f11 0 2023-12-09T02:34:54.957 INFO:tasks.workunit.client.0.smithi088.stdout:5/721: mknod d3/d15/de/d10/d18/d19/d20/cf9 0 2023-12-09T02:34:54.957 INFO:tasks.workunit.client.0.smithi088.stdout:5/722: stat d3/d15/de/d10/d18/d19/d1b/d35/d42/de2/cf8 0 2023-12-09T02:34:54.957 INFO:tasks.workunit.client.0.smithi088.stdout:5/723: readlink d3/d15/de/d10/d51/dc9/lc1 0 2023-12-09T02:34:54.957 INFO:tasks.workunit.client.0.smithi088.stdout:5/724: write d3/d15/de/d10/d18/d19/fa0 [850085,91967] 0 2023-12-09T02:34:54.957 INFO:tasks.workunit.client.0.smithi088.stdout:9/743: dread df/d20/d30/d3f/fab [0,4194304] 0 2023-12-09T02:34:54.958 INFO:tasks.workunit.client.0.smithi088.stdout:0/683: mkdir df/de6 0 2023-12-09T02:34:54.958 INFO:tasks.workunit.client.0.smithi088.stdout:0/684: dread - df/d28/f9f zero size 2023-12-09T02:34:54.958 INFO:tasks.workunit.client.0.smithi088.stdout:0/685: fdatasync df/d10/f31 0 2023-12-09T02:34:54.958 INFO:tasks.workunit.client.0.smithi088.stdout:0/686: dread - df/d37/de2/fc9 zero size 2023-12-09T02:34:54.960 INFO:tasks.workunit.client.0.smithi088.stdout:2/715: rename d6/d8/d77/la4 to d6/d8/d77/lf1 0 2023-12-09T02:34:54.960 INFO:tasks.workunit.client.0.smithi088.stdout:3/632: creat d1/d9/d6f/d6/d4a/d41/fd1 x:0 0 0 2023-12-09T02:34:54.962 INFO:tasks.workunit.client.0.smithi088.stdout:4/755: dread d3/dc/d43/d8c/d95/f4b [0,4194304] 0 2023-12-09T02:34:54.962 INFO:tasks.workunit.client.0.smithi088.stdout:4/756: stat d3/dc/d43/d8c/d95/fb1 0 2023-12-09T02:34:54.962 INFO:tasks.workunit.client.0.smithi088.stdout:5/725: mkdir d3/d15/de/d2c/dfa 0 2023-12-09T02:34:54.962 INFO:tasks.workunit.client.0.smithi088.stdout:9/744: unlink df/d20/d4c/d97/lb2 0 2023-12-09T02:34:54.962 INFO:tasks.workunit.client.0.smithi088.stdout:9/745: chown df/d20/d30/d60/dc9/dda/de2/df6 1 1 2023-12-09T02:34:54.962 INFO:tasks.workunit.client.0.smithi088.stdout:9/746: fdatasync df/d20/d30/d3f/d48/fe0 0 2023-12-09T02:34:54.963 INFO:tasks.workunit.client.0.smithi088.stdout:0/687: link df/d28/d34/l4c df/d28/d43/le7 0 2023-12-09T02:34:54.963 INFO:tasks.workunit.client.0.smithi088.stdout:3/633: creat d1/d9/d6f/d6/d4a/d41/fd2 x:0 0 0 2023-12-09T02:34:54.964 INFO:tasks.workunit.client.0.smithi088.stdout:4/757: rename d3/d65/f6f to d3/dc/d43/d83/d37/ff5 0 2023-12-09T02:34:54.965 INFO:tasks.workunit.client.0.smithi088.stdout:4/758: stat d3/dc/d43/d83/f55 0 2023-12-09T02:34:54.965 INFO:tasks.workunit.client.0.smithi088.stdout:5/726: creat d3/d15/de/d10/d51/db4/ffb x:0 0 0 2023-12-09T02:34:54.965 INFO:tasks.workunit.client.0.smithi088.stdout:5/727: fsync d3/f3d 0 2023-12-09T02:34:54.965 INFO:tasks.workunit.client.0.smithi088.stdout:5/728: fsync d3/d8/f56 0 2023-12-09T02:34:54.966 INFO:tasks.workunit.client.0.smithi088.stdout:0/688: creat df/d10/d22/d2d/d96/fe8 x:0 0 0 2023-12-09T02:34:54.966 INFO:tasks.workunit.client.0.smithi088.stdout:0/689: fsync df/fa3 0 2023-12-09T02:34:54.966 INFO:tasks.workunit.client.0.smithi088.stdout:3/634: creat d1/d9/d6f/d22/d7f/fd3 x:0 0 0 2023-12-09T02:34:54.967 INFO:tasks.workunit.client.0.smithi088.stdout:3/635: chown d1/d3e/l59 141115178 1 2023-12-09T02:34:54.967 INFO:tasks.workunit.client.0.smithi088.stdout:3/636: chown d1/d9/d6f/d15/f27 1909863 1 2023-12-09T02:34:54.967 INFO:tasks.workunit.client.0.smithi088.stdout:5/729: mknod d3/d15/de/d10/d18/d19/d20/ddf/cfc 0 2023-12-09T02:34:54.968 INFO:tasks.workunit.client.0.smithi088.stdout:5/730: chown d3/d15/de/d10 104243112 1 2023-12-09T02:34:54.968 INFO:tasks.workunit.client.0.smithi088.stdout:3/637: dread d1/d9/d6f/d2d/d66/fa9 [0,4194304] 0 2023-12-09T02:34:54.968 INFO:tasks.workunit.client.0.smithi088.stdout:0/690: symlink df/d37/d70/db8/le9 0 2023-12-09T02:34:54.969 INFO:tasks.workunit.client.0.smithi088.stdout:3/638: symlink d1/d9/ld4 0 2023-12-09T02:34:54.970 INFO:tasks.workunit.client.0.smithi088.stdout:0/691: mkdir df/d10/d22/d2d/d96/dea 0 2023-12-09T02:34:54.972 INFO:tasks.workunit.client.0.smithi088.stdout:4/759: dread d3/dc/d1d/f3f [0,4194304] 0 2023-12-09T02:34:54.972 INFO:tasks.workunit.client.0.smithi088.stdout:4/760: stat d3/dc/d43/l8b 0 2023-12-09T02:34:54.984 INFO:tasks.workunit.client.0.smithi088.stdout:9/747: dread df/d20/d30/f35 [0,4194304] 0 2023-12-09T02:34:54.989 INFO:tasks.workunit.client.0.smithi088.stdout:5/731: write d3/f24 [3875753,89556] 0 2023-12-09T02:34:54.991 INFO:tasks.workunit.client.0.smithi088.stdout:5/732: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/dfd 0 2023-12-09T02:34:54.994 INFO:tasks.workunit.client.0.smithi088.stdout:1/791: dwrite d8/d1c/d50/d6c/fb2 [0,4194304] 0 2023-12-09T02:34:54.996 INFO:tasks.workunit.client.0.smithi088.stdout:1/792: link d8/l52 d8/d3d/d5d/d95/d98/l110 0 2023-12-09T02:34:54.996 INFO:tasks.workunit.client.0.smithi088.stdout:1/793: write d8/d1b/f33 [4386336,17699] 0 2023-12-09T02:34:55.001 INFO:tasks.workunit.client.0.smithi088.stdout:9/748: dread df/d20/f3e [0,4194304] 0 2023-12-09T02:34:55.001 INFO:tasks.workunit.client.0.smithi088.stdout:9/749: readlink df/d20/l8f 0 2023-12-09T02:34:55.002 INFO:tasks.workunit.client.0.smithi088.stdout:9/750: write df/d20/d30/d60/d5c/db9/fa5 [330633,85267] 0 2023-12-09T02:34:55.002 INFO:tasks.workunit.client.0.smithi088.stdout:9/751: stat df/d20/d30/f35 0 2023-12-09T02:34:55.007 INFO:tasks.workunit.client.0.smithi088.stdout:2/716: dwrite d6/d20/d3d/fac [4194304,4194304] 0 2023-12-09T02:34:55.007 INFO:tasks.workunit.client.0.smithi088.stdout:2/717: fdatasync d6/d20/d3a/d84/faf 0 2023-12-09T02:34:55.008 INFO:tasks.workunit.client.0.smithi088.stdout:3/639: dwrite d1/fa [4194304,4194304] 0 2023-12-09T02:34:55.010 INFO:tasks.workunit.client.0.smithi088.stdout:3/640: mknod d1/d9/dbf/cd5 0 2023-12-09T02:34:55.011 INFO:tasks.workunit.client.0.smithi088.stdout:0/692: dwrite df/d28/d34/dc8/fca [0,4194304] 0 2023-12-09T02:34:55.011 INFO:tasks.workunit.client.0.smithi088.stdout:0/693: write df/d10/d22/d5f/f87 [1865720,23460] 0 2023-12-09T02:34:55.011 INFO:tasks.workunit.client.0.smithi088.stdout:0/694: stat df/d28/ca2 0 2023-12-09T02:34:55.017 INFO:tasks.workunit.client.0.smithi088.stdout:3/641: write d1/d9/d6f/d22/f8a [2875777,5082] 0 2023-12-09T02:34:55.020 INFO:tasks.workunit.client.0.smithi088.stdout:0/695: mkdir df/d10/d22/d2d/d6a/deb 0 2023-12-09T02:34:55.020 INFO:tasks.workunit.client.0.smithi088.stdout:0/696: chown l5 39412877 1 2023-12-09T02:34:55.022 INFO:tasks.workunit.client.0.smithi088.stdout:0/697: link df/d37/c3a df/dd0/cec 0 2023-12-09T02:34:55.024 INFO:tasks.workunit.client.0.smithi088.stdout:0/698: mkdir df/d10/d22/ded 0 2023-12-09T02:34:55.024 INFO:tasks.workunit.client.0.smithi088.stdout:9/752: dwrite df/d20/d30/d4e/fbf [0,4194304] 0 2023-12-09T02:34:55.029 INFO:tasks.workunit.client.0.smithi088.stdout:4/761: dwrite d3/dc/d1d/d40/f54 [0,4194304] 0 2023-12-09T02:34:55.030 INFO:tasks.workunit.client.0.smithi088.stdout:2/718: dwrite d6/d13/f15 [0,4194304] 0 2023-12-09T02:34:55.031 INFO:tasks.workunit.client.0.smithi088.stdout:3/642: dread d1/d9/d6f/d6/d4a/d41/d33/d49/f52 [0,4194304] 0 2023-12-09T02:34:55.031 INFO:tasks.workunit.client.0.smithi088.stdout:3/643: dread - d1/d9/d6f/d6/d83/fcc zero size 2023-12-09T02:34:55.032 INFO:tasks.workunit.client.0.smithi088.stdout:9/753: symlink df/d20/d30/d60/dca/dee/lfd 0 2023-12-09T02:34:55.032 INFO:tasks.workunit.client.0.smithi088.stdout:9/754: fsync df/d20/d30/d60/d5c/db9/feb 0 2023-12-09T02:34:55.033 INFO:tasks.workunit.client.0.smithi088.stdout:1/794: dwrite d8/d1b/d6d/f97 [0,4194304] 0 2023-12-09T02:34:55.034 INFO:tasks.workunit.client.0.smithi088.stdout:4/762: creat d3/dc/d18/da9/ff6 x:0 0 0 2023-12-09T02:34:55.036 INFO:tasks.workunit.client.0.smithi088.stdout:2/719: mkdir d6/d20/d3a/d82/d99/df2 0 2023-12-09T02:34:55.040 INFO:tasks.workunit.client.0.smithi088.stdout:3/644: mknod d1/d9/d6f/d6/d8b/cd6 0 2023-12-09T02:34:55.041 INFO:tasks.workunit.client.0.smithi088.stdout:0/699: dwrite df/d28/d43/f4f [0,4194304] 0 2023-12-09T02:34:55.043 INFO:tasks.workunit.client.0.smithi088.stdout:4/763: mknod d3/dc/d88/cf7 0 2023-12-09T02:34:55.045 INFO:tasks.workunit.client.0.smithi088.stdout:2/720: rename d6/d20/d69/db2/db4/cd4 to d6/d8/d1f/d22/d68/dd3/cf3 0 2023-12-09T02:34:55.047 INFO:tasks.workunit.client.0.smithi088.stdout:3/645: unlink d1/d9/d6f/d2d/db9/l6a 0 2023-12-09T02:34:55.047 INFO:tasks.workunit.client.0.smithi088.stdout:3/646: getdents d1/d9/d6f/d2d/dab 0 2023-12-09T02:34:55.048 INFO:tasks.workunit.client.0.smithi088.stdout:3/647: dread d1/d9/d6f/d2d/dab/dc5/dc9/dce/fc1 [0,4194304] 0 2023-12-09T02:34:55.049 INFO:tasks.workunit.client.0.smithi088.stdout:7/699: sync 2023-12-09T02:34:55.049 INFO:tasks.workunit.client.0.smithi088.stdout:9/755: dwrite df/d20/d30/d3f/d48/f6e [0,4194304] 0 2023-12-09T02:34:55.049 INFO:tasks.workunit.client.0.smithi088.stdout:8/759: sync 2023-12-09T02:34:55.053 INFO:tasks.workunit.client.0.smithi088.stdout:4/764: mknod d3/dc/d43/d8c/d95/daa/db7/cf8 0 2023-12-09T02:34:55.054 INFO:tasks.workunit.client.0.smithi088.stdout:2/721: rmdir d6/d13/d42 39 2023-12-09T02:34:55.054 INFO:tasks.workunit.client.0.smithi088.stdout:3/648: write d1/fa [1444340,26236] 0 2023-12-09T02:34:55.054 INFO:tasks.workunit.client.0.smithi088.stdout:3/649: rename d1/d9/d6f to d1/d9/d6f/d6/d8b/dd7 22 2023-12-09T02:34:55.058 INFO:tasks.workunit.client.0.smithi088.stdout:9/756: mknod df/d20/d30/d60/dc9/dda/de2/df6/cfe 0 2023-12-09T02:34:55.058 INFO:tasks.workunit.client.0.smithi088.stdout:3/650: read d1/d9/f1b [2206028,124324] 0 2023-12-09T02:34:55.058 INFO:tasks.workunit.client.0.smithi088.stdout:3/651: write d1/d9/d6f/d6/d8b/fa4 [253088,58305] 0 2023-12-09T02:34:55.058 INFO:tasks.workunit.client.0.smithi088.stdout:8/760: creat d2/d9/d13/d15/d6e/fff x:0 0 0 2023-12-09T02:34:55.058 INFO:tasks.workunit.client.0.smithi088.stdout:4/765: creat d3/dc/d43/ff9 x:0 0 0 2023-12-09T02:34:55.059 INFO:tasks.workunit.client.0.smithi088.stdout:2/722: symlink d6/d8/d1f/d22/d68/dd3/lf4 0 2023-12-09T02:34:55.059 INFO:tasks.workunit.client.0.smithi088.stdout:3/652: rmdir d1/d73 39 2023-12-09T02:34:55.059 INFO:tasks.workunit.client.0.smithi088.stdout:4/766: mknod d3/dc/d43/d8c/d9a/cfa 0 2023-12-09T02:34:55.059 INFO:tasks.workunit.client.0.smithi088.stdout:2/723: truncate d6/d8/f1a 2065415 0 2023-12-09T02:34:55.063 INFO:tasks.workunit.client.0.smithi088.stdout:2/724: unlink d6/d8/f30 0 2023-12-09T02:34:55.064 INFO:tasks.workunit.client.0.smithi088.stdout:3/653: write d1/d9/d6f/d6/f3f [3624679,64752] 0 2023-12-09T02:34:55.066 INFO:tasks.workunit.client.0.smithi088.stdout:0/700: dwrite df/d10/d22/d2d/d96/fe8 [0,4194304] 0 2023-12-09T02:34:55.070 INFO:tasks.workunit.client.0.smithi088.stdout:0/701: truncate df/d28/f3b 3859834 0 2023-12-09T02:34:55.073 INFO:tasks.workunit.client.0.smithi088.stdout:0/702: creat df/d28/d43/fee x:0 0 0 2023-12-09T02:34:55.074 INFO:tasks.workunit.client.0.smithi088.stdout:0/703: chown df/d28/d33/la8 361240 1 2023-12-09T02:34:55.075 INFO:tasks.workunit.client.0.smithi088.stdout:0/704: truncate df/d28/f95 916918 0 2023-12-09T02:34:55.076 INFO:tasks.workunit.client.0.smithi088.stdout:7/700: dwrite dc/fe5 [0,4194304] 0 2023-12-09T02:34:55.076 INFO:tasks.workunit.client.0.smithi088.stdout:7/701: write dc/d21/f61 [392692,43848] 0 2023-12-09T02:34:55.077 INFO:tasks.workunit.client.0.smithi088.stdout:0/705: truncate df/d10/d22/d2d/d3c/f47 7399183 0 2023-12-09T02:34:55.090 INFO:tasks.workunit.client.0.smithi088.stdout:6/701: sync 2023-12-09T02:34:55.090 INFO:tasks.workunit.client.0.smithi088.stdout:6/702: truncate d16/d35/d36/d97/d90/fb9 1615159 0 2023-12-09T02:34:55.093 INFO:tasks.workunit.client.0.smithi088.stdout:9/757: dwrite df/d50/d63/f73 [4194304,4194304] 0 2023-12-09T02:34:55.096 INFO:tasks.workunit.client.0.smithi088.stdout:9/758: link df/c2b df/d20/d30/d60/dc6/cff 0 2023-12-09T02:34:55.097 INFO:tasks.workunit.client.0.smithi088.stdout:9/759: mknod df/d29/c100 0 2023-12-09T02:34:55.097 INFO:tasks.workunit.client.0.smithi088.stdout:9/760: readlink df/d20/d4c/d97/l98 0 2023-12-09T02:34:55.098 INFO:tasks.workunit.client.0.smithi088.stdout:9/761: mkdir df/d50/da3/d101 0 2023-12-09T02:34:55.099 INFO:tasks.workunit.client.0.smithi088.stdout:9/762: symlink df/d20/d30/d4e/l102 0 2023-12-09T02:34:55.100 INFO:tasks.workunit.client.0.smithi088.stdout:9/763: read - df/d20/d30/d3f/d48/da7/ff0 zero size 2023-12-09T02:34:55.100 INFO:tasks.workunit.client.0.smithi088.stdout:9/764: readlink df/d20/d30/ldf 0 2023-12-09T02:34:55.100 INFO:tasks.workunit.client.0.smithi088.stdout:9/765: dread df/d20/d30/d3f/d48/fae [0,4194304] 0 2023-12-09T02:34:55.105 INFO:tasks.workunit.client.0.smithi088.stdout:9/766: write df/d20/d30/d60/d5c/f16 [650839,85950] 0 2023-12-09T02:34:55.116 INFO:tasks.workunit.client.0.smithi088.stdout:2/725: dwrite d6/d20/fc3 [0,4194304] 0 2023-12-09T02:34:55.118 INFO:tasks.workunit.client.0.smithi088.stdout:6/703: dwrite d16/d35/d36/d97/d90/fbf [0,4194304] 0 2023-12-09T02:34:55.118 INFO:tasks.workunit.client.0.smithi088.stdout:8/761: dwrite d2/d9/d13/d1c/f5a [0,4194304] 0 2023-12-09T02:34:55.118 INFO:tasks.workunit.client.0.smithi088.stdout:8/762: truncate d2/d9/d1a/d62/fc8 4277894 0 2023-12-09T02:34:55.118 INFO:tasks.workunit.client.0.smithi088.stdout:4/767: dwrite d3/dc/d18/d29/f6e [0,4194304] 0 2023-12-09T02:34:55.119 INFO:tasks.workunit.client.0.smithi088.stdout:3/654: dwrite d1/d9/d6f/d6/fc3 [0,4194304] 0 2023-12-09T02:34:55.119 INFO:tasks.workunit.client.0.smithi088.stdout:0/706: dwrite df/d10/d22/fb3 [0,4194304] 0 2023-12-09T02:34:55.119 INFO:tasks.workunit.client.0.smithi088.stdout:0/707: dread - df/d37/de2/fc9 zero size 2023-12-09T02:34:55.119 INFO:tasks.workunit.client.0.smithi088.stdout:7/702: dwrite dc/d21/f58 [0,4194304] 0 2023-12-09T02:34:55.121 INFO:tasks.workunit.client.0.smithi088.stdout:6/704: read d16/d35/d36/d97/d90/fbf [829902,120878] 0 2023-12-09T02:34:55.123 INFO:tasks.workunit.client.0.smithi088.stdout:0/708: write df/d37/d70/f98 [1194945,119632] 0 2023-12-09T02:34:55.123 INFO:tasks.workunit.client.0.smithi088.stdout:0/709: write df/d10/f31 [970097,60862] 0 2023-12-09T02:34:55.124 INFO:tasks.workunit.client.0.smithi088.stdout:0/710: write df/d28/f9f [573673,66873] 0 2023-12-09T02:34:55.124 INFO:tasks.workunit.client.0.smithi088.stdout:0/711: fsync df/d37/de2/fc9 0 2023-12-09T02:34:55.131 INFO:tasks.workunit.client.0.smithi088.stdout:3/655: fsync d1/d9/d6f/f51 0 2023-12-09T02:34:55.144 INFO:tasks.workunit.client.0.smithi088.stdout:6/705: dwrite d16/d1b/d25/fae [0,4194304] 0 2023-12-09T02:34:55.144 INFO:tasks.workunit.client.0.smithi088.stdout:0/712: dwrite df/d28/d43/f7c [4194304,4194304] 0 2023-12-09T02:34:55.144 INFO:tasks.workunit.client.0.smithi088.stdout:0/713: truncate df/d10/d22/d2d/d2e/f99 857943 0 2023-12-09T02:34:55.144 INFO:tasks.workunit.client.0.smithi088.stdout:8/763: rename d2/d2b/l50 to d2/d9/d1a/d62/l100 0 2023-12-09T02:34:55.145 INFO:tasks.workunit.client.0.smithi088.stdout:8/764: stat d2/d9/fa7 0 2023-12-09T02:34:55.146 INFO:tasks.workunit.client.0.smithi088.stdout:6/706: write d16/d1b/d2c/d3f/d41/f4b [8072157,127961] 0 2023-12-09T02:34:55.149 INFO:tasks.workunit.client.0.smithi088.stdout:7/703: symlink dc/d21/d6b/d6d/da4/d38/d1e/lf3 0 2023-12-09T02:34:55.149 INFO:tasks.workunit.client.0.smithi088.stdout:7/704: stat dc/d21/d6b/d6d/da4/d3e/d97/fe3 0 2023-12-09T02:34:55.151 INFO:tasks.workunit.client.0.smithi088.stdout:8/765: dread d2/d9/d1a/d62/fc8 [0,4194304] 0 2023-12-09T02:34:55.152 INFO:tasks.workunit.client.0.smithi088.stdout:0/714: stat df/d28/d33/c9b 0 2023-12-09T02:34:55.153 INFO:tasks.workunit.client.0.smithi088.stdout:4/768: rename d3/dc/d43/dc5/cf3 to d3/dc/d43/d8c/d99/cfb 0 2023-12-09T02:34:55.153 INFO:tasks.workunit.client.0.smithi088.stdout:4/769: readlink d3/l7e 0 2023-12-09T02:34:55.155 INFO:tasks.workunit.client.0.smithi088.stdout:6/707: mkdir d16/d1b/d2c/d3f/d41/d80/dd0 0 2023-12-09T02:34:55.156 INFO:tasks.workunit.client.0.smithi088.stdout:7/705: rmdir dc/d1b/d91 39 2023-12-09T02:34:55.157 INFO:tasks.workunit.client.0.smithi088.stdout:8/766: write d2/f11 [1621338,72510] 0 2023-12-09T02:34:55.158 INFO:tasks.workunit.client.0.smithi088.stdout:0/715: symlink df/d28/d33/daf/lef 0 2023-12-09T02:34:55.159 INFO:tasks.workunit.client.0.smithi088.stdout:3/656: rename d1/d9/d6f/d6/d8b/fc0 to d1/d73/d89/fd8 0 2023-12-09T02:34:55.160 INFO:tasks.workunit.client.0.smithi088.stdout:4/770: mknod d3/dc/d43/d8c/d95/daa/db7/cfc 0 2023-12-09T02:34:55.162 INFO:tasks.workunit.client.0.smithi088.stdout:7/706: link dc/d21/d6b/d6d/da4/d38/c12 dc/d21/d6b/dbb/cf4 0 2023-12-09T02:34:55.164 INFO:tasks.workunit.client.0.smithi088.stdout:5/733: sync 2023-12-09T02:34:55.164 INFO:tasks.workunit.client.0.smithi088.stdout:1/795: sync 2023-12-09T02:34:55.165 INFO:tasks.workunit.client.0.smithi088.stdout:8/767: rmdir d2/d9/d13/d15/d6e/d9f 39 2023-12-09T02:34:55.166 INFO:tasks.workunit.client.0.smithi088.stdout:0/716: mkdir df/d10/d22/ded/df0 0 2023-12-09T02:34:55.167 INFO:tasks.workunit.client.0.smithi088.stdout:3/657: symlink d1/d9/d6f/d6/ld9 0 2023-12-09T02:34:55.168 INFO:tasks.workunit.client.0.smithi088.stdout:8/768: dread d2/d9/d1a/d62/d76/d85/fdc [0,4194304] 0 2023-12-09T02:34:55.170 INFO:tasks.workunit.client.0.smithi088.stdout:5/734: getdents d3 0 2023-12-09T02:34:55.173 INFO:tasks.workunit.client.0.smithi088.stdout:1/796: dread d8/d1b/d6d/d7c/fbe [0,4194304] 0 2023-12-09T02:34:55.175 INFO:tasks.workunit.client.0.smithi088.stdout:0/717: truncate df/d10/d22/f54 1658697 0 2023-12-09T02:34:55.176 INFO:tasks.workunit.client.0.smithi088.stdout:5/735: creat d3/d15/de/d10/d18/d19/d1b/ffe x:0 0 0 2023-12-09T02:34:55.176 INFO:tasks.workunit.client.0.smithi088.stdout:5/736: stat d3/d15/d2e/d49/f4f 0 2023-12-09T02:34:55.180 INFO:tasks.workunit.client.0.smithi088.stdout:5/737: rmdir d3/d15/d2e/def 0 2023-12-09T02:34:55.189 INFO:tasks.workunit.client.0.smithi088.stdout:5/738: write d3/d15/de/d10/d18/da5/fb1 [2676481,89112] 0 2023-12-09T02:34:55.190 INFO:tasks.workunit.client.0.smithi088.stdout:6/708: dwrite d16/d1b/f1d [0,4194304] 0 2023-12-09T02:34:55.190 INFO:tasks.workunit.client.0.smithi088.stdout:6/709: fsync d16/d1b/d25/f3b 0 2023-12-09T02:34:55.192 INFO:tasks.workunit.client.0.smithi088.stdout:6/710: rmdir d16/d35/d36/d97 39 2023-12-09T02:34:55.194 INFO:tasks.workunit.client.0.smithi088.stdout:6/711: unlink d16/d35/c64 0 2023-12-09T02:34:55.194 INFO:tasks.workunit.client.0.smithi088.stdout:6/712: rmdir d16/d35/d36/d97 39 2023-12-09T02:34:55.194 INFO:tasks.workunit.client.0.smithi088.stdout:6/713: chown d16/d62/d6f/c9a 104333393 1 2023-12-09T02:34:55.195 INFO:tasks.workunit.client.0.smithi088.stdout:6/714: truncate d16/d62/d6f/da4/dc2/dc7/fbb 840577 0 2023-12-09T02:34:55.195 INFO:tasks.workunit.client.0.smithi088.stdout:6/715: stat d16/d62/d6f/da4/dc2/dc7/d8c/c98 0 2023-12-09T02:34:55.195 INFO:tasks.workunit.client.0.smithi088.stdout:6/716: dread d16/d62/d6f/da4/dc2/dc7/fbb [0,4194304] 0 2023-12-09T02:34:55.195 INFO:tasks.workunit.client.0.smithi088.stdout:6/717: chown d16/d1b/d2c/f48 604006390 1 2023-12-09T02:34:55.196 INFO:tasks.workunit.client.0.smithi088.stdout:6/718: mknod d16/d62/d87/cd1 0 2023-12-09T02:34:55.197 INFO:tasks.workunit.client.0.smithi088.stdout:6/719: symlink d16/d1b/d25/d5f/d63/ld2 0 2023-12-09T02:34:55.198 INFO:tasks.workunit.client.0.smithi088.stdout:3/658: dwrite d1/d9/d6f/d2d/dab/dc5/dc9/dce/f9c [0,4194304] 0 2023-12-09T02:34:55.199 INFO:tasks.workunit.client.0.smithi088.stdout:3/659: chown d1/d9/d6f/d6/d83/cbb 107316 1 2023-12-09T02:34:55.202 INFO:tasks.workunit.client.0.smithi088.stdout:6/720: dread d16/d1b/d2c/f48 [0,4194304] 0 2023-12-09T02:34:55.203 INFO:tasks.workunit.client.0.smithi088.stdout:6/721: creat d16/d35/fd3 x:0 0 0 2023-12-09T02:34:55.203 INFO:tasks.workunit.client.0.smithi088.stdout:6/722: write d16/d62/d6f/da4/dc2/dc7/d8c/fcc [657569,31760] 0 2023-12-09T02:34:55.204 INFO:tasks.workunit.client.0.smithi088.stdout:6/723: getdents d16/d62/da7/da9 0 2023-12-09T02:34:55.204 INFO:tasks.workunit.client.0.smithi088.stdout:6/724: chown d16/d62/d6f/ca1 3 1 2023-12-09T02:34:55.204 INFO:tasks.workunit.client.0.smithi088.stdout:6/725: dread - d16/d1b/d56/fa2 zero size 2023-12-09T02:34:55.204 INFO:tasks.workunit.client.0.smithi088.stdout:0/718: dwrite df/d10/d22/d5b/fcc [0,4194304] 0 2023-12-09T02:34:55.205 INFO:tasks.workunit.client.0.smithi088.stdout:6/726: symlink d16/d35/d36/ld4 0 2023-12-09T02:34:55.205 INFO:tasks.workunit.client.0.smithi088.stdout:6/727: truncate f14 4465893 0 2023-12-09T02:34:55.205 INFO:tasks.workunit.client.0.smithi088.stdout:6/728: dread - d16/d1b/fb1 zero size 2023-12-09T02:34:55.205 INFO:tasks.workunit.client.0.smithi088.stdout:6/729: stat d16/d1b/d25/f3b 0 2023-12-09T02:34:55.205 INFO:tasks.workunit.client.0.smithi088.stdout:6/730: chown d16/d1b/f51 32 1 2023-12-09T02:34:55.205 INFO:tasks.workunit.client.0.smithi088.stdout:0/719: write df/d10/f24 [4111497,89326] 0 2023-12-09T02:34:55.206 INFO:tasks.workunit.client.0.smithi088.stdout:7/707: dwrite dc/fe0 [0,4194304] 0 2023-12-09T02:34:55.206 INFO:tasks.workunit.client.0.smithi088.stdout:1/797: dwrite d8/d3d/f4f [0,4194304] 0 2023-12-09T02:34:55.208 INFO:tasks.workunit.client.0.smithi088.stdout:0/720: mknod df/d10/d22/ded/cf1 0 2023-12-09T02:34:55.209 INFO:tasks.workunit.client.0.smithi088.stdout:6/731: write d16/d1b/d25/f27 [1848142,54345] 0 2023-12-09T02:34:55.216 INFO:tasks.workunit.client.0.smithi088.stdout:1/798: mknod d8/d27/d40/da5/c111 0 2023-12-09T02:34:55.218 INFO:tasks.workunit.client.0.smithi088.stdout:3/660: dread d1/d9/d6f/d2d/f6b [0,4194304] 0 2023-12-09T02:34:55.218 INFO:tasks.workunit.client.0.smithi088.stdout:8/769: dwrite d2/d9/fc1 [0,4194304] 0 2023-12-09T02:34:55.218 INFO:tasks.workunit.client.0.smithi088.stdout:3/661: dread - d1/d9/d6f/d22/d7f/fd3 zero size 2023-12-09T02:34:55.218 INFO:tasks.workunit.client.0.smithi088.stdout:3/662: fdatasync d1/fa 0 2023-12-09T02:34:55.218 INFO:tasks.workunit.client.0.smithi088.stdout:3/663: chown d1/d9/d6f/d6/d4a/f5b 35 1 2023-12-09T02:34:55.218 INFO:tasks.workunit.client.0.smithi088.stdout:0/721: unlink df/d10/d22/d5b/fcc 0 2023-12-09T02:34:55.218 INFO:tasks.workunit.client.0.smithi088.stdout:0/722: write df/d28/f9f [1383818,90194] 0 2023-12-09T02:34:55.220 INFO:tasks.workunit.client.0.smithi088.stdout:6/732: rmdir d16/d35/d36 39 2023-12-09T02:34:55.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:54 smithi088 ceph-mon[112028]: pgmap v195: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 77 MiB/s rd, 166 MiB/s wr, 598 op/s 2023-12-09T02:34:55.230 INFO:tasks.workunit.client.0.smithi088.stdout:8/770: unlink d2/d9/d70/d8f/cd1 0 2023-12-09T02:34:55.230 INFO:tasks.workunit.client.0.smithi088.stdout:5/739: dwrite d3/d15/de/d10/d51/db4/dd7/fe3 [0,4194304] 0 2023-12-09T02:34:55.231 INFO:tasks.workunit.client.0.smithi088.stdout:3/664: rmdir d1/d9/d6f/d6/d8b 39 2023-12-09T02:34:55.232 INFO:tasks.workunit.client.0.smithi088.stdout:0/723: symlink df/d10/d22/d2d/d3c/lf2 0 2023-12-09T02:34:55.233 INFO:tasks.workunit.client.0.smithi088.stdout:0/724: dread df/d10/d22/d2d/f8a [0,4194304] 0 2023-12-09T02:34:55.238 INFO:tasks.workunit.client.0.smithi088.stdout:8/771: mknod d2/d9/d13/d1c/c101 0 2023-12-09T02:34:55.238 INFO:tasks.workunit.client.0.smithi088.stdout:8/772: fdatasync d2/d9/d70/d8f/da8/dbe/fd5 0 2023-12-09T02:34:55.238 INFO:tasks.workunit.client.0.smithi088.stdout:8/773: chown d2/f8 73 1 2023-12-09T02:34:55.240 INFO:tasks.workunit.client.0.smithi088.stdout:3/665: symlink d1/d9/d6f/d2d/db9/lda 0 2023-12-09T02:34:55.241 INFO:tasks.workunit.client.0.smithi088.stdout:8/774: creat d2/d9/d70/d8f/d98/d9b/f102 x:0 0 0 2023-12-09T02:34:55.241 INFO:tasks.workunit.client.0.smithi088.stdout:8/775: dread - d2/d9/d70/d8f/f94 zero size 2023-12-09T02:34:55.242 INFO:tasks.workunit.client.0.smithi088.stdout:7/708: dwrite dc/d21/d6b/f80 [0,4194304] 0 2023-12-09T02:34:55.242 INFO:tasks.workunit.client.0.smithi088.stdout:7/709: read dc/f43 [3625320,13528] 0 2023-12-09T02:34:55.242 INFO:tasks.workunit.client.0.smithi088.stdout:7/710: fsync dc/d21/d6b/d6d/da4/f48 0 2023-12-09T02:34:55.244 INFO:tasks.workunit.client.0.smithi088.stdout:1/799: dwrite d8/d27/d40/da5/fd4 [0,4194304] 0 2023-12-09T02:34:55.244 INFO:tasks.workunit.client.0.smithi088.stdout:1/800: chown d8/d1b/d1d/f67 10403040 1 2023-12-09T02:34:55.245 INFO:tasks.workunit.client.0.smithi088.stdout:3/666: mknod d1/d9/d6f/d70/cdb 0 2023-12-09T02:34:55.247 INFO:tasks.workunit.client.0.smithi088.stdout:8/776: link d2/d9/d1a/f1f d2/db9/f103 0 2023-12-09T02:34:55.247 INFO:tasks.workunit.client.0.smithi088.stdout:8/777: fsync d2/d9/d70/d8f/da8/dbe/fd5 0 2023-12-09T02:34:55.250 INFO:tasks.workunit.client.0.smithi088.stdout:1/801: link d8/d53/f89 d8/d27/f112 0 2023-12-09T02:34:55.252 INFO:tasks.workunit.client.0.smithi088.stdout:9/767: sync 2023-12-09T02:34:55.252 INFO:tasks.workunit.client.0.smithi088.stdout:2/726: sync 2023-12-09T02:34:55.252 INFO:tasks.workunit.client.0.smithi088.stdout:6/733: dwrite d16/f21 [0,4194304] 0 2023-12-09T02:34:55.253 INFO:tasks.workunit.client.0.smithi088.stdout:5/740: dwrite d3/d15/de/d10/d51/d7f/f86 [0,4194304] 0 2023-12-09T02:34:55.255 INFO:tasks.workunit.client.0.smithi088.stdout:3/667: mkdir d1/d9/d6f/d22/d7f/d81/d85/ddc 0 2023-12-09T02:34:55.257 INFO:tasks.workunit.client.0.smithi088.stdout:1/802: symlink d8/d27/d66/l113 0 2023-12-09T02:34:55.258 INFO:tasks.workunit.client.0.smithi088.stdout:9/768: symlink df/d20/d30/l103 0 2023-12-09T02:34:55.258 INFO:tasks.workunit.client.0.smithi088.stdout:9/769: write df/d20/d4c/d97/fc0 [278802,77847] 0 2023-12-09T02:34:55.261 INFO:tasks.workunit.client.0.smithi088.stdout:2/727: getdents d6/d8/d73/d78 0 2023-12-09T02:34:55.264 INFO:tasks.workunit.client.0.smithi088.stdout:9/770: write df/d20/d30/f35 [2671187,18429] 0 2023-12-09T02:34:55.264 INFO:tasks.workunit.client.0.smithi088.stdout:6/734: creat d16/d1b/d25/d5f/d63/fd5 x:0 0 0 2023-12-09T02:34:55.265 INFO:tasks.workunit.client.0.smithi088.stdout:6/735: stat fb 0 2023-12-09T02:34:55.266 INFO:tasks.workunit.client.0.smithi088.stdout:3/668: creat d1/d9/dbf/fdd x:0 0 0 2023-12-09T02:34:55.268 INFO:tasks.workunit.client.0.smithi088.stdout:1/803: link d8/d3d/d44/f6b d8/d1b/d1d/f114 0 2023-12-09T02:34:55.268 INFO:tasks.workunit.client.0.smithi088.stdout:1/804: chown d8/d3d/d5d/d95/lae 1 1 2023-12-09T02:34:55.268 INFO:tasks.workunit.client.0.smithi088.stdout:9/771: dread df/f1a [0,4194304] 0 2023-12-09T02:34:55.269 INFO:tasks.workunit.client.0.smithi088.stdout:2/728: creat d6/d8/d4e/ff5 x:0 0 0 2023-12-09T02:34:55.270 INFO:tasks.workunit.client.0.smithi088.stdout:8/778: dwrite d2/d9/d70/d8f/d98/fe4 [0,4194304] 0 2023-12-09T02:34:55.270 INFO:tasks.workunit.client.0.smithi088.stdout:8/779: dread - d2/d9/d1a/d62/d76/d85/fbd zero size 2023-12-09T02:34:55.270 INFO:tasks.workunit.client.0.smithi088.stdout:8/780: chown d2/d9/d70/d8f/da8 352 1 2023-12-09T02:34:55.270 INFO:tasks.workunit.client.0.smithi088.stdout:6/736: stat d16/d1b/d2c/d3f/d9c/lbd 0 2023-12-09T02:34:55.271 INFO:tasks.workunit.client.0.smithi088.stdout:1/805: creat d8/d3d/d5d/d95/dac/db9/f115 x:0 0 0 2023-12-09T02:34:55.271 INFO:tasks.workunit.client.0.smithi088.stdout:9/772: rmdir df/d50/d63/db8 39 2023-12-09T02:34:55.272 INFO:tasks.workunit.client.0.smithi088.stdout:3/669: write d1/d9/d6f/d6/d4a/f53 [37733,49282] 0 2023-12-09T02:34:55.272 INFO:tasks.workunit.client.0.smithi088.stdout:3/670: chown d1/d9/d6f 22378599 1 2023-12-09T02:34:55.272 INFO:tasks.workunit.client.0.smithi088.stdout:5/741: dwrite d3/d15/de/d10/d51/d7f/fec [0,4194304] 0 2023-12-09T02:34:55.272 INFO:tasks.workunit.client.0.smithi088.stdout:9/773: write df/f13 [2649102,37814] 0 2023-12-09T02:34:55.272 INFO:tasks.workunit.client.0.smithi088.stdout:2/729: symlink d6/d8/d4e/d3c/lf6 0 2023-12-09T02:34:55.273 INFO:tasks.workunit.client.0.smithi088.stdout:8/781: mknod d2/d9/d13/d15/c104 0 2023-12-09T02:34:55.274 INFO:tasks.workunit.client.0.smithi088.stdout:6/737: creat d16/d62/da7/fd6 x:0 0 0 2023-12-09T02:34:55.274 INFO:tasks.workunit.client.0.smithi088.stdout:1/806: truncate d8/d1c/f29 5702657 0 2023-12-09T02:34:55.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/807: write d8/d1b/f20 [3525641,91997] 0 2023-12-09T02:34:55.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/808: fdatasync d8/f15 0 2023-12-09T02:34:55.279 INFO:tasks.workunit.client.0.smithi088.stdout:5/742: creat d3/d15/de/d10/d18/d19/d1b/d35/d61/ded/fff x:0 0 0 2023-12-09T02:34:55.279 INFO:tasks.workunit.client.0.smithi088.stdout:3/671: dread d1/d9/d6f/d6/ff [0,4194304] 0 2023-12-09T02:34:55.279 INFO:tasks.workunit.client.0.smithi088.stdout:5/743: chown d3/d15/de/d10/d51/dc9/dc4 106 1 2023-12-09T02:34:55.279 INFO:tasks.workunit.client.0.smithi088.stdout:3/672: stat d1/d9/d6f/d70/cb6 0 2023-12-09T02:34:55.280 INFO:tasks.workunit.client.0.smithi088.stdout:1/809: write d8/d1b/d6d/d7c/f90 [3742770,5489] 0 2023-12-09T02:34:55.280 INFO:tasks.workunit.client.0.smithi088.stdout:1/810: read - d8/d59/feb zero size 2023-12-09T02:34:55.280 INFO:tasks.workunit.client.0.smithi088.stdout:1/811: truncate d8/d3d/f4f 4993453 0 2023-12-09T02:34:55.280 INFO:tasks.workunit.client.0.smithi088.stdout:9/774: creat df/d20/d4c/d84/f104 x:0 0 0 2023-12-09T02:34:55.281 INFO:tasks.workunit.client.0.smithi088.stdout:2/730: mkdir d6/de3/df7 0 2023-12-09T02:34:55.282 INFO:tasks.workunit.client.0.smithi088.stdout:8/782: rmdir d2/d9/d13/d1c/d3b 39 2023-12-09T02:34:55.283 INFO:tasks.workunit.client.0.smithi088.stdout:6/738: symlink d16/d35/d36/dc6/ld7 0 2023-12-09T02:34:55.283 INFO:tasks.workunit.client.0.smithi088.stdout:6/739: chown d16/d35/d36/dad 6 1 2023-12-09T02:34:55.286 INFO:tasks.workunit.client.0.smithi088.stdout:3/673: creat d1/d9/d6f/fde x:0 0 0 2023-12-09T02:34:55.287 INFO:tasks.workunit.client.0.smithi088.stdout:1/812: mknod d8/d3d/d5d/d95/d98/c116 0 2023-12-09T02:34:55.288 INFO:tasks.workunit.client.0.smithi088.stdout:1/813: write d8/d1b/d1d/f67 [3874490,43685] 0 2023-12-09T02:34:55.289 INFO:tasks.workunit.client.0.smithi088.stdout:9/775: symlink df/d50/da3/l105 0 2023-12-09T02:34:55.289 INFO:tasks.workunit.client.0.smithi088.stdout:9/776: chown df/d20/d30/d4e/fbf 29 1 2023-12-09T02:34:55.289 INFO:tasks.workunit.client.0.smithi088.stdout:9/777: dread - df/d20/d4c/d84/f104 zero size 2023-12-09T02:34:55.291 INFO:tasks.workunit.client.0.smithi088.stdout:8/783: creat d2/d9/d13/d1c/d5f/d96/f105 x:0 0 0 2023-12-09T02:34:55.292 INFO:tasks.workunit.client.0.smithi088.stdout:9/778: dread df/d20/d4c/f56 [0,4194304] 0 2023-12-09T02:34:55.292 INFO:tasks.workunit.client.0.smithi088.stdout:8/784: read d2/d9/d13/f19 [4307088,105759] 0 2023-12-09T02:34:55.293 INFO:tasks.workunit.client.0.smithi088.stdout:6/740: truncate d16/d1b/d56/f6c 1945123 0 2023-12-09T02:34:55.293 INFO:tasks.workunit.client.0.smithi088.stdout:8/785: dread d2/d9/d1a/d62/f4f [0,4194304] 0 2023-12-09T02:34:55.294 INFO:tasks.workunit.client.0.smithi088.stdout:8/786: dread - d2/db9/fd9 zero size 2023-12-09T02:34:55.294 INFO:tasks.workunit.client.0.smithi088.stdout:9/779: write df/d20/d30/d60/d5c/f1f [1207497,67285] 0 2023-12-09T02:34:55.294 INFO:tasks.workunit.client.0.smithi088.stdout:3/674: mkdir d1/d3e/ddf 0 2023-12-09T02:34:55.294 INFO:tasks.workunit.client.0.smithi088.stdout:3/675: truncate d1/d9/d6f/d6/fa7 1003124 0 2023-12-09T02:34:55.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/814: mkdir d8/d3d/d44/da4/d117 0 2023-12-09T02:34:55.297 INFO:tasks.workunit.client.0.smithi088.stdout:8/787: symlink d2/d9/d70/d8f/da8/dbe/l106 0 2023-12-09T02:34:55.297 INFO:tasks.workunit.client.0.smithi088.stdout:5/744: dwrite d3/d15/de/d10/d51/d70/fa1 [0,4194304] 0 2023-12-09T02:34:55.298 INFO:tasks.workunit.client.0.smithi088.stdout:8/788: dread d2/d9/d13/d15/d6e/d9f/f86 [0,4194304] 0 2023-12-09T02:34:55.298 INFO:tasks.workunit.client.0.smithi088.stdout:3/676: rename d1/d9/d6f/d6/d8b/l9a to d1/d9/le0 0 2023-12-09T02:34:55.300 INFO:tasks.workunit.client.0.smithi088.stdout:2/731: dwrite d6/d20/d3a/d84/fcf [0,4194304] 0 2023-12-09T02:34:55.305 INFO:tasks.workunit.client.0.smithi088.stdout:8/789: link d2/d9/d1a/l3f d2/d9/d70/d8f/l107 0 2023-12-09T02:34:55.305 INFO:tasks.workunit.client.0.smithi088.stdout:8/790: dread - d2/db9/ff9 zero size 2023-12-09T02:34:55.307 INFO:tasks.workunit.client.0.smithi088.stdout:1/815: rename d8/d27/d40/fa9 to d8/d27/d9a/f118 0 2023-12-09T02:34:55.308 INFO:tasks.workunit.client.0.smithi088.stdout:3/677: creat d1/d9/d6f/d6/fe1 x:0 0 0 2023-12-09T02:34:55.308 INFO:tasks.workunit.client.0.smithi088.stdout:1/816: dread d8/d3d/d5d/d95/f39 [0,4194304] 0 2023-12-09T02:34:55.308 INFO:tasks.workunit.client.0.smithi088.stdout:3/678: read d1/d9/d6f/d6/d83/f8c [218720,30153] 0 2023-12-09T02:34:55.309 INFO:tasks.workunit.client.0.smithi088.stdout:2/732: creat d6/d20/d69/ff8 x:0 0 0 2023-12-09T02:34:55.311 INFO:tasks.workunit.client.0.smithi088.stdout:8/791: creat d2/d9/d13/d1c/d5f/dc4/f108 x:0 0 0 2023-12-09T02:34:55.311 INFO:tasks.workunit.client.0.smithi088.stdout:5/745: dread d3/d15/de/d10/d18/d19/d20/f43 [0,4194304] 0 2023-12-09T02:34:55.311 INFO:tasks.workunit.client.0.smithi088.stdout:3/679: creat d1/d3e/ddf/fe2 x:0 0 0 2023-12-09T02:34:55.311 INFO:tasks.workunit.client.0.smithi088.stdout:3/680: truncate d1/d9/dbf/fdd 39109 0 2023-12-09T02:34:55.312 INFO:tasks.workunit.client.0.smithi088.stdout:2/733: rename d6/d8/d1f/d22/c2e to d6/d13/d18/cf9 0 2023-12-09T02:34:55.312 INFO:tasks.workunit.client.0.smithi088.stdout:2/734: stat d6/d20/d9a/fcb 0 2023-12-09T02:34:55.313 INFO:tasks.workunit.client.0.smithi088.stdout:8/792: creat d2/d9/d70/f109 x:0 0 0 2023-12-09T02:34:55.313 INFO:tasks.workunit.client.0.smithi088.stdout:8/793: fsync d2/d9/d1a/d62/f55 0 2023-12-09T02:34:55.314 INFO:tasks.workunit.client.0.smithi088.stdout:3/681: symlink d1/d9/d6f/d2d/dab/le3 0 2023-12-09T02:34:55.314 INFO:tasks.workunit.client.0.smithi088.stdout:3/682: write d1/d9/f37 [414535,32184] 0 2023-12-09T02:34:55.315 INFO:tasks.workunit.client.0.smithi088.stdout:3/683: fsync d1/d9/d6f/d6/d4a/faf 0 2023-12-09T02:34:55.315 INFO:tasks.workunit.client.0.smithi088.stdout:8/794: mknod d2/d9/d1a/d62/d9a/c10a 0 2023-12-09T02:34:55.315 INFO:tasks.workunit.client.0.smithi088.stdout:8/795: write d2/d9/d1a/d62/fc8 [4101736,11079] 0 2023-12-09T02:34:55.316 INFO:tasks.workunit.client.0.smithi088.stdout:3/684: rename d1/d73/d89/fd8 to d1/d9/dbf/fe4 0 2023-12-09T02:34:55.316 INFO:tasks.workunit.client.0.smithi088.stdout:3/685: fdatasync d1/d9/d6f/d6/d4a/d41/d33/d49/f54 0 2023-12-09T02:34:55.316 INFO:tasks.workunit.client.0.smithi088.stdout:2/735: read d6/d8/d54/fa6 [433807,76332] 0 2023-12-09T02:34:55.318 INFO:tasks.workunit.client.0.smithi088.stdout:8/796: rename d2/d9/d70/d8f/da8/dbe/ced to d2/d9/d13/d15/d6e/d9f/c10b 0 2023-12-09T02:34:55.318 INFO:tasks.workunit.client.0.smithi088.stdout:3/686: write d1/d9/d6f/d2d/d66/fb2 [1192495,70893] 0 2023-12-09T02:34:55.318 INFO:tasks.workunit.client.0.smithi088.stdout:6/741: dwrite d16/d35/f84 [0,4194304] 0 2023-12-09T02:34:55.319 INFO:tasks.workunit.client.0.smithi088.stdout:2/736: unlink d6/d8/d4e/c4b 0 2023-12-09T02:34:55.319 INFO:tasks.workunit.client.0.smithi088.stdout:2/737: stat d6/d20/d3d/f61 0 2023-12-09T02:34:55.320 INFO:tasks.workunit.client.0.smithi088.stdout:9/780: dwrite df/d20/d5b/ff3 [0,4194304] 0 2023-12-09T02:34:55.320 INFO:tasks.workunit.client.0.smithi088.stdout:8/797: write d2/d9/f8b [117023,26448] 0 2023-12-09T02:34:55.321 INFO:tasks.workunit.client.0.smithi088.stdout:6/742: write d16/d1b/f1d [2047008,25921] 0 2023-12-09T02:34:55.322 INFO:tasks.workunit.client.0.smithi088.stdout:8/798: write d2/d9/d13/d1c/d5f/d84/fdb [3719605,109294] 0 2023-12-09T02:34:55.322 INFO:tasks.workunit.client.0.smithi088.stdout:8/799: chown d2/d9/d13/d1c/f64 7 1 2023-12-09T02:34:55.322 INFO:tasks.workunit.client.0.smithi088.stdout:6/743: write fb [364686,101790] 0 2023-12-09T02:34:55.322 INFO:tasks.workunit.client.0.smithi088.stdout:5/746: dread d3/d15/de/d10/d18/d19/d1b/f32 [0,4194304] 0 2023-12-09T02:34:55.322 INFO:tasks.workunit.client.0.smithi088.stdout:5/747: truncate d3/d15/de/d10/d51/d70/fbb 1630014 0 2023-12-09T02:34:55.325 INFO:tasks.workunit.client.0.smithi088.stdout:3/687: unlink d1/d9/d6f/d2d/f46 0 2023-12-09T02:34:55.327 INFO:tasks.workunit.client.0.smithi088.stdout:2/738: mknod d6/d20/d3a/d84/de5/cfa 0 2023-12-09T02:34:55.330 INFO:tasks.workunit.client.0.smithi088.stdout:1/817: dwrite d8/d3d/d44/f6b [0,4194304] 0 2023-12-09T02:34:55.340 INFO:tasks.workunit.client.0.smithi088.stdout:9/781: unlink df/d20/d30/ldf 0 2023-12-09T02:34:55.342 INFO:tasks.workunit.client.0.smithi088.stdout:3/688: dread d1/d9/d6f/d22/f8a [0,4194304] 0 2023-12-09T02:34:55.342 INFO:tasks.workunit.client.0.smithi088.stdout:3/689: fsync d1/d9/d6f/d22/f8a 0 2023-12-09T02:34:55.344 INFO:tasks.workunit.client.0.smithi088.stdout:5/748: dwrite d3/d15/de/d2c/fa9 [0,4194304] 0 2023-12-09T02:34:55.349 INFO:tasks.workunit.client.0.smithi088.stdout:8/800: symlink d2/d9/d1a/d62/l10c 0 2023-12-09T02:34:55.349 INFO:tasks.workunit.client.0.smithi088.stdout:8/801: truncate d2/d9/d70/d8f/d98/d9b/f102 997406 0 2023-12-09T02:34:55.350 INFO:tasks.workunit.client.0.smithi088.stdout:6/744: creat d16/d62/d6f/da4/dc2/dc7/fd8 x:0 0 0 2023-12-09T02:34:55.350 INFO:tasks.workunit.client.0.smithi088.stdout:6/745: fdatasync d16/d35/d36/d97/d90/f7d 0 2023-12-09T02:34:55.353 INFO:tasks.workunit.client.0.smithi088.stdout:6/746: read d16/d35/d36/f6b [70008,81322] 0 2023-12-09T02:34:55.356 INFO:tasks.workunit.client.0.smithi088.stdout:1/818: rename d8/d1b/d6d/c9d to d8/d3d/d5d/d95/dac/db9/c119 0 2023-12-09T02:34:55.356 INFO:tasks.workunit.client.0.smithi088.stdout:5/749: dread d3/d15/de/d10/d18/d19/d1b/d35/d42/f5e [0,4194304] 0 2023-12-09T02:34:55.356 INFO:tasks.workunit.client.0.smithi088.stdout:1/819: write d8/d1c/f28 [3795576,8873] 0 2023-12-09T02:34:55.359 INFO:tasks.workunit.client.0.smithi088.stdout:8/802: dread d2/d9/d13/d15/fa0 [0,4194304] 0 2023-12-09T02:34:55.359 INFO:tasks.workunit.client.0.smithi088.stdout:8/803: stat d2/d9/f10 0 2023-12-09T02:34:55.359 INFO:tasks.workunit.client.0.smithi088.stdout:8/804: truncate d2/d9/d13/d15/fc7 1016116 0 2023-12-09T02:34:55.359 INFO:tasks.workunit.client.0.smithi088.stdout:8/805: fdatasync d2/d9/d70/d8f/d98/fe4 0 2023-12-09T02:34:55.363 INFO:tasks.workunit.client.0.smithi088.stdout:9/782: symlink df/d50/da3/d101/l106 0 2023-12-09T02:34:55.367 INFO:tasks.workunit.client.0.smithi088.stdout:1/820: rmdir d8/d27/d40 39 2023-12-09T02:34:55.367 INFO:tasks.workunit.client.0.smithi088.stdout:1/821: chown d8/d3d/d44/fc3 4528167 1 2023-12-09T02:34:55.367 INFO:tasks.workunit.client.0.smithi088.stdout:1/822: write d8/d1c/d50/f7f [1487582,122406] 0 2023-12-09T02:34:55.370 INFO:tasks.workunit.client.0.smithi088.stdout:9/783: mknod df/d29/d2f/c107 0 2023-12-09T02:34:55.373 INFO:tasks.workunit.client.0.smithi088.stdout:1/823: rmdir d8/d3d/d44/da4/d117 0 2023-12-09T02:34:55.373 INFO:tasks.workunit.client.0.smithi088.stdout:1/824: fsync d8/d3d/d5d/d95/dac/db9/f115 0 2023-12-09T02:34:55.374 INFO:tasks.workunit.client.0.smithi088.stdout:8/806: link d2/f3 d2/d9/d13/d1c/d3b/f10d 0 2023-12-09T02:34:55.375 INFO:tasks.workunit.client.0.smithi088.stdout:8/807: write d2/d9/d13/d1c/f32 [972402,33229] 0 2023-12-09T02:34:55.376 INFO:tasks.workunit.client.0.smithi088.stdout:9/784: mkdir df/d20/d4c/d84/d108 0 2023-12-09T02:34:55.376 INFO:tasks.workunit.client.0.smithi088.stdout:9/785: stat df/d29/d2f/la1 0 2023-12-09T02:34:55.377 INFO:tasks.workunit.client.0.smithi088.stdout:1/825: stat d8/d3d/d44/da4/dcb/cf9 0 2023-12-09T02:34:55.379 INFO:tasks.workunit.client.0.smithi088.stdout:3/690: dwrite d1/d9/d6f/d6/d8b/fa4 [0,4194304] 0 2023-12-09T02:34:55.379 INFO:tasks.workunit.client.0.smithi088.stdout:8/808: getdents d2/d9/d1a 0 2023-12-09T02:34:55.380 INFO:tasks.workunit.client.0.smithi088.stdout:2/739: dwrite d6/d8/d1f/d22/d68/fa5 [0,4194304] 0 2023-12-09T02:34:55.380 INFO:tasks.workunit.client.0.smithi088.stdout:9/786: symlink df/d50/da3/l109 0 2023-12-09T02:34:55.381 INFO:tasks.workunit.client.0.smithi088.stdout:1/826: creat d8/d27/d66/d79/ddc/f11a x:0 0 0 2023-12-09T02:34:55.381 INFO:tasks.workunit.client.0.smithi088.stdout:1/827: dread - d8/d3d/df0/f10b zero size 2023-12-09T02:34:55.383 INFO:tasks.workunit.client.0.smithi088.stdout:5/750: dwrite d3/d15/de/d10/d18/d19/d1b/d35/d42/f5e [0,4194304] 0 2023-12-09T02:34:55.383 INFO:tasks.workunit.client.0.smithi088.stdout:5/751: fsync d3/d15/de/d10/d18/d19/d20/f27 0 2023-12-09T02:34:55.383 INFO:tasks.workunit.client.0.smithi088.stdout:5/752: write d3/d15/de/d10/d18/d19/d20/fac [1044373,91265] 0 2023-12-09T02:34:55.383 INFO:tasks.workunit.client.0.smithi088.stdout:5/753: readlink d3/d15/dc/le7 0 2023-12-09T02:34:55.384 INFO:tasks.workunit.client.0.smithi088.stdout:1/828: write d8/f3e [524208,85983] 0 2023-12-09T02:34:55.385 INFO:tasks.workunit.client.0.smithi088.stdout:4/771: sync 2023-12-09T02:34:55.385 INFO:tasks.workunit.client.0.smithi088.stdout:9/787: write df/d20/d30/d3f/d48/f65 [2330493,88780] 0 2023-12-09T02:34:55.389 INFO:tasks.workunit.client.0.smithi088.stdout:8/809: rename d2/d9/d13/d1c/f32 to d2/d9/d1a/d62/d9a/f10e 0 2023-12-09T02:34:55.389 INFO:tasks.workunit.client.0.smithi088.stdout:8/810: truncate d2/d9/d70/d8f/f94 864903 0 2023-12-09T02:34:55.389 INFO:tasks.workunit.client.0.smithi088.stdout:8/811: write d2/d9/d1a/d62/f55 [1058124,124793] 0 2023-12-09T02:34:55.390 INFO:tasks.workunit.client.0.smithi088.stdout:2/740: rmdir d6/d8/d73/d78/dbf 39 2023-12-09T02:34:55.390 INFO:tasks.workunit.client.0.smithi088.stdout:2/741: stat d6/d8/d4e/dc9 0 2023-12-09T02:34:55.392 INFO:tasks.workunit.client.0.smithi088.stdout:6/747: dwrite d16/d1b/d2c/d60/f74 [0,4194304] 0 2023-12-09T02:34:55.392 INFO:tasks.workunit.client.0.smithi088.stdout:6/748: fdatasync d16/d1b/d2c/d3f/d41/f43 0 2023-12-09T02:34:55.392 INFO:tasks.workunit.client.0.smithi088.stdout:6/749: read - d16/fa6 zero size 2023-12-09T02:34:55.392 INFO:tasks.workunit.client.0.smithi088.stdout:5/754: link d3/d15/dc/fd3 d3/d8/f100 0 2023-12-09T02:34:55.392 INFO:tasks.workunit.client.0.smithi088.stdout:5/755: chown d3/d15/dc/fd3 64156 1 2023-12-09T02:34:55.392 INFO:tasks.workunit.client.0.smithi088.stdout:5/756: readlink d3/d15/de/d10/d18/d19/d1b/d35/d42/l31 0 2023-12-09T02:34:55.392 INFO:tasks.workunit.client.0.smithi088.stdout:5/757: fsync d3/d15/de/d2c/f44 0 2023-12-09T02:34:55.398 INFO:tasks.workunit.client.0.smithi088.stdout:1/829: creat d8/d27/f11b x:0 0 0 2023-12-09T02:34:55.398 INFO:tasks.workunit.client.0.smithi088.stdout:1/830: read - d8/d3d/d5d/d95/dac/db9/f115 zero size 2023-12-09T02:34:55.399 INFO:tasks.workunit.client.0.smithi088.stdout:4/772: mkdir d3/dc/d18/d29/da4/dfd 0 2023-12-09T02:34:55.400 INFO:tasks.workunit.client.0.smithi088.stdout:3/691: mknod d1/d9/d6f/ce5 0 2023-12-09T02:34:55.400 INFO:tasks.workunit.client.0.smithi088.stdout:3/692: write d1/d9/d6f/d6/d83/f8c [1589003,15668] 0 2023-12-09T02:34:55.403 INFO:tasks.workunit.client.0.smithi088.stdout:2/742: mkdir d6/d20/d9a/dfb 0 2023-12-09T02:34:55.403 INFO:tasks.workunit.client.0.smithi088.stdout:5/758: creat d3/d15/f101 x:0 0 0 2023-12-09T02:34:55.406 INFO:tasks.workunit.client.0.smithi088.stdout:1/831: mknod d8/d1b/d1d/dc7/d108/d10a/c11c 0 2023-12-09T02:34:55.410 INFO:tasks.workunit.client.0.smithi088.stdout:0/725: sync 2023-12-09T02:34:55.416 INFO:tasks.workunit.client.0.smithi088.stdout:4/773: link d3/dc/d43/d83/d37/fbe d3/dc/d18/d8d/ffe 0 2023-12-09T02:34:55.416 INFO:tasks.workunit.client.0.smithi088.stdout:4/774: stat d3/dc/d88/cf7 0 2023-12-09T02:34:55.417 INFO:tasks.workunit.client.0.smithi088.stdout:3/693: creat d1/d9/d6f/d6/fe6 x:0 0 0 2023-12-09T02:34:55.417 INFO:tasks.workunit.client.0.smithi088.stdout:5/759: mknod d3/d15/de/d10/d18/d19/c102 0 2023-12-09T02:34:55.418 INFO:tasks.workunit.client.0.smithi088.stdout:4/775: mkdir d3/d65/de4/dff 0 2023-12-09T02:34:55.419 INFO:tasks.workunit.client.0.smithi088.stdout:3/694: creat d1/d9/d6f/d2d/d66/fe7 x:0 0 0 2023-12-09T02:34:55.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:54 smithi161 ceph-mon[121170]: pgmap v195: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 77 MiB/s rd, 166 MiB/s wr, 598 op/s 2023-12-09T02:34:55.421 INFO:tasks.workunit.client.0.smithi088.stdout:5/760: link d3/d15/de/d10/d18/d19/d1b/d35/ld1 d3/d15/de/l103 0 2023-12-09T02:34:55.423 INFO:tasks.workunit.client.0.smithi088.stdout:4/776: symlink d3/dc/d43/d8c/d9a/l100 0 2023-12-09T02:34:55.424 INFO:tasks.workunit.client.0.smithi088.stdout:3/695: truncate d1/d9/d6f/d6/d8b/f95 622183 0 2023-12-09T02:34:55.425 INFO:tasks.workunit.client.0.smithi088.stdout:5/761: symlink d3/d15/de/d10/d51/d7f/l104 0 2023-12-09T02:34:55.425 INFO:tasks.workunit.client.0.smithi088.stdout:5/762: fdatasync d3/d8/f100 0 2023-12-09T02:34:55.426 INFO:tasks.workunit.client.0.smithi088.stdout:9/788: rename df/d50/da3 to df/d20/d5b/d91/d10a 0 2023-12-09T02:34:55.426 INFO:tasks.workunit.client.0.smithi088.stdout:9/789: stat df/d20/d30/d60/dca/dee 0 2023-12-09T02:34:55.427 INFO:tasks.workunit.client.0.smithi088.stdout:4/777: truncate d3/dc/d18/d29/f3d 161317 0 2023-12-09T02:34:55.427 INFO:tasks.workunit.client.0.smithi088.stdout:4/778: getdents d3/dc/d43/d8c/d99/dd1 0 2023-12-09T02:34:55.427 INFO:tasks.workunit.client.0.smithi088.stdout:4/779: fsync d3/dc/d43/d83/f49 0 2023-12-09T02:34:55.428 INFO:tasks.workunit.client.0.smithi088.stdout:9/790: creat df/d20/d5b/d91/f10b x:0 0 0 2023-12-09T02:34:55.429 INFO:tasks.workunit.client.0.smithi088.stdout:4/780: truncate d3/dc/d18/d29/f60 3976127 0 2023-12-09T02:34:55.431 INFO:tasks.workunit.client.0.smithi088.stdout:0/726: dwrite df/f2c [0,4194304] 0 2023-12-09T02:34:55.431 INFO:tasks.workunit.client.0.smithi088.stdout:2/743: dwrite d6/d13/f76 [0,4194304] 0 2023-12-09T02:34:55.431 INFO:tasks.workunit.client.0.smithi088.stdout:2/744: dread - d6/d8/d1f/faa zero size 2023-12-09T02:34:55.432 INFO:tasks.workunit.client.0.smithi088.stdout:8/812: rename d2/d9/d13/d15 to d2/d10f 0 2023-12-09T02:34:55.433 INFO:tasks.workunit.client.0.smithi088.stdout:9/791: unlink df/d20/dc7/cf1 0 2023-12-09T02:34:55.434 INFO:tasks.workunit.client.0.smithi088.stdout:4/781: link d3/dc/f9e d3/d65/de4/f101 0 2023-12-09T02:34:55.434 INFO:tasks.workunit.client.0.smithi088.stdout:4/782: chown d3/dc/d18/d7b/l64 95553 1 2023-12-09T02:34:55.435 INFO:tasks.workunit.client.0.smithi088.stdout:7/711: sync 2023-12-09T02:34:55.436 INFO:tasks.workunit.client.0.smithi088.stdout:9/792: dread df/d20/d5b/f95 [0,4194304] 0 2023-12-09T02:34:55.436 INFO:tasks.workunit.client.0.smithi088.stdout:0/727: mkdir df/d28/df3 0 2023-12-09T02:34:55.437 INFO:tasks.workunit.client.0.smithi088.stdout:2/745: dread d6/d8/d1f/d22/f40 [0,4194304] 0 2023-12-09T02:34:55.441 INFO:tasks.workunit.client.0.smithi088.stdout:3/696: rename d1/d9/d6f/d6/l3c to d1/d9/d6f/d22/d7f/d81/d85/dcb/le8 0 2023-12-09T02:34:55.441 INFO:tasks.workunit.client.0.smithi088.stdout:3/697: fdatasync d1/d9/d6f/d2d/dab/dc5/dc9/dce/f76 0 2023-12-09T02:34:55.445 INFO:tasks.workunit.client.0.smithi088.stdout:8/813: mkdir d2/d9/d13/d1c/d5f/d96/dec/d110 0 2023-12-09T02:34:55.449 INFO:tasks.workunit.client.0.smithi088.stdout:7/712: creat dc/d21/ff5 x:0 0 0 2023-12-09T02:34:55.449 INFO:tasks.workunit.client.0.smithi088.stdout:7/713: stat dc/d21/d6b/d6d/da4/d38/f51 0 2023-12-09T02:34:55.450 INFO:tasks.workunit.client.0.smithi088.stdout:9/793: rmdir df/d20/d30/d60/dc9/dda/de2 39 2023-12-09T02:34:55.452 INFO:tasks.workunit.client.0.smithi088.stdout:5/763: rename d3/d15/d2e/d49/d88/dd6/ce1 to d3/d15/de/d2c/dfa/c105 0 2023-12-09T02:34:55.452 INFO:tasks.workunit.client.0.smithi088.stdout:5/764: fdatasync d3/d15/de/d10/d18/d19/d1b/d35/f69 0 2023-12-09T02:34:55.453 INFO:tasks.workunit.client.0.smithi088.stdout:0/728: dread df/d10/f24 [0,4194304] 0 2023-12-09T02:34:55.453 INFO:tasks.workunit.client.0.smithi088.stdout:0/729: chown df/d10/d22/d2d/d96/dea 300 1 2023-12-09T02:34:55.453 INFO:tasks.workunit.client.0.smithi088.stdout:0/730: readlink df/l19 0 2023-12-09T02:34:55.454 INFO:tasks.workunit.client.0.smithi088.stdout:3/698: mknod d1/d9/d6f/d2d/d66/ce9 0 2023-12-09T02:34:55.454 INFO:tasks.workunit.client.0.smithi088.stdout:3/699: stat d1/d9/d6f/d2d/dab 0 2023-12-09T02:34:55.454 INFO:tasks.workunit.client.0.smithi088.stdout:8/814: readlink d2/d9/d1a/d62/d49/lbf 0 2023-12-09T02:34:55.454 INFO:tasks.workunit.client.0.smithi088.stdout:3/700: fdatasync d1/d9/d6f/d15/fa3 0 2023-12-09T02:34:55.455 INFO:tasks.workunit.client.0.smithi088.stdout:3/701: read d1/d9/d6f/d6/fa7 [566273,52663] 0 2023-12-09T02:34:55.455 INFO:tasks.workunit.client.0.smithi088.stdout:3/702: fdatasync d1/d9/d6f/d15/f3a 0 2023-12-09T02:34:55.455 INFO:tasks.workunit.client.0.smithi088.stdout:3/703: write d1/d9/d6f/d2d/dab/dc5/dc9/fcf [810606,51724] 0 2023-12-09T02:34:55.455 INFO:tasks.workunit.client.0.smithi088.stdout:7/714: getdents dc/d1b/d72/dc4 0 2023-12-09T02:34:55.455 INFO:tasks.workunit.client.0.smithi088.stdout:7/715: chown dc/d21/d6b/d6d/da4/d38/d1e/c59 2 1 2023-12-09T02:34:55.457 INFO:tasks.workunit.client.0.smithi088.stdout:9/794: link df/d20/d30/d60/dc9/cdc df/d20/d30/d60/dc6/dd2/c10c 0 2023-12-09T02:34:55.457 INFO:tasks.workunit.client.0.smithi088.stdout:9/795: write df/d20/d30/d60/d5c/f1f [2889490,45090] 0 2023-12-09T02:34:55.457 INFO:tasks.workunit.client.0.smithi088.stdout:9/796: chown df/d20/d4c/c74 1391 1 2023-12-09T02:34:55.457 INFO:tasks.workunit.client.0.smithi088.stdout:9/797: truncate df/d20/d30/d3f/d48/ff4 501014 0 2023-12-09T02:34:55.457 INFO:tasks.workunit.client.0.smithi088.stdout:5/765: dread d3/d15/de/d10/d18/d19/d1b/f32 [0,4194304] 0 2023-12-09T02:34:55.460 INFO:tasks.workunit.client.0.smithi088.stdout:7/716: truncate dc/d1b/d72/dc4/fc7 610193 0 2023-12-09T02:34:55.461 INFO:tasks.workunit.client.0.smithi088.stdout:3/704: getdents d1/d9/d6f/d22/d7f/d81/d85 0 2023-12-09T02:34:55.465 INFO:tasks.workunit.client.0.smithi088.stdout:5/766: mkdir d3/d15/d106 0 2023-12-09T02:34:55.465 INFO:tasks.workunit.client.0.smithi088.stdout:7/717: truncate dc/fc3 84844 0 2023-12-09T02:34:55.466 INFO:tasks.workunit.client.0.smithi088.stdout:7/718: fdatasync dc/f47 0 2023-12-09T02:34:55.467 INFO:tasks.workunit.client.0.smithi088.stdout:5/767: getdents d3/d15/de/d10/d18/d19/d1b/d35/d58/d67 0 2023-12-09T02:34:55.469 INFO:tasks.workunit.client.0.smithi088.stdout:7/719: symlink dc/d1b/d66/lf6 0 2023-12-09T02:34:55.469 INFO:tasks.workunit.client.0.smithi088.stdout:7/720: write dc/d1b/d66/fab [636684,106266] 0 2023-12-09T02:34:55.469 INFO:tasks.workunit.client.0.smithi088.stdout:7/721: chown dc/d21/c24 26976 1 2023-12-09T02:34:55.469 INFO:tasks.workunit.client.0.smithi088.stdout:7/722: write dc/d21/ff5 [768053,37960] 0 2023-12-09T02:34:55.470 INFO:tasks.workunit.client.0.smithi088.stdout:5/768: rmdir d3/d15/de/d10/d18 39 2023-12-09T02:34:55.472 INFO:tasks.workunit.client.0.smithi088.stdout:5/769: write d3/d15/de/d10/d18/d19/d20/f27 [3376834,45150] 0 2023-12-09T02:34:55.472 INFO:tasks.workunit.client.0.smithi088.stdout:5/770: write d3/fda [259676,47082] 0 2023-12-09T02:34:55.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/723: mknod dc/d1b/d72/dc4/cf7 0 2023-12-09T02:34:55.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/724: write dc/d21/d6b/d6d/da4/d38/d1e/f39 [1662355,107932] 0 2023-12-09T02:34:55.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/725: chown dc/d21/d6b/d93/lb8 6 1 2023-12-09T02:34:55.477 INFO:tasks.workunit.client.0.smithi088.stdout:7/726: link dc/fe0 dc/d21/d6b/ff8 0 2023-12-09T02:34:55.477 INFO:tasks.workunit.client.0.smithi088.stdout:7/727: write dc/d21/d6b/d6d/da4/d3e/dde/fe8 [902583,130459] 0 2023-12-09T02:34:55.477 INFO:tasks.workunit.client.0.smithi088.stdout:2/746: dwrite d6/d8/d4e/ff5 [0,4194304] 0 2023-12-09T02:34:55.478 INFO:tasks.workunit.client.0.smithi088.stdout:7/728: symlink dc/d21/d6b/d93/lf9 0 2023-12-09T02:34:55.485 INFO:tasks.workunit.client.0.smithi088.stdout:2/747: rename d6/d20/d69/db2 to d6/d8/d4e/da2/db8/dfc 0 2023-12-09T02:34:55.485 INFO:tasks.workunit.client.0.smithi088.stdout:2/748: write d6/fe1 [193101,85251] 0 2023-12-09T02:34:55.485 INFO:tasks.workunit.client.0.smithi088.stdout:5/771: dread d3/d15/de/d2c/f44 [0,4194304] 0 2023-12-09T02:34:55.486 INFO:tasks.workunit.client.0.smithi088.stdout:4/783: dwrite d3/f9 [0,4194304] 0 2023-12-09T02:34:55.486 INFO:tasks.workunit.client.0.smithi088.stdout:5/772: mknod d3/d15/de/d10/d51/d70/c107 0 2023-12-09T02:34:55.486 INFO:tasks.workunit.client.0.smithi088.stdout:5/773: chown d3/d15/de/d10/d18/d19/d20/ddf/cfc 2980 1 2023-12-09T02:34:55.487 INFO:tasks.workunit.client.0.smithi088.stdout:8/815: dwrite d2/d9/d1a/f7d [0,4194304] 0 2023-12-09T02:34:55.489 INFO:tasks.workunit.client.0.smithi088.stdout:5/774: rename d3/d15/dc/l75 to d3/d15/de/d10/d18/da5/l108 0 2023-12-09T02:34:55.495 INFO:tasks.workunit.client.0.smithi088.stdout:8/816: truncate d2/d2b/ff8 3422165 0 2023-12-09T02:34:55.495 INFO:tasks.workunit.client.0.smithi088.stdout:8/817: write d2/d9/d1a/d62/d76/d85/fdc [1107063,8186] 0 2023-12-09T02:34:55.497 INFO:tasks.workunit.client.0.smithi088.stdout:2/749: dread d6/d13/db3/fb6 [0,4194304] 0 2023-12-09T02:34:55.498 INFO:tasks.workunit.client.0.smithi088.stdout:5/775: mkdir d3/d15/de/d10/d51/db4/d109 0 2023-12-09T02:34:55.498 INFO:tasks.workunit.client.0.smithi088.stdout:0/731: dwrite df/d10/d22/d5b/f71 [0,4194304] 0 2023-12-09T02:34:55.498 INFO:tasks.workunit.client.0.smithi088.stdout:0/732: chown df/d10/d22/d2d/d2e/fb5 401 1 2023-12-09T02:34:55.498 INFO:tasks.workunit.client.0.smithi088.stdout:3/705: dwrite d1/d9/d6f/d6/d4a/d41/d33/f63 [0,4194304] 0 2023-12-09T02:34:55.498 INFO:tasks.workunit.client.0.smithi088.stdout:3/706: fsync d1/d9/d6f/d2d/db9/f68 0 2023-12-09T02:34:55.499 INFO:tasks.workunit.client.0.smithi088.stdout:2/750: creat d6/d8/deb/ffd x:0 0 0 2023-12-09T02:34:55.501 INFO:tasks.workunit.client.0.smithi088.stdout:9/798: dwrite df/fe6 [0,4194304] 0 2023-12-09T02:34:55.502 INFO:tasks.workunit.client.0.smithi088.stdout:9/799: write df/d29/d2f/f34 [1461435,123479] 0 2023-12-09T02:34:55.504 INFO:tasks.workunit.client.0.smithi088.stdout:0/733: getdents df/d37/d70 0 2023-12-09T02:34:55.510 INFO:tasks.workunit.client.0.smithi088.stdout:3/707: symlink d1/d73/lea 0 2023-12-09T02:34:55.510 INFO:tasks.workunit.client.0.smithi088.stdout:4/784: dwrite d3/dc/d18/d7b/f62 [0,4194304] 0 2023-12-09T02:34:55.512 INFO:tasks.workunit.client.0.smithi088.stdout:2/751: creat d6/d8/d4e/da2/db8/dfc/dc2/ffe x:0 0 0 2023-12-09T02:34:55.512 INFO:tasks.workunit.client.0.smithi088.stdout:2/752: dread - d6/d20/d69/ff8 zero size 2023-12-09T02:34:55.515 INFO:tasks.workunit.client.0.smithi088.stdout:8/818: dread d2/d9/d1a/d62/d76/f79 [0,4194304] 0 2023-12-09T02:34:55.515 INFO:tasks.workunit.client.0.smithi088.stdout:8/819: write d2/d9/d1a/d62/fe6 [743116,76993] 0 2023-12-09T02:34:55.521 INFO:tasks.workunit.client.0.smithi088.stdout:0/734: symlink df/d10/d22/d2d/d96/dea/lf4 0 2023-12-09T02:34:55.523 INFO:tasks.workunit.client.0.smithi088.stdout:9/800: dread df/d20/d5b/ff3 [0,4194304] 0 2023-12-09T02:34:55.523 INFO:tasks.workunit.client.0.smithi088.stdout:9/801: chown df/d20/d30/d60/dca/dee/lfd 213 1 2023-12-09T02:34:55.524 INFO:tasks.workunit.client.0.smithi088.stdout:9/802: stat df/d20/d30/d3f/d48/f45 0 2023-12-09T02:34:55.524 INFO:tasks.workunit.client.0.smithi088.stdout:9/803: truncate df/d20/d4c/d84/dcd/ffb 35738 0 2023-12-09T02:34:55.524 INFO:tasks.workunit.client.0.smithi088.stdout:5/776: dwrite d3/d15/de/d2c/f44 [0,4194304] 0 2023-12-09T02:34:55.524 INFO:tasks.workunit.client.0.smithi088.stdout:3/708: creat d1/d9/d6f/d22/d7f/d81/d85/dcb/feb x:0 0 0 2023-12-09T02:34:55.526 INFO:tasks.workunit.client.0.smithi088.stdout:4/785: rename d3/d65/f6d to d3/dc/d43/d8c/d95/daa/dc4/f102 0 2023-12-09T02:34:55.528 INFO:tasks.workunit.client.0.smithi088.stdout:2/753: creat d6/d8/d77/fff x:0 0 0 2023-12-09T02:34:55.528 INFO:tasks.workunit.client.0.smithi088.stdout:2/754: read - d6/d20/d3a/fd9 zero size 2023-12-09T02:34:55.528 INFO:tasks.workunit.client.0.smithi088.stdout:2/755: write d6/d8/d4e/d64/fe4 [667660,123317] 0 2023-12-09T02:34:55.530 INFO:tasks.workunit.client.0.smithi088.stdout:8/820: creat d2/d9/d13/d1c/d5f/f111 x:0 0 0 2023-12-09T02:34:55.532 INFO:tasks.workunit.client.0.smithi088.stdout:9/804: symlink df/d20/d30/d3f/d48/l10d 0 2023-12-09T02:34:55.532 INFO:tasks.workunit.client.0.smithi088.stdout:9/805: truncate df/d20/d30/d60/d5c/f16 1792000 0 2023-12-09T02:34:55.535 INFO:tasks.workunit.client.0.smithi088.stdout:9/806: write df/d50/d63/f80 [271192,88766] 0 2023-12-09T02:34:55.535 INFO:tasks.workunit.client.0.smithi088.stdout:5/777: creat d3/d15/de/d10/d51/dc9/dc4/f10a x:0 0 0 2023-12-09T02:34:55.544 INFO:tasks.workunit.client.0.smithi088.stdout:3/709: rename d1/d9/d6f/d6/f36 to d1/d9/d6f/d6/d83/fec 0 2023-12-09T02:34:55.544 INFO:tasks.workunit.client.0.smithi088.stdout:3/710: chown d1/d9/d6f/d6/fe6 11843754 1 2023-12-09T02:34:55.545 INFO:tasks.workunit.client.0.smithi088.stdout:4/786: getdents d3/dc/d1d/d40/d9f/dc8 0 2023-12-09T02:34:55.551 INFO:tasks.workunit.client.0.smithi088.stdout:9/807: unlink df/l15 0 2023-12-09T02:34:55.553 INFO:tasks.workunit.client.0.smithi088.stdout:5/778: creat d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/dfd/f10b x:0 0 0 2023-12-09T02:34:55.558 INFO:tasks.workunit.client.0.smithi088.stdout:4/787: getdents d3/dc/d88 0 2023-12-09T02:34:55.562 INFO:tasks.workunit.client.0.smithi088.stdout:2/756: unlink d6/d8/d1f/d22/d68/dd3/cf3 0 2023-12-09T02:34:55.562 INFO:tasks.workunit.client.0.smithi088.stdout:9/808: creat df/d20/d30/d60/d5c/f10e x:0 0 0 2023-12-09T02:34:55.565 INFO:tasks.workunit.client.0.smithi088.stdout:2/757: read d6/d8/d4e/d3c/f8c [221712,44166] 0 2023-12-09T02:34:55.565 INFO:tasks.workunit.client.0.smithi088.stdout:8/821: dread d2/d9/d1a/d62/d49/f59 [0,4194304] 0 2023-12-09T02:34:55.565 INFO:tasks.workunit.client.0.smithi088.stdout:8/822: write d2/d9/d1a/d62/fe6 [380658,23990] 0 2023-12-09T02:34:55.568 INFO:tasks.workunit.client.0.smithi088.stdout:5/779: creat d3/d15/de/d2c/dfa/f10c x:0 0 0 2023-12-09T02:34:55.570 INFO:tasks.workunit.client.0.smithi088.stdout:4/788: symlink d3/dc/d18/d8d/l103 0 2023-12-09T02:34:55.571 INFO:tasks.workunit.client.0.smithi088.stdout:9/809: symlink df/d20/d30/d60/dc6/dd2/l10f 0 2023-12-09T02:34:55.571 INFO:tasks.workunit.client.0.smithi088.stdout:9/810: fsync df/d29/d2f/f34 0 2023-12-09T02:34:55.572 INFO:tasks.workunit.client.0.smithi088.stdout:9/811: write df/f13 [569682,82049] 0 2023-12-09T02:34:55.572 INFO:tasks.workunit.client.0.smithi088.stdout:9/812: chown df/d20/dc7/fc8 0 1 2023-12-09T02:34:55.573 INFO:tasks.workunit.client.0.smithi088.stdout:8/823: symlink d2/d9/d70/d8f/da8/dbe/l112 0 2023-12-09T02:34:55.573 INFO:tasks.workunit.client.0.smithi088.stdout:8/824: chown d2/d9/d13/d1c/d5f/d96 10126265 1 2023-12-09T02:34:55.574 INFO:tasks.workunit.client.0.smithi088.stdout:5/780: creat d3/d15/de/d10/d51/db4/d109/f10d x:0 0 0 2023-12-09T02:34:55.575 INFO:tasks.workunit.client.0.smithi088.stdout:5/781: write d3/d15/dc/f2d [390548,95020] 0 2023-12-09T02:34:55.575 INFO:tasks.workunit.client.0.smithi088.stdout:5/782: chown d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a 77664478 1 2023-12-09T02:34:55.576 INFO:tasks.workunit.client.0.smithi088.stdout:4/789: mknod d3/dc/d18/d7b/dbb/dbc/c104 0 2023-12-09T02:34:55.577 INFO:tasks.workunit.client.0.smithi088.stdout:5/783: write d3/d15/de/d10/d51/d7f/f86 [2534753,110820] 0 2023-12-09T02:34:55.577 INFO:tasks.workunit.client.0.smithi088.stdout:4/790: write d3/dc/d18/d7b/dbb/fde [2107627,40189] 0 2023-12-09T02:34:55.577 INFO:tasks.workunit.client.0.smithi088.stdout:4/791: truncate d3/dc/d43/ff9 790905 0 2023-12-09T02:34:55.578 INFO:tasks.workunit.client.0.smithi088.stdout:4/792: write d3/dc/d43/ff9 [554608,41675] 0 2023-12-09T02:34:55.578 INFO:tasks.workunit.client.0.smithi088.stdout:2/758: mkdir d6/d8/d1f/d22/d68/d100 0 2023-12-09T02:34:55.579 INFO:tasks.workunit.client.0.smithi088.stdout:9/813: rename df/d29/c100 to df/d20/d4c/c110 0 2023-12-09T02:34:55.579 INFO:tasks.workunit.client.0.smithi088.stdout:8/825: symlink d2/d9/l113 0 2023-12-09T02:34:55.580 INFO:tasks.workunit.client.0.smithi088.stdout:8/826: readlink d2/d9/d70/d8f/da8/dbe/ld8 0 2023-12-09T02:34:55.583 INFO:tasks.workunit.client.0.smithi088.stdout:4/793: symlink d3/d65/db0/dc1/l105 0 2023-12-09T02:34:55.583 INFO:tasks.workunit.client.0.smithi088.stdout:4/794: truncate d3/dc/d43/d83/f67 1140202 0 2023-12-09T02:34:55.584 INFO:tasks.workunit.client.0.smithi088.stdout:2/759: rmdir d6/d13/db3 39 2023-12-09T02:34:55.585 INFO:tasks.workunit.client.0.smithi088.stdout:9/814: symlink df/d20/d30/d3f/d48/l111 0 2023-12-09T02:34:55.585 INFO:tasks.workunit.client.0.smithi088.stdout:9/815: chown df/d20/d4c/c110 51107237 1 2023-12-09T02:34:55.587 INFO:tasks.workunit.client.0.smithi088.stdout:8/827: rmdir d2/d9/d13/d1c/d3b 39 2023-12-09T02:34:55.587 INFO:tasks.workunit.client.0.smithi088.stdout:5/784: mkdir d3/d15/d2e/d10e 0 2023-12-09T02:34:55.589 INFO:tasks.workunit.client.0.smithi088.stdout:2/760: rmdir d6/de3/df7 0 2023-12-09T02:34:55.590 INFO:tasks.workunit.client.0.smithi088.stdout:9/816: creat df/f112 x:0 0 0 2023-12-09T02:34:55.591 INFO:tasks.workunit.client.0.smithi088.stdout:8/828: mkdir d2/d9/d1a/d65/d114 0 2023-12-09T02:34:55.592 INFO:tasks.workunit.client.0.smithi088.stdout:2/761: creat d6/d13/f101 x:0 0 0 2023-12-09T02:34:55.594 INFO:tasks.workunit.client.0.smithi088.stdout:8/829: creat d2/d10f/d6e/d9f/f115 x:0 0 0 2023-12-09T02:34:55.594 INFO:tasks.workunit.client.0.smithi088.stdout:8/830: chown d2/d9/d1a/d62/f95 1 1 2023-12-09T02:34:55.596 INFO:tasks.workunit.client.0.smithi088.stdout:8/831: mknod d2/d10f/d6e/d9f/c116 0 2023-12-09T02:34:55.596 INFO:tasks.workunit.client.0.smithi088.stdout:4/795: dwrite d3/dc/d43/d8c/fa5 [0,4194304] 0 2023-12-09T02:34:55.597 INFO:tasks.workunit.client.0.smithi088.stdout:8/832: getdents d2/d9/d13/d1c/d3b 0 2023-12-09T02:34:55.600 INFO:tasks.workunit.client.0.smithi088.stdout:5/785: dread d3/d8/f56 [0,4194304] 0 2023-12-09T02:34:55.600 INFO:tasks.workunit.client.0.smithi088.stdout:5/786: dread - d3/d15/de/d10/d18/d19/d1b/d35/d61/ded/fff zero size 2023-12-09T02:34:55.600 INFO:tasks.workunit.client.0.smithi088.stdout:5/787: write d3/d15/de/d73/f8f [37953,37934] 0 2023-12-09T02:34:55.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/817: dread df/d50/d63/f73 [0,4194304] 0 2023-12-09T02:34:55.605 INFO:tasks.workunit.client.0.smithi088.stdout:5/788: dread d3/d15/de/d10/d18/d19/d1b/f32 [4194304,4194304] 0 2023-12-09T02:34:55.612 INFO:tasks.workunit.client.0.smithi088.stdout:9/818: dread df/d50/d63/db8/fe4 [4194304,4194304] 0 2023-12-09T02:34:55.613 INFO:tasks.workunit.client.0.smithi088.stdout:9/819: mkdir df/d20/d30/d60/dca/dee/d113 0 2023-12-09T02:34:55.614 INFO:tasks.workunit.client.0.smithi088.stdout:9/820: creat df/f114 x:0 0 0 2023-12-09T02:34:55.614 INFO:tasks.workunit.client.0.smithi088.stdout:9/821: truncate df/d50/f58 1341492 0 2023-12-09T02:34:55.614 INFO:tasks.workunit.client.0.smithi088.stdout:9/822: fdatasync df/d20/d30/d60/d5c/f1e 0 2023-12-09T02:34:55.614 INFO:tasks.workunit.client.0.smithi088.stdout:9/823: fdatasync df/d20/d5b/fd8 0 2023-12-09T02:34:55.614 INFO:tasks.workunit.client.0.smithi088.stdout:9/824: chown df/d20/d30/d60/dc9/dda/de2/df6/cfe 1 1 2023-12-09T02:34:55.614 INFO:tasks.workunit.client.0.smithi088.stdout:9/825: fdatasync df/d20/d5b/f95 0 2023-12-09T02:34:55.615 INFO:tasks.workunit.client.0.smithi088.stdout:9/826: creat df/d50/f115 x:0 0 0 2023-12-09T02:34:55.615 INFO:tasks.workunit.client.0.smithi088.stdout:9/827: fsync df/d20/d30/d3f/d48/fae 0 2023-12-09T02:34:55.615 INFO:tasks.workunit.client.0.smithi088.stdout:9/828: chown df/d20/d30/d4e/cd9 3783 1 2023-12-09T02:34:55.619 INFO:tasks.workunit.client.0.smithi088.stdout:3/711: rmdir d1/d9/d6f/d6 39 2023-12-09T02:34:55.620 INFO:tasks.workunit.client.0.smithi088.stdout:3/712: mknod d1/d3e/d9d/ced 0 2023-12-09T02:34:55.620 INFO:tasks.workunit.client.0.smithi088.stdout:3/713: chown d1/d9/l4b 8 1 2023-12-09T02:34:55.621 INFO:tasks.workunit.client.0.smithi088.stdout:6/750: sync 2023-12-09T02:34:55.621 INFO:tasks.workunit.client.0.smithi088.stdout:1/832: sync 2023-12-09T02:34:55.622 INFO:tasks.workunit.client.0.smithi088.stdout:8/833: dwrite d2/d9/d1a/d62/d49/f59 [4194304,4194304] 0 2023-12-09T02:34:55.622 INFO:tasks.workunit.client.0.smithi088.stdout:2/762: dwrite d6/d8/d77/f87 [0,4194304] 0 2023-12-09T02:34:55.626 INFO:tasks.workunit.client.0.smithi088.stdout:6/751: mkdir d16/d62/da7/da9/dd9 0 2023-12-09T02:34:55.627 INFO:tasks.workunit.client.0.smithi088.stdout:3/714: mknod d1/d9/d6f/d6/d4a/d41/d33/cee 0 2023-12-09T02:34:55.628 INFO:tasks.workunit.client.0.smithi088.stdout:7/729: sync 2023-12-09T02:34:55.629 INFO:tasks.workunit.client.0.smithi088.stdout:9/829: dread df/d20/d30/d60/d5c/db9/fd1 [0,4194304] 0 2023-12-09T02:34:55.632 INFO:tasks.workunit.client.0.smithi088.stdout:3/715: symlink d1/d9/d6f/d22/d7f/d81/d85/dcb/lef 0 2023-12-09T02:34:55.634 INFO:tasks.workunit.client.0.smithi088.stdout:7/730: creat dc/d1b/de4/ffa x:0 0 0 2023-12-09T02:34:55.634 INFO:tasks.workunit.client.0.smithi088.stdout:7/731: fsync dc/d21/d6b/d6d/da4/d38/d1e/f39 0 2023-12-09T02:34:55.635 INFO:tasks.workunit.client.0.smithi088.stdout:8/834: dread d2/d9/d1a/f1f [0,4194304] 0 2023-12-09T02:34:55.635 INFO:tasks.workunit.client.0.smithi088.stdout:7/732: write dc/d21/d6b/d6d/da4/d3e/f92 [178166,76970] 0 2023-12-09T02:34:55.635 INFO:tasks.workunit.client.0.smithi088.stdout:9/830: dread df/d20/d30/d60/d5c/db9/fa5 [0,4194304] 0 2023-12-09T02:34:55.642 INFO:tasks.workunit.client.0.smithi088.stdout:3/716: creat d1/d9/d6f/d15/ff0 x:0 0 0 2023-12-09T02:34:55.646 INFO:tasks.workunit.client.0.smithi088.stdout:8/835: unlink d2/d10f/cf4 0 2023-12-09T02:34:55.646 INFO:tasks.workunit.client.0.smithi088.stdout:8/836: dread - d2/db9/ff9 zero size 2023-12-09T02:34:55.648 INFO:tasks.workunit.client.0.smithi088.stdout:7/733: truncate dc/d21/d6b/d6d/da4/d38/d1e/f60 408361 0 2023-12-09T02:34:55.650 INFO:tasks.workunit.client.0.smithi088.stdout:3/717: rename d1/d9/c30 to d1/d9/d6f/d22/d7f/d81/d85/ddc/cf1 0 2023-12-09T02:34:55.652 INFO:tasks.workunit.client.0.smithi088.stdout:4/796: getdents d3/d65/db0/dc1 0 2023-12-09T02:34:55.652 INFO:tasks.workunit.client.0.smithi088.stdout:8/837: truncate d2/d9/d13/d1c/d3b/f10d 134075 0 2023-12-09T02:34:55.654 INFO:tasks.workunit.client.0.smithi088.stdout:3/718: dread d1/f6c [0,4194304] 0 2023-12-09T02:34:55.654 INFO:tasks.workunit.client.0.smithi088.stdout:3/719: fdatasync d1/d9/d6f/d6/fc3 0 2023-12-09T02:34:55.654 INFO:tasks.workunit.client.0.smithi088.stdout:3/720: stat d1/d9/d6f/d2d/dab/dc5/dc9/dce 0 2023-12-09T02:34:55.654 INFO:tasks.workunit.client.0.smithi088.stdout:4/797: truncate d3/dc/d18/d7b/dbb/fde 3651306 0 2023-12-09T02:34:55.657 INFO:tasks.workunit.client.0.smithi088.stdout:8/838: creat d2/d10f/d6e/f117 x:0 0 0 2023-12-09T02:34:55.657 INFO:tasks.workunit.client.0.smithi088.stdout:8/839: readlink d2/d9/d13/l4e 0 2023-12-09T02:34:55.657 INFO:tasks.workunit.client.0.smithi088.stdout:8/840: truncate d2/d9/d13/d1c/d5f/d84/faa 562708 0 2023-12-09T02:34:55.659 INFO:tasks.workunit.client.0.smithi088.stdout:4/798: unlink d3/dc/d43/d83/d37/fc9 0 2023-12-09T02:34:55.662 INFO:tasks.workunit.client.0.smithi088.stdout:8/841: mkdir d2/d9/d70/d8f/d98/d118 0 2023-12-09T02:34:55.663 INFO:tasks.workunit.client.0.smithi088.stdout:4/799: creat d3/d65/f106 x:0 0 0 2023-12-09T02:34:55.664 INFO:tasks.workunit.client.0.smithi088.stdout:4/800: write d3/dc/f11 [8882728,90576] 0 2023-12-09T02:34:55.665 INFO:tasks.workunit.client.0.smithi088.stdout:8/842: mkdir d2/d9/d70/d8f/da8/d119 0 2023-12-09T02:34:55.671 INFO:tasks.workunit.client.0.smithi088.stdout:8/843: write d2/d9/f10 [230824,6395] 0 2023-12-09T02:34:55.673 INFO:tasks.workunit.client.0.smithi088.stdout:4/801: dread d3/dc/d43/f87 [0,4194304] 0 2023-12-09T02:34:55.674 INFO:tasks.workunit.client.0.smithi088.stdout:6/752: dwrite d16/d62/d6f/da4/dc2/dc7/d8c/fc4 [0,4194304] 0 2023-12-09T02:34:55.675 INFO:tasks.workunit.client.0.smithi088.stdout:6/753: truncate d16/d1b/d25/fae 779311 0 2023-12-09T02:34:55.677 INFO:tasks.workunit.client.0.smithi088.stdout:6/754: rename d16/fce to d16/d35/d36/dc6/fda 0 2023-12-09T02:34:55.678 INFO:tasks.workunit.client.0.smithi088.stdout:6/755: write d16/d35/f76 [1449787,65982] 0 2023-12-09T02:34:55.678 INFO:tasks.workunit.client.0.smithi088.stdout:6/756: fdatasync f15 0 2023-12-09T02:34:55.679 INFO:tasks.workunit.client.0.smithi088.stdout:6/757: write d16/d1b/d2c/d3f/d41/f4b [500796,31885] 0 2023-12-09T02:34:55.681 INFO:tasks.workunit.client.0.smithi088.stdout:2/763: dwrite d6/d20/d3a/fd9 [0,4194304] 0 2023-12-09T02:34:55.684 INFO:tasks.workunit.client.0.smithi088.stdout:2/764: mknod d6/d8/d4e/da2/db8/dfc/db4/c102 0 2023-12-09T02:34:55.685 INFO:tasks.workunit.client.0.smithi088.stdout:2/765: symlink d6/d8/d4e/d64/l103 0 2023-12-09T02:34:55.686 INFO:tasks.workunit.client.0.smithi088.stdout:2/766: creat d6/d13/d42/f104 x:0 0 0 2023-12-09T02:34:55.688 INFO:tasks.workunit.client.0.smithi088.stdout:2/767: truncate d6/d20/d3d/fac 312547 0 2023-12-09T02:34:55.688 INFO:tasks.workunit.client.0.smithi088.stdout:2/768: fsync d6/d20/fc3 0 2023-12-09T02:34:55.688 INFO:tasks.workunit.client.0.smithi088.stdout:2/769: truncate d6/d8/d73/d78/f8a 1371582 0 2023-12-09T02:34:55.693 INFO:tasks.workunit.client.0.smithi088.stdout:0/735: sync 2023-12-09T02:34:55.693 INFO:tasks.workunit.client.0.smithi088.stdout:1/833: dwrite d8/d27/d9a/fc2 [0,4194304] 0 2023-12-09T02:34:55.693 INFO:tasks.workunit.client.0.smithi088.stdout:9/831: dwrite df/d20/f3e [0,4194304] 0 2023-12-09T02:34:55.694 INFO:tasks.workunit.client.0.smithi088.stdout:9/832: fsync df/d20/d30/d4e/fbf 0 2023-12-09T02:34:55.694 INFO:tasks.workunit.client.0.smithi088.stdout:0/736: read df/d10/d22/d5f/fb6 [2600737,18705] 0 2023-12-09T02:34:55.694 INFO:tasks.workunit.client.0.smithi088.stdout:0/737: chown df/d37/de2/fa6 10 1 2023-12-09T02:34:55.694 INFO:tasks.workunit.client.0.smithi088.stdout:0/738: stat df/d28/d34/c73 0 2023-12-09T02:34:55.695 INFO:tasks.workunit.client.0.smithi088.stdout:1/834: link d8/d1c/d50/ffd d8/d3d/d44/da4/f11d 0 2023-12-09T02:34:55.697 INFO:tasks.workunit.client.0.smithi088.stdout:0/739: unlink df/d28/f9f 0 2023-12-09T02:34:55.700 INFO:tasks.workunit.client.0.smithi088.stdout:1/835: unlink d8/d53/l58 0 2023-12-09T02:34:55.700 INFO:tasks.workunit.client.0.smithi088.stdout:0/740: mkdir df/dd0/df5 0 2023-12-09T02:34:55.700 INFO:tasks.workunit.client.0.smithi088.stdout:1/836: write d8/f5c [5049254,70785] 0 2023-12-09T02:34:55.700 INFO:tasks.workunit.client.0.smithi088.stdout:3/721: dwrite d1/d9/d6f/d2d/d66/fe7 [0,4194304] 0 2023-12-09T02:34:55.700 INFO:tasks.workunit.client.0.smithi088.stdout:3/722: write d1/d9/d6f/d6/d4a/d41/fd2 [649521,43671] 0 2023-12-09T02:34:55.700 INFO:tasks.workunit.client.0.smithi088.stdout:7/734: dwrite dc/d21/d6b/d6d/da4/f71 [0,4194304] 0 2023-12-09T02:34:55.701 INFO:tasks.workunit.client.0.smithi088.stdout:0/741: write df/d10/d22/d5f/f87 [1720766,115272] 0 2023-12-09T02:34:55.701 INFO:tasks.workunit.client.0.smithi088.stdout:1/837: rmdir d8/d3d/d5d/d95 39 2023-12-09T02:34:55.706 INFO:tasks.workunit.client.0.smithi088.stdout:3/723: write d1/fa [8055417,29101] 0 2023-12-09T02:34:55.707 INFO:tasks.workunit.client.0.smithi088.stdout:9/833: dread df/f13 [0,4194304] 0 2023-12-09T02:34:55.707 INFO:tasks.workunit.client.0.smithi088.stdout:3/724: write d1/d9/d6f/d2d/d66/fa9 [882248,18081] 0 2023-12-09T02:34:55.707 INFO:tasks.workunit.client.0.smithi088.stdout:8/844: dwrite d2/d9/d1a/d65/fbb [0,4194304] 0 2023-12-09T02:34:55.709 INFO:tasks.workunit.client.0.smithi088.stdout:2/770: dwrite d6/f12 [0,4194304] 0 2023-12-09T02:34:55.709 INFO:tasks.workunit.client.0.smithi088.stdout:2/771: truncate d6/d8/d4e/da2/fc1 769986 0 2023-12-09T02:34:55.709 INFO:tasks.workunit.client.0.smithi088.stdout:2/772: dread - d6/d8/deb/ffd zero size 2023-12-09T02:34:55.709 INFO:tasks.workunit.client.0.smithi088.stdout:2/773: truncate d6/d20/d3a/f91 154349 0 2023-12-09T02:34:55.710 INFO:tasks.workunit.client.0.smithi088.stdout:6/758: dwrite d16/d1b/d2c/d3f/d83/f9d [0,4194304] 0 2023-12-09T02:34:55.711 INFO:tasks.workunit.client.0.smithi088.stdout:6/759: dread - d16/d1b/d25/d5f/d63/fd5 zero size 2023-12-09T02:34:55.718 INFO:tasks.workunit.client.0.smithi088.stdout:9/834: dread df/d20/d4c/fd0 [0,4194304] 0 2023-12-09T02:34:55.719 INFO:tasks.workunit.client.0.smithi088.stdout:1/838: mknod d8/d3d/df0/c11e 0 2023-12-09T02:34:55.719 INFO:tasks.workunit.client.0.smithi088.stdout:1/839: chown d8/d27/d40/f76 15222 1 2023-12-09T02:34:55.721 INFO:tasks.workunit.client.0.smithi088.stdout:3/725: creat d1/d9/d6f/d15/ff2 x:0 0 0 2023-12-09T02:34:55.723 INFO:tasks.workunit.client.0.smithi088.stdout:4/802: dread d3/dc/d18/d7b/dbb/fde [0,4194304] 0 2023-12-09T02:34:55.725 INFO:tasks.workunit.client.0.smithi088.stdout:8/845: creat d2/d10f/d6e/f11a x:0 0 0 2023-12-09T02:34:55.725 INFO:tasks.workunit.client.0.smithi088.stdout:8/846: chown d2/d10f/d6e/d9f/fba 18 1 2023-12-09T02:34:55.725 INFO:tasks.workunit.client.0.smithi088.stdout:8/847: truncate d2/d10f/d6e/d9f/f86 980728 0 2023-12-09T02:34:55.727 INFO:tasks.workunit.client.0.smithi088.stdout:7/735: dwrite dc/d1b/f5c [0,4194304] 0 2023-12-09T02:34:55.728 INFO:tasks.workunit.client.0.smithi088.stdout:7/736: read dc/f74 [1023352,75165] 0 2023-12-09T02:34:55.729 INFO:tasks.workunit.client.0.smithi088.stdout:2/774: rename d6/d8/fab to d6/d8/d4e/d47/f105 0 2023-12-09T02:34:55.731 INFO:tasks.workunit.client.0.smithi088.stdout:6/760: creat d16/d62/fdb x:0 0 0 2023-12-09T02:34:55.732 INFO:tasks.workunit.client.0.smithi088.stdout:9/835: mkdir df/d50/d63/db8/d116 0 2023-12-09T02:34:55.734 INFO:tasks.workunit.client.0.smithi088.stdout:1/840: symlink d8/d1c/d50/dc5/l11f 0 2023-12-09T02:34:55.734 INFO:tasks.workunit.client.0.smithi088.stdout:1/841: write d8/d1c/d50/f7f [1853846,100065] 0 2023-12-09T02:34:55.736 INFO:tasks.workunit.client.0.smithi088.stdout:4/803: mknod d3/dc/d18/da9/c107 0 2023-12-09T02:34:55.736 INFO:tasks.workunit.client.0.smithi088.stdout:4/804: fsync d3/dc/d18/d7b/fcc 0 2023-12-09T02:34:55.736 INFO:tasks.workunit.client.0.smithi088.stdout:4/805: write d3/dc/d43/f52 [5074178,34658] 0 2023-12-09T02:34:55.736 INFO:tasks.workunit.client.0.smithi088.stdout:4/806: truncate d3/dc/d1d/d40/fa1 626745 0 2023-12-09T02:34:55.737 INFO:tasks.workunit.client.0.smithi088.stdout:8/848: mknod d2/d9/d13/d1c/d5f/dc4/c11b 0 2023-12-09T02:34:55.742 INFO:tasks.workunit.client.0.smithi088.stdout:7/737: getdents dc/d1b/d72/dec 0 2023-12-09T02:34:55.747 INFO:tasks.workunit.client.0.smithi088.stdout:0/742: rename df/d10/f31 to df/d28/d33/d81/ff6 0 2023-12-09T02:34:55.749 INFO:tasks.workunit.client.0.smithi088.stdout:2/775: truncate d6/d20/d3a/fdd 117726 0 2023-12-09T02:34:55.751 INFO:tasks.workunit.client.0.smithi088.stdout:6/761: creat d16/d62/d6f/da4/dc2/fdc x:0 0 0 2023-12-09T02:34:55.755 INFO:tasks.workunit.client.0.smithi088.stdout:4/807: creat d3/f108 x:0 0 0 2023-12-09T02:34:55.755 INFO:tasks.workunit.client.0.smithi088.stdout:4/808: chown d3/dc/d18/dab/cf1 228774491 1 2023-12-09T02:34:55.755 INFO:tasks.workunit.client.0.smithi088.stdout:5/789: sync 2023-12-09T02:34:55.755 INFO:tasks.workunit.client.0.smithi088.stdout:5/790: chown d3/d15/de/d10/d18/d19/d1b/cd4 881293 1 2023-12-09T02:34:55.756 INFO:tasks.workunit.client.0.smithi088.stdout:5/791: dread - d3/d15/de/d73/fee zero size 2023-12-09T02:34:55.756 INFO:tasks.workunit.client.0.smithi088.stdout:5/792: chown d3/d15/de/d10/d18/d19/c7c 16337 1 2023-12-09T02:34:55.756 INFO:tasks.workunit.client.0.smithi088.stdout:5/793: chown d3/d15/de/d10/d18/d19/d1b/d35/d42/de2/cf8 4750 1 2023-12-09T02:34:55.756 INFO:tasks.workunit.client.0.smithi088.stdout:5/794: chown d3/d15/de/d10/d18/f4a 18112 1 2023-12-09T02:34:55.756 INFO:tasks.workunit.client.0.smithi088.stdout:9/836: dwrite df/d20/d30/d3f/d48/f6e [0,4194304] 0 2023-12-09T02:34:55.757 INFO:tasks.workunit.client.0.smithi088.stdout:8/849: truncate d2/d10f/fc7 781580 0 2023-12-09T02:34:55.757 INFO:tasks.workunit.client.0.smithi088.stdout:8/850: readlink d2/d9/d1a/d62/l66 0 2023-12-09T02:34:55.757 INFO:tasks.workunit.client.0.smithi088.stdout:1/842: dwrite d8/d1b/d1d/dc7/fe7 [0,4194304] 0 2023-12-09T02:34:55.762 INFO:tasks.workunit.client.0.smithi088.stdout:7/738: mknod dc/d21/d7f/cfb 0 2023-12-09T02:34:55.774 INFO:tasks.workunit.client.0.smithi088.stdout:6/762: truncate d16/d1b/d2c/f48 8778775 0 2023-12-09T02:34:55.774 INFO:tasks.workunit.client.0.smithi088.stdout:6/763: write d16/d1b/d25/d5f/fcb [968300,31685] 0 2023-12-09T02:34:55.775 INFO:tasks.workunit.client.0.smithi088.stdout:4/809: truncate d3/dc/f61 2204199 0 2023-12-09T02:34:55.776 INFO:tasks.workunit.client.0.smithi088.stdout:9/837: creat df/d20/d30/d60/dc9/dda/de2/df6/f117 x:0 0 0 2023-12-09T02:34:55.781 INFO:tasks.workunit.client.0.smithi088.stdout:1/843: link d8/d1b/d1d/ddf/f10c d8/d1b/d1d/ddf/f120 0 2023-12-09T02:34:55.781 INFO:tasks.workunit.client.0.smithi088.stdout:1/844: chown d8/d27/d40 675 1 2023-12-09T02:34:55.783 INFO:tasks.workunit.client.0.smithi088.stdout:6/764: creat d16/d35/d36/fdd x:0 0 0 2023-12-09T02:34:55.783 INFO:tasks.workunit.client.0.smithi088.stdout:6/765: chown d16/f21 7470 1 2023-12-09T02:34:55.785 INFO:tasks.workunit.client.0.smithi088.stdout:2/776: dwrite d6/d20/d3d/fac [0,4194304] 0 2023-12-09T02:34:55.785 INFO:tasks.workunit.client.0.smithi088.stdout:2/777: readlink d6/d20/d69/l7d 0 2023-12-09T02:34:55.785 INFO:tasks.workunit.client.0.smithi088.stdout:4/810: rename d3/dc/d43/d8c/d95/daa/db7/ff0 to d3/dc/d43/d8c/d95/daa/db7/f109 0 2023-12-09T02:34:55.785 INFO:tasks.workunit.client.0.smithi088.stdout:4/811: write d3/d65/f74 [1202449,47335] 0 2023-12-09T02:34:55.786 INFO:tasks.workunit.client.0.smithi088.stdout:1/845: mknod d8/d3d/d5d/c121 0 2023-12-09T02:34:55.786 INFO:tasks.workunit.client.0.smithi088.stdout:1/846: write d8/d3d/d5d/faf [301325,36651] 0 2023-12-09T02:34:55.787 INFO:tasks.workunit.client.0.smithi088.stdout:6/766: link d16/f31 d16/d1b/d2c/d3f/d41/d80/fde 0 2023-12-09T02:34:55.787 INFO:tasks.workunit.client.0.smithi088.stdout:6/767: fdatasync d16/f21 0 2023-12-09T02:34:55.789 INFO:tasks.workunit.client.0.smithi088.stdout:2/778: mkdir d6/d8/d4e/da2/db8/dfc/db4/d106 0 2023-12-09T02:34:55.789 INFO:tasks.workunit.client.0.smithi088.stdout:0/743: dwrite df/d10/f29 [0,4194304] 0 2023-12-09T02:34:55.789 INFO:tasks.workunit.client.0.smithi088.stdout:0/744: write df/d10/d22/f6f [538910,14992] 0 2023-12-09T02:34:55.790 INFO:tasks.workunit.client.0.smithi088.stdout:4/812: symlink d3/dc/d18/d29/da4/l10a 0 2023-12-09T02:34:55.790 INFO:tasks.workunit.client.0.smithi088.stdout:1/847: creat d8/d1b/d6d/f122 x:0 0 0 2023-12-09T02:34:55.792 INFO:tasks.workunit.client.0.smithi088.stdout:6/768: dread d16/d62/d6f/da4/dc2/dc7/d8c/fcc [0,4194304] 0 2023-12-09T02:34:55.792 INFO:tasks.workunit.client.0.smithi088.stdout:2/779: getdents d6/d20/d9a 0 2023-12-09T02:34:55.794 INFO:tasks.workunit.client.0.smithi088.stdout:4/813: rmdir d3/d65 39 2023-12-09T02:34:55.794 INFO:tasks.workunit.client.0.smithi088.stdout:4/814: fdatasync d3/dc/f11 0 2023-12-09T02:34:55.795 INFO:tasks.workunit.client.0.smithi088.stdout:2/780: symlink d6/d8/d4e/da2/l107 0 2023-12-09T02:34:55.797 INFO:tasks.workunit.client.0.smithi088.stdout:4/815: read d3/dc/d18/d29/fb8 [2737882,125234] 0 2023-12-09T02:34:55.797 INFO:tasks.workunit.client.0.smithi088.stdout:4/816: chown d3/dc/d43/d8c/d9a/ca2 337 1 2023-12-09T02:34:55.797 INFO:tasks.workunit.client.0.smithi088.stdout:4/817: readlink d3/dc/d18/da9/le1 0 2023-12-09T02:34:55.799 INFO:tasks.workunit.client.0.smithi088.stdout:4/818: mknod d3/dc/d43/d83/c10b 0 2023-12-09T02:34:55.801 INFO:tasks.workunit.client.0.smithi088.stdout:4/819: truncate d3/dc/f48 3677306 0 2023-12-09T02:34:55.801 INFO:tasks.workunit.client.0.smithi088.stdout:4/820: chown d3/dc/d1d/f71 7 1 2023-12-09T02:34:55.803 INFO:tasks.workunit.client.0.smithi088.stdout:4/821: creat d3/dc/d18/d29/da4/dfd/f10c x:0 0 0 2023-12-09T02:34:55.806 INFO:tasks.workunit.client.0.smithi088.stdout:1/848: chown d8/d3d/d44/lbf 743821791 1 2023-12-09T02:34:55.806 INFO:tasks.workunit.client.0.smithi088.stdout:1/849: write d8/d3d/fdb [834796,3212] 0 2023-12-09T02:34:55.806 INFO:tasks.workunit.client.0.smithi088.stdout:1/850: chown d8/d1b/d1d/dc7/d108 3791742 1 2023-12-09T02:34:55.812 INFO:tasks.workunit.client.0.smithi088.stdout:5/795: dwrite d3/d15/de/d10/d51/db4/ffb [0,4194304] 0 2023-12-09T02:34:55.813 INFO:tasks.workunit.client.0.smithi088.stdout:5/796: write d3/d15/f101 [480925,130874] 0 2023-12-09T02:34:55.813 INFO:tasks.workunit.client.0.smithi088.stdout:5/797: truncate d3/d15/de/d10/d18/f99 4821519 0 2023-12-09T02:34:55.813 INFO:tasks.workunit.client.0.smithi088.stdout:7/739: dwrite dc/d21/d6b/fb3 [0,4194304] 0 2023-12-09T02:34:55.813 INFO:tasks.workunit.client.0.smithi088.stdout:8/851: dwrite d2/d9/d13/d1c/f64 [0,4194304] 0 2023-12-09T02:34:55.813 INFO:tasks.workunit.client.0.smithi088.stdout:8/852: write d2/d9/d70/d8f/da8/dbe/fd5 [25670,95571] 0 2023-12-09T02:34:55.817 INFO:tasks.workunit.client.0.smithi088.stdout:6/769: dwrite d16/d1b/d25/d5f/f68 [0,4194304] 0 2023-12-09T02:34:55.817 INFO:tasks.workunit.client.0.smithi088.stdout:6/770: write d16/f94 [892558,122780] 0 2023-12-09T02:34:55.818 INFO:tasks.workunit.client.0.smithi088.stdout:5/798: rmdir d3/d15/de/d10/d51/dc9 39 2023-12-09T02:34:55.818 INFO:tasks.workunit.client.0.smithi088.stdout:2/781: dwrite f4 [0,4194304] 0 2023-12-09T02:34:55.818 INFO:tasks.workunit.client.0.smithi088.stdout:7/740: write dc/d1b/d66/f8e [4125527,60236] 0 2023-12-09T02:34:55.818 INFO:tasks.workunit.client.0.smithi088.stdout:9/838: dwrite df/d20/d30/d3f/d48/f65 [4194304,4194304] 0 2023-12-09T02:34:55.819 INFO:tasks.workunit.client.0.smithi088.stdout:9/839: rename df/d20 to df/d20/d5b/d91/d10a/d118 22 2023-12-09T02:34:55.819 INFO:tasks.workunit.client.0.smithi088.stdout:5/799: write d3/d15/de/d10/d18/d19/d20/f43 [2079696,109276] 0 2023-12-09T02:34:55.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/745: dwrite df/d10/d22/f6f [0,4194304] 0 2023-12-09T02:34:55.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/746: dread - df/d28/d34/dc8/fdb zero size 2023-12-09T02:34:55.828 INFO:tasks.workunit.client.0.smithi088.stdout:8/853: symlink d2/d9/d70/d8f/d98/l11c 0 2023-12-09T02:34:55.830 INFO:tasks.workunit.client.0.smithi088.stdout:6/771: unlink d16/d1b/d2c/d60/f74 0 2023-12-09T02:34:55.832 INFO:tasks.workunit.client.0.smithi088.stdout:2/782: symlink d6/d20/d3a/d94/dad/ddb/dde/l108 0 2023-12-09T02:34:55.832 INFO:tasks.workunit.client.0.smithi088.stdout:2/783: truncate d6/d13/f1e 1554311 0 2023-12-09T02:34:55.832 INFO:tasks.workunit.client.0.smithi088.stdout:6/772: read d16/d1b/d2c/d3f/d41/f4d [864892,71541] 0 2023-12-09T02:34:55.832 INFO:tasks.workunit.client.0.smithi088.stdout:6/773: readlink d16/d1b/d2c/d60/l8f 0 2023-12-09T02:34:55.835 INFO:tasks.workunit.client.0.smithi088.stdout:9/840: truncate df/d20/d30/d60/d5c/db9/f83 1684171 0 2023-12-09T02:34:55.837 INFO:tasks.workunit.client.0.smithi088.stdout:5/800: mkdir d3/d15/de/d10/d51/dc9/d10f 0 2023-12-09T02:34:55.839 INFO:tasks.workunit.client.0.smithi088.stdout:1/851: dwrite d8/d3d/d5d/d95/f3f [0,4194304] 0 2023-12-09T02:34:55.839 INFO:tasks.workunit.client.0.smithi088.stdout:7/741: dwrite dc/d1b/d82/f84 [0,4194304] 0 2023-12-09T02:34:55.842 INFO:tasks.workunit.client.0.smithi088.stdout:7/742: write dc/f15 [4494264,35247] 0 2023-12-09T02:34:55.845 INFO:tasks.workunit.client.0.smithi088.stdout:0/747: creat df/d37/d70/db8/ff7 x:0 0 0 2023-12-09T02:34:55.846 INFO:tasks.workunit.client.0.smithi088.stdout:8/854: write d2/d9/d1a/d62/d49/f97 [809078,100015] 0 2023-12-09T02:34:55.846 INFO:tasks.workunit.client.0.smithi088.stdout:8/855: write d2/d9/f10 [4611006,33280] 0 2023-12-09T02:34:55.848 INFO:tasks.workunit.client.0.smithi088.stdout:8/856: write d2/d9/fa7 [2731685,113641] 0 2023-12-09T02:34:55.848 INFO:tasks.workunit.client.0.smithi088.stdout:2/784: symlink d6/d13/db3/l109 0 2023-12-09T02:34:55.848 INFO:tasks.workunit.client.0.smithi088.stdout:2/785: read d6/d20/d3d/f83 [3492377,20059] 0 2023-12-09T02:34:55.849 INFO:tasks.workunit.client.0.smithi088.stdout:9/841: creat df/d20/d30/d4e/f119 x:0 0 0 2023-12-09T02:34:55.851 INFO:tasks.workunit.client.0.smithi088.stdout:5/801: creat d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/dcc/f110 x:0 0 0 2023-12-09T02:34:55.856 INFO:tasks.workunit.client.0.smithi088.stdout:2/786: write d6/d8/f1d [1528323,103583] 0 2023-12-09T02:34:55.856 INFO:tasks.workunit.client.0.smithi088.stdout:2/787: truncate d6/d8/d4e/dc9/fd1 4293170 0 2023-12-09T02:34:55.856 INFO:tasks.workunit.client.0.smithi088.stdout:2/788: chown d6/d8/l25 6055 1 2023-12-09T02:34:55.856 INFO:tasks.workunit.client.0.smithi088.stdout:7/743: rmdir dc/d21/d6b/d6d/da4 39 2023-12-09T02:34:55.856 INFO:tasks.workunit.client.0.smithi088.stdout:0/748: symlink df/d28/d34/dc8/lf8 0 2023-12-09T02:34:55.856 INFO:tasks.workunit.client.0.smithi088.stdout:0/749: chown df/d37/d70 22857 1 2023-12-09T02:34:55.859 INFO:tasks.workunit.client.0.smithi088.stdout:3/726: sync 2023-12-09T02:34:55.859 INFO:tasks.workunit.client.0.smithi088.stdout:3/727: chown d1/d9/d6f/d22/d7f/d81 1166 1 2023-12-09T02:34:55.861 INFO:tasks.workunit.client.0.smithi088.stdout:5/802: creat d3/d15/de/d10/d18/d19/d20/ddf/f111 x:0 0 0 2023-12-09T02:34:55.861 INFO:tasks.workunit.client.0.smithi088.stdout:5/803: chown d3/d15/de/d10/d18/d19/d20/f43 4753 1 2023-12-09T02:34:55.862 INFO:tasks.workunit.client.0.smithi088.stdout:3/728: write d1/d9/d6f/d15/fb4 [4068152,30200] 0 2023-12-09T02:34:55.865 INFO:tasks.workunit.client.0.smithi088.stdout:0/750: mknod df/d10/d22/d2d/d3c/cf9 0 2023-12-09T02:34:55.865 INFO:tasks.workunit.client.0.smithi088.stdout:0/751: chown df/d28/f95 11113 1 2023-12-09T02:34:55.865 INFO:tasks.workunit.client.0.smithi088.stdout:0/752: dread - df/d37/de2/fc9 zero size 2023-12-09T02:34:55.869 INFO:tasks.workunit.client.0.smithi088.stdout:5/804: dread d3/d15/de/d10/d18/d19/d20/f27 [0,4194304] 0 2023-12-09T02:34:55.869 INFO:tasks.workunit.client.0.smithi088.stdout:5/805: write d3/d8/f100 [108910,80110] 0 2023-12-09T02:34:55.869 INFO:tasks.workunit.client.0.smithi088.stdout:3/729: rmdir d1/d9/d6f/d6/d4a/d41/d33 39 2023-12-09T02:34:55.869 INFO:tasks.workunit.client.0.smithi088.stdout:1/852: dwrite d8/d53/f89 [0,4194304] 0 2023-12-09T02:34:55.869 INFO:tasks.workunit.client.0.smithi088.stdout:0/753: creat df/dd0/df5/ffa x:0 0 0 2023-12-09T02:34:55.872 INFO:tasks.workunit.client.0.smithi088.stdout:5/806: link d3/d15/de/d10/d18/d19/d1b/d35/d42/f21 d3/f112 0 2023-12-09T02:34:55.875 INFO:tasks.workunit.client.0.smithi088.stdout:5/807: symlink d3/d15/d2e/d49/d88/dd6/l113 0 2023-12-09T02:34:55.877 INFO:tasks.workunit.client.0.smithi088.stdout:1/853: getdents d8/d3d/d44/da4/dcb 0 2023-12-09T02:34:55.877 INFO:tasks.workunit.client.0.smithi088.stdout:0/754: read df/d10/d22/fb3 [1052676,33827] 0 2023-12-09T02:34:55.880 INFO:tasks.workunit.client.0.smithi088.stdout:8/857: dwrite d2/d9/d1a/d62/d9a/f10e [0,4194304] 0 2023-12-09T02:34:55.880 INFO:tasks.workunit.client.0.smithi088.stdout:8/858: write d2/d10f/d6e/f11a [58696,25966] 0 2023-12-09T02:34:55.882 INFO:tasks.workunit.client.0.smithi088.stdout:5/808: rmdir d3/d15/de/d10/d18/d19/d1b/d35/d42 39 2023-12-09T02:34:55.886 INFO:tasks.workunit.client.0.smithi088.stdout:5/809: creat d3/d15/de/d10/d51/db4/dd7/f114 x:0 0 0 2023-12-09T02:34:55.886 INFO:tasks.workunit.client.0.smithi088.stdout:9/842: dwrite df/d20/d30/d60/d5c/f2a [4194304,4194304] 0 2023-12-09T02:34:55.886 INFO:tasks.workunit.client.0.smithi088.stdout:2/789: dwrite d6/d8/f1a [0,4194304] 0 2023-12-09T02:34:55.887 INFO:tasks.workunit.client.0.smithi088.stdout:2/790: fdatasync d6/d20/d69/ff8 0 2023-12-09T02:34:55.888 INFO:tasks.workunit.client.0.smithi088.stdout:9/843: creat df/d20/d30/d3f/d48/da7/f11a x:0 0 0 2023-12-09T02:34:55.890 INFO:tasks.workunit.client.0.smithi088.stdout:9/844: truncate df/d20/f3e 1184358 0 2023-12-09T02:34:55.892 INFO:tasks.workunit.client.0.smithi088.stdout:9/845: write df/f112 [619197,52703] 0 2023-12-09T02:34:55.895 INFO:tasks.workunit.client.0.smithi088.stdout:7/744: dwrite dc/d21/d6b/d6d/da4/d3e/dde/fe8 [0,4194304] 0 2023-12-09T02:34:55.898 INFO:tasks.workunit.client.0.smithi088.stdout:5/810: dread d3/d15/de/d10/d51/d70/fa1 [0,4194304] 0 2023-12-09T02:34:55.900 INFO:tasks.workunit.client.0.smithi088.stdout:7/745: creat dc/d21/d6b/ffc x:0 0 0 2023-12-09T02:34:55.900 INFO:tasks.workunit.client.0.smithi088.stdout:5/811: rmdir d3/d8 39 2023-12-09T02:34:55.901 INFO:tasks.workunit.client.0.smithi088.stdout:5/812: fdatasync d3/d15/de/d10/d51/d70/fa1 0 2023-12-09T02:34:55.901 INFO:tasks.workunit.client.0.smithi088.stdout:5/813: chown d3/d15/de/d10/d18/d19/d1b/f1c 193726245 1 2023-12-09T02:34:55.902 INFO:tasks.workunit.client.0.smithi088.stdout:3/730: dwrite d1/d3e/f97 [0,4194304] 0 2023-12-09T02:34:55.908 INFO:tasks.workunit.client.0.smithi088.stdout:5/814: symlink d3/d15/de/d10/d51/l115 0 2023-12-09T02:34:55.908 INFO:tasks.workunit.client.0.smithi088.stdout:7/746: rename dc/d21/d6b/d6d/da4/d38/c12 to dc/d21/d6b/d6d/da4/d38/d1e/cfd 0 2023-12-09T02:34:55.909 INFO:tasks.workunit.client.0.smithi088.stdout:5/815: getdents d3/d15/de/d10/d51/db4/df5 0 2023-12-09T02:34:55.911 INFO:tasks.workunit.client.0.smithi088.stdout:7/747: rename dc/d21/d6b/d6d/da4/d3e/dde to dc/d1b/d91/dfe 0 2023-12-09T02:34:55.914 INFO:tasks.workunit.client.0.smithi088.stdout:5/816: unlink d3/d15/de/d10/d18/d19/d1b/d35/d58/lf7 0 2023-12-09T02:34:55.916 INFO:tasks.workunit.client.0.smithi088.stdout:7/748: truncate dc/d21/d6b/d6d/da4/d3e/f5a 185247 0 2023-12-09T02:34:55.931 INFO:tasks.workunit.client.0.smithi088.stdout:5/817: write d3/d15/de/d10/d51/d7f/f9c [2750479,79423] 0 2023-12-09T02:34:55.932 INFO:tasks.workunit.client.0.smithi088.stdout:5/818: unlink d3/d15/de/d73/f8f 0 2023-12-09T02:34:55.947 INFO:tasks.workunit.client.0.smithi088.stdout:5/819: dread d3/d15/de/d10/d18/da5/fb1 [0,4194304] 0 2023-12-09T02:34:55.949 INFO:tasks.workunit.client.0.smithi088.stdout:1/854: dwrite d8/d27/d66/d79/ddc/f11a [0,4194304] 0 2023-12-09T02:34:55.949 INFO:tasks.workunit.client.0.smithi088.stdout:1/855: chown d8/d1b/d6d/d7c/fcd 130817718 1 2023-12-09T02:34:55.949 INFO:tasks.workunit.client.0.smithi088.stdout:1/856: readlink d8/d27/l7b 0 2023-12-09T02:34:55.949 INFO:tasks.workunit.client.0.smithi088.stdout:8/859: dwrite d2/d9/d13/d1c/d5f/d96/f105 [0,4194304] 0 2023-12-09T02:34:55.949 INFO:tasks.workunit.client.0.smithi088.stdout:8/860: stat d2/d9/l17 0 2023-12-09T02:34:55.949 INFO:tasks.workunit.client.0.smithi088.stdout:5/820: dread d3/d15/de/d10/d18/d19/d1b/d35/d42/f84 [0,4194304] 0 2023-12-09T02:34:55.949 INFO:tasks.workunit.client.0.smithi088.stdout:5/821: stat d3/d15/de/d10/d18 0 2023-12-09T02:34:55.950 INFO:tasks.workunit.client.0.smithi088.stdout:0/755: dwrite df/d10/d22/da0/fb7 [0,4194304] 0 2023-12-09T02:34:55.951 INFO:tasks.workunit.client.0.smithi088.stdout:2/791: dwrite d6/d20/d3a/fea [0,4194304] 0 2023-12-09T02:34:55.951 INFO:tasks.workunit.client.0.smithi088.stdout:3/731: dwrite d1/d9/d6f/d2d/d66/fa2 [0,4194304] 0 2023-12-09T02:34:55.953 INFO:tasks.workunit.client.0.smithi088.stdout:7/749: dwrite dc/d1b/d66/fab [0,4194304] 0 2023-12-09T02:34:55.963 INFO:tasks.workunit.client.0.smithi088.stdout:1/857: readlink d8/d3d/d44/le9 0 2023-12-09T02:34:55.964 INFO:tasks.workunit.client.0.smithi088.stdout:8/861: dread d2/d9/d1a/d62/d9a/f10e [0,4194304] 0 2023-12-09T02:34:55.964 INFO:tasks.workunit.client.0.smithi088.stdout:9/846: dwrite df/d20/d30/d60/d5c/f1e [0,4194304] 0 2023-12-09T02:34:55.965 INFO:tasks.workunit.client.0.smithi088.stdout:5/822: creat d3/d15/d2e/d49/d88/dd8/f116 x:0 0 0 2023-12-09T02:34:55.968 INFO:tasks.workunit.client.0.smithi088.stdout:8/862: dread d2/d9/d1a/d65/f9d [0,4194304] 0 2023-12-09T02:34:55.968 INFO:tasks.workunit.client.0.smithi088.stdout:8/863: chown d2/d9/d70/d8f/l107 3744 1 2023-12-09T02:34:55.968 INFO:tasks.workunit.client.0.smithi088.stdout:8/864: chown d2/d9/d70/d8f/d98/d9b/fe0 73394398 1 2023-12-09T02:34:55.968 INFO:tasks.workunit.client.0.smithi088.stdout:0/756: creat df/d10/d22/d5f/ffb x:0 0 0 2023-12-09T02:34:55.968 INFO:tasks.workunit.client.0.smithi088.stdout:8/865: dread d2/d9/d13/d1c/d5f/d84/faa [0,4194304] 0 2023-12-09T02:34:55.970 INFO:tasks.workunit.client.0.smithi088.stdout:3/732: dwrite d1/d9/d6f/d22/d7f/f4d [0,4194304] 0 2023-12-09T02:34:55.971 INFO:tasks.workunit.client.0.smithi088.stdout:2/792: unlink d6/d8/d1f/d22/l45 0 2023-12-09T02:34:55.977 INFO:tasks.workunit.client.0.smithi088.stdout:7/750: creat dc/d21/d6b/d6d/d76/db9/fff x:0 0 0 2023-12-09T02:34:55.977 INFO:tasks.workunit.client.0.smithi088.stdout:7/751: chown dc/d21/d6b/d6d/d76/db9/ldd 4232 1 2023-12-09T02:34:55.978 INFO:tasks.workunit.client.0.smithi088.stdout:1/858: rename d8/d1b/d6d/f122 to d8/d3d/d44/da4/f123 0 2023-12-09T02:34:55.979 INFO:tasks.workunit.client.0.smithi088.stdout:7/752: read dc/d1b/f6e [347878,125377] 0 2023-12-09T02:34:55.980 INFO:tasks.workunit.client.0.smithi088.stdout:2/793: write d6/d8/d1f/d22/d68/fa5 [1727607,70289] 0 2023-12-09T02:34:55.981 INFO:tasks.workunit.client.0.smithi088.stdout:4/822: sync 2023-12-09T02:34:55.981 INFO:tasks.workunit.client.0.smithi088.stdout:4/823: fdatasync d3/dc/d43/d8c/d95/f7a 0 2023-12-09T02:34:55.984 INFO:tasks.workunit.client.0.smithi088.stdout:9/847: mknod df/d20/d4c/d84/dcd/c11b 0 2023-12-09T02:34:55.984 INFO:tasks.workunit.client.0.smithi088.stdout:9/848: dread - df/d50/f7d zero size 2023-12-09T02:34:55.984 INFO:tasks.workunit.client.0.smithi088.stdout:9/849: readlink df/d20/d30/d4e/l6f 0 2023-12-09T02:34:55.984 INFO:tasks.workunit.client.0.smithi088.stdout:9/850: chown df/d20/d30/d3f/d48/f5e 0 1 2023-12-09T02:34:55.985 INFO:tasks.workunit.client.0.smithi088.stdout:9/851: chown df/d20/d30/d3f/d48/da7/lb4 54 1 2023-12-09T02:34:55.985 INFO:tasks.workunit.client.0.smithi088.stdout:9/852: write df/d29/f6a [686128,50999] 0 2023-12-09T02:34:55.985 INFO:tasks.workunit.client.0.smithi088.stdout:9/853: dread - df/d20/d30/d60/d5c/f10e zero size 2023-12-09T02:34:55.985 INFO:tasks.workunit.client.0.smithi088.stdout:4/824: dread d3/dc/d43/d8c/fa3 [0,4194304] 0 2023-12-09T02:34:55.985 INFO:tasks.workunit.client.0.smithi088.stdout:4/825: chown d3/l6b 26 1 2023-12-09T02:34:55.988 INFO:tasks.workunit.client.0.smithi088.stdout:5/823: symlink d3/d15/d106/l117 0 2023-12-09T02:34:55.988 INFO:tasks.workunit.client.0.smithi088.stdout:0/757: unlink df/d10/d22/l3f 0 2023-12-09T02:34:55.990 INFO:tasks.workunit.client.0.smithi088.stdout:7/753: link dc/d21/d6b/d6d/da4/d38/d1e/f60 dc/d21/d6b/d6d/da4/d3e/f100 0 2023-12-09T02:34:55.993 INFO:tasks.workunit.client.0.smithi088.stdout:4/826: unlink d3/dc/d43/f52 0 2023-12-09T02:34:55.994 INFO:tasks.workunit.client.0.smithi088.stdout:4/827: fdatasync d3/dc/d43/d8c/d95/f4b 0 2023-12-09T02:34:55.995 INFO:tasks.workunit.client.0.smithi088.stdout:0/758: creat df/d37/ffc x:0 0 0 2023-12-09T02:34:55.995 INFO:tasks.workunit.client.0.smithi088.stdout:0/759: fdatasync df/d37/ffc 0 2023-12-09T02:34:55.997 INFO:tasks.workunit.client.0.smithi088.stdout:9/854: dread df/d20/d5b/d91/f8b [0,4194304] 0 2023-12-09T02:34:55.997 INFO:tasks.workunit.client.0.smithi088.stdout:1/859: rename d8/d27/d40/f76 to d8/f124 0 2023-12-09T02:34:55.997 INFO:tasks.workunit.client.0.smithi088.stdout:1/860: stat d8/d1b/d6d/d7c/dc0/lda 0 2023-12-09T02:34:55.997 INFO:tasks.workunit.client.0.smithi088.stdout:0/760: mknod df/d28/df3/cfd 0 2023-12-09T02:34:55.997 INFO:tasks.workunit.client.0.smithi088.stdout:0/761: dread - df/d10/d22/d5f/fbb zero size 2023-12-09T02:34:55.999 INFO:tasks.workunit.client.0.smithi088.stdout:3/733: dwrite d1/d9/d6f/d6/d8b/fa4 [4194304,4194304] 0 2023-12-09T02:34:55.999 INFO:tasks.workunit.client.0.smithi088.stdout:9/855: unlink df/c21 0 2023-12-09T02:34:55.999 INFO:tasks.workunit.client.0.smithi088.stdout:9/856: chown df/d29/d2f/c78 13 1 2023-12-09T02:34:55.999 INFO:tasks.workunit.client.0.smithi088.stdout:9/857: write df/d20/d30/d60/dc9/dda/de2/df6/f117 [1046370,40629] 0 2023-12-09T02:34:55.999 INFO:tasks.workunit.client.0.smithi088.stdout:8/866: dwrite d2/d10f/d6e/f11a [0,4194304] 0 2023-12-09T02:34:55.999 INFO:tasks.workunit.client.0.smithi088.stdout:8/867: chown d2/d2b 772743 1 2023-12-09T02:34:55.999 INFO:tasks.workunit.client.0.smithi088.stdout:8/868: stat d2/d9/d13/df6 0 2023-12-09T02:34:55.999 INFO:tasks.workunit.client.0.smithi088.stdout:8/869: write d2/d9/d70/d8f/d98/fe4 [5148093,57157] 0 2023-12-09T02:34:56.000 INFO:tasks.workunit.client.0.smithi088.stdout:1/861: getdents d8/d27 0 2023-12-09T02:34:56.001 INFO:tasks.workunit.client.0.smithi088.stdout:0/762: write df/d10/d22/d5b/f5d [4012952,95633] 0 2023-12-09T02:34:56.001 INFO:tasks.workunit.client.0.smithi088.stdout:1/862: dread d8/d3d/d5d/d95/f5b [0,4194304] 0 2023-12-09T02:34:56.002 INFO:tasks.workunit.client.0.smithi088.stdout:1/863: read d8/d27/d66/d79/ddc/f11a [46710,126697] 0 2023-12-09T02:34:56.004 INFO:tasks.workunit.client.0.smithi088.stdout:7/754: dread dc/d21/d6b/d9b/fbf [0,4194304] 0 2023-12-09T02:34:56.004 INFO:tasks.workunit.client.0.smithi088.stdout:7/755: chown dc/d21/d6b/d6d/da4/d5d 0 1 2023-12-09T02:34:56.005 INFO:tasks.workunit.client.0.smithi088.stdout:3/734: rename d1/d9/d6f/d6/fa7 to d1/d9/d6f/d6/d4a/d41/ff3 0 2023-12-09T02:34:56.005 INFO:tasks.workunit.client.0.smithi088.stdout:9/858: link df/d20/d30/d60/d5c/f10e df/d50/d63/dbd/f11c 0 2023-12-09T02:34:56.005 INFO:tasks.workunit.client.0.smithi088.stdout:9/859: read df/d50/f58 [1252465,7974] 0 2023-12-09T02:34:56.005 INFO:tasks.workunit.client.0.smithi088.stdout:8/870: dread d2/f11 [0,4194304] 0 2023-12-09T02:34:56.008 INFO:tasks.workunit.client.0.smithi088.stdout:6/774: sync 2023-12-09T02:34:56.008 INFO:tasks.workunit.client.0.smithi088.stdout:6/775: getdents d16/d35/d36/dad 0 2023-12-09T02:34:56.012 INFO:tasks.workunit.client.0.smithi088.stdout:7/756: dread dc/d1b/f57 [0,4194304] 0 2023-12-09T02:34:56.012 INFO:tasks.workunit.client.0.smithi088.stdout:7/757: write dc/d21/d6b/d6d/da4/d5d/fac [713534,110523] 0 2023-12-09T02:34:56.012 INFO:tasks.workunit.client.0.smithi088.stdout:7/758: write dc/d21/d6b/d6d/da4/f34 [780660,79323] 0 2023-12-09T02:34:56.014 INFO:tasks.workunit.client.0.smithi088.stdout:3/735: creat d1/d9/d6f/d2d/dab/dc5/dc9/dce/ff4 x:0 0 0 2023-12-09T02:34:56.014 INFO:tasks.workunit.client.0.smithi088.stdout:3/736: chown d1/d9/d6f/d22/d7f/d81/d85/l90 13796 1 2023-12-09T02:34:56.014 INFO:tasks.workunit.client.0.smithi088.stdout:3/737: fdatasync d1/d9/d6f/d2d/d66/fa9 0 2023-12-09T02:34:56.014 INFO:tasks.workunit.client.0.smithi088.stdout:3/738: dread - d1/d9/d6f/d6/d4a/d41/fd1 zero size 2023-12-09T02:34:56.015 INFO:tasks.workunit.client.0.smithi088.stdout:9/860: creat df/d20/d4c/d84/d108/f11d x:0 0 0 2023-12-09T02:34:56.017 INFO:tasks.workunit.client.0.smithi088.stdout:6/776: mkdir d16/d35/d36/ddf 0 2023-12-09T02:34:56.017 INFO:tasks.workunit.client.0.smithi088.stdout:5/824: dread d3/d15/de/d10/d51/d7f/f9c [0,4194304] 0 2023-12-09T02:34:56.019 INFO:tasks.workunit.client.0.smithi088.stdout:7/759: symlink dc/d21/d6b/d9b/l101 0 2023-12-09T02:34:56.023 INFO:tasks.workunit.client.0.smithi088.stdout:9/861: symlink df/d20/d30/d60/l11e 0 2023-12-09T02:34:56.024 INFO:tasks.workunit.client.0.smithi088.stdout:5/825: creat d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/f118 x:0 0 0 2023-12-09T02:34:56.024 INFO:tasks.workunit.client.0.smithi088.stdout:5/826: stat d3/d15/de/d10/d18/lc3 0 2023-12-09T02:34:56.027 INFO:tasks.workunit.client.0.smithi088.stdout:9/862: write df/d20/d30/d60/d5c/f23 [1278249,87988] 0 2023-12-09T02:34:56.027 INFO:tasks.workunit.client.0.smithi088.stdout:5/827: mkdir d3/d15/de/d10/d51/dc9/d10f/d119 0 2023-12-09T02:34:56.031 INFO:tasks.workunit.client.0.smithi088.stdout:5/828: symlink d3/d15/dc/d60/db2/l11a 0 2023-12-09T02:34:56.031 INFO:tasks.workunit.client.0.smithi088.stdout:5/829: stat d3/d8 0 2023-12-09T02:34:56.033 INFO:tasks.workunit.client.0.smithi088.stdout:8/871: dwrite d2/d10f/f68 [0,4194304] 0 2023-12-09T02:34:56.037 INFO:tasks.workunit.client.0.smithi088.stdout:8/872: unlink d2/fe7 0 2023-12-09T02:34:56.038 INFO:tasks.workunit.client.0.smithi088.stdout:8/873: write d2/d9/d13/d1c/d5f/d84/faa [85870,121976] 0 2023-12-09T02:34:56.039 INFO:tasks.workunit.client.0.smithi088.stdout:8/874: mknod d2/d9/d1a/c11d 0 2023-12-09T02:34:56.040 INFO:tasks.workunit.client.0.smithi088.stdout:3/739: dwrite d1/d9/d6f/d6/fe6 [0,4194304] 0 2023-12-09T02:34:56.040 INFO:tasks.workunit.client.0.smithi088.stdout:3/740: fsync d1/d9/d6f/d6/fe6 0 2023-12-09T02:34:56.040 INFO:tasks.workunit.client.0.smithi088.stdout:8/875: symlink d2/d9/d1a/d65/l11e 0 2023-12-09T02:34:56.042 INFO:tasks.workunit.client.0.smithi088.stdout:8/876: read d2/d9/d70/d8f/d98/fe4 [2190092,10415] 0 2023-12-09T02:34:56.043 INFO:tasks.workunit.client.0.smithi088.stdout:7/760: dwrite dc/d21/d6b/d6d/da4/d3e/d97/fe3 [0,4194304] 0 2023-12-09T02:34:56.044 INFO:tasks.workunit.client.0.smithi088.stdout:3/741: unlink d1/d9/d6f/d22/d7f/d81/d85/cb5 0 2023-12-09T02:34:56.044 INFO:tasks.workunit.client.0.smithi088.stdout:3/742: readlink d1/d9/l7d 0 2023-12-09T02:34:56.046 INFO:tasks.workunit.client.0.smithi088.stdout:9/863: dread df/d20/d4c/d84/fa8 [0,4194304] 0 2023-12-09T02:34:56.047 INFO:tasks.workunit.client.0.smithi088.stdout:3/743: mknod d1/d9/d6f/d22/cf5 0 2023-12-09T02:34:56.050 INFO:tasks.workunit.client.0.smithi088.stdout:9/864: creat df/d20/d30/d60/d5c/ddb/f11f x:0 0 0 2023-12-09T02:34:56.051 INFO:tasks.workunit.client.0.smithi088.stdout:3/744: link d1/d9/d6f/d22/d7f/d81/d85/fb3 d1/d9/d6f/d6/d4a/ff6 0 2023-12-09T02:34:56.052 INFO:tasks.workunit.client.0.smithi088.stdout:7/761: dread dc/fe5 [0,4194304] 0 2023-12-09T02:34:56.053 INFO:tasks.workunit.client.0.smithi088.stdout:7/762: dread dc/d21/d6b/d6d/d76/df0/ff2 [0,4194304] 0 2023-12-09T02:34:56.053 INFO:tasks.workunit.client.0.smithi088.stdout:7/763: chown dc/fe0 0 1 2023-12-09T02:34:56.053 INFO:tasks.workunit.client.0.smithi088.stdout:9/865: rename df/d20/d30/d4e/ce1 to df/d20/d30/d3f/d48/da7/c120 0 2023-12-09T02:34:56.053 INFO:tasks.workunit.client.0.smithi088.stdout:9/866: fdatasync df/d20/d30/d60/dc9/dda/de2/df6/f117 0 2023-12-09T02:34:56.054 INFO:tasks.workunit.client.0.smithi088.stdout:3/745: creat d1/d9/d6f/d6/d4a/d41/d33/d49/ff7 x:0 0 0 2023-12-09T02:34:56.056 INFO:tasks.workunit.client.0.smithi088.stdout:7/764: rename dc/d21/d6b/d6d/da4/f71 to dc/d21/d6b/d93/f102 0 2023-12-09T02:34:56.056 INFO:tasks.workunit.client.0.smithi088.stdout:5/830: dwrite d3/d8/f56 [0,4194304] 0 2023-12-09T02:34:56.056 INFO:tasks.workunit.client.0.smithi088.stdout:3/746: creat d1/d9/d6f/d22/d7f/d81/d85/dcb/ff8 x:0 0 0 2023-12-09T02:34:56.060 INFO:tasks.workunit.client.0.smithi088.stdout:7/765: write dc/d1b/d66/f6f [785253,69035] 0 2023-12-09T02:34:56.062 INFO:tasks.workunit.client.0.smithi088.stdout:7/766: link dc/d21/d6b/ff8 dc/d21/d6b/d6d/f103 0 2023-12-09T02:34:56.063 INFO:tasks.workunit.client.0.smithi088.stdout:7/767: creat dc/d21/d6b/dbb/f104 x:0 0 0 2023-12-09T02:34:56.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/831: dread d3/d15/de/d10/d18/d19/d1b/f9b [0,4194304] 0 2023-12-09T02:34:56.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/832: write d3/d15/d2e/ff4 [857563,11615] 0 2023-12-09T02:34:56.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/833: readlink d3/d15/de/d10/d51/d7f/lcb 0 2023-12-09T02:34:56.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/834: chown d3/d15/dc/d60/db2 1453 1 2023-12-09T02:34:56.070 INFO:tasks.workunit.client.0.smithi088.stdout:5/835: unlink d3/d15/de/d2c/c37 0 2023-12-09T02:34:56.070 INFO:tasks.workunit.client.0.smithi088.stdout:9/867: dwrite df/d50/f58 [0,4194304] 0 2023-12-09T02:34:56.075 INFO:tasks.workunit.client.0.smithi088.stdout:7/768: dread dc/d21/d6b/d6d/da4/d38/f17 [4194304,4194304] 0 2023-12-09T02:34:56.075 INFO:tasks.workunit.client.0.smithi088.stdout:7/769: chown dc/d21/d6b/d6d/da4/d38/fa7 18 1 2023-12-09T02:34:56.075 INFO:tasks.workunit.client.0.smithi088.stdout:7/770: write dc/d21/d6b/dbb/fcc [362303,234] 0 2023-12-09T02:34:56.076 INFO:tasks.workunit.client.0.smithi088.stdout:7/771: symlink dc/d1b/d91/l105 0 2023-12-09T02:34:56.076 INFO:tasks.workunit.client.0.smithi088.stdout:7/772: mkdir dc/d21/d6b/d6d/d76/d106 0 2023-12-09T02:34:56.077 INFO:tasks.workunit.client.0.smithi088.stdout:7/773: truncate dc/d21/f8c 3802489 0 2023-12-09T02:34:56.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/774: creat dc/d21/d6b/d6d/da4/d5d/f107 x:0 0 0 2023-12-09T02:34:56.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/775: write dc/d21/f61 [979866,63302] 0 2023-12-09T02:34:56.082 INFO:tasks.workunit.client.0.smithi088.stdout:7/776: creat dc/d21/d6b/d6d/da4/d38/f108 x:0 0 0 2023-12-09T02:34:56.082 INFO:tasks.workunit.client.0.smithi088.stdout:7/777: write dc/d1b/fe6 [405750,81650] 0 2023-12-09T02:34:56.082 INFO:tasks.workunit.client.0.smithi088.stdout:3/747: dwrite d1/d9/d6f/d6/d83/fec [0,4194304] 0 2023-12-09T02:34:56.083 INFO:tasks.workunit.client.0.smithi088.stdout:9/868: dread df/d20/d30/d3f/fab [0,4194304] 0 2023-12-09T02:34:56.085 INFO:tasks.workunit.client.0.smithi088.stdout:7/778: dread dc/fe5 [0,4194304] 0 2023-12-09T02:34:56.085 INFO:tasks.workunit.client.0.smithi088.stdout:9/869: mknod df/d20/d30/c121 0 2023-12-09T02:34:56.086 INFO:tasks.workunit.client.0.smithi088.stdout:9/870: write df/d20/d30/f43 [438362,11827] 0 2023-12-09T02:34:56.088 INFO:tasks.workunit.client.0.smithi088.stdout:7/779: creat dc/d21/d6b/d6d/d76/db9/f109 x:0 0 0 2023-12-09T02:34:56.088 INFO:tasks.workunit.client.0.smithi088.stdout:5/836: dread d3/d15/dc/d60/f9e [0,4194304] 0 2023-12-09T02:34:56.090 INFO:tasks.workunit.client.0.smithi088.stdout:9/871: link df/d20/d30/d60/dc9/cdc df/d50/d63/db8/d116/c122 0 2023-12-09T02:34:56.091 INFO:tasks.workunit.client.0.smithi088.stdout:9/872: creat df/d20/d30/d60/dc9/f123 x:0 0 0 2023-12-09T02:34:56.092 INFO:tasks.workunit.client.0.smithi088.stdout:9/873: mknod df/d20/d30/d4e/c124 0 2023-12-09T02:34:56.093 INFO:tasks.workunit.client.0.smithi088.stdout:9/874: chown df/d20/d30/d3f/d48/fba 3056 1 2023-12-09T02:34:56.094 INFO:tasks.workunit.client.0.smithi088.stdout:9/875: symlink df/d20/d30/d3f/d48/dfa/l125 0 2023-12-09T02:34:56.096 INFO:tasks.workunit.client.0.smithi088.stdout:9/876: creat df/d20/d4c/d84/f126 x:0 0 0 2023-12-09T02:34:56.097 INFO:tasks.workunit.client.0.smithi088.stdout:9/877: write df/f1a [1742938,15055] 0 2023-12-09T02:34:56.100 INFO:tasks.workunit.client.0.smithi088.stdout:9/878: rmdir df/d20/d5b/d91 39 2023-12-09T02:34:56.100 INFO:tasks.workunit.client.0.smithi088.stdout:5/837: dread d3/d15/de/f17 [0,4194304] 0 2023-12-09T02:34:56.102 INFO:tasks.workunit.client.0.smithi088.stdout:5/838: creat d3/d15/f11b x:0 0 0 2023-12-09T02:34:56.102 INFO:tasks.workunit.client.0.smithi088.stdout:5/839: stat d3/d15/de/d10/d18/d19/d1b 0 2023-12-09T02:34:56.102 INFO:tasks.workunit.client.0.smithi088.stdout:5/840: stat d3/d15/de/d10/d18/d19/d20/l38 0 2023-12-09T02:34:56.102 INFO:tasks.workunit.client.0.smithi088.stdout:5/841: chown d3/d15/de/d10/d51/dc9/dc4 95 1 2023-12-09T02:34:56.103 INFO:tasks.workunit.client.0.smithi088.stdout:5/842: rename d3/d15/de/c66 to d3/d15/de/d10/d18/d19/d20/ddf/c11c 0 2023-12-09T02:34:56.108 INFO:tasks.workunit.client.0.smithi088.stdout:7/780: dwrite dc/d1b/f6e [0,4194304] 0 2023-12-09T02:34:56.110 INFO:tasks.workunit.client.0.smithi088.stdout:2/794: sync 2023-12-09T02:34:56.110 INFO:tasks.workunit.client.0.smithi088.stdout:2/795: write d6/d20/d3a/d94/dad/fef [903374,127192] 0 2023-12-09T02:34:56.110 INFO:tasks.workunit.client.0.smithi088.stdout:2/796: write d6/d8/d73/d78/f8a [1873965,125399] 0 2023-12-09T02:34:56.111 INFO:tasks.workunit.client.0.smithi088.stdout:9/879: dread df/d20/d30/d60/dc9/dda/de2/ff5 [0,4194304] 0 2023-12-09T02:34:56.112 INFO:tasks.workunit.client.0.smithi088.stdout:9/880: chown df/d29/d2f/c107 19321 1 2023-12-09T02:34:56.113 INFO:tasks.workunit.client.0.smithi088.stdout:7/781: mknod dc/d21/d6b/d6d/dc1/c10a 0 2023-12-09T02:34:56.113 INFO:tasks.workunit.client.0.smithi088.stdout:7/782: fsync dc/d21/d6b/d6d/da4/d3e/fb2 0 2023-12-09T02:34:56.114 INFO:tasks.workunit.client.0.smithi088.stdout:7/783: write dc/d21/f8c [252996,21094] 0 2023-12-09T02:34:56.114 INFO:tasks.workunit.client.0.smithi088.stdout:5/843: dread d3/d15/dc/f2d [0,4194304] 0 2023-12-09T02:34:56.114 INFO:tasks.workunit.client.0.smithi088.stdout:5/844: fdatasync d3/d15/de/fd9 0 2023-12-09T02:34:56.116 INFO:tasks.workunit.client.0.smithi088.stdout:9/881: rename df/d29/cc3 to df/d20/d30/d60/d5c/ddb/c127 0 2023-12-09T02:34:56.116 INFO:tasks.workunit.client.0.smithi088.stdout:9/882: dread - df/d20/d30/d3f/d48/da7/f11a zero size 2023-12-09T02:34:56.116 INFO:tasks.workunit.client.0.smithi088.stdout:9/883: stat df/d20/d30/d60/dc9/dda/fe7 0 2023-12-09T02:34:56.116 INFO:tasks.workunit.client.0.smithi088.stdout:9/884: readlink df/d20/d30/d60/dca/dee/lfd 0 2023-12-09T02:34:56.117 INFO:tasks.workunit.client.0.smithi088.stdout:7/784: getdents dc/dcb 0 2023-12-09T02:34:56.117 INFO:tasks.workunit.client.0.smithi088.stdout:7/785: write dc/d21/d7f/fa1 [445097,112967] 0 2023-12-09T02:34:56.117 INFO:tasks.workunit.client.0.smithi088.stdout:9/885: write df/d29/d2f/f93 [2922842,86097] 0 2023-12-09T02:34:56.117 INFO:tasks.workunit.client.0.smithi088.stdout:7/786: dread dc/d21/d6b/d6d/da4/d38/d1e/f60 [0,4194304] 0 2023-12-09T02:34:56.118 INFO:tasks.workunit.client.0.smithi088.stdout:7/787: dread - dc/d1b/d72/dec/fee zero size 2023-12-09T02:34:56.119 INFO:tasks.workunit.client.0.smithi088.stdout:5/845: unlink d3/d15/de/d10/d18/d19/d1b/d35/d61/f81 0 2023-12-09T02:34:56.119 INFO:tasks.workunit.client.0.smithi088.stdout:5/846: write d3/d15/de/d10/d18/d19/d1b/d35/d42/f84 [1658561,128948] 0 2023-12-09T02:34:56.123 INFO:tasks.workunit.client.0.smithi088.stdout:9/886: rename df/d20/d5b/d91/f10b to df/d20/d30/d60/dc9/dda/f128 0 2023-12-09T02:34:56.123 INFO:tasks.workunit.client.0.smithi088.stdout:7/788: rmdir dc/d1b/d72/dc4 39 2023-12-09T02:34:56.124 INFO:tasks.workunit.client.0.smithi088.stdout:7/789: rename dc/d21/d6b/d6d/d76/l96 to dc/d21/d6b/d6d/d76/l10b 0 2023-12-09T02:34:56.124 INFO:tasks.workunit.client.0.smithi088.stdout:7/790: chown dc/dcb/de2/feb 23 1 2023-12-09T02:34:56.125 INFO:tasks.workunit.client.0.smithi088.stdout:9/887: creat df/d20/d30/d60/dc9/dda/f129 x:0 0 0 2023-12-09T02:34:56.125 INFO:tasks.workunit.client.0.smithi088.stdout:9/888: write df/d20/d4c/fc1 [1022261,34263] 0 2023-12-09T02:34:56.125 INFO:tasks.workunit.client.0.smithi088.stdout:9/889: mkdir df/d20/dc7/d12a 0 2023-12-09T02:34:56.125 INFO:tasks.workunit.client.0.smithi088.stdout:9/890: write df/d20/d30/d60/d5c/db9/fa5 [431549,104792] 0 2023-12-09T02:34:56.127 INFO:tasks.workunit.client.0.smithi088.stdout:2/797: dwrite d6/d8/d4e/d47/f105 [0,4194304] 0 2023-12-09T02:34:56.127 INFO:tasks.workunit.client.0.smithi088.stdout:2/798: chown d6/d20 6 1 2023-12-09T02:34:56.127 INFO:tasks.workunit.client.0.smithi088.stdout:2/799: write d6/d20/d9a/fcb [5070881,15924] 0 2023-12-09T02:34:56.127 INFO:tasks.workunit.client.0.smithi088.stdout:9/891: mkdir df/d20/d4c/d84/d108/d12b 0 2023-12-09T02:34:56.128 INFO:tasks.workunit.client.0.smithi088.stdout:7/791: write dc/d21/d6b/d6d/da4/f3c [1212157,74261] 0 2023-12-09T02:34:56.128 INFO:tasks.workunit.client.0.smithi088.stdout:7/792: truncate dc/d21/d6b/f80 4678949 0 2023-12-09T02:34:56.129 INFO:tasks.workunit.client.0.smithi088.stdout:9/892: write df/d20/d30/d3f/d48/f45 [3255687,97722] 0 2023-12-09T02:34:56.130 INFO:tasks.workunit.client.0.smithi088.stdout:2/800: mkdir d6/d13/d18/d10a 0 2023-12-09T02:34:56.132 INFO:tasks.workunit.client.0.smithi088.stdout:9/893: mkdir df/d20/d30/d60/dca/dee/d113/d12c 0 2023-12-09T02:34:56.134 INFO:tasks.workunit.client.0.smithi088.stdout:9/894: link df/f112 df/d20/d5b/d91/f12d 0 2023-12-09T02:34:56.134 INFO:tasks.workunit.client.0.smithi088.stdout:9/895: dread - df/d20/d30/d60/d5c/db9/feb zero size 2023-12-09T02:34:56.136 INFO:tasks.workunit.client.0.smithi088.stdout:9/896: link df/f3d df/d20/d5b/d91/d10a/d101/f12e 0 2023-12-09T02:34:56.138 INFO:tasks.workunit.client.0.smithi088.stdout:7/793: dread dc/f43 [0,4194304] 0 2023-12-09T02:34:56.139 INFO:tasks.workunit.client.0.smithi088.stdout:7/794: mkdir dc/d21/d6b/d6d/da4/d10c 0 2023-12-09T02:34:56.143 INFO:tasks.workunit.client.0.smithi088.stdout:2/801: dread d6/d8/f1d [0,4194304] 0 2023-12-09T02:34:56.151 INFO:tasks.workunit.client.0.smithi088.stdout:2/802: write d6/d13/f1e [370767,57762] 0 2023-12-09T02:34:56.152 INFO:tasks.workunit.client.0.smithi088.stdout:2/803: getdents d6/d20/d3a 0 2023-12-09T02:34:56.153 INFO:tasks.workunit.client.0.smithi088.stdout:2/804: creat d6/d8/d1f/d22/d68/d100/f10b x:0 0 0 2023-12-09T02:34:56.158 INFO:tasks.workunit.client.0.smithi088.stdout:2/805: symlink d6/d13/dc6/l10c 0 2023-12-09T02:34:56.158 INFO:tasks.workunit.client.0.smithi088.stdout:2/806: fdatasync d6/d20/d3a/d84/fe6 0 2023-12-09T02:34:56.158 INFO:tasks.workunit.client.0.smithi088.stdout:9/897: dwrite df/d20/d5b/f7e [0,4194304] 0 2023-12-09T02:34:56.159 INFO:tasks.workunit.client.0.smithi088.stdout:2/807: mkdir d6/d8/d73/d78/d10d 0 2023-12-09T02:34:56.159 INFO:tasks.workunit.client.0.smithi088.stdout:2/808: truncate d6/d20/d3a/fb0 485698 0 2023-12-09T02:34:56.163 INFO:tasks.workunit.client.0.smithi088.stdout:7/795: dwrite dc/d21/d6b/d6d/f103 [0,4194304] 0 2023-12-09T02:34:56.165 INFO:tasks.workunit.client.0.smithi088.stdout:2/809: creat d6/d13/d18/f10e x:0 0 0 2023-12-09T02:34:56.170 INFO:tasks.workunit.client.0.smithi088.stdout:7/796: link dc/d21/d6b/d6d/da4/f5e dc/d21/db1/f10d 0 2023-12-09T02:34:56.172 INFO:tasks.workunit.client.0.smithi088.stdout:7/797: truncate dc/d21/d6b/d6d/da4/f3c 631038 0 2023-12-09T02:34:56.177 INFO:tasks.workunit.client.0.smithi088.stdout:4/828: sync 2023-12-09T02:34:56.177 INFO:tasks.workunit.client.0.smithi088.stdout:1/864: sync 2023-12-09T02:34:56.177 INFO:tasks.workunit.client.0.smithi088.stdout:6/777: sync 2023-12-09T02:34:56.177 INFO:tasks.workunit.client.0.smithi088.stdout:0/763: sync 2023-12-09T02:34:56.177 INFO:tasks.workunit.client.0.smithi088.stdout:4/829: dread - d3/f76 zero size 2023-12-09T02:34:56.178 INFO:tasks.workunit.client.0.smithi088.stdout:6/778: getdents d16/d1b/d25/d5f 0 2023-12-09T02:34:56.178 INFO:tasks.workunit.client.0.smithi088.stdout:9/898: dwrite df/d20/d30/d3f/d48/da7/f11a [0,4194304] 0 2023-12-09T02:34:56.180 INFO:tasks.workunit.client.0.smithi088.stdout:0/764: dread df/d28/d33/d81/ff6 [0,4194304] 0 2023-12-09T02:34:56.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/899: link df/d20/d4c/d84/fa8 df/d50/d63/f12f 0 2023-12-09T02:34:56.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/900: dread - df/d20/d30/d4e/f119 zero size 2023-12-09T02:34:56.183 INFO:tasks.workunit.client.0.smithi088.stdout:9/901: symlink df/d20/d30/d60/dca/l130 0 2023-12-09T02:34:56.185 INFO:tasks.workunit.client.0.smithi088.stdout:7/798: dread dc/d21/d6b/ff8 [0,4194304] 0 2023-12-09T02:34:56.185 INFO:tasks.workunit.client.0.smithi088.stdout:9/902: write df/d20/d30/f43 [2248704,118976] 0 2023-12-09T02:34:56.187 INFO:tasks.workunit.client.0.smithi088.stdout:2/810: dwrite d6/f39 [0,4194304] 0 2023-12-09T02:34:56.193 INFO:tasks.workunit.client.0.smithi088.stdout:2/811: dread d6/d8/d4e/f57 [0,4194304] 0 2023-12-09T02:34:56.195 INFO:tasks.workunit.client.0.smithi088.stdout:2/812: creat d6/d20/d3a/d82/d99/df2/f10f x:0 0 0 2023-12-09T02:34:56.198 INFO:tasks.workunit.client.0.smithi088.stdout:2/813: mknod d6/d20/d3a/c110 0 2023-12-09T02:34:56.200 INFO:tasks.workunit.client.0.smithi088.stdout:2/814: creat d6/d8/d1f/d22/d68/d100/f111 x:0 0 0 2023-12-09T02:34:56.200 INFO:tasks.workunit.client.0.smithi088.stdout:1/865: dread d8/d27/f112 [0,4194304] 0 2023-12-09T02:34:56.201 INFO:tasks.workunit.client.0.smithi088.stdout:7/799: dread dc/d21/d6b/d6d/da4/d3e/d97/fe3 [0,4194304] 0 2023-12-09T02:34:56.201 INFO:tasks.workunit.client.0.smithi088.stdout:7/800: write dc/d21/d6b/d6d/d76/db9/f109 [530162,8226] 0 2023-12-09T02:34:56.201 INFO:tasks.workunit.client.0.smithi088.stdout:2/815: creat d6/d20/d3a/d84/f112 x:0 0 0 2023-12-09T02:34:56.202 INFO:tasks.workunit.client.0.smithi088.stdout:1/866: symlink d8/d59/l125 0 2023-12-09T02:34:56.203 INFO:tasks.workunit.client.0.smithi088.stdout:7/801: mkdir dc/d21/d6b/d6d/da4/d10c/d10e 0 2023-12-09T02:34:56.204 INFO:tasks.workunit.client.0.smithi088.stdout:7/802: creat dc/d21/d6b/d6d/da4/d38/f10f x:0 0 0 2023-12-09T02:34:56.205 INFO:tasks.workunit.client.0.smithi088.stdout:1/867: unlink d8/d3d/d44/l73 0 2023-12-09T02:34:56.206 INFO:tasks.workunit.client.0.smithi088.stdout:7/803: getdents dc/d21/d6b/d6d/d76 0 2023-12-09T02:34:56.207 INFO:tasks.workunit.client.0.smithi088.stdout:1/868: mknod d8/d27/d66/d79/c126 0 2023-12-09T02:34:56.207 INFO:tasks.workunit.client.0.smithi088.stdout:6/779: dwrite d16/f39 [0,4194304] 0 2023-12-09T02:34:56.207 INFO:tasks.workunit.client.0.smithi088.stdout:6/780: fsync d16/d1b/d25/f3d 0 2023-12-09T02:34:56.209 INFO:tasks.workunit.client.0.smithi088.stdout:1/869: mknod d8/d1c/d50/d6c/c127 0 2023-12-09T02:34:56.211 INFO:tasks.workunit.client.0.smithi088.stdout:0/765: dwrite fc [4194304,4194304] 0 2023-12-09T02:34:56.211 INFO:tasks.workunit.client.0.smithi088.stdout:0/766: chown df/d28/d43/f49 20067347 1 2023-12-09T02:34:56.211 INFO:tasks.workunit.client.0.smithi088.stdout:0/767: dread - df/d10/d22/d5f/fbb zero size 2023-12-09T02:34:56.211 INFO:tasks.workunit.client.0.smithi088.stdout:6/781: rename d16/d35/d36/d97/d90/fbf to d16/d1b/d2c/d3f/d41/fe0 0 2023-12-09T02:34:56.214 INFO:tasks.workunit.client.0.smithi088.stdout:6/782: creat d16/d62/da7/da9/dd9/fe1 x:0 0 0 2023-12-09T02:34:56.218 INFO:tasks.workunit.client.0.smithi088.stdout:1/870: dread d8/d3d/d5d/d95/dac/fb4 [0,4194304] 0 2023-12-09T02:34:56.219 INFO:tasks.workunit.client.0.smithi088.stdout:1/871: readlink d8/d59/ldd 0 2023-12-09T02:34:56.219 INFO:tasks.workunit.client.0.smithi088.stdout:1/872: write d8/d53/f89 [1434925,17062] 0 2023-12-09T02:34:56.220 INFO:tasks.workunit.client.0.smithi088.stdout:1/873: stat d8/d3d/d5d 0 2023-12-09T02:34:56.220 INFO:tasks.workunit.client.0.smithi088.stdout:1/874: fsync d8/d3d/d5d/d95/f5b 0 2023-12-09T02:34:56.221 INFO:tasks.workunit.client.0.smithi088.stdout:9/903: dwrite df/d20/d30/d60/f62 [0,4194304] 0 2023-12-09T02:34:56.223 INFO:tasks.workunit.client.0.smithi088.stdout:1/875: dread d8/d1b/d6d/d7c/fbe [0,4194304] 0 2023-12-09T02:34:56.223 INFO:tasks.workunit.client.0.smithi088.stdout:1/876: stat d8/d1c/dc9 0 2023-12-09T02:34:56.223 INFO:tasks.workunit.client.0.smithi088.stdout:1/877: write d8/d1b/d1d/ddf/f102 [903269,43456] 0 2023-12-09T02:34:56.224 INFO:tasks.workunit.client.0.smithi088.stdout:2/816: dwrite d6/d8/d54/f65 [0,4194304] 0 2023-12-09T02:34:56.226 INFO:tasks.workunit.client.0.smithi088.stdout:1/878: symlink d8/d1c/d50/l128 0 2023-12-09T02:34:56.226 INFO:tasks.workunit.client.0.smithi088.stdout:9/904: creat df/d20/d30/d60/dca/dee/d113/d12c/f131 x:0 0 0 2023-12-09T02:34:56.226 INFO:tasks.workunit.client.0.smithi088.stdout:9/905: chown df/d20/d5b/d91/d10a/d101 186625444 1 2023-12-09T02:34:56.226 INFO:tasks.workunit.client.0.smithi088.stdout:9/906: write df/d20/d30/d60/dc9/dda/f128 [836087,55072] 0 2023-12-09T02:34:56.227 INFO:tasks.workunit.client.0.smithi088.stdout:1/879: symlink d8/d3d/d44/da4/l129 0 2023-12-09T02:34:56.228 INFO:tasks.workunit.client.0.smithi088.stdout:7/804: getdents dc/d21/d6b/d6d/da4/d38 0 2023-12-09T02:34:56.230 INFO:tasks.workunit.client.0.smithi088.stdout:9/907: symlink df/d20/d4c/d84/d108/l132 0 2023-12-09T02:34:56.231 INFO:tasks.workunit.client.0.smithi088.stdout:1/880: creat d8/d3d/d5d/d95/f12a x:0 0 0 2023-12-09T02:34:56.232 INFO:tasks.workunit.client.0.smithi088.stdout:1/881: write d8/d27/d75/fcc [1181129,5503] 0 2023-12-09T02:34:56.233 INFO:tasks.workunit.client.0.smithi088.stdout:7/805: mkdir dc/d21/d7f/d110 0 2023-12-09T02:34:56.233 INFO:tasks.workunit.client.0.smithi088.stdout:7/806: fdatasync dc/d1b/de4/fed 0 2023-12-09T02:34:56.234 INFO:tasks.workunit.client.0.smithi088.stdout:9/908: creat df/d20/d4c/d84/dcd/f133 x:0 0 0 2023-12-09T02:34:56.235 INFO:tasks.workunit.client.0.smithi088.stdout:1/882: mknod d8/d1b/d6d/d7c/c12b 0 2023-12-09T02:34:56.235 INFO:tasks.workunit.client.0.smithi088.stdout:3/748: sync 2023-12-09T02:34:56.235 INFO:tasks.workunit.client.0.smithi088.stdout:8/877: sync 2023-12-09T02:34:56.236 INFO:tasks.workunit.client.0.smithi088.stdout:0/768: dwrite df/d28/f95 [0,4194304] 0 2023-12-09T02:34:56.237 INFO:tasks.workunit.client.0.smithi088.stdout:7/807: link dc/d1b/d66/f8e dc/d1b/d91/f111 0 2023-12-09T02:34:56.240 INFO:tasks.workunit.client.0.smithi088.stdout:1/883: rmdir d8/d27/d40 39 2023-12-09T02:34:56.242 INFO:tasks.workunit.client.0.smithi088.stdout:8/878: truncate d2/d9/d1a/d62/d9a/f10e 1050096 0 2023-12-09T02:34:56.245 INFO:tasks.workunit.client.0.smithi088.stdout:7/808: symlink dc/d21/d6b/d9b/l112 0 2023-12-09T02:34:56.246 INFO:tasks.workunit.client.0.smithi088.stdout:1/884: creat d8/d1c/d50/f12c x:0 0 0 2023-12-09T02:34:56.246 INFO:tasks.workunit.client.0.smithi088.stdout:1/885: fsync d8/d3d/d44/da4/dcb/de3/f101 0 2023-12-09T02:34:56.247 INFO:tasks.workunit.client.0.smithi088.stdout:3/749: symlink d1/d9/d6f/d22/d7f/d45/lf9 0 2023-12-09T02:34:56.247 INFO:tasks.workunit.client.0.smithi088.stdout:2/817: dwrite d6/d13/d42/fa3 [0,4194304] 0 2023-12-09T02:34:56.248 INFO:tasks.workunit.client.0.smithi088.stdout:2/818: chown d6/d8/d4e/c81 0 1 2023-12-09T02:34:56.248 INFO:tasks.workunit.client.0.smithi088.stdout:8/879: creat d2/d9/d1a/f11f x:0 0 0 2023-12-09T02:34:56.251 INFO:tasks.workunit.client.0.smithi088.stdout:3/750: dread d1/d9/d6f/d6/d83/f8c [0,4194304] 0 2023-12-09T02:34:56.251 INFO:tasks.workunit.client.0.smithi088.stdout:3/751: stat d1/d9/d6f/d2d/d66/ce9 0 2023-12-09T02:34:56.251 INFO:tasks.workunit.client.0.smithi088.stdout:3/752: fsync d1/d9/d6f/d22/d7f/d45/fc8 0 2023-12-09T02:34:56.251 INFO:tasks.workunit.client.0.smithi088.stdout:3/753: chown d1/d9/d6f/d6/d4a/d41/d33/d49/f4f 41365848 1 2023-12-09T02:34:56.252 INFO:tasks.workunit.client.0.smithi088.stdout:0/769: dwrite df/d28/d34/fd6 [0,4194304] 0 2023-12-09T02:34:56.252 INFO:tasks.workunit.client.0.smithi088.stdout:0/770: fdatasync df/d10/f69 0 2023-12-09T02:34:56.252 INFO:tasks.workunit.client.0.smithi088.stdout:0/771: truncate df/dd0/df5/ffa 12215 0 2023-12-09T02:34:56.252 INFO:tasks.workunit.client.0.smithi088.stdout:0/772: fsync df/d10/d22/d5f/fae 0 2023-12-09T02:34:56.252 INFO:tasks.workunit.client.0.smithi088.stdout:0/773: read - df/d10/d22/d2d/d96/fe3 zero size 2023-12-09T02:34:56.253 INFO:tasks.workunit.client.0.smithi088.stdout:9/909: rename df/d20/d4c/d84/d108 to df/d20/d4c/d97/d134 0 2023-12-09T02:34:56.253 INFO:tasks.workunit.client.0.smithi088.stdout:7/809: rename dc to dc/d21/d113 22 2023-12-09T02:34:56.253 INFO:tasks.workunit.client.0.smithi088.stdout:3/754: dread d1/d9/d6f/d2d/dab/dc5/dc9/dce/f76 [0,4194304] 0 2023-12-09T02:34:56.253 INFO:tasks.workunit.client.0.smithi088.stdout:7/810: read dc/fc3 [13484,14465] 0 2023-12-09T02:34:56.259 INFO:tasks.workunit.client.0.smithi088.stdout:2/819: symlink d6/d20/d3a/d82/l113 0 2023-12-09T02:34:56.263 INFO:tasks.workunit.client.0.smithi088.stdout:8/880: read d2/f28 [529257,13985] 0 2023-12-09T02:34:56.264 INFO:tasks.workunit.client.0.smithi088.stdout:9/910: mkdir df/d29/d2f/da2/def/d135 0 2023-12-09T02:34:56.265 INFO:tasks.workunit.client.0.smithi088.stdout:3/755: mknod d1/d9/d6f/d15/cfa 0 2023-12-09T02:34:56.265 INFO:tasks.workunit.client.0.smithi088.stdout:3/756: fsync d1/d9/d6f/d6/d4a/d41/d33/f63 0 2023-12-09T02:34:56.265 INFO:tasks.workunit.client.0.smithi088.stdout:3/757: stat d1/d9/d6f/d22/d7f/d81 0 2023-12-09T02:34:56.265 INFO:tasks.workunit.client.0.smithi088.stdout:3/758: write d1/d9/d6f/d22/f8a [5095507,110401] 0 2023-12-09T02:34:56.266 INFO:tasks.workunit.client.0.smithi088.stdout:7/811: symlink dc/d1b/d91/dd2/l114 0 2023-12-09T02:34:56.266 INFO:tasks.workunit.client.0.smithi088.stdout:7/812: chown dc/d21/d6b/d6d/da4/d38/c2d 708846 1 2023-12-09T02:34:56.266 INFO:tasks.workunit.client.0.smithi088.stdout:7/813: write dc/d21/d6b/d6d/da4/d5d/f107 [786725,86618] 0 2023-12-09T02:34:56.266 INFO:tasks.workunit.client.0.smithi088.stdout:7/814: fdatasync dc/d1b/f4b 0 2023-12-09T02:34:56.266 INFO:tasks.workunit.client.0.smithi088.stdout:7/815: chown dc/d21/d6b/ffc 10735043 1 2023-12-09T02:34:56.267 INFO:tasks.workunit.client.0.smithi088.stdout:1/886: mkdir d8/d3d/d44/d49/d12d 0 2023-12-09T02:34:56.267 INFO:tasks.workunit.client.0.smithi088.stdout:7/816: write dc/d1b/d91/f111 [1242584,74803] 0 2023-12-09T02:34:56.268 INFO:tasks.workunit.client.0.smithi088.stdout:7/817: read dc/f43 [3401783,9768] 0 2023-12-09T02:34:56.268 INFO:tasks.workunit.client.0.smithi088.stdout:0/774: dwrite df/dd0/df5/ffa [0,4194304] 0 2023-12-09T02:34:56.268 INFO:tasks.workunit.client.0.smithi088.stdout:0/775: write df/d37/ffc [543010,44400] 0 2023-12-09T02:34:56.268 INFO:tasks.workunit.client.0.smithi088.stdout:2/820: mknod d6/d8/d4e/d47/c114 0 2023-12-09T02:34:56.269 INFO:tasks.workunit.client.0.smithi088.stdout:8/881: mkdir d2/d9/d70/d8f/da8/d119/d120 0 2023-12-09T02:34:56.271 INFO:tasks.workunit.client.0.smithi088.stdout:9/911: symlink df/d20/d30/l136 0 2023-12-09T02:34:56.273 INFO:tasks.workunit.client.0.smithi088.stdout:3/759: getdents d1/d9/d6f/d2d/dab/dc5/dc9/dce 0 2023-12-09T02:34:56.274 INFO:tasks.workunit.client.0.smithi088.stdout:1/887: readlink d8/l18 0 2023-12-09T02:34:56.274 INFO:tasks.workunit.client.0.smithi088.stdout:1/888: readlink d8/d27/d66/d79/lf6 0 2023-12-09T02:34:56.275 INFO:tasks.workunit.client.0.smithi088.stdout:2/821: dread d6/d20/d3a/fea [0,4194304] 0 2023-12-09T02:34:56.277 INFO:tasks.workunit.client.0.smithi088.stdout:2/822: write d6/d20/d9a/fcb [1456735,102951] 0 2023-12-09T02:34:56.277 INFO:tasks.workunit.client.0.smithi088.stdout:2/823: stat d6/d20/d3d/f61 0 2023-12-09T02:34:56.280 INFO:tasks.workunit.client.0.smithi088.stdout:7/818: creat dc/d21/d7f/d110/f115 x:0 0 0 2023-12-09T02:34:56.281 INFO:tasks.workunit.client.0.smithi088.stdout:0/776: creat df/d37/ffe x:0 0 0 2023-12-09T02:34:56.282 INFO:tasks.workunit.client.0.smithi088.stdout:0/777: write df/d28/d34/f48 [2152278,95844] 0 2023-12-09T02:34:56.282 INFO:tasks.workunit.client.0.smithi088.stdout:9/912: unlink df/d20/d5b/d91/d10a/d101/l106 0 2023-12-09T02:34:56.285 INFO:tasks.workunit.client.0.smithi088.stdout:1/889: creat d8/d3d/d5d/d95/dac/db9/f12e x:0 0 0 2023-12-09T02:34:56.288 INFO:tasks.workunit.client.0.smithi088.stdout:2/824: creat d6/d20/d3a/d94/dad/ddb/dde/f115 x:0 0 0 2023-12-09T02:34:56.290 INFO:tasks.workunit.client.0.smithi088.stdout:3/760: dwrite d1/d9/d6f/d22/d7f/d81/d85/fb3 [0,4194304] 0 2023-12-09T02:34:56.290 INFO:tasks.workunit.client.0.smithi088.stdout:0/778: creat df/d28/d33/daf/fff x:0 0 0 2023-12-09T02:34:56.290 INFO:tasks.workunit.client.0.smithi088.stdout:0/779: truncate df/d37/d70/db8/ff7 603081 0 2023-12-09T02:34:56.291 INFO:tasks.workunit.client.0.smithi088.stdout:0/780: dread - df/d10/d22/d5f/fae zero size 2023-12-09T02:34:56.291 INFO:tasks.workunit.client.0.smithi088.stdout:0/781: fdatasync df/d37/ffc 0 2023-12-09T02:34:56.291 INFO:tasks.workunit.client.0.smithi088.stdout:7/819: dread dc/d1b/d91/dfe/fe8 [0,4194304] 0 2023-12-09T02:34:56.293 INFO:tasks.workunit.client.0.smithi088.stdout:1/890: getdents d8/d1b/d6d 0 2023-12-09T02:34:56.293 INFO:tasks.workunit.client.0.smithi088.stdout:5/847: sync 2023-12-09T02:34:56.293 INFO:tasks.workunit.client.0.smithi088.stdout:1/891: fdatasync d8/d27/d9a/fa3 0 2023-12-09T02:34:56.294 INFO:tasks.workunit.client.0.smithi088.stdout:2/825: symlink d6/d8/d73/d78/d10d/l116 0 2023-12-09T02:34:56.294 INFO:tasks.workunit.client.0.smithi088.stdout:2/826: chown d6/d8/d4e/d64/f75 263929240 1 2023-12-09T02:34:56.294 INFO:tasks.workunit.client.0.smithi088.stdout:2/827: write d6/d8/d1f/d22/f38 [4878713,39928] 0 2023-12-09T02:34:56.299 INFO:tasks.workunit.client.0.smithi088.stdout:3/761: link d1/d9/d6f/d22/d7f/d81/d85/dcb/le8 d1/d9/d6f/d6/d83/lfb 0 2023-12-09T02:34:56.299 INFO:tasks.workunit.client.0.smithi088.stdout:1/892: write d8/f34 [63764,67990] 0 2023-12-09T02:34:56.299 INFO:tasks.workunit.client.0.smithi088.stdout:5/848: write d3/d15/de/d10/d51/d7f/fec [1893588,47306] 0 2023-12-09T02:34:56.303 INFO:tasks.workunit.client.0.smithi088.stdout:2/828: symlink d6/d20/d3a/d82/d99/l117 0 2023-12-09T02:34:56.303 INFO:tasks.workunit.client.0.smithi088.stdout:2/829: chown d6/d20/d9a/dfb 323 1 2023-12-09T02:34:56.303 INFO:tasks.workunit.client.0.smithi088.stdout:1/893: truncate d8/f38 876926 0 2023-12-09T02:34:56.307 INFO:tasks.workunit.client.0.smithi088.stdout:5/849: mknod d3/d15/de/d73/c11d 0 2023-12-09T02:34:56.307 INFO:tasks.workunit.client.0.smithi088.stdout:7/820: dwrite dc/d21/d6b/d6d/f7e [0,4194304] 0 2023-12-09T02:34:56.307 INFO:tasks.workunit.client.0.smithi088.stdout:0/782: dread df/d10/d22/fb3 [0,4194304] 0 2023-12-09T02:34:56.308 INFO:tasks.workunit.client.0.smithi088.stdout:2/830: link d6/d8/d1f/l49 d6/d20/d3a/l118 0 2023-12-09T02:34:56.309 INFO:tasks.workunit.client.0.smithi088.stdout:0/783: dread df/d28/d33/d81/ff6 [0,4194304] 0 2023-12-09T02:34:56.309 INFO:tasks.workunit.client.0.smithi088.stdout:0/784: chown df/d10/laa 12967 1 2023-12-09T02:34:56.310 INFO:tasks.workunit.client.0.smithi088.stdout:5/850: mknod d3/d15/de/d10/d18/d19/d1b/c11e 0 2023-12-09T02:34:56.311 INFO:tasks.workunit.client.0.smithi088.stdout:9/913: dwrite df/d20/d30/d60/d5c/f1e [0,4194304] 0 2023-12-09T02:34:56.313 INFO:tasks.workunit.client.0.smithi088.stdout:7/821: getdents dc/d21/d6b/d9b 0 2023-12-09T02:34:56.313 INFO:tasks.workunit.client.0.smithi088.stdout:7/822: chown dc/d21/d6b/ffc 0 1 2023-12-09T02:34:56.313 INFO:tasks.workunit.client.0.smithi088.stdout:7/823: chown dc/d21/d6b/d6d/da4/lc6 1652236411 1 2023-12-09T02:34:56.315 INFO:tasks.workunit.client.0.smithi088.stdout:2/831: creat d6/d20/d3a/d82/d99/df2/f119 x:0 0 0 2023-12-09T02:34:56.315 INFO:tasks.workunit.client.0.smithi088.stdout:2/832: chown d6/d20/d3a/d84/f112 1 1 2023-12-09T02:34:56.315 INFO:tasks.workunit.client.0.smithi088.stdout:2/833: read d6/d20/d3a/d84/fcf [1951198,9242] 0 2023-12-09T02:34:56.317 INFO:tasks.workunit.client.0.smithi088.stdout:5/851: mknod d3/d15/dc/d14/c11f 0 2023-12-09T02:34:56.319 INFO:tasks.workunit.client.0.smithi088.stdout:7/824: rmdir dc/d21/d6b/d6d/da4/d5d 39 2023-12-09T02:34:56.321 INFO:tasks.workunit.client.0.smithi088.stdout:5/852: mkdir d3/d15/d120 0 2023-12-09T02:34:56.323 INFO:tasks.workunit.client.0.smithi088.stdout:7/825: symlink dc/d1b/d72/dec/l116 0 2023-12-09T02:34:56.325 INFO:tasks.workunit.client.0.smithi088.stdout:7/826: creat dc/d1b/de4/f117 x:0 0 0 2023-12-09T02:34:56.327 INFO:tasks.workunit.client.0.smithi088.stdout:7/827: creat dc/d1b/d91/dfe/f118 x:0 0 0 2023-12-09T02:34:56.330 INFO:tasks.workunit.client.0.smithi088.stdout:1/894: dwrite d8/d59/feb [0,4194304] 0 2023-12-09T02:34:56.334 INFO:tasks.workunit.client.0.smithi088.stdout:7/828: write dc/d21/d6b/f80 [3053704,110105] 0 2023-12-09T02:34:56.336 INFO:tasks.workunit.client.0.smithi088.stdout:7/829: creat dc/d1b/d72/dc4/f119 x:0 0 0 2023-12-09T02:34:56.338 INFO:tasks.workunit.client.0.smithi088.stdout:7/830: unlink dc/d21/d6b/d6d/da4/d38/d1e/f60 0 2023-12-09T02:34:56.339 INFO:tasks.workunit.client.0.smithi088.stdout:7/831: creat dc/d1b/d72/dc4/f11a x:0 0 0 2023-12-09T02:34:56.361 INFO:tasks.workunit.client.0.smithi088.stdout:9/914: dwrite df/d29/f6a [8388608,4194304] 0 2023-12-09T02:34:56.361 INFO:tasks.workunit.client.0.smithi088.stdout:0/785: dwrite df/d37/de2/f91 [0,4194304] 0 2023-12-09T02:34:56.361 INFO:tasks.workunit.client.0.smithi088.stdout:0/786: write df/d10/d22/d2d/f8d [20378,39141] 0 2023-12-09T02:34:56.364 INFO:tasks.workunit.client.0.smithi088.stdout:0/787: mkdir df/d10/d22/d100 0 2023-12-09T02:34:56.364 INFO:tasks.workunit.client.0.smithi088.stdout:0/788: fsync df/d37/ffc 0 2023-12-09T02:34:56.364 INFO:tasks.workunit.client.0.smithi088.stdout:0/789: chown df/l85 12098042 1 2023-12-09T02:34:56.365 INFO:tasks.workunit.client.0.smithi088.stdout:0/790: mknod df/d37/de2/c101 0 2023-12-09T02:34:56.366 INFO:tasks.workunit.client.0.smithi088.stdout:0/791: mknod df/d10/d22/d2d/d6a/deb/c102 0 2023-12-09T02:34:56.368 INFO:tasks.workunit.client.0.smithi088.stdout:1/895: dwrite d8/d1b/d1d/dc7/ffc [0,4194304] 0 2023-12-09T02:34:56.368 INFO:tasks.workunit.client.0.smithi088.stdout:7/832: dwrite dc/d21/d6b/d9b/fbf [0,4194304] 0 2023-12-09T02:34:56.368 INFO:tasks.workunit.client.0.smithi088.stdout:7/833: dread - dc/d1b/d91/dfe/f118 zero size 2023-12-09T02:34:56.368 INFO:tasks.workunit.client.0.smithi088.stdout:2/834: dwrite d6/d8/d4e/d64/f66 [0,4194304] 0 2023-12-09T02:34:56.368 INFO:tasks.workunit.client.0.smithi088.stdout:0/792: symlink df/l103 0 2023-12-09T02:34:56.371 INFO:tasks.workunit.client.0.smithi088.stdout:2/835: dread d6/d13/f33 [0,4194304] 0 2023-12-09T02:34:56.372 INFO:tasks.workunit.client.0.smithi088.stdout:0/793: creat df/d28/df3/f104 x:0 0 0 2023-12-09T02:34:56.372 INFO:tasks.workunit.client.0.smithi088.stdout:2/836: dread d6/d8/f46 [0,4194304] 0 2023-12-09T02:34:56.372 INFO:tasks.workunit.client.0.smithi088.stdout:2/837: fdatasync d6/d8/d1f/f3b 0 2023-12-09T02:34:56.375 INFO:tasks.workunit.client.0.smithi088.stdout:2/838: mkdir d6/d8/d1f/d11a 0 2023-12-09T02:34:56.377 INFO:tasks.workunit.client.0.smithi088.stdout:2/839: creat d6/d8/d1f/f11b x:0 0 0 2023-12-09T02:34:56.377 INFO:tasks.workunit.client.0.smithi088.stdout:2/840: rename d6 to d6/d8/deb/d11c 22 2023-12-09T02:34:56.379 INFO:tasks.workunit.client.0.smithi088.stdout:2/841: mkdir d6/d20/d11d 0 2023-12-09T02:34:56.381 INFO:tasks.workunit.client.0.smithi088.stdout:2/842: mknod d6/d8/d4e/da2/db8/dfc/db4/d106/c11e 0 2023-12-09T02:34:56.384 INFO:tasks.workunit.client.0.smithi088.stdout:2/843: creat d6/de3/f11f x:0 0 0 2023-12-09T02:34:56.386 INFO:tasks.workunit.client.0.smithi088.stdout:2/844: creat d6/d13/d42/d89/f120 x:0 0 0 2023-12-09T02:34:56.393 INFO:tasks.workunit.client.0.smithi088.stdout:0/794: dwrite df/f25 [0,4194304] 0 2023-12-09T02:34:56.394 INFO:tasks.workunit.client.0.smithi088.stdout:1/896: dwrite d8/d53/f89 [4194304,4194304] 0 2023-12-09T02:34:56.394 INFO:tasks.workunit.client.0.smithi088.stdout:1/897: chown d8/d1b/d1d/ddf/f120 53250 1 2023-12-09T02:34:56.396 INFO:tasks.workunit.client.0.smithi088.stdout:0/795: creat df/d37/d97/f105 x:0 0 0 2023-12-09T02:34:56.398 INFO:tasks.workunit.client.0.smithi088.stdout:1/898: mkdir d8/d59/d12f 0 2023-12-09T02:34:56.399 INFO:tasks.workunit.client.0.smithi088.stdout:9/915: dwrite df/d20/d5b/ff3 [0,4194304] 0 2023-12-09T02:34:56.399 INFO:tasks.workunit.client.0.smithi088.stdout:2/845: dread d6/f12 [0,4194304] 0 2023-12-09T02:34:56.399 INFO:tasks.workunit.client.0.smithi088.stdout:9/916: truncate df/d20/d30/d60/d5c/fed 5171626 0 2023-12-09T02:34:56.399 INFO:tasks.workunit.client.0.smithi088.stdout:9/917: dread - df/d50/f115 zero size 2023-12-09T02:34:56.399 INFO:tasks.workunit.client.0.smithi088.stdout:0/796: creat df/f106 x:0 0 0 2023-12-09T02:34:56.400 INFO:tasks.workunit.client.0.smithi088.stdout:1/899: creat d8/d1b/d6d/df2/f130 x:0 0 0 2023-12-09T02:34:56.401 INFO:tasks.workunit.client.0.smithi088.stdout:1/900: dread - d8/d1b/d1d/f96 zero size 2023-12-09T02:34:56.401 INFO:tasks.workunit.client.0.smithi088.stdout:1/901: fdatasync d8/f3e 0 2023-12-09T02:34:56.401 INFO:tasks.workunit.client.0.smithi088.stdout:1/902: chown d8/d1c/d50/f7f 99093025 1 2023-12-09T02:34:56.401 INFO:tasks.workunit.client.0.smithi088.stdout:1/903: readlink d8/d1b/d1d/l25 0 2023-12-09T02:34:56.401 INFO:tasks.workunit.client.0.smithi088.stdout:4/830: sync 2023-12-09T02:34:56.401 INFO:tasks.workunit.client.0.smithi088.stdout:6/783: sync 2023-12-09T02:34:56.403 INFO:tasks.workunit.client.0.smithi088.stdout:9/918: rename df/d20/d30/d4e/l102 to df/d29/d2f/da2/def/d135/l137 0 2023-12-09T02:34:56.403 INFO:tasks.workunit.client.0.smithi088.stdout:0/797: truncate df/d10/d22/fb3 612919 0 2023-12-09T02:34:56.405 INFO:tasks.workunit.client.0.smithi088.stdout:1/904: creat d8/d3d/d44/da4/dcb/de2/f131 x:0 0 0 2023-12-09T02:34:56.407 INFO:tasks.workunit.client.0.smithi088.stdout:4/831: symlink d3/dc/d1d/d40/ddf/l10d 0 2023-12-09T02:34:56.408 INFO:tasks.workunit.client.0.smithi088.stdout:9/919: dread df/d20/d30/d60/d5c/f47 [0,4194304] 0 2023-12-09T02:34:56.408 INFO:tasks.workunit.client.0.smithi088.stdout:9/920: fsync df/d50/f58 0 2023-12-09T02:34:56.408 INFO:tasks.workunit.client.0.smithi088.stdout:6/784: creat d16/d35/d36/dc6/fe2 x:0 0 0 2023-12-09T02:34:56.411 INFO:tasks.workunit.client.0.smithi088.stdout:0/798: truncate df/d28/d43/f49 2455224 0 2023-12-09T02:34:56.415 INFO:tasks.workunit.client.0.smithi088.stdout:1/905: symlink d8/d27/d75/l132 0 2023-12-09T02:34:56.417 INFO:tasks.workunit.client.0.smithi088.stdout:0/799: mkdir df/d28/d33/d81/d107 0 2023-12-09T02:34:56.420 INFO:tasks.workunit.client.0.smithi088.stdout:0/800: mkdir df/d28/d34/dc8/d108 0 2023-12-09T02:34:56.420 INFO:tasks.workunit.client.0.smithi088.stdout:2/846: dwrite d6/d13/db3/fb6 [0,4194304] 0 2023-12-09T02:34:56.420 INFO:tasks.workunit.client.0.smithi088.stdout:6/785: dread d16/d1b/f22 [0,4194304] 0 2023-12-09T02:34:56.422 INFO:tasks.workunit.client.0.smithi088.stdout:0/801: truncate df/f57 691806 0 2023-12-09T02:34:56.422 INFO:tasks.workunit.client.0.smithi088.stdout:0/802: fsync df/d10/d22/d5f/fc6 0 2023-12-09T02:34:56.423 INFO:tasks.workunit.client.0.smithi088.stdout:6/786: truncate d16/d35/d65/fc0 3993977 0 2023-12-09T02:34:56.424 INFO:tasks.workunit.client.0.smithi088.stdout:2/847: mkdir d6/d8/d73/d78/d121 0 2023-12-09T02:34:56.428 INFO:tasks.workunit.client.0.smithi088.stdout:6/787: rename d16/d1b/d25/l2e to d16/d62/da7/da9/le3 0 2023-12-09T02:34:56.429 INFO:tasks.workunit.client.0.smithi088.stdout:6/788: truncate d16/d35/d65/fb2 494815 0 2023-12-09T02:34:56.429 INFO:tasks.workunit.client.0.smithi088.stdout:8/882: sync 2023-12-09T02:34:56.429 INFO:tasks.workunit.client.0.smithi088.stdout:2/848: dread d6/d20/d3a/d94/f9d [0,4194304] 0 2023-12-09T02:34:56.430 INFO:tasks.workunit.client.0.smithi088.stdout:6/789: unlink d16/d1b/d25/d5f/f6e 0 2023-12-09T02:34:56.431 INFO:tasks.workunit.client.0.smithi088.stdout:2/849: write d6/f12 [2526080,126415] 0 2023-12-09T02:34:56.431 INFO:tasks.workunit.client.0.smithi088.stdout:2/850: truncate d6/d8/d1f/d22/d68/d100/f10b 822822 0 2023-12-09T02:34:56.431 INFO:tasks.workunit.client.0.smithi088.stdout:2/851: chown d6/d8/d4e/d64/f66 59 1 2023-12-09T02:34:56.432 INFO:tasks.workunit.client.0.smithi088.stdout:9/921: dwrite df/d20/d30/d3f/d48/fa4 [0,4194304] 0 2023-12-09T02:34:56.432 INFO:tasks.workunit.client.0.smithi088.stdout:9/922: chown df/d20/d30/d60/d5c/f23 8030 1 2023-12-09T02:34:56.432 INFO:tasks.workunit.client.0.smithi088.stdout:4/832: dwrite d3/dc/d43/d8c/d95/f51 [0,4194304] 0 2023-12-09T02:34:56.432 INFO:tasks.workunit.client.0.smithi088.stdout:9/923: stat df/d20/d30/d60/dc9/dda/le5 0 2023-12-09T02:34:56.432 INFO:tasks.workunit.client.0.smithi088.stdout:4/833: chown d3/dc/d43/d8c/f9b 571404 1 2023-12-09T02:34:56.432 INFO:tasks.workunit.client.0.smithi088.stdout:9/924: dread - df/d20/d30/d3f/d48/fe0 zero size 2023-12-09T02:34:56.432 INFO:tasks.workunit.client.0.smithi088.stdout:8/883: link d2/d9/d13/d1c/d3b/cae d2/d9/d70/d8f/da8/d119/d120/c121 0 2023-12-09T02:34:56.432 INFO:tasks.workunit.client.0.smithi088.stdout:8/884: truncate d2/d9/d70/f109 72578 0 2023-12-09T02:34:56.433 INFO:tasks.workunit.client.0.smithi088.stdout:6/790: mkdir d16/d1b/d2c/d3f/d83/de4 0 2023-12-09T02:34:56.433 INFO:tasks.workunit.client.0.smithi088.stdout:4/834: dread d3/d65/f79 [0,4194304] 0 2023-12-09T02:34:56.434 INFO:tasks.workunit.client.0.smithi088.stdout:2/852: truncate d6/d8/d4e/da2/fc1 607286 0 2023-12-09T02:34:56.435 INFO:tasks.workunit.client.0.smithi088.stdout:0/803: dread df/d10/d22/d2d/d2e/fb5 [4194304,4194304] 0 2023-12-09T02:34:56.435 INFO:tasks.workunit.client.0.smithi088.stdout:1/906: dwrite d8/d1c/d50/f12c [0,4194304] 0 2023-12-09T02:34:56.435 INFO:tasks.workunit.client.0.smithi088.stdout:9/925: write df/d29/d2f/f37 [2431700,126227] 0 2023-12-09T02:34:56.438 INFO:tasks.workunit.client.0.smithi088.stdout:4/835: mknod d3/dc/d18/d29/da4/c10e 0 2023-12-09T02:34:56.438 INFO:tasks.workunit.client.0.smithi088.stdout:4/836: chown d3/d65/de4 195 1 2023-12-09T02:34:56.438 INFO:tasks.workunit.client.0.smithi088.stdout:4/837: write d3/dc/d18/d29/fb8 [4983125,70876] 0 2023-12-09T02:34:56.439 INFO:tasks.workunit.client.0.smithi088.stdout:2/853: getdents d6/d13/d42 0 2023-12-09T02:34:56.440 INFO:tasks.workunit.client.0.smithi088.stdout:2/854: write d6/d20/d3d/f83 [3367517,121948] 0 2023-12-09T02:34:56.440 INFO:tasks.workunit.client.0.smithi088.stdout:2/855: chown d6/d8/d1f/d22/f38 38101 1 2023-12-09T02:34:56.442 INFO:tasks.workunit.client.0.smithi088.stdout:8/885: dread d2/d10f/f18 [0,4194304] 0 2023-12-09T02:34:56.447 INFO:tasks.workunit.client.0.smithi088.stdout:0/804: creat df/d28/d34/dc8/f109 x:0 0 0 2023-12-09T02:34:56.448 INFO:tasks.workunit.client.0.smithi088.stdout:1/907: mknod d8/d3d/d5d/c133 0 2023-12-09T02:34:56.450 INFO:tasks.workunit.client.0.smithi088.stdout:9/926: getdents df/d20/d4c/d97/d134 0 2023-12-09T02:34:56.450 INFO:tasks.workunit.client.0.smithi088.stdout:9/927: chown df/d20/d30/d60/dca/dee 394358418 1 2023-12-09T02:34:56.450 INFO:tasks.workunit.client.0.smithi088.stdout:9/928: chown df/d20/d30/d60/dc9/dda/de2/ff5 518 1 2023-12-09T02:34:56.450 INFO:tasks.workunit.client.0.smithi088.stdout:1/908: dread d8/d1c/f86 [0,4194304] 0 2023-12-09T02:34:56.451 INFO:tasks.workunit.client.0.smithi088.stdout:1/909: write d8/f15 [2314776,25534] 0 2023-12-09T02:34:56.451 INFO:tasks.workunit.client.0.smithi088.stdout:4/838: creat d3/dc/d43/d8c/d95/f10f x:0 0 0 2023-12-09T02:34:56.452 INFO:tasks.workunit.client.0.smithi088.stdout:2/856: rmdir d6/d8/d73/d78/d10d 39 2023-12-09T02:34:56.458 INFO:tasks.workunit.client.0.smithi088.stdout:0/805: symlink df/d28/d33/daf/l10a 0 2023-12-09T02:34:56.459 INFO:tasks.workunit.client.0.smithi088.stdout:9/929: truncate df/f1a 656717 0 2023-12-09T02:34:56.459 INFO:tasks.workunit.client.0.smithi088.stdout:1/910: dread d8/f124 [0,4194304] 0 2023-12-09T02:34:56.459 INFO:tasks.workunit.client.0.smithi088.stdout:9/930: write df/d50/f7d [778220,6771] 0 2023-12-09T02:34:56.459 INFO:tasks.workunit.client.0.smithi088.stdout:9/931: chown df/d20/d30/d3f/d48/f6e 44288 1 2023-12-09T02:34:56.460 INFO:tasks.workunit.client.0.smithi088.stdout:4/839: mkdir d3/dc/d43/d8c/d95/d110 0 2023-12-09T02:34:56.462 INFO:tasks.workunit.client.0.smithi088.stdout:2/857: truncate d6/d8/d4e/dc9/fd1 3113115 0 2023-12-09T02:34:56.462 INFO:tasks.workunit.client.0.smithi088.stdout:0/806: stat df/d28/d43/lbc 0 2023-12-09T02:34:56.464 INFO:tasks.workunit.client.0.smithi088.stdout:9/932: creat df/d20/d30/d4e/f138 x:0 0 0 2023-12-09T02:34:56.464 INFO:tasks.workunit.client.0.smithi088.stdout:4/840: getdents d3/dc/d43/d8c/d95/daa/dc4 0 2023-12-09T02:34:56.466 INFO:tasks.workunit.client.0.smithi088.stdout:4/841: write d3/dc/d18/d8d/ffe [287448,11140] 0 2023-12-09T02:34:56.466 INFO:tasks.workunit.client.0.smithi088.stdout:2/858: unlink d6/d13/c14 0 2023-12-09T02:34:56.470 INFO:tasks.workunit.client.0.smithi088.stdout:0/807: rename df/d37/d70/db8 to df/d10/d10b 0 2023-12-09T02:34:56.470 INFO:tasks.workunit.client.0.smithi088.stdout:0/808: dread - df/d10/d22/d5f/fae zero size 2023-12-09T02:34:56.472 INFO:tasks.workunit.client.0.smithi088.stdout:9/933: creat df/d20/d4c/d84/f139 x:0 0 0 2023-12-09T02:34:56.472 INFO:tasks.workunit.client.0.smithi088.stdout:9/934: fsync df/d50/d63/f7f 0 2023-12-09T02:34:56.472 INFO:tasks.workunit.client.0.smithi088.stdout:9/935: truncate df/d20/d30/d3f/fab 4760450 0 2023-12-09T02:34:56.475 INFO:tasks.workunit.client.0.smithi088.stdout:0/809: unlink df/d10/d22/d2d/f4b 0 2023-12-09T02:34:56.475 INFO:tasks.workunit.client.0.smithi088.stdout:0/810: stat df/d10/fd8 0 2023-12-09T02:34:56.476 INFO:tasks.workunit.client.0.smithi088.stdout:5/853: sync 2023-12-09T02:34:56.476 INFO:tasks.workunit.client.0.smithi088.stdout:3/762: sync 2023-12-09T02:34:56.477 INFO:tasks.workunit.client.0.smithi088.stdout:0/811: unlink df/d28/d34/f48 0 2023-12-09T02:34:56.482 INFO:tasks.workunit.client.0.smithi088.stdout:3/763: creat d1/d9/dbf/ffc x:0 0 0 2023-12-09T02:34:56.484 INFO:tasks.workunit.client.0.smithi088.stdout:5/854: creat d3/d15/de/d10/d51/d70/f121 x:0 0 0 2023-12-09T02:34:56.484 INFO:tasks.workunit.client.0.smithi088.stdout:1/911: dwrite d8/d3d/d5d/d95/dac/db9/f12e [0,4194304] 0 2023-12-09T02:34:56.484 INFO:tasks.workunit.client.0.smithi088.stdout:3/764: creat d1/d3e/ffd x:0 0 0 2023-12-09T02:34:56.490 INFO:tasks.workunit.client.0.smithi088.stdout:5/855: symlink d3/d15/d2e/d49/d88/dd8/l122 0 2023-12-09T02:34:56.490 INFO:tasks.workunit.client.0.smithi088.stdout:3/765: creat d1/d3e/ffe x:0 0 0 2023-12-09T02:34:56.491 INFO:tasks.workunit.client.0.smithi088.stdout:4/842: dwrite d3/f76 [0,4194304] 0 2023-12-09T02:34:56.492 INFO:tasks.workunit.client.0.smithi088.stdout:5/856: unlink d3/d15/de/d10/d18/c2a 0 2023-12-09T02:34:56.492 INFO:tasks.workunit.client.0.smithi088.stdout:2/859: dwrite f1 [0,4194304] 0 2023-12-09T02:34:56.493 INFO:tasks.workunit.client.0.smithi088.stdout:3/766: rmdir d1/d3e/d9d 39 2023-12-09T02:34:56.493 INFO:tasks.workunit.client.0.smithi088.stdout:3/767: write d1/d9/d6f/d15/ff0 [988222,50190] 0 2023-12-09T02:34:56.493 INFO:tasks.workunit.client.0.smithi088.stdout:1/912: write d8/d3d/d5d/d95/f3f [1278474,41345] 0 2023-12-09T02:34:56.496 INFO:tasks.workunit.client.0.smithi088.stdout:5/857: mknod d3/d15/de/d10/c123 0 2023-12-09T02:34:56.497 INFO:tasks.workunit.client.0.smithi088.stdout:2/860: mknod d6/d20/d3a/d94/dad/ddb/c122 0 2023-12-09T02:34:56.497 INFO:tasks.workunit.client.0.smithi088.stdout:1/913: write d8/d59/feb [2516789,67174] 0 2023-12-09T02:34:56.497 INFO:tasks.workunit.client.0.smithi088.stdout:1/914: truncate d8/d1b/d6d/da2/fe4 1266850 0 2023-12-09T02:34:56.499 INFO:tasks.workunit.client.0.smithi088.stdout:3/768: mknod d1/d9/d6f/d2d/cff 0 2023-12-09T02:34:56.503 INFO:tasks.workunit.client.0.smithi088.stdout:5/858: symlink d3/d15/de/d2c/dfa/l124 0 2023-12-09T02:34:56.503 INFO:tasks.workunit.client.0.smithi088.stdout:5/859: truncate d3/d8/f9 4359794 0 2023-12-09T02:34:56.505 INFO:tasks.workunit.client.0.smithi088.stdout:1/915: mkdir d8/d3d/d44/da4/d134 0 2023-12-09T02:34:56.505 INFO:tasks.workunit.client.0.smithi088.stdout:0/812: dwrite df/f106 [0,4194304] 0 2023-12-09T02:34:56.506 INFO:tasks.workunit.client.0.smithi088.stdout:9/936: dwrite df/f114 [0,4194304] 0 2023-12-09T02:34:56.509 INFO:tasks.workunit.client.0.smithi088.stdout:3/769: mknod d1/d9/d6f/d2d/d66/c100 0 2023-12-09T02:34:56.509 INFO:tasks.workunit.client.0.smithi088.stdout:5/860: symlink d3/d15/de/d10/d18/d19/d1b/l125 0 2023-12-09T02:34:56.510 INFO:tasks.workunit.client.0.smithi088.stdout:1/916: creat d8/d1b/d6d/f135 x:0 0 0 2023-12-09T02:34:56.512 INFO:tasks.workunit.client.0.smithi088.stdout:5/861: write d3/d15/de/d10/d18/d19/d1b/fe0 [2089436,79369] 0 2023-12-09T02:34:56.512 INFO:tasks.workunit.client.0.smithi088.stdout:5/862: stat d3/f24 0 2023-12-09T02:34:56.517 INFO:tasks.workunit.client.0.smithi088.stdout:9/937: symlink df/d29/d2f/da2/def/d135/l13a 0 2023-12-09T02:34:56.517 INFO:tasks.workunit.client.0.smithi088.stdout:9/938: readlink df/d20/d4c/d97/d134/l132 0 2023-12-09T02:34:56.518 INFO:tasks.workunit.client.0.smithi088.stdout:3/770: mkdir d1/d9/d6f/d2d/d66/d101 0 2023-12-09T02:34:56.520 INFO:tasks.workunit.client.0.smithi088.stdout:2/861: dwrite d6/d8/d1f/d22/f38 [0,4194304] 0 2023-12-09T02:34:56.520 INFO:tasks.workunit.client.0.smithi088.stdout:2/862: dread - d6/d20/d3a/d84/fe6 zero size 2023-12-09T02:34:56.520 INFO:tasks.workunit.client.0.smithi088.stdout:2/863: chown d6/d13/d42/c5e 51381 1 2023-12-09T02:34:56.520 INFO:tasks.workunit.client.0.smithi088.stdout:1/917: getdents d8/d1c/d50 0 2023-12-09T02:34:56.523 INFO:tasks.workunit.client.0.smithi088.stdout:0/813: dwrite df/d28/d43/f46 [4194304,4194304] 0 2023-12-09T02:34:56.523 INFO:tasks.workunit.client.0.smithi088.stdout:0/814: write df/d37/ffe [600431,97817] 0 2023-12-09T02:34:56.523 INFO:tasks.workunit.client.0.smithi088.stdout:0/815: chown df/d37/c62 1 1 2023-12-09T02:34:56.523 INFO:tasks.workunit.client.0.smithi088.stdout:0/816: fsync df/d10/d22/d5f/ffb 0 2023-12-09T02:34:56.523 INFO:tasks.workunit.client.0.smithi088.stdout:0/817: chown df/d28/d43/cc5 349343760 1 2023-12-09T02:34:56.523 INFO:tasks.workunit.client.0.smithi088.stdout:0/818: chown df/d10/d10b/cc3 7650300 1 2023-12-09T02:34:56.523 INFO:tasks.workunit.client.0.smithi088.stdout:0/819: stat df/d10/d22/d2d/ca4 0 2023-12-09T02:34:56.524 INFO:tasks.workunit.client.0.smithi088.stdout:0/820: write f6 [951498,25906] 0 2023-12-09T02:34:56.524 INFO:tasks.workunit.client.0.smithi088.stdout:5/863: rename d3/d15/de/d10/d18/d19/d1b/fe0 to d3/d15/de/d10/d18/d19/d1b/d35/d58/f126 0 2023-12-09T02:34:56.527 INFO:tasks.workunit.client.0.smithi088.stdout:3/771: link d1/d9/d6f/d6/d83/lfb d1/d9/d6f/d22/d7f/d81/d85/ddc/l102 0 2023-12-09T02:34:56.529 INFO:tasks.workunit.client.0.smithi088.stdout:9/939: dread df/d50/d63/f73 [0,4194304] 0 2023-12-09T02:34:56.529 INFO:tasks.workunit.client.0.smithi088.stdout:9/940: chown df/d20/d30/d3f/d48/fae 97305 1 2023-12-09T02:34:56.529 INFO:tasks.workunit.client.0.smithi088.stdout:9/941: stat df/d20/f5f 0 2023-12-09T02:34:56.530 INFO:tasks.workunit.client.0.smithi088.stdout:9/942: truncate df/d20/d30/d60/d5c/db9/fa5 1447608 0 2023-12-09T02:34:56.530 INFO:tasks.workunit.client.0.smithi088.stdout:9/943: chown df/d20/d30/d4e 50558 1 2023-12-09T02:34:56.531 INFO:tasks.workunit.client.0.smithi088.stdout:2/864: mknod d6/d8/d4e/d3c/c123 0 2023-12-09T02:34:56.534 INFO:tasks.workunit.client.0.smithi088.stdout:1/918: creat d8/d27/d40/f136 x:0 0 0 2023-12-09T02:34:56.534 INFO:tasks.workunit.client.0.smithi088.stdout:1/919: chown d8/d1b 66 1 2023-12-09T02:34:56.538 INFO:tasks.workunit.client.0.smithi088.stdout:2/865: getdents d6/d8/d1f/d22 0 2023-12-09T02:34:56.538 INFO:tasks.workunit.client.0.smithi088.stdout:5/864: dread d3/d15/de/d10/d51/d7f/f86 [0,4194304] 0 2023-12-09T02:34:56.538 INFO:tasks.workunit.client.0.smithi088.stdout:5/865: chown d3/d15/de/d10/d18/d19/d1b/d35/d58/d67 2859640 1 2023-12-09T02:34:56.538 INFO:tasks.workunit.client.0.smithi088.stdout:5/866: truncate d3/d15/de/d10/d18/d19/d1b/d35/ff0 155596 0 2023-12-09T02:34:56.538 INFO:tasks.workunit.client.0.smithi088.stdout:5/867: fdatasync d3/d15/de/d10/d51/d7f/fec 0 2023-12-09T02:34:56.539 INFO:tasks.workunit.client.0.smithi088.stdout:5/868: chown d3/d15/dc/d60/d9d/fb6 7818 1 2023-12-09T02:34:56.540 INFO:tasks.workunit.client.0.smithi088.stdout:3/772: rename d1/d9/d6f/d2d/dab/dc5/dc9/dce/ff4 to d1/d9/d6f/f103 0 2023-12-09T02:34:56.540 INFO:tasks.workunit.client.0.smithi088.stdout:3/773: write d1/d9/d6f/d6/d4a/f5b [969917,27561] 0 2023-12-09T02:34:56.541 INFO:tasks.workunit.client.0.smithi088.stdout:2/866: creat d6/d8/d4e/da2/db8/dfc/db4/d106/f124 x:0 0 0 2023-12-09T02:34:56.542 INFO:tasks.workunit.client.0.smithi088.stdout:2/867: write d6/d20/d3d/f61 [467771,108249] 0 2023-12-09T02:34:56.542 INFO:tasks.workunit.client.0.smithi088.stdout:2/868: readlink d6/d8/l25 0 2023-12-09T02:34:56.543 INFO:tasks.workunit.client.0.smithi088.stdout:5/869: creat d3/d15/de/d10/d18/d19/d1b/da8/f127 x:0 0 0 2023-12-09T02:34:56.543 INFO:tasks.workunit.client.0.smithi088.stdout:3/774: mkdir d1/d9/d6f/d70/d104 0 2023-12-09T02:34:56.544 INFO:tasks.workunit.client.0.smithi088.stdout:2/869: creat d6/d8/f125 x:0 0 0 2023-12-09T02:34:56.544 INFO:tasks.workunit.client.0.smithi088.stdout:2/870: readlink d6/d8/d1f/d22/l6e 0 2023-12-09T02:34:56.544 INFO:tasks.workunit.client.0.smithi088.stdout:2/871: fsync d6/d13/f1e 0 2023-12-09T02:34:56.545 INFO:tasks.workunit.client.0.smithi088.stdout:5/870: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d61/ded/d128 0 2023-12-09T02:34:56.546 INFO:tasks.workunit.client.0.smithi088.stdout:3/775: truncate d1/d9/d6f/d6/d4a/d41/d33/d49/f54 1595569 0 2023-12-09T02:34:56.548 INFO:tasks.workunit.client.0.smithi088.stdout:2/872: mknod d6/d20/c126 0 2023-12-09T02:34:56.548 INFO:tasks.workunit.client.0.smithi088.stdout:2/873: chown d6/d20/d3a/d94 86 1 2023-12-09T02:34:56.548 INFO:tasks.workunit.client.0.smithi088.stdout:0/821: dwrite df/d37/ffc [0,4194304] 0 2023-12-09T02:34:56.548 INFO:tasks.workunit.client.0.smithi088.stdout:5/871: write d3/d15/de/d2c/f44 [3740495,26919] 0 2023-12-09T02:34:56.548 INFO:tasks.workunit.client.0.smithi088.stdout:5/872: stat d3/f24 0 2023-12-09T02:34:56.548 INFO:tasks.workunit.client.0.smithi088.stdout:5/873: fsync d3/d15/de/d10/d18/d19/d20/f27 0 2023-12-09T02:34:56.548 INFO:tasks.workunit.client.0.smithi088.stdout:3/776: rmdir d1/d9/d6f/d22/d7f/d81/d85/ddc 39 2023-12-09T02:34:56.550 INFO:tasks.workunit.client.0.smithi088.stdout:2/874: mknod d6/d20/d3a/d82/d99/c127 0 2023-12-09T02:34:56.550 INFO:tasks.workunit.client.0.smithi088.stdout:2/875: readlink d6/d13/dc6/l10c 0 2023-12-09T02:34:56.550 INFO:tasks.workunit.client.0.smithi088.stdout:2/876: chown d6/d8/d4e/d64/l103 41671693 1 2023-12-09T02:34:56.551 INFO:tasks.workunit.client.0.smithi088.stdout:5/874: write d3/d15/de/d10/d51/d7f/fdc [3870461,85328] 0 2023-12-09T02:34:56.551 INFO:tasks.workunit.client.0.smithi088.stdout:5/875: chown d3/d15/de/d2c/faa 37 1 2023-12-09T02:34:56.551 INFO:tasks.workunit.client.0.smithi088.stdout:5/876: write d3/d15/de/d2c/ff3 [447665,68099] 0 2023-12-09T02:34:56.551 INFO:tasks.workunit.client.0.smithi088.stdout:5/877: write d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/dfd/f10b [75256,8405] 0 2023-12-09T02:34:56.551 INFO:tasks.workunit.client.0.smithi088.stdout:5/878: write d3/d15/de/d10/d51/d70/fbb [213044,113540] 0 2023-12-09T02:34:56.551 INFO:tasks.workunit.client.0.smithi088.stdout:9/944: dwrite df/d29/d2f/f3a [4194304,4194304] 0 2023-12-09T02:34:56.552 INFO:tasks.workunit.client.0.smithi088.stdout:0/822: mknod df/d10/d22/d2d/d2e/ddc/c10c 0 2023-12-09T02:34:56.552 INFO:tasks.workunit.client.0.smithi088.stdout:7/834: sync 2023-12-09T02:34:56.553 INFO:tasks.workunit.client.0.smithi088.stdout:1/920: dwrite d8/d1c/d50/ffd [0,4194304] 0 2023-12-09T02:34:56.555 INFO:tasks.workunit.client.0.smithi088.stdout:3/777: truncate d1/d9/d6f/d6/d4a/f38 3418209 0 2023-12-09T02:34:56.555 INFO:tasks.workunit.client.0.smithi088.stdout:2/877: getdents d6/de3 0 2023-12-09T02:34:56.558 INFO:tasks.workunit.client.0.smithi088.stdout:5/879: creat d3/d15/de/d10/d18/d19/d1b/f129 x:0 0 0 2023-12-09T02:34:56.558 INFO:tasks.workunit.client.0.smithi088.stdout:5/880: truncate d3/fe8 565178 0 2023-12-09T02:34:56.560 INFO:tasks.workunit.client.0.smithi088.stdout:9/945: symlink df/d29/l13b 0 2023-12-09T02:34:56.563 INFO:tasks.workunit.client.0.smithi088.stdout:7/835: write dc/d21/d6b/d6d/da4/d3e/f100 [1389764,1197] 0 2023-12-09T02:34:56.566 INFO:tasks.workunit.client.0.smithi088.stdout:1/921: rename d8/d1b/d1d/f114 to d8/d1c/d50/d6c/df7/d10d/f137 0 2023-12-09T02:34:56.566 INFO:tasks.workunit.client.0.smithi088.stdout:1/922: write d8/d1c/d50/f72 [896647,59300] 0 2023-12-09T02:34:56.567 INFO:tasks.workunit.client.0.smithi088.stdout:3/778: creat d1/d9/d6f/d2d/dab/dc5/dc9/dce/f105 x:0 0 0 2023-12-09T02:34:56.568 INFO:tasks.workunit.client.0.smithi088.stdout:3/779: fdatasync d1/d9/d6f/d6/d83/fec 0 2023-12-09T02:34:56.569 INFO:tasks.workunit.client.0.smithi088.stdout:2/878: unlink d6/d13/l8f 0 2023-12-09T02:34:56.571 INFO:tasks.workunit.client.0.smithi088.stdout:5/881: link d3/d15/de/d10/d18/d19/d1b/d35/d42/f5e d3/d15/f12a 0 2023-12-09T02:34:56.571 INFO:tasks.workunit.client.0.smithi088.stdout:5/882: write d3/d15/de/f17 [6017065,89658] 0 2023-12-09T02:34:56.571 INFO:tasks.workunit.client.0.smithi088.stdout:9/946: symlink df/d20/d5b/d91/d10a/l13c 0 2023-12-09T02:34:56.573 INFO:tasks.workunit.client.0.smithi088.stdout:0/823: dwrite df/d10/f9e [0,4194304] 0 2023-12-09T02:34:56.573 INFO:tasks.workunit.client.0.smithi088.stdout:7/836: creat dc/d1b/d91/f11b x:0 0 0 2023-12-09T02:34:56.574 INFO:tasks.workunit.client.0.smithi088.stdout:5/883: write d3/d15/de/d10/d18/f57 [1921244,66283] 0 2023-12-09T02:34:56.574 INFO:tasks.workunit.client.0.smithi088.stdout:5/884: chown d3/d15/de/d10/d18/d19/d1b/ffe 1109 1 2023-12-09T02:34:56.574 INFO:tasks.workunit.client.0.smithi088.stdout:5/885: fdatasync d3/fa7 0 2023-12-09T02:34:56.577 INFO:tasks.workunit.client.0.smithi088.stdout:1/923: rename f3 to d8/d3d/f138 0 2023-12-09T02:34:56.578 INFO:tasks.workunit.client.0.smithi088.stdout:3/780: mknod d1/d9/d6f/d6/d83/c106 0 2023-12-09T02:34:56.579 INFO:tasks.workunit.client.0.smithi088.stdout:1/924: write d8/d1c/fbc [3207766,10025] 0 2023-12-09T02:34:56.579 INFO:tasks.workunit.client.0.smithi088.stdout:9/947: dread df/d29/d2f/f34 [0,4194304] 0 2023-12-09T02:34:56.579 INFO:tasks.workunit.client.0.smithi088.stdout:3/781: write d1/f6c [300914,19368] 0 2023-12-09T02:34:56.579 INFO:tasks.workunit.client.0.smithi088.stdout:0/824: rmdir df/d10/d22/da0 39 2023-12-09T02:34:56.582 INFO:tasks.workunit.client.0.smithi088.stdout:5/886: link d3/d15/de/d10/d51/db4/dd7/lea d3/d15/d2e/d49/l12b 0 2023-12-09T02:34:56.582 INFO:tasks.workunit.client.0.smithi088.stdout:7/837: creat dc/f11c x:0 0 0 2023-12-09T02:34:56.584 INFO:tasks.workunit.client.0.smithi088.stdout:0/825: write df/f106 [422262,9996] 0 2023-12-09T02:34:56.584 INFO:tasks.workunit.client.0.smithi088.stdout:3/782: dread d1/d9/d6f/d6/d4a/d41/d33/d49/f52 [0,4194304] 0 2023-12-09T02:34:56.584 INFO:tasks.workunit.client.0.smithi088.stdout:3/783: write d1/d9/dbf/fdd [411107,21756] 0 2023-12-09T02:34:56.584 INFO:tasks.workunit.client.0.smithi088.stdout:1/925: mkdir d8/d27/d75/d139 0 2023-12-09T02:34:56.584 INFO:tasks.workunit.client.0.smithi088.stdout:5/887: mknod d3/d15/de/d10/d51/dc9/dc4/c12c 0 2023-12-09T02:34:56.586 INFO:tasks.workunit.client.0.smithi088.stdout:7/838: creat dc/d21/d6b/d6d/d76/d106/f11d x:0 0 0 2023-12-09T02:34:56.588 INFO:tasks.workunit.client.0.smithi088.stdout:2/879: dwrite d6/d20/d9a/fcb [0,4194304] 0 2023-12-09T02:34:56.588 INFO:tasks.workunit.client.0.smithi088.stdout:2/880: fsync d6/d20/fe2 0 2023-12-09T02:34:56.589 INFO:tasks.workunit.client.0.smithi088.stdout:5/888: dread d3/d15/de/d10/d51/d7f/f86 [4194304,4194304] 0 2023-12-09T02:34:56.590 INFO:tasks.workunit.client.0.smithi088.stdout:0/826: mknod df/d10/d22/d2d/d2e/c10d 0 2023-12-09T02:34:56.592 INFO:tasks.workunit.client.0.smithi088.stdout:3/784: mknod d1/c107 0 2023-12-09T02:34:56.592 INFO:tasks.workunit.client.0.smithi088.stdout:3/785: chown d1/d9/d6f/d15/c35 154 1 2023-12-09T02:34:56.592 INFO:tasks.workunit.client.0.smithi088.stdout:1/926: creat d8/d3d/d44/d49/d12d/f13a x:0 0 0 2023-12-09T02:34:56.597 INFO:tasks.workunit.client.0.smithi088.stdout:2/881: getdents d6/d20/d3a/d82 0 2023-12-09T02:34:56.600 INFO:tasks.workunit.client.0.smithi088.stdout:1/927: link d8/d3d/d44/da4/f123 d8/d27/d66/f13b 0 2023-12-09T02:34:56.601 INFO:tasks.workunit.client.0.smithi088.stdout:3/786: creat d1/d9/d6f/d22/d7f/d81/d85/dcb/f108 x:0 0 0 2023-12-09T02:34:56.601 INFO:tasks.workunit.client.0.smithi088.stdout:3/787: stat d1/d3e/d9d/cd0 0 2023-12-09T02:34:56.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/948: dwrite df/d20/d5b/f8c [0,4194304] 0 2023-12-09T02:34:56.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/949: dread - df/d20/d30/d60/dca/dee/d113/d12c/f131 zero size 2023-12-09T02:34:56.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/950: chown df/d20/d30/d3f/d48/dc4 876 1 2023-12-09T02:34:56.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/951: write df/d20/d30/d60/d5c/ddb/f81 [951693,1885] 0 2023-12-09T02:34:56.603 INFO:tasks.workunit.client.0.smithi088.stdout:7/839: mknod dc/d21/d6b/d6d/da4/d38/d1e/c11e 0 2023-12-09T02:34:56.605 INFO:tasks.workunit.client.0.smithi088.stdout:2/882: mkdir d6/d8/d1f/d22/d68/d100/d128 0 2023-12-09T02:34:56.606 INFO:tasks.workunit.client.0.smithi088.stdout:1/928: getdents d8/d3d/d44/da4/dcb/de2 0 2023-12-09T02:34:56.610 INFO:tasks.workunit.client.0.smithi088.stdout:9/952: creat df/d20/f13d x:0 0 0 2023-12-09T02:34:56.612 INFO:tasks.workunit.client.0.smithi088.stdout:7/840: getdents dc/d1b/d82 0 2023-12-09T02:34:56.612 INFO:tasks.workunit.client.0.smithi088.stdout:7/841: truncate dc/d21/d6b/ffc 936692 0 2023-12-09T02:34:56.614 INFO:tasks.workunit.client.0.smithi088.stdout:2/883: mknod d6/d8/d54/c129 0 2023-12-09T02:34:56.615 INFO:tasks.workunit.client.0.smithi088.stdout:7/842: mkdir dc/d21/d6b/d93/d11f 0 2023-12-09T02:34:56.616 INFO:tasks.workunit.client.0.smithi088.stdout:0/827: dwrite df/d28/d43/f7c [0,4194304] 0 2023-12-09T02:34:56.621 INFO:tasks.workunit.client.0.smithi088.stdout:0/828: getdents df/d10/d22/d2d/d96 0 2023-12-09T02:34:56.622 INFO:tasks.workunit.client.0.smithi088.stdout:5/889: dwrite d3/d15/f101 [0,4194304] 0 2023-12-09T02:34:56.623 INFO:tasks.workunit.client.0.smithi088.stdout:0/829: getdents df/d10 0 2023-12-09T02:34:56.623 INFO:tasks.workunit.client.0.smithi088.stdout:0/830: write df/d28/f6c [135811,75876] 0 2023-12-09T02:34:56.627 INFO:tasks.workunit.client.0.smithi088.stdout:3/788: rename d1/d9/d6f/d22/d7f/d81 to d1/d9/d6f/d2d/d109 0 2023-12-09T02:34:56.634 INFO:tasks.workunit.client.0.smithi088.stdout:9/953: dwrite df/d20/d30/d4e/fbf [0,4194304] 0 2023-12-09T02:34:56.634 INFO:tasks.workunit.client.0.smithi088.stdout:1/929: dwrite d8/d1c/d50/fca [0,4194304] 0 2023-12-09T02:34:56.640 INFO:tasks.workunit.client.0.smithi088.stdout:2/884: dwrite d6/d8/d4e/da2/fc1 [0,4194304] 0 2023-12-09T02:34:56.640 INFO:tasks.workunit.client.0.smithi088.stdout:7/843: dwrite dc/d1b/d72/f8d [0,4194304] 0 2023-12-09T02:34:56.643 INFO:tasks.workunit.client.0.smithi088.stdout:5/890: creat d3/d15/de/d10/d51/db4/df5/f12d x:0 0 0 2023-12-09T02:34:56.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/844: read dc/d21/d6b/d93/f102 [1487299,115938] 0 2023-12-09T02:34:56.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/845: fsync dc/d21/d6b/d6d/da4/d38/f10f 0 2023-12-09T02:34:56.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/846: getdents dc/d21/d6b/d6d/d76 0 2023-12-09T02:34:56.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/847: readlink dc/d21/d6b/ld5 0 2023-12-09T02:34:56.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/848: chown dc/d1b/d91/c9e 3335 1 2023-12-09T02:34:56.645 INFO:tasks.workunit.client.0.smithi088.stdout:7/849: dread - dc/d1b/d72/dc4/f119 zero size 2023-12-09T02:34:56.645 INFO:tasks.workunit.client.0.smithi088.stdout:0/831: rmdir df/d10/d22/ded 39 2023-12-09T02:34:56.646 INFO:tasks.workunit.client.0.smithi088.stdout:3/789: symlink d1/d9/d6f/d70/l10a 0 2023-12-09T02:34:56.649 INFO:tasks.workunit.client.0.smithi088.stdout:9/954: rename df/d50/f7d to df/d20/d30/d4e/f13e 0 2023-12-09T02:34:56.653 INFO:tasks.workunit.client.0.smithi088.stdout:9/955: read df/d20/d30/d3f/d48/fa4 [3328032,113126] 0 2023-12-09T02:34:56.653 INFO:tasks.workunit.client.0.smithi088.stdout:9/956: fdatasync df/d50/d63/f80 0 2023-12-09T02:34:56.654 INFO:tasks.workunit.client.0.smithi088.stdout:1/930: dwrite d8/d53/f55 [0,4194304] 0 2023-12-09T02:34:56.654 INFO:tasks.workunit.client.0.smithi088.stdout:2/885: symlink d6/d20/d69/l12a 0 2023-12-09T02:34:56.655 INFO:tasks.workunit.client.0.smithi088.stdout:2/886: fdatasync d6/d8/d1f/faa 0 2023-12-09T02:34:56.655 INFO:tasks.workunit.client.0.smithi088.stdout:2/887: readlink d6/d8/d4e/da2/l107 0 2023-12-09T02:34:56.655 INFO:tasks.workunit.client.0.smithi088.stdout:2/888: write d6/d20/d9a/fcb [4511928,40926] 0 2023-12-09T02:34:56.657 INFO:tasks.workunit.client.0.smithi088.stdout:7/850: creat dc/d21/d6b/d6d/da4/d38/d1e/f120 x:0 0 0 2023-12-09T02:34:56.664 INFO:tasks.workunit.client.0.smithi088.stdout:0/832: rmdir df 39 2023-12-09T02:34:56.664 INFO:tasks.workunit.client.0.smithi088.stdout:0/833: write df/d28/d34/dc8/fdb [702199,93140] 0 2023-12-09T02:34:56.664 INFO:tasks.workunit.client.0.smithi088.stdout:5/891: dwrite d3/d15/de/d10/d18/d19/d1b/d35/d42/f21 [0,4194304] 0 2023-12-09T02:34:56.666 INFO:tasks.workunit.client.0.smithi088.stdout:3/790: rename d1/d3e/d9d to d1/d9/d6f/d6/d4a/d41/d10b 0 2023-12-09T02:34:56.667 INFO:tasks.workunit.client.0.smithi088.stdout:9/957: getdents df/d20/d30/d60/d5c/ddb 0 2023-12-09T02:34:56.667 INFO:tasks.workunit.client.0.smithi088.stdout:9/958: chown df/d29/d2f/f3c 0 1 2023-12-09T02:34:56.668 INFO:tasks.workunit.client.0.smithi088.stdout:9/959: read df/d20/d5b/f8c [15913,17703] 0 2023-12-09T02:34:56.668 INFO:tasks.workunit.client.0.smithi088.stdout:5/892: write d3/f24 [4207757,127075] 0 2023-12-09T02:34:56.668 INFO:tasks.workunit.client.0.smithi088.stdout:1/931: truncate d8/d27/f112 4178432 0 2023-12-09T02:34:56.669 INFO:tasks.workunit.client.0.smithi088.stdout:2/889: mknod d6/d8/d1f/d22/c12b 0 2023-12-09T02:34:56.671 INFO:tasks.workunit.client.0.smithi088.stdout:7/851: mknod dc/d1b/d82/c121 0 2023-12-09T02:34:56.671 INFO:tasks.workunit.client.0.smithi088.stdout:7/852: readlink dc/d21/d6b/d6d/d76/le1 0 2023-12-09T02:34:56.671 INFO:tasks.workunit.client.0.smithi088.stdout:3/791: creat d1/d9/d6f/f10c x:0 0 0 2023-12-09T02:34:56.672 INFO:tasks.workunit.client.0.smithi088.stdout:9/960: symlink df/d20/d5b/d91/l13f 0 2023-12-09T02:34:56.673 INFO:tasks.workunit.client.0.smithi088.stdout:5/893: creat d3/d15/de/d10/d18/d19/f12e x:0 0 0 2023-12-09T02:34:56.675 INFO:tasks.workunit.client.0.smithi088.stdout:9/961: write df/d20/d5b/f95 [52699,52262] 0 2023-12-09T02:34:56.675 INFO:tasks.workunit.client.0.smithi088.stdout:1/932: creat d8/d27/f13c x:0 0 0 2023-12-09T02:34:56.675 INFO:tasks.workunit.client.0.smithi088.stdout:1/933: stat d8/d3d/d44 0 2023-12-09T02:34:56.675 INFO:tasks.workunit.client.0.smithi088.stdout:1/934: chown d8/d27/d66/f13b 826 1 2023-12-09T02:34:56.675 INFO:tasks.workunit.client.0.smithi088.stdout:1/935: readlink d8/d3d/d5d/d82/ld2 0 2023-12-09T02:34:56.675 INFO:tasks.workunit.client.0.smithi088.stdout:7/853: creat dc/d21/d6b/d93/f122 x:0 0 0 2023-12-09T02:34:56.676 INFO:tasks.workunit.client.0.smithi088.stdout:3/792: rmdir d1/d9/d6f/d6/d4a 39 2023-12-09T02:34:56.677 INFO:tasks.workunit.client.0.smithi088.stdout:0/834: dread df/d10/d22/d5f/fb6 [0,4194304] 0 2023-12-09T02:34:56.677 INFO:tasks.workunit.client.0.smithi088.stdout:5/894: mkdir d3/d15/de/d73/d12f 0 2023-12-09T02:34:56.678 INFO:tasks.workunit.client.0.smithi088.stdout:9/962: mkdir df/d20/d5b/d91/d10a/d140 0 2023-12-09T02:34:56.679 INFO:tasks.workunit.client.0.smithi088.stdout:1/936: mknod d8/d27/d75/c13d 0 2023-12-09T02:34:56.679 INFO:tasks.workunit.client.0.smithi088.stdout:6/791: sync 2023-12-09T02:34:56.679 INFO:tasks.workunit.client.0.smithi088.stdout:8/886: sync 2023-12-09T02:34:56.679 INFO:tasks.workunit.client.0.smithi088.stdout:4/843: sync 2023-12-09T02:34:56.679 INFO:tasks.workunit.client.0.smithi088.stdout:4/844: fsync d3/dc/d18/d29/f3d 0 2023-12-09T02:34:56.689 INFO:tasks.workunit.client.0.smithi088.stdout:2/890: dwrite d6/f55 [0,4194304] 0 2023-12-09T02:34:56.689 INFO:tasks.workunit.client.0.smithi088.stdout:2/891: chown d6/d8/d4e/d3c/f50 94397 1 2023-12-09T02:34:56.689 INFO:tasks.workunit.client.0.smithi088.stdout:2/892: dread - d6/d8/d1f/f11b zero size 2023-12-09T02:34:56.689 INFO:tasks.workunit.client.0.smithi088.stdout:2/893: readlink d6/d20/d3a/l41 0 2023-12-09T02:34:56.689 INFO:tasks.workunit.client.0.smithi088.stdout:7/854: symlink dc/dcb/de2/l123 0 2023-12-09T02:34:56.689 INFO:tasks.workunit.client.0.smithi088.stdout:5/895: creat d3/d15/de/d10/d18/d19/d1b/d35/d42/f130 x:0 0 0 2023-12-09T02:34:56.689 INFO:tasks.workunit.client.0.smithi088.stdout:0/835: symlink df/d37/d97/l10e 0 2023-12-09T02:34:56.689 INFO:tasks.workunit.client.0.smithi088.stdout:0/836: chown df/c12 0 1 2023-12-09T02:34:56.689 INFO:tasks.workunit.client.0.smithi088.stdout:9/963: mknod df/d20/c141 0 2023-12-09T02:34:56.690 INFO:tasks.workunit.client.0.smithi088.stdout:5/896: dread - d3/d15/de/d10/d18/d19/d1b/ffe zero size 2023-12-09T02:34:56.690 INFO:tasks.workunit.client.0.smithi088.stdout:5/897: readlink d3/d15/de/d10/d18/d19/d1b/d35/d42/l68 0 2023-12-09T02:34:56.690 INFO:tasks.workunit.client.0.smithi088.stdout:6/792: creat d16/d1b/d2c/d3f/d41/d80/fe5 x:0 0 0 2023-12-09T02:34:56.690 INFO:tasks.workunit.client.0.smithi088.stdout:3/793: creat d1/d9/d6f/d2d/d109/d85/dcb/f10d x:0 0 0 2023-12-09T02:34:56.690 INFO:tasks.workunit.client.0.smithi088.stdout:7/855: read dc/d1b/d72/f8d [4010754,105336] 0 2023-12-09T02:34:56.691 INFO:tasks.workunit.client.0.smithi088.stdout:8/887: symlink d2/d9/d70/d8f/d98/d118/l122 0 2023-12-09T02:34:56.691 INFO:tasks.workunit.client.0.smithi088.stdout:4/845: symlink d3/dc/d43/d83/l111 0 2023-12-09T02:34:56.694 INFO:tasks.workunit.client.0.smithi088.stdout:4/846: read d3/f9 [2484996,77177] 0 2023-12-09T02:34:56.694 INFO:tasks.workunit.client.0.smithi088.stdout:5/898: stat d3/d15/de/d10/d18/d19/d1b/d35/d42/c3a 0 2023-12-09T02:34:56.694 INFO:tasks.workunit.client.0.smithi088.stdout:5/899: write d3/d15/de/d10/d18/d19/d1b/d35/ff0 [1025900,86160] 0 2023-12-09T02:34:56.695 INFO:tasks.workunit.client.0.smithi088.stdout:9/964: mknod df/d20/d30/d60/dca/dee/c142 0 2023-12-09T02:34:56.695 INFO:tasks.workunit.client.0.smithi088.stdout:9/965: write df/d20/d30/d60/d5c/f1e [4758562,110375] 0 2023-12-09T02:34:56.696 INFO:tasks.workunit.client.0.smithi088.stdout:0/837: dread df/f2c [0,4194304] 0 2023-12-09T02:34:56.697 INFO:tasks.workunit.client.0.smithi088.stdout:0/838: read df/d37/ffe [43394,14064] 0 2023-12-09T02:34:56.697 INFO:tasks.workunit.client.0.smithi088.stdout:6/793: rename d16/d1b/d2c/d3f/d41/f43 to d16/d35/d36/d97/d90/fe6 0 2023-12-09T02:34:56.699 INFO:tasks.workunit.client.0.smithi088.stdout:3/794: unlink d1/d9/d6f/d2d/d66/c50 0 2023-12-09T02:34:56.699 INFO:tasks.workunit.client.0.smithi088.stdout:3/795: write d1/d9/d6f/d2d/dab/dc5/dc9/dce/fc1 [1089573,92957] 0 2023-12-09T02:34:56.700 INFO:tasks.workunit.client.0.smithi088.stdout:7/856: mknod dc/d21/d7f/d110/c124 0 2023-12-09T02:34:56.700 INFO:tasks.workunit.client.0.smithi088.stdout:7/857: dread - dc/d21/d6b/d6d/fad zero size 2023-12-09T02:34:56.700 INFO:tasks.workunit.client.0.smithi088.stdout:7/858: write dc/d1b/de4/fed [403873,89049] 0 2023-12-09T02:34:56.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/888: mkdir d2/d9/d1a/d65/d123 0 2023-12-09T02:34:56.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/889: fsync d2/d9/d70/f109 0 2023-12-09T02:34:56.702 INFO:tasks.workunit.client.0.smithi088.stdout:8/890: read d2/d9/d13/d1c/d5f/d96/f105 [1577594,92096] 0 2023-12-09T02:34:56.702 INFO:tasks.workunit.client.0.smithi088.stdout:8/891: stat d2/f28 0 2023-12-09T02:34:56.702 INFO:tasks.workunit.client.0.smithi088.stdout:8/892: readlink d2/d9/d1a/l35 0 2023-12-09T02:34:56.702 INFO:tasks.workunit.client.0.smithi088.stdout:2/894: truncate d6/d8/d1f/d22/d68/f7f 3252093 0 2023-12-09T02:34:56.705 INFO:tasks.workunit.client.0.smithi088.stdout:5/900: link d3/c5 d3/d15/de/d10/d18/da5/c131 0 2023-12-09T02:34:56.705 INFO:tasks.workunit.client.0.smithi088.stdout:5/901: read d3/d15/de/d10/d18/d19/d20/f27 [3750440,93498] 0 2023-12-09T02:34:56.708 INFO:tasks.workunit.client.0.smithi088.stdout:3/796: creat d1/d9/d6f/d2d/dab/dc5/f10e x:0 0 0 2023-12-09T02:34:56.710 INFO:tasks.workunit.client.0.smithi088.stdout:7/859: creat dc/d1b/f125 x:0 0 0 2023-12-09T02:34:56.712 INFO:tasks.workunit.client.0.smithi088.stdout:9/966: dread df/d50/d63/f7f [0,4194304] 0 2023-12-09T02:34:56.712 INFO:tasks.workunit.client.0.smithi088.stdout:6/794: dread d16/d62/d6f/da4/dc2/dc7/fbb [0,4194304] 0 2023-12-09T02:34:56.713 INFO:tasks.workunit.client.0.smithi088.stdout:8/893: link d2/d9/d1a/d62/d76/f79 d2/d9/d1a/d62/d9a/f124 0 2023-12-09T02:34:56.714 INFO:tasks.workunit.client.0.smithi088.stdout:5/902: symlink d3/d15/de/d10/d51/db4/d9a/l132 0 2023-12-09T02:34:56.716 INFO:tasks.workunit.client.0.smithi088.stdout:3/797: creat d1/d3e/ddf/f10f x:0 0 0 2023-12-09T02:34:56.716 INFO:tasks.workunit.client.0.smithi088.stdout:3/798: fdatasync d1/d9/d6f/d2d/d109/d85/dcb/f108 0 2023-12-09T02:34:56.717 INFO:tasks.workunit.client.0.smithi088.stdout:7/860: mknod dc/d1b/de4/c126 0 2023-12-09T02:34:56.717 INFO:tasks.workunit.client.0.smithi088.stdout:7/861: write dc/d1b/f81 [1385403,97070] 0 2023-12-09T02:34:56.719 INFO:tasks.workunit.client.0.smithi088.stdout:9/967: symlink df/d20/d4c/d97/d134/l143 0 2023-12-09T02:34:56.721 INFO:tasks.workunit.client.0.smithi088.stdout:8/894: link d2/d9/d1a/d62/fa1 d2/d9/d70/d8f/dc2/f125 0 2023-12-09T02:34:56.723 INFO:tasks.workunit.client.0.smithi088.stdout:5/903: creat d3/d15/de/d10/d18/d19/d1b/d35/d42/d47/f133 x:0 0 0 2023-12-09T02:34:56.724 INFO:tasks.workunit.client.0.smithi088.stdout:3/799: link d1/d9/d6f/d15/c35 d1/d9/d6f/d2d/dab/c110 0 2023-12-09T02:34:56.725 INFO:tasks.workunit.client.0.smithi088.stdout:2/895: dwrite d6/d8/d54/f65 [0,4194304] 0 2023-12-09T02:34:56.726 INFO:tasks.workunit.client.0.smithi088.stdout:7/862: mkdir dc/d1b/d127 0 2023-12-09T02:34:56.727 INFO:tasks.workunit.client.0.smithi088.stdout:2/896: write d6/d20/d3d/f4a [7203889,78057] 0 2023-12-09T02:34:56.727 INFO:tasks.workunit.client.0.smithi088.stdout:2/897: truncate d6/d20/d3a/ff0 837624 0 2023-12-09T02:34:56.727 INFO:tasks.workunit.client.0.smithi088.stdout:2/898: fsync d6/d8/d4e/f57 0 2023-12-09T02:34:56.727 INFO:tasks.workunit.client.0.smithi088.stdout:0/839: dwrite df/d28/d33/f5a [0,4194304] 0 2023-12-09T02:34:56.727 INFO:tasks.workunit.client.0.smithi088.stdout:0/840: fdatasync df/d37/ffc 0 2023-12-09T02:34:56.727 INFO:tasks.workunit.client.0.smithi088.stdout:9/968: mkdir df/d50/d63/db8/d116/d144 0 2023-12-09T02:34:56.729 INFO:tasks.workunit.client.0.smithi088.stdout:6/795: creat d16/d1b/d2c/dcd/fe7 x:0 0 0 2023-12-09T02:34:56.730 INFO:tasks.workunit.client.0.smithi088.stdout:8/895: creat d2/d10f/d6e/d9f/f126 x:0 0 0 2023-12-09T02:34:56.732 INFO:tasks.workunit.client.0.smithi088.stdout:9/969: write df/d20/d30/d60/d5c/ddb/f79 [319979,101566] 0 2023-12-09T02:34:56.732 INFO:tasks.workunit.client.0.smithi088.stdout:9/970: stat df/d20/d5b/d91/d10a/l13c 0 2023-12-09T02:34:56.733 INFO:tasks.workunit.client.0.smithi088.stdout:5/904: rename d3/d15/l2f to d3/d15/de/d10/d18/d19/d1b/d35/d42/de2/l134 0 2023-12-09T02:34:56.735 INFO:tasks.workunit.client.0.smithi088.stdout:3/800: creat d1/d9/d6f/d2d/d66/d101/f111 x:0 0 0 2023-12-09T02:34:56.736 INFO:tasks.workunit.client.0.smithi088.stdout:9/971: write df/d20/d30/d60/d5c/f47 [925833,87407] 0 2023-12-09T02:34:56.736 INFO:tasks.workunit.client.0.smithi088.stdout:7/863: creat dc/d1b/d82/f128 x:0 0 0 2023-12-09T02:34:56.738 INFO:tasks.workunit.client.0.smithi088.stdout:2/899: creat d6/d20/d3a/d82/f12c x:0 0 0 2023-12-09T02:34:56.741 INFO:tasks.workunit.client.0.smithi088.stdout:0/841: mknod df/d10/d22/c10f 0 2023-12-09T02:34:56.743 INFO:tasks.workunit.client.0.smithi088.stdout:6/796: getdents d16/d62/d6f/da4/dc2 0 2023-12-09T02:34:56.745 INFO:tasks.workunit.client.0.smithi088.stdout:5/905: creat d3/d15/de/d2c/f135 x:0 0 0 2023-12-09T02:34:56.746 INFO:tasks.workunit.client.0.smithi088.stdout:3/801: mkdir d1/d9/d6f/d2d/dab/d112 0 2023-12-09T02:34:56.746 INFO:tasks.workunit.client.0.smithi088.stdout:7/864: dread dc/d21/d6b/d9b/fbd [0,4194304] 0 2023-12-09T02:34:56.748 INFO:tasks.workunit.client.0.smithi088.stdout:8/896: dwrite d2/d9/f51 [4194304,4194304] 0 2023-12-09T02:34:56.748 INFO:tasks.workunit.client.0.smithi088.stdout:8/897: chown d2/d9/d70/d8f/dc2/f125 1589 1 2023-12-09T02:34:56.749 INFO:tasks.workunit.client.0.smithi088.stdout:9/972: unlink df/d20/d30/d60/d5c/db9/feb 0 2023-12-09T02:34:56.751 INFO:tasks.workunit.client.0.smithi088.stdout:2/900: creat d6/d20/d3a/f12d x:0 0 0 2023-12-09T02:34:56.754 INFO:tasks.workunit.client.0.smithi088.stdout:0/842: symlink df/d37/d70/l110 0 2023-12-09T02:34:56.756 INFO:tasks.workunit.client.0.smithi088.stdout:6/797: rmdir d16/d1b/d2c/d3f/d83 39 2023-12-09T02:34:56.758 INFO:tasks.workunit.client.0.smithi088.stdout:2/901: dread d6/d20/d3a/fd9 [0,4194304] 0 2023-12-09T02:34:56.758 INFO:tasks.workunit.client.0.smithi088.stdout:2/902: write d6/d8/f10 [612090,115846] 0 2023-12-09T02:34:56.763 INFO:tasks.workunit.client.0.smithi088.stdout:3/802: creat d1/d3e/ddf/f113 x:0 0 0 2023-12-09T02:34:56.764 INFO:tasks.workunit.client.0.smithi088.stdout:7/865: dwrite dc/d1b/f4b [0,4194304] 0 2023-12-09T02:34:56.764 INFO:tasks.workunit.client.0.smithi088.stdout:7/866: dread - dc/d1b/f125 zero size 2023-12-09T02:34:56.764 INFO:tasks.workunit.client.0.smithi088.stdout:8/898: unlink d2/d9/d1a/d62/l5b 0 2023-12-09T02:34:56.764 INFO:tasks.workunit.client.0.smithi088.stdout:8/899: chown d2/d9/d1a/d62/l66 10 1 2023-12-09T02:34:56.764 INFO:tasks.workunit.client.0.smithi088.stdout:8/900: chown d2/d9/d70/d8f/dc2 10338880 1 2023-12-09T02:34:56.764 INFO:tasks.workunit.client.0.smithi088.stdout:9/973: stat df/d20/d30/d60/d5c/l1d 0 2023-12-09T02:34:56.765 INFO:tasks.workunit.client.0.smithi088.stdout:9/974: write df/d20/d30/f43 [1333180,22256] 0 2023-12-09T02:34:56.765 INFO:tasks.workunit.client.0.smithi088.stdout:8/901: dread d2/d10f/fc7 [0,4194304] 0 2023-12-09T02:34:56.766 INFO:tasks.workunit.client.0.smithi088.stdout:0/843: rename df/d10/d22/d2d/d2e/ddc/c10c to df/d10/d22/d2d/d2e/c111 0 2023-12-09T02:34:56.767 INFO:tasks.workunit.client.0.smithi088.stdout:6/798: creat d16/d62/da7/da9/dd9/fe8 x:0 0 0 2023-12-09T02:34:56.767 INFO:tasks.workunit.client.0.smithi088.stdout:6/799: write d16/f1c [4359873,55382] 0 2023-12-09T02:34:56.768 INFO:tasks.workunit.client.0.smithi088.stdout:2/903: truncate d6/d13/d18/f19 3298993 0 2023-12-09T02:34:56.775 INFO:tasks.workunit.client.0.smithi088.stdout:5/906: rmdir d3/d15/de/d10/d18/d19/d1b 39 2023-12-09T02:34:56.777 INFO:tasks.workunit.client.0.smithi088.stdout:2/904: dread d6/d13/d42/fa3 [0,4194304] 0 2023-12-09T02:34:56.781 INFO:tasks.workunit.client.0.smithi088.stdout:7/867: creat dc/d21/d6b/d6d/d76/d106/f129 x:0 0 0 2023-12-09T02:34:56.782 INFO:tasks.workunit.client.0.smithi088.stdout:9/975: rename df/d20/d5b/d91/d10a/ccb to df/d20/d30/d60/dc9/dda/c145 0 2023-12-09T02:34:56.782 INFO:tasks.workunit.client.0.smithi088.stdout:2/905: write d6/d8/d1f/d22/d68/f7f [3130339,100280] 0 2023-12-09T02:34:56.783 INFO:tasks.workunit.client.0.smithi088.stdout:0/844: creat df/d10/d22/d5f/f112 x:0 0 0 2023-12-09T02:34:56.783 INFO:tasks.workunit.client.0.smithi088.stdout:8/902: dwrite d2/d10f/f4b [0,4194304] 0 2023-12-09T02:34:56.784 INFO:tasks.workunit.client.0.smithi088.stdout:3/803: dwrite d1/d9/d6f/d6/d4a/d41/fd1 [0,4194304] 0 2023-12-09T02:34:56.784 INFO:tasks.workunit.client.0.smithi088.stdout:6/800: mknod d16/d1b/d25/d5f/d63/ce9 0 2023-12-09T02:34:56.785 INFO:tasks.workunit.client.0.smithi088.stdout:5/907: symlink d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/dcc/l136 0 2023-12-09T02:34:56.786 INFO:tasks.workunit.client.0.smithi088.stdout:7/868: mkdir dc/d21/d6b/d93/d12a 0 2023-12-09T02:34:56.789 INFO:tasks.workunit.client.0.smithi088.stdout:9/976: rename df/d20/d5b/d91/d10a/l105 to df/d29/l146 0 2023-12-09T02:34:56.791 INFO:tasks.workunit.client.0.smithi088.stdout:2/906: mknod d6/d13/dc6/c12e 0 2023-12-09T02:34:56.796 INFO:tasks.workunit.client.0.smithi088.stdout:8/903: creat d2/d9/d13/d1c/d5f/d84/f127 x:0 0 0 2023-12-09T02:34:56.796 INFO:tasks.workunit.client.0.smithi088.stdout:8/904: write d2/d10f/fc7 [1477522,110576] 0 2023-12-09T02:34:56.796 INFO:tasks.workunit.client.0.smithi088.stdout:8/905: stat d2/d10f/d6e/lcf 0 2023-12-09T02:34:56.798 INFO:tasks.workunit.client.0.smithi088.stdout:3/804: creat d1/d9/d6f/d6/d4a/d41/d33/f114 x:0 0 0 2023-12-09T02:34:56.799 INFO:tasks.workunit.client.0.smithi088.stdout:6/801: mkdir d16/d62/da7/da9/dd9/dea 0 2023-12-09T02:34:56.800 INFO:tasks.workunit.client.0.smithi088.stdout:5/908: unlink d3/d15/de/d10/d51/d7f/cc5 0 2023-12-09T02:34:56.801 INFO:tasks.workunit.client.0.smithi088.stdout:7/869: creat dc/d1b/d72/f12b x:0 0 0 2023-12-09T02:34:56.802 INFO:tasks.workunit.client.0.smithi088.stdout:9/977: creat df/d20/d30/d60/dca/dee/f147 x:0 0 0 2023-12-09T02:34:56.802 INFO:tasks.workunit.client.0.smithi088.stdout:9/978: dread - df/d20/d4c/d84/dcd/f133 zero size 2023-12-09T02:34:56.803 INFO:tasks.workunit.client.0.smithi088.stdout:2/907: link d6/d20/f23 d6/d8/f12f 0 2023-12-09T02:34:56.803 INFO:tasks.workunit.client.0.smithi088.stdout:2/908: readlink d6/d20/d3a/d82/l92 0 2023-12-09T02:34:56.803 INFO:tasks.workunit.client.0.smithi088.stdout:2/909: write d6/d8/f10 [1293133,4528] 0 2023-12-09T02:34:56.803 INFO:tasks.workunit.client.0.smithi088.stdout:4/847: sync 2023-12-09T02:34:56.804 INFO:tasks.workunit.client.0.smithi088.stdout:1/937: sync 2023-12-09T02:34:56.808 INFO:tasks.workunit.client.0.smithi088.stdout:8/906: rename d2/d9/d13/c30 to d2/d9/d13/d1c/c128 0 2023-12-09T02:34:56.808 INFO:tasks.workunit.client.0.smithi088.stdout:8/907: readlink d2/d9/d70/d8f/da8/dbe/l106 0 2023-12-09T02:34:56.812 INFO:tasks.workunit.client.0.smithi088.stdout:5/909: creat d3/d15/dc/d60/f137 x:0 0 0 2023-12-09T02:34:56.812 INFO:tasks.workunit.client.0.smithi088.stdout:6/802: write d16/d1b/d2c/d3f/d41/f4b [3071261,53097] 0 2023-12-09T02:34:56.813 INFO:tasks.workunit.client.0.smithi088.stdout:7/870: mknod dc/d21/d6b/dbb/c12c 0 2023-12-09T02:34:56.815 INFO:tasks.workunit.client.0.smithi088.stdout:9/979: creat df/d20/d5b/d91/d10a/d140/f148 x:0 0 0 2023-12-09T02:34:56.816 INFO:tasks.workunit.client.0.smithi088.stdout:9/980: write df/d20/d30/d60/d5c/db9/fd1 [399901,119365] 0 2023-12-09T02:34:56.816 INFO:tasks.workunit.client.0.smithi088.stdout:9/981: chown df/d20/d30/l39 36 1 2023-12-09T02:34:56.821 INFO:tasks.workunit.client.0.smithi088.stdout:3/805: dwrite d1/d9/d6f/d2d/d109/d85/dcb/f10d [0,4194304] 0 2023-12-09T02:34:56.821 INFO:tasks.workunit.client.0.smithi088.stdout:3/806: truncate d1/d3e/ddf/fe2 693819 0 2023-12-09T02:34:56.821 INFO:tasks.workunit.client.0.smithi088.stdout:3/807: truncate d1/d9/dbf/fdd 555003 0 2023-12-09T02:34:56.821 INFO:tasks.workunit.client.0.smithi088.stdout:3/808: chown d1/l71 6648735 1 2023-12-09T02:34:56.822 INFO:tasks.workunit.client.0.smithi088.stdout:4/848: unlink d3/dc/d43/d8c/d99/fa8 0 2023-12-09T02:34:56.822 INFO:tasks.workunit.client.0.smithi088.stdout:1/938: creat d8/d1b/d6d/df2/f13e x:0 0 0 2023-12-09T02:34:56.822 INFO:tasks.workunit.client.0.smithi088.stdout:4/849: write d3/dc/d1d/d40/ddf/fe0 [1623772,27469] 0 2023-12-09T02:34:56.823 INFO:tasks.workunit.client.0.smithi088.stdout:5/910: link d3/d15/de/d10/d51/l115 d3/d15/de/d10/d18/d19/d1b/l138 0 2023-12-09T02:34:56.825 INFO:tasks.workunit.client.0.smithi088.stdout:7/871: rename dc/d21/d6b/d6d/da4/d38/d1e/c46 to dc/d1b/de4/c12d 0 2023-12-09T02:34:56.826 INFO:tasks.workunit.client.0.smithi088.stdout:0/845: write df/d28/d43/f49 [3253375,107871] 0 2023-12-09T02:34:56.832 INFO:tasks.workunit.client.0.smithi088.stdout:3/809: symlink d1/d9/d6f/d2d/d109/d85/dcb/l115 0 2023-12-09T02:34:56.832 INFO:tasks.workunit.client.0.smithi088.stdout:3/810: chown d1/d3e/ddf/f10f 23340191 1 2023-12-09T02:34:56.832 INFO:tasks.workunit.client.0.smithi088.stdout:3/811: truncate d1/f1c 4131499 0 2023-12-09T02:34:56.832 INFO:tasks.workunit.client.0.smithi088.stdout:3/812: fsync d1/d9/d6f/d2d/d66/f7a 0 2023-12-09T02:34:56.832 INFO:tasks.workunit.client.0.smithi088.stdout:2/910: dwrite d6/d8/d4e/d47/f105 [0,4194304] 0 2023-12-09T02:34:56.833 INFO:tasks.workunit.client.0.smithi088.stdout:4/850: dread d3/f76 [0,4194304] 0 2023-12-09T02:34:56.833 INFO:tasks.workunit.client.0.smithi088.stdout:1/939: creat d8/d3d/d5d/d95/d98/f13f x:0 0 0 2023-12-09T02:34:56.834 INFO:tasks.workunit.client.0.smithi088.stdout:0/846: symlink df/d10/d22/d2d/l113 0 2023-12-09T02:34:56.837 INFO:tasks.workunit.client.0.smithi088.stdout:3/813: rmdir d1/d9/d6f/d70/d104 0 2023-12-09T02:34:56.838 INFO:tasks.workunit.client.0.smithi088.stdout:3/814: stat d1/d9/d6f/d22/d7f/fd3 0 2023-12-09T02:34:56.838 INFO:tasks.workunit.client.0.smithi088.stdout:1/940: symlink d8/d1c/d50/l140 0 2023-12-09T02:34:56.840 INFO:tasks.workunit.client.0.smithi088.stdout:8/908: dwrite d2/d9/d70/d8f/d98/fe4 [0,4194304] 0 2023-12-09T02:34:56.840 INFO:tasks.workunit.client.0.smithi088.stdout:0/847: link fc df/d10/d22/d2d/d96/f114 0 2023-12-09T02:34:56.842 INFO:tasks.workunit.client.0.smithi088.stdout:1/941: mkdir d8/d1b/d1d/dc7/d141 0 2023-12-09T02:34:56.842 INFO:tasks.workunit.client.0.smithi088.stdout:1/942: dread - d8/d3d/d44/da4/f123 zero size 2023-12-09T02:34:56.842 INFO:tasks.workunit.client.0.smithi088.stdout:2/911: dread d6/d20/d3a/d84/faf [0,4194304] 0 2023-12-09T02:34:56.845 INFO:tasks.workunit.client.0.smithi088.stdout:0/848: creat df/d10/d22/d5b/f115 x:0 0 0 2023-12-09T02:34:56.845 INFO:tasks.workunit.client.0.smithi088.stdout:8/909: creat d2/d10f/f129 x:0 0 0 2023-12-09T02:34:56.846 INFO:tasks.workunit.client.0.smithi088.stdout:0/849: read df/f57 [549184,109281] 0 2023-12-09T02:34:56.846 INFO:tasks.workunit.client.0.smithi088.stdout:2/912: creat d6/d8/d1f/d22/d68/dd3/f130 x:0 0 0 2023-12-09T02:34:56.851 INFO:tasks.workunit.client.0.smithi088.stdout:8/910: creat d2/d9/d13/f12a x:0 0 0 2023-12-09T02:34:56.851 INFO:tasks.workunit.client.0.smithi088.stdout:2/913: creat d6/d20/d3a/d82/f131 x:0 0 0 2023-12-09T02:34:56.855 INFO:tasks.workunit.client.0.smithi088.stdout:9/982: dwrite df/d20/d30/d3f/d48/fba [0,4194304] 0 2023-12-09T02:34:56.857 INFO:tasks.workunit.client.0.smithi088.stdout:8/911: truncate d2/d9/d1a/d62/f47 3069911 0 2023-12-09T02:34:56.858 INFO:tasks.workunit.client.0.smithi088.stdout:2/914: mknod d6/d8/d1f/d11a/c132 0 2023-12-09T02:34:56.858 INFO:tasks.workunit.client.0.smithi088.stdout:2/915: rename d6 to d6/d8/d73/d78/d10d/d133 22 2023-12-09T02:34:56.858 INFO:tasks.workunit.client.0.smithi088.stdout:2/916: write d6/d8/d4e/d47/f58 [246617,20544] 0 2023-12-09T02:34:56.858 INFO:tasks.workunit.client.0.smithi088.stdout:2/917: write d6/d13/fbb [638854,99505] 0 2023-12-09T02:34:56.858 INFO:tasks.workunit.client.0.smithi088.stdout:2/918: write d6/fe1 [833639,112456] 0 2023-12-09T02:34:56.858 INFO:tasks.workunit.client.0.smithi088.stdout:2/919: chown d6/d20/d3a/d82/f131 201019 1 2023-12-09T02:34:56.861 INFO:tasks.workunit.client.0.smithi088.stdout:8/912: symlink d2/d9/d13/d1c/d5f/d96/dec/l12b 0 2023-12-09T02:34:56.861 INFO:tasks.workunit.client.0.smithi088.stdout:8/913: readlink d2/d9/l17 0 2023-12-09T02:34:56.870 INFO:tasks.workunit.client.0.smithi088.stdout:5/911: dwrite d3/d15/de/d10/d18/d19/d1b/f9b [0,4194304] 0 2023-12-09T02:34:56.870 INFO:tasks.workunit.client.0.smithi088.stdout:5/912: chown d3/d15/d2e/d49/l12b 55598 1 2023-12-09T02:34:56.870 INFO:tasks.workunit.client.0.smithi088.stdout:5/913: chown d3/d15/de/l103 16101 1 2023-12-09T02:34:56.870 INFO:tasks.workunit.client.0.smithi088.stdout:5/914: read - d3/d15/de/d10/d18/d19/d1b/d35/d42/d47/f133 zero size 2023-12-09T02:34:56.873 INFO:tasks.workunit.client.0.smithi088.stdout:2/920: write d6/d8/d1f/d22/d68/fa5 [726274,92713] 0 2023-12-09T02:34:56.874 INFO:tasks.workunit.client.0.smithi088.stdout:5/915: write d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/fa3 [1970453,27591] 0 2023-12-09T02:34:56.874 INFO:tasks.workunit.client.0.smithi088.stdout:5/916: write d3/d15/de/d10/d51/db4/f9f [490949,25535] 0 2023-12-09T02:34:56.874 INFO:tasks.workunit.client.0.smithi088.stdout:2/921: symlink d6/d8/l134 0 2023-12-09T02:34:56.875 INFO:tasks.workunit.client.0.smithi088.stdout:5/917: getdents d3/d15/de/d10/d51/db4 0 2023-12-09T02:34:56.875 INFO:tasks.workunit.client.0.smithi088.stdout:5/918: readlink d3/d15/de/d10/d51/d7f/lb5 0 2023-12-09T02:34:56.876 INFO:tasks.workunit.client.0.smithi088.stdout:2/922: truncate d6/d8/d1f/d22/f40 3798259 0 2023-12-09T02:34:56.877 INFO:tasks.workunit.client.0.smithi088.stdout:2/923: rmdir d6/d8/d1f/d11a 39 2023-12-09T02:34:56.880 INFO:tasks.workunit.client.0.smithi088.stdout:5/919: dread d3/d15/de/d10/d18/d19/fa0 [0,4194304] 0 2023-12-09T02:34:56.881 INFO:tasks.workunit.client.0.smithi088.stdout:5/920: symlink d3/d15/de/d10/d18/d19/d1b/d35/d42/de2/l139 0 2023-12-09T02:34:56.881 INFO:tasks.workunit.client.0.smithi088.stdout:5/921: symlink d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/l13a 0 2023-12-09T02:34:56.882 INFO:tasks.workunit.client.0.smithi088.stdout:5/922: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d42/d13b 0 2023-12-09T02:34:56.883 INFO:tasks.workunit.client.0.smithi088.stdout:5/923: mknod d3/d15/dc/c13c 0 2023-12-09T02:34:56.883 INFO:tasks.workunit.client.0.smithi088.stdout:5/924: chown d3/d15/de/d10/d18/d19/d20/ddf/cfc 2782770 1 2023-12-09T02:34:56.884 INFO:tasks.workunit.client.0.smithi088.stdout:5/925: mknod d3/d15/d106/c13d 0 2023-12-09T02:34:56.884 INFO:tasks.workunit.client.0.smithi088.stdout:5/926: dread - d3/d15/de/d10/d51/db4/dd7/fe6 zero size 2023-12-09T02:34:56.885 INFO:tasks.workunit.client.0.smithi088.stdout:5/927: creat d3/f13e x:0 0 0 2023-12-09T02:34:56.885 INFO:tasks.workunit.client.0.smithi088.stdout:5/928: stat d3/d15/de/d10/d18/c46 0 2023-12-09T02:34:56.885 INFO:tasks.workunit.client.0.smithi088.stdout:5/929: chown d3/d15/de/d10/d18/d19/d1b/d35/d58/d67/l13a 30548981 1 2023-12-09T02:34:56.885 INFO:tasks.workunit.client.0.smithi088.stdout:5/930: chown d3/d15/de/d10/d18/d19/d1b/d35/d61/c72 89111 1 2023-12-09T02:34:56.894 INFO:tasks.workunit.client.0.smithi088.stdout:7/872: dwrite dc/d21/d6b/d6d/da4/d38/f44 [0,4194304] 0 2023-12-09T02:34:56.894 INFO:tasks.workunit.client.0.smithi088.stdout:7/873: chown dc/d21/d6b/d6d/dcd 780 1 2023-12-09T02:34:56.894 INFO:tasks.workunit.client.0.smithi088.stdout:3/815: dwrite d1/d9/d6f/d2d/d66/fb2 [0,4194304] 0 2023-12-09T02:34:56.894 INFO:tasks.workunit.client.0.smithi088.stdout:4/851: dwrite d3/dc/d43/d8c/d95/f9c [0,4194304] 0 2023-12-09T02:34:56.894 INFO:tasks.workunit.client.0.smithi088.stdout:1/943: dwrite d8/d3d/d5d/d95/f39 [0,4194304] 0 2023-12-09T02:34:56.894 INFO:tasks.workunit.client.0.smithi088.stdout:6/803: dwrite f9 [0,4194304] 0 2023-12-09T02:34:56.894 INFO:tasks.workunit.client.0.smithi088.stdout:6/804: getdents d16/d1b/d2c/d3f/d41/d80/dd0 0 2023-12-09T02:34:56.895 INFO:tasks.workunit.client.0.smithi088.stdout:8/914: dwrite d2/d9/d13/d1c/d5f/fce [4194304,4194304] 0 2023-12-09T02:34:56.895 INFO:tasks.workunit.client.0.smithi088.stdout:8/915: truncate d2/d9/d1a/d62/fa1 894718 0 2023-12-09T02:34:56.897 INFO:tasks.workunit.client.0.smithi088.stdout:7/874: creat dc/d21/d6b/f12e x:0 0 0 2023-12-09T02:34:56.900 INFO:tasks.workunit.client.0.smithi088.stdout:3/816: link d1/d9/d6f/d6/d4a/f5b d1/d9/d6f/d2d/d66/f116 0 2023-12-09T02:34:56.903 INFO:tasks.workunit.client.0.smithi088.stdout:4/852: creat d3/dc/d43/d8c/d95/daa/db7/f112 x:0 0 0 2023-12-09T02:34:56.905 INFO:tasks.workunit.client.0.smithi088.stdout:3/817: dread d1/d9/d6f/d2d/dab/dc5/dc9/dce/fc1 [0,4194304] 0 2023-12-09T02:34:56.908 INFO:tasks.workunit.client.0.smithi088.stdout:1/944: creat d8/d3d/d44/da4/dcb/f142 x:0 0 0 2023-12-09T02:34:56.908 INFO:tasks.workunit.client.0.smithi088.stdout:2/924: dread d6/d8/d1f/d22/d68/fa5 [0,4194304] 0 2023-12-09T02:34:56.908 INFO:tasks.workunit.client.0.smithi088.stdout:5/931: dwrite d3/d15/de/d10/d51/db4/d109/f10d [0,4194304] 0 2023-12-09T02:34:56.908 INFO:tasks.workunit.client.0.smithi088.stdout:2/925: write d6/d8/d4e/d64/f75 [1470814,9678] 0 2023-12-09T02:34:56.914 INFO:tasks.workunit.client.0.smithi088.stdout:5/932: dread d3/d15/de/d2c/fa9 [0,4194304] 0 2023-12-09T02:34:56.914 INFO:tasks.workunit.client.0.smithi088.stdout:5/933: write d3/d15/de/d10/d18/d19/d1b/ffe [638219,84063] 0 2023-12-09T02:34:56.921 INFO:tasks.workunit.client.0.smithi088.stdout:6/805: mkdir d16/d62/d6f/da4/dc2/dc7/d8c/deb 0 2023-12-09T02:34:56.923 INFO:tasks.workunit.client.0.smithi088.stdout:8/916: mknod d2/d9/d13/d1c/d3b/c12c 0 2023-12-09T02:34:56.923 INFO:tasks.workunit.client.0.smithi088.stdout:8/917: truncate d2/d9/d1a/d65/f9d 1538730 0 2023-12-09T02:34:56.923 INFO:tasks.workunit.client.0.smithi088.stdout:8/918: dread - d2/d10f/d6e/fb6 zero size 2023-12-09T02:34:56.923 INFO:tasks.workunit.client.0.smithi088.stdout:8/919: fsync d2/d9/f4d 0 2023-12-09T02:34:56.925 INFO:tasks.workunit.client.0.smithi088.stdout:7/875: mknod dc/d1b/d91/dd2/c12f 0 2023-12-09T02:34:56.927 INFO:tasks.workunit.client.0.smithi088.stdout:7/876: dread dc/d21/ff5 [0,4194304] 0 2023-12-09T02:34:56.927 INFO:tasks.workunit.client.0.smithi088.stdout:7/877: write dc/d1b/fe6 [969126,24520] 0 2023-12-09T02:34:56.927 INFO:tasks.workunit.client.0.smithi088.stdout:4/853: symlink d3/d65/db0/dc1/l113 0 2023-12-09T02:34:56.927 INFO:tasks.workunit.client.0.smithi088.stdout:4/854: chown d3/f108 0 1 2023-12-09T02:34:56.930 INFO:tasks.workunit.client.0.smithi088.stdout:3/818: rename d1/d3e to d1/d9/d6f/d22/d7f/d117 0 2023-12-09T02:34:56.931 INFO:tasks.workunit.client.0.smithi088.stdout:1/945: mknod d8/d1c/c143 0 2023-12-09T02:34:56.934 INFO:tasks.workunit.client.0.smithi088.stdout:2/926: mknod d6/d8/d73/d78/c135 0 2023-12-09T02:34:56.936 INFO:tasks.workunit.client.0.smithi088.stdout:5/934: truncate d3/d15/d2e/d49/f4f 1559148 0 2023-12-09T02:34:56.938 INFO:tasks.workunit.client.0.smithi088.stdout:6/806: mknod d16/d62/d6f/da4/dc2/dc7/cec 0 2023-12-09T02:34:56.939 INFO:tasks.workunit.client.0.smithi088.stdout:8/920: mknod d2/d9/d1a/d65/d123/c12d 0 2023-12-09T02:34:56.940 INFO:tasks.workunit.client.0.smithi088.stdout:7/878: fsync dc/d21/d6b/d6d/da4/d3e/f92 0 2023-12-09T02:34:56.942 INFO:tasks.workunit.client.0.smithi088.stdout:6/807: dread d16/d62/d6f/da4/dc2/dc7/d8c/fcc [0,4194304] 0 2023-12-09T02:34:56.942 INFO:tasks.workunit.client.0.smithi088.stdout:4/855: truncate d3/dc/d18/dab/dc7/fea 2664047 0 2023-12-09T02:34:56.943 INFO:tasks.workunit.client.0.smithi088.stdout:4/856: write d3/dc/d43/d83/f4f [1348431,22828] 0 2023-12-09T02:34:56.947 INFO:tasks.workunit.client.0.smithi088.stdout:8/921: unlink d2/d10f/d6e/f117 0 2023-12-09T02:34:56.947 INFO:tasks.workunit.client.0.smithi088.stdout:8/922: readlink d2/d9/d70/d8f/lcd 0 2023-12-09T02:34:56.948 INFO:tasks.workunit.client.0.smithi088.stdout:8/923: read d2/d9/d13/f56 [1359315,100475] 0 2023-12-09T02:34:56.948 INFO:tasks.workunit.client.0.smithi088.stdout:8/924: dread - d2/db9/ff9 zero size 2023-12-09T02:34:56.949 INFO:tasks.workunit.client.0.smithi088.stdout:8/925: write d2/d9/d1a/d65/f9d [141920,15911] 0 2023-12-09T02:34:56.949 INFO:tasks.workunit.client.0.smithi088.stdout:8/926: chown d2/d9/d1a/d65/lbc 1434916 1 2023-12-09T02:34:56.949 INFO:tasks.workunit.client.0.smithi088.stdout:8/927: chown d2/d9/d13/d1c/d5f/d96/f105 43 1 2023-12-09T02:34:56.950 INFO:tasks.workunit.client.0.smithi088.stdout:7/879: unlink dc/f43 0 2023-12-09T02:34:56.950 INFO:tasks.workunit.client.0.smithi088.stdout:6/808: truncate d16/d35/f46 3986339 0 2023-12-09T02:34:56.950 INFO:tasks.workunit.client.0.smithi088.stdout:6/809: stat d16/d1b/f26 0 2023-12-09T02:34:56.952 INFO:tasks.workunit.client.0.smithi088.stdout:4/857: mkdir d3/dc/d43/d8c/d99/d114 0 2023-12-09T02:34:56.953 INFO:tasks.workunit.client.0.smithi088.stdout:7/880: rmdir dc/d21/db1 39 2023-12-09T02:34:56.955 INFO:tasks.workunit.client.0.smithi088.stdout:6/810: mknod d16/d1b/d2c/d3f/ced 0 2023-12-09T02:34:56.955 INFO:tasks.workunit.client.0.smithi088.stdout:5/935: write d3/d15/dc/f2d [3077194,88988] 0 2023-12-09T02:34:56.957 INFO:tasks.workunit.client.0.smithi088.stdout:4/858: mkdir d3/dc/d18/da9/d115 0 2023-12-09T02:34:56.958 INFO:tasks.workunit.client.0.smithi088.stdout:6/811: creat d16/d35/d36/dad/fee x:0 0 0 2023-12-09T02:34:56.958 INFO:tasks.workunit.client.0.smithi088.stdout:6/812: chown d16/d1b/d25/d5f/d63 426 1 2023-12-09T02:34:56.958 INFO:tasks.workunit.client.0.smithi088.stdout:6/813: chown d16/d62/d6f/da4/dc2/dc7/fd8 27 1 2023-12-09T02:34:56.958 INFO:tasks.workunit.client.0.smithi088.stdout:8/928: write d2/f41 [495118,105207] 0 2023-12-09T02:34:56.963 INFO:tasks.workunit.client.0.smithi088.stdout:7/881: dread dc/d21/d6b/d6d/da4/d38/ff [0,4194304] 0 2023-12-09T02:34:56.965 INFO:tasks.workunit.client.0.smithi088.stdout:6/814: unlink d16/d1b/d25/d5f/d63/f7f 0 2023-12-09T02:34:56.966 INFO:tasks.workunit.client.0.smithi088.stdout:8/929: write d2/d9/d13/d1c/f3a [1527122,61374] 0 2023-12-09T02:34:56.966 INFO:tasks.workunit.client.0.smithi088.stdout:8/930: dread d2/d9/d70/f109 [0,4194304] 0 2023-12-09T02:34:56.967 INFO:tasks.workunit.client.0.smithi088.stdout:7/882: mkdir dc/d21/d6b/d6d/d130 0 2023-12-09T02:34:56.967 INFO:tasks.workunit.client.0.smithi088.stdout:7/883: write dc/d1b/d89/f94 [865518,123444] 0 2023-12-09T02:34:56.970 INFO:tasks.workunit.client.0.smithi088.stdout:1/946: dwrite d8/d3d/d44/f6b [0,4194304] 0 2023-12-09T02:34:56.974 INFO:tasks.workunit.client.0.smithi088.stdout:7/884: dread dc/d21/d6b/d6d/da4/f34 [0,4194304] 0 2023-12-09T02:34:56.974 INFO:tasks.workunit.client.0.smithi088.stdout:8/931: unlink d2/d9/d13/d1c/d5f/d96/f105 0 2023-12-09T02:34:56.974 INFO:tasks.workunit.client.0.smithi088.stdout:8/932: truncate d2/d9/d1a/d62/d49/f97 949216 0 2023-12-09T02:34:56.975 INFO:tasks.workunit.client.0.smithi088.stdout:8/933: creat d2/d9/d1a/d62/d76/d85/f12e x:0 0 0 2023-12-09T02:34:56.976 INFO:tasks.workunit.client.0.smithi088.stdout:0/850: sync 2023-12-09T02:34:56.976 INFO:tasks.workunit.client.0.smithi088.stdout:9/983: sync 2023-12-09T02:34:56.976 INFO:tasks.workunit.client.0.smithi088.stdout:9/984: truncate df/d20/d4c/d84/f126 898459 0 2023-12-09T02:34:56.978 INFO:tasks.workunit.client.0.smithi088.stdout:8/934: mknod d2/d9/d70/d8f/da8/d119/d120/c12f 0 2023-12-09T02:34:56.978 INFO:tasks.workunit.client.0.smithi088.stdout:8/935: chown d2/d10f/l38 943724 1 2023-12-09T02:34:56.978 INFO:tasks.workunit.client.0.smithi088.stdout:8/936: readlink d2/d10f/d6e/d9f/l7e 0 2023-12-09T02:34:56.981 INFO:tasks.workunit.client.0.smithi088.stdout:0/851: getdents df/d10/d22 0 2023-12-09T02:34:56.982 INFO:tasks.workunit.client.0.smithi088.stdout:9/985: write df/d20/d30/d60/d5c/f2a [1973637,32857] 0 2023-12-09T02:34:56.982 INFO:tasks.workunit.client.0.smithi088.stdout:9/986: chown df/d20/d4c/d84/f126 163448094 1 2023-12-09T02:34:56.984 INFO:tasks.workunit.client.0.smithi088.stdout:8/937: symlink d2/d9/d1a/d65/d114/l130 0 2023-12-09T02:34:56.985 INFO:tasks.workunit.client.0.smithi088.stdout:2/927: dwrite d6/d8/d1f/faa [0,4194304] 0 2023-12-09T02:34:56.985 INFO:tasks.workunit.client.0.smithi088.stdout:2/928: chown d6/d8/d4e/da2/l107 32 1 2023-12-09T02:34:56.989 INFO:tasks.workunit.client.0.smithi088.stdout:4/859: dwrite d3/d65/f80 [0,4194304] 0 2023-12-09T02:34:56.989 INFO:tasks.workunit.client.0.smithi088.stdout:5/936: dwrite d3/d15/de/d10/f78 [0,4194304] 0 2023-12-09T02:34:56.989 INFO:tasks.workunit.client.0.smithi088.stdout:4/860: dread - d3/f108 zero size 2023-12-09T02:34:56.989 INFO:tasks.workunit.client.0.smithi088.stdout:3/819: dwrite d1/d9/d6f/d6/f11 [0,4194304] 0 2023-12-09T02:34:56.989 INFO:tasks.workunit.client.0.smithi088.stdout:3/820: write d1/d9/f1b [4536551,97991] 0 2023-12-09T02:34:56.989 INFO:tasks.workunit.client.0.smithi088.stdout:3/821: fdatasync d1/d9/d6f/d2d/d66/fa2 0 2023-12-09T02:34:56.992 INFO:tasks.workunit.client.0.smithi088.stdout:8/938: unlink d2/d10f/d6e/d9f/f115 0 2023-12-09T02:34:56.992 INFO:tasks.workunit.client.0.smithi088.stdout:0/852: rename df/d10/d22/da0/fb7 to df/d10/d22/d2d/d96/f116 0 2023-12-09T02:34:56.992 INFO:tasks.workunit.client.0.smithi088.stdout:0/853: stat df/d10/d22/d5f/ffb 0 2023-12-09T02:34:56.992 INFO:tasks.workunit.client.0.smithi088.stdout:0/854: stat df/d10/d22/d2d/d6a 0 2023-12-09T02:34:56.995 INFO:tasks.workunit.client.0.smithi088.stdout:2/929: link d6/d8/d4e/d47/cc5 d6/d8/d4e/d3c/c136 0 2023-12-09T02:34:56.998 INFO:tasks.workunit.client.0.smithi088.stdout:5/937: mknod d3/d15/d2e/d49/d88/dd6/c13f 0 2023-12-09T02:34:57.000 INFO:tasks.workunit.client.0.smithi088.stdout:4/861: creat d3/dc/d18/dab/dc7/dd7/f116 x:0 0 0 2023-12-09T02:34:57.000 INFO:tasks.workunit.client.0.smithi088.stdout:8/939: creat d2/d9/d13/d1c/d5f/dc4/f131 x:0 0 0 2023-12-09T02:34:57.000 INFO:tasks.workunit.client.0.smithi088.stdout:8/940: chown d2/d9/d13/d1c/fd3 232265 1 2023-12-09T02:34:57.002 INFO:tasks.workunit.client.0.smithi088.stdout:0/855: rename df/d10/d10b/ff7 to df/d10/d22/d2d/d6a/deb/f117 0 2023-12-09T02:34:57.003 INFO:tasks.workunit.client.0.smithi088.stdout:2/930: mkdir d6/d8/d4e/d47/d137 0 2023-12-09T02:34:57.003 INFO:tasks.workunit.client.0.smithi088.stdout:4/862: symlink d3/d65/de4/l117 0 2023-12-09T02:34:57.003 INFO:tasks.workunit.client.0.smithi088.stdout:4/863: chown d3/d65/f106 14426823 1 2023-12-09T02:34:57.003 INFO:tasks.workunit.client.0.smithi088.stdout:2/931: fdatasync d6/d8/d54/f65 0 2023-12-09T02:34:57.005 INFO:tasks.workunit.client.0.smithi088.stdout:8/941: mkdir d2/d9/d70/d8f/da8/d119/d132 0 2023-12-09T02:34:57.005 INFO:tasks.workunit.client.0.smithi088.stdout:2/932: rename d6/d8/d1f/l49 to d6/d13/d18/d10a/l138 0 2023-12-09T02:34:57.005 INFO:tasks.workunit.client.0.smithi088.stdout:2/933: write d6/d8/d73/d78/f8a [2993606,90032] 0 2023-12-09T02:34:57.008 INFO:tasks.workunit.client.0.smithi088.stdout:2/934: rename d6/d20/d3a/d94/dad/ddb/c122 to d6/d20/d3a/d94/c139 0 2023-12-09T02:34:57.011 INFO:tasks.workunit.client.0.smithi088.stdout:6/815: dwrite d16/d1b/d2c/f2d [0,4194304] 0 2023-12-09T02:34:57.013 INFO:tasks.workunit.client.0.smithi088.stdout:6/816: symlink d16/d1b/d56/lef 0 2023-12-09T02:34:57.018 INFO:tasks.workunit.client.0.smithi088.stdout:6/817: mknod d16/d62/d6f/da4/dc2/dc7/cf0 0 2023-12-09T02:34:57.023 INFO:tasks.workunit.client.0.smithi088.stdout:1/947: dwrite d8/d3d/d44/da4/dcb/de2/f131 [0,4194304] 0 2023-12-09T02:34:57.028 INFO:tasks.workunit.client.0.smithi088.stdout:7/885: dwrite dc/d1b/de4/f117 [0,4194304] 0 2023-12-09T02:34:57.031 INFO:tasks.workunit.client.0.smithi088.stdout:8/942: write d2/d9/d13/d1c/d5f/d84/fdb [926173,128761] 0 2023-12-09T02:34:57.031 INFO:tasks.workunit.client.0.smithi088.stdout:7/886: creat dc/d21/db1/f131 x:0 0 0 2023-12-09T02:34:57.031 INFO:tasks.workunit.client.0.smithi088.stdout:7/887: truncate dc/fc3 774347 0 2023-12-09T02:34:57.032 INFO:tasks.workunit.client.0.smithi088.stdout:7/888: dread - dc/d21/d6b/d6d/da4/d38/f10f zero size 2023-12-09T02:34:57.032 INFO:tasks.workunit.client.0.smithi088.stdout:7/889: write dc/d1b/d91/dfe/f118 [891664,53153] 0 2023-12-09T02:34:57.032 INFO:tasks.workunit.client.0.smithi088.stdout:6/818: rmdir d16/d35/d36 39 2023-12-09T02:34:57.032 INFO:tasks.workunit.client.0.smithi088.stdout:6/819: write d16/d1b/d25/f3d [5482733,65469] 0 2023-12-09T02:34:57.032 INFO:tasks.workunit.client.0.smithi088.stdout:6/820: stat d16/d35/fd3 0 2023-12-09T02:34:57.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/821: dread - d16/d35/fd3 zero size 2023-12-09T02:34:57.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/822: dread - d16/d62/d6f/da4/dc2/dc7/fd8 zero size 2023-12-09T02:34:57.034 INFO:tasks.workunit.client.0.smithi088.stdout:8/943: unlink d2/d9/d70/d8f/da8/dbe/ld8 0 2023-12-09T02:34:57.034 INFO:tasks.workunit.client.0.smithi088.stdout:8/944: fsync d2/d9/f4d 0 2023-12-09T02:34:57.039 INFO:tasks.workunit.client.0.smithi088.stdout:8/945: dread d2/d9/d13/d1c/d3b/f10d [0,4194304] 0 2023-12-09T02:34:57.042 INFO:tasks.workunit.client.0.smithi088.stdout:8/946: symlink d2/d9/d1a/d62/d9a/de8/l133 0 2023-12-09T02:34:57.044 INFO:tasks.workunit.client.0.smithi088.stdout:5/938: dwrite d3/fa7 [0,4194304] 0 2023-12-09T02:34:57.044 INFO:tasks.workunit.client.0.smithi088.stdout:8/947: readlink d2/d9/d1a/d62/d49/l5d 0 2023-12-09T02:34:57.046 INFO:tasks.workunit.client.0.smithi088.stdout:9/987: dwrite df/d20/d30/d3f/fab [0,4194304] 0 2023-12-09T02:34:57.046 INFO:tasks.workunit.client.0.smithi088.stdout:5/939: symlink d3/d15/de/d10/d51/db4/d9a/l140 0 2023-12-09T02:34:57.047 INFO:tasks.workunit.client.0.smithi088.stdout:8/948: getdents d2/d9/d1a/d62/d9a 0 2023-12-09T02:34:57.050 INFO:tasks.workunit.client.0.smithi088.stdout:9/988: rename df/d20/d30/d3f/d48/fae to df/d20/d4c/d84/f149 0 2023-12-09T02:34:57.052 INFO:tasks.workunit.client.0.smithi088.stdout:5/940: creat d3/d15/de/d10/d18/d19/d20/ddf/f141 x:0 0 0 2023-12-09T02:34:57.052 INFO:tasks.workunit.client.0.smithi088.stdout:5/941: chown d3/d15/de/d10/d18 10013 1 2023-12-09T02:34:57.052 INFO:tasks.workunit.client.0.smithi088.stdout:8/949: dread d2/d9/d1a/d65/f67 [4194304,4194304] 0 2023-12-09T02:34:57.052 INFO:tasks.workunit.client.0.smithi088.stdout:8/950: truncate d2/d9/d70/d8f/dc2/fd7 546456 0 2023-12-09T02:34:57.053 INFO:tasks.workunit.client.0.smithi088.stdout:8/951: creat d2/d9/d70/d8f/da8/d119/d132/f134 x:0 0 0 2023-12-09T02:34:57.054 INFO:tasks.workunit.client.0.smithi088.stdout:8/952: creat d2/d9/d1a/d62/d76/df0/f135 x:0 0 0 2023-12-09T02:34:57.056 INFO:tasks.workunit.client.0.smithi088.stdout:0/856: dwrite df/d10/d22/d2d/d6a/fb0 [0,4194304] 0 2023-12-09T02:34:57.057 INFO:tasks.workunit.client.0.smithi088.stdout:8/953: link d2/d9/d13/d1c/d3b/lf2 d2/l136 0 2023-12-09T02:34:57.057 INFO:tasks.workunit.client.0.smithi088.stdout:8/954: truncate d2/d9/d13/d1c/d5f/d84/f127 4884 0 2023-12-09T02:34:57.057 INFO:tasks.workunit.client.0.smithi088.stdout:3/822: dwrite d1/d9/d6f/d2d/db9/fb8 [0,4194304] 0 2023-12-09T02:34:57.059 INFO:tasks.workunit.client.0.smithi088.stdout:0/857: symlink df/d10/d22/d2d/d3c/l118 0 2023-12-09T02:34:57.060 INFO:tasks.workunit.client.0.smithi088.stdout:2/935: dwrite d6/d20/d3a/d84/fcf [4194304,4194304] 0 2023-12-09T02:34:57.060 INFO:tasks.workunit.client.0.smithi088.stdout:2/936: write d6/d8/d4e/ff5 [4684244,8072] 0 2023-12-09T02:34:57.061 INFO:tasks.workunit.client.0.smithi088.stdout:6/823: dwrite d16/d35/d36/d97/d90/fe6 [0,4194304] 0 2023-12-09T02:34:57.061 INFO:tasks.workunit.client.0.smithi088.stdout:7/890: dwrite dc/d21/d6b/d93/f122 [0,4194304] 0 2023-12-09T02:34:57.062 INFO:tasks.workunit.client.0.smithi088.stdout:4/864: dwrite d3/dc/d18/dab/dc7/dd7/f116 [0,4194304] 0 2023-12-09T02:34:57.062 INFO:tasks.workunit.client.0.smithi088.stdout:4/865: fsync f0 0 2023-12-09T02:34:57.063 INFO:tasks.workunit.client.0.smithi088.stdout:0/858: dread df/d10/f1e [0,4194304] 0 2023-12-09T02:34:57.064 INFO:tasks.workunit.client.0.smithi088.stdout:8/955: unlink d2/d10f/faf 0 2023-12-09T02:34:57.068 INFO:tasks.workunit.client.0.smithi088.stdout:3/823: getdents d1/d9/dbf 0 2023-12-09T02:34:57.078 INFO:tasks.workunit.client.0.smithi088.stdout:7/891: mkdir dc/d1b/d72/dc4/d132 0 2023-12-09T02:34:57.079 INFO:tasks.workunit.client.0.smithi088.stdout:2/937: dwrite d6/d13/f101 [0,4194304] 0 2023-12-09T02:34:57.081 INFO:tasks.workunit.client.0.smithi088.stdout:4/866: symlink d3/dc/d18/dab/dc7/dd7/l118 0 2023-12-09T02:34:57.085 INFO:tasks.workunit.client.0.smithi088.stdout:6/824: dwrite d16/d1b/d2c/d3f/d41/f4b [4194304,4194304] 0 2023-12-09T02:34:57.087 INFO:tasks.workunit.client.0.smithi088.stdout:0/859: mkdir df/dd0/d119 0 2023-12-09T02:34:57.088 INFO:tasks.workunit.client.0.smithi088.stdout:8/956: symlink d2/d9/d13/d1c/d5f/d84/dfd/l137 0 2023-12-09T02:34:57.091 INFO:tasks.workunit.client.0.smithi088.stdout:2/938: truncate d6/d20/d3a/fd9 1705538 0 2023-12-09T02:34:57.095 INFO:tasks.workunit.client.0.smithi088.stdout:4/867: link d3/dc/d43/d8c/d95/f51 d3/dc/d18/d29/f119 0 2023-12-09T02:34:57.097 INFO:tasks.workunit.client.0.smithi088.stdout:6/825: symlink d16/d1b/d25/d5f/lf1 0 2023-12-09T02:34:57.099 INFO:tasks.workunit.client.0.smithi088.stdout:0/860: link df/d28/d33/c9b df/d37/d97/c11a 0 2023-12-09T02:34:57.099 INFO:tasks.workunit.client.0.smithi088.stdout:0/861: chown df/c12 848373 1 2023-12-09T02:34:57.101 INFO:tasks.workunit.client.0.smithi088.stdout:8/957: mknod d2/d9/d70/d8f/da8/d119/d120/c138 0 2023-12-09T02:34:57.102 INFO:tasks.workunit.client.0.smithi088.stdout:4/868: rmdir d3/dc/d43/d8c/d95/daa/db7 39 2023-12-09T02:34:57.105 INFO:tasks.workunit.client.0.smithi088.stdout:6/826: mkdir d16/d1b/d2c/d3f/d83/df2 0 2023-12-09T02:34:57.106 INFO:tasks.workunit.client.0.smithi088.stdout:0/862: symlink df/d10/d22/ded/df0/l11b 0 2023-12-09T02:34:57.106 INFO:tasks.workunit.client.0.smithi088.stdout:0/863: chown df/d10/d22/c10f 12 1 2023-12-09T02:34:57.106 INFO:tasks.workunit.client.0.smithi088.stdout:0/864: truncate df/d10/d22/d5f/f87 2135192 0 2023-12-09T02:34:57.108 INFO:tasks.workunit.client.0.smithi088.stdout:2/939: dwrite d6/d8/d4e/d3c/fb5 [0,4194304] 0 2023-12-09T02:34:57.111 INFO:tasks.workunit.client.0.smithi088.stdout:7/892: dwrite dc/d21/d6b/d6d/da4/d3e/f5a [0,4194304] 0 2023-12-09T02:34:57.111 INFO:tasks.workunit.client.0.smithi088.stdout:6/827: dread d16/d35/d36/d97/d90/fb9 [0,4194304] 0 2023-12-09T02:34:57.115 INFO:tasks.workunit.client.0.smithi088.stdout:7/893: link dc/d21/c68 dc/d21/d6b/d6d/da4/c133 0 2023-12-09T02:34:57.116 INFO:tasks.workunit.client.0.smithi088.stdout:7/894: chown dc/d21/d6b/d6d/da4/f55 46352977 1 2023-12-09T02:34:57.116 INFO:tasks.workunit.client.0.smithi088.stdout:7/895: dread - dc/d21/d6b/d6d/da4/d38/d1e/f5f zero size 2023-12-09T02:34:57.116 INFO:tasks.workunit.client.0.smithi088.stdout:7/896: chown dc/d21/d7f/cfb 117 1 2023-12-09T02:34:57.116 INFO:tasks.workunit.client.0.smithi088.stdout:0/865: dread df/d10/d22/f54 [0,4194304] 0 2023-12-09T02:34:57.117 INFO:tasks.workunit.client.0.smithi088.stdout:0/866: chown df/d10/d22/c40 18 1 2023-12-09T02:34:57.118 INFO:tasks.workunit.client.0.smithi088.stdout:0/867: creat df/d10/d22/d5f/f11c x:0 0 0 2023-12-09T02:34:57.118 INFO:tasks.workunit.client.0.smithi088.stdout:0/868: readlink df/d10/d22/l7d 0 2023-12-09T02:34:57.118 INFO:tasks.workunit.client.0.smithi088.stdout:0/869: truncate df/d10/d22/d2d/d96/fe3 671198 0 2023-12-09T02:34:57.124 INFO:tasks.workunit.client.0.smithi088.stdout:6/828: dread d16/f99 [0,4194304] 0 2023-12-09T02:34:57.128 INFO:tasks.workunit.client.0.smithi088.stdout:6/829: mkdir d16/d1b/d2c/d3f/d83/de4/df3 0 2023-12-09T02:34:57.132 INFO:tasks.workunit.client.0.smithi088.stdout:6/830: getdents d16/d1b/d56 0 2023-12-09T02:34:57.133 INFO:tasks.workunit.client.0.smithi088.stdout:6/831: creat d16/d35/d36/d97/ff4 x:0 0 0 2023-12-09T02:34:57.135 INFO:tasks.workunit.client.0.smithi088.stdout:8/958: dwrite d2/d9/d1a/d62/fe6 [0,4194304] 0 2023-12-09T02:34:57.135 INFO:tasks.workunit.client.0.smithi088.stdout:4/869: dwrite d3/dc/d18/d8d/fc0 [4194304,4194304] 0 2023-12-09T02:34:57.137 INFO:tasks.workunit.client.0.smithi088.stdout:8/959: mknod d2/d9/d70/d8f/d98/d9b/c139 0 2023-12-09T02:34:57.137 INFO:tasks.workunit.client.0.smithi088.stdout:8/960: dread - d2/d9/d70/d8f/d98/d9b/fe0 zero size 2023-12-09T02:34:57.138 INFO:tasks.workunit.client.0.smithi088.stdout:4/870: mkdir d3/dc/d18/d7b/d11a 0 2023-12-09T02:34:57.139 INFO:tasks.workunit.client.0.smithi088.stdout:2/940: dwrite d6/d8/d4e/d64/fe4 [0,4194304] 0 2023-12-09T02:34:57.139 INFO:tasks.workunit.client.0.smithi088.stdout:0/870: dwrite df/d10/f1e [0,4194304] 0 2023-12-09T02:34:57.140 INFO:tasks.workunit.client.0.smithi088.stdout:8/961: getdents d2/d2b 0 2023-12-09T02:34:57.147 INFO:tasks.workunit.client.0.smithi088.stdout:4/871: dread d3/dc/d18/da9/fdb [0,4194304] 0 2023-12-09T02:34:57.152 INFO:tasks.workunit.client.0.smithi088.stdout:2/941: dread d6/d8/d1f/d22/f40 [0,4194304] 0 2023-12-09T02:34:57.153 INFO:tasks.workunit.client.0.smithi088.stdout:0/871: dread df/d28/d34/dc8/fdb [0,4194304] 0 2023-12-09T02:34:57.153 INFO:tasks.workunit.client.0.smithi088.stdout:8/962: dwrite d2/d9/d1a/f7d [4194304,4194304] 0 2023-12-09T02:34:57.153 INFO:tasks.workunit.client.0.smithi088.stdout:8/963: dread - d2/d9/d70/d8f/d98/d9b/fda zero size 2023-12-09T02:34:57.154 INFO:tasks.workunit.client.0.smithi088.stdout:2/942: creat d6/d13/d42/d89/f13a x:0 0 0 2023-12-09T02:34:57.154 INFO:tasks.workunit.client.0.smithi088.stdout:2/943: fsync d6/d20/d3a/fd9 0 2023-12-09T02:34:57.154 INFO:tasks.workunit.client.0.smithi088.stdout:0/872: write df/d28/f6c [81671,42228] 0 2023-12-09T02:34:57.154 INFO:tasks.workunit.client.0.smithi088.stdout:0/873: truncate df/d37/d97/f105 301298 0 2023-12-09T02:34:57.156 INFO:tasks.workunit.client.0.smithi088.stdout:8/964: symlink d2/d9/d13/d1c/d5f/d96/dec/l13a 0 2023-12-09T02:34:57.157 INFO:tasks.workunit.client.0.smithi088.stdout:0/874: creat df/d28/d33/f11d x:0 0 0 2023-12-09T02:34:57.157 INFO:tasks.workunit.client.0.smithi088.stdout:0/875: truncate df/d10/d22/d5f/fae 915568 0 2023-12-09T02:34:57.158 INFO:tasks.workunit.client.0.smithi088.stdout:8/965: rmdir d2/d9/d1a/d65/d114 39 2023-12-09T02:34:57.160 INFO:tasks.workunit.client.0.smithi088.stdout:0/876: mknod df/d10/d22/d100/c11e 0 2023-12-09T02:34:57.160 INFO:tasks.workunit.client.0.smithi088.stdout:0/877: chown df/d10/d22/d5f/ccf 440938411 1 2023-12-09T02:34:57.160 INFO:tasks.workunit.client.0.smithi088.stdout:0/878: getdents df/dd0/d119 0 2023-12-09T02:34:57.161 INFO:tasks.workunit.client.0.smithi088.stdout:0/879: rmdir df/d10/d22/d100 39 2023-12-09T02:34:57.168 INFO:tasks.workunit.client.0.smithi088.stdout:0/880: symlink df/d28/d43/l11f 0 2023-12-09T02:34:57.168 INFO:tasks.workunit.client.0.smithi088.stdout:0/881: readlink df/d10/l78 0 2023-12-09T02:34:57.168 INFO:tasks.workunit.client.0.smithi088.stdout:0/882: write df/d10/fd8 [44030,126215] 0 2023-12-09T02:34:57.168 INFO:tasks.workunit.client.0.smithi088.stdout:0/883: fsync df/d10/d22/d2d/d6a/fb0 0 2023-12-09T02:34:57.169 INFO:tasks.workunit.client.0.smithi088.stdout:0/884: mknod df/d28/df3/c120 0 2023-12-09T02:34:57.169 INFO:tasks.workunit.client.0.smithi088.stdout:0/885: truncate df/d28/d33/f11d 841761 0 2023-12-09T02:34:57.169 INFO:tasks.workunit.client.0.smithi088.stdout:0/886: readlink df/l85 0 2023-12-09T02:34:57.169 INFO:tasks.workunit.client.0.smithi088.stdout:0/887: readlink df/ldd 0 2023-12-09T02:34:57.170 INFO:tasks.workunit.client.0.smithi088.stdout:0/888: getdents df/d10/d22/ded 0 2023-12-09T02:34:57.172 INFO:tasks.workunit.client.0.smithi088.stdout:4/872: dwrite d3/dc/d43/d83/d37/fbe [0,4194304] 0 2023-12-09T02:34:57.174 INFO:tasks.workunit.client.0.smithi088.stdout:0/889: dread df/d10/d22/d5f/f87 [0,4194304] 0 2023-12-09T02:34:57.175 INFO:tasks.workunit.client.0.smithi088.stdout:4/873: link d3/dc/d43/d8c/d95/fb1 d3/dc/d18/da9/f11b 0 2023-12-09T02:34:57.175 INFO:tasks.workunit.client.0.smithi088.stdout:4/874: fdatasync d3/dc/d43/d8c/d95/daa/db7/f112 0 2023-12-09T02:34:57.175 INFO:tasks.workunit.client.0.smithi088.stdout:4/875: write d3/dc/d43/d8c/fa5 [4351073,60344] 0 2023-12-09T02:34:57.175 INFO:tasks.workunit.client.0.smithi088.stdout:4/876: readlink d3/dc/d43/l77 0 2023-12-09T02:34:57.175 INFO:tasks.workunit.client.0.smithi088.stdout:4/877: chown d3/dc/d88/cf7 16 1 2023-12-09T02:34:57.175 INFO:tasks.workunit.client.0.smithi088.stdout:0/890: mkdir df/d10/d22/d2d/d6a/deb/d121 0 2023-12-09T02:34:57.177 INFO:tasks.workunit.client.0.smithi088.stdout:4/878: mknod d3/dc/d43/d8c/d95/d110/c11c 0 2023-12-09T02:34:57.177 INFO:tasks.workunit.client.0.smithi088.stdout:4/879: chown d3/dc/f14 29031653 1 2023-12-09T02:34:57.180 INFO:tasks.workunit.client.0.smithi088.stdout:2/944: dwrite d6/d8/d4e/da2/db8/dfc/dc2/ddf/fee [0,4194304] 0 2023-12-09T02:34:57.180 INFO:tasks.workunit.client.0.smithi088.stdout:8/966: dwrite d2/d9/d70/d8f/da8/d119/d132/f134 [0,4194304] 0 2023-12-09T02:34:57.183 INFO:tasks.workunit.client.0.smithi088.stdout:2/945: symlink d6/d13/l13b 0 2023-12-09T02:34:57.183 INFO:tasks.workunit.client.0.smithi088.stdout:2/946: readlink d6/d8/d4e/d3c/la0 0 2023-12-09T02:34:57.187 INFO:tasks.workunit.client.0.smithi088.stdout:2/947: mkdir d6/d8/d4e/d13c 0 2023-12-09T02:34:57.189 INFO:tasks.workunit.client.0.smithi088.stdout:2/948: truncate d6/d13/f1e 973273 0 2023-12-09T02:34:57.191 INFO:tasks.workunit.client.0.smithi088.stdout:2/949: write d6/d8/d4e/d47/f105 [3222206,128492] 0 2023-12-09T02:34:57.191 INFO:tasks.workunit.client.0.smithi088.stdout:2/950: chown d6/d8/d73/d78/l95 117 1 2023-12-09T02:34:57.198 INFO:tasks.workunit.client.0.smithi088.stdout:8/967: dwrite d2/d10f/f68 [0,4194304] 0 2023-12-09T02:34:57.200 INFO:tasks.workunit.client.0.smithi088.stdout:8/968: rmdir d2/d9/d1a/d62/d9a/de8 39 2023-12-09T02:34:57.200 INFO:tasks.workunit.client.0.smithi088.stdout:8/969: write d2/d9/d13/d1c/d3b/f10d [938231,7066] 0 2023-12-09T02:34:57.200 INFO:tasks.workunit.client.0.smithi088.stdout:8/970: readlink d2/d10f/lee 0 2023-12-09T02:34:57.202 INFO:tasks.workunit.client.0.smithi088.stdout:8/971: rmdir d2/d9/d13/d1c/d5f 39 2023-12-09T02:34:57.202 INFO:tasks.workunit.client.0.smithi088.stdout:8/972: read d2/d9/d13/d1c/d5f/d84/f127 [1630,52333] 0 2023-12-09T02:34:57.209 INFO:tasks.workunit.client.0.smithi088.stdout:2/951: dwrite d6/d8/d4e/d64/f66 [0,4194304] 0 2023-12-09T02:34:57.229 INFO:tasks.workunit.client.0.smithi088.stdout:8/973: dwrite d2/f54 [0,4194304] 0 2023-12-09T02:34:57.229 INFO:tasks.workunit.client.0.smithi088.stdout:2/952: dwrite d6/d8/deb/ffd [0,4194304] 0 2023-12-09T02:34:57.229 INFO:tasks.workunit.client.0.smithi088.stdout:8/974: write d2/d9/d13/d1c/fd3 [424418,131018] 0 2023-12-09T02:34:57.233 INFO:tasks.workunit.client.0.smithi088.stdout:2/953: mknod d6/d20/c13d 0 2023-12-09T02:34:57.233 INFO:tasks.workunit.client.0.smithi088.stdout:2/954: stat d6/d8/f46 0 2023-12-09T02:34:57.235 INFO:tasks.workunit.client.0.smithi088.stdout:8/975: truncate d2/d9/f51 1551350 0 2023-12-09T02:34:57.235 INFO:tasks.workunit.client.0.smithi088.stdout:8/976: chown d2/d9/d13/f2f 2438213 1 2023-12-09T02:34:57.235 INFO:tasks.workunit.client.0.smithi088.stdout:8/977: fdatasync d2/f28 0 2023-12-09T02:34:57.235 INFO:tasks.workunit.client.0.smithi088.stdout:8/978: readlink d2/d9/d1a/l3f 0 2023-12-09T02:34:57.237 INFO:tasks.workunit.client.0.smithi088.stdout:8/979: creat d2/d9/d70/d8f/da8/f13b x:0 0 0 2023-12-09T02:34:57.237 INFO:tasks.workunit.client.0.smithi088.stdout:8/980: write d2/d9/d70/d8f/d98/fe4 [6103365,29778] 0 2023-12-09T02:34:57.237 INFO:tasks.workunit.client.0.smithi088.stdout:8/981: chown d2/d9/d1a/l3f 1594206 1 2023-12-09T02:34:57.241 INFO:tasks.workunit.client.0.smithi088.stdout:8/982: mkdir d2/d9/d13/d1c/d5f/d13c 0 2023-12-09T02:34:57.242 INFO:tasks.workunit.client.0.smithi088.stdout:8/983: creat d2/d9/d1a/d65/d114/f13d x:0 0 0 2023-12-09T02:34:57.244 INFO:tasks.workunit.client.0.smithi088.stdout:8/984: symlink d2/d9/d1a/l13e 0 2023-12-09T02:34:57.245 INFO:tasks.workunit.client.0.smithi088.stdout:8/985: mkdir d2/d9/d70/d8f/da8/d13f 0 2023-12-09T02:34:57.247 INFO:tasks.workunit.client.0.smithi088.stdout:8/986: symlink d2/d9/d1a/d62/d49/l140 0 2023-12-09T02:34:57.251 INFO:tasks.workunit.client.0.smithi088.stdout:2/955: dwrite d6/d13/f101 [0,4194304] 0 2023-12-09T02:34:57.256 INFO:tasks.workunit.client.0.smithi088.stdout:2/956: write d6/d8/d4e/dc9/fd1 [950151,98197] 0 2023-12-09T02:34:57.257 INFO:tasks.workunit.client.0.smithi088.stdout:2/957: write d6/d13/f101 [2644854,24325] 0 2023-12-09T02:34:57.262 INFO:tasks.workunit.client.0.smithi088.stdout:1/948: sync 2023-12-09T02:34:57.262 INFO:tasks.workunit.client.0.smithi088.stdout:9/989: sync 2023-12-09T02:34:57.262 INFO:tasks.workunit.client.0.smithi088.stdout:5/942: sync 2023-12-09T02:34:57.262 INFO:tasks.workunit.client.0.smithi088.stdout:3/824: sync 2023-12-09T02:34:57.262 INFO:tasks.workunit.client.0.smithi088.stdout:7/897: sync 2023-12-09T02:34:57.262 INFO:tasks.workunit.client.0.smithi088.stdout:7/898: stat fb 0 2023-12-09T02:34:57.262 INFO:tasks.workunit.client.0.smithi088.stdout:5/943: rmdir d3/d15/de/d10/d18/d19/d20 39 2023-12-09T02:34:57.262 INFO:tasks.workunit.client.0.smithi088.stdout:5/944: fsync d3/d15/d2e/ff4 0 2023-12-09T02:34:57.263 INFO:tasks.workunit.client.0.smithi088.stdout:9/990: mknod df/d20/d5b/d91/c14a 0 2023-12-09T02:34:57.263 INFO:tasks.workunit.client.0.smithi088.stdout:1/949: creat d8/d27/f144 x:0 0 0 2023-12-09T02:34:57.264 INFO:tasks.workunit.client.0.smithi088.stdout:7/899: chown dc/d21/d6b/d6d/da4/d3e/d97/fe3 14863 1 2023-12-09T02:34:57.264 INFO:tasks.workunit.client.0.smithi088.stdout:1/950: write d8/d27/f112 [3848546,62487] 0 2023-12-09T02:34:57.265 INFO:tasks.workunit.client.0.smithi088.stdout:5/945: creat d3/d15/dc/d60/d9d/f142 x:0 0 0 2023-12-09T02:34:57.266 INFO:tasks.workunit.client.0.smithi088.stdout:9/991: creat df/d20/d30/d60/dca/f14b x:0 0 0 2023-12-09T02:34:57.268 INFO:tasks.workunit.client.0.smithi088.stdout:7/900: unlink dc/d21/d6b/d6d/d76/le1 0 2023-12-09T02:34:57.269 INFO:tasks.workunit.client.0.smithi088.stdout:1/951: symlink d8/d3d/d5d/d95/l145 0 2023-12-09T02:34:57.270 INFO:tasks.workunit.client.0.smithi088.stdout:3/825: dread d1/d9/d6f/d2d/db9/fb8 [0,4194304] 0 2023-12-09T02:34:57.271 INFO:tasks.workunit.client.0.smithi088.stdout:9/992: mknod df/d20/d5b/d91/d10a/d101/c14c 0 2023-12-09T02:34:57.271 INFO:tasks.workunit.client.0.smithi088.stdout:9/993: dread - df/d20/d5b/d91/d10a/d140/f148 zero size 2023-12-09T02:34:57.271 INFO:tasks.workunit.client.0.smithi088.stdout:9/994: chown df/d20/d30/d3f/fab 392 1 2023-12-09T02:34:57.271 INFO:tasks.workunit.client.0.smithi088.stdout:9/995: write df/d20/d4c/fc1 [1650943,4232] 0 2023-12-09T02:34:57.272 INFO:tasks.workunit.client.0.smithi088.stdout:1/952: creat d8/d3d/d5d/d95/f146 x:0 0 0 2023-12-09T02:34:57.272 INFO:tasks.workunit.client.0.smithi088.stdout:1/953: fdatasync d8/d27/faa 0 2023-12-09T02:34:57.272 INFO:tasks.workunit.client.0.smithi088.stdout:3/826: creat d1/d9/d6f/f118 x:0 0 0 2023-12-09T02:34:57.273 INFO:tasks.workunit.client.0.smithi088.stdout:9/996: creat df/d20/d4c/d97/d134/d12b/f14d x:0 0 0 2023-12-09T02:34:57.274 INFO:tasks.workunit.client.0.smithi088.stdout:1/954: creat d8/d1c/d50/d6c/df7/f147 x:0 0 0 2023-12-09T02:34:57.274 INFO:tasks.workunit.client.0.smithi088.stdout:9/997: dread df/f3d [0,4194304] 0 2023-12-09T02:34:57.274 INFO:tasks.workunit.client.0.smithi088.stdout:5/946: dread d3/d15/de/d10/d18/d19/d1b/d35/d42/f21 [0,4194304] 0 2023-12-09T02:34:57.274 INFO:tasks.workunit.client.0.smithi088.stdout:3/827: write d1/d9/d6f/d6/fac [418228,122770] 0 2023-12-09T02:34:57.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/955: creat d8/d1b/d1d/dc7/f148 x:0 0 0 2023-12-09T02:34:57.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/956: chown d8/d3d/d5d/c133 0 1 2023-12-09T02:34:57.277 INFO:tasks.workunit.client.0.smithi088.stdout:5/947: dread d3/d15/de/d10/d51/db4/f9f [0,4194304] 0 2023-12-09T02:34:57.277 INFO:tasks.workunit.client.0.smithi088.stdout:9/998: mknod df/d20/d4c/c14e 0 2023-12-09T02:34:57.278 INFO:tasks.workunit.client.0.smithi088.stdout:9/999: write df/d20/d5b/d91/f8b [2245405,115670] 0 2023-12-09T02:34:57.279 INFO:tasks.workunit.client.0.smithi088.stdout:3/828: mkdir d1/d9/d6f/d22/d7f/d117/d119 0 2023-12-09T02:34:57.279 INFO:tasks.workunit.client.0.smithi088.stdout:1/957: getdents d8/d27/d9a 0 2023-12-09T02:34:57.279 INFO:tasks.workunit.client.0.smithi088.stdout:1/958: chown d8/d3d/d5d/d95/dac/db9/c119 5 1 2023-12-09T02:34:57.280 INFO:tasks.workunit.client.0.smithi088.stdout:1/959: write d8/d27/d40/fa7 [571408,95632] 0 2023-12-09T02:34:57.280 INFO:tasks.workunit.client.0.smithi088.stdout:7/901: dwrite dc/d21/d7f/fa1 [0,4194304] 0 2023-12-09T02:34:57.283 INFO:tasks.workunit.client.0.smithi088.stdout:5/948: creat d3/d15/de/d10/d51/dc9/dc4/f143 x:0 0 0 2023-12-09T02:34:57.283 INFO:tasks.workunit.client.0.smithi088.stdout:5/949: chown d3/d15/de/d10/d18/d19/d1b/d35/ff0 0 1 2023-12-09T02:34:57.283 INFO:tasks.workunit.client.0.smithi088.stdout:5/950: fdatasync d3/d15/de/d10/d51/d7f/ff2 0 2023-12-09T02:34:57.284 INFO:tasks.workunit.client.0.smithi088.stdout:1/960: mkdir d8/d1b/d149 0 2023-12-09T02:34:57.285 INFO:tasks.workunit.client.0.smithi088.stdout:1/961: write d8/f124 [1638321,61441] 0 2023-12-09T02:34:57.286 INFO:tasks.workunit.client.0.smithi088.stdout:7/902: symlink dc/d1b/d66/l134 0 2023-12-09T02:34:57.287 INFO:tasks.workunit.client.0.smithi088.stdout:7/903: write dc/d1b/d82/f128 [813116,56093] 0 2023-12-09T02:34:57.288 INFO:tasks.workunit.client.0.smithi088.stdout:5/951: creat d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/f144 x:0 0 0 2023-12-09T02:34:57.289 INFO:tasks.workunit.client.0.smithi088.stdout:1/962: mkdir d8/d1c/d50/dc5/d14a 0 2023-12-09T02:34:57.289 INFO:tasks.workunit.client.0.smithi088.stdout:1/963: chown d8/d3d/d5d/d82/ld2 23 1 2023-12-09T02:34:57.290 INFO:tasks.workunit.client.0.smithi088.stdout:7/904: rename dc/d21/d6b/ld5 to dc/d21/d6b/l135 0 2023-12-09T02:34:57.290 INFO:tasks.workunit.client.0.smithi088.stdout:7/905: chown dc/d21/d6b/d6d/da4/d38/l9c 24229426 1 2023-12-09T02:34:57.291 INFO:tasks.workunit.client.0.smithi088.stdout:5/952: truncate d3/d15/de/d10/d51/db4/d109/f10d 4185955 0 2023-12-09T02:34:57.291 INFO:tasks.workunit.client.0.smithi088.stdout:5/953: chown d3/d15/de/d10/d51/ce4 334 1 2023-12-09T02:34:57.293 INFO:tasks.workunit.client.0.smithi088.stdout:7/906: link dc/d21/d6b/d6d/d76/l10b dc/l136 0 2023-12-09T02:34:57.296 INFO:tasks.workunit.client.0.smithi088.stdout:7/907: dread dc/fc3 [0,4194304] 0 2023-12-09T02:34:57.298 INFO:tasks.workunit.client.0.smithi088.stdout:3/829: dwrite d1/d9/d6f/d6/d4a/d41/fd2 [0,4194304] 0 2023-12-09T02:34:57.298 INFO:tasks.workunit.client.0.smithi088.stdout:3/830: fsync d1/d9/d6f/d22/d7f/d117/ddf/fe2 0 2023-12-09T02:34:57.302 INFO:tasks.workunit.client.0.smithi088.stdout:3/831: unlink d1/d9/le0 0 2023-12-09T02:34:57.302 INFO:tasks.workunit.client.0.smithi088.stdout:3/832: chown d1/d9/d6f/d6/d4a/d41/d10b/ced 0 1 2023-12-09T02:34:57.304 INFO:tasks.workunit.client.0.smithi088.stdout:3/833: rmdir d1/d9/d6f/d2d/dab/dc5 39 2023-12-09T02:34:57.309 INFO:tasks.workunit.client.0.smithi088.stdout:3/834: write d1/d9/d6f/d2d/d66/f6e [2546163,115876] 0 2023-12-09T02:34:57.312 INFO:tasks.workunit.client.0.smithi088.stdout:3/835: read d1/d9/d6f/d6/fe6 [3841181,99328] 0 2023-12-09T02:34:57.313 INFO:tasks.workunit.client.0.smithi088.stdout:3/836: unlink d1/d9/d6f/d6/d4a/d41/d33/l57 0 2023-12-09T02:34:57.314 INFO:tasks.workunit.client.0.smithi088.stdout:3/837: mknod d1/d9/d6f/d22/d7f/d117/ddf/c11a 0 2023-12-09T02:34:57.315 INFO:tasks.workunit.client.0.smithi088.stdout:1/964: dwrite d8/d3d/d44/f6b [4194304,4194304] 0 2023-12-09T02:34:57.315 INFO:tasks.workunit.client.0.smithi088.stdout:5/954: dwrite d3/fda [0,4194304] 0 2023-12-09T02:34:57.315 INFO:tasks.workunit.client.0.smithi088.stdout:7/908: dwrite dc/d21/ff5 [0,4194304] 0 2023-12-09T02:34:57.316 INFO:tasks.workunit.client.0.smithi088.stdout:7/909: write dc/fe0 [100232,2332] 0 2023-12-09T02:34:57.317 INFO:tasks.workunit.client.0.smithi088.stdout:3/838: fdatasync d1/d9/d6f/d2d/d66/f6e 0 2023-12-09T02:34:57.318 INFO:tasks.workunit.client.0.smithi088.stdout:1/965: mkdir d8/d3d/d5d/d95/d14b 0 2023-12-09T02:34:57.318 INFO:tasks.workunit.client.0.smithi088.stdout:1/966: write d8/d27/f5e [360638,78322] 0 2023-12-09T02:34:57.322 INFO:tasks.workunit.client.0.smithi088.stdout:5/955: dread d3/d15/dc/f2d [0,4194304] 0 2023-12-09T02:34:57.327 INFO:tasks.workunit.client.0.smithi088.stdout:7/910: dread dc/d21/d6b/d6d/da4/d38/f17 [0,4194304] 0 2023-12-09T02:34:57.328 INFO:tasks.workunit.client.0.smithi088.stdout:3/839: getdents d1/d9/d6f/d2d/dab/dc5/dc9/dce 0 2023-12-09T02:34:57.329 INFO:tasks.workunit.client.0.smithi088.stdout:3/840: chown d1/d73/cb7 0 1 2023-12-09T02:34:57.329 INFO:tasks.workunit.client.0.smithi088.stdout:3/841: dread - d1/d9/d6f/d22/d7f/d117/ddf/f10f zero size 2023-12-09T02:34:57.329 INFO:tasks.workunit.client.0.smithi088.stdout:3/842: dread - d1/d9/d6f/d2d/d66/f9e zero size 2023-12-09T02:34:57.333 INFO:tasks.workunit.client.0.smithi088.stdout:5/956: creat d3/d15/de/d10/d18/d19/d1b/d35/d61/ded/f145 x:0 0 0 2023-12-09T02:34:57.333 INFO:tasks.workunit.client.0.smithi088.stdout:3/843: creat d1/d9/f11b x:0 0 0 2023-12-09T02:34:57.334 INFO:tasks.workunit.client.0.smithi088.stdout:4/880: sync 2023-12-09T02:34:57.334 INFO:tasks.workunit.client.0.smithi088.stdout:0/891: sync 2023-12-09T02:34:57.334 INFO:tasks.workunit.client.0.smithi088.stdout:6/832: sync 2023-12-09T02:34:57.334 INFO:tasks.workunit.client.0.smithi088.stdout:6/833: chown d16/d35/d36/ddf 24608342 1 2023-12-09T02:34:57.335 INFO:tasks.workunit.client.0.smithi088.stdout:0/892: truncate df/d37/d97/f105 418973 0 2023-12-09T02:34:57.335 INFO:tasks.workunit.client.0.smithi088.stdout:6/834: write d16/d1b/d25/d5f/fcb [1605200,65201] 0 2023-12-09T02:34:57.335 INFO:tasks.workunit.client.0.smithi088.stdout:5/957: rename d3/d8/l12 to d3/d15/de/d10/d51/l146 0 2023-12-09T02:34:57.335 INFO:tasks.workunit.client.0.smithi088.stdout:5/958: fsync d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/fd5 0 2023-12-09T02:34:57.337 INFO:tasks.workunit.client.0.smithi088.stdout:0/893: symlink df/d10/d22/d2d/d6a/deb/l122 0 2023-12-09T02:34:57.339 INFO:tasks.workunit.client.0.smithi088.stdout:0/894: write df/d28/d43/f46 [8268030,108544] 0 2023-12-09T02:34:57.339 INFO:tasks.workunit.client.0.smithi088.stdout:5/959: mkdir d3/d15/de/d10/d18/d19/d1b/d35/d42/d13b/d147 0 2023-12-09T02:34:57.339 INFO:tasks.workunit.client.0.smithi088.stdout:5/960: read d3/d15/de/d10/d18/da5/fb1 [2402937,79756] 0 2023-12-09T02:34:57.340 INFO:tasks.workunit.client.0.smithi088.stdout:5/961: dread - d3/d15/de/d10/d18/d19/d1b/d35/d61/feb zero size 2023-12-09T02:34:57.340 INFO:tasks.workunit.client.0.smithi088.stdout:3/844: link d1/d9/d6f/d22/d7f/d117/ddf/c11a d1/d9/d6f/d6/d4a/d41/d33/c11c 0 2023-12-09T02:34:57.340 INFO:tasks.workunit.client.0.smithi088.stdout:6/835: symlink d16/d1b/d25/lf5 0 2023-12-09T02:34:57.342 INFO:tasks.workunit.client.0.smithi088.stdout:5/962: rename d3/d15/de/d10/c123 to d3/d15/de/d73/c148 0 2023-12-09T02:34:57.343 INFO:tasks.workunit.client.0.smithi088.stdout:3/845: getdents d1/d73 0 2023-12-09T02:34:57.343 INFO:tasks.workunit.client.0.smithi088.stdout:1/967: dwrite d8/d27/d66/d79/ddc/f11a [0,4194304] 0 2023-12-09T02:34:57.343 INFO:tasks.workunit.client.0.smithi088.stdout:7/911: dwrite dc/d21/d6b/dbb/fcc [0,4194304] 0 2023-12-09T02:34:57.345 INFO:tasks.workunit.client.0.smithi088.stdout:0/895: dread df/d28/f6c [0,4194304] 0 2023-12-09T02:34:57.345 INFO:tasks.workunit.client.0.smithi088.stdout:3/846: symlink d1/d9/d6f/d2d/dab/d112/l11d 0 2023-12-09T02:34:57.345 INFO:tasks.workunit.client.0.smithi088.stdout:0/896: readlink df/d10/d22/d2d/d2e/l8c 0 2023-12-09T02:34:57.345 INFO:tasks.workunit.client.0.smithi088.stdout:0/897: fsync f6 0 2023-12-09T02:34:57.345 INFO:tasks.workunit.client.0.smithi088.stdout:0/898: readlink df/d10/d22/la5 0 2023-12-09T02:34:57.351 INFO:tasks.workunit.client.0.smithi088.stdout:7/912: link dc/d21/c14 dc/d1b/d72/dc4/c137 0 2023-12-09T02:34:57.351 INFO:tasks.workunit.client.0.smithi088.stdout:5/963: write d3/d15/de/d10/d18/d19/d1b/f1c [2703103,102510] 0 2023-12-09T02:34:57.353 INFO:tasks.workunit.client.0.smithi088.stdout:3/847: creat d1/d9/d6f/d2d/dab/dc5/dc9/f11e x:0 0 0 2023-12-09T02:34:57.353 INFO:tasks.workunit.client.0.smithi088.stdout:3/848: dread - d1/d9/dbf/ffc zero size 2023-12-09T02:34:57.353 INFO:tasks.workunit.client.0.smithi088.stdout:3/849: chown d1 13251 1 2023-12-09T02:34:57.354 INFO:tasks.workunit.client.0.smithi088.stdout:7/913: rename dc/d21/d6b/d6d/dcd to dc/d1b/d72/dc4/d138 0 2023-12-09T02:34:57.357 INFO:tasks.workunit.client.0.smithi088.stdout:3/850: write d1/d9/d6f/d6/d4a/f38 [502846,81551] 0 2023-12-09T02:34:57.359 INFO:tasks.workunit.client.0.smithi088.stdout:5/964: rename d3/d15/f101 to d3/d15/de/d10/d18/d19/d1b/d35/d58/f149 0 2023-12-09T02:34:57.359 INFO:tasks.workunit.client.0.smithi088.stdout:5/965: fsync d3/d15/de/d10/d18/d19/d20/f27 0 2023-12-09T02:34:57.359 INFO:tasks.workunit.client.0.smithi088.stdout:7/914: mknod dc/d1b/d82/c139 0 2023-12-09T02:34:57.359 INFO:tasks.workunit.client.0.smithi088.stdout:3/851: symlink d1/d9/d6f/d2d/db9/l11f 0 2023-12-09T02:34:57.359 INFO:tasks.workunit.client.0.smithi088.stdout:3/852: dread - d1/d9/f11b zero size 2023-12-09T02:34:57.359 INFO:tasks.workunit.client.0.smithi088.stdout:3/853: chown d1/d9/d6f/d6/d4a/f53 22 1 2023-12-09T02:34:57.360 INFO:tasks.workunit.client.0.smithi088.stdout:7/915: creat dc/d21/d6b/d9b/f13a x:0 0 0 2023-12-09T02:34:57.360 INFO:tasks.workunit.client.0.smithi088.stdout:7/916: fsync dc/d1b/f125 0 2023-12-09T02:34:57.361 INFO:tasks.workunit.client.0.smithi088.stdout:7/917: creat dc/dcb/de2/f13b x:0 0 0 2023-12-09T02:34:57.369 INFO:tasks.workunit.client.0.smithi088.stdout:3/854: dread d1/d9/d6f/d2d/dab/dc5/dc9/dce/f9c [0,4194304] 0 2023-12-09T02:34:57.369 INFO:tasks.workunit.client.0.smithi088.stdout:3/855: chown d1/d9/d6f/d2d/d109 8152743 1 2023-12-09T02:34:57.371 INFO:tasks.workunit.client.0.smithi088.stdout:3/856: read d1/d9/d6f/d15/f3a [2467636,19873] 0 2023-12-09T02:34:57.371 INFO:tasks.workunit.client.0.smithi088.stdout:7/918: dread dc/d1b/f5c [0,4194304] 0 2023-12-09T02:34:57.371 INFO:tasks.workunit.client.0.smithi088.stdout:7/919: dread - dc/d1b/d72/dec/fee zero size 2023-12-09T02:34:57.372 INFO:tasks.workunit.client.0.smithi088.stdout:3/857: mkdir d1/d9/d120 0 2023-12-09T02:34:57.374 INFO:tasks.workunit.client.0.smithi088.stdout:3/858: mknod d1/d9/d6f/d6/d4a/d41/d10b/db1/c121 0 2023-12-09T02:34:57.375 INFO:tasks.workunit.client.0.smithi088.stdout:3/859: stat d1/d9/d6f/d6/l40 0 2023-12-09T02:34:57.375 INFO:tasks.workunit.client.0.smithi088.stdout:3/860: dread - d1/d9/d6f/d6/d4a/d41/d33/d49/ff7 zero size 2023-12-09T02:34:57.375 INFO:tasks.workunit.client.0.smithi088.stdout:3/861: chown d1/d9/d6f/d22/f8a 501377507 1 2023-12-09T02:34:57.376 INFO:tasks.workunit.client.0.smithi088.stdout:3/862: readlink d1/d9/d6f/d6/d8b/l91 0 2023-12-09T02:34:57.376 INFO:tasks.workunit.client.0.smithi088.stdout:3/863: symlink d1/d9/d6f/d2d/d109/d85/ddc/l122 0 2023-12-09T02:34:57.376 INFO:tasks.workunit.client.0.smithi088.stdout:3/864: write d1/d9/d6f/d6/d4a/d41/d33/d49/fae [183245,96848] 0 2023-12-09T02:34:57.377 INFO:tasks.workunit.client.0.smithi088.stdout:2/958: sync 2023-12-09T02:34:57.377 INFO:tasks.workunit.client.0.smithi088.stdout:6/836: dwrite d16/d1b/d25/f40 [0,4194304] 0 2023-12-09T02:34:57.378 INFO:tasks.workunit.client.0.smithi088.stdout:2/959: symlink d6/d13/d42/l13e 0 2023-12-09T02:34:57.378 INFO:tasks.workunit.client.0.smithi088.stdout:2/960: dread - d6/d20/d69/fae zero size 2023-12-09T02:34:57.378 INFO:tasks.workunit.client.0.smithi088.stdout:1/968: dwrite d8/d3d/d44/d49/f65 [4194304,4194304] 0 2023-12-09T02:34:57.379 INFO:tasks.workunit.client.0.smithi088.stdout:6/837: creat d16/d1b/d25/d5f/d63/ff6 x:0 0 0 2023-12-09T02:34:57.379 INFO:tasks.workunit.client.0.smithi088.stdout:6/838: fsync d16/d62/d6f/da4/dc2/dc7/fd8 0 2023-12-09T02:34:57.380 INFO:tasks.workunit.client.0.smithi088.stdout:0/899: dwrite df/d10/d22/d2d/d96/fe8 [0,4194304] 0 2023-12-09T02:34:57.380 INFO:tasks.workunit.client.0.smithi088.stdout:0/900: chown df/d37/de2/f91 859318 1 2023-12-09T02:34:57.381 INFO:tasks.workunit.client.0.smithi088.stdout:2/961: mknod d6/d8/d73/d78/d121/c13f 0 2023-12-09T02:34:57.383 INFO:tasks.workunit.client.0.smithi088.stdout:1/969: symlink d8/d1b/d6d/d7c/ded/l14c 0 2023-12-09T02:34:57.383 INFO:tasks.workunit.client.0.smithi088.stdout:6/839: write d16/d35/d36/d97/d90/fe6 [1050152,118057] 0 2023-12-09T02:34:57.383 INFO:tasks.workunit.client.0.smithi088.stdout:6/840: truncate d16/d1b/d2c/d3f/d41/d80/fe5 866887 0 2023-12-09T02:34:57.384 INFO:tasks.workunit.client.0.smithi088.stdout:6/841: write d16/d1b/f26 [346733,74173] 0 2023-12-09T02:34:57.384 INFO:tasks.workunit.client.0.smithi088.stdout:6/842: dread - d16/d1b/d56/fa2 zero size 2023-12-09T02:34:57.384 INFO:tasks.workunit.client.0.smithi088.stdout:8/987: sync 2023-12-09T02:34:57.385 INFO:tasks.workunit.client.0.smithi088.stdout:5/966: dwrite d3/d15/de/d10/d18/d19/d20/ddf/f111 [0,4194304] 0 2023-12-09T02:34:57.385 INFO:tasks.workunit.client.0.smithi088.stdout:5/967: fsync d3/d15/de/d2c/f44 0 2023-12-09T02:34:57.388 INFO:tasks.workunit.client.0.smithi088.stdout:8/988: symlink d2/d9/d13/d1c/d5f/d84/l141 0 2023-12-09T02:34:57.391 INFO:tasks.workunit.client.0.smithi088.stdout:2/962: dread d6/d8/d4e/d64/f75 [0,4194304] 0 2023-12-09T02:34:57.392 INFO:tasks.workunit.client.0.smithi088.stdout:8/989: mkdir d2/d9/d13/d1c/d5f/d96/dec/dfb/d142 0 2023-12-09T02:34:57.392 INFO:tasks.workunit.client.0.smithi088.stdout:5/968: getdents d3/d15/de/d10/d18/d19/d1b/d35/d58/d95 0 2023-12-09T02:34:57.392 INFO:tasks.workunit.client.0.smithi088.stdout:8/990: write d2/d9/d1a/f57 [1459979,72286] 0 2023-12-09T02:34:57.395 INFO:tasks.workunit.client.0.smithi088.stdout:5/969: rename d3/d15/dc/d14/c11f to d3/d15/de/d10/d18/d19/d1b/d35/d42/c14a 0 2023-12-09T02:34:57.397 INFO:tasks.workunit.client.0.smithi088.stdout:8/991: unlink d2/d9/d70/d8f/l107 0 2023-12-09T02:34:57.400 INFO:tasks.workunit.client.0.smithi088.stdout:5/970: creat d3/d15/de/d10/d18/d19/d20/ddf/f14b x:0 0 0 2023-12-09T02:34:57.400 INFO:tasks.workunit.client.0.smithi088.stdout:5/971: fsync d3/d15/de/d10/f6e 0 2023-12-09T02:34:57.405 INFO:tasks.workunit.client.0.smithi088.stdout:6/843: rmdir d16/d1b/d25/d5f/d63 39 2023-12-09T02:34:57.405 INFO:tasks.workunit.client.0.smithi088.stdout:6/844: dread - d16/d35/d36/d97/ff4 zero size 2023-12-09T02:34:57.407 INFO:tasks.workunit.client.0.smithi088.stdout:1/970: dread d8/d53/f55 [0,4194304] 0 2023-12-09T02:34:57.407 INFO:tasks.workunit.client.0.smithi088.stdout:1/971: chown d8/d3d/d5d/d95/l3c 509070360 1 2023-12-09T02:34:57.408 INFO:tasks.workunit.client.0.smithi088.stdout:1/972: creat d8/d1c/d50/d6c/df7/f14d x:0 0 0 2023-12-09T02:34:57.409 INFO:tasks.workunit.client.0.smithi088.stdout:1/973: symlink d8/d3d/d44/da4/l14e 0 2023-12-09T02:34:57.411 INFO:tasks.workunit.client.0.smithi088.stdout:1/974: rename d8/d3d/d5d/d95/d14b to d8/d27/d40/d14f 0 2023-12-09T02:34:57.411 INFO:tasks.workunit.client.0.smithi088.stdout:8/992: dread d2/d2b/f2e [0,4194304] 0 2023-12-09T02:34:57.413 INFO:tasks.workunit.client.0.smithi088.stdout:1/975: mkdir d8/d3d/d44/da4/dcb/de3/d150 0 2023-12-09T02:34:57.413 INFO:tasks.workunit.client.0.smithi088.stdout:1/976: write d8/d1b/d6d/da2/fe4 [2118509,112944] 0 2023-12-09T02:34:57.414 INFO:tasks.workunit.client.0.smithi088.stdout:8/993: unlink d2/d9/d1a/d62/d49/f97 0 2023-12-09T02:34:57.414 INFO:tasks.workunit.client.0.smithi088.stdout:5/972: dread d3/d15/de/d10/d51/db4/ffb [0,4194304] 0 2023-12-09T02:34:57.415 INFO:tasks.workunit.client.0.smithi088.stdout:5/973: chown d3/d15/dc/d14 1425892 1 2023-12-09T02:34:57.415 INFO:tasks.workunit.client.0.smithi088.stdout:8/994: read d2/d9/d13/f2f [2015789,100710] 0 2023-12-09T02:34:57.415 INFO:tasks.workunit.client.0.smithi088.stdout:8/995: chown d2/d9/d1a/d62/lf5 388 1 2023-12-09T02:34:57.415 INFO:tasks.workunit.client.0.smithi088.stdout:1/977: mknod d8/d3d/d44/da4/dcb/de3/c151 0 2023-12-09T02:34:57.415 INFO:tasks.workunit.client.0.smithi088.stdout:1/978: chown d8/d27/d66/ffa 107910 1 2023-12-09T02:34:57.416 INFO:tasks.workunit.client.0.smithi088.stdout:8/996: creat d2/d9/f143 x:0 0 0 2023-12-09T02:34:57.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:56 smithi161 ceph-mon[121170]: pgmap v196: 65 pgs: 65 active+clean; 1.5 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 84 MiB/s rd, 184 MiB/s wr, 471 op/s 2023-12-09T02:34:57.422 INFO:tasks.workunit.client.0.smithi088.stdout:6/845: dread f10 [0,4194304] 0 2023-12-09T02:34:57.424 INFO:tasks.workunit.client.0.smithi088.stdout:6/846: link d16/d1b/f22 d16/d1b/d56/ff7 0 2023-12-09T02:34:57.425 INFO:tasks.workunit.client.0.smithi088.stdout:0/901: dwrite df/d10/d22/d2d/d96/fe8 [0,4194304] 0 2023-12-09T02:34:57.426 INFO:tasks.workunit.client.0.smithi088.stdout:6/847: rmdir d16/d35/d36/dad 39 2023-12-09T02:34:57.427 INFO:tasks.workunit.client.0.smithi088.stdout:3/865: dwrite d1/d9/d6f/d6/fac [0,4194304] 0 2023-12-09T02:34:57.429 INFO:tasks.workunit.client.0.smithi088.stdout:0/902: rename df/d10/d22/d2d/f8d to df/d28/d34/dc8/f123 0 2023-12-09T02:34:57.429 INFO:tasks.workunit.client.0.smithi088.stdout:0/903: chown df/c3e 259070 1 2023-12-09T02:34:57.429 INFO:tasks.workunit.client.0.smithi088.stdout:0/904: write df/d10/f93 [124341,68264] 0 2023-12-09T02:34:57.431 INFO:tasks.workunit.client.0.smithi088.stdout:0/905: symlink df/d28/d34/l124 0 2023-12-09T02:34:57.431 INFO:tasks.workunit.client.0.smithi088.stdout:0/906: fdatasync df/f2c 0 2023-12-09T02:34:57.432 INFO:tasks.workunit.client.0.smithi088.stdout:0/907: mknod df/d10/d22/d2d/c125 0 2023-12-09T02:34:57.439 INFO:tasks.workunit.client.0.smithi088.stdout:2/963: dwrite d6/d20/d3a/d84/fe6 [0,4194304] 0 2023-12-09T02:34:57.443 INFO:tasks.workunit.client.0.smithi088.stdout:2/964: rename d6/d13/d18 to d6/d20/d3a/d94/d140 0 2023-12-09T02:34:57.444 INFO:tasks.workunit.client.0.smithi088.stdout:2/965: read d6/d8/d4e/d3c/fb5 [3163883,114699] 0 2023-12-09T02:34:57.446 INFO:tasks.workunit.client.0.smithi088.stdout:2/966: mknod d6/d20/d9a/c141 0 2023-12-09T02:34:57.448 INFO:tasks.workunit.client.0.smithi088.stdout:1/979: dwrite d8/d1b/d1d/dc7/f148 [0,4194304] 0 2023-12-09T02:34:57.450 INFO:tasks.workunit.client.0.smithi088.stdout:2/967: symlink d6/d8/d4e/da2/db8/dfc/l142 0 2023-12-09T02:34:57.451 INFO:tasks.workunit.client.0.smithi088.stdout:5/974: dwrite d3/d15/de/d10/d51/d70/fbb [0,4194304] 0 2023-12-09T02:34:57.453 INFO:tasks.workunit.client.0.smithi088.stdout:1/980: unlink d8/d1b/f20 0 2023-12-09T02:34:57.454 INFO:tasks.workunit.client.0.smithi088.stdout:2/968: truncate d6/f55 2348243 0 2023-12-09T02:34:57.454 INFO:tasks.workunit.client.0.smithi088.stdout:2/969: read - d6/d20/d3a/d84/f112 zero size 2023-12-09T02:34:57.455 INFO:tasks.workunit.client.0.smithi088.stdout:2/970: readlink d6/d20/d69/l7d 0 2023-12-09T02:34:57.455 INFO:tasks.workunit.client.0.smithi088.stdout:2/971: fsync d6/d8/d4e/d64/fe4 0 2023-12-09T02:34:57.457 INFO:tasks.workunit.client.0.smithi088.stdout:5/975: creat d3/d15/de/d10/d18/d19/d1b/d35/d42/d8a/f14c x:0 0 0 2023-12-09T02:34:57.459 INFO:tasks.workunit.client.0.smithi088.stdout:1/981: link d8/d1c/fbc d8/d1c/d50/dc5/f152 0 2023-12-09T02:34:57.461 INFO:tasks.workunit.client.0.smithi088.stdout:2/972: rename d6/d8/d77/lf1 to d6/d20/d3a/d84/de5/l143 0 2023-12-09T02:34:57.461 INFO:tasks.workunit.client.0.smithi088.stdout:2/973: chown d6/d20/d3a/fb0 0 1 2023-12-09T02:34:57.461 INFO:tasks.workunit.client.0.smithi088.stdout:2/974: getdents d6/d8/d1f/d22/d68/d100/d128 0 2023-12-09T02:34:57.462 INFO:tasks.workunit.client.0.smithi088.stdout:3/866: dwrite d1/d9/f37 [0,4194304] 0 2023-12-09T02:34:57.462 INFO:tasks.workunit.client.0.smithi088.stdout:6/848: dwrite d16/f39 [0,4194304] 0 2023-12-09T02:34:57.462 INFO:tasks.workunit.client.0.smithi088.stdout:6/849: chown d16/d35/d36/d97/d90/f7d 171 1 2023-12-09T02:34:57.462 INFO:tasks.workunit.client.0.smithi088.stdout:5/976: mknod d3/d15/de/d10/d51/db4/d109/c14d 0 2023-12-09T02:34:57.462 INFO:tasks.workunit.client.0.smithi088.stdout:5/977: write d3/d8/f9 [4205360,37716] 0 2023-12-09T02:34:57.463 INFO:tasks.workunit.client.0.smithi088.stdout:2/975: getdents d6/d20/d3a/d84 0 2023-12-09T02:34:57.466 INFO:tasks.workunit.client.0.smithi088.stdout:3/867: write d1/fa [7989287,35980] 0 2023-12-09T02:34:57.466 INFO:tasks.workunit.client.0.smithi088.stdout:3/868: dread - d1/d9/d6f/d2d/d109/d85/dcb/f108 zero size 2023-12-09T02:34:57.466 INFO:tasks.workunit.client.0.smithi088.stdout:3/869: write d1/d9/d6f/f103 [424119,72996] 0 2023-12-09T02:34:57.469 INFO:tasks.workunit.client.0.smithi088.stdout:6/850: rename d16/d35/d36/dad to d16/d1b/d25/d5f/d63/df8 0 2023-12-09T02:34:57.469 INFO:tasks.workunit.client.0.smithi088.stdout:6/851: write d16/d1b/d25/d5f/d63/fd5 [387869,116141] 0 2023-12-09T02:34:57.470 INFO:tasks.workunit.client.0.smithi088.stdout:5/978: creat d3/d15/de/d73/d12f/f14e x:0 0 0 2023-12-09T02:34:57.470 INFO:tasks.workunit.client.0.smithi088.stdout:5/979: chown d3/c4c 780907 1 2023-12-09T02:34:57.471 INFO:tasks.workunit.client.0.smithi088.stdout:3/870: write d1/d9/d6f/d22/d7f/d45/f47 [4843300,127508] 0 2023-12-09T02:34:57.472 INFO:tasks.workunit.client.0.smithi088.stdout:6/852: mknod d16/d1b/d56/cf9 0 2023-12-09T02:34:57.472 INFO:tasks.workunit.client.0.smithi088.stdout:5/980: creat d3/d15/f14f x:0 0 0 2023-12-09T02:34:57.475 INFO:tasks.workunit.client.0.smithi088.stdout:3/871: mknod d1/d9/d6f/d2d/d66/d101/c123 0 2023-12-09T02:34:57.475 INFO:tasks.workunit.client.0.smithi088.stdout:3/872: chown d1/d9/d6f/d2d/d109 12933 1 2023-12-09T02:34:57.475 INFO:tasks.workunit.client.0.smithi088.stdout:3/873: dread - d1/d9/d6f/d2d/d66/d101/f111 zero size 2023-12-09T02:34:57.475 INFO:tasks.workunit.client.0.smithi088.stdout:4/881: sync 2023-12-09T02:34:57.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:56 smithi088 ceph-mon[112028]: pgmap v196: 65 pgs: 65 active+clean; 1.5 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 84 MiB/s rd, 184 MiB/s wr, 471 op/s 2023-12-09T02:34:57.476 INFO:tasks.workunit.client.0.smithi088.stdout:4/882: write d3/dc/d1d/d40/ddf/fe0 [965597,39535] 0 2023-12-09T02:34:57.477 INFO:tasks.workunit.client.0.smithi088.stdout:3/874: mkdir d1/d9/d6f/d6/d4a/d41/d124 0 2023-12-09T02:34:57.477 INFO:tasks.workunit.client.0.smithi088.stdout:3/875: truncate d1/d9/d6f/d22/d7f/d45/f88 5110919 0 2023-12-09T02:34:57.478 INFO:tasks.workunit.client.0.smithi088.stdout:3/876: symlink d1/d9/d6f/d6/d4a/d41/l125 0 2023-12-09T02:34:57.478 INFO:tasks.workunit.client.0.smithi088.stdout:3/877: truncate d1/d9/d6f/d15/ff0 1709800 0 2023-12-09T02:34:57.480 INFO:tasks.workunit.client.0.smithi088.stdout:3/878: creat d1/d9/d6f/d15/f126 x:0 0 0 2023-12-09T02:34:57.480 INFO:tasks.workunit.client.0.smithi088.stdout:3/879: dread - d1/d9/d6f/d2d/dab/dc5/f10e zero size 2023-12-09T02:34:57.482 INFO:tasks.workunit.client.0.smithi088.stdout:3/880: creat d1/d9/d6f/d6/d8b/f127 x:0 0 0 2023-12-09T02:34:57.482 INFO:tasks.workunit.client.0.smithi088.stdout:3/881: fdatasync d1/d9/d6f/d6/d4a/d41/d33/d49/ff7 0 2023-12-09T02:34:57.484 INFO:tasks.workunit.client.0.smithi088.stdout:3/882: mkdir d1/d9/d128 0 2023-12-09T02:34:57.484 INFO:tasks.workunit.client.0.smithi088.stdout:3/883: dread - d1/d9/d6f/d15/f67 zero size 2023-12-09T02:34:57.484 INFO:tasks.workunit.client.0.smithi088.stdout:1/982: dwrite d8/d3d/d44/da4/dcb/de3/fe5 [0,4194304] 0 2023-12-09T02:34:57.485 INFO:tasks.workunit.client.0.smithi088.stdout:2/976: dwrite d6/d20/d3a/d94/fed [0,4194304] 0 2023-12-09T02:34:57.488 INFO:tasks.workunit.client.0.smithi088.stdout:3/884: creat d1/d9/d128/f129 x:0 0 0 2023-12-09T02:34:57.492 INFO:tasks.workunit.client.0.smithi088.stdout:1/983: rename d8/c16 to d8/d3d/d5d/d95/c153 0 2023-12-09T02:34:57.494 INFO:tasks.workunit.client.0.smithi088.stdout:2/977: creat d6/d13/f144 x:0 0 0 2023-12-09T02:34:57.494 INFO:tasks.workunit.client.0.smithi088.stdout:2/978: write d6/d13/f101 [4291395,71954] 0 2023-12-09T02:34:57.494 INFO:tasks.workunit.client.0.smithi088.stdout:3/885: mkdir d1/d9/d6f/d6/d4a/d41/d10b/db1/d12a 0 2023-12-09T02:34:57.495 INFO:tasks.workunit.client.0.smithi088.stdout:1/984: creat d8/d27/d66/d79/f154 x:0 0 0 2023-12-09T02:34:57.496 INFO:tasks.workunit.client.0.smithi088.stdout:1/985: write d8/f124 [2930545,47204] 0 2023-12-09T02:34:57.496 INFO:tasks.workunit.client.0.smithi088.stdout:2/979: mkdir d6/d8/d4e/da2/db8/dfc/db4/d106/d145 0 2023-12-09T02:34:57.498 INFO:tasks.workunit.client.0.smithi088.stdout:2/980: symlink d6/d20/d3a/d94/d140/d10a/l146 0 2023-12-09T02:34:57.506 INFO:tasks.workunit.client.0.smithi088.stdout:6/853: dwrite d16/d62/d6f/da4/dc2/dc7/fd8 [0,4194304] 0 2023-12-09T02:34:57.507 INFO:tasks.workunit.client.0.smithi088.stdout:5/981: dwrite d3/d15/de/d10/d18/d19/d20/ddf/f14b [0,4194304] 0 2023-12-09T02:34:57.508 INFO:tasks.workunit.client.0.smithi088.stdout:4/883: dwrite d3/dc/d18/d29/f119 [4194304,4194304] 0 2023-12-09T02:34:57.508 INFO:tasks.workunit.client.0.smithi088.stdout:6/854: chown d16/d35/d65/lac 7509497 1 2023-12-09T02:34:57.521 INFO:tasks.workunit.client.0.smithi088.stdout:4/884: link d3/dc/d43/dc5/fca d3/dc/d43/dc5/dd8/f11d 0 2023-12-09T02:34:57.521 INFO:tasks.workunit.client.0.smithi088.stdout:3/886: dread d1/d9/d6f/d22/d7f/d45/f47 [0,4194304] 0 2023-12-09T02:34:57.521 INFO:tasks.workunit.client.0.smithi088.stdout:6/855: mknod d16/d1b/d25/d5f/d63/df8/cfa 0 2023-12-09T02:34:57.524 INFO:tasks.workunit.client.0.smithi088.stdout:4/885: link d3/dc/d1d/d40/ddf/ce9 d3/dc/d43/d8c/d95/daa/db7/c11e 0 2023-12-09T02:34:57.525 INFO:tasks.workunit.client.0.smithi088.stdout:3/887: mkdir d1/d9/d6f/d6/d4a/d41/d124/d12b 0 2023-12-09T02:34:57.525 INFO:tasks.workunit.client.0.smithi088.stdout:5/982: dread d3/d15/de/d10/d18/d19/d1b/d35/d42/fa6 [0,4194304] 0 2023-12-09T02:34:57.525 INFO:tasks.workunit.client.0.smithi088.stdout:1/986: dwrite d8/d27/d9a/fa3 [0,4194304] 0 2023-12-09T02:34:57.526 INFO:tasks.workunit.client.0.smithi088.stdout:4/886: symlink d3/dc/d43/d8c/l11f 0 2023-12-09T02:34:57.526 INFO:tasks.workunit.client.0.smithi088.stdout:3/888: read d1/d9/d6f/d22/d7f/d117/f97 [3984646,87342] 0 2023-12-09T02:34:57.530 INFO:tasks.workunit.client.0.smithi088.stdout:1/987: creat d8/d1c/d50/f155 x:0 0 0 2023-12-09T02:34:57.530 INFO:tasks.workunit.client.0.smithi088.stdout:1/988: write d8/d1c/d50/d6c/df7/d10d/f137 [8747527,92551] 0 2023-12-09T02:34:57.532 INFO:tasks.workunit.client.0.smithi088.stdout:5/983: link d3/d15/de/d10/d51/db4/dd7/fe3 d3/d15/de/d10/d18/d19/f150 0 2023-12-09T02:34:57.534 INFO:tasks.workunit.client.0.smithi088.stdout:3/889: dread d1/d9/d6f/d6/d8b/fa4 [0,4194304] 0 2023-12-09T02:34:57.534 INFO:tasks.workunit.client.0.smithi088.stdout:1/989: symlink d8/d1b/d149/l156 0 2023-12-09T02:34:57.535 INFO:tasks.workunit.client.0.smithi088.stdout:4/887: dread d3/dc/d1d/d40/f50 [0,4194304] 0 2023-12-09T02:34:57.535 INFO:tasks.workunit.client.0.smithi088.stdout:4/888: chown d3/dc/d43/d8c/d95/daa/db7/f109 881 1 2023-12-09T02:34:57.535 INFO:tasks.workunit.client.0.smithi088.stdout:4/889: stat d3/d65/feb 0 2023-12-09T02:34:57.536 INFO:tasks.workunit.client.0.smithi088.stdout:3/890: symlink d1/d9/d6f/d22/l12c 0 2023-12-09T02:34:57.536 INFO:tasks.workunit.client.0.smithi088.stdout:3/891: read d1/d9/d6f/d22/d7f/d117/ddf/fe2 [256537,91234] 0 2023-12-09T02:34:57.538 INFO:tasks.workunit.client.0.smithi088.stdout:4/890: unlink d3/d65/cd5 0 2023-12-09T02:34:57.538 INFO:tasks.workunit.client.0.smithi088.stdout:6/856: dwrite d16/d62/d6f/da4/dc2/dc7/d8c/fcc [0,4194304] 0 2023-12-09T02:34:57.539 INFO:tasks.workunit.client.0.smithi088.stdout:6/857: dread - d16/fa6 zero size 2023-12-09T02:34:57.539 INFO:tasks.workunit.client.0.smithi088.stdout:6/858: truncate d16/d1b/d2c/d3f/d41/d80/fde 4825682 0 2023-12-09T02:34:57.539 INFO:tasks.workunit.client.0.smithi088.stdout:3/892: rename d1/d9/d6f/d2d/d66/d101/f111 to d1/d9/d6f/d22/d7f/f12d 0 2023-12-09T02:34:57.539 INFO:tasks.workunit.client.0.smithi088.stdout:3/893: readlink d1/l71 0 2023-12-09T02:34:57.539 INFO:tasks.workunit.client.0.smithi088.stdout:1/990: write d8/d1b/d1d/dc7/ffc [541019,28982] 0 2023-12-09T02:34:57.541 INFO:tasks.workunit.client.0.smithi088.stdout:6/859: write f12 [4055171,75138] 0 2023-12-09T02:34:57.542 INFO:tasks.workunit.client.0.smithi088.stdout:5/984: rmdir d3/d15/de/d10/d18/d19/d1b/d35/d58/d95 0 2023-12-09T02:34:57.542 INFO:tasks.workunit.client.0.smithi088.stdout:5/985: fdatasync d3/d15/de/d10/d51/d7f/f86 0 2023-12-09T02:34:57.546 INFO:tasks.workunit.client.0.smithi088.stdout:1/991: truncate d8/f3e 1059449 0 2023-12-09T02:34:57.548 INFO:tasks.workunit.client.0.smithi088.stdout:6/860: creat d16/d1b/d2c/d3f/d83/ffb x:0 0 0 2023-12-09T02:34:57.550 INFO:tasks.workunit.client.0.smithi088.stdout:5/986: mkdir d3/d15/de/d10/d51/dc9/d151 0 2023-12-09T02:34:57.551 INFO:tasks.workunit.client.0.smithi088.stdout:1/992: creat d8/d27/f157 x:0 0 0 2023-12-09T02:34:57.552 INFO:tasks.workunit.client.0.smithi088.stdout:6/861: truncate d16/d35/f46 2628812 0 2023-12-09T02:34:57.552 INFO:tasks.workunit.client.0.smithi088.stdout:6/862: truncate d16/d62/da7/fd6 826322 0 2023-12-09T02:34:57.552 INFO:tasks.workunit.client.0.smithi088.stdout:6/863: chown d16/d35/l3a 0 1 2023-12-09T02:34:57.554 INFO:tasks.workunit.client.0.smithi088.stdout:1/993: symlink d8/d3d/df0/l158 0 2023-12-09T02:34:57.555 INFO:tasks.workunit.client.0.smithi088.stdout:6/864: read d16/d62/d6f/da4/dc2/dc7/d8c/fc4 [2024041,117529] 0 2023-12-09T02:34:57.555 INFO:tasks.workunit.client.0.smithi088.stdout:7/920: sync 2023-12-09T02:34:57.555 INFO:tasks.workunit.client.0.smithi088.stdout:6/865: fdatasync d16/d1b/d2c/f2d 0 2023-12-09T02:34:57.555 INFO:tasks.workunit.client.0.smithi088.stdout:7/921: truncate dc/d21/d6b/d6d/da4/d3e/f100 1406976 0 2023-12-09T02:34:57.559 INFO:tasks.workunit.client.0.smithi088.stdout:7/922: rmdir dc/d21/d6b/d6d/d76/df0 39 2023-12-09T02:34:57.559 INFO:tasks.workunit.client.0.smithi088.stdout:8/997: sync 2023-12-09T02:34:57.560 INFO:tasks.workunit.client.0.smithi088.stdout:6/866: unlink d16/c1a 0 2023-12-09T02:34:57.561 INFO:tasks.workunit.client.0.smithi088.stdout:0/908: sync 2023-12-09T02:34:57.562 INFO:tasks.workunit.client.0.smithi088.stdout:7/923: rename dc/d1b/d82/f84 to dc/d1b/d72/dc4/d138/f13c 0 2023-12-09T02:34:57.564 INFO:tasks.workunit.client.0.smithi088.stdout:8/998: creat d2/d9/d70/d8f/da8/d119/f144 x:0 0 0 2023-12-09T02:34:57.564 INFO:tasks.workunit.client.0.smithi088.stdout:8/999: fsync d2/d9/d13/d1c/d5f/d84/fd4 0 2023-12-09T02:34:57.565 INFO:tasks.workunit.client.0.smithi088.stdout:3/894: dwrite d1/d9/d6f/d15/fa3 [0,4194304] 0 2023-12-09T02:34:57.566 INFO:tasks.workunit.client.0.smithi088.stdout:6/867: unlink d16/d1b/d25/d5f/d63/ce9 0 2023-12-09T02:34:57.567 INFO:tasks.workunit.client.0.smithi088.stdout:7/924: unlink dc/d21/d6b/f80 0 2023-12-09T02:34:57.570 INFO:tasks.workunit.client.0.smithi088.stdout:0/909: write df/f106 [3470316,123042] 0 2023-12-09T02:34:57.570 INFO:tasks.workunit.client.0.smithi088.stdout:1/994: dread d8/d1c/d50/dc5/f152 [0,4194304] 0 2023-12-09T02:34:57.570 INFO:tasks.workunit.client.0.smithi088.stdout:1/995: truncate d8/d27/d40/fa7 1114098 0 2023-12-09T02:34:57.570 INFO:tasks.workunit.client.0.smithi088.stdout:1/996: write d8/d1b/d1d/ddf/f102 [382308,46044] 0 2023-12-09T02:34:57.572 INFO:tasks.workunit.client.0.smithi088.stdout:4/891: dwrite d3/f76 [0,4194304] 0 2023-12-09T02:34:57.573 INFO:tasks.workunit.client.0.smithi088.stdout:5/987: dwrite d3/d15/de/d2c/f135 [0,4194304] 0 2023-12-09T02:34:57.573 INFO:tasks.workunit.client.0.smithi088.stdout:3/895: dread d1/d9/d6f/d2d/d109/d85/fb3 [0,4194304] 0 2023-12-09T02:34:57.573 INFO:tasks.workunit.client.0.smithi088.stdout:7/925: mknod dc/d21/d6b/d6d/c13d 0 2023-12-09T02:34:57.573 INFO:tasks.workunit.client.0.smithi088.stdout:5/988: write d3/d15/de/d10/d18/d19/d1b/d35/d42/fa6 [1809642,2166] 0 2023-12-09T02:34:57.573 INFO:tasks.workunit.client.0.smithi088.stdout:5/989: chown d3/d15/de/d73 14157066 1 2023-12-09T02:34:57.574 INFO:tasks.workunit.client.0.smithi088.stdout:0/910: truncate df/d28/d34/fd6 688862 0 2023-12-09T02:34:57.574 INFO:tasks.workunit.client.0.smithi088.stdout:0/911: fsync df/d10/fd8 0 2023-12-09T02:34:57.575 INFO:tasks.workunit.client.0.smithi088.stdout:1/997: mknod d8/d1b/d1d/dc7/d108/d10a/c159 0 2023-12-09T02:34:57.575 INFO:tasks.workunit.client.0.smithi088.stdout:1/998: readlink d8/d3d/d5d/d95/l3c 0 2023-12-09T02:34:57.576 INFO:tasks.workunit.client.0.smithi088.stdout:6/868: link d16/d35/d65/c96 d16/d1b/d25/d5f/d63/df8/cfc 0 2023-12-09T02:34:57.579 INFO:tasks.workunit.client.0.smithi088.stdout:4/892: unlink d3/dc/d43/d8c/d95/f10f 0 2023-12-09T02:34:57.579 INFO:tasks.workunit.client.0.smithi088.stdout:4/893: chown d3/dc/d1d/d40/f54 2 1 2023-12-09T02:34:57.582 INFO:tasks.workunit.client.0.smithi088.stdout:3/896: rename d1/d9/d6f/d2d/d109/d85/ddc/l102 to d1/d9/d6f/d6/d4a/d41/d124/l12e 0 2023-12-09T02:34:57.583 INFO:tasks.workunit.client.0.smithi088.stdout:3/897: read d1/d9/d6f/d6/d4a/d41/d33/f63 [3646839,74063] 0 2023-12-09T02:34:57.660 INFO:tasks.workunit.client.0.smithi088.stdout:7/926: creat dc/d1b/d89/f13e x:0 0 0 2023-12-09T02:34:57.661 INFO:tasks.workunit.client.0.smithi088.stdout:7/927: write dc/d21/ff5 [3045126,86445] 0 2023-12-09T02:34:57.662 INFO:tasks.workunit.client.0.smithi088.stdout:4/894: dwrite d3/dc/d43/d8c/fb5 [0,4194304] 0 2023-12-09T02:34:57.663 INFO:tasks.workunit.client.0.smithi088.stdout:5/990: symlink d3/d15/de/d10/d18/d19/d1b/d35/d58/l152 0 2023-12-09T02:34:57.664 INFO:tasks.workunit.client.0.smithi088.stdout:5/991: write d3/d15/de/d2c/ff3 [126109,113693] 0 2023-12-09T02:34:57.664 INFO:tasks.workunit.client.0.smithi088.stdout:0/912: getdents df/d28/d33/daf 0 2023-12-09T02:34:57.665 INFO:tasks.workunit.client.0.smithi088.stdout:0/913: stat df/f2c 0 2023-12-09T02:34:57.666 INFO:tasks.workunit.client.0.smithi088.stdout:1/999: mknod d8/d3d/c15a 0 2023-12-09T02:34:57.669 INFO:tasks.workunit.client.0.smithi088.stdout:6/869: rename d16/d62/d6f/da4/dc2/dc7/d8c/deb to d16/d1b/d56/dfd 0 2023-12-09T02:34:57.671 INFO:tasks.workunit.client.0.smithi088.stdout:3/898: mkdir d1/d12f 0 2023-12-09T02:34:57.674 INFO:tasks.workunit.client.0.smithi088.stdout:7/928: symlink dc/d1b/d72/l13f 0 2023-12-09T02:34:57.680 INFO:tasks.workunit.client.0.smithi088.stdout:3/899: dread d1/d9/d6f/d2d/db9/fb8 [0,4194304] 0 2023-12-09T02:34:57.680 INFO:tasks.workunit.client.0.smithi088.stdout:3/900: write d1/d9/dbf/fdd [526175,99185] 0 2023-12-09T02:34:57.684 INFO:tasks.workunit.client.0.smithi088.stdout:0/914: dwrite df/d10/f29 [4194304,4194304] 0 2023-12-09T02:34:57.687 INFO:tasks.workunit.client.0.smithi088.stdout:4/895: getdents d3/dc/d18/dab/dc7 0 2023-12-09T02:34:57.689 INFO:tasks.workunit.client.0.smithi088.stdout:5/992: unlink d3/d15/de/d10/l1a 0 2023-12-09T02:34:57.691 INFO:tasks.workunit.client.0.smithi088.stdout:6/870: mknod d16/d1b/d56/cfe 0 2023-12-09T02:34:57.691 INFO:tasks.workunit.client.0.smithi088.stdout:6/871: getdents d16/d1b 0 2023-12-09T02:34:57.691 INFO:tasks.workunit.client.0.smithi088.stdout:6/872: dread - d16/d1b/fb1 zero size 2023-12-09T02:34:57.692 INFO:tasks.workunit.client.0.smithi088.stdout:3/901: creat d1/d9/d6f/d22/d7f/d45/f130 x:0 0 0 2023-12-09T02:34:57.692 INFO:tasks.workunit.client.0.smithi088.stdout:7/929: dwrite dc/d21/d6b/d93/f102 [0,4194304] 0 2023-12-09T02:34:57.693 INFO:tasks.workunit.client.0.smithi088.stdout:0/915: link df/d37/d97/c11a df/d10/d22/da0/dac/c126 0 2023-12-09T02:34:57.693 INFO:tasks.workunit.client.0.smithi088.stdout:0/916: chown df/dd0/d119 56633613 1 2023-12-09T02:34:57.695 INFO:tasks.workunit.client.0.smithi088.stdout:4/896: unlink d3/dc/d43/d83/f4f 0 2023-12-09T02:34:57.695 INFO:tasks.workunit.client.0.smithi088.stdout:4/897: stat d3/dc/f10 0 2023-12-09T02:34:57.696 INFO:tasks.workunit.client.0.smithi088.stdout:5/993: rename d3/d15/de/d10/d51/db4/d109/f10d to d3/d15/de/d73/d12f/f153 0 2023-12-09T02:34:57.696 INFO:tasks.workunit.client.0.smithi088.stdout:5/994: chown d3/d15/dc/c13c 1 1 2023-12-09T02:34:57.697 INFO:tasks.workunit.client.0.smithi088.stdout:5/995: read d3/d15/de/d10/d18/d19/d1b/d35/d58/f149 [3710059,88261] 0 2023-12-09T02:34:57.697 INFO:tasks.workunit.client.0.smithi088.stdout:6/873: mkdir d16/d1b/d2c/d60/dff 0 2023-12-09T02:34:57.699 INFO:tasks.workunit.client.0.smithi088.stdout:3/902: symlink d1/d9/d6f/d6/d4a/d41/l131 0 2023-12-09T02:34:57.701 INFO:tasks.workunit.client.0.smithi088.stdout:4/898: truncate f1 2457444 0 2023-12-09T02:34:57.703 INFO:tasks.workunit.client.0.smithi088.stdout:0/917: rename df/d10/d22/l61 to df/d10/d22/ded/l127 0 2023-12-09T02:34:57.703 INFO:tasks.workunit.client.0.smithi088.stdout:4/899: write d3/dc/d18/d8d/ffe [2711931,100310] 0 2023-12-09T02:34:57.704 INFO:tasks.workunit.client.0.smithi088.stdout:5/996: getdents d3/d15/de/d2c/dfa 0 2023-12-09T02:34:57.708 INFO:tasks.workunit.client.0.smithi088.stdout:6/874: getdents d16/d62 0 2023-12-09T02:34:57.710 INFO:tasks.workunit.client.0.smithi088.stdout:6/875: truncate d16/d1b/d25/f3d 2657111 0 2023-12-09T02:34:57.711 INFO:tasks.workunit.client.0.smithi088.stdout:2/981: sync 2023-12-09T02:34:57.712 INFO:tasks.workunit.client.0.smithi088.stdout:6/876: mknod d16/d62/d87/c100 0 2023-12-09T02:34:57.713 INFO:tasks.workunit.client.0.smithi088.stdout:5/997: write d3/d15/de/d10/d18/fa2 [1297893,105633] 0 2023-12-09T02:34:57.713 INFO:tasks.workunit.client.0.smithi088.stdout:5/998: write d3/d15/de/d10/d18/d19/d1b/d35/d61/feb [748125,82380] 0 2023-12-09T02:34:57.716 INFO:tasks.workunit.client.0.smithi088.stdout:5/999: rename d3/d15/de/f26 to d3/d15/de/d10/d51/f154 0 2023-12-09T02:34:57.721 INFO:tasks.workunit.client.0.smithi088.stdout:7/930: dwrite dc/d21/d6b/d6d/da4/d38/f10f [0,4194304] 0 2023-12-09T02:34:57.721 INFO:tasks.workunit.client.0.smithi088.stdout:7/931: fsync dc/d21/d7f/fef 0 2023-12-09T02:34:57.721 INFO:tasks.workunit.client.0.smithi088.stdout:6/877: dread d16/d35/f5d [0,4194304] 0 2023-12-09T02:34:57.721 INFO:tasks.workunit.client.0.smithi088.stdout:4/900: dread d3/f9 [0,4194304] 0 2023-12-09T02:34:57.723 INFO:tasks.workunit.client.0.smithi088.stdout:7/932: creat dc/d21/d6b/d6d/da4/d38/f140 x:0 0 0 2023-12-09T02:34:57.724 INFO:tasks.workunit.client.0.smithi088.stdout:4/901: mknod d3/dc/d43/d8c/d9a/dd0/c120 0 2023-12-09T02:34:57.728 INFO:tasks.workunit.client.0.smithi088.stdout:7/933: rmdir dc/d21/d6b/d6d/da4/d5d 39 2023-12-09T02:34:57.728 INFO:tasks.workunit.client.0.smithi088.stdout:7/934: chown dc/d21/d6b/d6d/da4/f55 15 1 2023-12-09T02:34:57.728 INFO:tasks.workunit.client.0.smithi088.stdout:3/903: dwrite d1/d9/d128/f129 [0,4194304] 0 2023-12-09T02:34:57.728 INFO:tasks.workunit.client.0.smithi088.stdout:0/918: dwrite df/d10/d22/fb3 [0,4194304] 0 2023-12-09T02:34:57.729 INFO:tasks.workunit.client.0.smithi088.stdout:0/919: chown df/d37/ffe 7256594 1 2023-12-09T02:34:57.729 INFO:tasks.workunit.client.0.smithi088.stdout:2/982: dwrite d6/d20/d3d/f83 [0,4194304] 0 2023-12-09T02:34:57.729 INFO:tasks.workunit.client.0.smithi088.stdout:6/878: link d16/d1b/d25/d5f/f68 d16/f101 0 2023-12-09T02:34:57.730 INFO:tasks.workunit.client.0.smithi088.stdout:6/879: chown d16/d1b/d25/lf5 6538 1 2023-12-09T02:34:57.731 INFO:tasks.workunit.client.0.smithi088.stdout:4/902: creat d3/dc/d43/d8c/d99/f121 x:0 0 0 2023-12-09T02:34:57.732 INFO:tasks.workunit.client.0.smithi088.stdout:4/903: chown f1 830 1 2023-12-09T02:34:57.733 INFO:tasks.workunit.client.0.smithi088.stdout:7/935: creat dc/d21/d6b/d93/d11f/f141 x:0 0 0 2023-12-09T02:34:57.738 INFO:tasks.workunit.client.0.smithi088.stdout:3/904: mkdir d1/d9/d6f/d22/d7f/d117/ddf/d132 0 2023-12-09T02:34:57.738 INFO:tasks.workunit.client.0.smithi088.stdout:3/905: write d1/d9/d6f/d2d/dab/dc5/dc9/dce/fa6 [1708474,11051] 0 2023-12-09T02:34:57.739 INFO:tasks.workunit.client.0.smithi088.stdout:0/920: creat df/d10/f128 x:0 0 0 2023-12-09T02:34:57.739 INFO:tasks.workunit.client.0.smithi088.stdout:4/904: dread d3/dc/d43/d83/f25 [0,4194304] 0 2023-12-09T02:34:57.740 INFO:tasks.workunit.client.0.smithi088.stdout:2/983: mknod d6/d8/d73/d78/d121/c147 0 2023-12-09T02:34:57.740 INFO:tasks.workunit.client.0.smithi088.stdout:2/984: dread - d6/d20/d3a/d94/d140/f10e zero size 2023-12-09T02:34:57.746 INFO:tasks.workunit.client.0.smithi088.stdout:2/985: write d6/d13/f33 [129077,77736] 0 2023-12-09T02:34:57.746 INFO:tasks.workunit.client.0.smithi088.stdout:3/906: creat d1/d9/d6f/d6/d4a/d41/d10b/db1/d12a/f133 x:0 0 0 2023-12-09T02:34:57.746 INFO:tasks.workunit.client.0.smithi088.stdout:3/907: write d1/d9/d6f/d2d/d109/d85/dcb/feb [303266,7223] 0 2023-12-09T02:34:57.746 INFO:tasks.workunit.client.0.smithi088.stdout:6/880: dread d16/d1b/d2c/d3f/d41/f4b [0,4194304] 0 2023-12-09T02:34:57.748 INFO:tasks.workunit.client.0.smithi088.stdout:0/921: symlink df/l129 0 2023-12-09T02:34:57.750 INFO:tasks.workunit.client.0.smithi088.stdout:6/881: creat d16/d1b/d2c/d3f/d41/d80/dd0/f102 x:0 0 0 2023-12-09T02:34:57.750 INFO:tasks.workunit.client.0.smithi088.stdout:6/882: chown d16/d1b/d2c/d3f/d41/d80/dd0 336 1 2023-12-09T02:34:57.751 INFO:tasks.workunit.client.0.smithi088.stdout:6/883: chown d16/d35/d36/d97/d90 919914 1 2023-12-09T02:34:57.751 INFO:tasks.workunit.client.0.smithi088.stdout:6/884: fsync f14 0 2023-12-09T02:34:57.753 INFO:tasks.workunit.client.0.smithi088.stdout:6/885: mknod d16/d1b/d2c/d3f/d9c/c103 0 2023-12-09T02:34:57.755 INFO:tasks.workunit.client.0.smithi088.stdout:6/886: creat d16/d1b/d25/d5f/d63/df8/f104 x:0 0 0 2023-12-09T02:34:57.756 INFO:tasks.workunit.client.0.smithi088.stdout:6/887: fsync d16/d1b/d2c/dcd/fe7 0 2023-12-09T02:34:57.761 INFO:tasks.workunit.client.0.smithi088.stdout:7/936: dwrite dc/fe5 [4194304,4194304] 0 2023-12-09T02:34:57.761 INFO:tasks.workunit.client.0.smithi088.stdout:7/937: fsync dc/d1b/fe6 0 2023-12-09T02:34:57.763 INFO:tasks.workunit.client.0.smithi088.stdout:0/922: dread df/d10/d22/d2d/d2e/fb5 [0,4194304] 0 2023-12-09T02:34:57.765 INFO:tasks.workunit.client.0.smithi088.stdout:7/938: mkdir dc/d21/d6b/d6d/da4/d10c/d10e/d142 0 2023-12-09T02:34:57.766 INFO:tasks.workunit.client.0.smithi088.stdout:0/923: creat df/dd0/d119/f12a x:0 0 0 2023-12-09T02:34:57.766 INFO:tasks.workunit.client.0.smithi088.stdout:0/924: readlink df/d10/d22/ded/df0/l11b 0 2023-12-09T02:34:57.767 INFO:tasks.workunit.client.0.smithi088.stdout:7/939: creat dc/d21/d6b/d93/d12a/f143 x:0 0 0 2023-12-09T02:34:57.768 INFO:tasks.workunit.client.0.smithi088.stdout:0/925: symlink df/d10/d22/d2d/d96/dea/l12b 0 2023-12-09T02:34:57.768 INFO:tasks.workunit.client.0.smithi088.stdout:7/940: creat dc/d21/db1/f144 x:0 0 0 2023-12-09T02:34:57.769 INFO:tasks.workunit.client.0.smithi088.stdout:0/926: creat df/d10/d22/d2d/d2e/ddc/f12c x:0 0 0 2023-12-09T02:34:57.769 INFO:tasks.workunit.client.0.smithi088.stdout:0/927: readlink df/d10/d22/d2d/d2e/l63 0 2023-12-09T02:34:57.770 INFO:tasks.workunit.client.0.smithi088.stdout:7/941: truncate dc/d1b/d82/f128 322583 0 2023-12-09T02:34:57.771 INFO:tasks.workunit.client.0.smithi088.stdout:7/942: write dc/d1b/f81 [804975,34675] 0 2023-12-09T02:34:57.771 INFO:tasks.workunit.client.0.smithi088.stdout:0/928: mknod df/d37/d70/dcb/c12d 0 2023-12-09T02:34:57.772 INFO:tasks.workunit.client.0.smithi088.stdout:7/943: getdents dc/dcb/de2 0 2023-12-09T02:34:57.774 INFO:tasks.workunit.client.0.smithi088.stdout:0/929: write df/d10/d22/d2d/d96/fe8 [430372,11372] 0 2023-12-09T02:34:57.775 INFO:tasks.workunit.client.0.smithi088.stdout:2/986: dwrite d6/d8/d4e/f57 [0,4194304] 0 2023-12-09T02:34:57.777 INFO:tasks.workunit.client.0.smithi088.stdout:7/944: rmdir dc/d1b/d127 0 2023-12-09T02:34:57.777 INFO:tasks.workunit.client.0.smithi088.stdout:3/908: dwrite d1/d9/d6f/d22/d7f/f4d [4194304,4194304] 0 2023-12-09T02:34:57.777 INFO:tasks.workunit.client.0.smithi088.stdout:6/888: dwrite d16/d1b/fb1 [0,4194304] 0 2023-12-09T02:34:57.778 INFO:tasks.workunit.client.0.smithi088.stdout:7/945: write dc/fe0 [368825,32568] 0 2023-12-09T02:34:57.782 INFO:tasks.workunit.client.0.smithi088.stdout:3/909: rename d1/d9/ld4 to d1/d9/dbf/l134 0 2023-12-09T02:34:57.788 INFO:tasks.workunit.client.0.smithi088.stdout:7/946: mknod dc/d21/d6b/d9b/c145 0 2023-12-09T02:34:57.790 INFO:tasks.workunit.client.0.smithi088.stdout:6/889: rename d16/d1b/d56/c85 to d16/d1b/d2c/d3f/d41/c105 0 2023-12-09T02:34:57.791 INFO:tasks.workunit.client.0.smithi088.stdout:3/910: creat d1/d9/d6f/d70/f135 x:0 0 0 2023-12-09T02:34:57.793 INFO:tasks.workunit.client.0.smithi088.stdout:6/890: unlink d16/d1b/fb1 0 2023-12-09T02:34:57.794 INFO:tasks.workunit.client.0.smithi088.stdout:6/891: creat d16/d1b/d25/d5f/f106 x:0 0 0 2023-12-09T02:34:57.794 INFO:tasks.workunit.client.0.smithi088.stdout:6/892: stat d16/d1b/d25/d5f/d63/df8/fee 0 2023-12-09T02:34:57.795 INFO:tasks.workunit.client.0.smithi088.stdout:6/893: creat d16/d35/f107 x:0 0 0 2023-12-09T02:34:57.797 INFO:tasks.workunit.client.0.smithi088.stdout:6/894: mknod d16/d35/d36/d97/d90/c108 0 2023-12-09T02:34:57.797 INFO:tasks.workunit.client.0.smithi088.stdout:0/930: dwrite df/d28/d33/f4e [0,4194304] 0 2023-12-09T02:34:57.797 INFO:tasks.workunit.client.0.smithi088.stdout:0/931: fsync df/d37/d97/f105 0 2023-12-09T02:34:57.797 INFO:tasks.workunit.client.0.smithi088.stdout:0/932: readlink df/d10/le4 0 2023-12-09T02:34:57.797 INFO:tasks.workunit.client.0.smithi088.stdout:2/987: dwrite d6/d13/f1e [0,4194304] 0 2023-12-09T02:34:57.798 INFO:tasks.workunit.client.0.smithi088.stdout:0/933: getdents df/d10/d10b 0 2023-12-09T02:34:57.798 INFO:tasks.workunit.client.0.smithi088.stdout:0/934: dread - df/d28/d33/daf/fff zero size 2023-12-09T02:34:57.798 INFO:tasks.workunit.client.0.smithi088.stdout:0/935: read df/d10/f93 [126873,76289] 0 2023-12-09T02:34:57.799 INFO:tasks.workunit.client.0.smithi088.stdout:2/988: creat d6/d20/d3a/d94/dad/ddb/dde/f148 x:0 0 0 2023-12-09T02:34:57.800 INFO:tasks.workunit.client.0.smithi088.stdout:6/895: dread d16/d1b/d25/d5f/d63/fd5 [0,4194304] 0 2023-12-09T02:34:57.800 INFO:tasks.workunit.client.0.smithi088.stdout:0/936: mknod df/d10/d22/ded/c12e 0 2023-12-09T02:34:57.801 INFO:tasks.workunit.client.0.smithi088.stdout:6/896: dread d16/d35/d36/d97/d90/fb9 [0,4194304] 0 2023-12-09T02:34:57.803 INFO:tasks.workunit.client.0.smithi088.stdout:6/897: mknod d16/d1b/d25/d5f/d63/c109 0 2023-12-09T02:34:57.805 INFO:tasks.workunit.client.0.smithi088.stdout:6/898: dread d16/d1b/d2c/d3f/d41/d80/fe5 [0,4194304] 0 2023-12-09T02:34:57.808 INFO:tasks.workunit.client.0.smithi088.stdout:6/899: creat d16/d35/d36/ddf/f10a x:0 0 0 2023-12-09T02:34:57.808 INFO:tasks.workunit.client.0.smithi088.stdout:6/900: write d16/d1b/d2c/d3f/d83/f9d [5127813,38880] 0 2023-12-09T02:34:57.808 INFO:tasks.workunit.client.0.smithi088.stdout:6/901: chown d16/d35/d36/d97/d90/fe6 2409 1 2023-12-09T02:34:57.808 INFO:tasks.workunit.client.0.smithi088.stdout:6/902: stat d16/d35/d36/c4c 0 2023-12-09T02:34:57.809 INFO:tasks.workunit.client.0.smithi088.stdout:6/903: mknod d16/d1b/d2c/d3f/d9c/c10b 0 2023-12-09T02:34:57.823 INFO:tasks.workunit.client.0.smithi088.stdout:0/937: dwrite df/dd0/d119/f12a [0,4194304] 0 2023-12-09T02:34:57.824 INFO:tasks.workunit.client.0.smithi088.stdout:2/989: dwrite d6/d8/d1f/d22/d68/dd3/f130 [0,4194304] 0 2023-12-09T02:34:57.824 INFO:tasks.workunit.client.0.smithi088.stdout:2/990: dread - d6/d8/d1f/d22/d68/d100/f111 zero size 2023-12-09T02:34:57.824 INFO:tasks.workunit.client.0.smithi088.stdout:6/904: dwrite d16/d1b/d2c/f2d [0,4194304] 0 2023-12-09T02:34:57.825 INFO:tasks.workunit.client.0.smithi088.stdout:0/938: getdents df/d10/d22 0 2023-12-09T02:34:57.825 INFO:tasks.workunit.client.0.smithi088.stdout:0/939: chown df/d10/d22/l2b 57205292 1 2023-12-09T02:34:57.827 INFO:tasks.workunit.client.0.smithi088.stdout:2/991: unlink d6/d13/d42/d89/f120 0 2023-12-09T02:34:57.829 INFO:tasks.workunit.client.0.smithi088.stdout:6/905: link d16/d1b/d2c/d3f/d41/d80/fde d16/d1b/f10c 0 2023-12-09T02:34:57.830 INFO:tasks.workunit.client.0.smithi088.stdout:0/940: rename df/d28/ca2 to df/d37/c12f 0 2023-12-09T02:34:57.831 INFO:tasks.workunit.client.0.smithi088.stdout:2/992: creat d6/d20/d11d/f149 x:0 0 0 2023-12-09T02:34:57.831 INFO:tasks.workunit.client.0.smithi088.stdout:6/906: truncate f10 525902 0 2023-12-09T02:34:57.832 INFO:tasks.workunit.client.0.smithi088.stdout:2/993: dread d6/d8/d4e/d47/f58 [0,4194304] 0 2023-12-09T02:34:57.835 INFO:tasks.workunit.client.0.smithi088.stdout:0/941: symlink df/d37/de2/l130 0 2023-12-09T02:34:57.838 INFO:tasks.workunit.client.0.smithi088.stdout:0/942: creat df/d28/d33/d81/d107/f131 x:0 0 0 2023-12-09T02:34:57.840 INFO:tasks.workunit.client.0.smithi088.stdout:6/907: symlink d16/l10d 0 2023-12-09T02:34:57.849 INFO:tasks.workunit.client.0.smithi088.stdout:6/908: write d16/f101 [2543087,125258] 0 2023-12-09T02:34:57.849 INFO:tasks.workunit.client.0.smithi088.stdout:6/909: write d16/d35/fd3 [714469,24243] 0 2023-12-09T02:34:57.849 INFO:tasks.workunit.client.0.smithi088.stdout:6/910: fsync d16/d1b/d2c/d3f/d83/ffb 0 2023-12-09T02:34:57.851 INFO:tasks.workunit.client.0.smithi088.stdout:6/911: getdents d16/d62/da7 0 2023-12-09T02:34:57.851 INFO:tasks.workunit.client.0.smithi088.stdout:6/912: fsync d16/d62/da7/da9/dd9/fe8 0 2023-12-09T02:34:57.851 INFO:tasks.workunit.client.0.smithi088.stdout:6/913: fdatasync d16/d1b/d2c/d3f/d41/d80/fe5 0 2023-12-09T02:34:57.852 INFO:tasks.workunit.client.0.smithi088.stdout:6/914: creat d16/d1b/d2c/d3f/d41/d80/dd0/f10e x:0 0 0 2023-12-09T02:34:57.852 INFO:tasks.workunit.client.0.smithi088.stdout:6/915: stat d16/d1b/d2c/d3f/l9b 0 2023-12-09T02:34:57.852 INFO:tasks.workunit.client.0.smithi088.stdout:6/916: truncate d16/d35/d65/fb2 1271341 0 2023-12-09T02:34:57.854 INFO:tasks.workunit.client.0.smithi088.stdout:2/994: dwrite d6/d8/f1a [0,4194304] 0 2023-12-09T02:34:57.861 INFO:tasks.workunit.client.0.smithi088.stdout:0/943: dwrite df/d10/d22/f74 [0,4194304] 0 2023-12-09T02:34:57.863 INFO:tasks.workunit.client.0.smithi088.stdout:6/917: dread d16/d1b/d25/f3b [0,4194304] 0 2023-12-09T02:34:57.866 INFO:tasks.workunit.client.0.smithi088.stdout:0/944: write df/d28/d43/f79 [1293688,29555] 0 2023-12-09T02:34:57.866 INFO:tasks.workunit.client.0.smithi088.stdout:6/918: creat d16/d35/d36/f10f x:0 0 0 2023-12-09T02:34:57.866 INFO:tasks.workunit.client.0.smithi088.stdout:6/919: write d16/f39 [4935513,126722] 0 2023-12-09T02:34:57.867 INFO:tasks.workunit.client.0.smithi088.stdout:2/995: dread d6/d8/d1f/d22/f40 [0,4194304] 0 2023-12-09T02:34:57.868 INFO:tasks.workunit.client.0.smithi088.stdout:0/945: truncate df/d37/ffc 1401129 0 2023-12-09T02:34:57.868 INFO:tasks.workunit.client.0.smithi088.stdout:2/996: read d6/f55 [1553681,83626] 0 2023-12-09T02:34:57.868 INFO:tasks.workunit.client.0.smithi088.stdout:2/997: truncate d6/d20/d3a/d82/f131 760529 0 2023-12-09T02:34:57.868 INFO:tasks.workunit.client.0.smithi088.stdout:0/946: dread df/d10/d22/d5f/fae [0,4194304] 0 2023-12-09T02:34:57.869 INFO:tasks.workunit.client.0.smithi088.stdout:6/920: mkdir d16/d62/d6f/da4/dc2/d110 0 2023-12-09T02:34:57.871 INFO:tasks.workunit.client.0.smithi088.stdout:6/921: creat d16/d35/d36/d97/d90/f111 x:0 0 0 2023-12-09T02:34:57.871 INFO:tasks.workunit.client.0.smithi088.stdout:6/922: stat d16/d35/d65/lac 0 2023-12-09T02:34:57.872 INFO:tasks.workunit.client.0.smithi088.stdout:6/923: symlink d16/d1b/d2c/d3f/d83/l112 0 2023-12-09T02:34:57.873 INFO:tasks.workunit.client.0.smithi088.stdout:6/924: truncate d16/d35/f76 4339584 0 2023-12-09T02:34:57.881 INFO:tasks.workunit.client.0.smithi088.stdout:4/905: sync 2023-12-09T02:34:57.881 INFO:tasks.workunit.client.0.smithi088.stdout:2/998: dread d6/d13/f15 [0,4194304] 0 2023-12-09T02:34:57.882 INFO:tasks.workunit.client.0.smithi088.stdout:4/906: symlink d3/dc/d18/da9/d115/l122 0 2023-12-09T02:34:57.885 INFO:tasks.workunit.client.0.smithi088.stdout:4/907: write d3/dc/d43/d8c/d95/daa/dc4/f102 [3611186,1269] 0 2023-12-09T02:34:57.888 INFO:tasks.workunit.client.0.smithi088.stdout:4/908: write d3/dc/d43/fae [1744785,117786] 0 2023-12-09T02:34:57.889 INFO:tasks.workunit.client.0.smithi088.stdout:4/909: creat d3/d65/de4/f123 x:0 0 0 2023-12-09T02:34:57.893 INFO:tasks.workunit.client.0.smithi088.stdout:6/925: dwrite d16/d1b/f10c [4194304,4194304] 0 2023-12-09T02:34:57.893 INFO:tasks.workunit.client.0.smithi088.stdout:0/947: dwrite df/d37/de2/f91 [4194304,4194304] 0 2023-12-09T02:34:57.893 INFO:tasks.workunit.client.0.smithi088.stdout:0/948: fsync df/d28/d34/fd6 0 2023-12-09T02:34:57.893 INFO:tasks.workunit.client.0.smithi088.stdout:0/949: chown df/d37/d70/f98 3 1 2023-12-09T02:34:57.893 INFO:tasks.workunit.client.0.smithi088.stdout:0/950: fdatasync df/d10/f69 0 2023-12-09T02:34:57.898 INFO:tasks.workunit.client.0.smithi088.stdout:4/910: dread d3/dc/d1d/f71 [0,4194304] 0 2023-12-09T02:34:57.900 INFO:tasks.workunit.client.0.smithi088.stdout:0/951: creat df/d37/d70/f132 x:0 0 0 2023-12-09T02:34:57.901 INFO:tasks.workunit.client.0.smithi088.stdout:7/947: sync 2023-12-09T02:34:57.902 INFO:tasks.workunit.client.0.smithi088.stdout:4/911: link d3/dc/d18/dab/dc7/dd7/f116 d3/dc/d18/da9/d115/f124 0 2023-12-09T02:34:57.902 INFO:tasks.workunit.client.0.smithi088.stdout:4/912: fsync d3/dc/f48 0 2023-12-09T02:34:57.903 INFO:tasks.workunit.client.0.smithi088.stdout:4/913: fsync d3/f9 0 2023-12-09T02:34:57.909 INFO:tasks.workunit.client.0.smithi088.stdout:6/926: dwrite d16/d35/f107 [0,4194304] 0 2023-12-09T02:34:57.914 INFO:tasks.workunit.client.0.smithi088.stdout:6/927: link d16/d1b/d56/fa2 d16/f113 0 2023-12-09T02:34:57.915 INFO:tasks.workunit.client.0.smithi088.stdout:6/928: creat d16/d1b/d2c/d3f/d83/de4/f114 x:0 0 0 2023-12-09T02:34:57.916 INFO:tasks.workunit.client.0.smithi088.stdout:6/929: creat d16/d62/d6f/db3/f115 x:0 0 0 2023-12-09T02:34:57.916 INFO:tasks.workunit.client.0.smithi088.stdout:7/948: dread dc/d21/d6b/d6d/da4/d38/f49 [4194304,4194304] 0 2023-12-09T02:34:57.917 INFO:tasks.workunit.client.0.smithi088.stdout:4/914: dread d3/f4c [0,4194304] 0 2023-12-09T02:34:57.917 INFO:tasks.workunit.client.0.smithi088.stdout:4/915: dread - d3/fac zero size 2023-12-09T02:34:57.917 INFO:tasks.workunit.client.0.smithi088.stdout:6/930: symlink d16/d1b/d2c/d3f/d41/d80/l116 0 2023-12-09T02:34:57.918 INFO:tasks.workunit.client.0.smithi088.stdout:0/952: dwrite df/d28/d43/f46 [0,4194304] 0 2023-12-09T02:34:57.918 INFO:tasks.workunit.client.0.smithi088.stdout:0/953: readlink df/l103 0 2023-12-09T02:34:57.918 INFO:tasks.workunit.client.0.smithi088.stdout:0/954: chown df/d10/d22/d2d/d3c/lf2 790868 1 2023-12-09T02:34:57.919 INFO:tasks.workunit.client.0.smithi088.stdout:4/916: rename d3/dc/d43/d8c/fa5 to d3/dc/d43/d8c/d95/d110/f125 0 2023-12-09T02:34:57.921 INFO:tasks.workunit.client.0.smithi088.stdout:6/931: read d16/d1b/d25/fae [744507,61786] 0 2023-12-09T02:34:57.926 INFO:tasks.workunit.client.0.smithi088.stdout:4/917: mkdir d3/dc/d43/dc5/dd8/d126 0 2023-12-09T02:34:57.926 INFO:tasks.workunit.client.0.smithi088.stdout:7/949: dread dc/fe0 [0,4194304] 0 2023-12-09T02:34:57.926 INFO:tasks.workunit.client.0.smithi088.stdout:7/950: dread - dc/d1b/d72/fca zero size 2023-12-09T02:34:57.926 INFO:tasks.workunit.client.0.smithi088.stdout:7/951: fdatasync dc/d21/d6b/d6d/da4/d3e/f100 0 2023-12-09T02:34:57.926 INFO:tasks.workunit.client.0.smithi088.stdout:6/932: creat d16/d35/d36/d97/d90/f117 x:0 0 0 2023-12-09T02:34:57.927 INFO:tasks.workunit.client.0.smithi088.stdout:4/918: getdents d3/dc/d18/d29/da4/dfd 0 2023-12-09T02:34:57.927 INFO:tasks.workunit.client.0.smithi088.stdout:7/952: mknod dc/dcb/c146 0 2023-12-09T02:34:57.927 INFO:tasks.workunit.client.0.smithi088.stdout:7/953: write dc/dcb/de2/feb [471198,122693] 0 2023-12-09T02:34:57.927 INFO:tasks.workunit.client.0.smithi088.stdout:0/955: dread df/d10/d22/d5b/f71 [0,4194304] 0 2023-12-09T02:34:57.928 INFO:tasks.workunit.client.0.smithi088.stdout:0/956: truncate df/d10/d22/d2d/d6a/fb0 2514071 0 2023-12-09T02:34:57.931 INFO:tasks.workunit.client.0.smithi088.stdout:0/957: mkdir df/d10/d22/d2d/d96/dea/d133 0 2023-12-09T02:34:57.931 INFO:tasks.workunit.client.0.smithi088.stdout:0/958: read df/f57 [594638,119666] 0 2023-12-09T02:34:57.933 INFO:tasks.workunit.client.0.smithi088.stdout:3/911: sync 2023-12-09T02:34:57.933 INFO:tasks.workunit.client.0.smithi088.stdout:3/912: chown d1/d9/d6f/d22/d7f/d117/ddf/f113 199 1 2023-12-09T02:34:57.935 INFO:tasks.workunit.client.0.smithi088.stdout:6/933: dread d16/d1b/d25/f40 [0,4194304] 0 2023-12-09T02:34:57.936 INFO:tasks.workunit.client.0.smithi088.stdout:4/919: dread d3/dc/d43/d83/d37/fbe [0,4194304] 0 2023-12-09T02:34:57.937 INFO:tasks.workunit.client.0.smithi088.stdout:3/913: write d1/d9/d6f/d6/f3f [1980112,96740] 0 2023-12-09T02:34:57.937 INFO:tasks.workunit.client.0.smithi088.stdout:3/914: chown d1/d9/d6f/d70 5 1 2023-12-09T02:34:57.938 INFO:tasks.workunit.client.0.smithi088.stdout:0/959: dread df/d28/f95 [0,4194304] 0 2023-12-09T02:34:57.939 INFO:tasks.workunit.client.0.smithi088.stdout:4/920: link d3/dc/d43/dc5/dd8/fec d3/dc/d43/d8c/d9a/f127 0 2023-12-09T02:34:57.941 INFO:tasks.workunit.client.0.smithi088.stdout:4/921: mkdir d3/dc/d43/d8c/d9a/dd0/d128 0 2023-12-09T02:34:57.941 INFO:tasks.workunit.client.0.smithi088.stdout:0/960: creat df/d28/d34/dc8/d108/f134 x:0 0 0 2023-12-09T02:34:57.941 INFO:tasks.workunit.client.0.smithi088.stdout:4/922: readlink d3/dc/d43/d83/lcd 0 2023-12-09T02:34:57.942 INFO:tasks.workunit.client.0.smithi088.stdout:4/923: chown d3/dc/d43/d83/f25 14043582 1 2023-12-09T02:34:57.942 INFO:tasks.workunit.client.0.smithi088.stdout:0/961: symlink df/d10/d22/d2d/d2e/ddc/l135 0 2023-12-09T02:34:57.942 INFO:tasks.workunit.client.0.smithi088.stdout:4/924: creat d3/dc/d18/d29/da4/f129 x:0 0 0 2023-12-09T02:34:57.943 INFO:tasks.workunit.client.0.smithi088.stdout:0/962: truncate df/d10/d22/d5f/fb6 549668 0 2023-12-09T02:34:57.945 INFO:tasks.workunit.client.0.smithi088.stdout:0/963: mknod df/d28/d33/c136 0 2023-12-09T02:34:57.952 INFO:tasks.workunit.client.0.smithi088.stdout:3/915: dwrite d1/d9/d6f/d6/fe6 [0,4194304] 0 2023-12-09T02:34:57.953 INFO:tasks.workunit.client.0.smithi088.stdout:3/916: mkdir d1/d9/d136 0 2023-12-09T02:34:57.959 INFO:tasks.workunit.client.0.smithi088.stdout:4/925: dwrite d3/dc/d18/da9/ff6 [0,4194304] 0 2023-12-09T02:34:57.961 INFO:tasks.workunit.client.0.smithi088.stdout:4/926: mkdir d3/dc/d18/d7b/dbb/dbc/d12a 0 2023-12-09T02:34:57.962 INFO:tasks.workunit.client.0.smithi088.stdout:4/927: getdents d3/dc/d43/dc5/dd8 0 2023-12-09T02:34:57.963 INFO:tasks.workunit.client.0.smithi088.stdout:4/928: write d3/dc/d18/d29/da4/dfd/f10c [854403,67299] 0 2023-12-09T02:34:57.965 INFO:tasks.workunit.client.0.smithi088.stdout:4/929: creat d3/dc/d43/d8c/d95/daa/db7/f12b x:0 0 0 2023-12-09T02:34:57.965 INFO:tasks.workunit.client.0.smithi088.stdout:4/930: write d3/dc/d18/d29/da4/fe5 [1010771,124522] 0 2023-12-09T02:34:57.965 INFO:tasks.workunit.client.0.smithi088.stdout:4/931: read d3/d65/f74 [587528,51950] 0 2023-12-09T02:34:57.966 INFO:tasks.workunit.client.0.smithi088.stdout:4/932: stat d3/d65/de4/f101 0 2023-12-09T02:34:57.969 INFO:tasks.workunit.client.0.smithi088.stdout:3/917: dwrite d1/d9/d6f/f51 [0,4194304] 0 2023-12-09T02:34:57.969 INFO:tasks.workunit.client.0.smithi088.stdout:3/918: chown d1/d9/d6f/d2d/db9/l11f 344 1 2023-12-09T02:34:57.969 INFO:tasks.workunit.client.0.smithi088.stdout:3/919: truncate d1/d9/f11b 69781 0 2023-12-09T02:34:57.970 INFO:tasks.workunit.client.0.smithi088.stdout:3/920: rename d1/d9/d6f/d22/d7f/f12d to d1/d9/d6f/d6/d4a/d41/d33/d49/f137 0 2023-12-09T02:34:57.972 INFO:tasks.workunit.client.0.smithi088.stdout:3/921: mkdir d1/d9/d6f/d2d/dab/dc5/dc9/d138 0 2023-12-09T02:34:57.978 INFO:tasks.workunit.client.0.smithi088.stdout:4/933: dwrite d3/dc/d43/d8c/fa3 [0,4194304] 0 2023-12-09T02:34:57.986 INFO:tasks.workunit.client.0.smithi088.stdout:3/922: dwrite d1/d9/d6f/d6/d4a/d41/d10b/fa0 [0,4194304] 0 2023-12-09T02:34:57.986 INFO:tasks.workunit.client.0.smithi088.stdout:3/923: chown d1/d9/d6f/d22/d7f/d45/f130 1 1 2023-12-09T02:34:57.986 INFO:tasks.workunit.client.0.smithi088.stdout:3/924: fdatasync d1/d9/d6f/d2d/d66/f5d 0 2023-12-09T02:34:57.987 INFO:tasks.workunit.client.0.smithi088.stdout:4/934: dread d3/dc/d43/d8c/fb5 [0,4194304] 0 2023-12-09T02:34:57.991 INFO:tasks.workunit.client.0.smithi088.stdout:3/925: creat d1/d9/d6f/d2d/dab/d112/f139 x:0 0 0 2023-12-09T02:34:57.993 INFO:tasks.workunit.client.0.smithi088.stdout:4/935: rename d3/dc/d1d/f9d to d3/d65/db0/dc1/f12c 0 2023-12-09T02:34:57.995 INFO:tasks.workunit.client.0.smithi088.stdout:3/926: rmdir d1/d9/d120 0 2023-12-09T02:34:57.996 INFO:tasks.workunit.client.0.smithi088.stdout:4/936: mknod d3/dc/d18/d7b/dbb/c12d 0 2023-12-09T02:34:57.998 INFO:tasks.workunit.client.0.smithi088.stdout:3/927: creat d1/d9/d136/f13a x:0 0 0 2023-12-09T02:34:57.998 INFO:tasks.workunit.client.0.smithi088.stdout:2/999: sync 2023-12-09T02:34:58.000 INFO:tasks.workunit.client.0.smithi088.stdout:4/937: rename d3/dc/d43/dc5/dd8/fe7 to d3/dc/d18/da9/d115/f12e 0 2023-12-09T02:34:58.002 INFO:tasks.workunit.client.0.smithi088.stdout:3/928: mkdir d1/d9/d6f/d2d/dab/d112/d13b 0 2023-12-09T02:34:58.003 INFO:tasks.workunit.client.0.smithi088.stdout:4/938: mknod d3/dc/d43/d8c/d99/c12f 0 2023-12-09T02:34:58.003 INFO:tasks.workunit.client.0.smithi088.stdout:4/939: chown d3/dc/f9e 1 1 2023-12-09T02:34:58.006 INFO:tasks.workunit.client.0.smithi088.stdout:4/940: write d3/dc/d43/fae [2004029,38468] 0 2023-12-09T02:34:58.008 INFO:tasks.workunit.client.0.smithi088.stdout:4/941: link d3/dc/d18/d7b/dbb/c12d d3/dc/d43/d8c/d9a/c130 0 2023-12-09T02:34:58.008 INFO:tasks.workunit.client.0.smithi088.stdout:4/942: chown d3/dc/d43/d83/l111 66591374 1 2023-12-09T02:34:58.021 INFO:tasks.workunit.client.0.smithi088.stdout:3/929: dwrite d1/d9/d6f/d2d/d66/fe7 [0,4194304] 0 2023-12-09T02:34:58.021 INFO:tasks.workunit.client.0.smithi088.stdout:3/930: fdatasync d1/d9/d6f/d2d/d66/fa2 0 2023-12-09T02:34:58.025 INFO:tasks.workunit.client.0.smithi088.stdout:3/931: creat d1/d9/dbf/f13c x:0 0 0 2023-12-09T02:34:58.025 INFO:tasks.workunit.client.0.smithi088.stdout:3/932: chown d1/d9/d6f/d2d/d109/d85/ddc 1044392 1 2023-12-09T02:34:58.031 INFO:tasks.workunit.client.0.smithi088.stdout:3/933: dread d1/d9/d6f/d15/ff0 [0,4194304] 0 2023-12-09T02:34:58.031 INFO:tasks.workunit.client.0.smithi088.stdout:3/934: truncate d1/d9/fc7 438118 0 2023-12-09T02:34:58.031 INFO:tasks.workunit.client.0.smithi088.stdout:4/943: dwrite d3/dc/d43/d8c/d95/f7a [0,4194304] 0 2023-12-09T02:34:58.034 INFO:tasks.workunit.client.0.smithi088.stdout:4/944: creat d3/dc/d43/d83/f131 x:0 0 0 2023-12-09T02:34:58.041 INFO:tasks.workunit.client.0.smithi088.stdout:4/945: dread d3/dc/d43/d83/f55 [0,4194304] 0 2023-12-09T02:34:58.042 INFO:tasks.workunit.client.0.smithi088.stdout:4/946: mkdir d3/dc/d88/d132 0 2023-12-09T02:34:58.042 INFO:tasks.workunit.client.0.smithi088.stdout:4/947: chown d3/dc/d43/d8c/d95/daa 434330 1 2023-12-09T02:34:58.042 INFO:tasks.workunit.client.0.smithi088.stdout:4/948: readlink d3/dc/d43/d83/l111 0 2023-12-09T02:34:58.042 INFO:tasks.workunit.client.0.smithi088.stdout:0/964: sync 2023-12-09T02:34:58.043 INFO:tasks.workunit.client.0.smithi088.stdout:7/954: sync 2023-12-09T02:34:58.043 INFO:tasks.workunit.client.0.smithi088.stdout:6/934: sync 2023-12-09T02:34:58.043 INFO:tasks.workunit.client.0.smithi088.stdout:4/949: creat d3/dc/d18/d29/da4/dfd/f133 x:0 0 0 2023-12-09T02:34:58.043 INFO:tasks.workunit.client.0.smithi088.stdout:7/955: link dc/d21/d7f/cfb dc/d21/d7f/c147 0 2023-12-09T02:34:58.044 INFO:tasks.workunit.client.0.smithi088.stdout:6/935: mkdir d16/d1b/d2c/d3f/d41/d118 0 2023-12-09T02:34:58.045 INFO:tasks.workunit.client.0.smithi088.stdout:7/956: symlink dc/d1b/d91/dfe/l148 0 2023-12-09T02:34:58.047 INFO:tasks.workunit.client.0.smithi088.stdout:0/965: write df/d37/de2/f91 [7741555,130784] 0 2023-12-09T02:34:58.047 INFO:tasks.workunit.client.0.smithi088.stdout:6/936: rename d16/d35/d65/c96 to d16/d35/d36/c119 0 2023-12-09T02:34:58.047 INFO:tasks.workunit.client.0.smithi088.stdout:3/935: dwrite d1/d9/d6f/d6/d83/fcc [0,4194304] 0 2023-12-09T02:34:58.047 INFO:tasks.workunit.client.0.smithi088.stdout:3/936: fsync d1/d9/d6f/d6/d4a/d41/d33/d49/f52 0 2023-12-09T02:34:58.049 INFO:tasks.workunit.client.0.smithi088.stdout:4/950: unlink d3/dc/d1d/d40/ddf/l10d 0 2023-12-09T02:34:58.050 INFO:tasks.workunit.client.0.smithi088.stdout:7/957: mknod dc/d21/d6b/d6d/d130/c149 0 2023-12-09T02:34:58.052 INFO:tasks.workunit.client.0.smithi088.stdout:3/937: getdents d1/d9/d6f/d2d/db9 0 2023-12-09T02:34:58.053 INFO:tasks.workunit.client.0.smithi088.stdout:3/938: getdents d1/d9/d6f/d2d/dab/dc5/dc9/dce 0 2023-12-09T02:34:58.053 INFO:tasks.workunit.client.0.smithi088.stdout:4/951: mknod d3/dc/d43/d8c/d9a/c134 0 2023-12-09T02:34:58.054 INFO:tasks.workunit.client.0.smithi088.stdout:7/958: symlink dc/d1b/d91/dfe/l14a 0 2023-12-09T02:34:58.055 INFO:tasks.workunit.client.0.smithi088.stdout:3/939: creat d1/d9/d6f/d22/d7f/d117/d119/f13d x:0 0 0 2023-12-09T02:34:58.057 INFO:tasks.workunit.client.0.smithi088.stdout:3/940: read d1/d9/d6f/d22/f8a [1148739,73248] 0 2023-12-09T02:34:58.057 INFO:tasks.workunit.client.0.smithi088.stdout:3/941: write d1/d9/d6f/f118 [240754,111916] 0 2023-12-09T02:34:58.057 INFO:tasks.workunit.client.0.smithi088.stdout:4/952: rename d3/dc/d18/d7b/fcc to d3/dc/d18/d29/da4/f135 0 2023-12-09T02:34:58.057 INFO:tasks.workunit.client.0.smithi088.stdout:6/937: dread d16/d1b/f1d [0,4194304] 0 2023-12-09T02:34:58.058 INFO:tasks.workunit.client.0.smithi088.stdout:7/959: mkdir dc/d21/d6b/dbb/d14b 0 2023-12-09T02:34:58.061 INFO:tasks.workunit.client.0.smithi088.stdout:3/942: rename d1/d9/d6f/d6/d4a/d41/d10b/db1/d12a/f133 to d1/d9/d6f/d2d/d109/d85/dcb/f13e 0 2023-12-09T02:34:58.062 INFO:tasks.workunit.client.0.smithi088.stdout:0/966: dwrite df/d37/fb2 [0,4194304] 0 2023-12-09T02:34:58.062 INFO:tasks.workunit.client.0.smithi088.stdout:6/938: symlink d16/d1b/d25/d5f/d63/l11a 0 2023-12-09T02:34:58.065 INFO:tasks.workunit.client.0.smithi088.stdout:3/943: mknod d1/d9/d6f/d22/c13f 0 2023-12-09T02:34:58.069 INFO:tasks.workunit.client.0.smithi088.stdout:6/939: creat d16/d1b/d25/d5f/d63/df8/f11b x:0 0 0 2023-12-09T02:34:58.070 INFO:tasks.workunit.client.0.smithi088.stdout:6/940: mkdir d16/d35/d36/d97/d11c 0 2023-12-09T02:34:58.070 INFO:tasks.workunit.client.0.smithi088.stdout:6/941: fsync d16/f39 0 2023-12-09T02:34:58.071 INFO:tasks.workunit.client.0.smithi088.stdout:6/942: chown d16/d1b/d25/d5f/fb5 27932 1 2023-12-09T02:34:58.072 INFO:tasks.workunit.client.0.smithi088.stdout:6/943: creat d16/d62/d6f/db3/f11d x:0 0 0 2023-12-09T02:34:58.072 INFO:tasks.workunit.client.0.smithi088.stdout:0/967: dread df/d10/d22/f74 [0,4194304] 0 2023-12-09T02:34:58.074 INFO:tasks.workunit.client.0.smithi088.stdout:0/968: write df/d10/d22/d2d/f8a [9611,42963] 0 2023-12-09T02:34:58.074 INFO:tasks.workunit.client.0.smithi088.stdout:0/969: readlink df/d10/laa 0 2023-12-09T02:34:58.075 INFO:tasks.workunit.client.0.smithi088.stdout:7/960: dwrite dc/d1b/d89/f94 [0,4194304] 0 2023-12-09T02:34:58.077 INFO:tasks.workunit.client.0.smithi088.stdout:0/970: dread df/d28/d33/d81/ff6 [0,4194304] 0 2023-12-09T02:34:58.077 INFO:tasks.workunit.client.0.smithi088.stdout:0/971: fsync df/d10/d22/d5f/f112 0 2023-12-09T02:34:58.079 INFO:tasks.workunit.client.0.smithi088.stdout:7/961: creat dc/d21/d6b/d6d/d76/df0/f14c x:0 0 0 2023-12-09T02:34:58.081 INFO:tasks.workunit.client.0.smithi088.stdout:0/972: rename df/d28/d43 to df/d28/d33/daf/d137 0 2023-12-09T02:34:58.082 INFO:tasks.workunit.client.0.smithi088.stdout:7/962: creat dc/d21/d6b/d6d/da4/d10c/f14d x:0 0 0 2023-12-09T02:34:58.082 INFO:tasks.workunit.client.0.smithi088.stdout:7/963: write dc/d1b/f4b [4562570,27514] 0 2023-12-09T02:34:58.083 INFO:tasks.workunit.client.0.smithi088.stdout:0/973: mkdir df/d37/d97/d138 0 2023-12-09T02:34:58.091 INFO:tasks.workunit.client.0.smithi088.stdout:7/964: dread dc/d21/d6b/d6d/da4/f5e [0,4194304] 0 2023-12-09T02:34:58.093 INFO:tasks.workunit.client.0.smithi088.stdout:3/944: dwrite d1/d9/d6f/d6/d83/fcc [0,4194304] 0 2023-12-09T02:34:58.096 INFO:tasks.workunit.client.0.smithi088.stdout:3/945: dread d1/d9/d6f/d2d/d109/d85/fb3 [0,4194304] 0 2023-12-09T02:34:58.100 INFO:tasks.workunit.client.0.smithi088.stdout:7/965: dread dc/d21/d6b/d6d/da4/d38/fa7 [0,4194304] 0 2023-12-09T02:34:58.101 INFO:tasks.workunit.client.0.smithi088.stdout:6/944: dwrite d16/fa6 [0,4194304] 0 2023-12-09T02:34:58.105 INFO:tasks.workunit.client.0.smithi088.stdout:0/974: dwrite df/d28/f95 [0,4194304] 0 2023-12-09T02:34:58.109 INFO:tasks.workunit.client.0.smithi088.stdout:0/975: dread df/d10/fd8 [0,4194304] 0 2023-12-09T02:34:58.109 INFO:tasks.workunit.client.0.smithi088.stdout:0/976: write df/d10/d22/d5f/ffb [772806,80182] 0 2023-12-09T02:34:58.109 INFO:tasks.workunit.client.0.smithi088.stdout:0/977: fsync df/d28/df3/f104 0 2023-12-09T02:34:58.109 INFO:tasks.workunit.client.0.smithi088.stdout:0/978: read df/d10/d22/d5b/f5d [3538245,64372] 0 2023-12-09T02:34:58.174 INFO:tasks.workunit.client.0.smithi088.stdout:3/946: creat d1/d9/d6f/d6/d4a/d41/d10b/db1/d12a/f140 x:0 0 0 2023-12-09T02:34:58.174 INFO:tasks.workunit.client.0.smithi088.stdout:3/947: readlink d1/d9/d6f/d6/d4a/d41/d124/l12e 0 2023-12-09T02:34:58.176 INFO:tasks.workunit.client.0.smithi088.stdout:7/966: truncate dc/d21/d6b/d6d/da4/d38/ff 2365626 0 2023-12-09T02:34:58.179 INFO:tasks.workunit.client.0.smithi088.stdout:6/945: creat d16/d1b/d2c/d3f/d41/d80/dd0/f11e x:0 0 0 2023-12-09T02:34:58.184 INFO:tasks.workunit.client.0.smithi088.stdout:0/979: rename df/d37/de2/fc9 to df/d10/d22/d2d/d6a/deb/f139 0 2023-12-09T02:34:58.186 INFO:tasks.workunit.client.0.smithi088.stdout:3/948: mkdir d1/d9/d6f/d2d/d109/d85/dcb/d141 0 2023-12-09T02:34:58.186 INFO:tasks.workunit.client.0.smithi088.stdout:3/949: read d1/d9/d6f/d15/ff0 [74045,95162] 0 2023-12-09T02:34:58.187 INFO:tasks.workunit.client.0.smithi088.stdout:7/967: creat dc/d21/d6b/d9b/f14e x:0 0 0 2023-12-09T02:34:58.188 INFO:tasks.workunit.client.0.smithi088.stdout:7/968: write dc/d21/d6b/d6d/d76/df0/ff2 [28646,114206] 0 2023-12-09T02:34:58.190 INFO:tasks.workunit.client.0.smithi088.stdout:6/946: rename d16/d35/d36/d97/d90/f111 to d16/d1b/d2c/d3f/d41/d80/f11f 0 2023-12-09T02:34:58.192 INFO:tasks.workunit.client.0.smithi088.stdout:0/980: dread df/d10/d22/d2d/d3c/f47 [4194304,4194304] 0 2023-12-09T02:34:58.193 INFO:tasks.workunit.client.0.smithi088.stdout:7/969: mkdir dc/d21/d6b/d93/d11f/d14f 0 2023-12-09T02:34:58.195 INFO:tasks.workunit.client.0.smithi088.stdout:0/981: unlink df/d10/c80 0 2023-12-09T02:34:58.207 INFO:tasks.workunit.client.0.smithi088.stdout:0/982: dread df/d28/d33/f4e [0,4194304] 0 2023-12-09T02:34:58.207 INFO:tasks.workunit.client.0.smithi088.stdout:3/950: dwrite d1/d9/d6f/f10c [0,4194304] 0 2023-12-09T02:34:58.208 INFO:tasks.workunit.client.0.smithi088.stdout:0/983: write df/d10/d22/d5f/fd5 [271490,117592] 0 2023-12-09T02:34:58.211 INFO:tasks.workunit.client.0.smithi088.stdout:7/970: dwrite dc/dcb/de2/f13b [0,4194304] 0 2023-12-09T02:34:58.214 INFO:tasks.workunit.client.0.smithi088.stdout:0/984: creat df/d10/d22/d2d/d2e/f13a x:0 0 0 2023-12-09T02:34:58.216 INFO:tasks.workunit.client.0.smithi088.stdout:7/971: symlink dc/d21/d6b/dbb/l150 0 2023-12-09T02:34:58.218 INFO:tasks.workunit.client.0.smithi088.stdout:0/985: truncate df/f106 3410103 0 2023-12-09T02:34:58.220 INFO:tasks.workunit.client.0.smithi088.stdout:0/986: dread df/d37/ffe [0,4194304] 0 2023-12-09T02:34:58.243 INFO:tasks.workunit.client.0.smithi088.stdout:0/987: dwrite df/d28/d33/f5a [4194304,4194304] 0 2023-12-09T02:34:58.245 INFO:tasks.workunit.client.0.smithi088.stdout:0/988: symlink df/d28/d34/l13b 0 2023-12-09T02:34:58.245 INFO:tasks.workunit.client.0.smithi088.stdout:0/989: readlink df/d28/d34/l4c 0 2023-12-09T02:34:58.245 INFO:tasks.workunit.client.0.smithi088.stdout:0/990: truncate df/d10/d22/d2d/d2e/f13a 529830 0 2023-12-09T02:34:58.247 INFO:tasks.workunit.client.0.smithi088.stdout:0/991: creat df/dd0/f13c x:0 0 0 2023-12-09T02:34:58.260 INFO:tasks.workunit.client.0.smithi088.stdout:4/953: sync 2023-12-09T02:34:58.260 INFO:tasks.workunit.client.0.smithi088.stdout:4/954: readlink d3/l5d 0 2023-12-09T02:34:58.261 INFO:tasks.workunit.client.0.smithi088.stdout:0/992: dwrite df/d28/d33/daf/fff [0,4194304] 0 2023-12-09T02:34:58.261 INFO:tasks.workunit.client.0.smithi088.stdout:4/955: write d3/f39 [3795497,125507] 0 2023-12-09T02:34:58.261 INFO:tasks.workunit.client.0.smithi088.stdout:4/956: chown d3/dc/d18/d29/f119 131 1 2023-12-09T02:34:58.268 INFO:tasks.workunit.client.0.smithi088.stdout:4/957: truncate d3/dc/d43/d83/f67 256642 0 2023-12-09T02:34:58.277 INFO:tasks.workunit.client.0.smithi088.stdout:0/993: dwrite df/d10/d22/f74 [4194304,4194304] 0 2023-12-09T02:34:58.277 INFO:tasks.workunit.client.0.smithi088.stdout:0/994: readlink df/d28/d34/l13b 0 2023-12-09T02:34:58.290 INFO:tasks.workunit.client.0.smithi088.stdout:4/958: mknod d3/dc/d43/c136 0 2023-12-09T02:34:58.291 INFO:tasks.workunit.client.0.smithi088.stdout:4/959: truncate d3/dc/f48 397514 0 2023-12-09T02:34:58.291 INFO:tasks.workunit.client.0.smithi088.stdout:4/960: write d3/dc/d43/d83/f49 [1426134,127625] 0 2023-12-09T02:34:58.294 INFO:tasks.workunit.client.0.smithi088.stdout:4/961: rmdir d3/dc/d43/d8c/d95/daa/db7 39 2023-12-09T02:34:58.302 INFO:tasks.workunit.client.0.smithi088.stdout:3/951: rename d1/d9/d6f/d6/fac to d1/d9/d6f/d15/f142 0 2023-12-09T02:34:58.304 INFO:tasks.workunit.client.0.smithi088.stdout:7/972: rename dc/d21/d6b/d6d/da4/d38/l65 to dc/d21/d6b/d93/d12a/l151 0 2023-12-09T02:34:58.304 INFO:tasks.workunit.client.0.smithi088.stdout:7/973: write dc/d21/f58 [3820851,20475] 0 2023-12-09T02:34:58.305 INFO:tasks.workunit.client.0.smithi088.stdout:0/995: rename df/d10/d22/l8f to df/dd0/l13d 0 2023-12-09T02:34:58.305 INFO:tasks.workunit.client.0.smithi088.stdout:0/996: chown df/d10/d22/d2d/d2e/l63 3 1 2023-12-09T02:34:58.308 INFO:tasks.workunit.client.0.smithi088.stdout:7/974: link dc/d21/d6b/d6d/da4/d38/d1e/c11e dc/d1b/d89/c152 0 2023-12-09T02:34:58.309 INFO:tasks.workunit.client.0.smithi088.stdout:0/997: stat df/d37/d70/c75 0 2023-12-09T02:34:58.310 INFO:tasks.workunit.client.0.smithi088.stdout:7/975: creat dc/f153 x:0 0 0 2023-12-09T02:34:58.310 INFO:tasks.workunit.client.0.smithi088.stdout:7/976: truncate dc/d21/d6b/d6d/da4/d38/f140 347722 0 2023-12-09T02:34:58.311 INFO:tasks.workunit.client.0.smithi088.stdout:7/977: truncate dc/d21/d6b/d6d/d76/f98 858947 0 2023-12-09T02:34:58.311 INFO:tasks.workunit.client.0.smithi088.stdout:3/952: dread d1/d9/d6f/d6/d83/fcc [0,4194304] 0 2023-12-09T02:34:58.311 INFO:tasks.workunit.client.0.smithi088.stdout:3/953: truncate d1/d9/d6f/d22/d7f/d117/ffe 541285 0 2023-12-09T02:34:58.311 INFO:tasks.workunit.client.0.smithi088.stdout:0/998: mkdir df/d28/d34/dc8/d13e 0 2023-12-09T02:34:58.312 INFO:tasks.workunit.client.0.smithi088.stdout:0/999: write df/d10/d22/fb3 [2242581,61420] 0 2023-12-09T02:34:58.312 INFO:tasks.workunit.client.0.smithi088.stdout:7/978: link dc/d1b/de4/c126 dc/d21/d6b/d6d/da4/d10c/d10e/d142/c154 0 2023-12-09T02:34:58.313 INFO:tasks.workunit.client.0.smithi088.stdout:7/979: truncate dc/d21/d6b/d93/f102 3158157 0 2023-12-09T02:34:58.313 INFO:tasks.workunit.client.0.smithi088.stdout:7/980: dread - dc/d21/d6b/d93/d11f/f141 zero size 2023-12-09T02:34:58.314 INFO:tasks.workunit.client.0.smithi088.stdout:6/947: sync 2023-12-09T02:34:58.315 INFO:tasks.workunit.client.0.smithi088.stdout:7/981: dread dc/d21/d6b/d6d/da4/d3e/f100 [0,4194304] 0 2023-12-09T02:34:58.320 INFO:tasks.workunit.client.0.smithi088.stdout:7/982: rename dc/d21/d7f to dc/d155 0 2023-12-09T02:34:58.320 INFO:tasks.workunit.client.0.smithi088.stdout:7/983: truncate dc/d1b/d72/dc4/f119 155203 0 2023-12-09T02:34:58.321 INFO:tasks.workunit.client.0.smithi088.stdout:7/984: mknod dc/d21/d6b/dbb/c156 0 2023-12-09T02:34:58.322 INFO:tasks.workunit.client.0.smithi088.stdout:7/985: stat dc/d21/d6b/d6d/da4/lc6 0 2023-12-09T02:34:58.322 INFO:tasks.workunit.client.0.smithi088.stdout:7/986: chown dc/d21/d6b/d6d/da4/d38/d1e/cfd 2975 1 2023-12-09T02:34:58.324 INFO:tasks.workunit.client.0.smithi088.stdout:7/987: creat dc/d21/d6b/d6d/da4/d10c/d10e/d142/f157 x:0 0 0 2023-12-09T02:34:58.324 INFO:tasks.workunit.client.0.smithi088.stdout:7/988: dread - dc/d21/d6b/d6d/d76/d106/f129 zero size 2023-12-09T02:34:58.325 INFO:tasks.workunit.client.0.smithi088.stdout:7/989: creat dc/d21/d6b/d9b/f158 x:0 0 0 2023-12-09T02:34:58.325 INFO:tasks.workunit.client.0.smithi088.stdout:7/990: chown dc/f15 877362 1 2023-12-09T02:34:58.328 INFO:tasks.workunit.client.0.smithi088.stdout:6/948: dwrite d16/d35/f46 [0,4194304] 0 2023-12-09T02:34:58.329 INFO:tasks.workunit.client.0.smithi088.stdout:6/949: rmdir d16/d62/d6f/da4/dc2/d110 0 2023-12-09T02:34:58.330 INFO:tasks.workunit.client.0.smithi088.stdout:6/950: chown d16/d1b/d2c/l2f 0 1 2023-12-09T02:34:58.333 INFO:tasks.workunit.client.0.smithi088.stdout:6/951: rename d16/d1b/d2c/d3f/d41/l45 to d16/d62/da7/l120 0 2023-12-09T02:34:58.333 INFO:tasks.workunit.client.0.smithi088.stdout:6/952: readlink d16/d62/da7/l120 0 2023-12-09T02:34:58.351 INFO:tasks.workunit.client.0.smithi088.stdout:6/953: dwrite d16/d35/f84 [0,4194304] 0 2023-12-09T02:34:58.351 INFO:tasks.workunit.client.0.smithi088.stdout:7/991: dwrite dc/d1b/d72/dec/fee [0,4194304] 0 2023-12-09T02:34:58.351 INFO:tasks.workunit.client.0.smithi088.stdout:7/992: write dc/d21/d6b/d6d/da4/f55 [35628,75761] 0 2023-12-09T02:34:58.354 INFO:tasks.workunit.client.0.smithi088.stdout:6/954: symlink d16/d1b/d2c/d3f/d83/de4/l121 0 2023-12-09T02:34:58.354 INFO:tasks.workunit.client.0.smithi088.stdout:6/955: write d16/d62/da7/fd6 [685754,38380] 0 2023-12-09T02:34:58.355 INFO:tasks.workunit.client.0.smithi088.stdout:6/956: link f12 d16/d35/d36/f122 0 2023-12-09T02:34:58.356 INFO:tasks.workunit.client.0.smithi088.stdout:6/957: read d16/d1b/f51 [1846534,91447] 0 2023-12-09T02:34:58.359 INFO:tasks.workunit.client.0.smithi088.stdout:6/958: rename d16/d1b/d71 to d16/d1b/d2c/d3f/d41/d123 0 2023-12-09T02:34:58.361 INFO:tasks.workunit.client.0.smithi088.stdout:4/962: sync 2023-12-09T02:34:58.361 INFO:tasks.workunit.client.0.smithi088.stdout:4/963: read d3/dc/d1d/d40/f90 [3296,93294] 0 2023-12-09T02:34:58.362 INFO:tasks.workunit.client.0.smithi088.stdout:4/964: truncate d3/dc/f14 111239 0 2023-12-09T02:34:58.363 INFO:tasks.workunit.client.0.smithi088.stdout:4/965: mkdir d3/dc/d1d/d40/d9f/d137 0 2023-12-09T02:34:58.364 INFO:tasks.workunit.client.0.smithi088.stdout:4/966: creat d3/d65/de4/f138 x:0 0 0 2023-12-09T02:34:58.365 INFO:tasks.workunit.client.0.smithi088.stdout:4/967: read d3/dc/d1d/f97 [1272164,77451] 0 2023-12-09T02:34:58.367 INFO:tasks.workunit.client.0.smithi088.stdout:4/968: mkdir d3/dc/d88/d132/d139 0 2023-12-09T02:34:58.367 INFO:tasks.workunit.client.0.smithi088.stdout:4/969: write d3/dc/d18/d29/da4/fe5 [1341792,65762] 0 2023-12-09T02:34:58.385 INFO:tasks.workunit.client.0.smithi088.stdout:6/959: dwrite d16/d1b/d2c/d3f/d41/f4b [8388608,4194304] 0 2023-12-09T02:34:58.386 INFO:tasks.workunit.client.0.smithi088.stdout:6/960: dread - d16/d1b/d2c/dcd/fe7 zero size 2023-12-09T02:34:58.386 INFO:tasks.workunit.client.0.smithi088.stdout:6/961: write d16/d62/f8e [230630,53937] 0 2023-12-09T02:34:58.386 INFO:tasks.workunit.client.0.smithi088.stdout:4/970: dwrite d3/dc/d43/d8c/d95/f7a [4194304,4194304] 0 2023-12-09T02:34:58.389 INFO:tasks.workunit.client.0.smithi088.stdout:4/971: link d3/dc/d43/d83/cd3 d3/dc/d88/d132/d139/c13a 0 2023-12-09T02:34:58.391 INFO:tasks.workunit.client.0.smithi088.stdout:6/962: link d16/d1b/d56/fa0 d16/d1b/d25/f124 0 2023-12-09T02:34:58.392 INFO:tasks.workunit.client.0.smithi088.stdout:6/963: creat d16/d1b/d2c/d3f/d83/de4/f125 x:0 0 0 2023-12-09T02:34:58.393 INFO:tasks.workunit.client.0.smithi088.stdout:6/964: write d16/f1c [3793105,23217] 0 2023-12-09T02:34:58.393 INFO:tasks.workunit.client.0.smithi088.stdout:6/965: fdatasync d16/f99 0 2023-12-09T02:34:58.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/966: mknod d16/d62/da7/da9/dd9/c126 0 2023-12-09T02:34:58.395 INFO:tasks.workunit.client.0.smithi088.stdout:4/972: dread d3/dc/d18/da9/fdb [0,4194304] 0 2023-12-09T02:34:58.395 INFO:tasks.workunit.client.0.smithi088.stdout:4/973: chown d3/dc/d18/d7b 158131070 1 2023-12-09T02:34:58.396 INFO:tasks.workunit.client.0.smithi088.stdout:4/974: getdents d3/dc/d18/d7b/dbb 0 2023-12-09T02:34:58.397 INFO:tasks.workunit.client.0.smithi088.stdout:4/975: creat d3/dc/d43/d8c/d9a/dd0/d128/f13b x:0 0 0 2023-12-09T02:34:58.398 INFO:tasks.workunit.client.0.smithi088.stdout:4/976: rmdir d3/dc/d1d/d40/d9f 39 2023-12-09T02:34:58.404 INFO:tasks.workunit.client.0.smithi088.stdout:3/954: sync 2023-12-09T02:34:58.405 INFO:tasks.workunit.client.0.smithi088.stdout:3/955: creat d1/d9/d6f/d2d/d66/d101/f143 x:0 0 0 2023-12-09T02:34:58.406 INFO:tasks.workunit.client.0.smithi088.stdout:6/967: dread d16/f21 [0,4194304] 0 2023-12-09T02:34:58.406 INFO:tasks.workunit.client.0.smithi088.stdout:3/956: creat d1/d9/d6f/d6/d4a/d41/d124/f144 x:0 0 0 2023-12-09T02:34:58.409 INFO:tasks.workunit.client.0.smithi088.stdout:3/957: rename d1/d9/d6f/d6/d4a/d41/c8e to d1/d9/d6f/d2d/d109/c145 0 2023-12-09T02:34:58.409 INFO:tasks.workunit.client.0.smithi088.stdout:3/958: write d1/d9/d6f/d2d/d66/fa9 [1537482,3206] 0 2023-12-09T02:34:58.409 INFO:tasks.workunit.client.0.smithi088.stdout:3/959: write d1/d9/d6f/d22/d7f/d117/ddf/f113 [334321,20787] 0 2023-12-09T02:34:58.409 INFO:tasks.workunit.client.0.smithi088.stdout:6/968: mknod d16/d1b/d2c/c127 0 2023-12-09T02:34:58.411 INFO:tasks.workunit.client.0.smithi088.stdout:3/960: rename d1/d9/d6f/f51 to d1/d9/d128/f146 0 2023-12-09T02:34:58.411 INFO:tasks.workunit.client.0.smithi088.stdout:7/993: sync 2023-12-09T02:34:58.411 INFO:tasks.workunit.client.0.smithi088.stdout:7/994: readlink dc/d1b/l26 0 2023-12-09T02:34:58.412 INFO:tasks.workunit.client.0.smithi088.stdout:3/961: read d1/d9/d6f/d2d/d109/d85/dcb/feb [126096,41700] 0 2023-12-09T02:34:58.412 INFO:tasks.workunit.client.0.smithi088.stdout:4/977: dwrite d3/dc/d18/d29/f119 [8388608,4194304] 0 2023-12-09T02:34:58.413 INFO:tasks.workunit.client.0.smithi088.stdout:6/969: rename f9 to d16/d35/d36/d97/f128 0 2023-12-09T02:34:58.413 INFO:tasks.workunit.client.0.smithi088.stdout:7/995: symlink dc/d21/d6b/d6d/da4/d10c/l159 0 2023-12-09T02:34:58.414 INFO:tasks.workunit.client.0.smithi088.stdout:3/962: symlink d1/l147 0 2023-12-09T02:34:58.414 INFO:tasks.workunit.client.0.smithi088.stdout:3/963: stat d1/d9/d6f/d2d/dab/dc5 0 2023-12-09T02:34:58.416 INFO:tasks.workunit.client.0.smithi088.stdout:6/970: unlink d16/d62/d6f/da4/dc2/dc7/fbb 0 2023-12-09T02:34:58.416 INFO:tasks.workunit.client.0.smithi088.stdout:6/971: dread - d16/d35/d36/fdd zero size 2023-12-09T02:34:58.416 INFO:tasks.workunit.client.0.smithi088.stdout:6/972: read - d16/d35/d36/fdd zero size 2023-12-09T02:34:58.416 INFO:tasks.workunit.client.0.smithi088.stdout:7/996: mkdir dc/d1b/d15a 0 2023-12-09T02:34:58.417 INFO:tasks.workunit.client.0.smithi088.stdout:6/973: mknod d16/d1b/d25/d5f/c129 0 2023-12-09T02:34:58.417 INFO:tasks.workunit.client.0.smithi088.stdout:6/974: chown d16/d62/da7/da9/dd9 5446492 1 2023-12-09T02:34:58.417 INFO:tasks.workunit.client.0.smithi088.stdout:6/975: truncate d16/d62/f8e 819860 0 2023-12-09T02:34:58.417 INFO:tasks.workunit.client.0.smithi088.stdout:7/997: mknod dc/d21/d6b/d6d/da4/d38/c15b 0 2023-12-09T02:34:58.418 INFO:tasks.workunit.client.0.smithi088.stdout:6/976: creat d16/d1b/d25/d5f/d63/f12a x:0 0 0 2023-12-09T02:34:58.418 INFO:tasks.workunit.client.0.smithi088.stdout:6/977: rmdir d16/d1b/d25 39 2023-12-09T02:34:58.427 INFO:tasks.workunit.client.0.smithi088.stdout:4/978: dwrite d3/dc/d18/d29/da4/f129 [0,4194304] 0 2023-12-09T02:34:58.430 INFO:tasks.workunit.client.0.smithi088.stdout:4/979: read d3/f89 [745601,55746] 0 2023-12-09T02:34:58.434 INFO:tasks.workunit.client.0.smithi088.stdout:4/980: creat d3/dc/d43/dc5/dd8/d126/f13c x:0 0 0 2023-12-09T02:34:58.452 INFO:tasks.workunit.client.0.smithi088.stdout:3/964: dwrite d1/d9/d6f/d15/fb4 [0,4194304] 0 2023-12-09T02:34:58.453 INFO:tasks.workunit.client.0.smithi088.stdout:3/965: write d1/d9/d6f/d22/f8a [4608826,94404] 0 2023-12-09T02:34:58.454 INFO:tasks.workunit.client.0.smithi088.stdout:3/966: mkdir d1/d9/d6f/d70/d148 0 2023-12-09T02:34:58.455 INFO:tasks.workunit.client.0.smithi088.stdout:3/967: creat d1/d9/d6f/d22/d7f/f149 x:0 0 0 2023-12-09T02:34:58.456 INFO:tasks.workunit.client.0.smithi088.stdout:3/968: mknod d1/d9/d6f/d2d/d109/d85/dcb/d141/c14a 0 2023-12-09T02:34:58.456 INFO:tasks.workunit.client.0.smithi088.stdout:3/969: fdatasync d1/d9/d128/f129 0 2023-12-09T02:34:58.456 INFO:tasks.workunit.client.0.smithi088.stdout:4/981: dwrite d3/dc/d43/d8c/d95/daa/db7/f12b [0,4194304] 0 2023-12-09T02:34:58.456 INFO:tasks.workunit.client.0.smithi088.stdout:6/978: dwrite d16/d62/d6f/da4/dc2/dc7/d8c/fc4 [0,4194304] 0 2023-12-09T02:34:58.457 INFO:tasks.workunit.client.0.smithi088.stdout:3/970: mknod d1/d9/d6f/d6/d4a/d41/d33/c14b 0 2023-12-09T02:34:58.458 INFO:tasks.workunit.client.0.smithi088.stdout:7/998: dwrite dc/d1b/d72/dec/fee [0,4194304] 0 2023-12-09T02:34:58.458 INFO:tasks.workunit.client.0.smithi088.stdout:3/971: truncate d1/d9/d6f/d6/d4a/d41/fd2 2923887 0 2023-12-09T02:34:58.459 INFO:tasks.workunit.client.0.smithi088.stdout:3/972: dread - d1/d9/d6f/d22/d7f/d117/d119/f13d zero size 2023-12-09T02:34:58.460 INFO:tasks.workunit.client.0.smithi088.stdout:7/999: creat dc/d21/d6b/d6d/da4/d38/d1e/f15c x:0 0 0 2023-12-09T02:34:58.461 INFO:tasks.workunit.client.0.smithi088.stdout:3/973: mknod d1/d9/d6f/d6/d4a/d41/d124/c14c 0 2023-12-09T02:34:58.463 INFO:tasks.workunit.client.0.smithi088.stdout:3/974: mknod d1/d9/d6f/d22/d7f/d45/c14d 0 2023-12-09T02:34:58.464 INFO:tasks.workunit.client.0.smithi088.stdout:3/975: readlink d1/d9/d6f/d2d/d109/d85/l90 0 2023-12-09T02:34:58.465 INFO:tasks.workunit.client.0.smithi088.stdout:3/976: mknod d1/d9/c14e 0 2023-12-09T02:34:58.467 INFO:tasks.workunit.client.0.smithi088.stdout:3/977: creat d1/d9/d6f/d2d/d109/d85/dcb/d141/f14f x:0 0 0 2023-12-09T02:34:58.468 INFO:tasks.workunit.client.0.smithi088.stdout:3/978: write d1/d9/d6f/d6/d8b/fa4 [6735694,1065] 0 2023-12-09T02:34:58.469 INFO:tasks.workunit.client.0.smithi088.stdout:6/979: dread d16/d1b/d25/f3b [0,4194304] 0 2023-12-09T02:34:58.470 INFO:tasks.workunit.client.0.smithi088.stdout:3/979: mkdir d1/d9/d6f/d6/d4a/d150 0 2023-12-09T02:34:58.470 INFO:tasks.workunit.client.0.smithi088.stdout:3/980: chown d1/d9/l64 285289944 1 2023-12-09T02:34:58.470 INFO:tasks.workunit.client.0.smithi088.stdout:3/981: chown d1/d9/d6f/d6/d4a/d41/d33/d49/f4f 14 1 2023-12-09T02:34:58.470 INFO:tasks.workunit.client.0.smithi088.stdout:6/980: write d16/d1b/d25/d5f/fcb [372610,6758] 0 2023-12-09T02:34:58.470 INFO:tasks.workunit.client.0.smithi088.stdout:6/981: fdatasync d16/d35/d36/fa3 0 2023-12-09T02:34:58.470 INFO:tasks.workunit.client.0.smithi088.stdout:6/982: readlink d16/d1b/d56/lef 0 2023-12-09T02:34:58.471 INFO:tasks.workunit.client.0.smithi088.stdout:3/982: creat d1/d9/d6f/d70/f151 x:0 0 0 2023-12-09T02:34:58.472 INFO:tasks.workunit.client.0.smithi088.stdout:6/983: creat d16/d62/da7/da9/f12b x:0 0 0 2023-12-09T02:34:58.473 INFO:tasks.workunit.client.0.smithi088.stdout:6/984: getdents d16/d1b/d2c/d3f/d41/d80 0 2023-12-09T02:34:58.473 INFO:tasks.workunit.client.0.smithi088.stdout:6/985: chown d16/d62/da7 2 1 2023-12-09T02:34:58.473 INFO:tasks.workunit.client.0.smithi088.stdout:6/986: write d16/d1b/f22 [2531345,69938] 0 2023-12-09T02:34:58.476 INFO:tasks.workunit.client.0.smithi088.stdout:4/982: dwrite d3/dc/d18/d7b/f62 [0,4194304] 0 2023-12-09T02:34:58.476 INFO:tasks.workunit.client.0.smithi088.stdout:4/983: readlink d3/dc/d18/d29/l81 0 2023-12-09T02:34:58.480 INFO:tasks.workunit.client.0.smithi088.stdout:4/984: unlink d3/dc/d43/d8c/fa3 0 2023-12-09T02:34:58.480 INFO:tasks.workunit.client.0.smithi088.stdout:3/983: dread d1/d9/d6f/d6/d4a/f38 [0,4194304] 0 2023-12-09T02:34:58.483 INFO:tasks.workunit.client.0.smithi088.stdout:4/985: truncate d3/dc/d1d/d40/ddf/fe0 1141853 0 2023-12-09T02:34:58.487 INFO:tasks.workunit.client.0.smithi088.stdout:3/984: unlink d1/d9/d6f/d6/d4a/d41/d33/faa 0 2023-12-09T02:34:58.487 INFO:tasks.workunit.client.0.smithi088.stdout:4/986: unlink d3/d65/db0/dc1/l105 0 2023-12-09T02:34:58.488 INFO:tasks.workunit.client.0.smithi088.stdout:3/985: fdatasync d1/d9/d6f/d6/d4a/faf 0 2023-12-09T02:34:58.488 INFO:tasks.workunit.client.0.smithi088.stdout:4/987: readlink d3/dc/d43/d83/lcd 0 2023-12-09T02:34:58.490 INFO:tasks.workunit.client.0.smithi088.stdout:3/986: rename d1/d9/d6f/d2d/d109/d85/ddc/l122 to d1/d9/d128/l152 0 2023-12-09T02:34:58.491 INFO:tasks.workunit.client.0.smithi088.stdout:6/987: dwrite d16/d1b/d56/ff7 [4194304,4194304] 0 2023-12-09T02:34:58.491 INFO:tasks.workunit.client.0.smithi088.stdout:4/988: creat d3/dc/d43/d83/f13d x:0 0 0 2023-12-09T02:34:58.492 INFO:tasks.workunit.client.0.smithi088.stdout:3/987: symlink d1/d73/d89/l153 0 2023-12-09T02:34:58.494 INFO:tasks.workunit.client.0.smithi088.stdout:6/988: symlink d16/d1b/d2c/d3f/d41/d80/dd0/l12c 0 2023-12-09T02:34:58.495 INFO:tasks.workunit.client.0.smithi088.stdout:4/989: truncate d3/f4c 1544785 0 2023-12-09T02:34:58.495 INFO:tasks.workunit.client.0.smithi088.stdout:4/990: write d3/dc/d1d/d40/fa1 [1075918,44619] 0 2023-12-09T02:34:58.496 INFO:tasks.workunit.client.0.smithi088.stdout:4/991: fsync d3/dc/d18/d8d/ffe 0 2023-12-09T02:34:58.499 INFO:tasks.workunit.client.0.smithi088.stdout:4/992: mknod d3/dc/d43/d83/d37/c13e 0 2023-12-09T02:34:58.500 INFO:tasks.workunit.client.0.smithi088.stdout:3/988: mknod d1/d9/d6f/c154 0 2023-12-09T02:34:58.500 INFO:tasks.workunit.client.0.smithi088.stdout:4/993: dread d3/dc/d43/d8c/f9b [0,4194304] 0 2023-12-09T02:34:58.501 INFO:tasks.workunit.client.0.smithi088.stdout:6/989: rename d16/d35/d65/fc0 to d16/d35/f12d 0 2023-12-09T02:34:58.502 INFO:tasks.workunit.client.0.smithi088.stdout:3/989: write d1/d9/d6f/d6/fc3 [3776629,63378] 0 2023-12-09T02:34:58.502 INFO:tasks.workunit.client.0.smithi088.stdout:4/994: truncate d3/d65/f79 294052 0 2023-12-09T02:34:58.507 INFO:tasks.workunit.client.0.smithi088.stdout:3/990: rename d1/d9/d6f/d6/d4a/d41/d33/d49 to d1/d9/d6f/d22/d7f/d117/ddf/d155 0 2023-12-09T02:34:58.507 INFO:tasks.workunit.client.0.smithi088.stdout:3/991: stat d1/d9/d6f/d22/l86 0 2023-12-09T02:34:58.508 INFO:tasks.workunit.client.0.smithi088.stdout:4/995: symlink d3/dc/d43/dc5/dd8/d126/l13f 0 2023-12-09T02:34:58.509 INFO:tasks.workunit.client.0.smithi088.stdout:6/990: link d16/d35/d65/lac d16/d1b/d2c/l12e 0 2023-12-09T02:34:58.509 INFO:tasks.workunit.client.0.smithi088.stdout:6/991: truncate d16/d1b/d2c/d3f/d83/de4/f114 1010905 0 2023-12-09T02:34:58.510 INFO:tasks.workunit.client.0.smithi088.stdout:3/992: symlink d1/d9/d6f/d6/d4a/d41/d10b/db1/d12a/l156 0 2023-12-09T02:34:58.515 INFO:tasks.workunit.client.0.smithi088.stdout:6/992: link f12 d16/d35/d36/d97/d11c/f12f 0 2023-12-09T02:34:58.518 INFO:tasks.workunit.client.0.smithi088.stdout:6/993: mkdir d16/d62/da7/da9/dd9/d130 0 2023-12-09T02:34:58.523 INFO:tasks.workunit.client.0.smithi088.stdout:6/994: getdents d16/d62/d6f/da4/dc2 0 2023-12-09T02:34:58.526 INFO:tasks.workunit.client.0.smithi088.stdout:4/996: dwrite d3/dc/d43/dc5/dd8/fec [0,4194304] 0 2023-12-09T02:34:58.549 INFO:tasks.workunit.client.0.smithi088.stdout:6/995: dwrite d16/d1b/d2c/d3f/d83/f9d [0,4194304] 0 2023-12-09T02:34:58.549 INFO:tasks.workunit.client.0.smithi088.stdout:4/997: dwrite f1 [0,4194304] 0 2023-12-09T02:34:58.550 INFO:tasks.workunit.client.0.smithi088.stdout:4/998: truncate d3/dc/d18/d8d/fc0 6521862 0 2023-12-09T02:34:58.563 INFO:tasks.workunit.client.0.smithi088.stdout:6/996: dread d16/d1b/d2c/f88 [0,4194304] 0 2023-12-09T02:34:58.566 INFO:tasks.workunit.client.0.smithi088.stdout:4/999: dwrite d3/dc/d43/f87 [0,4194304] 0 2023-12-09T02:34:58.616 INFO:tasks.workunit.client.0.smithi088.stdout:3/993: sync 2023-12-09T02:34:58.666 INFO:tasks.workunit.client.0.smithi088.stdout:6/997: sync 2023-12-09T02:34:58.667 INFO:tasks.workunit.client.0.smithi088.stdout:6/998: fsync d16/d1b/d56/fa0 0 2023-12-09T02:34:58.669 INFO:tasks.workunit.client.0.smithi088.stdout:6/999: rename d16/d1b/f51 to d16/d35/d36/d97/d11c/f131 0 2023-12-09T02:34:59.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:34:58 smithi161 ceph-mon[121170]: pgmap v197: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 100 MiB/s rd, 219 MiB/s wr, 437 op/s 2023-12-09T02:34:59.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:34:58 smithi088 ceph-mon[112028]: pgmap v197: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 100 MiB/s rd, 219 MiB/s wr, 437 op/s 2023-12-09T02:35:01.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:00 smithi161 ceph-mon[121170]: pgmap v198: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 151 MiB/s rd, 324 MiB/s wr, 554 op/s 2023-12-09T02:35:01.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:00 smithi088 ceph-mon[112028]: pgmap v198: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 151 MiB/s rd, 324 MiB/s wr, 554 op/s 2023-12-09T02:35:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:01 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:35:02.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:01 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:35:02.980 INFO:tasks.workunit.client.0.smithi088.stdout:3/994: sync 2023-12-09T02:35:02.988 INFO:tasks.workunit.client.0.smithi088.stdout:3/995: dread d1/d9/d6f/f10c [0,4194304] 0 2023-12-09T02:35:02.988 INFO:tasks.workunit.client.0.smithi088.stdout:3/996: fsync d1/d9/d6f/d15/fb4 0 2023-12-09T02:35:02.988 INFO:tasks.workunit.client.0.smithi088.stdout:3/997: dread - d1/d9/d6f/d22/d7f/d117/ffd zero size 2023-12-09T02:35:02.993 INFO:tasks.workunit.client.0.smithi088.stdout:3/998: creat d1/d9/d6f/d6/d4a/d41/d124/d12b/f157 x:0 0 0 2023-12-09T02:35:02.993 INFO:tasks.workunit.client.0.smithi088.stdout:3/999: dread - d1/d9/d6f/d22/fbd zero size 2023-12-09T02:35:02.998 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -rf -- ./tmp.jT8WBkintA 2023-12-09T02:35:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:03 smithi161 ceph-mon[121170]: pgmap v199: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 138 MiB/s rd, 290 MiB/s wr, 447 op/s 2023-12-09T02:35:03.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:03 smithi088 ceph-mon[112028]: pgmap v199: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 138 MiB/s rd, 290 MiB/s wr, 447 op/s 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:1/34: sync 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:9/38: sync 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:8/1: sync 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:5/0: sync 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:0/4: sync 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:8/2: readlink - no filename 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:8/3: dread - no filename 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:8/4: dwrite - no filename 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:8/5: truncate - no filename 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:8/6: chown . 23775850 1 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:8/7: dwrite - no filename 2023-12-09T02:35:03.692 INFO:tasks.workunit.client.1.smithi161.stdout:8/8: dread - no filename 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:8/9: fsync - no filename 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:9/39: fsync d2/da/fb 0 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:3/100: sync 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:3/101: stat d2/d4/l8 0 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:3/102: chown d2/d4/d11/d19/d1b 0 1 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:9/40: readlink d2/l7 0 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:4/16: sync 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:7/100: sync 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:2/39: sync 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:6/3: sync 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:6/4: fsync - no filename 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:6/5: fdatasync - no filename 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:2/40: chown d4/d7/c9 376776 1 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:2/41: chown d4/d7/fc 614088 1 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:2/42: fsync f3 0 2023-12-09T02:35:03.693 INFO:tasks.workunit.client.1.smithi161.stdout:2/43: stat d4 0 2023-12-09T02:35:03.694 INFO:tasks.workunit.client.1.smithi161.stdout:9/41: dread d2/f8 [0,4194304] 0 2023-12-09T02:35:03.694 INFO:tasks.workunit.client.1.smithi161.stdout:5/1: mkdir d0 0 2023-12-09T02:35:03.694 INFO:tasks.workunit.client.1.smithi161.stdout:5/2: dwrite - no filename 2023-12-09T02:35:03.694 INFO:tasks.workunit.client.1.smithi161.stdout:5/3: dread - no filename 2023-12-09T02:35:03.695 INFO:tasks.workunit.client.1.smithi161.stdout:1/35: truncate f5 1179955 0 2023-12-09T02:35:03.696 INFO:tasks.workunit.client.1.smithi161.stdout:0/5: mknod c0 0 2023-12-09T02:35:03.696 INFO:tasks.workunit.client.1.smithi161.stdout:0/6: dread - no filename 2023-12-09T02:35:03.697 INFO:tasks.workunit.client.1.smithi161.stdout:8/10: symlink l0 0 2023-12-09T02:35:03.698 INFO:tasks.workunit.client.1.smithi161.stdout:4/17: dread - f4 zero size 2023-12-09T02:35:03.699 INFO:tasks.workunit.client.1.smithi161.stdout:6/6: creat f0 x:0 0 0 2023-12-09T02:35:03.699 INFO:tasks.workunit.client.1.smithi161.stdout:6/7: rmdir - no directory 2023-12-09T02:35:03.700 INFO:tasks.workunit.client.1.smithi161.stdout:6/8: dread - f0 zero size 2023-12-09T02:35:03.703 INFO:tasks.workunit.client.1.smithi161.stdout:3/103: dread d2/d4/f18 [4194304,4194304] 0 2023-12-09T02:35:03.703 INFO:tasks.workunit.client.1.smithi161.stdout:5/4: creat d0/f1 x:0 0 0 2023-12-09T02:35:03.705 INFO:tasks.workunit.client.1.smithi161.stdout:1/36: chown l2 9074669 1 2023-12-09T02:35:03.711 INFO:tasks.workunit.client.1.smithi161.stdout:7/101: dread d0/d3/f8 [0,4194304] 0 2023-12-09T02:35:03.713 INFO:tasks.workunit.client.1.smithi161.stdout:8/11: mknod c1 0 2023-12-09T02:35:03.715 INFO:tasks.workunit.client.1.smithi161.stdout:0/7: getdents . 0 2023-12-09T02:35:03.716 INFO:tasks.workunit.client.1.smithi161.stdout:0/8: fdatasync - no filename 2023-12-09T02:35:03.718 INFO:tasks.workunit.client.1.smithi161.stdout:6/9: creat f1 x:0 0 0 2023-12-09T02:35:03.718 INFO:tasks.workunit.client.1.smithi161.stdout:6/10: dread - f1 zero size 2023-12-09T02:35:03.720 INFO:tasks.workunit.client.1.smithi161.stdout:3/104: rename d2/d4/d11/f12 to d2/d4/f1e 0 2023-12-09T02:35:03.720 INFO:tasks.workunit.client.1.smithi161.stdout:3/105: readlink l1 0 2023-12-09T02:35:03.721 INFO:tasks.workunit.client.1.smithi161.stdout:5/5: mkdir d0/d2 0 2023-12-09T02:35:03.721 INFO:tasks.workunit.client.1.smithi161.stdout:5/6: dread - d0/f1 zero size 2023-12-09T02:35:03.724 INFO:tasks.workunit.client.1.smithi161.stdout:8/12: mkdir d2 0 2023-12-09T02:35:03.724 INFO:tasks.workunit.client.1.smithi161.stdout:8/13: readlink l0 0 2023-12-09T02:35:03.725 INFO:tasks.workunit.client.1.smithi161.stdout:0/9: creat f1 x:0 0 0 2023-12-09T02:35:03.725 INFO:tasks.workunit.client.1.smithi161.stdout:0/10: dread - f1 zero size 2023-12-09T02:35:03.725 INFO:tasks.workunit.client.1.smithi161.stdout:0/11: truncate f1 737795 0 2023-12-09T02:35:03.725 INFO:tasks.workunit.client.1.smithi161.stdout:0/12: stat f1 0 2023-12-09T02:35:03.728 INFO:tasks.workunit.client.1.smithi161.stdout:4/18: rename f4 to f7 0 2023-12-09T02:35:03.728 INFO:tasks.workunit.client.1.smithi161.stdout:4/19: read - f7 zero size 2023-12-09T02:35:03.728 INFO:tasks.workunit.client.1.smithi161.stdout:4/20: write f7 [214013,100502] 0 2023-12-09T02:35:03.728 INFO:tasks.workunit.client.1.smithi161.stdout:9/42: dwrite d2/f8 [0,4194304] 0 2023-12-09T02:35:03.731 INFO:tasks.workunit.client.1.smithi161.stdout:7/102: creat d0/d3/d13/f1f x:0 0 0 2023-12-09T02:35:03.734 INFO:tasks.workunit.client.1.smithi161.stdout:8/14: creat d2/f3 x:0 0 0 2023-12-09T02:35:03.739 INFO:tasks.workunit.client.1.smithi161.stdout:2/44: dwrite f1 [0,4194304] 0 2023-12-09T02:35:03.740 INFO:tasks.workunit.client.1.smithi161.stdout:4/21: creat f8 x:0 0 0 2023-12-09T02:35:03.748 INFO:tasks.workunit.client.1.smithi161.stdout:9/43: symlink d2/da/ld 0 2023-12-09T02:35:03.748 INFO:tasks.workunit.client.1.smithi161.stdout:9/44: fdatasync d2/f8 0 2023-12-09T02:35:03.751 INFO:tasks.workunit.client.1.smithi161.stdout:3/106: write d2/d4/d11/f14 [726163,96014] 0 2023-12-09T02:35:03.751 INFO:tasks.workunit.client.1.smithi161.stdout:5/7: link d0/f1 d0/d2/f3 0 2023-12-09T02:35:03.751 INFO:tasks.workunit.client.1.smithi161.stdout:5/8: write d0/d2/f3 [551434,60601] 0 2023-12-09T02:35:03.752 INFO:tasks.workunit.client.1.smithi161.stdout:3/107: write d2/d4/f18 [3034747,83911] 0 2023-12-09T02:35:03.753 INFO:tasks.workunit.client.1.smithi161.stdout:7/103: rmdir d0 39 2023-12-09T02:35:03.755 INFO:tasks.workunit.client.1.smithi161.stdout:1/37: dwrite f5 [0,4194304] 0 2023-12-09T02:35:03.756 INFO:tasks.workunit.client.1.smithi161.stdout:8/15: symlink d2/l4 0 2023-12-09T02:35:03.757 INFO:tasks.workunit.client.1.smithi161.stdout:8/16: readlink d2/l4 0 2023-12-09T02:35:03.757 INFO:tasks.workunit.client.1.smithi161.stdout:8/17: dread - d2/f3 zero size 2023-12-09T02:35:03.758 INFO:tasks.workunit.client.1.smithi161.stdout:0/13: mknod c2 0 2023-12-09T02:35:03.759 INFO:tasks.workunit.client.1.smithi161.stdout:0/14: write f1 [96098,74725] 0 2023-12-09T02:35:03.762 INFO:tasks.workunit.client.1.smithi161.stdout:4/22: creat f9 x:0 0 0 2023-12-09T02:35:03.764 INFO:tasks.workunit.client.1.smithi161.stdout:1/38: dread f5 [0,4194304] 0 2023-12-09T02:35:03.765 INFO:tasks.workunit.client.1.smithi161.stdout:5/9: mknod d0/d2/c4 0 2023-12-09T02:35:03.770 INFO:tasks.workunit.client.1.smithi161.stdout:3/108: mkdir d2/d4/d11/d1f 0 2023-12-09T02:35:03.770 INFO:tasks.workunit.client.1.smithi161.stdout:9/45: dread d2/f8 [0,4194304] 0 2023-12-09T02:35:03.770 INFO:tasks.workunit.client.1.smithi161.stdout:7/104: read d0/d3/f17 [294473,22177] 0 2023-12-09T02:35:03.771 INFO:tasks.workunit.client.1.smithi161.stdout:9/46: read d2/f9 [498300,9034] 0 2023-12-09T02:35:03.779 INFO:tasks.workunit.client.1.smithi161.stdout:1/39: mkdir d6/d8/da 0 2023-12-09T02:35:03.781 INFO:tasks.workunit.client.1.smithi161.stdout:5/10: mkdir d0/d2/d5 0 2023-12-09T02:35:03.783 INFO:tasks.workunit.client.1.smithi161.stdout:5/11: symlink d0/d2/l6 0 2023-12-09T02:35:03.783 INFO:tasks.workunit.client.1.smithi161.stdout:5/12: write d0/d2/f3 [1306787,51747] 0 2023-12-09T02:35:03.785 INFO:tasks.workunit.client.1.smithi161.stdout:4/23: rename l0 to la 0 2023-12-09T02:35:03.785 INFO:tasks.workunit.client.1.smithi161.stdout:5/13: mkdir d0/d2/d7 0 2023-12-09T02:35:03.786 INFO:tasks.workunit.client.1.smithi161.stdout:5/14: readlink d0/d2/l6 0 2023-12-09T02:35:03.786 INFO:tasks.workunit.client.1.smithi161.stdout:9/47: dread d2/f8 [0,4194304] 0 2023-12-09T02:35:03.788 INFO:tasks.workunit.client.1.smithi161.stdout:4/24: link l6 lb 0 2023-12-09T02:35:03.788 INFO:tasks.workunit.client.1.smithi161.stdout:4/25: readlink l3 0 2023-12-09T02:35:03.793 INFO:tasks.workunit.client.1.smithi161.stdout:4/26: link lb lc 0 2023-12-09T02:35:03.793 INFO:tasks.workunit.client.1.smithi161.stdout:8/18: dwrite d2/f3 [0,4194304] 0 2023-12-09T02:35:03.794 INFO:tasks.workunit.client.1.smithi161.stdout:4/27: mkdir dd 0 2023-12-09T02:35:03.796 INFO:tasks.workunit.client.1.smithi161.stdout:4/28: creat dd/fe x:0 0 0 2023-12-09T02:35:03.797 INFO:tasks.workunit.client.1.smithi161.stdout:8/19: write d2/f3 [3670651,75151] 0 2023-12-09T02:35:03.798 INFO:tasks.workunit.client.1.smithi161.stdout:0/15: dwrite f1 [0,4194304] 0 2023-12-09T02:35:03.798 INFO:tasks.workunit.client.1.smithi161.stdout:4/29: rename c5 to dd/cf 0 2023-12-09T02:35:03.799 INFO:tasks.workunit.client.1.smithi161.stdout:4/30: read - dd/fe zero size 2023-12-09T02:35:03.799 INFO:tasks.workunit.client.1.smithi161.stdout:4/31: write dd/fe [887140,120548] 0 2023-12-09T02:35:03.800 INFO:tasks.workunit.client.1.smithi161.stdout:4/32: rename l6 to dd/l10 0 2023-12-09T02:35:03.800 INFO:tasks.workunit.client.1.smithi161.stdout:4/33: chown dd/cf 1 1 2023-12-09T02:35:03.801 INFO:tasks.workunit.client.1.smithi161.stdout:0/16: link f1 f3 0 2023-12-09T02:35:03.802 INFO:tasks.workunit.client.1.smithi161.stdout:4/34: mknod dd/c11 0 2023-12-09T02:35:03.805 INFO:tasks.workunit.client.1.smithi161.stdout:1/40: dwrite f5 [0,4194304] 0 2023-12-09T02:35:03.805 INFO:tasks.workunit.client.1.smithi161.stdout:3/109: dwrite d2/d4/f5 [0,4194304] 0 2023-12-09T02:35:03.805 INFO:tasks.workunit.client.1.smithi161.stdout:3/110: chown d2 9379 1 2023-12-09T02:35:03.805 INFO:tasks.workunit.client.1.smithi161.stdout:4/35: mknod dd/c12 0 2023-12-09T02:35:03.805 INFO:tasks.workunit.client.1.smithi161.stdout:3/111: write d2/fe [1892505,82567] 0 2023-12-09T02:35:03.805 INFO:tasks.workunit.client.1.smithi161.stdout:3/112: dread - d2/d4/d11/d1a/f1c zero size 2023-12-09T02:35:03.805 INFO:tasks.workunit.client.1.smithi161.stdout:3/113: fsync d2/f15 0 2023-12-09T02:35:03.808 INFO:tasks.workunit.client.1.smithi161.stdout:9/48: dwrite f1 [0,4194304] 0 2023-12-09T02:35:03.811 INFO:tasks.workunit.client.1.smithi161.stdout:1/41: mknod d6/d8/cb 0 2023-12-09T02:35:03.813 INFO:tasks.workunit.client.1.smithi161.stdout:4/36: creat dd/f13 x:0 0 0 2023-12-09T02:35:03.813 INFO:tasks.workunit.client.1.smithi161.stdout:4/37: dread - f8 zero size 2023-12-09T02:35:03.818 INFO:tasks.workunit.client.1.smithi161.stdout:1/42: mkdir d6/dc 0 2023-12-09T02:35:03.820 INFO:tasks.workunit.client.1.smithi161.stdout:4/38: mknod dd/c14 0 2023-12-09T02:35:03.821 INFO:tasks.workunit.client.1.smithi161.stdout:4/39: creat dd/f15 x:0 0 0 2023-12-09T02:35:03.823 INFO:tasks.workunit.client.1.smithi161.stdout:4/40: symlink dd/l16 0 2023-12-09T02:35:03.823 INFO:tasks.workunit.client.1.smithi161.stdout:1/43: write f5 [2607354,76993] 0 2023-12-09T02:35:03.824 INFO:tasks.workunit.client.1.smithi161.stdout:1/44: readlink l3 0 2023-12-09T02:35:03.846 INFO:tasks.workunit.client.1.smithi161.stdout:3/114: write d2/f15 [1659925,8126] 0 2023-12-09T02:35:03.848 INFO:tasks.workunit.client.1.smithi161.stdout:5/15: dwrite d0/d2/f3 [0,4194304] 0 2023-12-09T02:35:03.848 INFO:tasks.workunit.client.1.smithi161.stdout:3/115: getdents d2 0 2023-12-09T02:35:03.851 INFO:tasks.workunit.client.1.smithi161.stdout:0/17: dwrite f3 [0,4194304] 0 2023-12-09T02:35:03.851 INFO:tasks.workunit.client.1.smithi161.stdout:0/18: rmdir - no directory 2023-12-09T02:35:03.851 INFO:tasks.workunit.client.1.smithi161.stdout:3/116: symlink d2/d4/d11/d19/l20 0 2023-12-09T02:35:03.853 INFO:tasks.workunit.client.1.smithi161.stdout:3/117: mknod d2/d4/d11/d1f/c21 0 2023-12-09T02:35:03.853 INFO:tasks.workunit.client.1.smithi161.stdout:0/19: symlink l4 0 2023-12-09T02:35:03.854 INFO:tasks.workunit.client.1.smithi161.stdout:3/118: creat d2/d4/d11/d19/d1b/f22 x:0 0 0 2023-12-09T02:35:03.856 INFO:tasks.workunit.client.1.smithi161.stdout:9/49: dwrite d2/f8 [0,4194304] 0 2023-12-09T02:35:03.856 INFO:tasks.workunit.client.1.smithi161.stdout:4/41: dwrite dd/f15 [0,4194304] 0 2023-12-09T02:35:03.856 INFO:tasks.workunit.client.1.smithi161.stdout:9/50: chown d2/da 1703 1 2023-12-09T02:35:03.858 INFO:tasks.workunit.client.1.smithi161.stdout:3/119: unlink d2/d4/d11/d1a/f1c 0 2023-12-09T02:35:03.870 INFO:tasks.workunit.client.1.smithi161.stdout:9/51: dread f1 [0,4194304] 0 2023-12-09T02:35:03.874 INFO:tasks.workunit.client.1.smithi161.stdout:9/52: rename d2/da/fb to d2/fe 0 2023-12-09T02:35:03.874 INFO:tasks.workunit.client.1.smithi161.stdout:1/45: dwrite f5 [0,4194304] 0 2023-12-09T02:35:03.874 INFO:tasks.workunit.client.1.smithi161.stdout:1/46: write f5 [4477749,64285] 0 2023-12-09T02:35:03.874 INFO:tasks.workunit.client.1.smithi161.stdout:8/20: dwrite d2/f3 [4194304,4194304] 0 2023-12-09T02:35:03.874 INFO:tasks.workunit.client.1.smithi161.stdout:8/21: chown l0 501837 1 2023-12-09T02:35:03.875 INFO:tasks.workunit.client.1.smithi161.stdout:0/20: dwrite f3 [0,4194304] 0 2023-12-09T02:35:03.875 INFO:tasks.workunit.client.1.smithi161.stdout:7/105: dwrite d0/d3/f9 [0,4194304] 0 2023-12-09T02:35:03.875 INFO:tasks.workunit.client.1.smithi161.stdout:7/106: fdatasync d0/d3/f9 0 2023-12-09T02:35:03.875 INFO:tasks.workunit.client.1.smithi161.stdout:9/53: write d2/f8 [1806675,106749] 0 2023-12-09T02:35:03.876 INFO:tasks.workunit.client.1.smithi161.stdout:1/47: rename d6/dc to d6/d8/da/dd 0 2023-12-09T02:35:03.880 INFO:tasks.workunit.client.1.smithi161.stdout:0/21: creat f5 x:0 0 0 2023-12-09T02:35:03.881 INFO:tasks.workunit.client.1.smithi161.stdout:4/42: rmdir dd 39 2023-12-09T02:35:03.881 INFO:tasks.workunit.client.1.smithi161.stdout:4/43: write f8 [791414,54636] 0 2023-12-09T02:35:03.883 INFO:tasks.workunit.client.1.smithi161.stdout:9/54: mknod d2/da/cf 0 2023-12-09T02:35:03.884 INFO:tasks.workunit.client.1.smithi161.stdout:1/48: creat d6/d8/da/dd/fe x:0 0 0 2023-12-09T02:35:03.884 INFO:tasks.workunit.client.1.smithi161.stdout:1/49: readlink l3 0 2023-12-09T02:35:03.885 INFO:tasks.workunit.client.1.smithi161.stdout:1/50: chown d6/l7 2895 1 2023-12-09T02:35:03.886 INFO:tasks.workunit.client.1.smithi161.stdout:4/44: symlink dd/l17 0 2023-12-09T02:35:03.888 INFO:tasks.workunit.client.1.smithi161.stdout:7/107: link d0/d3/f8 d0/d3/db/f20 0 2023-12-09T02:35:03.889 INFO:tasks.workunit.client.1.smithi161.stdout:5/16: write d0/f1 [5232941,38942] 0 2023-12-09T02:35:03.890 INFO:tasks.workunit.client.1.smithi161.stdout:5/17: write d0/d2/f3 [4228235,130790] 0 2023-12-09T02:35:03.890 INFO:tasks.workunit.client.1.smithi161.stdout:5/18: chown d0/d2 31463 1 2023-12-09T02:35:03.890 INFO:tasks.workunit.client.1.smithi161.stdout:9/55: creat d2/da/f10 x:0 0 0 2023-12-09T02:35:03.891 INFO:tasks.workunit.client.1.smithi161.stdout:1/51: getdents d6/d8 0 2023-12-09T02:35:03.891 INFO:tasks.workunit.client.1.smithi161.stdout:1/52: dread - d6/d8/da/dd/fe zero size 2023-12-09T02:35:03.892 INFO:tasks.workunit.client.1.smithi161.stdout:8/22: dwrite d2/f3 [0,4194304] 0 2023-12-09T02:35:03.892 INFO:tasks.workunit.client.1.smithi161.stdout:0/22: dread f3 [0,4194304] 0 2023-12-09T02:35:03.893 INFO:tasks.workunit.client.1.smithi161.stdout:4/45: creat dd/f18 x:0 0 0 2023-12-09T02:35:03.895 INFO:tasks.workunit.client.1.smithi161.stdout:5/19: write d0/f1 [2746222,88366] 0 2023-12-09T02:35:03.895 INFO:tasks.workunit.client.1.smithi161.stdout:5/20: write d0/f1 [5418227,100632] 0 2023-12-09T02:35:03.895 INFO:tasks.workunit.client.1.smithi161.stdout:5/21: write d0/d2/f3 [5475140,53984] 0 2023-12-09T02:35:03.896 INFO:tasks.workunit.client.1.smithi161.stdout:3/120: fsync d2/d4/d11/d19/d1b/f22 0 2023-12-09T02:35:03.897 INFO:tasks.workunit.client.1.smithi161.stdout:5/22: write d0/f1 [4352478,91869] 0 2023-12-09T02:35:03.899 INFO:tasks.workunit.client.1.smithi161.stdout:9/56: creat d2/da/f11 x:0 0 0 2023-12-09T02:35:03.899 INFO:tasks.workunit.client.1.smithi161.stdout:9/57: chown d2/c6 8266730 1 2023-12-09T02:35:03.901 INFO:tasks.workunit.client.1.smithi161.stdout:5/23: fdatasync d0/d2/f3 0 2023-12-09T02:35:03.903 INFO:tasks.workunit.client.1.smithi161.stdout:1/53: creat d6/d8/da/dd/ff x:0 0 0 2023-12-09T02:35:03.903 INFO:tasks.workunit.client.1.smithi161.stdout:1/54: truncate d6/d8/da/dd/fe 934789 0 2023-12-09T02:35:03.903 INFO:tasks.workunit.client.1.smithi161.stdout:1/55: read f5 [3696444,67778] 0 2023-12-09T02:35:03.906 INFO:tasks.workunit.client.1.smithi161.stdout:4/46: creat dd/f19 x:0 0 0 2023-12-09T02:35:03.908 INFO:tasks.workunit.client.1.smithi161.stdout:3/121: unlink d2/d4/f6 0 2023-12-09T02:35:03.909 INFO:tasks.workunit.client.1.smithi161.stdout:0/23: getdents . 0 2023-12-09T02:35:03.910 INFO:tasks.workunit.client.1.smithi161.stdout:8/23: dwrite d2/f3 [0,4194304] 0 2023-12-09T02:35:03.911 INFO:tasks.workunit.client.1.smithi161.stdout:7/108: mkdir d0/d3/d21 0 2023-12-09T02:35:03.914 INFO:tasks.workunit.client.1.smithi161.stdout:3/122: write d2/d4/f18 [2035198,81262] 0 2023-12-09T02:35:03.916 INFO:tasks.workunit.client.1.smithi161.stdout:5/24: mknod d0/d2/d5/c8 0 2023-12-09T02:35:03.918 INFO:tasks.workunit.client.1.smithi161.stdout:5/25: write d0/f1 [1346349,15756] 0 2023-12-09T02:35:03.919 INFO:tasks.workunit.client.1.smithi161.stdout:8/24: dread d2/f3 [4194304,4194304] 0 2023-12-09T02:35:03.922 INFO:tasks.workunit.client.1.smithi161.stdout:9/58: rmdir d2/da 39 2023-12-09T02:35:03.923 INFO:tasks.workunit.client.1.smithi161.stdout:4/47: mkdir dd/d1a 0 2023-12-09T02:35:03.923 INFO:tasks.workunit.client.1.smithi161.stdout:4/48: readlink dd/l17 0 2023-12-09T02:35:03.927 INFO:tasks.workunit.client.1.smithi161.stdout:0/24: creat f6 x:0 0 0 2023-12-09T02:35:03.932 INFO:tasks.workunit.client.1.smithi161.stdout:1/56: rename c4 to d6/d8/da/c10 0 2023-12-09T02:35:03.933 INFO:tasks.workunit.client.1.smithi161.stdout:9/59: link d2/f9 d2/f12 0 2023-12-09T02:35:03.934 INFO:tasks.workunit.client.1.smithi161.stdout:4/49: link dd/l10 dd/d1a/l1b 0 2023-12-09T02:35:03.934 INFO:tasks.workunit.client.1.smithi161.stdout:4/50: dread - dd/f19 zero size 2023-12-09T02:35:03.946 INFO:tasks.workunit.client.1.smithi161.stdout:1/57: mkdir d6/d8/da/dd/d11 0 2023-12-09T02:35:03.946 INFO:tasks.workunit.client.1.smithi161.stdout:1/58: symlink d6/d9/l12 0 2023-12-09T02:35:03.949 INFO:tasks.workunit.client.1.smithi161.stdout:1/59: read f5 [1416551,4372] 0 2023-12-09T02:35:03.949 INFO:tasks.workunit.client.1.smithi161.stdout:1/60: fsync d6/d8/da/dd/ff 0 2023-12-09T02:35:03.949 INFO:tasks.workunit.client.1.smithi161.stdout:1/61: truncate d6/d8/da/dd/fe 1517224 0 2023-12-09T02:35:03.958 INFO:tasks.workunit.client.1.smithi161.stdout:9/60: dwrite f1 [0,4194304] 0 2023-12-09T02:35:03.959 INFO:tasks.workunit.client.1.smithi161.stdout:9/61: dread - d2/da/f11 zero size 2023-12-09T02:35:03.961 INFO:tasks.workunit.client.1.smithi161.stdout:5/26: dwrite d0/f1 [4194304,4194304] 0 2023-12-09T02:35:03.963 INFO:tasks.workunit.client.1.smithi161.stdout:3/123: dwrite d2/fe [0,4194304] 0 2023-12-09T02:35:03.964 INFO:tasks.workunit.client.1.smithi161.stdout:5/27: rename d0/d2/d5 to d0/d9 0 2023-12-09T02:35:03.969 INFO:tasks.workunit.client.1.smithi161.stdout:3/124: creat d2/d4/f23 x:0 0 0 2023-12-09T02:35:03.970 INFO:tasks.workunit.client.1.smithi161.stdout:5/28: creat d0/fa x:0 0 0 2023-12-09T02:35:03.977 INFO:tasks.workunit.client.1.smithi161.stdout:5/29: write d0/d2/f3 [3977558,53000] 0 2023-12-09T02:35:03.977 INFO:tasks.workunit.client.1.smithi161.stdout:1/62: getdents d6/d9 0 2023-12-09T02:35:03.977 INFO:tasks.workunit.client.1.smithi161.stdout:1/63: chown f5 10 1 2023-12-09T02:35:03.979 INFO:tasks.workunit.client.1.smithi161.stdout:7/109: dwrite d0/d3/f7 [0,4194304] 0 2023-12-09T02:35:03.985 INFO:tasks.workunit.client.1.smithi161.stdout:0/25: dwrite f5 [0,4194304] 0 2023-12-09T02:35:03.986 INFO:tasks.workunit.client.1.smithi161.stdout:5/30: rename d0/fa to d0/d9/fb 0 2023-12-09T02:35:03.986 INFO:tasks.workunit.client.1.smithi161.stdout:7/110: creat d0/d3/d13/f22 x:0 0 0 2023-12-09T02:35:03.986 INFO:tasks.workunit.client.1.smithi161.stdout:7/111: truncate d0/d3/db/f1c 614556 0 2023-12-09T02:35:03.996 INFO:tasks.workunit.client.1.smithi161.stdout:1/64: dwrite d6/d8/da/dd/fe [0,4194304] 0 2023-12-09T02:35:03.996 INFO:tasks.workunit.client.1.smithi161.stdout:3/125: dwrite d2/d4/f23 [0,4194304] 0 2023-12-09T02:35:03.996 INFO:tasks.workunit.client.1.smithi161.stdout:5/31: creat d0/d2/fc x:0 0 0 2023-12-09T02:35:03.996 INFO:tasks.workunit.client.1.smithi161.stdout:7/112: fsync d0/fc 0 2023-12-09T02:35:03.997 INFO:tasks.workunit.client.1.smithi161.stdout:5/32: readlink d0/d2/l6 0 2023-12-09T02:35:04.002 INFO:tasks.workunit.client.1.smithi161.stdout:1/65: unlink d6/d8/da/dd/ff 0 2023-12-09T02:35:04.002 INFO:tasks.workunit.client.1.smithi161.stdout:1/66: stat l2 0 2023-12-09T02:35:04.003 INFO:tasks.workunit.client.1.smithi161.stdout:7/113: dread d0/d3/f8 [0,4194304] 0 2023-12-09T02:35:04.006 INFO:tasks.workunit.client.1.smithi161.stdout:3/126: unlink d2/d4/d11/d19/l20 0 2023-12-09T02:35:04.007 INFO:tasks.workunit.client.1.smithi161.stdout:5/33: symlink d0/ld 0 2023-12-09T02:35:04.011 INFO:tasks.workunit.client.1.smithi161.stdout:3/127: mknod d2/d4/d11/d1a/c24 0 2023-12-09T02:35:04.014 INFO:tasks.workunit.client.1.smithi161.stdout:1/67: truncate d6/d8/da/dd/fe 632853 0 2023-12-09T02:35:04.018 INFO:tasks.workunit.client.1.smithi161.stdout:1/68: link d6/l7 d6/d8/da/dd/l13 0 2023-12-09T02:35:04.020 INFO:tasks.workunit.client.1.smithi161.stdout:3/128: dread d2/d4/f5 [0,4194304] 0 2023-12-09T02:35:04.048 INFO:tasks.workunit.client.1.smithi161.stdout:0/26: dwrite f5 [4194304,4194304] 0 2023-12-09T02:35:04.049 INFO:tasks.workunit.client.1.smithi161.stdout:5/34: dwrite d0/d2/fc [0,4194304] 0 2023-12-09T02:35:04.049 INFO:tasks.workunit.client.1.smithi161.stdout:5/35: dread - d0/d9/fb zero size 2023-12-09T02:35:04.049 INFO:tasks.workunit.client.1.smithi161.stdout:5/36: truncate d0/d9/fb 74911 0 2023-12-09T02:35:04.049 INFO:tasks.workunit.client.1.smithi161.stdout:1/69: dwrite f5 [0,4194304] 0 2023-12-09T02:35:04.050 INFO:tasks.workunit.client.1.smithi161.stdout:0/27: creat f7 x:0 0 0 2023-12-09T02:35:04.056 INFO:tasks.workunit.client.1.smithi161.stdout:5/37: rmdir d0 39 2023-12-09T02:35:04.056 INFO:tasks.workunit.client.1.smithi161.stdout:1/70: creat d6/d8/da/dd/f14 x:0 0 0 2023-12-09T02:35:04.056 INFO:tasks.workunit.client.1.smithi161.stdout:1/71: readlink l2 0 2023-12-09T02:35:04.059 INFO:tasks.workunit.client.1.smithi161.stdout:5/38: mkdir d0/d2/de 0 2023-12-09T02:35:04.062 INFO:tasks.workunit.client.1.smithi161.stdout:0/28: dread f1 [0,4194304] 0 2023-12-09T02:35:04.062 INFO:tasks.workunit.client.1.smithi161.stdout:0/29: fdatasync f6 0 2023-12-09T02:35:04.062 INFO:tasks.workunit.client.1.smithi161.stdout:1/72: link d6/d8/da/dd/l13 d6/d8/da/l15 0 2023-12-09T02:35:04.063 INFO:tasks.workunit.client.1.smithi161.stdout:0/30: creat f8 x:0 0 0 2023-12-09T02:35:04.063 INFO:tasks.workunit.client.1.smithi161.stdout:0/31: dread - f8 zero size 2023-12-09T02:35:04.064 INFO:tasks.workunit.client.1.smithi161.stdout:0/32: write f1 [266522,71306] 0 2023-12-09T02:35:04.064 INFO:tasks.workunit.client.1.smithi161.stdout:1/73: link f5 d6/d8/da/dd/f16 0 2023-12-09T02:35:04.066 INFO:tasks.workunit.client.1.smithi161.stdout:1/74: link d6/d8/da/dd/l13 d6/d8/da/dd/l17 0 2023-12-09T02:35:04.067 INFO:tasks.workunit.client.1.smithi161.stdout:1/75: creat d6/f18 x:0 0 0 2023-12-09T02:35:04.068 INFO:tasks.workunit.client.1.smithi161.stdout:5/39: dread d0/d2/fc [0,4194304] 0 2023-12-09T02:35:04.068 INFO:tasks.workunit.client.1.smithi161.stdout:5/40: read d0/d2/fc [2608322,58165] 0 2023-12-09T02:35:04.069 INFO:tasks.workunit.client.1.smithi161.stdout:1/76: creat d6/d9/f19 x:0 0 0 2023-12-09T02:35:04.069 INFO:tasks.workunit.client.1.smithi161.stdout:1/77: chown d6/d8/cb 1012 1 2023-12-09T02:35:04.069 INFO:tasks.workunit.client.1.smithi161.stdout:1/78: write d6/d9/f19 [100637,85304] 0 2023-12-09T02:35:04.072 INFO:tasks.workunit.client.1.smithi161.stdout:1/79: link d6/d8/da/c10 d6/d8/da/dd/c1a 0 2023-12-09T02:35:04.073 INFO:tasks.workunit.client.1.smithi161.stdout:1/80: write d6/d8/da/dd/f16 [2463368,109670] 0 2023-12-09T02:35:04.077 INFO:tasks.workunit.client.1.smithi161.stdout:1/81: mknod d6/d8/da/c1b 0 2023-12-09T02:35:04.078 INFO:tasks.workunit.client.1.smithi161.stdout:5/41: dread d0/d2/fc [0,4194304] 0 2023-12-09T02:35:04.078 INFO:tasks.workunit.client.1.smithi161.stdout:1/82: mkdir d6/d8/da/dd/d11/d1c 0 2023-12-09T02:35:04.078 INFO:tasks.workunit.client.1.smithi161.stdout:5/42: mkdir d0/d2/d7/df 0 2023-12-09T02:35:04.078 INFO:tasks.workunit.client.1.smithi161.stdout:5/43: chown d0 225775 1 2023-12-09T02:35:04.079 INFO:tasks.workunit.client.1.smithi161.stdout:5/44: read d0/d2/f3 [2584404,111271] 0 2023-12-09T02:35:04.081 INFO:tasks.workunit.client.1.smithi161.stdout:5/45: unlink d0/d9/fb 0 2023-12-09T02:35:04.094 INFO:tasks.workunit.client.1.smithi161.stdout:1/83: dwrite f5 [4194304,4194304] 0 2023-12-09T02:35:04.095 INFO:tasks.workunit.client.1.smithi161.stdout:1/84: mknod d6/d8/da/dd/d11/d1c/c1d 0 2023-12-09T02:35:04.099 INFO:tasks.workunit.client.1.smithi161.stdout:5/46: dread d0/d2/f3 [4194304,4194304] 0 2023-12-09T02:35:04.099 INFO:tasks.workunit.client.1.smithi161.stdout:5/47: chown d0/d2 341226 1 2023-12-09T02:35:04.102 INFO:tasks.workunit.client.1.smithi161.stdout:5/48: write d0/d2/f3 [5191608,122243] 0 2023-12-09T02:35:04.112 INFO:tasks.workunit.client.1.smithi161.stdout:5/49: fdatasync d0/d2/f3 0 2023-12-09T02:35:04.113 INFO:tasks.workunit.client.1.smithi161.stdout:5/50: symlink d0/d9/l10 0 2023-12-09T02:35:04.114 INFO:tasks.workunit.client.1.smithi161.stdout:5/51: mkdir d0/d2/d7/d11 0 2023-12-09T02:35:04.119 INFO:tasks.workunit.client.1.smithi161.stdout:1/85: dwrite d6/d9/f19 [0,4194304] 0 2023-12-09T02:35:04.122 INFO:tasks.workunit.client.1.smithi161.stdout:5/52: dread d0/d2/fc [0,4194304] 0 2023-12-09T02:35:04.122 INFO:tasks.workunit.client.1.smithi161.stdout:1/86: rmdir d6/d8 39 2023-12-09T02:35:04.122 INFO:tasks.workunit.client.1.smithi161.stdout:1/87: write d6/d8/da/dd/fe [1522390,99569] 0 2023-12-09T02:35:04.124 INFO:tasks.workunit.client.1.smithi161.stdout:5/53: mknod d0/d9/c12 0 2023-12-09T02:35:04.145 INFO:tasks.workunit.client.1.smithi161.stdout:5/54: dwrite d0/f1 [4194304,4194304] 0 2023-12-09T02:35:04.147 INFO:tasks.workunit.client.1.smithi161.stdout:5/55: symlink d0/d2/d7/d11/l13 0 2023-12-09T02:35:04.180 INFO:tasks.workunit.client.1.smithi161.stdout:1/88: dwrite d6/d9/f19 [4194304,4194304] 0 2023-12-09T02:35:04.182 INFO:tasks.workunit.client.1.smithi161.stdout:1/89: rename d6/f18 to d6/d8/da/dd/d11/d1c/f1e 0 2023-12-09T02:35:04.182 INFO:tasks.workunit.client.1.smithi161.stdout:1/90: write d6/d8/da/dd/d11/d1c/f1e [336125,102023] 0 2023-12-09T02:35:04.184 INFO:tasks.workunit.client.1.smithi161.stdout:1/91: creat d6/d8/da/dd/d11/d1c/f1f x:0 0 0 2023-12-09T02:35:04.184 INFO:tasks.workunit.client.1.smithi161.stdout:1/92: stat d6/d8/da/dd/f14 0 2023-12-09T02:35:04.186 INFO:tasks.workunit.client.1.smithi161.stdout:1/93: rmdir d6/d8 39 2023-12-09T02:35:04.186 INFO:tasks.workunit.client.1.smithi161.stdout:1/94: write d6/d8/da/dd/d11/d1c/f1f [173627,14014] 0 2023-12-09T02:35:04.188 INFO:tasks.workunit.client.1.smithi161.stdout:1/95: link d6/d8/da/dd/d11/d1c/c1d d6/d8/da/dd/d11/c20 0 2023-12-09T02:35:04.195 INFO:tasks.workunit.client.1.smithi161.stdout:1/96: dread d6/d9/f19 [0,4194304] 0 2023-12-09T02:35:04.195 INFO:tasks.workunit.client.1.smithi161.stdout:1/97: write d6/d8/da/dd/f14 [784078,49179] 0 2023-12-09T02:35:04.197 INFO:tasks.workunit.client.1.smithi161.stdout:1/98: creat d6/d8/da/dd/f21 x:0 0 0 2023-12-09T02:35:04.197 INFO:tasks.workunit.client.1.smithi161.stdout:1/99: write d6/d8/da/dd/f14 [1480449,62866] 0 2023-12-09T02:35:04.198 INFO:tasks.workunit.client.1.smithi161.stdout:1/100: creat d6/d8/da/dd/d11/f22 x:0 0 0 2023-12-09T02:35:04.198 INFO:tasks.workunit.client.1.smithi161.stdout:1/101: write d6/d8/da/dd/f21 [865658,37619] 0 2023-12-09T02:35:04.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/102: symlink d6/d9/l23 0 2023-12-09T02:35:04.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/103: chown d6 0 1 2023-12-09T02:35:04.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/104: write d6/d8/da/dd/d11/f22 [379715,53968] 0 2023-12-09T02:35:04.207 INFO:tasks.workunit.client.1.smithi161.stdout:1/105: truncate d6/d8/da/dd/d11/d1c/f1e 142567 0 2023-12-09T02:35:04.209 INFO:tasks.workunit.client.1.smithi161.stdout:1/106: symlink d6/d8/da/dd/l24 0 2023-12-09T02:35:04.213 INFO:tasks.workunit.client.1.smithi161.stdout:1/107: rename d6/d8/da/dd/l17 to d6/d9/l25 0 2023-12-09T02:35:04.213 INFO:tasks.workunit.client.1.smithi161.stdout:1/108: stat d6/d8/da/dd/fe 0 2023-12-09T02:35:04.213 INFO:tasks.workunit.client.1.smithi161.stdout:1/109: write d6/d8/da/dd/f14 [420441,112461] 0 2023-12-09T02:35:04.215 INFO:tasks.workunit.client.1.smithi161.stdout:1/110: getdents d6/d8/da/dd/d11 0 2023-12-09T02:35:04.216 INFO:tasks.workunit.client.1.smithi161.stdout:1/111: creat d6/f26 x:0 0 0 2023-12-09T02:35:04.218 INFO:tasks.workunit.client.1.smithi161.stdout:1/112: mkdir d6/d27 0 2023-12-09T02:35:04.218 INFO:tasks.workunit.client.1.smithi161.stdout:1/113: fsync d6/d8/da/dd/d11/d1c/f1e 0 2023-12-09T02:35:04.219 INFO:tasks.workunit.client.1.smithi161.stdout:1/114: symlink d6/d9/l28 0 2023-12-09T02:35:04.221 INFO:tasks.workunit.client.1.smithi161.stdout:1/115: rmdir d6/d8/da/dd/d11 39 2023-12-09T02:35:04.221 INFO:tasks.workunit.client.1.smithi161.stdout:1/116: dread - d6/f26 zero size 2023-12-09T02:35:04.223 INFO:tasks.workunit.client.1.smithi161.stdout:1/117: creat d6/d9/f29 x:0 0 0 2023-12-09T02:35:04.226 INFO:tasks.workunit.client.1.smithi161.stdout:1/118: dread d6/d8/da/dd/fe [0,4194304] 0 2023-12-09T02:35:04.226 INFO:tasks.workunit.client.1.smithi161.stdout:1/119: chown d6/d9/l28 23 1 2023-12-09T02:35:04.227 INFO:tasks.workunit.client.1.smithi161.stdout:1/120: symlink d6/d8/da/dd/l2a 0 2023-12-09T02:35:04.228 INFO:tasks.workunit.client.1.smithi161.stdout:1/121: creat d6/f2b x:0 0 0 2023-12-09T02:35:04.240 INFO:tasks.workunit.client.1.smithi161.stdout:1/122: getdents d6 0 2023-12-09T02:35:04.246 INFO:tasks.workunit.client.1.smithi161.stdout:1/123: truncate d6/d8/da/dd/f14 213393 0 2023-12-09T02:35:04.262 INFO:tasks.workunit.client.1.smithi161.stdout:1/124: dwrite d6/f2b [0,4194304] 0 2023-12-09T02:35:04.262 INFO:tasks.workunit.client.1.smithi161.stdout:1/125: read d6/d8/da/dd/d11/d1c/f1e [20425,35606] 0 2023-12-09T02:35:04.266 INFO:tasks.workunit.client.1.smithi161.stdout:1/126: unlink d6/d9/l23 0 2023-12-09T02:35:04.267 INFO:tasks.workunit.client.1.smithi161.stdout:1/127: write d6/d9/f29 [549403,24961] 0 2023-12-09T02:35:04.267 INFO:tasks.workunit.client.1.smithi161.stdout:1/128: chown l2 78304869 1 2023-12-09T02:35:04.267 INFO:tasks.workunit.client.1.smithi161.stdout:1/129: dread d6/d8/da/dd/f14 [0,4194304] 0 2023-12-09T02:35:04.277 INFO:tasks.workunit.client.1.smithi161.stdout:1/130: truncate d6/d8/da/dd/f16 1162097 0 2023-12-09T02:35:04.278 INFO:tasks.workunit.client.1.smithi161.stdout:1/131: chown d6/d8/da/dd/l13 28 1 2023-12-09T02:35:04.280 INFO:tasks.workunit.client.1.smithi161.stdout:1/132: link d6/d8/da/c1b d6/d27/c2c 0 2023-12-09T02:35:04.280 INFO:tasks.workunit.client.1.smithi161.stdout:1/133: readlink d6/d8/da/dd/l13 0 2023-12-09T02:35:04.280 INFO:tasks.workunit.client.1.smithi161.stdout:1/134: chown d6/d27/c2c 255433 1 2023-12-09T02:35:04.282 INFO:tasks.workunit.client.1.smithi161.stdout:1/135: rename d6/l7 to d6/d8/da/l2d 0 2023-12-09T02:35:04.285 INFO:tasks.workunit.client.1.smithi161.stdout:1/136: rename d6/d8/da/dd/d11/d1c/c1d to d6/d9/c2e 0 2023-12-09T02:35:04.286 INFO:tasks.workunit.client.1.smithi161.stdout:1/137: getdents d6/d8 0 2023-12-09T02:35:04.286 INFO:tasks.workunit.client.1.smithi161.stdout:1/138: read d6/d8/da/dd/d11/d1c/f1e [46263,42837] 0 2023-12-09T02:35:04.286 INFO:tasks.workunit.client.1.smithi161.stdout:1/139: truncate d6/f26 831072 0 2023-12-09T02:35:04.286 INFO:tasks.workunit.client.1.smithi161.stdout:1/140: truncate d6/d8/da/dd/d11/d1c/f1e 360992 0 2023-12-09T02:35:04.286 INFO:tasks.workunit.client.1.smithi161.stdout:1/141: chown d6/d8/da/c1b 6017 1 2023-12-09T02:35:04.295 INFO:tasks.workunit.client.1.smithi161.stdout:1/142: getdents d6/d8/da/dd/d11/d1c 0 2023-12-09T02:35:04.320 INFO:tasks.workunit.client.1.smithi161.stdout:1/143: dwrite d6/d9/f29 [0,4194304] 0 2023-12-09T02:35:04.325 INFO:tasks.workunit.client.1.smithi161.stdout:1/144: creat d6/d27/f2f x:0 0 0 2023-12-09T02:35:04.325 INFO:tasks.workunit.client.1.smithi161.stdout:1/145: fsync d6/d8/da/dd/fe 0 2023-12-09T02:35:04.326 INFO:tasks.workunit.client.1.smithi161.stdout:1/146: fdatasync d6/d8/da/dd/f21 0 2023-12-09T02:35:04.345 INFO:tasks.workunit.client.1.smithi161.stdout:1/147: dwrite f5 [0,4194304] 0 2023-12-09T02:35:04.363 INFO:tasks.workunit.client.1.smithi161.stdout:1/148: dwrite d6/d8/da/dd/d11/f22 [0,4194304] 0 2023-12-09T02:35:04.363 INFO:tasks.workunit.client.1.smithi161.stdout:1/149: write d6/f26 [413746,45922] 0 2023-12-09T02:35:04.364 INFO:tasks.workunit.client.1.smithi161.stdout:1/150: chown d6/d8/da/dd/d11/d1c 585999 1 2023-12-09T02:35:04.368 INFO:tasks.workunit.client.1.smithi161.stdout:1/151: creat d6/d8/f30 x:0 0 0 2023-12-09T02:35:04.388 INFO:tasks.workunit.client.1.smithi161.stdout:1/152: dwrite d6/d27/f2f [0,4194304] 0 2023-12-09T02:35:04.392 INFO:tasks.workunit.client.1.smithi161.stdout:1/153: mkdir d6/d27/d31 0 2023-12-09T02:35:04.394 INFO:tasks.workunit.client.1.smithi161.stdout:1/154: symlink d6/d9/l32 0 2023-12-09T02:35:04.804 INFO:tasks.workunit.client.1.smithi161.stdout:6/11: sync 2023-12-09T02:35:04.805 INFO:tasks.workunit.client.1.smithi161.stdout:6/12: chown f0 0 1 2023-12-09T02:35:04.806 INFO:tasks.workunit.client.1.smithi161.stdout:6/13: creat f2 x:0 0 0 2023-12-09T02:35:04.823 INFO:tasks.workunit.client.1.smithi161.stdout:6/14: dwrite f1 [0,4194304] 0 2023-12-09T02:35:04.823 INFO:tasks.workunit.client.1.smithi161.stdout:6/15: write f0 [899719,5355] 0 2023-12-09T02:35:04.826 INFO:tasks.workunit.client.1.smithi161.stdout:6/16: creat f3 x:0 0 0 2023-12-09T02:35:04.826 INFO:tasks.workunit.client.1.smithi161.stdout:6/17: dread - f3 zero size 2023-12-09T02:35:04.831 INFO:tasks.workunit.client.1.smithi161.stdout:6/18: dread f0 [0,4194304] 0 2023-12-09T02:35:04.831 INFO:tasks.workunit.client.1.smithi161.stdout:6/19: write f1 [5157637,68550] 0 2023-12-09T02:35:04.833 INFO:tasks.workunit.client.1.smithi161.stdout:6/20: mknod c4 0 2023-12-09T02:35:04.833 INFO:tasks.workunit.client.1.smithi161.stdout:6/21: fdatasync f2 0 2023-12-09T02:35:04.834 INFO:tasks.workunit.client.1.smithi161.stdout:6/22: write f1 [3044315,46303] 0 2023-12-09T02:35:04.853 INFO:tasks.workunit.client.1.smithi161.stdout:6/23: dwrite f2 [0,4194304] 0 2023-12-09T02:35:04.856 INFO:tasks.workunit.client.1.smithi161.stdout:6/24: symlink l5 0 2023-12-09T02:35:04.857 INFO:tasks.workunit.client.1.smithi161.stdout:6/25: mknod c6 0 2023-12-09T02:35:04.861 INFO:tasks.workunit.client.1.smithi161.stdout:6/26: unlink c6 0 2023-12-09T02:35:04.861 INFO:tasks.workunit.client.1.smithi161.stdout:6/27: chown f2 20179826 1 2023-12-09T02:35:04.861 INFO:tasks.workunit.client.1.smithi161.stdout:6/28: rmdir - no directory 2023-12-09T02:35:04.861 INFO:tasks.workunit.client.1.smithi161.stdout:6/29: chown f0 2424117 1 2023-12-09T02:35:04.862 INFO:tasks.workunit.client.1.smithi161.stdout:6/30: readlink l5 0 2023-12-09T02:35:04.865 INFO:tasks.workunit.client.1.smithi161.stdout:6/31: creat f7 x:0 0 0 2023-12-09T02:35:04.868 INFO:tasks.workunit.client.1.smithi161.stdout:6/32: creat f8 x:0 0 0 2023-12-09T02:35:04.888 INFO:tasks.workunit.client.1.smithi161.stdout:6/33: dwrite f1 [0,4194304] 0 2023-12-09T02:35:04.891 INFO:tasks.workunit.client.1.smithi161.stdout:6/34: getdents . 0 2023-12-09T02:35:04.891 INFO:tasks.workunit.client.1.smithi161.stdout:6/35: write f8 [306389,33504] 0 2023-12-09T02:35:04.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:04 smithi161 ceph-mon[121170]: pgmap v200: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 143 MiB/s rd, 305 MiB/s wr, 462 op/s 2023-12-09T02:35:04.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:04.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:04.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:04.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:04 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:04 smithi088 ceph-mon[112028]: pgmap v200: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 143 MiB/s rd, 305 MiB/s wr, 462 op/s 2023-12-09T02:35:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:04 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:04.999 INFO:tasks.workunit.client.1.smithi161.stdout:9/62: sync 2023-12-09T02:35:04.999 INFO:tasks.workunit.client.1.smithi161.stdout:2/45: sync 2023-12-09T02:35:04.999 INFO:tasks.workunit.client.1.smithi161.stdout:4/51: sync 2023-12-09T02:35:04.999 INFO:tasks.workunit.client.1.smithi161.stdout:8/25: sync 2023-12-09T02:35:05.000 INFO:tasks.workunit.client.1.smithi161.stdout:2/46: mknod d4/cd 0 2023-12-09T02:35:05.001 INFO:tasks.workunit.client.1.smithi161.stdout:8/26: mkdir d2/d5 0 2023-12-09T02:35:05.003 INFO:tasks.workunit.client.1.smithi161.stdout:4/52: creat dd/d1a/f1c x:0 0 0 2023-12-09T02:35:05.004 INFO:tasks.workunit.client.1.smithi161.stdout:2/47: rename f3 to d4/fe 0 2023-12-09T02:35:05.004 INFO:tasks.workunit.client.1.smithi161.stdout:2/48: readlink l2 0 2023-12-09T02:35:05.008 INFO:tasks.workunit.client.1.smithi161.stdout:4/53: mkdir dd/d1a/d1d 0 2023-12-09T02:35:05.008 INFO:tasks.workunit.client.1.smithi161.stdout:4/54: write dd/fe [589675,66245] 0 2023-12-09T02:35:05.008 INFO:tasks.workunit.client.1.smithi161.stdout:4/55: write f7 [806824,49545] 0 2023-12-09T02:35:05.020 INFO:tasks.workunit.client.1.smithi161.stdout:8/27: rmdir d2 39 2023-12-09T02:35:05.023 INFO:tasks.workunit.client.1.smithi161.stdout:8/28: creat d2/f6 x:0 0 0 2023-12-09T02:35:05.023 INFO:tasks.workunit.client.1.smithi161.stdout:8/29: chown d2/f3 247213 1 2023-12-09T02:35:05.023 INFO:tasks.workunit.client.1.smithi161.stdout:8/30: readlink l0 0 2023-12-09T02:35:05.024 INFO:tasks.workunit.client.1.smithi161.stdout:2/49: getdents d4 0 2023-12-09T02:35:05.026 INFO:tasks.workunit.client.1.smithi161.stdout:8/31: mknod d2/d5/c7 0 2023-12-09T02:35:05.027 INFO:tasks.workunit.client.1.smithi161.stdout:2/50: mknod d4/d7/cf 0 2023-12-09T02:35:05.027 INFO:tasks.workunit.client.1.smithi161.stdout:2/51: dread - d4/d7/fc zero size 2023-12-09T02:35:05.029 INFO:tasks.workunit.client.1.smithi161.stdout:8/32: rename d2/d5/c7 to d2/c8 0 2023-12-09T02:35:05.030 INFO:tasks.workunit.client.1.smithi161.stdout:2/52: creat d4/d7/db/f10 x:0 0 0 2023-12-09T02:35:05.030 INFO:tasks.workunit.client.1.smithi161.stdout:2/53: chown d4/d7/fc 3844395 1 2023-12-09T02:35:05.031 INFO:tasks.workunit.client.1.smithi161.stdout:8/33: truncate d2/f3 1251918 0 2023-12-09T02:35:05.031 INFO:tasks.workunit.client.1.smithi161.stdout:8/34: chown d2/f6 1648 1 2023-12-09T02:35:05.031 INFO:tasks.workunit.client.1.smithi161.stdout:8/35: readlink l0 0 2023-12-09T02:35:05.033 INFO:tasks.workunit.client.1.smithi161.stdout:2/54: creat d4/d7/f11 x:0 0 0 2023-12-09T02:35:05.033 INFO:tasks.workunit.client.1.smithi161.stdout:2/55: truncate d4/d7/f11 846434 0 2023-12-09T02:35:05.041 INFO:tasks.workunit.client.1.smithi161.stdout:2/56: dread f1 [0,4194304] 0 2023-12-09T02:35:05.042 INFO:tasks.workunit.client.1.smithi161.stdout:2/57: symlink d4/d7/db/l12 0 2023-12-09T02:35:05.044 INFO:tasks.workunit.client.1.smithi161.stdout:2/58: creat d4/d7/f13 x:0 0 0 2023-12-09T02:35:05.044 INFO:tasks.workunit.client.1.smithi161.stdout:2/59: link d4/c6 d4/c14 0 2023-12-09T02:35:05.046 INFO:tasks.workunit.client.1.smithi161.stdout:2/60: write d4/fa [928515,66527] 0 2023-12-09T02:35:05.046 INFO:tasks.workunit.client.1.smithi161.stdout:2/61: stat d4/cd 0 2023-12-09T02:35:05.046 INFO:tasks.workunit.client.1.smithi161.stdout:2/62: chown d4/cd 51337412 1 2023-12-09T02:35:05.046 INFO:tasks.workunit.client.1.smithi161.stdout:2/63: dread - d4/d7/db/f10 zero size 2023-12-09T02:35:05.047 INFO:tasks.workunit.client.1.smithi161.stdout:8/36: dread d2/f3 [0,4194304] 0 2023-12-09T02:35:05.047 INFO:tasks.workunit.client.1.smithi161.stdout:2/64: creat d4/d7/f15 x:0 0 0 2023-12-09T02:35:05.049 INFO:tasks.workunit.client.1.smithi161.stdout:8/37: truncate d2/f3 835176 0 2023-12-09T02:35:05.049 INFO:tasks.workunit.client.1.smithi161.stdout:8/38: chown d2/c8 252930 1 2023-12-09T02:35:05.049 INFO:tasks.workunit.client.1.smithi161.stdout:2/65: truncate d4/fe 2942105 0 2023-12-09T02:35:05.052 INFO:tasks.workunit.client.1.smithi161.stdout:8/39: link d2/f6 d2/f9 0 2023-12-09T02:35:05.053 INFO:tasks.workunit.client.1.smithi161.stdout:8/40: chown d2/f6 9242611 1 2023-12-09T02:35:05.053 INFO:tasks.workunit.client.1.smithi161.stdout:2/66: mkdir d4/d16 0 2023-12-09T02:35:05.053 INFO:tasks.workunit.client.1.smithi161.stdout:2/67: chown l2 5245114 1 2023-12-09T02:35:05.056 INFO:tasks.workunit.client.1.smithi161.stdout:8/41: creat d2/d5/fa x:0 0 0 2023-12-09T02:35:05.058 INFO:tasks.workunit.client.1.smithi161.stdout:2/68: creat d4/f17 x:0 0 0 2023-12-09T02:35:05.061 INFO:tasks.workunit.client.1.smithi161.stdout:8/42: creat d2/d5/fb x:0 0 0 2023-12-09T02:35:05.061 INFO:tasks.workunit.client.1.smithi161.stdout:8/43: chown d2/d5/fa 127960 1 2023-12-09T02:35:05.065 INFO:tasks.workunit.client.1.smithi161.stdout:2/69: unlink l2 0 2023-12-09T02:35:05.066 INFO:tasks.workunit.client.1.smithi161.stdout:8/44: creat d2/fc x:0 0 0 2023-12-09T02:35:05.070 INFO:tasks.workunit.client.1.smithi161.stdout:8/45: creat d2/fd x:0 0 0 2023-12-09T02:35:05.070 INFO:tasks.workunit.client.1.smithi161.stdout:8/46: truncate d2/f9 431986 0 2023-12-09T02:35:05.070 INFO:tasks.workunit.client.1.smithi161.stdout:8/47: dread - d2/d5/fa zero size 2023-12-09T02:35:05.073 INFO:tasks.workunit.client.1.smithi161.stdout:8/48: symlink d2/d5/le 0 2023-12-09T02:35:05.084 INFO:tasks.workunit.client.1.smithi161.stdout:2/70: dwrite d4/d7/f15 [0,4194304] 0 2023-12-09T02:35:05.087 INFO:tasks.workunit.client.1.smithi161.stdout:2/71: creat d4/d16/f18 x:0 0 0 2023-12-09T02:35:05.089 INFO:tasks.workunit.client.1.smithi161.stdout:8/49: dwrite d2/f3 [0,4194304] 0 2023-12-09T02:35:05.092 INFO:tasks.workunit.client.1.smithi161.stdout:8/50: unlink d2/c8 0 2023-12-09T02:35:05.092 INFO:tasks.workunit.client.1.smithi161.stdout:8/51: readlink d2/l4 0 2023-12-09T02:35:05.092 INFO:tasks.workunit.client.1.smithi161.stdout:8/52: write d2/fd [183066,33793] 0 2023-12-09T02:35:05.094 INFO:tasks.workunit.client.1.smithi161.stdout:8/53: symlink d2/lf 0 2023-12-09T02:35:05.095 INFO:tasks.workunit.client.1.smithi161.stdout:8/54: creat d2/d5/f10 x:0 0 0 2023-12-09T02:35:05.097 INFO:tasks.workunit.client.1.smithi161.stdout:8/55: link d2/d5/le d2/d5/l11 0 2023-12-09T02:35:05.097 INFO:tasks.workunit.client.1.smithi161.stdout:8/56: chown c1 0 1 2023-12-09T02:35:05.098 INFO:tasks.workunit.client.1.smithi161.stdout:8/57: write d2/f3 [1402229,87454] 0 2023-12-09T02:35:05.105 INFO:tasks.workunit.client.1.smithi161.stdout:2/72: dwrite d4/d7/f15 [0,4194304] 0 2023-12-09T02:35:05.108 INFO:tasks.workunit.client.1.smithi161.stdout:2/73: getdents d4 0 2023-12-09T02:35:05.108 INFO:tasks.workunit.client.1.smithi161.stdout:2/74: chown f1 1 1 2023-12-09T02:35:05.128 INFO:tasks.workunit.client.1.smithi161.stdout:2/75: dwrite d4/fe [0,4194304] 0 2023-12-09T02:35:05.130 INFO:tasks.workunit.client.1.smithi161.stdout:2/76: creat d4/d7/db/f19 x:0 0 0 2023-12-09T02:35:05.149 INFO:tasks.workunit.client.1.smithi161.stdout:2/77: dwrite d4/d7/db/f19 [0,4194304] 0 2023-12-09T02:35:05.154 INFO:tasks.workunit.client.1.smithi161.stdout:2/78: mkdir d4/d1a 0 2023-12-09T02:35:05.171 INFO:tasks.workunit.client.1.smithi161.stdout:2/79: dwrite d4/f17 [0,4194304] 0 2023-12-09T02:35:05.172 INFO:tasks.workunit.client.1.smithi161.stdout:2/80: write d4/fe [3072858,9099] 0 2023-12-09T02:35:05.173 INFO:tasks.workunit.client.1.smithi161.stdout:2/81: creat d4/d1a/f1b x:0 0 0 2023-12-09T02:35:05.174 INFO:tasks.workunit.client.1.smithi161.stdout:2/82: unlink d4/d7/f11 0 2023-12-09T02:35:05.183 INFO:tasks.workunit.client.1.smithi161.stdout:2/83: rmdir d4/d7 39 2023-12-09T02:35:05.187 INFO:tasks.workunit.client.1.smithi161.stdout:2/84: getdents d4/d7 0 2023-12-09T02:35:05.310 INFO:tasks.workunit.client.1.smithi161.stdout:6/36: sync 2023-12-09T02:35:05.311 INFO:tasks.workunit.client.1.smithi161.stdout:0/33: sync 2023-12-09T02:35:05.311 INFO:tasks.workunit.client.1.smithi161.stdout:1/155: sync 2023-12-09T02:35:05.311 INFO:tasks.workunit.client.1.smithi161.stdout:6/37: stat f7 0 2023-12-09T02:35:05.311 INFO:tasks.workunit.client.1.smithi161.stdout:1/156: stat d6/d8/cb 0 2023-12-09T02:35:05.311 INFO:tasks.workunit.client.1.smithi161.stdout:7/114: sync 2023-12-09T02:35:05.314 INFO:tasks.workunit.client.1.smithi161.stdout:5/56: sync 2023-12-09T02:35:05.314 INFO:tasks.workunit.client.1.smithi161.stdout:1/157: truncate d6/d8/da/dd/d11/d1c/f1f 785333 0 2023-12-09T02:35:05.314 INFO:tasks.workunit.client.1.smithi161.stdout:5/57: chown d0/d2/d7/df 6 1 2023-12-09T02:35:05.314 INFO:tasks.workunit.client.1.smithi161.stdout:3/129: sync 2023-12-09T02:35:05.314 INFO:tasks.workunit.client.1.smithi161.stdout:3/130: readlink d2/d4/l8 0 2023-12-09T02:35:05.315 INFO:tasks.workunit.client.1.smithi161.stdout:0/34: chown c2 253 1 2023-12-09T02:35:05.315 INFO:tasks.workunit.client.1.smithi161.stdout:1/158: truncate f5 696429 0 2023-12-09T02:35:05.316 INFO:tasks.workunit.client.1.smithi161.stdout:5/58: mkdir d0/d2/d14 0 2023-12-09T02:35:05.317 INFO:tasks.workunit.client.1.smithi161.stdout:5/59: write d0/d2/fc [1292019,66103] 0 2023-12-09T02:35:05.327 INFO:tasks.workunit.client.1.smithi161.stdout:6/38: dwrite f2 [4194304,4194304] 0 2023-12-09T02:35:05.327 INFO:tasks.workunit.client.1.smithi161.stdout:5/60: dread d0/d2/f3 [4194304,4194304] 0 2023-12-09T02:35:05.328 INFO:tasks.workunit.client.1.smithi161.stdout:5/61: fsync d0/d2/fc 0 2023-12-09T02:35:05.333 INFO:tasks.workunit.client.1.smithi161.stdout:5/62: dread d0/f1 [4194304,4194304] 0 2023-12-09T02:35:05.439 INFO:tasks.workunit.client.1.smithi161.stdout:3/131: creat d2/d4/d11/d1f/f25 x:0 0 0 2023-12-09T02:35:05.451 INFO:tasks.workunit.client.1.smithi161.stdout:0/35: dread f3 [0,4194304] 0 2023-12-09T02:35:05.451 INFO:tasks.workunit.client.1.smithi161.stdout:7/115: symlink d0/l23 0 2023-12-09T02:35:05.453 INFO:tasks.workunit.client.1.smithi161.stdout:1/159: link d6/d8/da/dd/l2a d6/l33 0 2023-12-09T02:35:05.464 INFO:tasks.workunit.client.1.smithi161.stdout:5/63: rename d0/d2/d7/d11/l13 to d0/d9/l15 0 2023-12-09T02:35:05.464 INFO:tasks.workunit.client.1.smithi161.stdout:1/160: dread d6/f2b [0,4194304] 0 2023-12-09T02:35:05.465 INFO:tasks.workunit.client.1.smithi161.stdout:3/132: symlink d2/d4/d11/d1a/l26 0 2023-12-09T02:35:05.465 INFO:tasks.workunit.client.1.smithi161.stdout:3/133: chown d2/d4/d11/d19/d1b 226639 1 2023-12-09T02:35:05.465 INFO:tasks.workunit.client.1.smithi161.stdout:3/134: dread - d2/d4/d11/d1f/f25 zero size 2023-12-09T02:35:05.467 INFO:tasks.workunit.client.1.smithi161.stdout:0/36: truncate f3 3377296 0 2023-12-09T02:35:05.469 INFO:tasks.workunit.client.1.smithi161.stdout:7/116: creat d0/d3/d13/d1b/f24 x:0 0 0 2023-12-09T02:35:05.469 INFO:tasks.workunit.client.1.smithi161.stdout:7/117: stat d0/d3/d13/f18 0 2023-12-09T02:35:05.470 INFO:tasks.workunit.client.1.smithi161.stdout:5/64: creat d0/d2/f16 x:0 0 0 2023-12-09T02:35:05.473 INFO:tasks.workunit.client.1.smithi161.stdout:1/161: mknod d6/d8/da/dd/c34 0 2023-12-09T02:35:05.474 INFO:tasks.workunit.client.1.smithi161.stdout:3/135: creat d2/d4/f27 x:0 0 0 2023-12-09T02:35:05.474 INFO:tasks.workunit.client.1.smithi161.stdout:3/136: chown d2/f15 3573 1 2023-12-09T02:35:05.474 INFO:tasks.workunit.client.1.smithi161.stdout:3/137: chown d2 6571 1 2023-12-09T02:35:05.476 INFO:tasks.workunit.client.1.smithi161.stdout:7/118: unlink d0/d3/db/f19 0 2023-12-09T02:35:05.478 INFO:tasks.workunit.client.1.smithi161.stdout:1/162: mkdir d6/d8/da/dd/d11/d35 0 2023-12-09T02:35:05.479 INFO:tasks.workunit.client.1.smithi161.stdout:7/119: creat d0/d3/f25 x:0 0 0 2023-12-09T02:35:05.490 INFO:tasks.workunit.client.1.smithi161.stdout:3/138: dread d2/d4/f1e [0,4194304] 0 2023-12-09T02:35:05.493 INFO:tasks.workunit.client.1.smithi161.stdout:0/37: dwrite f7 [0,4194304] 0 2023-12-09T02:35:05.493 INFO:tasks.workunit.client.1.smithi161.stdout:0/38: rmdir - no directory 2023-12-09T02:35:05.493 INFO:tasks.workunit.client.1.smithi161.stdout:0/39: dread - f8 zero size 2023-12-09T02:35:05.494 INFO:tasks.workunit.client.1.smithi161.stdout:3/139: rename d2/d4/d11/d19/d1b to d2/d4/d11/d28 0 2023-12-09T02:35:05.494 INFO:tasks.workunit.client.1.smithi161.stdout:5/65: dwrite d0/d2/f16 [0,4194304] 0 2023-12-09T02:35:05.494 INFO:tasks.workunit.client.1.smithi161.stdout:3/140: dread - d2/d4/f27 zero size 2023-12-09T02:35:05.496 INFO:tasks.workunit.client.1.smithi161.stdout:0/40: write f5 [6814736,79434] 0 2023-12-09T02:35:05.496 INFO:tasks.workunit.client.1.smithi161.stdout:0/41: write f6 [555729,83472] 0 2023-12-09T02:35:05.500 INFO:tasks.workunit.client.1.smithi161.stdout:1/163: dwrite f5 [0,4194304] 0 2023-12-09T02:35:05.500 INFO:tasks.workunit.client.1.smithi161.stdout:1/164: readlink d6/d9/l28 0 2023-12-09T02:35:05.502 INFO:tasks.workunit.client.1.smithi161.stdout:3/141: creat d2/d4/d11/d1a/f29 x:0 0 0 2023-12-09T02:35:05.504 INFO:tasks.workunit.client.1.smithi161.stdout:1/165: truncate d6/f26 649798 0 2023-12-09T02:35:05.506 INFO:tasks.workunit.client.1.smithi161.stdout:3/142: truncate d2/d4/f18 637490 0 2023-12-09T02:35:05.507 INFO:tasks.workunit.client.1.smithi161.stdout:3/143: write d2/d4/f1e [6288684,79813] 0 2023-12-09T02:35:05.507 INFO:tasks.workunit.client.1.smithi161.stdout:3/144: chown d2/d4/lc 1174 1 2023-12-09T02:35:05.507 INFO:tasks.workunit.client.1.smithi161.stdout:3/145: write d2/d4/d11/d1a/f29 [51348,96687] 0 2023-12-09T02:35:05.507 INFO:tasks.workunit.client.1.smithi161.stdout:3/146: dread - d2/d4/d11/d1f/f25 zero size 2023-12-09T02:35:05.507 INFO:tasks.workunit.client.1.smithi161.stdout:7/120: rmdir d0/d3/db 39 2023-12-09T02:35:05.511 INFO:tasks.workunit.client.1.smithi161.stdout:3/147: getdents d2/d4 0 2023-12-09T02:35:05.512 INFO:tasks.workunit.client.1.smithi161.stdout:7/121: rmdir d0 39 2023-12-09T02:35:05.513 INFO:tasks.workunit.client.1.smithi161.stdout:3/148: mkdir d2/d4/d11/d1f/d2a 0 2023-12-09T02:35:05.514 INFO:tasks.workunit.client.1.smithi161.stdout:7/122: creat d0/d3/d13/f26 x:0 0 0 2023-12-09T02:35:05.514 INFO:tasks.workunit.client.1.smithi161.stdout:7/123: truncate d0/fc 1685273 0 2023-12-09T02:35:05.515 INFO:tasks.workunit.client.1.smithi161.stdout:3/149: creat d2/d4/d11/d1f/d2a/f2b x:0 0 0 2023-12-09T02:35:05.517 INFO:tasks.workunit.client.1.smithi161.stdout:3/150: truncate d2/fa 2994664 0 2023-12-09T02:35:05.520 INFO:tasks.workunit.client.1.smithi161.stdout:7/124: rename d0/d3/l12 to d0/l27 0 2023-12-09T02:35:05.523 INFO:tasks.workunit.client.1.smithi161.stdout:7/125: write d0/d3/f17 [142495,40667] 0 2023-12-09T02:35:05.524 INFO:tasks.workunit.client.1.smithi161.stdout:7/126: fdatasync d0/d3/d13/f1f 0 2023-12-09T02:35:05.535 INFO:tasks.workunit.client.1.smithi161.stdout:0/42: truncate f5 1726343 0 2023-12-09T02:35:05.552 INFO:tasks.workunit.client.1.smithi161.stdout:3/151: dwrite d2/f15 [0,4194304] 0 2023-12-09T02:35:05.562 INFO:tasks.workunit.client.1.smithi161.stdout:0/43: dwrite f1 [0,4194304] 0 2023-12-09T02:35:05.562 INFO:tasks.workunit.client.1.smithi161.stdout:0/44: truncate f8 758435 0 2023-12-09T02:35:05.562 INFO:tasks.workunit.client.1.smithi161.stdout:3/152: dread d2/fe [0,4194304] 0 2023-12-09T02:35:05.562 INFO:tasks.workunit.client.1.smithi161.stdout:7/127: dwrite d0/d3/d13/d1b/f24 [0,4194304] 0 2023-12-09T02:35:05.569 INFO:tasks.workunit.client.1.smithi161.stdout:3/153: rename d2/d4/d11/d1a to d2/d4/d2c 0 2023-12-09T02:35:05.569 INFO:tasks.workunit.client.1.smithi161.stdout:3/154: write d2/d4/d11/f14 [1057090,130178] 0 2023-12-09T02:35:05.569 INFO:tasks.workunit.client.1.smithi161.stdout:3/155: stat d2/d4/d2c/l26 0 2023-12-09T02:35:05.569 INFO:tasks.workunit.client.1.smithi161.stdout:3/156: write d2/d4/d11/d1f/f25 [783732,35633] 0 2023-12-09T02:35:05.569 INFO:tasks.workunit.client.1.smithi161.stdout:3/157: fdatasync d2/d4/f5 0 2023-12-09T02:35:05.572 INFO:tasks.workunit.client.1.smithi161.stdout:7/128: symlink d0/d3/d13/l28 0 2023-12-09T02:35:05.572 INFO:tasks.workunit.client.1.smithi161.stdout:7/129: truncate d0/d3/db/f10 582510 0 2023-12-09T02:35:05.579 INFO:tasks.workunit.client.1.smithi161.stdout:7/130: mkdir d0/d29 0 2023-12-09T02:35:05.584 INFO:tasks.workunit.client.1.smithi161.stdout:3/158: dread d2/d4/d11/f14 [0,4194304] 0 2023-12-09T02:35:05.585 INFO:tasks.workunit.client.1.smithi161.stdout:7/131: symlink d0/d3/d13/d1b/l2a 0 2023-12-09T02:35:05.591 INFO:tasks.workunit.client.1.smithi161.stdout:3/159: rmdir d2/d4/d11/d1f 39 2023-12-09T02:35:05.591 INFO:tasks.workunit.client.1.smithi161.stdout:3/160: chown d2/d4/d11/d1f/d2a/f2b 64235 1 2023-12-09T02:35:05.591 INFO:tasks.workunit.client.1.smithi161.stdout:3/161: stat d2/d4/l17 0 2023-12-09T02:35:05.602 INFO:tasks.workunit.client.1.smithi161.stdout:0/45: dwrite f5 [0,4194304] 0 2023-12-09T02:35:05.602 INFO:tasks.workunit.client.1.smithi161.stdout:0/46: fdatasync f7 0 2023-12-09T02:35:05.616 INFO:tasks.workunit.client.1.smithi161.stdout:7/132: dwrite d0/d3/d13/d1b/f24 [0,4194304] 0 2023-12-09T02:35:05.616 INFO:tasks.workunit.client.1.smithi161.stdout:7/133: dread - d0/d3/d13/f22 zero size 2023-12-09T02:35:05.616 INFO:tasks.workunit.client.1.smithi161.stdout:7/134: readlink d0/d3/d13/l28 0 2023-12-09T02:35:05.630 INFO:tasks.workunit.client.1.smithi161.stdout:0/47: mkdir d9 0 2023-12-09T02:35:05.637 INFO:tasks.workunit.client.1.smithi161.stdout:3/162: rmdir d2/d4/d2c 39 2023-12-09T02:35:05.639 INFO:tasks.workunit.client.1.smithi161.stdout:7/135: dwrite d0/d3/f9 [0,4194304] 0 2023-12-09T02:35:05.639 INFO:tasks.workunit.client.1.smithi161.stdout:7/136: fdatasync d0/d3/d13/f18 0 2023-12-09T02:35:05.639 INFO:tasks.workunit.client.1.smithi161.stdout:7/137: stat d0/c1d 0 2023-12-09T02:35:05.650 INFO:tasks.workunit.client.1.smithi161.stdout:3/163: dread d2/fa [0,4194304] 0 2023-12-09T02:35:05.650 INFO:tasks.workunit.client.1.smithi161.stdout:3/164: write d2/d4/d11/d1f/d2a/f2b [39886,113096] 0 2023-12-09T02:35:05.650 INFO:tasks.workunit.client.1.smithi161.stdout:3/165: fsync d2/d4/d11/d28/f22 0 2023-12-09T02:35:05.650 INFO:tasks.workunit.client.1.smithi161.stdout:3/166: fsync d2/d4/d11/f14 0 2023-12-09T02:35:05.654 INFO:tasks.workunit.client.1.smithi161.stdout:3/167: mkdir d2/d4/d2c/d2d 0 2023-12-09T02:35:05.659 INFO:tasks.workunit.client.1.smithi161.stdout:0/48: dwrite f5 [0,4194304] 0 2023-12-09T02:35:05.663 INFO:tasks.workunit.client.1.smithi161.stdout:0/49: unlink f5 0 2023-12-09T02:35:05.665 INFO:tasks.workunit.client.1.smithi161.stdout:7/138: dwrite d0/d3/d13/f1f [0,4194304] 0 2023-12-09T02:35:05.667 INFO:tasks.workunit.client.1.smithi161.stdout:0/50: creat d9/fa x:0 0 0 2023-12-09T02:35:05.671 INFO:tasks.workunit.client.1.smithi161.stdout:0/51: mkdir d9/db 0 2023-12-09T02:35:05.671 INFO:tasks.workunit.client.1.smithi161.stdout:0/52: chown f6 479 1 2023-12-09T02:35:05.674 INFO:tasks.workunit.client.1.smithi161.stdout:7/139: rename d0/d3/f6 to d0/d3/d13/d1b/f2b 0 2023-12-09T02:35:05.678 INFO:tasks.workunit.client.1.smithi161.stdout:7/140: unlink d0/d3/d13/d1b/f24 0 2023-12-09T02:35:05.679 INFO:tasks.workunit.client.1.smithi161.stdout:7/141: chown d0/d3/d21 374 1 2023-12-09T02:35:05.681 INFO:tasks.workunit.client.1.smithi161.stdout:7/142: write d0/d3/f7 [3337388,57169] 0 2023-12-09T02:35:05.682 INFO:tasks.workunit.client.1.smithi161.stdout:7/143: stat d0/d3/f8 0 2023-12-09T02:35:05.682 INFO:tasks.workunit.client.1.smithi161.stdout:7/144: chown d0/d3/d13/d1b/f2b 2394192 1 2023-12-09T02:35:05.682 INFO:tasks.workunit.client.1.smithi161.stdout:9/63: sync 2023-12-09T02:35:05.682 INFO:tasks.workunit.client.1.smithi161.stdout:9/64: dread - d2/da/f11 zero size 2023-12-09T02:35:05.682 INFO:tasks.workunit.client.1.smithi161.stdout:9/65: write d2/da/f10 [40232,71774] 0 2023-12-09T02:35:05.684 INFO:tasks.workunit.client.1.smithi161.stdout:7/145: mknod d0/c2c 0 2023-12-09T02:35:05.688 INFO:tasks.workunit.client.1.smithi161.stdout:7/146: mkdir d0/d3/d13/d2d 0 2023-12-09T02:35:05.691 INFO:tasks.workunit.client.1.smithi161.stdout:7/147: getdents d0/d3/db 0 2023-12-09T02:35:05.694 INFO:tasks.workunit.client.1.smithi161.stdout:7/148: chown d0/d3/l1a 10285074 1 2023-12-09T02:35:05.704 INFO:tasks.workunit.client.1.smithi161.stdout:9/66: dwrite d2/da/f10 [0,4194304] 0 2023-12-09T02:35:05.704 INFO:tasks.workunit.client.1.smithi161.stdout:0/53: dwrite d9/fa [0,4194304] 0 2023-12-09T02:35:05.704 INFO:tasks.workunit.client.1.smithi161.stdout:0/54: write f1 [5051386,65389] 0 2023-12-09T02:35:05.714 INFO:tasks.workunit.client.1.smithi161.stdout:9/67: dread d2/da/f10 [0,4194304] 0 2023-12-09T02:35:05.718 INFO:tasks.workunit.client.1.smithi161.stdout:9/68: mkdir d2/da/d13 0 2023-12-09T02:35:05.718 INFO:tasks.workunit.client.1.smithi161.stdout:9/69: fdatasync d2/da/f10 0 2023-12-09T02:35:05.721 INFO:tasks.workunit.client.1.smithi161.stdout:9/70: unlink d2/da/ld 0 2023-12-09T02:35:05.728 INFO:tasks.workunit.client.1.smithi161.stdout:0/55: dwrite f3 [4194304,4194304] 0 2023-12-09T02:35:05.728 INFO:tasks.workunit.client.1.smithi161.stdout:9/71: dread d2/f9 [0,4194304] 0 2023-12-09T02:35:05.728 INFO:tasks.workunit.client.1.smithi161.stdout:7/149: dwrite d0/fd [0,4194304] 0 2023-12-09T02:35:05.729 INFO:tasks.workunit.client.1.smithi161.stdout:7/150: read - d0/d3/d13/f22 zero size 2023-12-09T02:35:05.730 INFO:tasks.workunit.client.1.smithi161.stdout:0/56: rename f3 to d9/fc 0 2023-12-09T02:35:05.735 INFO:tasks.workunit.client.1.smithi161.stdout:0/57: mkdir d9/dd 0 2023-12-09T02:35:05.737 INFO:tasks.workunit.client.1.smithi161.stdout:9/72: dread f1 [0,4194304] 0 2023-12-09T02:35:05.737 INFO:tasks.workunit.client.1.smithi161.stdout:0/58: mkdir d9/de 0 2023-12-09T02:35:05.740 INFO:tasks.workunit.client.1.smithi161.stdout:9/73: dread d2/f12 [0,4194304] 0 2023-12-09T02:35:05.747 INFO:tasks.workunit.client.1.smithi161.stdout:9/74: rename d2/fe to d2/da/f14 0 2023-12-09T02:35:05.747 INFO:tasks.workunit.client.1.smithi161.stdout:9/75: chown d2/da/f10 192356 1 2023-12-09T02:35:05.755 INFO:tasks.workunit.client.1.smithi161.stdout:0/59: truncate f1 159637 0 2023-12-09T02:35:05.758 INFO:tasks.workunit.client.1.smithi161.stdout:0/60: rmdir d9/de 0 2023-12-09T02:35:05.758 INFO:tasks.workunit.client.1.smithi161.stdout:0/61: write f8 [1207964,29954] 0 2023-12-09T02:35:05.764 INFO:tasks.workunit.client.1.smithi161.stdout:0/62: write f7 [173181,123934] 0 2023-12-09T02:35:05.765 INFO:tasks.workunit.client.1.smithi161.stdout:0/63: mknod d9/dd/cf 0 2023-12-09T02:35:05.766 INFO:tasks.workunit.client.1.smithi161.stdout:0/64: mknod d9/db/c10 0 2023-12-09T02:35:05.768 INFO:tasks.workunit.client.1.smithi161.stdout:9/76: dwrite f1 [0,4194304] 0 2023-12-09T02:35:05.783 INFO:tasks.workunit.client.1.smithi161.stdout:9/77: truncate f1 1441792 0 2023-12-09T02:35:05.783 INFO:tasks.workunit.client.1.smithi161.stdout:9/78: chown f1 92028 1 2023-12-09T02:35:05.783 INFO:tasks.workunit.client.1.smithi161.stdout:9/79: fdatasync d2/da/f10 0 2023-12-09T02:35:05.783 INFO:tasks.workunit.client.1.smithi161.stdout:9/80: chown d2 261458495 1 2023-12-09T02:35:05.783 INFO:tasks.workunit.client.1.smithi161.stdout:9/81: write d2/da/f11 [341581,6121] 0 2023-12-09T02:35:05.784 INFO:tasks.workunit.client.1.smithi161.stdout:0/65: dwrite f6 [0,4194304] 0 2023-12-09T02:35:05.786 INFO:tasks.workunit.client.1.smithi161.stdout:9/82: unlink d2/da/f11 0 2023-12-09T02:35:05.789 INFO:tasks.workunit.client.1.smithi161.stdout:9/83: write d2/f12 [2079699,40315] 0 2023-12-09T02:35:05.794 INFO:tasks.workunit.client.1.smithi161.stdout:9/84: creat d2/f15 x:0 0 0 2023-12-09T02:35:05.797 INFO:tasks.workunit.client.1.smithi161.stdout:9/85: rename d2/da/d13 to d2/da/d16 0 2023-12-09T02:35:05.799 INFO:tasks.workunit.client.1.smithi161.stdout:0/66: dwrite d9/fc [0,4194304] 0 2023-12-09T02:35:05.801 INFO:tasks.workunit.client.1.smithi161.stdout:9/86: link d2/da/cf d2/c17 0 2023-12-09T02:35:05.803 INFO:tasks.workunit.client.1.smithi161.stdout:0/67: unlink f8 0 2023-12-09T02:35:05.804 INFO:tasks.workunit.client.1.smithi161.stdout:9/87: symlink d2/da/l18 0 2023-12-09T02:35:05.806 INFO:tasks.workunit.client.1.smithi161.stdout:0/68: creat d9/f11 x:0 0 0 2023-12-09T02:35:05.806 INFO:tasks.workunit.client.1.smithi161.stdout:0/69: fdatasync f1 0 2023-12-09T02:35:05.808 INFO:tasks.workunit.client.1.smithi161.stdout:0/70: fdatasync f7 0 2023-12-09T02:35:05.808 INFO:tasks.workunit.client.1.smithi161.stdout:9/88: rename f1 to d2/f19 0 2023-12-09T02:35:05.811 INFO:tasks.workunit.client.1.smithi161.stdout:9/89: mknod d2/da/d16/c1a 0 2023-12-09T02:35:05.811 INFO:tasks.workunit.client.1.smithi161.stdout:9/90: chown d2/l7 109524089 1 2023-12-09T02:35:05.813 INFO:tasks.workunit.client.1.smithi161.stdout:9/91: creat d2/f1b x:0 0 0 2023-12-09T02:35:05.814 INFO:tasks.workunit.client.1.smithi161.stdout:9/92: rename d2/l7 to d2/da/l1c 0 2023-12-09T02:35:05.814 INFO:tasks.workunit.client.1.smithi161.stdout:9/93: dread - d2/f1b zero size 2023-12-09T02:35:05.828 INFO:tasks.workunit.client.1.smithi161.stdout:0/71: dwrite d9/fa [0,4194304] 0 2023-12-09T02:35:05.832 INFO:tasks.workunit.client.1.smithi161.stdout:0/72: readlink l4 0 2023-12-09T02:35:05.834 INFO:tasks.workunit.client.1.smithi161.stdout:0/73: truncate f6 2879878 0 2023-12-09T02:35:05.836 INFO:tasks.workunit.client.1.smithi161.stdout:0/74: mknod d9/dd/c12 0 2023-12-09T02:35:05.839 INFO:tasks.workunit.client.1.smithi161.stdout:0/75: unlink d9/dd/c12 0 2023-12-09T02:35:05.846 INFO:tasks.workunit.client.1.smithi161.stdout:9/94: dwrite d2/f8 [0,4194304] 0 2023-12-09T02:35:05.849 INFO:tasks.workunit.client.1.smithi161.stdout:0/76: dread d9/fc [0,4194304] 0 2023-12-09T02:35:05.850 INFO:tasks.workunit.client.1.smithi161.stdout:0/77: read d9/fc [2546507,62665] 0 2023-12-09T02:35:05.852 INFO:tasks.workunit.client.1.smithi161.stdout:0/78: mknod d9/dd/c13 0 2023-12-09T02:35:05.854 INFO:tasks.workunit.client.1.smithi161.stdout:9/95: dread d2/f12 [0,4194304] 0 2023-12-09T02:35:05.854 INFO:tasks.workunit.client.1.smithi161.stdout:9/96: chown d2/da 5 1 2023-12-09T02:35:05.854 INFO:tasks.workunit.client.1.smithi161.stdout:9/97: fsync d2/f9 0 2023-12-09T02:35:05.854 INFO:tasks.workunit.client.1.smithi161.stdout:9/98: chown d2/f8 25236 1 2023-12-09T02:35:05.854 INFO:tasks.workunit.client.1.smithi161.stdout:0/79: write d9/fa [2720590,80504] 0 2023-12-09T02:35:05.854 INFO:tasks.workunit.client.1.smithi161.stdout:0/80: write d9/f11 [259845,7878] 0 2023-12-09T02:35:05.857 INFO:tasks.workunit.client.1.smithi161.stdout:9/99: dread d2/f19 [0,4194304] 0 2023-12-09T02:35:05.857 INFO:tasks.workunit.client.1.smithi161.stdout:9/100: rename d2 to d2/da/d1d 22 2023-12-09T02:35:05.859 INFO:tasks.workunit.client.1.smithi161.stdout:0/81: symlink d9/db/l14 0 2023-12-09T02:35:05.861 INFO:tasks.workunit.client.1.smithi161.stdout:9/101: creat d2/da/f1e x:0 0 0 2023-12-09T02:35:05.861 INFO:tasks.workunit.client.1.smithi161.stdout:9/102: write d2/f1b [1033463,95384] 0 2023-12-09T02:35:05.863 INFO:tasks.workunit.client.1.smithi161.stdout:0/82: mkdir d9/db/d15 0 2023-12-09T02:35:05.864 INFO:tasks.workunit.client.1.smithi161.stdout:9/103: symlink d2/da/l1f 0 2023-12-09T02:35:05.865 INFO:tasks.workunit.client.1.smithi161.stdout:0/83: rename d9/dd/cf to d9/c16 0 2023-12-09T02:35:05.867 INFO:tasks.workunit.client.1.smithi161.stdout:0/84: mkdir d9/dd/d17 0 2023-12-09T02:35:05.867 INFO:tasks.workunit.client.1.smithi161.stdout:0/85: truncate f7 4319986 0 2023-12-09T02:35:05.872 INFO:tasks.workunit.client.1.smithi161.stdout:0/86: write d9/fa [2116769,45536] 0 2023-12-09T02:35:05.873 INFO:tasks.workunit.client.1.smithi161.stdout:0/87: creat d9/dd/d17/f18 x:0 0 0 2023-12-09T02:35:05.880 INFO:tasks.workunit.client.1.smithi161.stdout:9/104: dwrite d2/da/f14 [0,4194304] 0 2023-12-09T02:35:05.881 INFO:tasks.workunit.client.1.smithi161.stdout:0/88: dread f7 [0,4194304] 0 2023-12-09T02:35:05.892 INFO:tasks.workunit.client.1.smithi161.stdout:9/105: truncate d2/f12 2219110 0 2023-12-09T02:35:05.892 INFO:tasks.workunit.client.1.smithi161.stdout:9/106: chown d2/f8 1786 1 2023-12-09T02:35:05.895 INFO:tasks.workunit.client.1.smithi161.stdout:0/89: rename d9/db/c10 to d9/dd/d17/c19 0 2023-12-09T02:35:05.895 INFO:tasks.workunit.client.1.smithi161.stdout:0/90: readlink l4 0 2023-12-09T02:35:05.919 INFO:tasks.workunit.client.1.smithi161.stdout:0/91: dwrite d9/dd/d17/f18 [0,4194304] 0 2023-12-09T02:35:05.925 INFO:tasks.workunit.client.1.smithi161.stdout:9/107: dread d2/f12 [0,4194304] 0 2023-12-09T02:35:05.926 INFO:tasks.workunit.client.1.smithi161.stdout:0/92: unlink d9/fa 0 2023-12-09T02:35:05.929 INFO:tasks.workunit.client.1.smithi161.stdout:9/108: link d2/f9 d2/da/d16/f20 0 2023-12-09T02:35:05.930 INFO:tasks.workunit.client.1.smithi161.stdout:9/109: read d2/da/d16/f20 [577965,101967] 0 2023-12-09T02:35:05.932 INFO:tasks.workunit.client.1.smithi161.stdout:9/110: creat d2/da/f21 x:0 0 0 2023-12-09T02:35:05.935 INFO:tasks.workunit.client.1.smithi161.stdout:9/111: rmdir d2/da/d16 39 2023-12-09T02:35:05.937 INFO:tasks.workunit.client.1.smithi161.stdout:0/93: dread d9/dd/d17/f18 [0,4194304] 0 2023-12-09T02:35:05.937 INFO:tasks.workunit.client.1.smithi161.stdout:9/112: truncate d2/da/f14 477863 0 2023-12-09T02:35:05.938 INFO:tasks.workunit.client.1.smithi161.stdout:9/113: chown d2/da/d16 3 1 2023-12-09T02:35:05.938 INFO:tasks.workunit.client.1.smithi161.stdout:9/114: chown d2/f12 31 1 2023-12-09T02:35:05.939 INFO:tasks.workunit.client.1.smithi161.stdout:0/94: rmdir d9/dd/d17 39 2023-12-09T02:35:05.963 INFO:tasks.workunit.client.1.smithi161.stdout:9/115: dwrite d2/da/f10 [0,4194304] 0 2023-12-09T02:35:05.964 INFO:tasks.workunit.client.1.smithi161.stdout:0/95: dwrite f1 [4194304,4194304] 0 2023-12-09T02:35:05.966 INFO:tasks.workunit.client.1.smithi161.stdout:9/116: mkdir d2/da/d22 0 2023-12-09T02:35:05.970 INFO:tasks.workunit.client.1.smithi161.stdout:0/96: mkdir d9/d1a 0 2023-12-09T02:35:05.970 INFO:tasks.workunit.client.1.smithi161.stdout:0/97: write f1 [8743573,49712] 0 2023-12-09T02:35:05.971 INFO:tasks.workunit.client.1.smithi161.stdout:0/98: rename d9/d1a to d9/d1a/d1b 22 2023-12-09T02:35:05.972 INFO:tasks.workunit.client.1.smithi161.stdout:0/99: write f1 [6957973,76423] 0 2023-12-09T02:35:05.974 INFO:tasks.workunit.client.1.smithi161.stdout:0/100: mknod d9/dd/c1c 0 2023-12-09T02:35:05.978 INFO:tasks.workunit.client.1.smithi161.stdout:0/101: unlink c0 0 2023-12-09T02:35:05.983 INFO:tasks.workunit.client.1.smithi161.stdout:9/117: dwrite d2/da/f14 [0,4194304] 0 2023-12-09T02:35:05.985 INFO:tasks.workunit.client.1.smithi161.stdout:9/118: symlink d2/da/d16/l23 0 2023-12-09T02:35:05.985 INFO:tasks.workunit.client.1.smithi161.stdout:9/119: write d2/f9 [2739715,96268] 0 2023-12-09T02:35:05.985 INFO:tasks.workunit.client.1.smithi161.stdout:9/120: chown d2/f1b 4506290 1 2023-12-09T02:35:05.985 INFO:tasks.workunit.client.1.smithi161.stdout:9/121: rename d2 to d2/da/d16/d24 22 2023-12-09T02:35:05.985 INFO:tasks.workunit.client.1.smithi161.stdout:0/102: write d9/fc [6229746,6950] 0 2023-12-09T02:35:05.985 INFO:tasks.workunit.client.1.smithi161.stdout:0/103: chown d9/db 2550716 1 2023-12-09T02:35:05.996 INFO:tasks.workunit.client.1.smithi161.stdout:0/104: dread d9/dd/d17/f18 [0,4194304] 0 2023-12-09T02:35:05.998 INFO:tasks.workunit.client.1.smithi161.stdout:0/105: rmdir d9/db/d15 0 2023-12-09T02:35:05.999 INFO:tasks.workunit.client.1.smithi161.stdout:0/106: creat d9/f1d x:0 0 0 2023-12-09T02:35:06.001 INFO:tasks.workunit.client.1.smithi161.stdout:9/122: dwrite d2/da/f21 [0,4194304] 0 2023-12-09T02:35:06.001 INFO:tasks.workunit.client.1.smithi161.stdout:9/123: write d2/f15 [798371,126587] 0 2023-12-09T02:35:06.006 INFO:tasks.workunit.client.1.smithi161.stdout:9/124: mkdir d2/d25 0 2023-12-09T02:35:06.018 INFO:tasks.workunit.client.1.smithi161.stdout:0/107: dwrite d9/fc [0,4194304] 0 2023-12-09T02:35:06.018 INFO:tasks.workunit.client.1.smithi161.stdout:0/108: chown d9/dd 15421 1 2023-12-09T02:35:06.025 INFO:tasks.workunit.client.1.smithi161.stdout:0/109: dread f1 [0,4194304] 0 2023-12-09T02:35:06.028 INFO:tasks.workunit.client.1.smithi161.stdout:0/110: rename d9/fc to d9/dd/f1e 0 2023-12-09T02:35:06.033 INFO:tasks.workunit.client.1.smithi161.stdout:4/56: sync 2023-12-09T02:35:06.033 INFO:tasks.workunit.client.1.smithi161.stdout:8/58: sync 2023-12-09T02:35:06.033 INFO:tasks.workunit.client.1.smithi161.stdout:8/59: dread - d2/fc zero size 2023-12-09T02:35:06.034 INFO:tasks.workunit.client.1.smithi161.stdout:8/60: fsync d2/d5/fb 0 2023-12-09T02:35:06.034 INFO:tasks.workunit.client.1.smithi161.stdout:8/61: dread - d2/d5/f10 zero size 2023-12-09T02:35:06.036 INFO:tasks.workunit.client.1.smithi161.stdout:4/57: truncate dd/fe 172422 0 2023-12-09T02:35:06.036 INFO:tasks.workunit.client.1.smithi161.stdout:4/58: write dd/f19 [758193,40135] 0 2023-12-09T02:35:06.041 INFO:tasks.workunit.client.1.smithi161.stdout:4/59: mkdir dd/d1a/d1e 0 2023-12-09T02:35:06.044 INFO:tasks.workunit.client.1.smithi161.stdout:4/60: symlink dd/l1f 0 2023-12-09T02:35:06.044 INFO:tasks.workunit.client.1.smithi161.stdout:4/61: truncate dd/f13 119732 0 2023-12-09T02:35:06.046 INFO:tasks.workunit.client.1.smithi161.stdout:8/62: dwrite d2/d5/fb [0,4194304] 0 2023-12-09T02:35:06.053 INFO:tasks.workunit.client.1.smithi161.stdout:8/63: symlink d2/l12 0 2023-12-09T02:35:06.057 INFO:tasks.workunit.client.1.smithi161.stdout:6/39: sync 2023-12-09T02:35:06.059 INFO:tasks.workunit.client.1.smithi161.stdout:6/40: creat f9 x:0 0 0 2023-12-09T02:35:06.061 INFO:tasks.workunit.client.1.smithi161.stdout:6/41: mkdir da 0 2023-12-09T02:35:06.067 INFO:tasks.workunit.client.1.smithi161.stdout:4/62: write dd/fe [46579,13800] 0 2023-12-09T02:35:06.067 INFO:tasks.workunit.client.1.smithi161.stdout:4/63: dread - dd/f18 zero size 2023-12-09T02:35:06.067 INFO:tasks.workunit.client.1.smithi161.stdout:4/64: chown dd/d1a/l1b 20288854 1 2023-12-09T02:35:06.068 INFO:tasks.workunit.client.1.smithi161.stdout:4/65: rename l3 to dd/d1a/d1d/l20 0 2023-12-09T02:35:06.069 INFO:tasks.workunit.client.1.smithi161.stdout:8/64: dwrite d2/d5/fb [0,4194304] 0 2023-12-09T02:35:06.069 INFO:tasks.workunit.client.1.smithi161.stdout:8/65: fsync d2/fc 0 2023-12-09T02:35:06.069 INFO:tasks.workunit.client.1.smithi161.stdout:8/66: write d2/fc [998555,12982] 0 2023-12-09T02:35:06.070 INFO:tasks.workunit.client.1.smithi161.stdout:8/67: mknod d2/c13 0 2023-12-09T02:35:06.070 INFO:tasks.workunit.client.1.smithi161.stdout:8/68: stat d2/f3 0 2023-12-09T02:35:06.070 INFO:tasks.workunit.client.1.smithi161.stdout:8/69: chown d2/d5/f10 917879183 1 2023-12-09T02:35:06.082 INFO:tasks.workunit.client.1.smithi161.stdout:8/70: truncate d2/d5/fb 2288123 0 2023-12-09T02:35:06.083 INFO:tasks.workunit.client.1.smithi161.stdout:6/42: dwrite f9 [0,4194304] 0 2023-12-09T02:35:06.083 INFO:tasks.workunit.client.1.smithi161.stdout:4/66: dwrite dd/f15 [4194304,4194304] 0 2023-12-09T02:35:06.083 INFO:tasks.workunit.client.1.smithi161.stdout:8/71: truncate d2/f3 2188742 0 2023-12-09T02:35:06.085 INFO:tasks.workunit.client.1.smithi161.stdout:6/43: mknod da/cb 0 2023-12-09T02:35:06.088 INFO:tasks.workunit.client.1.smithi161.stdout:4/67: creat dd/d1a/d1e/f21 x:0 0 0 2023-12-09T02:35:06.088 INFO:tasks.workunit.client.1.smithi161.stdout:4/68: truncate dd/d1a/d1e/f21 639079 0 2023-12-09T02:35:06.090 INFO:tasks.workunit.client.1.smithi161.stdout:4/69: fsync dd/f19 0 2023-12-09T02:35:06.091 INFO:tasks.workunit.client.1.smithi161.stdout:8/72: rename d2/d5/f10 to d2/d5/f14 0 2023-12-09T02:35:06.091 INFO:tasks.workunit.client.1.smithi161.stdout:8/73: write d2/f9 [1233687,9730] 0 2023-12-09T02:35:06.094 INFO:tasks.workunit.client.1.smithi161.stdout:6/44: creat da/fc x:0 0 0 2023-12-09T02:35:06.099 INFO:tasks.workunit.client.1.smithi161.stdout:4/70: dread dd/f15 [4194304,4194304] 0 2023-12-09T02:35:06.099 INFO:tasks.workunit.client.1.smithi161.stdout:4/71: dread dd/f13 [0,4194304] 0 2023-12-09T02:35:06.105 INFO:tasks.workunit.client.1.smithi161.stdout:8/74: rename d2/fd to d2/f15 0 2023-12-09T02:35:06.105 INFO:tasks.workunit.client.1.smithi161.stdout:8/75: truncate d2/f6 2025598 0 2023-12-09T02:35:06.110 INFO:tasks.workunit.client.1.smithi161.stdout:6/45: rename f8 to da/fd 0 2023-12-09T02:35:06.111 INFO:tasks.workunit.client.1.smithi161.stdout:4/72: rmdir dd/d1a/d1e 39 2023-12-09T02:35:06.111 INFO:tasks.workunit.client.1.smithi161.stdout:4/73: chown dd/f19 434361992 1 2023-12-09T02:35:06.114 INFO:tasks.workunit.client.1.smithi161.stdout:8/76: rename d2/f15 to d2/d5/f16 0 2023-12-09T02:35:06.115 INFO:tasks.workunit.client.1.smithi161.stdout:6/46: mknod da/ce 0 2023-12-09T02:35:06.117 INFO:tasks.workunit.client.1.smithi161.stdout:4/74: stat c2 0 2023-12-09T02:35:06.117 INFO:tasks.workunit.client.1.smithi161.stdout:4/75: stat dd/fe 0 2023-12-09T02:35:06.117 INFO:tasks.workunit.client.1.smithi161.stdout:4/76: readlink lb 0 2023-12-09T02:35:06.117 INFO:tasks.workunit.client.1.smithi161.stdout:4/77: chown dd/d1a/d1d 431 1 2023-12-09T02:35:06.119 INFO:tasks.workunit.client.1.smithi161.stdout:6/47: mkdir da/df 0 2023-12-09T02:35:06.120 INFO:tasks.workunit.client.1.smithi161.stdout:8/77: rmdir d2 39 2023-12-09T02:35:06.122 INFO:tasks.workunit.client.1.smithi161.stdout:4/78: truncate dd/d1a/d1e/f21 33833 0 2023-12-09T02:35:06.122 INFO:tasks.workunit.client.1.smithi161.stdout:4/79: chown dd/fe 2610 1 2023-12-09T02:35:06.125 INFO:tasks.workunit.client.1.smithi161.stdout:8/78: link d2/fc d2/f17 0 2023-12-09T02:35:06.125 INFO:tasks.workunit.client.1.smithi161.stdout:8/79: chown d2/f17 649457447 1 2023-12-09T02:35:06.126 INFO:tasks.workunit.client.1.smithi161.stdout:4/80: symlink dd/d1a/l22 0 2023-12-09T02:35:06.126 INFO:tasks.workunit.client.1.smithi161.stdout:4/81: fsync f8 0 2023-12-09T02:35:06.129 INFO:tasks.workunit.client.1.smithi161.stdout:4/82: truncate dd/f19 588106 0 2023-12-09T02:35:06.129 INFO:tasks.workunit.client.1.smithi161.stdout:4/83: chown f8 224474 1 2023-12-09T02:35:06.129 INFO:tasks.workunit.client.1.smithi161.stdout:4/84: write f8 [1068967,117726] 0 2023-12-09T02:35:06.131 INFO:tasks.workunit.client.1.smithi161.stdout:8/80: dread d2/f9 [0,4194304] 0 2023-12-09T02:35:06.133 INFO:tasks.workunit.client.1.smithi161.stdout:8/81: symlink d2/l18 0 2023-12-09T02:35:06.138 INFO:tasks.workunit.client.1.smithi161.stdout:6/48: dwrite f3 [0,4194304] 0 2023-12-09T02:35:06.138 INFO:tasks.workunit.client.1.smithi161.stdout:6/49: write da/fc [594763,18374] 0 2023-12-09T02:35:06.138 INFO:tasks.workunit.client.1.smithi161.stdout:6/50: getdents da/df 0 2023-12-09T02:35:06.143 INFO:tasks.workunit.client.1.smithi161.stdout:6/51: creat da/f10 x:0 0 0 2023-12-09T02:35:06.143 INFO:tasks.workunit.client.1.smithi161.stdout:6/52: write f7 [539966,19705] 0 2023-12-09T02:35:06.145 INFO:tasks.workunit.client.1.smithi161.stdout:4/85: dwrite dd/f13 [0,4194304] 0 2023-12-09T02:35:06.145 INFO:tasks.workunit.client.1.smithi161.stdout:4/86: dread - f9 zero size 2023-12-09T02:35:06.145 INFO:tasks.workunit.client.1.smithi161.stdout:4/87: fdatasync dd/f13 0 2023-12-09T02:35:06.145 INFO:tasks.workunit.client.1.smithi161.stdout:6/53: link f3 da/df/f11 0 2023-12-09T02:35:06.145 INFO:tasks.workunit.client.1.smithi161.stdout:6/54: readlink l5 0 2023-12-09T02:35:06.149 INFO:tasks.workunit.client.1.smithi161.stdout:4/88: getdents dd/d1a/d1d 0 2023-12-09T02:35:06.150 INFO:tasks.workunit.client.1.smithi161.stdout:6/55: creat da/f12 x:0 0 0 2023-12-09T02:35:06.154 INFO:tasks.workunit.client.1.smithi161.stdout:6/56: link da/df/f11 da/df/f13 0 2023-12-09T02:35:06.157 INFO:tasks.workunit.client.1.smithi161.stdout:6/57: rmdir da/df 39 2023-12-09T02:35:06.160 INFO:tasks.workunit.client.1.smithi161.stdout:6/58: creat da/df/f14 x:0 0 0 2023-12-09T02:35:06.162 INFO:tasks.workunit.client.1.smithi161.stdout:4/89: write dd/f15 [3741602,52648] 0 2023-12-09T02:35:06.162 INFO:tasks.workunit.client.1.smithi161.stdout:8/82: dwrite d2/f17 [0,4194304] 0 2023-12-09T02:35:06.162 INFO:tasks.workunit.client.1.smithi161.stdout:6/59: rename f7 to da/f15 0 2023-12-09T02:35:06.162 INFO:tasks.workunit.client.1.smithi161.stdout:6/60: readlink l5 0 2023-12-09T02:35:06.162 INFO:tasks.workunit.client.1.smithi161.stdout:6/61: truncate da/df/f14 645531 0 2023-12-09T02:35:06.165 INFO:tasks.workunit.client.1.smithi161.stdout:6/62: fdatasync da/fc 0 2023-12-09T02:35:06.168 INFO:tasks.workunit.client.1.smithi161.stdout:8/83: mknod d2/c19 0 2023-12-09T02:35:06.171 INFO:tasks.workunit.client.1.smithi161.stdout:6/63: rename f0 to da/df/f16 0 2023-12-09T02:35:06.172 INFO:tasks.workunit.client.1.smithi161.stdout:8/84: dread d2/d5/fb [0,4194304] 0 2023-12-09T02:35:06.173 INFO:tasks.workunit.client.1.smithi161.stdout:4/90: truncate dd/f13 3680625 0 2023-12-09T02:35:06.173 INFO:tasks.workunit.client.1.smithi161.stdout:4/91: write dd/d1a/d1e/f21 [910826,46487] 0 2023-12-09T02:35:06.174 INFO:tasks.workunit.client.1.smithi161.stdout:4/92: fsync dd/f18 0 2023-12-09T02:35:06.176 INFO:tasks.workunit.client.1.smithi161.stdout:6/64: mknod da/df/c17 0 2023-12-09T02:35:06.178 INFO:tasks.workunit.client.1.smithi161.stdout:8/85: creat d2/d5/f1a x:0 0 0 2023-12-09T02:35:06.181 INFO:tasks.workunit.client.1.smithi161.stdout:4/93: getdents dd/d1a 0 2023-12-09T02:35:06.181 INFO:tasks.workunit.client.1.smithi161.stdout:4/94: write dd/d1a/d1e/f21 [978814,44365] 0 2023-12-09T02:35:06.184 INFO:tasks.workunit.client.1.smithi161.stdout:6/65: dread f3 [0,4194304] 0 2023-12-09T02:35:06.188 INFO:tasks.workunit.client.1.smithi161.stdout:6/66: mknod da/df/c18 0 2023-12-09T02:35:06.189 INFO:tasks.workunit.client.1.smithi161.stdout:8/86: getdents d2/d5 0 2023-12-09T02:35:06.192 INFO:tasks.workunit.client.1.smithi161.stdout:6/67: mkdir da/d19 0 2023-12-09T02:35:06.196 INFO:tasks.workunit.client.1.smithi161.stdout:8/87: dread d2/f3 [0,4194304] 0 2023-12-09T02:35:06.196 INFO:tasks.workunit.client.1.smithi161.stdout:8/88: fdatasync d2/f9 0 2023-12-09T02:35:06.196 INFO:tasks.workunit.client.1.smithi161.stdout:4/95: dwrite dd/d1a/f1c [0,4194304] 0 2023-12-09T02:35:06.197 INFO:tasks.workunit.client.1.smithi161.stdout:4/96: chown dd/d1a/d1e/f21 29218 1 2023-12-09T02:35:06.197 INFO:tasks.workunit.client.1.smithi161.stdout:4/97: truncate dd/f18 700346 0 2023-12-09T02:35:06.197 INFO:tasks.workunit.client.1.smithi161.stdout:4/98: write dd/d1a/d1e/f21 [915767,71737] 0 2023-12-09T02:35:06.199 INFO:tasks.workunit.client.1.smithi161.stdout:8/89: dread d2/d5/f16 [0,4194304] 0 2023-12-09T02:35:06.207 INFO:tasks.workunit.client.1.smithi161.stdout:8/90: symlink d2/l1b 0 2023-12-09T02:35:06.208 INFO:tasks.workunit.client.1.smithi161.stdout:8/91: symlink d2/l1c 0 2023-12-09T02:35:06.210 INFO:tasks.workunit.client.1.smithi161.stdout:8/92: creat d2/f1d x:0 0 0 2023-12-09T02:35:06.216 INFO:tasks.workunit.client.1.smithi161.stdout:4/99: dwrite dd/f18 [0,4194304] 0 2023-12-09T02:35:06.218 INFO:tasks.workunit.client.1.smithi161.stdout:5/66: sync 2023-12-09T02:35:06.218 INFO:tasks.workunit.client.1.smithi161.stdout:3/168: sync 2023-12-09T02:35:06.218 INFO:tasks.workunit.client.1.smithi161.stdout:2/85: sync 2023-12-09T02:35:06.218 INFO:tasks.workunit.client.1.smithi161.stdout:1/166: sync 2023-12-09T02:35:06.221 INFO:tasks.workunit.client.1.smithi161.stdout:4/100: mkdir dd/d1a/d23 0 2023-12-09T02:35:06.223 INFO:tasks.workunit.client.1.smithi161.stdout:5/67: mknod d0/d2/c17 0 2023-12-09T02:35:06.226 INFO:tasks.workunit.client.1.smithi161.stdout:3/169: creat d2/d4/d11/d19/f2e x:0 0 0 2023-12-09T02:35:06.226 INFO:tasks.workunit.client.1.smithi161.stdout:3/170: read - d2/d4/d11/d19/f2e zero size 2023-12-09T02:35:06.226 INFO:tasks.workunit.client.1.smithi161.stdout:3/171: write d2/d4/d11/d28/f22 [916354,71824] 0 2023-12-09T02:35:06.226 INFO:tasks.workunit.client.1.smithi161.stdout:3/172: chown d2/d4/lf 1155 1 2023-12-09T02:35:06.227 INFO:tasks.workunit.client.1.smithi161.stdout:8/93: dwrite d2/f9 [0,4194304] 0 2023-12-09T02:35:06.227 INFO:tasks.workunit.client.1.smithi161.stdout:2/86: mknod d4/d1a/c1c 0 2023-12-09T02:35:06.228 INFO:tasks.workunit.client.1.smithi161.stdout:1/167: symlink d6/d27/l36 0 2023-12-09T02:35:06.228 INFO:tasks.workunit.client.1.smithi161.stdout:1/168: chown d6/d8/da/dd/f21 62903 1 2023-12-09T02:35:06.228 INFO:tasks.workunit.client.1.smithi161.stdout:3/173: write d2/d4/f23 [1882461,129467] 0 2023-12-09T02:35:06.229 INFO:tasks.workunit.client.1.smithi161.stdout:5/68: creat d0/f18 x:0 0 0 2023-12-09T02:35:06.230 INFO:tasks.workunit.client.1.smithi161.stdout:4/101: dread dd/d1a/d1e/f21 [0,4194304] 0 2023-12-09T02:35:06.232 INFO:tasks.workunit.client.1.smithi161.stdout:8/94: mknod d2/d5/c1e 0 2023-12-09T02:35:06.236 INFO:tasks.workunit.client.1.smithi161.stdout:1/169: mknod d6/c37 0 2023-12-09T02:35:06.236 INFO:tasks.workunit.client.1.smithi161.stdout:1/170: fsync d6/d8/da/dd/f16 0 2023-12-09T02:35:06.236 INFO:tasks.workunit.client.1.smithi161.stdout:1/171: stat d6/d8/da/dd/fe 0 2023-12-09T02:35:06.237 INFO:tasks.workunit.client.1.smithi161.stdout:2/87: rmdir d4/d1a 39 2023-12-09T02:35:06.239 INFO:tasks.workunit.client.1.smithi161.stdout:3/174: creat d2/d4/d11/d1f/d2a/f2f x:0 0 0 2023-12-09T02:35:06.239 INFO:tasks.workunit.client.1.smithi161.stdout:2/88: write d4/d7/db/f19 [2000745,18111] 0 2023-12-09T02:35:06.239 INFO:tasks.workunit.client.1.smithi161.stdout:3/175: chown d2/d4/lf 29869 1 2023-12-09T02:35:06.239 INFO:tasks.workunit.client.1.smithi161.stdout:3/176: stat d2/d4/f5 0 2023-12-09T02:35:06.239 INFO:tasks.workunit.client.1.smithi161.stdout:3/177: chown d2/d4/l8 79131504 1 2023-12-09T02:35:06.241 INFO:tasks.workunit.client.1.smithi161.stdout:3/178: fdatasync d2/d4/f23 0 2023-12-09T02:35:06.241 INFO:tasks.workunit.client.1.smithi161.stdout:5/69: symlink d0/l19 0 2023-12-09T02:35:06.242 INFO:tasks.workunit.client.1.smithi161.stdout:4/102: rename dd/l17 to dd/d1a/d1e/l24 0 2023-12-09T02:35:06.243 INFO:tasks.workunit.client.1.smithi161.stdout:5/70: write d0/f1 [3499867,104894] 0 2023-12-09T02:35:06.244 INFO:tasks.workunit.client.1.smithi161.stdout:5/71: write d0/d2/f3 [5868764,113432] 0 2023-12-09T02:35:06.244 INFO:tasks.workunit.client.1.smithi161.stdout:1/172: rmdir d6/d9 39 2023-12-09T02:35:06.246 INFO:tasks.workunit.client.1.smithi161.stdout:8/95: rename d2/c19 to d2/d5/c1f 0 2023-12-09T02:35:06.249 INFO:tasks.workunit.client.1.smithi161.stdout:4/103: mkdir dd/d1a/d1d/d25 0 2023-12-09T02:35:06.249 INFO:tasks.workunit.client.1.smithi161.stdout:4/104: write f7 [1264963,92958] 0 2023-12-09T02:35:06.250 INFO:tasks.workunit.client.1.smithi161.stdout:5/72: creat d0/f1a x:0 0 0 2023-12-09T02:35:06.250 INFO:tasks.workunit.client.1.smithi161.stdout:5/73: readlink d0/d9/l15 0 2023-12-09T02:35:06.252 INFO:tasks.workunit.client.1.smithi161.stdout:3/179: dread d2/d4/f23 [0,4194304] 0 2023-12-09T02:35:06.252 INFO:tasks.workunit.client.1.smithi161.stdout:1/173: creat d6/f38 x:0 0 0 2023-12-09T02:35:06.253 INFO:tasks.workunit.client.1.smithi161.stdout:2/89: rename d4/d16/f18 to d4/d7/db/f1d 0 2023-12-09T02:35:06.256 INFO:tasks.workunit.client.1.smithi161.stdout:4/105: mkdir dd/d26 0 2023-12-09T02:35:06.256 INFO:tasks.workunit.client.1.smithi161.stdout:4/106: truncate dd/f15 9191554 0 2023-12-09T02:35:06.257 INFO:tasks.workunit.client.1.smithi161.stdout:5/74: creat d0/d2/f1b x:0 0 0 2023-12-09T02:35:06.257 INFO:tasks.workunit.client.1.smithi161.stdout:5/75: getdents d0/d2/d14 0 2023-12-09T02:35:06.259 INFO:tasks.workunit.client.1.smithi161.stdout:1/174: truncate d6/d9/f29 545791 0 2023-12-09T02:35:06.259 INFO:tasks.workunit.client.1.smithi161.stdout:1/175: chown d6/d8/f30 69324876 1 2023-12-09T02:35:06.261 INFO:tasks.workunit.client.1.smithi161.stdout:3/180: rename d2/d4/l17 to d2/l30 0 2023-12-09T02:35:06.262 INFO:tasks.workunit.client.1.smithi161.stdout:2/90: rmdir d4/d7/db 39 2023-12-09T02:35:06.264 INFO:tasks.workunit.client.1.smithi161.stdout:5/76: rename d0/d9/l10 to d0/d9/l1c 0 2023-12-09T02:35:06.265 INFO:tasks.workunit.client.1.smithi161.stdout:1/176: mknod d6/d8/c39 0 2023-12-09T02:35:06.265 INFO:tasks.workunit.client.1.smithi161.stdout:1/177: chown d6/d9/l32 14692 1 2023-12-09T02:35:06.265 INFO:tasks.workunit.client.1.smithi161.stdout:1/178: chown d6/d27/d31 5400 1 2023-12-09T02:35:06.266 INFO:tasks.workunit.client.1.smithi161.stdout:4/107: rename dd/c12 to dd/d1a/d1d/d25/c27 0 2023-12-09T02:35:06.267 INFO:tasks.workunit.client.1.smithi161.stdout:2/91: creat d4/d16/f1e x:0 0 0 2023-12-09T02:35:06.267 INFO:tasks.workunit.client.1.smithi161.stdout:2/92: write d4/d7/db/f10 [914141,6256] 0 2023-12-09T02:35:06.268 INFO:tasks.workunit.client.1.smithi161.stdout:5/77: symlink d0/d2/de/l1d 0 2023-12-09T02:35:06.268 INFO:tasks.workunit.client.1.smithi161.stdout:5/78: chown d0/d9/l1c 0 1 2023-12-09T02:35:06.270 INFO:tasks.workunit.client.1.smithi161.stdout:3/181: rename l1 to d2/d4/l31 0 2023-12-09T02:35:06.271 INFO:tasks.workunit.client.1.smithi161.stdout:4/108: rmdir dd/d1a/d1d 39 2023-12-09T02:35:06.271 INFO:tasks.workunit.client.1.smithi161.stdout:4/109: chown dd/d1a/d1d 0 1 2023-12-09T02:35:06.272 INFO:tasks.workunit.client.1.smithi161.stdout:2/93: link d4/d7/db/f19 d4/d1a/f1f 0 2023-12-09T02:35:06.276 INFO:tasks.workunit.client.1.smithi161.stdout:4/110: symlink dd/d1a/d23/l28 0 2023-12-09T02:35:06.276 INFO:tasks.workunit.client.1.smithi161.stdout:1/179: write d6/d9/f29 [1492488,21590] 0 2023-12-09T02:35:06.280 INFO:tasks.workunit.client.1.smithi161.stdout:4/111: dread f7 [0,4194304] 0 2023-12-09T02:35:06.283 INFO:tasks.workunit.client.1.smithi161.stdout:4/112: mkdir dd/d1a/d29 0 2023-12-09T02:35:06.283 INFO:tasks.workunit.client.1.smithi161.stdout:4/113: fsync dd/f18 0 2023-12-09T02:35:06.283 INFO:tasks.workunit.client.1.smithi161.stdout:4/114: fdatasync dd/f19 0 2023-12-09T02:35:06.286 INFO:tasks.workunit.client.1.smithi161.stdout:4/115: mknod dd/d1a/c2a 0 2023-12-09T02:35:06.297 INFO:tasks.workunit.client.1.smithi161.stdout:1/180: dwrite d6/d8/da/dd/f16 [0,4194304] 0 2023-12-09T02:35:06.317 INFO:tasks.workunit.client.1.smithi161.stdout:4/116: dwrite dd/f18 [0,4194304] 0 2023-12-09T02:35:06.318 INFO:tasks.workunit.client.1.smithi161.stdout:2/94: dwrite d4/fa [0,4194304] 0 2023-12-09T02:35:06.318 INFO:tasks.workunit.client.1.smithi161.stdout:1/181: dwrite f5 [0,4194304] 0 2023-12-09T02:35:06.318 INFO:tasks.workunit.client.1.smithi161.stdout:2/95: stat d4/d7/db/f10 0 2023-12-09T02:35:06.319 INFO:tasks.workunit.client.1.smithi161.stdout:2/96: fdatasync d4/fa 0 2023-12-09T02:35:06.319 INFO:tasks.workunit.client.1.smithi161.stdout:1/182: read f5 [3862618,27434] 0 2023-12-09T02:35:06.319 INFO:tasks.workunit.client.1.smithi161.stdout:4/117: dread dd/f19 [0,4194304] 0 2023-12-09T02:35:06.320 INFO:tasks.workunit.client.1.smithi161.stdout:4/118: write dd/f15 [7205774,35274] 0 2023-12-09T02:35:06.320 INFO:tasks.workunit.client.1.smithi161.stdout:1/183: creat d6/d27/d31/f3a x:0 0 0 2023-12-09T02:35:06.321 INFO:tasks.workunit.client.1.smithi161.stdout:2/97: fsync d4/d1a/f1f 0 2023-12-09T02:35:06.323 INFO:tasks.workunit.client.1.smithi161.stdout:2/98: creat d4/f20 x:0 0 0 2023-12-09T02:35:06.325 INFO:tasks.workunit.client.1.smithi161.stdout:2/99: symlink d4/d1a/l21 0 2023-12-09T02:35:06.325 INFO:tasks.workunit.client.1.smithi161.stdout:2/100: getdents d4/d7 0 2023-12-09T02:35:06.327 INFO:tasks.workunit.client.1.smithi161.stdout:2/101: creat d4/d7/db/f22 x:0 0 0 2023-12-09T02:35:06.334 INFO:tasks.workunit.client.1.smithi161.stdout:1/184: dread d6/d8/da/dd/f16 [0,4194304] 0 2023-12-09T02:35:06.335 INFO:tasks.workunit.client.1.smithi161.stdout:1/185: creat d6/d27/f3b x:0 0 0 2023-12-09T02:35:06.337 INFO:tasks.workunit.client.1.smithi161.stdout:1/186: dread d6/d8/da/dd/d11/d1c/f1f [0,4194304] 0 2023-12-09T02:35:06.338 INFO:tasks.workunit.client.1.smithi161.stdout:1/187: link d6/d8/da/dd/d11/d1c/f1f d6/d8/da/dd/d11/d35/f3c 0 2023-12-09T02:35:06.338 INFO:tasks.workunit.client.1.smithi161.stdout:4/119: dwrite f8 [0,4194304] 0 2023-12-09T02:35:06.339 INFO:tasks.workunit.client.1.smithi161.stdout:1/188: mkdir d6/d8/da/dd/d11/d35/d3d 0 2023-12-09T02:35:06.343 INFO:tasks.workunit.client.1.smithi161.stdout:4/120: unlink dd/l1f 0 2023-12-09T02:35:06.343 INFO:tasks.workunit.client.1.smithi161.stdout:4/121: fdatasync dd/f18 0 2023-12-09T02:35:06.354 INFO:tasks.workunit.client.1.smithi161.stdout:2/102: dwrite d4/d7/f15 [0,4194304] 0 2023-12-09T02:35:06.355 INFO:tasks.workunit.client.1.smithi161.stdout:2/103: truncate d4/d7/db/f1d 918532 0 2023-12-09T02:35:06.355 INFO:tasks.workunit.client.1.smithi161.stdout:1/189: dwrite d6/d27/d31/f3a [0,4194304] 0 2023-12-09T02:35:06.355 INFO:tasks.workunit.client.1.smithi161.stdout:1/190: readlink d6/d8/da/dd/l13 0 2023-12-09T02:35:06.357 INFO:tasks.workunit.client.1.smithi161.stdout:4/122: dread dd/d1a/f1c [0,4194304] 0 2023-12-09T02:35:06.358 INFO:tasks.workunit.client.1.smithi161.stdout:2/104: dread f1 [0,4194304] 0 2023-12-09T02:35:06.360 INFO:tasks.workunit.client.1.smithi161.stdout:4/123: read f8 [2314426,79765] 0 2023-12-09T02:35:06.361 INFO:tasks.workunit.client.1.smithi161.stdout:1/191: dread d6/d8/da/dd/f16 [0,4194304] 0 2023-12-09T02:35:06.361 INFO:tasks.workunit.client.1.smithi161.stdout:1/192: write d6/d8/da/dd/f14 [407629,82577] 0 2023-12-09T02:35:06.361 INFO:tasks.workunit.client.1.smithi161.stdout:2/105: mknod d4/d7/db/c23 0 2023-12-09T02:35:06.364 INFO:tasks.workunit.client.1.smithi161.stdout:4/124: creat dd/d1a/d1e/f2b x:0 0 0 2023-12-09T02:35:06.364 INFO:tasks.workunit.client.1.smithi161.stdout:4/125: read dd/f18 [628709,8083] 0 2023-12-09T02:35:06.370 INFO:tasks.workunit.client.1.smithi161.stdout:1/193: unlink d6/d9/f29 0 2023-12-09T02:35:06.373 INFO:tasks.workunit.client.1.smithi161.stdout:2/106: creat d4/d7/db/f24 x:0 0 0 2023-12-09T02:35:06.373 INFO:tasks.workunit.client.1.smithi161.stdout:2/107: read - d4/d7/fc zero size 2023-12-09T02:35:06.373 INFO:tasks.workunit.client.1.smithi161.stdout:2/108: getdents d4/d7 0 2023-12-09T02:35:06.373 INFO:tasks.workunit.client.1.smithi161.stdout:2/109: chown d4/fe 9608 1 2023-12-09T02:35:06.373 INFO:tasks.workunit.client.1.smithi161.stdout:2/110: write d4/d7/db/f24 [871386,53423] 0 2023-12-09T02:35:06.373 INFO:tasks.workunit.client.1.smithi161.stdout:2/111: write d4/d7/fc [617125,114862] 0 2023-12-09T02:35:06.377 INFO:tasks.workunit.client.1.smithi161.stdout:4/126: dwrite dd/d1a/d1e/f2b [0,4194304] 0 2023-12-09T02:35:06.377 INFO:tasks.workunit.client.1.smithi161.stdout:1/194: getdents d6/d8/da/dd 0 2023-12-09T02:35:06.393 INFO:tasks.workunit.client.1.smithi161.stdout:4/127: dwrite dd/d1a/f1c [0,4194304] 0 2023-12-09T02:35:06.396 INFO:tasks.workunit.client.1.smithi161.stdout:1/195: creat d6/d8/da/dd/d11/d35/d3d/f3e x:0 0 0 2023-12-09T02:35:06.396 INFO:tasks.workunit.client.1.smithi161.stdout:1/196: chown d6/d9/f19 2356 1 2023-12-09T02:35:06.396 INFO:tasks.workunit.client.1.smithi161.stdout:1/197: chown d6/d27/d31 1 1 2023-12-09T02:35:06.396 INFO:tasks.workunit.client.1.smithi161.stdout:1/198: write d6/d8/da/dd/d11/d35/f3c [1400919,106710] 0 2023-12-09T02:35:06.409 INFO:tasks.workunit.client.1.smithi161.stdout:1/199: symlink d6/d9/l3f 0 2023-12-09T02:35:06.409 INFO:tasks.workunit.client.1.smithi161.stdout:1/200: dread - d6/d27/f3b zero size 2023-12-09T02:35:06.409 INFO:tasks.workunit.client.1.smithi161.stdout:1/201: rename d6 to d6/d40 22 2023-12-09T02:35:06.409 INFO:tasks.workunit.client.1.smithi161.stdout:1/202: write d6/d8/da/dd/d11/d35/d3d/f3e [87079,73119] 0 2023-12-09T02:35:06.409 INFO:tasks.workunit.client.1.smithi161.stdout:1/203: stat d6/d27/d31/f3a 0 2023-12-09T02:35:06.410 INFO:tasks.workunit.client.1.smithi161.stdout:1/204: dread d6/d8/da/dd/d11/d1c/f1e [0,4194304] 0 2023-12-09T02:35:06.410 INFO:tasks.workunit.client.1.smithi161.stdout:1/205: readlink d6/d8/da/l15 0 2023-12-09T02:35:06.411 INFO:tasks.workunit.client.1.smithi161.stdout:1/206: fdatasync d6/d8/da/dd/d11/d35/f3c 0 2023-12-09T02:35:06.519 INFO:tasks.workunit.client.1.smithi161.stdout:7/151: sync 2023-12-09T02:35:06.519 INFO:tasks.workunit.client.1.smithi161.stdout:7/152: truncate d0/d3/f8 1199606 0 2023-12-09T02:35:06.523 INFO:tasks.workunit.client.1.smithi161.stdout:7/153: link d0/d3/f17 d0/d29/f2e 0 2023-12-09T02:35:06.525 INFO:tasks.workunit.client.1.smithi161.stdout:7/154: mkdir d0/d3/d13/d2f 0 2023-12-09T02:35:06.593 INFO:tasks.workunit.client.1.smithi161.stdout:7/155: mknod d0/d3/d13/d2d/c30 0 2023-12-09T02:35:06.599 INFO:tasks.workunit.client.1.smithi161.stdout:7/156: mkdir d0/d3/d21/d31 0 2023-12-09T02:35:06.605 INFO:tasks.workunit.client.1.smithi161.stdout:7/157: link d0/d3/db/f20 d0/d29/f32 0 2023-12-09T02:35:06.605 INFO:tasks.workunit.client.1.smithi161.stdout:7/158: readlink d0/d3/d13/l28 0 2023-12-09T02:35:06.605 INFO:tasks.workunit.client.1.smithi161.stdout:7/159: mknod d0/d3/c33 0 2023-12-09T02:35:06.607 INFO:tasks.workunit.client.1.smithi161.stdout:7/160: getdents d0 0 2023-12-09T02:35:06.607 INFO:tasks.workunit.client.1.smithi161.stdout:7/161: readlink d0/d3/d13/l28 0 2023-12-09T02:35:06.621 INFO:tasks.workunit.client.1.smithi161.stdout:7/162: dread d0/d3/d13/d1b/f2b [0,4194304] 0 2023-12-09T02:35:06.624 INFO:tasks.workunit.client.1.smithi161.stdout:7/163: creat d0/d3/d13/f34 x:0 0 0 2023-12-09T02:35:06.624 INFO:tasks.workunit.client.1.smithi161.stdout:7/164: dread - d0/d3/f25 zero size 2023-12-09T02:35:06.627 INFO:tasks.workunit.client.1.smithi161.stdout:7/165: unlink d0/c1d 0 2023-12-09T02:35:06.627 INFO:tasks.workunit.client.1.smithi161.stdout:7/166: chown d0/d3/d13/l14 114 1 2023-12-09T02:35:06.627 INFO:tasks.workunit.client.1.smithi161.stdout:7/167: dread - d0/d3/d13/f22 zero size 2023-12-09T02:35:06.627 INFO:tasks.workunit.client.1.smithi161.stdout:7/168: stat d0/d29 0 2023-12-09T02:35:06.641 INFO:tasks.workunit.client.1.smithi161.stdout:9/125: sync 2023-12-09T02:35:06.643 INFO:tasks.workunit.client.1.smithi161.stdout:9/126: mkdir d2/d25/d26 0 2023-12-09T02:35:06.646 INFO:tasks.workunit.client.1.smithi161.stdout:9/127: rmdir d2/d25/d26 0 2023-12-09T02:35:06.647 INFO:tasks.workunit.client.1.smithi161.stdout:7/169: dread d0/d3/d13/f1f [0,4194304] 0 2023-12-09T02:35:06.649 INFO:tasks.workunit.client.1.smithi161.stdout:9/128: creat d2/da/f27 x:0 0 0 2023-12-09T02:35:06.652 INFO:tasks.workunit.client.1.smithi161.stdout:9/129: link d2/da/l1f d2/d25/l28 0 2023-12-09T02:35:06.656 INFO:tasks.workunit.client.1.smithi161.stdout:9/130: symlink d2/l29 0 2023-12-09T02:35:06.668 INFO:tasks.workunit.client.1.smithi161.stdout:7/170: dwrite d0/d3/d13/f34 [0,4194304] 0 2023-12-09T02:35:06.676 INFO:tasks.workunit.client.1.smithi161.stdout:9/131: dwrite d2/da/f27 [0,4194304] 0 2023-12-09T02:35:06.680 INFO:tasks.workunit.client.1.smithi161.stdout:9/132: link d2/da/l1c d2/da/l2a 0 2023-12-09T02:35:06.680 INFO:tasks.workunit.client.1.smithi161.stdout:9/133: readlink d2/da/l1f 0 2023-12-09T02:35:06.682 INFO:tasks.workunit.client.1.smithi161.stdout:9/134: mknod d2/da/d22/c2b 0 2023-12-09T02:35:06.682 INFO:tasks.workunit.client.1.smithi161.stdout:9/135: fdatasync d2/da/f21 0 2023-12-09T02:35:06.692 INFO:tasks.workunit.client.1.smithi161.stdout:9/136: read d2/da/f27 [3518170,122739] 0 2023-12-09T02:35:06.692 INFO:tasks.workunit.client.1.smithi161.stdout:9/137: write d2/da/f1e [52647,17228] 0 2023-12-09T02:35:06.692 INFO:tasks.workunit.client.1.smithi161.stdout:9/138: write d2/da/f21 [4715442,87625] 0 2023-12-09T02:35:06.692 INFO:tasks.workunit.client.1.smithi161.stdout:9/139: readlink d2/da/l18 0 2023-12-09T02:35:06.697 INFO:tasks.workunit.client.1.smithi161.stdout:9/140: mknod d2/da/c2c 0 2023-12-09T02:35:06.700 INFO:tasks.workunit.client.1.smithi161.stdout:7/171: truncate d0/d3/d13/f34 2530898 0 2023-12-09T02:35:06.704 INFO:tasks.workunit.client.1.smithi161.stdout:7/172: unlink d0/d3/f9 0 2023-12-09T02:35:06.704 INFO:tasks.workunit.client.1.smithi161.stdout:7/173: dread - d0/d3/d13/f22 zero size 2023-12-09T02:35:06.704 INFO:tasks.workunit.client.1.smithi161.stdout:7/174: dread - d0/d3/d13/f18 zero size 2023-12-09T02:35:06.704 INFO:tasks.workunit.client.1.smithi161.stdout:7/175: dread - d0/d3/d13/f26 zero size 2023-12-09T02:35:06.705 INFO:tasks.workunit.client.1.smithi161.stdout:7/176: creat d0/d3/d13/d2d/f35 x:0 0 0 2023-12-09T02:35:06.708 INFO:tasks.workunit.client.1.smithi161.stdout:7/177: unlink d0/c2c 0 2023-12-09T02:35:06.708 INFO:tasks.workunit.client.1.smithi161.stdout:7/178: dread - d0/d3/d13/f26 zero size 2023-12-09T02:35:06.711 INFO:tasks.workunit.client.1.smithi161.stdout:7/179: rmdir d0/d3/d21/d31 0 2023-12-09T02:35:06.712 INFO:tasks.workunit.client.1.smithi161.stdout:7/180: read d0/d3/f7 [2457771,85146] 0 2023-12-09T02:35:06.714 INFO:tasks.workunit.client.1.smithi161.stdout:7/181: mknod d0/d3/c36 0 2023-12-09T02:35:06.716 INFO:tasks.workunit.client.1.smithi161.stdout:9/141: dwrite d2/da/f10 [4194304,4194304] 0 2023-12-09T02:35:06.717 INFO:tasks.workunit.client.1.smithi161.stdout:7/182: dread d0/d3/f17 [0,4194304] 0 2023-12-09T02:35:06.717 INFO:tasks.workunit.client.1.smithi161.stdout:7/183: write d0/d3/f17 [199750,65193] 0 2023-12-09T02:35:06.717 INFO:tasks.workunit.client.1.smithi161.stdout:7/184: stat d0/fd 0 2023-12-09T02:35:06.717 INFO:tasks.workunit.client.1.smithi161.stdout:7/185: dread - d0/d3/d13/f1e zero size 2023-12-09T02:35:06.720 INFO:tasks.workunit.client.1.smithi161.stdout:9/142: creat d2/da/d22/f2d x:0 0 0 2023-12-09T02:35:06.722 INFO:tasks.workunit.client.1.smithi161.stdout:7/186: creat d0/d3/d13/d1b/f37 x:0 0 0 2023-12-09T02:35:06.723 INFO:tasks.workunit.client.1.smithi161.stdout:7/187: symlink d0/l38 0 2023-12-09T02:35:06.723 INFO:tasks.workunit.client.1.smithi161.stdout:7/188: chown d0/d3/f8 95351 1 2023-12-09T02:35:06.723 INFO:tasks.workunit.client.1.smithi161.stdout:7/189: getdents d0/d3/d13/d2f 0 2023-12-09T02:35:06.725 INFO:tasks.workunit.client.1.smithi161.stdout:7/190: creat d0/d3/d13/d2d/f39 x:0 0 0 2023-12-09T02:35:06.725 INFO:tasks.workunit.client.1.smithi161.stdout:7/191: dread - d0/d3/d13/d1b/f37 zero size 2023-12-09T02:35:06.725 INFO:tasks.workunit.client.1.smithi161.stdout:7/192: dread - d0/d3/d13/d2d/f39 zero size 2023-12-09T02:35:06.727 INFO:tasks.workunit.client.1.smithi161.stdout:7/193: link d0/fc d0/d3/d13/d2f/f3a 0 2023-12-09T02:35:06.727 INFO:tasks.workunit.client.1.smithi161.stdout:7/194: read d0/d29/f2e [293657,57428] 0 2023-12-09T02:35:06.728 INFO:tasks.workunit.client.1.smithi161.stdout:9/143: dread d2/f8 [0,4194304] 0 2023-12-09T02:35:06.731 INFO:tasks.workunit.client.1.smithi161.stdout:9/144: rmdir d2/d25 39 2023-12-09T02:35:06.733 INFO:tasks.workunit.client.1.smithi161.stdout:9/145: dread d2/f19 [0,4194304] 0 2023-12-09T02:35:06.733 INFO:tasks.workunit.client.1.smithi161.stdout:4/128: sync 2023-12-09T02:35:06.733 INFO:tasks.workunit.client.1.smithi161.stdout:1/207: sync 2023-12-09T02:35:06.733 INFO:tasks.workunit.client.1.smithi161.stdout:0/111: sync 2023-12-09T02:35:06.733 INFO:tasks.workunit.client.1.smithi161.stdout:2/112: sync 2023-12-09T02:35:06.734 INFO:tasks.workunit.client.1.smithi161.stdout:2/113: chown d4/d1a 0 1 2023-12-09T02:35:06.734 INFO:tasks.workunit.client.1.smithi161.stdout:8/96: sync 2023-12-09T02:35:06.734 INFO:tasks.workunit.client.1.smithi161.stdout:3/182: sync 2023-12-09T02:35:06.734 INFO:tasks.workunit.client.1.smithi161.stdout:6/68: sync 2023-12-09T02:35:06.734 INFO:tasks.workunit.client.1.smithi161.stdout:5/79: sync 2023-12-09T02:35:06.734 INFO:tasks.workunit.client.1.smithi161.stdout:3/183: stat d2/d4/d2c/c24 0 2023-12-09T02:35:06.734 INFO:tasks.workunit.client.1.smithi161.stdout:9/146: mkdir d2/da/d16/d2e 0 2023-12-09T02:35:06.735 INFO:tasks.workunit.client.1.smithi161.stdout:1/208: dread d6/d8/da/dd/d11/d35/d3d/f3e [0,4194304] 0 2023-12-09T02:35:06.735 INFO:tasks.workunit.client.1.smithi161.stdout:1/209: fsync d6/d8/da/dd/fe 0 2023-12-09T02:35:06.737 INFO:tasks.workunit.client.1.smithi161.stdout:4/129: symlink dd/d1a/l2c 0 2023-12-09T02:35:06.738 INFO:tasks.workunit.client.1.smithi161.stdout:7/195: rmdir d0/d3 39 2023-12-09T02:35:06.739 INFO:tasks.workunit.client.1.smithi161.stdout:0/112: dread f6 [0,4194304] 0 2023-12-09T02:35:06.741 INFO:tasks.workunit.client.1.smithi161.stdout:2/114: rename d4/d1a/f1f to d4/f25 0 2023-12-09T02:35:06.741 INFO:tasks.workunit.client.1.smithi161.stdout:2/115: write d4/d1a/f1b [856104,64781] 0 2023-12-09T02:35:06.746 INFO:tasks.workunit.client.1.smithi161.stdout:0/113: dread f1 [0,4194304] 0 2023-12-09T02:35:06.746 INFO:tasks.workunit.client.1.smithi161.stdout:8/97: creat d2/d5/f20 x:0 0 0 2023-12-09T02:35:06.746 INFO:tasks.workunit.client.1.smithi161.stdout:8/98: write d2/d5/fa [1026182,22252] 0 2023-12-09T02:35:06.746 INFO:tasks.workunit.client.1.smithi161.stdout:6/69: getdents da/df 0 2023-12-09T02:35:06.748 INFO:tasks.workunit.client.1.smithi161.stdout:5/80: link d0/d9/l1c d0/d2/d7/d11/l1e 0 2023-12-09T02:35:06.749 INFO:tasks.workunit.client.1.smithi161.stdout:5/81: write d0/d2/fc [4629889,10621] 0 2023-12-09T02:35:06.751 INFO:tasks.workunit.client.1.smithi161.stdout:3/184: creat d2/d4/d11/f32 x:0 0 0 2023-12-09T02:35:06.755 INFO:tasks.workunit.client.1.smithi161.stdout:4/130: dwrite dd/fe [0,4194304] 0 2023-12-09T02:35:06.756 INFO:tasks.workunit.client.1.smithi161.stdout:7/196: truncate d0/fc 927198 0 2023-12-09T02:35:06.758 INFO:tasks.workunit.client.1.smithi161.stdout:0/114: rename d9/dd/d17 to d9/d1f 0 2023-12-09T02:35:06.758 INFO:tasks.workunit.client.1.smithi161.stdout:8/99: truncate d2/f6 2529542 0 2023-12-09T02:35:06.759 INFO:tasks.workunit.client.1.smithi161.stdout:8/100: chown d2/d5/f16 45691 1 2023-12-09T02:35:06.760 INFO:tasks.workunit.client.1.smithi161.stdout:2/116: dread d4/fe [0,4194304] 0 2023-12-09T02:35:06.760 INFO:tasks.workunit.client.1.smithi161.stdout:3/185: symlink d2/d4/d11/l33 0 2023-12-09T02:35:06.765 INFO:tasks.workunit.client.1.smithi161.stdout:0/115: creat d9/f20 x:0 0 0 2023-12-09T02:35:06.769 INFO:tasks.workunit.client.1.smithi161.stdout:4/131: getdents dd/d1a 0 2023-12-09T02:35:06.770 INFO:tasks.workunit.client.1.smithi161.stdout:2/117: unlink d4/d7/db/f22 0 2023-12-09T02:35:06.773 INFO:tasks.workunit.client.1.smithi161.stdout:1/210: dwrite d6/d8/da/dd/d11/d35/f3c [0,4194304] 0 2023-12-09T02:35:06.773 INFO:tasks.workunit.client.1.smithi161.stdout:4/132: mknod dd/d1a/d29/c2d 0 2023-12-09T02:35:06.773 INFO:tasks.workunit.client.1.smithi161.stdout:7/197: dread d0/d3/d13/f1f [0,4194304] 0 2023-12-09T02:35:06.773 INFO:tasks.workunit.client.1.smithi161.stdout:7/198: write d0/d3/f17 [997564,79980] 0 2023-12-09T02:35:06.774 INFO:tasks.workunit.client.1.smithi161.stdout:2/118: creat d4/d16/f26 x:0 0 0 2023-12-09T02:35:06.774 INFO:tasks.workunit.client.1.smithi161.stdout:2/119: chown d4/d7/c8 9 1 2023-12-09T02:35:06.774 INFO:tasks.workunit.client.1.smithi161.stdout:2/120: readlink d4/d1a/l21 0 2023-12-09T02:35:06.775 INFO:tasks.workunit.client.1.smithi161.stdout:8/101: getdents d2/d5 0 2023-12-09T02:35:06.775 INFO:tasks.workunit.client.1.smithi161.stdout:8/102: readlink d2/l1b 0 2023-12-09T02:35:06.780 INFO:tasks.workunit.client.1.smithi161.stdout:0/116: dread f1 [4194304,4194304] 0 2023-12-09T02:35:06.787 INFO:tasks.workunit.client.1.smithi161.stdout:2/121: write d4/d7/f15 [3413629,99953] 0 2023-12-09T02:35:06.787 INFO:tasks.workunit.client.1.smithi161.stdout:4/133: symlink dd/d1a/d1d/l2e 0 2023-12-09T02:35:06.788 INFO:tasks.workunit.client.1.smithi161.stdout:1/211: creat d6/d8/da/dd/d11/d1c/f41 x:0 0 0 2023-12-09T02:35:06.788 INFO:tasks.workunit.client.1.smithi161.stdout:1/212: rename d6/d8 to d6/d8/da/d42 22 2023-12-09T02:35:06.789 INFO:tasks.workunit.client.1.smithi161.stdout:6/70: dwrite da/df/f11 [4194304,4194304] 0 2023-12-09T02:35:06.792 INFO:tasks.workunit.client.1.smithi161.stdout:5/82: dwrite d0/f1 [4194304,4194304] 0 2023-12-09T02:35:06.797 INFO:tasks.workunit.client.1.smithi161.stdout:3/186: dwrite d2/d4/d11/d1f/f25 [0,4194304] 0 2023-12-09T02:35:06.798 INFO:tasks.workunit.client.1.smithi161.stdout:8/103: dwrite d2/d5/f16 [0,4194304] 0 2023-12-09T02:35:06.798 INFO:tasks.workunit.client.1.smithi161.stdout:8/104: dread - d2/d5/f1a zero size 2023-12-09T02:35:06.798 INFO:tasks.workunit.client.1.smithi161.stdout:8/105: readlink d2/d5/le 0 2023-12-09T02:35:06.798 INFO:tasks.workunit.client.1.smithi161.stdout:8/106: chown d2/d5/f1a 1 1 2023-12-09T02:35:06.798 INFO:tasks.workunit.client.1.smithi161.stdout:8/107: write d2/d5/fa [494576,72682] 0 2023-12-09T02:35:06.798 INFO:tasks.workunit.client.1.smithi161.stdout:8/108: truncate d2/fc 5081495 0 2023-12-09T02:35:06.802 INFO:tasks.workunit.client.1.smithi161.stdout:5/83: dread d0/d2/f3 [0,4194304] 0 2023-12-09T02:35:06.805 INFO:tasks.workunit.client.1.smithi161.stdout:5/84: dread d0/d2/f3 [0,4194304] 0 2023-12-09T02:35:06.824 INFO:tasks.workunit.client.1.smithi161.stdout:5/85: dwrite d0/d2/f16 [4194304,4194304] 0 2023-12-09T02:35:06.826 INFO:tasks.workunit.client.1.smithi161.stdout:7/199: link d0/d3/d13/f18 d0/d3/d21/f3b 0 2023-12-09T02:35:06.827 INFO:tasks.workunit.client.1.smithi161.stdout:0/117: mkdir d9/dd/d21 0 2023-12-09T02:35:06.831 INFO:tasks.workunit.client.1.smithi161.stdout:2/122: mknod d4/d1a/c27 0 2023-12-09T02:35:06.831 INFO:tasks.workunit.client.1.smithi161.stdout:2/123: chown d4/fa 4059 1 2023-12-09T02:35:06.831 INFO:tasks.workunit.client.1.smithi161.stdout:2/124: readlink d4/d7/db/l12 0 2023-12-09T02:35:06.843 INFO:tasks.workunit.client.1.smithi161.stdout:2/125: dwrite d4/d7/db/f10 [0,4194304] 0 2023-12-09T02:35:06.907 INFO:tasks.workunit.client.1.smithi161.stdout:4/134: creat dd/d1a/d1d/d25/f2f x:0 0 0 2023-12-09T02:35:06.911 INFO:tasks.workunit.client.1.smithi161.stdout:1/213: symlink d6/d8/da/dd/d11/d35/l43 0 2023-12-09T02:35:06.916 INFO:tasks.workunit.client.1.smithi161.stdout:6/71: rename f2 to da/f1a 0 2023-12-09T02:35:06.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:06 smithi161 ceph-mon[121170]: pgmap v201: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 87 MiB/s rd, 191 MiB/s wr, 361 op/s 2023-12-09T02:35:06.922 INFO:tasks.workunit.client.1.smithi161.stdout:3/187: link d2/d4/d11/f14 d2/d4/d2c/d2d/f34 0 2023-12-09T02:35:06.922 INFO:tasks.workunit.client.1.smithi161.stdout:3/188: chown d2/d4/d11 848 1 2023-12-09T02:35:06.927 INFO:tasks.workunit.client.1.smithi161.stdout:4/135: dwrite f9 [0,4194304] 0 2023-12-09T02:35:06.927 INFO:tasks.workunit.client.1.smithi161.stdout:4/136: fdatasync f7 0 2023-12-09T02:35:06.928 INFO:tasks.workunit.client.1.smithi161.stdout:5/86: mkdir d0/d1f 0 2023-12-09T02:35:06.935 INFO:tasks.workunit.client.1.smithi161.stdout:2/126: mknod d4/d7/db/c28 0 2023-12-09T02:35:06.935 INFO:tasks.workunit.client.1.smithi161.stdout:2/127: truncate d4/d7/db/f24 1057869 0 2023-12-09T02:35:06.936 INFO:tasks.workunit.client.1.smithi161.stdout:2/128: write d4/fe [3538689,74504] 0 2023-12-09T02:35:06.937 INFO:tasks.workunit.client.1.smithi161.stdout:2/129: write d4/fa [2648699,68773] 0 2023-12-09T02:35:06.937 INFO:tasks.workunit.client.1.smithi161.stdout:5/87: dread d0/d2/f3 [4194304,4194304] 0 2023-12-09T02:35:06.944 INFO:tasks.workunit.client.1.smithi161.stdout:7/200: rename d0/d3/d13/d1b/f37 to d0/d3/d13/d2d/f3c 0 2023-12-09T02:35:06.945 INFO:tasks.workunit.client.1.smithi161.stdout:6/72: creat da/d19/f1b x:0 0 0 2023-12-09T02:35:06.948 INFO:tasks.workunit.client.1.smithi161.stdout:3/189: mknod d2/d4/d11/d19/c35 0 2023-12-09T02:35:06.949 INFO:tasks.workunit.client.1.smithi161.stdout:8/109: truncate d2/d5/f16 2888206 0 2023-12-09T02:35:06.949 INFO:tasks.workunit.client.1.smithi161.stdout:8/110: dread - d2/d5/f1a zero size 2023-12-09T02:35:06.949 INFO:tasks.workunit.client.1.smithi161.stdout:8/111: dread - d2/f1d zero size 2023-12-09T02:35:06.950 INFO:tasks.workunit.client.1.smithi161.stdout:2/130: dwrite d4/d16/f1e [0,4194304] 0 2023-12-09T02:35:06.950 INFO:tasks.workunit.client.1.smithi161.stdout:2/131: readlink d4/d1a/l21 0 2023-12-09T02:35:06.954 INFO:tasks.workunit.client.1.smithi161.stdout:4/137: getdents dd/d1a/d1d/d25 0 2023-12-09T02:35:06.955 INFO:tasks.workunit.client.1.smithi161.stdout:5/88: mknod d0/d2/d7/c20 0 2023-12-09T02:35:06.955 INFO:tasks.workunit.client.1.smithi161.stdout:5/89: read - d0/f1a zero size 2023-12-09T02:35:06.959 INFO:tasks.workunit.client.1.smithi161.stdout:1/214: rename d6/d8/da/dd/l24 to d6/d9/l44 0 2023-12-09T02:35:06.960 INFO:tasks.workunit.client.1.smithi161.stdout:7/201: rename d0 to d0/d3/d21/d3d 22 2023-12-09T02:35:06.960 INFO:tasks.workunit.client.1.smithi161.stdout:1/215: read - d6/d27/f3b zero size 2023-12-09T02:35:06.960 INFO:tasks.workunit.client.1.smithi161.stdout:7/202: write d0/d29/f2e [1105955,10816] 0 2023-12-09T02:35:06.962 INFO:tasks.workunit.client.1.smithi161.stdout:7/203: dread d0/d3/d13/d2f/f3a [0,4194304] 0 2023-12-09T02:35:06.963 INFO:tasks.workunit.client.1.smithi161.stdout:6/73: symlink da/d19/l1c 0 2023-12-09T02:35:06.963 INFO:tasks.workunit.client.1.smithi161.stdout:8/112: unlink d2/d5/f1a 0 2023-12-09T02:35:06.969 INFO:tasks.workunit.client.1.smithi161.stdout:2/132: creat d4/d16/f29 x:0 0 0 2023-12-09T02:35:06.971 INFO:tasks.workunit.client.1.smithi161.stdout:5/90: getdents d0/d2 0 2023-12-09T02:35:06.972 INFO:tasks.workunit.client.1.smithi161.stdout:1/216: creat d6/d9/f45 x:0 0 0 2023-12-09T02:35:06.972 INFO:tasks.workunit.client.1.smithi161.stdout:1/217: fsync d6/d8/da/dd/f21 0 2023-12-09T02:35:06.972 INFO:tasks.workunit.client.1.smithi161.stdout:4/138: dwrite dd/d1a/f1c [0,4194304] 0 2023-12-09T02:35:06.974 INFO:tasks.workunit.client.1.smithi161.stdout:7/204: mkdir d0/d3/d21/d3e 0 2023-12-09T02:35:06.975 INFO:tasks.workunit.client.1.smithi161.stdout:6/74: getdents da 0 2023-12-09T02:35:06.975 INFO:tasks.workunit.client.1.smithi161.stdout:5/91: mkdir d0/d2/de/d21 0 2023-12-09T02:35:06.976 INFO:tasks.workunit.client.1.smithi161.stdout:5/92: chown d0/d9/c12 53043054 1 2023-12-09T02:35:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:06 smithi088 ceph-mon[112028]: pgmap v201: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 87 MiB/s rd, 191 MiB/s wr, 361 op/s 2023-12-09T02:35:06.977 INFO:tasks.workunit.client.1.smithi161.stdout:1/218: mkdir d6/d27/d46 0 2023-12-09T02:35:06.978 INFO:tasks.workunit.client.1.smithi161.stdout:4/139: creat dd/d1a/d1d/d25/f30 x:0 0 0 2023-12-09T02:35:06.980 INFO:tasks.workunit.client.1.smithi161.stdout:8/113: dwrite d2/d5/f14 [0,4194304] 0 2023-12-09T02:35:06.980 INFO:tasks.workunit.client.1.smithi161.stdout:7/205: creat d0/d3/d13/d1b/f3f x:0 0 0 2023-12-09T02:35:06.980 INFO:tasks.workunit.client.1.smithi161.stdout:7/206: fsync d0/d3/d13/d2d/f39 0 2023-12-09T02:35:06.980 INFO:tasks.workunit.client.1.smithi161.stdout:4/140: write dd/fe [3587058,15701] 0 2023-12-09T02:35:06.981 INFO:tasks.workunit.client.1.smithi161.stdout:4/141: read dd/f18 [525266,21053] 0 2023-12-09T02:35:06.983 INFO:tasks.workunit.client.1.smithi161.stdout:6/75: mknod da/df/c1d 0 2023-12-09T02:35:06.983 INFO:tasks.workunit.client.1.smithi161.stdout:6/76: write da/df/f16 [1385037,34778] 0 2023-12-09T02:35:06.984 INFO:tasks.workunit.client.1.smithi161.stdout:1/219: mkdir d6/d8/da/d47 0 2023-12-09T02:35:06.990 INFO:tasks.workunit.client.1.smithi161.stdout:8/114: symlink d2/l21 0 2023-12-09T02:35:06.991 INFO:tasks.workunit.client.1.smithi161.stdout:7/207: symlink d0/d3/d13/d1b/l40 0 2023-12-09T02:35:06.994 INFO:tasks.workunit.client.1.smithi161.stdout:4/142: mknod dd/d1a/d1d/d25/c31 0 2023-12-09T02:35:06.994 INFO:tasks.workunit.client.1.smithi161.stdout:4/143: write dd/d1a/d1d/d25/f30 [929473,349] 0 2023-12-09T02:35:06.995 INFO:tasks.workunit.client.1.smithi161.stdout:1/220: creat d6/d8/da/dd/f48 x:0 0 0 2023-12-09T02:35:06.996 INFO:tasks.workunit.client.1.smithi161.stdout:8/115: mkdir d2/d5/d22 0 2023-12-09T02:35:06.997 INFO:tasks.workunit.client.1.smithi161.stdout:2/133: dwrite d4/d7/db/f10 [4194304,4194304] 0 2023-12-09T02:35:06.998 INFO:tasks.workunit.client.1.smithi161.stdout:7/208: creat d0/d3/db/f41 x:0 0 0 2023-12-09T02:35:06.999 INFO:tasks.workunit.client.1.smithi161.stdout:7/209: read d0/d3/f17 [49621,106872] 0 2023-12-09T02:35:07.001 INFO:tasks.workunit.client.1.smithi161.stdout:4/144: mkdir dd/d1a/d1d/d25/d32 0 2023-12-09T02:35:07.003 INFO:tasks.workunit.client.1.smithi161.stdout:1/221: truncate d6/d9/f19 1009717 0 2023-12-09T02:35:07.003 INFO:tasks.workunit.client.1.smithi161.stdout:1/222: write d6/d8/da/dd/d11/d35/f3c [4578312,59268] 0 2023-12-09T02:35:07.008 INFO:tasks.workunit.client.1.smithi161.stdout:1/223: dread d6/d8/da/dd/f21 [0,4194304] 0 2023-12-09T02:35:07.008 INFO:tasks.workunit.client.1.smithi161.stdout:1/224: dread - d6/d9/f45 zero size 2023-12-09T02:35:07.009 INFO:tasks.workunit.client.1.smithi161.stdout:2/134: rmdir d4/d7 39 2023-12-09T02:35:07.010 INFO:tasks.workunit.client.1.smithi161.stdout:7/210: stat d0/d3/c11 0 2023-12-09T02:35:07.011 INFO:tasks.workunit.client.1.smithi161.stdout:5/93: dwrite d0/d2/fc [0,4194304] 0 2023-12-09T02:35:07.012 INFO:tasks.workunit.client.1.smithi161.stdout:7/211: read d0/fc [616371,57345] 0 2023-12-09T02:35:07.013 INFO:tasks.workunit.client.1.smithi161.stdout:6/77: dwrite da/df/f14 [0,4194304] 0 2023-12-09T02:35:07.013 INFO:tasks.workunit.client.1.smithi161.stdout:6/78: chown da/df/c17 164926656 1 2023-12-09T02:35:07.014 INFO:tasks.workunit.client.1.smithi161.stdout:5/94: rename d0/d2/d14 to d0/d2/de/d22 0 2023-12-09T02:35:07.014 INFO:tasks.workunit.client.1.smithi161.stdout:5/95: chown d0/f1a 177 1 2023-12-09T02:35:07.014 INFO:tasks.workunit.client.1.smithi161.stdout:8/116: dread d2/f6 [0,4194304] 0 2023-12-09T02:35:07.015 INFO:tasks.workunit.client.1.smithi161.stdout:7/212: creat d0/f42 x:0 0 0 2023-12-09T02:35:07.017 INFO:tasks.workunit.client.1.smithi161.stdout:6/79: creat da/d19/f1e x:0 0 0 2023-12-09T02:35:07.017 INFO:tasks.workunit.client.1.smithi161.stdout:6/80: chown da/d19/f1e 749213 1 2023-12-09T02:35:07.017 INFO:tasks.workunit.client.1.smithi161.stdout:6/81: write da/d19/f1b [718661,57467] 0 2023-12-09T02:35:07.019 INFO:tasks.workunit.client.1.smithi161.stdout:8/117: mkdir d2/d23 0 2023-12-09T02:35:07.020 INFO:tasks.workunit.client.1.smithi161.stdout:7/213: mkdir d0/d3/d13/d2d/d43 0 2023-12-09T02:35:07.020 INFO:tasks.workunit.client.1.smithi161.stdout:7/214: chown d0/d3/d13/d1b/f3f 19240399 1 2023-12-09T02:35:07.020 INFO:tasks.workunit.client.1.smithi161.stdout:7/215: fdatasync d0/d3/db/f41 0 2023-12-09T02:35:07.022 INFO:tasks.workunit.client.1.smithi161.stdout:4/145: dwrite dd/d1a/d1d/d25/f2f [0,4194304] 0 2023-12-09T02:35:07.022 INFO:tasks.workunit.client.1.smithi161.stdout:4/146: write dd/d1a/f1c [5180465,15853] 0 2023-12-09T02:35:07.022 INFO:tasks.workunit.client.1.smithi161.stdout:4/147: fsync dd/d1a/d1e/f21 0 2023-12-09T02:35:07.022 INFO:tasks.workunit.client.1.smithi161.stdout:6/82: symlink da/df/l1f 0 2023-12-09T02:35:07.023 INFO:tasks.workunit.client.1.smithi161.stdout:8/118: symlink d2/l24 0 2023-12-09T02:35:07.025 INFO:tasks.workunit.client.1.smithi161.stdout:7/216: symlink d0/d3/d13/d1b/l44 0 2023-12-09T02:35:07.029 INFO:tasks.workunit.client.1.smithi161.stdout:5/96: dread d0/d2/fc [0,4194304] 0 2023-12-09T02:35:07.029 INFO:tasks.workunit.client.1.smithi161.stdout:1/225: dwrite d6/d27/f2f [0,4194304] 0 2023-12-09T02:35:07.029 INFO:tasks.workunit.client.1.smithi161.stdout:8/119: write d2/f3 [40170,114530] 0 2023-12-09T02:35:07.033 INFO:tasks.workunit.client.1.smithi161.stdout:4/148: rmdir dd/d26 0 2023-12-09T02:35:07.034 INFO:tasks.workunit.client.1.smithi161.stdout:4/149: read dd/f15 [1441071,26126] 0 2023-12-09T02:35:07.042 INFO:tasks.workunit.client.1.smithi161.stdout:6/83: mkdir da/d19/d20 0 2023-12-09T02:35:07.042 INFO:tasks.workunit.client.1.smithi161.stdout:6/84: fdatasync da/d19/f1e 0 2023-12-09T02:35:07.043 INFO:tasks.workunit.client.1.smithi161.stdout:7/217: dwrite d0/d3/d13/f34 [0,4194304] 0 2023-12-09T02:35:07.044 INFO:tasks.workunit.client.1.smithi161.stdout:5/97: rename d0/d2/fc to d0/d1f/f23 0 2023-12-09T02:35:07.046 INFO:tasks.workunit.client.1.smithi161.stdout:1/226: mkdir d6/d49 0 2023-12-09T02:35:07.049 INFO:tasks.workunit.client.1.smithi161.stdout:8/120: symlink d2/l25 0 2023-12-09T02:35:07.052 INFO:tasks.workunit.client.1.smithi161.stdout:4/150: symlink dd/d1a/d1e/l33 0 2023-12-09T02:35:07.052 INFO:tasks.workunit.client.1.smithi161.stdout:6/85: rename da/ce to da/c21 0 2023-12-09T02:35:07.056 INFO:tasks.workunit.client.1.smithi161.stdout:7/218: link d0/f42 d0/d3/d13/d2d/f45 0 2023-12-09T02:35:07.056 INFO:tasks.workunit.client.1.smithi161.stdout:7/219: write d0/d3/d13/d1b/f2b [4795233,121748] 0 2023-12-09T02:35:07.056 INFO:tasks.workunit.client.1.smithi161.stdout:7/220: chown d0/d29/f2e 2487 1 2023-12-09T02:35:07.060 INFO:tasks.workunit.client.1.smithi161.stdout:5/98: symlink d0/l24 0 2023-12-09T02:35:07.062 INFO:tasks.workunit.client.1.smithi161.stdout:6/86: symlink da/l22 0 2023-12-09T02:35:07.062 INFO:tasks.workunit.client.1.smithi161.stdout:6/87: write da/f10 [814493,80396] 0 2023-12-09T02:35:07.064 INFO:tasks.workunit.client.1.smithi161.stdout:5/99: dread d0/d2/f3 [0,4194304] 0 2023-12-09T02:35:07.064 INFO:tasks.workunit.client.1.smithi161.stdout:5/100: rename d0/d2 to d0/d2/d7/df/d25 22 2023-12-09T02:35:07.065 INFO:tasks.workunit.client.1.smithi161.stdout:6/88: creat da/d19/f23 x:0 0 0 2023-12-09T02:35:07.067 INFO:tasks.workunit.client.1.smithi161.stdout:5/101: symlink d0/d2/de/d21/l26 0 2023-12-09T02:35:07.068 INFO:tasks.workunit.client.1.smithi161.stdout:5/102: creat d0/f27 x:0 0 0 2023-12-09T02:35:07.068 INFO:tasks.workunit.client.1.smithi161.stdout:7/221: dread d0/d3/d13/f34 [0,4194304] 0 2023-12-09T02:35:07.075 INFO:tasks.workunit.client.1.smithi161.stdout:6/89: write f9 [3070163,55908] 0 2023-12-09T02:35:07.076 INFO:tasks.workunit.client.1.smithi161.stdout:6/90: creat da/d19/f24 x:0 0 0 2023-12-09T02:35:07.078 INFO:tasks.workunit.client.1.smithi161.stdout:6/91: write da/f1a [259483,44621] 0 2023-12-09T02:35:07.078 INFO:tasks.workunit.client.1.smithi161.stdout:6/92: stat da/df 0 2023-12-09T02:35:07.079 INFO:tasks.workunit.client.1.smithi161.stdout:6/93: rmdir da 39 2023-12-09T02:35:07.080 INFO:tasks.workunit.client.1.smithi161.stdout:6/94: creat da/d19/d20/f25 x:0 0 0 2023-12-09T02:35:07.084 INFO:tasks.workunit.client.1.smithi161.stdout:1/227: dwrite d6/d8/f30 [0,4194304] 0 2023-12-09T02:35:07.088 INFO:tasks.workunit.client.1.smithi161.stdout:4/151: dwrite dd/f15 [8388608,4194304] 0 2023-12-09T02:35:07.088 INFO:tasks.workunit.client.1.smithi161.stdout:8/121: dwrite d2/d5/fb [0,4194304] 0 2023-12-09T02:35:07.088 INFO:tasks.workunit.client.1.smithi161.stdout:1/228: read d6/d8/da/dd/d11/d1c/f1f [3134388,42535] 0 2023-12-09T02:35:07.091 INFO:tasks.workunit.client.1.smithi161.stdout:5/103: dwrite d0/d2/f1b [0,4194304] 0 2023-12-09T02:35:07.091 INFO:tasks.workunit.client.1.smithi161.stdout:5/104: chown d0/f27 16155653 1 2023-12-09T02:35:07.095 INFO:tasks.workunit.client.1.smithi161.stdout:8/122: mknod d2/c26 0 2023-12-09T02:35:07.102 INFO:tasks.workunit.client.1.smithi161.stdout:8/123: symlink d2/d23/l27 0 2023-12-09T02:35:07.103 INFO:tasks.workunit.client.1.smithi161.stdout:8/124: symlink d2/d5/d22/l28 0 2023-12-09T02:35:07.106 INFO:tasks.workunit.client.1.smithi161.stdout:8/125: write d2/f6 [538377,65994] 0 2023-12-09T02:35:07.108 INFO:tasks.workunit.client.1.smithi161.stdout:4/152: dwrite f7 [0,4194304] 0 2023-12-09T02:35:07.108 INFO:tasks.workunit.client.1.smithi161.stdout:4/153: readlink dd/d1a/l22 0 2023-12-09T02:35:07.110 INFO:tasks.workunit.client.1.smithi161.stdout:8/126: creat d2/d23/f29 x:0 0 0 2023-12-09T02:35:07.110 INFO:tasks.workunit.client.1.smithi161.stdout:8/127: fdatasync d2/d23/f29 0 2023-12-09T02:35:07.113 INFO:tasks.workunit.client.1.smithi161.stdout:4/154: mkdir dd/d1a/d1d/d25/d32/d34 0 2023-12-09T02:35:07.113 INFO:tasks.workunit.client.1.smithi161.stdout:8/128: creat d2/d23/f2a x:0 0 0 2023-12-09T02:35:07.113 INFO:tasks.workunit.client.1.smithi161.stdout:8/129: dread - d2/d23/f2a zero size 2023-12-09T02:35:07.113 INFO:tasks.workunit.client.1.smithi161.stdout:8/130: stat d2/l24 0 2023-12-09T02:35:07.114 INFO:tasks.workunit.client.1.smithi161.stdout:4/155: getdents dd/d1a/d29 0 2023-12-09T02:35:07.115 INFO:tasks.workunit.client.1.smithi161.stdout:8/131: symlink d2/d5/d22/l2b 0 2023-12-09T02:35:07.115 INFO:tasks.workunit.client.1.smithi161.stdout:1/229: dwrite d6/f2b [0,4194304] 0 2023-12-09T02:35:07.116 INFO:tasks.workunit.client.1.smithi161.stdout:4/156: mknod dd/d1a/d1d/d25/c35 0 2023-12-09T02:35:07.117 INFO:tasks.workunit.client.1.smithi161.stdout:8/132: creat d2/d23/f2c x:0 0 0 2023-12-09T02:35:07.118 INFO:tasks.workunit.client.1.smithi161.stdout:8/133: write d2/d5/fa [849814,58559] 0 2023-12-09T02:35:07.118 INFO:tasks.workunit.client.1.smithi161.stdout:1/230: symlink d6/d8/da/dd/d11/d35/l4a 0 2023-12-09T02:35:07.124 INFO:tasks.workunit.client.1.smithi161.stdout:1/231: write d6/d8/da/dd/d11/f22 [3210577,66364] 0 2023-12-09T02:35:07.124 INFO:tasks.workunit.client.1.smithi161.stdout:1/232: fdatasync f5 0 2023-12-09T02:35:07.125 INFO:tasks.workunit.client.1.smithi161.stdout:1/233: read d6/d8/da/dd/d11/d35/d3d/f3e [136353,6104] 0 2023-12-09T02:35:07.125 INFO:tasks.workunit.client.1.smithi161.stdout:1/234: chown d6/d8/da/dd 548569443 1 2023-12-09T02:35:07.125 INFO:tasks.workunit.client.1.smithi161.stdout:1/235: stat d6/f38 0 2023-12-09T02:35:07.125 INFO:tasks.workunit.client.1.smithi161.stdout:1/236: dread d6/d8/da/dd/f21 [0,4194304] 0 2023-12-09T02:35:07.127 INFO:tasks.workunit.client.1.smithi161.stdout:6/95: dwrite f9 [0,4194304] 0 2023-12-09T02:35:07.127 INFO:tasks.workunit.client.1.smithi161.stdout:8/134: fdatasync d2/d5/fa 0 2023-12-09T02:35:07.130 INFO:tasks.workunit.client.1.smithi161.stdout:6/96: getdents da 0 2023-12-09T02:35:07.131 INFO:tasks.workunit.client.1.smithi161.stdout:8/135: write d2/d5/f14 [2018166,21356] 0 2023-12-09T02:35:07.131 INFO:tasks.workunit.client.1.smithi161.stdout:5/105: dwrite d0/f18 [0,4194304] 0 2023-12-09T02:35:07.132 INFO:tasks.workunit.client.1.smithi161.stdout:6/97: dread da/fc [0,4194304] 0 2023-12-09T02:35:07.132 INFO:tasks.workunit.client.1.smithi161.stdout:6/98: fsync da/d19/f1e 0 2023-12-09T02:35:07.133 INFO:tasks.workunit.client.1.smithi161.stdout:5/106: write d0/d2/f16 [7993624,98342] 0 2023-12-09T02:35:07.133 INFO:tasks.workunit.client.1.smithi161.stdout:5/107: chown d0/f18 0 1 2023-12-09T02:35:07.133 INFO:tasks.workunit.client.1.smithi161.stdout:5/108: fdatasync d0/d2/f3 0 2023-12-09T02:35:07.133 INFO:tasks.workunit.client.1.smithi161.stdout:5/109: fdatasync d0/d2/f3 0 2023-12-09T02:35:07.133 INFO:tasks.workunit.client.1.smithi161.stdout:5/110: write d0/f1a [368089,509] 0 2023-12-09T02:35:07.134 INFO:tasks.workunit.client.1.smithi161.stdout:1/237: dread d6/d8/da/dd/f16 [0,4194304] 0 2023-12-09T02:35:07.135 INFO:tasks.workunit.client.1.smithi161.stdout:1/238: readlink d6/d8/da/l2d 0 2023-12-09T02:35:07.136 INFO:tasks.workunit.client.1.smithi161.stdout:6/99: dread da/fd [0,4194304] 0 2023-12-09T02:35:07.136 INFO:tasks.workunit.client.1.smithi161.stdout:6/100: write da/d19/d20/f25 [18259,114583] 0 2023-12-09T02:35:07.136 INFO:tasks.workunit.client.1.smithi161.stdout:6/101: fdatasync da/f10 0 2023-12-09T02:35:07.139 INFO:tasks.workunit.client.1.smithi161.stdout:6/102: write f1 [4986172,85463] 0 2023-12-09T02:35:07.139 INFO:tasks.workunit.client.1.smithi161.stdout:6/103: stat da/df/c18 0 2023-12-09T02:35:07.148 INFO:tasks.workunit.client.1.smithi161.stdout:6/104: rmdir da 39 2023-12-09T02:35:07.148 INFO:tasks.workunit.client.1.smithi161.stdout:6/105: chown da/d19/f24 8448 1 2023-12-09T02:35:07.155 INFO:tasks.workunit.client.1.smithi161.stdout:6/106: write f1 [2060885,46942] 0 2023-12-09T02:35:07.155 INFO:tasks.workunit.client.1.smithi161.stdout:6/107: dread da/fd [0,4194304] 0 2023-12-09T02:35:07.155 INFO:tasks.workunit.client.1.smithi161.stdout:6/108: chown da/df/c1d 556084 1 2023-12-09T02:35:07.157 INFO:tasks.workunit.client.1.smithi161.stdout:6/109: link f3 da/f26 0 2023-12-09T02:35:07.157 INFO:tasks.workunit.client.1.smithi161.stdout:6/110: write da/fd [1380274,5225] 0 2023-12-09T02:35:07.159 INFO:tasks.workunit.client.1.smithi161.stdout:6/111: creat da/df/f27 x:0 0 0 2023-12-09T02:35:07.162 INFO:tasks.workunit.client.1.smithi161.stdout:6/112: mkdir da/d28 0 2023-12-09T02:35:07.162 INFO:tasks.workunit.client.1.smithi161.stdout:6/113: chown da/df/f16 10522552 1 2023-12-09T02:35:07.163 INFO:tasks.workunit.client.1.smithi161.stdout:6/114: mkdir da/d28/d29 0 2023-12-09T02:35:07.163 INFO:tasks.workunit.client.1.smithi161.stdout:5/111: dwrite d0/f27 [0,4194304] 0 2023-12-09T02:35:07.165 INFO:tasks.workunit.client.1.smithi161.stdout:1/239: dwrite f5 [0,4194304] 0 2023-12-09T02:35:07.166 INFO:tasks.workunit.client.1.smithi161.stdout:8/136: dwrite d2/d5/f14 [0,4194304] 0 2023-12-09T02:35:07.167 INFO:tasks.workunit.client.1.smithi161.stdout:6/115: mknod da/d19/c2a 0 2023-12-09T02:35:07.168 INFO:tasks.workunit.client.1.smithi161.stdout:5/112: dread d0/d2/f3 [4194304,4194304] 0 2023-12-09T02:35:07.171 INFO:tasks.workunit.client.1.smithi161.stdout:1/240: mknod d6/d8/da/dd/d11/d35/c4b 0 2023-12-09T02:35:07.171 INFO:tasks.workunit.client.1.smithi161.stdout:1/241: readlink d6/d8/da/dd/l13 0 2023-12-09T02:35:07.172 INFO:tasks.workunit.client.1.smithi161.stdout:6/116: mkdir da/d28/d29/d2b 0 2023-12-09T02:35:07.173 INFO:tasks.workunit.client.1.smithi161.stdout:6/117: write f3 [1545942,71282] 0 2023-12-09T02:35:07.173 INFO:tasks.workunit.client.1.smithi161.stdout:6/118: stat da/d19/d20/f25 0 2023-12-09T02:35:07.175 INFO:tasks.workunit.client.1.smithi161.stdout:5/113: creat d0/d2/de/d21/f28 x:0 0 0 2023-12-09T02:35:07.178 INFO:tasks.workunit.client.1.smithi161.stdout:1/242: rename d6/d8/da/dd/d11/d1c/f1f to d6/d27/f4c 0 2023-12-09T02:35:07.178 INFO:tasks.workunit.client.1.smithi161.stdout:1/243: chown d6/d8/f30 0 1 2023-12-09T02:35:07.181 INFO:tasks.workunit.client.1.smithi161.stdout:6/119: dread f1 [0,4194304] 0 2023-12-09T02:35:07.183 INFO:tasks.workunit.client.1.smithi161.stdout:6/120: fsync da/f26 0 2023-12-09T02:35:07.183 INFO:tasks.workunit.client.1.smithi161.stdout:6/121: chown da/d19/c2a 1220271174 1 2023-12-09T02:35:07.184 INFO:tasks.workunit.client.1.smithi161.stdout:6/122: rmdir da/d19/d20 39 2023-12-09T02:35:07.184 INFO:tasks.workunit.client.1.smithi161.stdout:6/123: fsync da/df/f27 0 2023-12-09T02:35:07.188 INFO:tasks.workunit.client.1.smithi161.stdout:6/124: dread f3 [0,4194304] 0 2023-12-09T02:35:07.188 INFO:tasks.workunit.client.1.smithi161.stdout:6/125: chown da/df/f14 482 1 2023-12-09T02:35:07.189 INFO:tasks.workunit.client.1.smithi161.stdout:6/126: creat da/f2c x:0 0 0 2023-12-09T02:35:07.199 INFO:tasks.workunit.client.1.smithi161.stdout:1/244: rename d6/d27 to d6/d8/da/dd/d11/d4d 0 2023-12-09T02:35:07.203 INFO:tasks.workunit.client.1.smithi161.stdout:1/245: write d6/d8/da/dd/d11/d4d/f2f [4103706,50329] 0 2023-12-09T02:35:07.204 INFO:tasks.workunit.client.1.smithi161.stdout:6/127: dwrite da/df/f11 [0,4194304] 0 2023-12-09T02:35:07.207 INFO:tasks.workunit.client.1.smithi161.stdout:1/246: link d6/d8/da/l15 d6/d8/da/dd/d11/d1c/l4e 0 2023-12-09T02:35:07.209 INFO:tasks.workunit.client.1.smithi161.stdout:6/128: mkdir da/df/d2d 0 2023-12-09T02:35:07.211 INFO:tasks.workunit.client.1.smithi161.stdout:1/247: rename d6/d8/da/c1b to d6/d8/da/dd/c4f 0 2023-12-09T02:35:07.212 INFO:tasks.workunit.client.1.smithi161.stdout:1/248: write d6/d8/da/dd/f14 [537144,8679] 0 2023-12-09T02:35:07.212 INFO:tasks.workunit.client.1.smithi161.stdout:1/249: truncate d6/d8/da/dd/d11/d4d/f3b 970744 0 2023-12-09T02:35:07.216 INFO:tasks.workunit.client.1.smithi161.stdout:1/250: rename d6/d9/l12 to d6/d9/l50 0 2023-12-09T02:35:07.216 INFO:tasks.workunit.client.1.smithi161.stdout:1/251: stat l3 0 2023-12-09T02:35:07.216 INFO:tasks.workunit.client.1.smithi161.stdout:1/252: readlink d6/d8/da/l2d 0 2023-12-09T02:35:07.217 INFO:tasks.workunit.client.1.smithi161.stdout:1/253: creat d6/d8/da/dd/d11/f51 x:0 0 0 2023-12-09T02:35:07.219 INFO:tasks.workunit.client.1.smithi161.stdout:1/254: symlink d6/d8/da/dd/d11/d35/d3d/l52 0 2023-12-09T02:35:07.219 INFO:tasks.workunit.client.1.smithi161.stdout:1/255: chown d6/d8/da/dd/f16 19793 1 2023-12-09T02:35:07.222 INFO:tasks.workunit.client.1.smithi161.stdout:6/129: dwrite da/d19/f24 [0,4194304] 0 2023-12-09T02:35:07.222 INFO:tasks.workunit.client.1.smithi161.stdout:1/256: write d6/d8/da/dd/d11/d35/f3c [3111082,68859] 0 2023-12-09T02:35:07.224 INFO:tasks.workunit.client.1.smithi161.stdout:6/130: symlink da/d19/d20/l2e 0 2023-12-09T02:35:07.226 INFO:tasks.workunit.client.1.smithi161.stdout:1/257: dread d6/d8/da/dd/d11/d35/f3c [4194304,4194304] 0 2023-12-09T02:35:07.229 INFO:tasks.workunit.client.1.smithi161.stdout:6/131: rename da/df/f16 to da/df/f2f 0 2023-12-09T02:35:07.233 INFO:tasks.workunit.client.1.smithi161.stdout:1/258: link d6/d8/da/dd/f14 d6/d8/da/dd/d11/d4d/f53 0 2023-12-09T02:35:07.234 INFO:tasks.workunit.client.1.smithi161.stdout:6/132: symlink da/df/l30 0 2023-12-09T02:35:07.234 INFO:tasks.workunit.client.1.smithi161.stdout:6/133: chown da/df/c1d 808574 1 2023-12-09T02:35:07.235 INFO:tasks.workunit.client.1.smithi161.stdout:6/134: mkdir da/d28/d29/d2b/d31 0 2023-12-09T02:35:07.237 INFO:tasks.workunit.client.1.smithi161.stdout:6/135: unlink f3 0 2023-12-09T02:35:07.247 INFO:tasks.workunit.client.1.smithi161.stdout:6/136: dread da/f1a [0,4194304] 0 2023-12-09T02:35:07.247 INFO:tasks.workunit.client.1.smithi161.stdout:6/137: chown da/df/l1f 31015116 1 2023-12-09T02:35:07.252 INFO:tasks.workunit.client.1.smithi161.stdout:1/259: dwrite d6/d8/da/dd/d11/f22 [0,4194304] 0 2023-12-09T02:35:07.255 INFO:tasks.workunit.client.1.smithi161.stdout:1/260: dread d6/d8/da/dd/f14 [0,4194304] 0 2023-12-09T02:35:07.255 INFO:tasks.workunit.client.1.smithi161.stdout:1/261: truncate d6/d8/da/dd/d11/d4d/f53 1372409 0 2023-12-09T02:35:07.255 INFO:tasks.workunit.client.1.smithi161.stdout:1/262: truncate d6/f38 679939 0 2023-12-09T02:35:07.255 INFO:tasks.workunit.client.1.smithi161.stdout:1/263: read - d6/d8/da/dd/d11/f51 zero size 2023-12-09T02:35:07.255 INFO:tasks.workunit.client.1.smithi161.stdout:1/264: fdatasync d6/d8/da/dd/d11/d4d/f3b 0 2023-12-09T02:35:07.256 INFO:tasks.workunit.client.1.smithi161.stdout:1/265: chown d6/d8/da/dd/d11/d4d/l36 26 1 2023-12-09T02:35:07.256 INFO:tasks.workunit.client.1.smithi161.stdout:1/266: mknod d6/d8/da/dd/d11/d1c/c54 0 2023-12-09T02:35:07.258 INFO:tasks.workunit.client.1.smithi161.stdout:1/267: write d6/d8/da/dd/d11/d4d/f4c [180550,125233] 0 2023-12-09T02:35:07.260 INFO:tasks.workunit.client.1.smithi161.stdout:6/138: dwrite da/d19/f1b [0,4194304] 0 2023-12-09T02:35:07.270 INFO:tasks.workunit.client.1.smithi161.stdout:1/268: dread d6/d8/da/dd/d11/d4d/f2f [0,4194304] 0 2023-12-09T02:35:07.286 INFO:tasks.workunit.client.1.smithi161.stdout:6/139: dwrite da/f1a [0,4194304] 0 2023-12-09T02:35:07.287 INFO:tasks.workunit.client.1.smithi161.stdout:6/140: chown da/d28/d29/d2b/d31 3 1 2023-12-09T02:35:07.287 INFO:tasks.workunit.client.1.smithi161.stdout:6/141: write da/f15 [1538000,27590] 0 2023-12-09T02:35:07.289 INFO:tasks.workunit.client.1.smithi161.stdout:6/142: rmdir da/d28 39 2023-12-09T02:35:07.291 INFO:tasks.workunit.client.1.smithi161.stdout:1/269: dwrite d6/d8/da/dd/d11/d4d/f4c [0,4194304] 0 2023-12-09T02:35:07.292 INFO:tasks.workunit.client.1.smithi161.stdout:1/270: write d6/d9/f45 [929961,14840] 0 2023-12-09T02:35:07.293 INFO:tasks.workunit.client.1.smithi161.stdout:6/143: creat da/df/d2d/f32 x:0 0 0 2023-12-09T02:35:07.293 INFO:tasks.workunit.client.1.smithi161.stdout:1/271: write d6/d8/da/dd/d11/d4d/d31/f3a [337812,50468] 0 2023-12-09T02:35:07.299 INFO:tasks.workunit.client.1.smithi161.stdout:6/144: mkdir da/d28/d29/d2b/d31/d33 0 2023-12-09T02:35:07.301 INFO:tasks.workunit.client.1.smithi161.stdout:1/272: unlink d6/d9/l25 0 2023-12-09T02:35:07.301 INFO:tasks.workunit.client.1.smithi161.stdout:1/273: write d6/d8/da/dd/fe [929648,4779] 0 2023-12-09T02:35:07.308 INFO:tasks.workunit.client.1.smithi161.stdout:1/274: rmdir d6/d8 39 2023-12-09T02:35:07.308 INFO:tasks.workunit.client.1.smithi161.stdout:1/275: write d6/d8/da/dd/d11/d4d/d31/f3a [5112601,106775] 0 2023-12-09T02:35:07.314 INFO:tasks.workunit.client.1.smithi161.stdout:1/276: link d6/d8/da/dd/d11/d35/l4a d6/d8/da/dd/d11/l55 0 2023-12-09T02:35:07.315 INFO:tasks.workunit.client.1.smithi161.stdout:1/277: chown d6/d9/l44 0 1 2023-12-09T02:35:07.315 INFO:tasks.workunit.client.1.smithi161.stdout:6/145: link da/cb da/d19/d20/c34 0 2023-12-09T02:35:07.316 INFO:tasks.workunit.client.1.smithi161.stdout:1/278: mkdir d6/d8/da/dd/d11/d4d/d31/d56 0 2023-12-09T02:35:07.318 INFO:tasks.workunit.client.1.smithi161.stdout:6/146: dread da/f15 [0,4194304] 0 2023-12-09T02:35:07.318 INFO:tasks.workunit.client.1.smithi161.stdout:1/279: symlink d6/d49/l57 0 2023-12-09T02:35:07.319 INFO:tasks.workunit.client.1.smithi161.stdout:6/147: creat da/d28/d29/d2b/d31/f35 x:0 0 0 2023-12-09T02:35:07.320 INFO:tasks.workunit.client.1.smithi161.stdout:6/148: write da/f15 [969608,91179] 0 2023-12-09T02:35:07.320 INFO:tasks.workunit.client.1.smithi161.stdout:1/280: getdents d6/d8/da/dd/d11/d1c 0 2023-12-09T02:35:07.320 INFO:tasks.workunit.client.1.smithi161.stdout:1/281: write d6/d9/f19 [1377169,91413] 0 2023-12-09T02:35:07.322 INFO:tasks.workunit.client.1.smithi161.stdout:9/147: sync 2023-12-09T02:35:07.323 INFO:tasks.workunit.client.1.smithi161.stdout:0/118: sync 2023-12-09T02:35:07.324 INFO:tasks.workunit.client.1.smithi161.stdout:0/119: write f1 [5876227,41272] 0 2023-12-09T02:35:07.324 INFO:tasks.workunit.client.1.smithi161.stdout:9/148: write d2/da/f27 [3136047,39125] 0 2023-12-09T02:35:07.324 INFO:tasks.workunit.client.1.smithi161.stdout:9/149: write d2/f1b [1191993,48450] 0 2023-12-09T02:35:07.328 INFO:tasks.workunit.client.1.smithi161.stdout:1/282: creat d6/d9/f58 x:0 0 0 2023-12-09T02:35:07.328 INFO:tasks.workunit.client.1.smithi161.stdout:1/283: readlink d6/d8/da/dd/d11/d35/l4a 0 2023-12-09T02:35:07.332 INFO:tasks.workunit.client.1.smithi161.stdout:1/284: rmdir d6/d8/da/dd/d11/d4d 39 2023-12-09T02:35:07.332 INFO:tasks.workunit.client.1.smithi161.stdout:1/285: write f5 [4582625,62114] 0 2023-12-09T02:35:07.332 INFO:tasks.workunit.client.1.smithi161.stdout:1/286: chown d6/d9 177819966 1 2023-12-09T02:35:07.334 INFO:tasks.workunit.client.1.smithi161.stdout:1/287: creat d6/f59 x:0 0 0 2023-12-09T02:35:07.334 INFO:tasks.workunit.client.1.smithi161.stdout:1/288: write d6/d8/da/dd/f14 [1922088,56159] 0 2023-12-09T02:35:07.334 INFO:tasks.workunit.client.1.smithi161.stdout:1/289: stat d6 0 2023-12-09T02:35:07.339 INFO:tasks.workunit.client.1.smithi161.stdout:1/290: write d6/d8/da/dd/d11/d4d/d31/f3a [4022110,69613] 0 2023-12-09T02:35:07.344 INFO:tasks.workunit.client.1.smithi161.stdout:9/150: dwrite d2/da/f1e [0,4194304] 0 2023-12-09T02:35:07.345 INFO:tasks.workunit.client.1.smithi161.stdout:9/151: fsync d2/da/f14 0 2023-12-09T02:35:07.346 INFO:tasks.workunit.client.1.smithi161.stdout:0/120: dwrite d9/f1d [0,4194304] 0 2023-12-09T02:35:07.357 INFO:tasks.workunit.client.1.smithi161.stdout:1/291: dwrite d6/f2b [0,4194304] 0 2023-12-09T02:35:07.357 INFO:tasks.workunit.client.1.smithi161.stdout:1/292: chown d6/d8 61143572 1 2023-12-09T02:35:07.357 INFO:tasks.workunit.client.1.smithi161.stdout:1/293: chown d6/d8/da/dd/d11/d35/d3d/l52 765 1 2023-12-09T02:35:07.361 INFO:tasks.workunit.client.1.smithi161.stdout:1/294: mkdir d6/d8/da/d47/d5a 0 2023-12-09T02:35:07.364 INFO:tasks.workunit.client.1.smithi161.stdout:1/295: truncate d6/d8/f30 2843152 0 2023-12-09T02:35:07.367 INFO:tasks.workunit.client.1.smithi161.stdout:1/296: unlink d6/d8/da/dd/d11/f51 0 2023-12-09T02:35:07.368 INFO:tasks.workunit.client.1.smithi161.stdout:1/297: mknod d6/d8/da/dd/c5b 0 2023-12-09T02:35:07.369 INFO:tasks.workunit.client.1.smithi161.stdout:0/121: truncate f1 4978748 0 2023-12-09T02:35:07.371 INFO:tasks.workunit.client.1.smithi161.stdout:0/122: creat d9/d1a/f22 x:0 0 0 2023-12-09T02:35:07.375 INFO:tasks.workunit.client.1.smithi161.stdout:0/123: getdents d9/d1f 0 2023-12-09T02:35:07.386 INFO:tasks.workunit.client.1.smithi161.stdout:1/298: dwrite d6/d8/da/dd/d11/d35/d3d/f3e [0,4194304] 0 2023-12-09T02:35:07.390 INFO:tasks.workunit.client.1.smithi161.stdout:1/299: mkdir d6/d9/d5c 0 2023-12-09T02:35:07.395 INFO:tasks.workunit.client.1.smithi161.stdout:0/124: dwrite d9/f1d [0,4194304] 0 2023-12-09T02:35:07.397 INFO:tasks.workunit.client.1.smithi161.stdout:0/125: symlink d9/l23 0 2023-12-09T02:35:07.397 INFO:tasks.workunit.client.1.smithi161.stdout:0/126: write d9/f20 [816600,100455] 0 2023-12-09T02:35:07.401 INFO:tasks.workunit.client.1.smithi161.stdout:0/127: dread f6 [0,4194304] 0 2023-12-09T02:35:07.402 INFO:tasks.workunit.client.1.smithi161.stdout:0/128: write d9/f11 [749039,83241] 0 2023-12-09T02:35:07.402 INFO:tasks.workunit.client.1.smithi161.stdout:0/129: truncate d9/dd/f1e 5810738 0 2023-12-09T02:35:07.405 INFO:tasks.workunit.client.1.smithi161.stdout:0/130: write d9/f1d [1248619,88593] 0 2023-12-09T02:35:07.409 INFO:tasks.workunit.client.1.smithi161.stdout:0/131: rename l4 to d9/db/l24 0 2023-12-09T02:35:07.412 INFO:tasks.workunit.client.1.smithi161.stdout:1/300: rmdir d6 39 2023-12-09T02:35:07.412 INFO:tasks.workunit.client.1.smithi161.stdout:1/301: stat d6/d49/l57 0 2023-12-09T02:35:07.414 INFO:tasks.workunit.client.1.smithi161.stdout:1/302: link d6/d49/l57 d6/d8/da/dd/d11/l5d 0 2023-12-09T02:35:07.414 INFO:tasks.workunit.client.1.smithi161.stdout:1/303: truncate d6/f59 252218 0 2023-12-09T02:35:07.426 INFO:tasks.workunit.client.1.smithi161.stdout:0/132: dwrite f6 [0,4194304] 0 2023-12-09T02:35:07.430 INFO:tasks.workunit.client.1.smithi161.stdout:0/133: rename d9/d1a to d9/d25 0 2023-12-09T02:35:07.430 INFO:tasks.workunit.client.1.smithi161.stdout:0/134: write d9/d25/f22 [542143,13384] 0 2023-12-09T02:35:07.434 INFO:tasks.workunit.client.1.smithi161.stdout:1/304: dwrite d6/d8/da/dd/d11/d4d/f4c [0,4194304] 0 2023-12-09T02:35:07.435 INFO:tasks.workunit.client.1.smithi161.stdout:1/305: truncate d6/d9/f45 1441535 0 2023-12-09T02:35:07.435 INFO:tasks.workunit.client.1.smithi161.stdout:1/306: fdatasync d6/f26 0 2023-12-09T02:35:07.439 INFO:tasks.workunit.client.1.smithi161.stdout:0/135: dread d9/d1f/f18 [0,4194304] 0 2023-12-09T02:35:07.457 INFO:tasks.workunit.client.1.smithi161.stdout:1/307: dwrite d6/d8/da/dd/d11/d1c/f1e [0,4194304] 0 2023-12-09T02:35:07.457 INFO:tasks.workunit.client.1.smithi161.stdout:0/136: dwrite f7 [0,4194304] 0 2023-12-09T02:35:07.471 INFO:tasks.workunit.client.1.smithi161.stdout:0/137: dwrite d9/d25/f22 [0,4194304] 0 2023-12-09T02:35:07.471 INFO:tasks.workunit.client.1.smithi161.stdout:0/138: chown d9/f11 357196481 1 2023-12-09T02:35:07.507 INFO:tasks.workunit.client.1.smithi161.stdout:1/308: mknod d6/d8/da/dd/d11/c5e 0 2023-12-09T02:35:07.509 INFO:tasks.workunit.client.1.smithi161.stdout:1/309: rmdir d6/d8/da/dd 39 2023-12-09T02:35:07.511 INFO:tasks.workunit.client.1.smithi161.stdout:1/310: mknod d6/d8/da/dd/d11/d1c/c5f 0 2023-12-09T02:35:07.511 INFO:tasks.workunit.client.1.smithi161.stdout:1/311: fsync d6/d8/da/dd/d11/d4d/f53 0 2023-12-09T02:35:07.511 INFO:tasks.workunit.client.1.smithi161.stdout:1/312: fsync d6/f38 0 2023-12-09T02:35:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.511+0000 7fa831dab700 1 -- 172.21.15.88:0/290371362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82c0fcd00 msgr2=0x7fa82c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.511+0000 7fa831dab700 1 --2- 172.21.15.88:0/290371362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82c0fcd00 0x7fa82c0fd150 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa81c004940 tx=0x7fa81c009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.511+0000 7fa831dab700 1 -- 172.21.15.88:0/290371362 shutdown_connections 2023-12-09T02:35:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.511+0000 7fa831dab700 1 --2- 172.21.15.88:0/290371362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82c0fcd00 0x7fa82c0fd150 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.511+0000 7fa831dab700 1 --2- 172.21.15.88:0/290371362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0fbaf0 0x7fa82c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.511+0000 7fa831dab700 1 -- 172.21.15.88:0/290371362 >> 172.21.15.88:0/290371362 conn(0x7fa82c0f7190 msgr2=0x7fa82c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.511+0000 7fa831dab700 1 -- 172.21.15.88:0/290371362 shutdown_connections 2023-12-09T02:35:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.511+0000 7fa831dab700 1 -- 172.21.15.88:0/290371362 wait complete. 2023-12-09T02:35:07.514 INFO:tasks.workunit.client.1.smithi161.stdout:0/139: dwrite f7 [0,4194304] 0 2023-12-09T02:35:07.514 INFO:tasks.workunit.client.1.smithi161.stdout:1/313: creat d6/d49/f60 x:0 0 0 2023-12-09T02:35:07.515 INFO:tasks.workunit.client.1.smithi161.stdout:1/314: fdatasync d6/d9/f58 0 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.511+0000 7fa831dab700 1 Processor -- start 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.511+0000 7fa831dab700 1 -- start start 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa831dab700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82c0fbaf0 0x7fa82c10d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa831dab700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0fcd00 0x7fa82c10dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa831dab700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c10e0b0 con 0x7fa82c0fbaf0 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa831dab700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c10e950 con 0x7fa82c0fcd00 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa82b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82c0fbaf0 0x7fa82c10d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa82b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82c0fbaf0 0x7fa82c10d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55082/0 (socket says 172.21.15.88:55082) 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa82b7fe700 1 -- 172.21.15.88:0/2590167649 learned_addr learned my addr 172.21.15.88:0/2590167649 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa82affd700 1 --2- 172.21.15.88:0/2590167649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0fcd00 0x7fa82c10dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa82b7fe700 1 -- 172.21.15.88:0/2590167649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0fcd00 msgr2=0x7fa82c10dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa82b7fe700 1 --2- 172.21.15.88:0/2590167649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0fcd00 0x7fa82c10dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:07.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa82b7fe700 1 -- 172.21.15.88:0/2590167649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c005040 con 0x7fa82c0fbaf0 2023-12-09T02:35:07.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa82b7fe700 1 --2- 172.21.15.88:0/2590167649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82c0fbaf0 0x7fa82c10d570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa814002a80 tx=0x7fa814004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:07.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa823fff700 1 -- 172.21.15.88:0/2590167649 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa814007cc0 con 0x7fa82c0fbaf0 2023-12-09T02:35:07.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa831dab700 1 -- 172.21.15.88:0/2590167649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c10ec30 con 0x7fa82c0fbaf0 2023-12-09T02:35:07.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa823fff700 1 -- 172.21.15.88:0/2590167649 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa81400f040 con 0x7fa82c0fbaf0 2023-12-09T02:35:07.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.512+0000 7fa823fff700 1 -- 172.21.15.88:0/2590167649 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa81400d9c0 con 0x7fa82c0fbaf0 2023-12-09T02:35:07.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.513+0000 7fa831dab700 1 -- 172.21.15.88:0/2590167649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c10f170 con 0x7fa82c0fbaf0 2023-12-09T02:35:07.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.513+0000 7fa831dab700 1 -- 172.21.15.88:0/2590167649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82c04bb80 con 0x7fa82c0fbaf0 2023-12-09T02:35:07.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.514+0000 7fa823fff700 1 -- 172.21.15.88:0/2590167649 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 88622+0+0 (secure 0 0 0) 0x7fa81400db20 con 0x7fa82c0fbaf0 2023-12-09T02:35:07.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.514+0000 7fa823fff700 1 --2- 172.21.15.88:0/2590167649 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa81806ad30 0x7fa81806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:07.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.514+0000 7fa823fff700 1 -- 172.21.15.88:0/2590167649 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa8140891a0 con 0x7fa82c0fbaf0 2023-12-09T02:35:07.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.514+0000 7fa82affd700 1 --2- 172.21.15.88:0/2590167649 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa81806ad30 0x7fa81806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:07.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.515+0000 7fa82affd700 1 --2- 172.21.15.88:0/2590167649 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa81806ad30 0x7fa81806d1e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00b3b0 tx=0x7fa81c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:07.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.519+0000 7fa823fff700 1 -- 172.21.15.88:0/2590167649 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa814059030 con 0x7fa82c0fbaf0 2023-12-09T02:35:07.529 INFO:tasks.workunit.client.1.smithi161.stdout:0/140: mkdir d9/dd/d21/d26 0 2023-12-09T02:35:07.529 INFO:tasks.workunit.client.1.smithi161.stdout:0/141: chown d9/d1f/c19 9559621 1 2023-12-09T02:35:07.530 INFO:tasks.workunit.client.1.smithi161.stdout:1/315: unlink d6/d9/f58 0 2023-12-09T02:35:07.530 INFO:tasks.workunit.client.1.smithi161.stdout:1/316: chown d6 1283860 1 2023-12-09T02:35:07.530 INFO:tasks.workunit.client.1.smithi161.stdout:1/317: fdatasync d6/d8/da/dd/f21 0 2023-12-09T02:35:07.532 INFO:tasks.workunit.client.1.smithi161.stdout:1/318: dread d6/d9/f19 [0,4194304] 0 2023-12-09T02:35:07.532 INFO:tasks.workunit.client.1.smithi161.stdout:1/319: truncate d6/f26 900288 0 2023-12-09T02:35:07.532 INFO:tasks.workunit.client.1.smithi161.stdout:1/320: chown d6/d8/da/dd/c4f 0 1 2023-12-09T02:35:07.533 INFO:tasks.workunit.client.1.smithi161.stdout:0/142: unlink f6 0 2023-12-09T02:35:07.535 INFO:tasks.workunit.client.1.smithi161.stdout:1/321: rename d6/d8/da/dd/d11/d4d/d31/d56 to d6/d8/da/dd/d11/d61 0 2023-12-09T02:35:07.535 INFO:tasks.workunit.client.1.smithi161.stdout:1/322: readlink d6/d8/da/dd/d11/d35/d3d/l52 0 2023-12-09T02:35:07.535 INFO:tasks.workunit.client.1.smithi161.stdout:1/323: chown d6/d8/cb 0 1 2023-12-09T02:35:07.537 INFO:tasks.workunit.client.1.smithi161.stdout:0/143: symlink d9/dd/d21/l27 0 2023-12-09T02:35:07.538 INFO:tasks.workunit.client.1.smithi161.stdout:1/324: rmdir d6/d8/da/dd/d11/d1c 39 2023-12-09T02:35:07.538 INFO:tasks.workunit.client.1.smithi161.stdout:1/325: truncate d6/d8/da/dd/f14 2422793 0 2023-12-09T02:35:07.538 INFO:tasks.workunit.client.1.smithi161.stdout:1/326: chown d6/d8/da/dd/d11/f22 336473165 1 2023-12-09T02:35:07.540 INFO:tasks.workunit.client.1.smithi161.stdout:1/327: symlink d6/d8/da/dd/d11/d4d/d31/l62 0 2023-12-09T02:35:07.553 INFO:tasks.workunit.client.1.smithi161.stdout:2/135: sync 2023-12-09T02:35:07.553 INFO:tasks.workunit.client.1.smithi161.stdout:3/190: sync 2023-12-09T02:35:07.553 INFO:tasks.workunit.client.1.smithi161.stdout:7/222: sync 2023-12-09T02:35:07.553 INFO:tasks.workunit.client.1.smithi161.stdout:4/157: sync 2023-12-09T02:35:07.555 INFO:tasks.workunit.client.1.smithi161.stdout:2/136: write d4/d1a/f1b [691499,7445] 0 2023-12-09T02:35:07.556 INFO:tasks.workunit.client.1.smithi161.stdout:7/223: rmdir d0/d3 39 2023-12-09T02:35:07.556 INFO:tasks.workunit.client.1.smithi161.stdout:7/224: fsync d0/d3/d13/d2d/f3c 0 2023-12-09T02:35:07.556 INFO:tasks.workunit.client.1.smithi161.stdout:7/225: write d0/d3/f8 [1950329,32331] 0 2023-12-09T02:35:07.557 INFO:tasks.workunit.client.1.smithi161.stdout:7/226: write d0/d3/d13/d2f/f3a [531477,90264] 0 2023-12-09T02:35:07.557 INFO:tasks.workunit.client.1.smithi161.stdout:4/158: getdents dd/d1a/d1d 0 2023-12-09T02:35:07.558 INFO:tasks.workunit.client.1.smithi161.stdout:2/137: mknod d4/d7/c2a 0 2023-12-09T02:35:07.566 INFO:tasks.workunit.client.1.smithi161.stdout:7/227: creat d0/d3/f46 x:0 0 0 2023-12-09T02:35:07.570 INFO:tasks.workunit.client.1.smithi161.stdout:4/159: mkdir dd/d36 0 2023-12-09T02:35:07.571 INFO:tasks.workunit.client.1.smithi161.stdout:4/160: chown dd/d1a/d29/c2d 133535209 1 2023-12-09T02:35:07.571 INFO:tasks.workunit.client.1.smithi161.stdout:4/161: chown dd/d1a/d1d/d25/f2f 79727940 1 2023-12-09T02:35:07.573 INFO:tasks.workunit.client.1.smithi161.stdout:2/138: dread d4/d16/f1e [0,4194304] 0 2023-12-09T02:35:07.575 INFO:tasks.workunit.client.1.smithi161.stdout:2/139: creat d4/d7/f2b x:0 0 0 2023-12-09T02:35:07.578 INFO:tasks.workunit.client.1.smithi161.stdout:0/144: dwrite d9/d1f/f18 [0,4194304] 0 2023-12-09T02:35:07.578 INFO:tasks.workunit.client.1.smithi161.stdout:0/145: fsync f7 0 2023-12-09T02:35:07.579 INFO:tasks.workunit.client.1.smithi161.stdout:3/191: dwrite d2/d4/d11/d1f/f25 [4194304,4194304] 0 2023-12-09T02:35:07.579 INFO:tasks.workunit.client.1.smithi161.stdout:3/192: dread - d2/d4/d11/d1f/d2a/f2f zero size 2023-12-09T02:35:07.579 INFO:tasks.workunit.client.1.smithi161.stdout:3/193: fdatasync d2/d4/d11/f32 0 2023-12-09T02:35:07.580 INFO:tasks.workunit.client.1.smithi161.stdout:0/146: write f1 [4308872,114118] 0 2023-12-09T02:35:07.580 INFO:tasks.workunit.client.1.smithi161.stdout:0/147: fsync d9/f11 0 2023-12-09T02:35:07.584 INFO:tasks.workunit.client.1.smithi161.stdout:4/162: dread f7 [0,4194304] 0 2023-12-09T02:35:07.605 INFO:tasks.workunit.client.1.smithi161.stdout:2/140: dwrite d4/d1a/f1b [0,4194304] 0 2023-12-09T02:35:07.605 INFO:tasks.workunit.client.1.smithi161.stdout:2/141: write d4/d16/f29 [246713,125601] 0 2023-12-09T02:35:07.606 INFO:tasks.workunit.client.1.smithi161.stdout:7/228: dwrite d0/fc [0,4194304] 0 2023-12-09T02:35:07.606 INFO:tasks.workunit.client.1.smithi161.stdout:7/229: chown d0/d3/d13/d1b/l2a 805 1 2023-12-09T02:35:07.606 INFO:tasks.workunit.client.1.smithi161.stdout:7/230: dread - d0/d3/f46 zero size 2023-12-09T02:35:07.612 INFO:tasks.workunit.client.1.smithi161.stdout:0/148: dwrite d9/d1f/f18 [0,4194304] 0 2023-12-09T02:35:07.612 INFO:tasks.workunit.client.1.smithi161.stdout:0/149: chown f7 203070943 1 2023-12-09T02:35:07.624 INFO:tasks.workunit.client.1.smithi161.stdout:2/142: dwrite f1 [0,4194304] 0 2023-12-09T02:35:07.654 INFO:tasks.workunit.client.1.smithi161.stdout:3/194: link d2/d4/d2c/f29 d2/d4/f36 0 2023-12-09T02:35:07.656 INFO:tasks.workunit.client.1.smithi161.stdout:3/195: write d2/d4/f1e [688319,98834] 0 2023-12-09T02:35:07.656 INFO:tasks.workunit.client.1.smithi161.stdout:4/163: creat dd/d1a/d29/f37 x:0 0 0 2023-12-09T02:35:07.660 INFO:tasks.workunit.client.1.smithi161.stdout:0/150: mkdir d9/dd/d21/d26/d28 0 2023-12-09T02:35:07.660 INFO:tasks.workunit.client.1.smithi161.stdout:0/151: chown c2 7099655 1 2023-12-09T02:35:07.660 INFO:tasks.workunit.client.1.smithi161.stdout:1/328: rename d6/d8/da/dd/d11 to d6/d8/d63 0 2023-12-09T02:35:07.668 INFO:tasks.workunit.client.1.smithi161.stdout:0/152: dread d9/f1d [0,4194304] 0 2023-12-09T02:35:07.669 INFO:tasks.workunit.client.1.smithi161.stdout:2/143: creat d4/d16/f2c x:0 0 0 2023-12-09T02:35:07.671 INFO:tasks.workunit.client.1.smithi161.stdout:3/196: mkdir d2/d37 0 2023-12-09T02:35:07.671 INFO:tasks.workunit.client.1.smithi161.stdout:4/164: mknod dd/d1a/d1d/d25/c38 0 2023-12-09T02:35:07.673 INFO:tasks.workunit.client.1.smithi161.stdout:4/165: read dd/fe [4175634,34276] 0 2023-12-09T02:35:07.675 INFO:tasks.workunit.client.1.smithi161.stdout:7/231: rename d0/d3/l1a to d0/d3/d13/l47 0 2023-12-09T02:35:07.677 INFO:tasks.workunit.client.1.smithi161.stdout:0/153: link d9/c16 d9/dd/d21/d26/c29 0 2023-12-09T02:35:07.679 INFO:tasks.workunit.client.1.smithi161.stdout:3/197: truncate d2/fa 3502461 0 2023-12-09T02:35:07.681 INFO:tasks.workunit.client.1.smithi161.stdout:2/144: dread f1 [0,4194304] 0 2023-12-09T02:35:07.681 INFO:tasks.workunit.client.1.smithi161.stdout:2/145: write d4/fa [4904593,30950] 0 2023-12-09T02:35:07.681 INFO:tasks.workunit.client.1.smithi161.stdout:1/329: rename d6/d9/l28 to d6/d8/l64 0 2023-12-09T02:35:07.682 INFO:tasks.workunit.client.1.smithi161.stdout:0/154: mkdir d9/db/d2a 0 2023-12-09T02:35:07.685 INFO:tasks.workunit.client.1.smithi161.stdout:3/198: rmdir d2/d4/d11 39 2023-12-09T02:35:07.685 INFO:tasks.workunit.client.1.smithi161.stdout:3/199: fsync d2/d4/d2c/d2d/f34 0 2023-12-09T02:35:07.686 INFO:tasks.workunit.client.1.smithi161.stdout:3/200: stat d2/d4/d11 0 2023-12-09T02:35:07.687 INFO:tasks.workunit.client.1.smithi161.stdout:4/166: dwrite dd/fe [0,4194304] 0 2023-12-09T02:35:07.688 INFO:tasks.workunit.client.1.smithi161.stdout:7/232: rename d0/d3/c33 to d0/d3/d13/d1b/c48 0 2023-12-09T02:35:07.688 INFO:tasks.workunit.client.1.smithi161.stdout:7/233: chown d0/d3/d13/d1b/f2b 652513 1 2023-12-09T02:35:07.689 INFO:tasks.workunit.client.1.smithi161.stdout:7/234: write d0/d3/d13/f26 [583482,70172] 0 2023-12-09T02:35:07.689 INFO:tasks.workunit.client.1.smithi161.stdout:7/235: truncate d0/d3/d13/d1b/f2b 5540990 0 2023-12-09T02:35:07.690 INFO:tasks.workunit.client.1.smithi161.stdout:1/330: creat d6/d8/d63/f65 x:0 0 0 2023-12-09T02:35:07.690 INFO:tasks.workunit.client.1.smithi161.stdout:0/155: rmdir d9/db 39 2023-12-09T02:35:07.692 INFO:tasks.workunit.client.1.smithi161.stdout:3/201: getdents d2/d4/d11/d1f 0 2023-12-09T02:35:07.693 INFO:tasks.workunit.client.1.smithi161.stdout:4/167: mknod dd/d1a/d29/c39 0 2023-12-09T02:35:07.694 INFO:tasks.workunit.client.1.smithi161.stdout:7/236: mkdir d0/d49 0 2023-12-09T02:35:07.695 INFO:tasks.workunit.client.1.smithi161.stdout:1/331: rmdir d6/d8/d63/d4d/d46 0 2023-12-09T02:35:07.696 INFO:tasks.workunit.client.1.smithi161.stdout:1/332: fsync d6/d8/da/dd/f16 0 2023-12-09T02:35:07.697 INFO:tasks.workunit.client.1.smithi161.stdout:2/146: dwrite d4/d7/f2b [0,4194304] 0 2023-12-09T02:35:07.698 INFO:tasks.workunit.client.1.smithi161.stdout:0/156: link d9/d25/f22 d9/d25/f2b 0 2023-12-09T02:35:07.704 INFO:tasks.workunit.client.1.smithi161.stdout:3/202: getdents d2/d4/d11/d19 0 2023-12-09T02:35:07.706 INFO:tasks.workunit.client.1.smithi161.stdout:0/157: symlink d9/d1f/l2c 0 2023-12-09T02:35:07.706 INFO:tasks.workunit.client.1.smithi161.stdout:0/158: stat d9/db/d2a 0 2023-12-09T02:35:07.713 INFO:tasks.workunit.client.1.smithi161.stdout:0/159: creat d9/d25/f2d x:0 0 0 2023-12-09T02:35:07.717 INFO:tasks.workunit.client.1.smithi161.stdout:0/160: read d9/d25/f2b [4172453,109460] 0 2023-12-09T02:35:07.721 INFO:tasks.workunit.client.1.smithi161.stdout:0/161: write f7 [3766333,108180] 0 2023-12-09T02:35:07.721 INFO:tasks.workunit.client.1.smithi161.stdout:4/168: dwrite dd/fe [0,4194304] 0 2023-12-09T02:35:07.721 INFO:tasks.workunit.client.1.smithi161.stdout:4/169: fdatasync dd/d1a/d1d/d25/f2f 0 2023-12-09T02:35:07.723 INFO:tasks.workunit.client.1.smithi161.stdout:2/147: dwrite f1 [0,4194304] 0 2023-12-09T02:35:07.724 INFO:tasks.workunit.client.1.smithi161.stdout:0/162: mknod d9/c2e 0 2023-12-09T02:35:07.728 INFO:tasks.workunit.client.1.smithi161.stdout:2/148: link d4/d7/c8 d4/d7/c2d 0 2023-12-09T02:35:07.728 INFO:tasks.workunit.client.1.smithi161.stdout:2/149: dread - d4/f20 zero size 2023-12-09T02:35:07.732 INFO:tasks.workunit.client.1.smithi161.stdout:2/150: mknod d4/c2e 0 2023-12-09T02:35:07.750 INFO:tasks.workunit.client.1.smithi161.stdout:0/163: truncate f1 170883 0 2023-12-09T02:35:07.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.748+0000 7fa831dab700 1 -- 172.21.15.88:0/2590167649 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa82c10f5c0 con 0x7fa81806ad30 2023-12-09T02:35:07.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.749+0000 7fa823fff700 1 -- 172.21.15.88:0/2590167649 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fa82c10f5c0 con 0x7fa81806ad30 2023-12-09T02:35:07.752 INFO:tasks.workunit.client.1.smithi161.stdout:0/164: truncate d9/d25/f2b 2966182 0 2023-12-09T02:35:07.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.751+0000 7fa831dab700 1 -- 172.21.15.88:0/2590167649 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa81806ad30 msgr2=0x7fa81806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:07.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.751+0000 7fa831dab700 1 --2- 172.21.15.88:0/2590167649 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa81806ad30 0x7fa81806d1e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00b3b0 tx=0x7fa81c009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:07.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.751+0000 7fa831dab700 1 -- 172.21.15.88:0/2590167649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82c0fbaf0 msgr2=0x7fa82c10d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:07.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.751+0000 7fa831dab700 1 --2- 172.21.15.88:0/2590167649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82c0fbaf0 0x7fa82c10d570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa814002a80 tx=0x7fa814004600 comp rx=0 tx=0).stop 2023-12-09T02:35:07.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.752+0000 7fa831dab700 1 -- 172.21.15.88:0/2590167649 shutdown_connections 2023-12-09T02:35:07.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.752+0000 7fa831dab700 1 --2- 172.21.15.88:0/2590167649 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fa81806ad30 0x7fa81806d1e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:07.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.752+0000 7fa831dab700 1 --2- 172.21.15.88:0/2590167649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82c0fbaf0 0x7fa82c10d570 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:07.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.752+0000 7fa831dab700 1 --2- 172.21.15.88:0/2590167649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0fcd00 0x7fa82c10dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:07.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.752+0000 7fa831dab700 1 -- 172.21.15.88:0/2590167649 >> 172.21.15.88:0/2590167649 conn(0x7fa82c0f7190 msgr2=0x7fa82c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:07.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.752+0000 7fa831dab700 1 -- 172.21.15.88:0/2590167649 shutdown_connections 2023-12-09T02:35:07.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.752+0000 7fa831dab700 1 -- 172.21.15.88:0/2590167649 wait complete. 2023-12-09T02:35:07.755 INFO:tasks.workunit.client.1.smithi161.stdout:0/165: dread d9/f11 [0,4194304] 0 2023-12-09T02:35:07.755 INFO:tasks.workunit.client.1.smithi161.stdout:0/166: write d9/d25/f2d [694009,94147] 0 2023-12-09T02:35:07.755 INFO:tasks.workunit.client.1.smithi161.stdout:0/167: chown d9/db/l14 48 1 2023-12-09T02:35:07.755 INFO:tasks.workunit.client.1.smithi161.stdout:0/168: fdatasync f1 0 2023-12-09T02:35:07.755 INFO:tasks.workunit.client.1.smithi161.stdout:7/237: truncate d0/d29/f32 1605021 0 2023-12-09T02:35:07.756 INFO:tasks.workunit.client.1.smithi161.stdout:0/169: mknod d9/dd/d21/c2f 0 2023-12-09T02:35:07.756 INFO:tasks.workunit.client.1.smithi161.stdout:0/170: readlink d9/d1f/l2c 0 2023-12-09T02:35:07.759 INFO:tasks.workunit.client.1.smithi161.stdout:7/238: rename d0/d3/db to d0/d3/d13/d2d/d43/d4a 0 2023-12-09T02:35:07.759 INFO:tasks.workunit.client.1.smithi161.stdout:7/239: readlink d0/d3/d13/l14 0 2023-12-09T02:35:07.761 INFO:tasks.workunit.client.1.smithi161.stdout:7/240: unlink d0/d3/d13/f1e 0 2023-12-09T02:35:07.764 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:35:07.771 INFO:tasks.workunit.client.1.smithi161.stdout:8/137: sync 2023-12-09T02:35:07.772 INFO:tasks.workunit.client.1.smithi161.stdout:8/138: mkdir d2/d2d 0 2023-12-09T02:35:07.776 INFO:tasks.workunit.client.1.smithi161.stdout:8/139: creat d2/d23/f2e x:0 0 0 2023-12-09T02:35:07.782 INFO:tasks.workunit.client.1.smithi161.stdout:8/140: write d2/f17 [945891,80517] 0 2023-12-09T02:35:07.786 INFO:tasks.workunit.client.1.smithi161.stdout:8/141: dread d2/f3 [0,4194304] 0 2023-12-09T02:35:07.786 INFO:tasks.workunit.client.1.smithi161.stdout:8/142: rename d2/d23 to d2/d23/d2f 22 2023-12-09T02:35:07.790 INFO:tasks.workunit.client.1.smithi161.stdout:7/241: dwrite d0/d3/d13/d2d/f3c [0,4194304] 0 2023-12-09T02:35:07.792 INFO:tasks.workunit.client.1.smithi161.stdout:2/151: dwrite d4/d16/f1e [0,4194304] 0 2023-12-09T02:35:07.792 INFO:tasks.workunit.client.1.smithi161.stdout:2/152: write d4/d7/db/f19 [4555224,110953] 0 2023-12-09T02:35:07.810 INFO:tasks.workunit.client.1.smithi161.stdout:2/153: dwrite d4/d7/fc [0,4194304] 0 2023-12-09T02:35:07.818 INFO:tasks.workunit.client.1.smithi161.stdout:7/242: rmdir d0/d3/d13/d2d/d43/d4a 39 2023-12-09T02:35:07.818 INFO:tasks.workunit.client.1.smithi161.stdout:7/243: write d0/d3/f46 [666594,111244] 0 2023-12-09T02:35:07.818 INFO:tasks.workunit.client.1.smithi161.stdout:7/244: chown d0/d3/c11 2094441276 1 2023-12-09T02:35:07.818 INFO:tasks.workunit.client.1.smithi161.stdout:7/245: chown d0/d3/d13/l28 0 1 2023-12-09T02:35:07.818 INFO:tasks.workunit.client.1.smithi161.stdout:7/246: write d0/d3/d13/d2d/d43/d4a/f20 [1920739,114202] 0 2023-12-09T02:35:07.818 INFO:tasks.workunit.client.1.smithi161.stdout:7/247: fdatasync d0/d3/d13/f18 0 2023-12-09T02:35:07.818 INFO:tasks.workunit.client.1.smithi161.stdout:7/248: read - d0/d3/f25 zero size 2023-12-09T02:35:07.819 INFO:tasks.workunit.client.1.smithi161.stdout:2/154: creat d4/d7/db/f2f x:0 0 0 2023-12-09T02:35:07.819 INFO:tasks.workunit.client.1.smithi161.stdout:2/155: chown d4/d7/db/c23 1144354 1 2023-12-09T02:35:07.820 INFO:tasks.workunit.client.1.smithi161.stdout:2/156: chown d4/d7/f13 2515 1 2023-12-09T02:35:07.821 INFO:tasks.workunit.client.1.smithi161.stdout:7/249: mkdir d0/d3/d13/d2d/d43/d4b 0 2023-12-09T02:35:07.822 INFO:tasks.workunit.client.1.smithi161.stdout:7/250: dread d0/d3/d13/d2d/d43/d4a/f1c [0,4194304] 0 2023-12-09T02:35:07.823 INFO:tasks.workunit.client.1.smithi161.stdout:2/157: truncate d4/f17 3802112 0 2023-12-09T02:35:07.826 INFO:tasks.workunit.client.1.smithi161.stdout:0/171: dread d9/d25/f22 [0,4194304] 0 2023-12-09T02:35:07.826 INFO:tasks.workunit.client.1.smithi161.stdout:7/251: unlink d0/d3/c36 0 2023-12-09T02:35:07.830 INFO:tasks.workunit.client.1.smithi161.stdout:7/252: dread d0/d29/f2e [0,4194304] 0 2023-12-09T02:35:07.831 INFO:tasks.workunit.client.1.smithi161.stdout:7/253: write d0/d3/d13/d1b/f2b [2968940,102665] 0 2023-12-09T02:35:07.831 INFO:tasks.workunit.client.1.smithi161.stdout:7/254: stat d0/l23 0 2023-12-09T02:35:07.836 INFO:tasks.workunit.client.1.smithi161.stdout:2/158: creat d4/f30 x:0 0 0 2023-12-09T02:35:07.836 INFO:tasks.workunit.client.1.smithi161.stdout:0/172: getdents d9/dd/d21/d26 0 2023-12-09T02:35:07.838 INFO:tasks.workunit.client.1.smithi161.stdout:7/255: creat d0/d49/f4c x:0 0 0 2023-12-09T02:35:07.840 INFO:tasks.workunit.client.1.smithi161.stdout:2/159: link d4/d7/f15 d4/d7/f31 0 2023-12-09T02:35:07.845 INFO:tasks.workunit.client.1.smithi161.stdout:0/173: getdents d9/d25 0 2023-12-09T02:35:07.849 INFO:tasks.workunit.client.1.smithi161.stdout:7/256: mknod d0/d3/d21/d3e/c4d 0 2023-12-09T02:35:07.851 INFO:tasks.workunit.client.1.smithi161.stdout:2/160: mknod d4/d7/db/c32 0 2023-12-09T02:35:07.852 INFO:tasks.workunit.client.1.smithi161.stdout:7/257: write d0/d29/f2e [810603,102843] 0 2023-12-09T02:35:07.856 INFO:tasks.workunit.client.1.smithi161.stdout:0/174: unlink f1 0 2023-12-09T02:35:07.857 INFO:tasks.workunit.client.1.smithi161.stdout:0/175: chown d9/db 102399 1 2023-12-09T02:35:07.860 INFO:tasks.workunit.client.1.smithi161.stdout:2/161: getdents d4/d1a 0 2023-12-09T02:35:07.860 INFO:tasks.workunit.client.1.smithi161.stdout:7/258: mkdir d0/d3/d13/d4e 0 2023-12-09T02:35:07.862 INFO:tasks.workunit.client.1.smithi161.stdout:2/162: unlink d4/d7/db/l12 0 2023-12-09T02:35:07.862 INFO:tasks.workunit.client.1.smithi161.stdout:7/259: rmdir d0/d3/d13/d2d/d43 39 2023-12-09T02:35:07.865 INFO:tasks.workunit.client.1.smithi161.stdout:2/163: mknod d4/d7/db/c33 0 2023-12-09T02:35:07.868 INFO:tasks.workunit.client.1.smithi161.stdout:7/260: creat d0/d3/d13/d2d/d43/d4a/f4f x:0 0 0 2023-12-09T02:35:07.870 INFO:tasks.workunit.client.1.smithi161.stdout:2/164: symlink d4/l34 0 2023-12-09T02:35:07.871 INFO:tasks.workunit.client.1.smithi161.stdout:5/114: sync 2023-12-09T02:35:07.872 INFO:tasks.workunit.client.1.smithi161.stdout:7/261: unlink d0/d3/d13/d2d/f3c 0 2023-12-09T02:35:07.873 INFO:tasks.workunit.client.1.smithi161.stdout:2/165: creat d4/d1a/f35 x:0 0 0 2023-12-09T02:35:07.875 INFO:tasks.workunit.client.1.smithi161.stdout:5/115: rename d0/d9/l1c to d0/d2/d7/df/l29 0 2023-12-09T02:35:07.875 INFO:tasks.workunit.client.1.smithi161.stdout:5/116: chown d0/l24 233 1 2023-12-09T02:35:07.876 INFO:tasks.workunit.client.1.smithi161.stdout:7/262: mkdir d0/d3/d13/d2f/d50 0 2023-12-09T02:35:07.877 INFO:tasks.workunit.client.1.smithi161.stdout:2/166: truncate d4/d7/f31 3506627 0 2023-12-09T02:35:07.877 INFO:tasks.workunit.client.1.smithi161.stdout:5/117: symlink d0/d2/de/d22/l2a 0 2023-12-09T02:35:07.878 INFO:tasks.workunit.client.1.smithi161.stdout:0/176: dwrite d9/d25/f2b [0,4194304] 0 2023-12-09T02:35:07.878 INFO:tasks.workunit.client.1.smithi161.stdout:7/263: mknod d0/d29/c51 0 2023-12-09T02:35:07.881 INFO:tasks.workunit.client.1.smithi161.stdout:5/118: truncate d0/f1a 92856 0 2023-12-09T02:35:07.882 INFO:tasks.workunit.client.1.smithi161.stdout:0/177: creat d9/dd/f30 x:0 0 0 2023-12-09T02:35:07.883 INFO:tasks.workunit.client.1.smithi161.stdout:7/264: fsync d0/d3/f46 0 2023-12-09T02:35:07.883 INFO:tasks.workunit.client.1.smithi161.stdout:7/265: dread - d0/d3/d21/f3b zero size 2023-12-09T02:35:07.884 INFO:tasks.workunit.client.1.smithi161.stdout:5/119: truncate d0/f1 911112 0 2023-12-09T02:35:07.886 INFO:tasks.workunit.client.1.smithi161.stdout:0/178: mknod d9/dd/d21/d26/d28/c31 0 2023-12-09T02:35:07.889 INFO:tasks.workunit.client.1.smithi161.stdout:2/167: dread d4/d1a/f1b [0,4194304] 0 2023-12-09T02:35:07.890 INFO:tasks.workunit.client.1.smithi161.stdout:0/179: write d9/d25/f22 [4192509,68704] 0 2023-12-09T02:35:07.891 INFO:tasks.workunit.client.1.smithi161.stdout:7/266: symlink d0/d3/d13/d4e/l52 0 2023-12-09T02:35:07.892 INFO:tasks.workunit.client.1.smithi161.stdout:5/120: mknod d0/d9/c2b 0 2023-12-09T02:35:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.891+0000 7fc42deae700 1 -- 172.21.15.88:0/4134379159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4280fbaf0 msgr2=0x7fc4280fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.891+0000 7fc42deae700 1 --2- 172.21.15.88:0/4134379159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4280fbaf0 0x7fc4280fbf00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc418004940 tx=0x7fc418009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.891+0000 7fc42deae700 1 -- 172.21.15.88:0/4134379159 shutdown_connections 2023-12-09T02:35:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.891+0000 7fc42deae700 1 --2- 172.21.15.88:0/4134379159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4280fcd00 0x7fc4280fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.891+0000 7fc42deae700 1 --2- 172.21.15.88:0/4134379159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4280fbaf0 0x7fc4280fbf00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.891+0000 7fc42deae700 1 -- 172.21.15.88:0/4134379159 >> 172.21.15.88:0/4134379159 conn(0x7fc4280f7190 msgr2=0x7fc4280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.892+0000 7fc42deae700 1 -- 172.21.15.88:0/4134379159 shutdown_connections 2023-12-09T02:35:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.892+0000 7fc42deae700 1 -- 172.21.15.88:0/4134379159 wait complete. 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.892+0000 7fc42deae700 1 Processor -- start 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.892+0000 7fc42deae700 1 -- start start 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc42deae700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4280fbaf0 0x7fc428110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc42deae700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4280fcd00 0x7fc428112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc42deae700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc428066110 con 0x7fc4280fcd00 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc42deae700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc428066250 con 0x7fc4280fbaf0 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc426ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4280fcd00 0x7fc428112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc426ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4280fcd00 0x7fc428112760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55100/0 (socket says 172.21.15.88:55100) 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc426ffd700 1 -- 172.21.15.88:0/202803871 learned_addr learned my addr 172.21.15.88:0/202803871 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc4277fe700 1 --2- 172.21.15.88:0/202803871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4280fbaf0 0x7fc428110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc426ffd700 1 -- 172.21.15.88:0/202803871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4280fbaf0 msgr2=0x7fc428110210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc426ffd700 1 --2- 172.21.15.88:0/202803871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4280fbaf0 0x7fc428110210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc426ffd700 1 -- 172.21.15.88:0/202803871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc418005040 con 0x7fc4280fcd00 2023-12-09T02:35:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc426ffd700 1 --2- 172.21.15.88:0/202803871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4280fcd00 0x7fc428112760 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00eb40 tx=0x7fc41c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc40ffff700 1 -- 172.21.15.88:0/202803871 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc41c007cc0 con 0x7fc4280fcd00 2023-12-09T02:35:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc40ffff700 1 -- 172.21.15.88:0/202803871 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc41c00f040 con 0x7fc4280fcd00 2023-12-09T02:35:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc40ffff700 1 -- 172.21.15.88:0/202803871 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc41c009570 con 0x7fc4280fcd00 2023-12-09T02:35:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.893+0000 7fc42deae700 1 -- 172.21.15.88:0/202803871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc428112d60 con 0x7fc4280fcd00 2023-12-09T02:35:07.897 INFO:tasks.workunit.client.1.smithi161.stdout:0/180: mkdir d9/d25/d32 0 2023-12-09T02:35:07.898 INFO:tasks.workunit.client.1.smithi161.stdout:0/181: chown d9/d1f/l2c 1891 1 2023-12-09T02:35:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.894+0000 7fc42deae700 1 -- 172.21.15.88:0/202803871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc428113240 con 0x7fc4280fcd00 2023-12-09T02:35:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.894+0000 7fc42deae700 1 -- 172.21.15.88:0/202803871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42804bb80 con 0x7fc4280fcd00 2023-12-09T02:35:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.896+0000 7fc40ffff700 1 -- 172.21.15.88:0/202803871 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 88622+0+0 (secure 0 0 0) 0x7fc41c0096d0 con 0x7fc4280fcd00 2023-12-09T02:35:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.896+0000 7fc40ffff700 1 --2- 172.21.15.88:0/202803871 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc41006ad30 0x7fc41006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.896+0000 7fc40ffff700 1 -- 172.21.15.88:0/202803871 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc41c089260 con 0x7fc4280fcd00 2023-12-09T02:35:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.896+0000 7fc4277fe700 1 --2- 172.21.15.88:0/202803871 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc41006ad30 0x7fc41006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.896+0000 7fc4277fe700 1 --2- 172.21.15.88:0/202803871 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc41006ad30 0x7fc41006d1e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc418013680 tx=0x7fc418009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:07.899 INFO:tasks.workunit.client.1.smithi161.stdout:2/168: dread d4/f17 [0,4194304] 0 2023-12-09T02:35:07.899 INFO:tasks.workunit.client.1.smithi161.stdout:7/267: mkdir d0/d29/d53 0 2023-12-09T02:35:07.900 INFO:tasks.workunit.client.1.smithi161.stdout:5/121: creat d0/d2/de/d21/f2c x:0 0 0 2023-12-09T02:35:07.901 INFO:tasks.workunit.client.1.smithi161.stdout:2/169: getdents d4 0 2023-12-09T02:35:07.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:07.899+0000 7fc40ffff700 1 -- 172.21.15.88:0/202803871 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc41c055830 con 0x7fc4280fcd00 2023-12-09T02:35:07.903 INFO:tasks.workunit.client.1.smithi161.stdout:7/268: mkdir d0/d3/d21/d54 0 2023-12-09T02:35:07.903 INFO:tasks.workunit.client.1.smithi161.stdout:2/170: write d4/d7/db/f1d [849398,48319] 0 2023-12-09T02:35:07.905 INFO:tasks.workunit.client.1.smithi161.stdout:5/122: unlink d0/d2/d7/d11/l1e 0 2023-12-09T02:35:07.913 INFO:tasks.workunit.client.1.smithi161.stdout:5/123: mknod d0/d2/c2d 0 2023-12-09T02:35:07.913 INFO:tasks.workunit.client.1.smithi161.stdout:5/124: chown d0/d2/de/l1d 6 1 2023-12-09T02:35:07.916 INFO:tasks.workunit.client.1.smithi161.stdout:2/171: dread d4/f17 [0,4194304] 0 2023-12-09T02:35:07.919 INFO:tasks.workunit.client.1.smithi161.stdout:2/172: creat d4/d7/db/f36 x:0 0 0 2023-12-09T02:35:07.919 INFO:tasks.workunit.client.1.smithi161.stdout:2/173: write d4/d7/f31 [4394283,102978] 0 2023-12-09T02:35:07.919 INFO:tasks.workunit.client.1.smithi161.stdout:2/174: rename d4/d7 to d4/d7/db/d37 22 2023-12-09T02:35:07.920 INFO:tasks.workunit.client.1.smithi161.stdout:2/175: creat d4/d7/f38 x:0 0 0 2023-12-09T02:35:07.922 INFO:tasks.workunit.client.1.smithi161.stdout:2/176: symlink d4/d7/l39 0 2023-12-09T02:35:07.924 INFO:tasks.workunit.client.1.smithi161.stdout:0/182: dwrite d9/d1f/f18 [0,4194304] 0 2023-12-09T02:35:07.925 INFO:tasks.workunit.client.1.smithi161.stdout:7/269: rmdir d0 39 2023-12-09T02:35:07.925 INFO:tasks.workunit.client.1.smithi161.stdout:2/177: mknod d4/d7/c3a 0 2023-12-09T02:35:07.934 INFO:tasks.workunit.client.1.smithi161.stdout:0/183: creat d9/d25/f33 x:0 0 0 2023-12-09T02:35:07.937 INFO:tasks.workunit.client.1.smithi161.stdout:7/270: mknod d0/d3/d21/c55 0 2023-12-09T02:35:07.938 INFO:tasks.workunit.client.1.smithi161.stdout:0/184: fdatasync d9/dd/f30 0 2023-12-09T02:35:07.940 INFO:tasks.workunit.client.1.smithi161.stdout:0/185: truncate d9/f1d 1736241 0 2023-12-09T02:35:07.967 INFO:tasks.workunit.client.1.smithi161.stdout:2/178: dwrite f1 [0,4194304] 0 2023-12-09T02:35:07.968 INFO:tasks.workunit.client.1.smithi161.stdout:5/125: dwrite d0/f18 [0,4194304] 0 2023-12-09T02:35:07.969 INFO:tasks.workunit.client.1.smithi161.stdout:7/271: dwrite d0/d3/d13/f22 [0,4194304] 0 2023-12-09T02:35:07.986 INFO:tasks.workunit.client.1.smithi161.stdout:2/179: dread d4/d16/f1e [0,4194304] 0 2023-12-09T02:35:07.988 INFO:tasks.workunit.client.1.smithi161.stdout:2/180: unlink d4/d7/c2d 0 2023-12-09T02:35:07.988 INFO:tasks.workunit.client.1.smithi161.stdout:2/181: dread - d4/d7/db/f36 zero size 2023-12-09T02:35:07.988 INFO:tasks.workunit.client.1.smithi161.stdout:2/182: truncate d4/d16/f2c 455309 0 2023-12-09T02:35:07.989 INFO:tasks.workunit.client.1.smithi161.stdout:0/186: dwrite d9/d25/f2b [0,4194304] 0 2023-12-09T02:35:07.989 INFO:tasks.workunit.client.1.smithi161.stdout:0/187: chown d9/f20 2129908338 1 2023-12-09T02:35:07.991 INFO:tasks.workunit.client.1.smithi161.stdout:2/183: mknod d4/d7/db/c3b 0 2023-12-09T02:35:07.994 INFO:tasks.workunit.client.1.smithi161.stdout:2/184: creat d4/d1a/f3c x:0 0 0 2023-12-09T02:35:07.995 INFO:tasks.workunit.client.1.smithi161.stdout:2/185: creat d4/d1a/f3d x:0 0 0 2023-12-09T02:35:07.995 INFO:tasks.workunit.client.1.smithi161.stdout:2/186: chown d4/d1a/l21 33723739 1 2023-12-09T02:35:07.998 INFO:tasks.workunit.client.1.smithi161.stdout:5/126: dwrite d0/d2/de/d21/f28 [0,4194304] 0 2023-12-09T02:35:08.003 INFO:tasks.workunit.client.1.smithi161.stdout:5/127: symlink d0/d1f/l2e 0 2023-12-09T02:35:08.004 INFO:tasks.workunit.client.1.smithi161.stdout:5/128: symlink d0/l2f 0 2023-12-09T02:35:08.004 INFO:tasks.workunit.client.1.smithi161.stdout:5/129: fdatasync d0/f18 0 2023-12-09T02:35:08.005 INFO:tasks.workunit.client.1.smithi161.stdout:5/130: creat d0/d2/d7/df/f30 x:0 0 0 2023-12-09T02:35:08.009 INFO:tasks.workunit.client.1.smithi161.stdout:0/188: dwrite d9/dd/f30 [0,4194304] 0 2023-12-09T02:35:08.014 INFO:tasks.workunit.client.1.smithi161.stdout:0/189: mknod d9/dd/c34 0 2023-12-09T02:35:08.016 INFO:tasks.workunit.client.1.smithi161.stdout:0/190: mkdir d9/db/d2a/d35 0 2023-12-09T02:35:08.018 INFO:tasks.workunit.client.1.smithi161.stdout:0/191: read d9/d25/f2b [3257222,98408] 0 2023-12-09T02:35:08.020 INFO:tasks.workunit.client.1.smithi161.stdout:0/192: mknod d9/db/c36 0 2023-12-09T02:35:08.021 INFO:tasks.workunit.client.1.smithi161.stdout:0/193: mknod d9/dd/d21/d26/c37 0 2023-12-09T02:35:08.021 INFO:tasks.workunit.client.1.smithi161.stdout:0/194: creat d9/d25/f38 x:0 0 0 2023-12-09T02:35:08.021 INFO:tasks.workunit.client.1.smithi161.stdout:0/195: truncate d9/d1f/f18 4500225 0 2023-12-09T02:35:08.022 INFO:tasks.workunit.client.1.smithi161.stdout:0/196: symlink d9/d1f/l39 0 2023-12-09T02:35:08.023 INFO:tasks.workunit.client.1.smithi161.stdout:0/197: mkdir d9/dd/d3a 0 2023-12-09T02:35:08.024 INFO:tasks.workunit.client.1.smithi161.stdout:0/198: getdents d9/dd/d21/d26/d28 0 2023-12-09T02:35:08.025 INFO:tasks.workunit.client.1.smithi161.stdout:0/199: unlink d9/dd/c1c 0 2023-12-09T02:35:08.028 INFO:tasks.workunit.client.1.smithi161.stdout:9/152: sync 2023-12-09T02:35:08.028 INFO:tasks.workunit.client.1.smithi161.stdout:9/153: rename d2/d25 to d2/d25/d2f 22 2023-12-09T02:35:08.028 INFO:tasks.workunit.client.1.smithi161.stdout:6/149: sync 2023-12-09T02:35:08.029 INFO:tasks.workunit.client.1.smithi161.stdout:9/154: read d2/f9 [2000662,18451] 0 2023-12-09T02:35:08.029 INFO:tasks.workunit.client.1.smithi161.stdout:0/200: symlink d9/dd/d21/d26/l3b 0 2023-12-09T02:35:08.029 INFO:tasks.workunit.client.1.smithi161.stdout:5/131: dwrite d0/f1 [0,4194304] 0 2023-12-09T02:35:08.030 INFO:tasks.workunit.client.1.smithi161.stdout:5/132: creat d0/d2/d7/df/f31 x:0 0 0 2023-12-09T02:35:08.030 INFO:tasks.workunit.client.1.smithi161.stdout:5/133: chown d0/d2/de/d21/f2c 1141474195 1 2023-12-09T02:35:08.031 INFO:tasks.workunit.client.1.smithi161.stdout:6/150: truncate da/df/f13 6428575 0 2023-12-09T02:35:08.032 INFO:tasks.workunit.client.1.smithi161.stdout:7/272: dwrite d0/d3/d13/d2d/d43/d4a/f10 [0,4194304] 0 2023-12-09T02:35:08.033 INFO:tasks.workunit.client.1.smithi161.stdout:5/134: unlink d0/d2/c2d 0 2023-12-09T02:35:08.034 INFO:tasks.workunit.client.1.smithi161.stdout:6/151: rename da/cb to da/df/d2d/c36 0 2023-12-09T02:35:08.038 INFO:tasks.workunit.client.1.smithi161.stdout:7/273: getdents d0/d3/d13/d4e 0 2023-12-09T02:35:08.038 INFO:tasks.workunit.client.1.smithi161.stdout:7/274: stat d0/d3/f17 0 2023-12-09T02:35:08.039 INFO:tasks.workunit.client.1.smithi161.stdout:6/152: mknod da/d28/d29/c37 0 2023-12-09T02:35:08.045 INFO:tasks.workunit.client.1.smithi161.stdout:5/135: getdents d0/d1f 0 2023-12-09T02:35:08.045 INFO:tasks.workunit.client.1.smithi161.stdout:5/136: chown d0/l2f 0 1 2023-12-09T02:35:08.069 INFO:tasks.workunit.client.1.smithi161.stdout:0/201: dwrite d9/dd/f1e [0,4194304] 0 2023-12-09T02:35:08.070 INFO:tasks.workunit.client.1.smithi161.stdout:6/153: dwrite da/fd [0,4194304] 0 2023-12-09T02:35:08.070 INFO:tasks.workunit.client.1.smithi161.stdout:5/137: dwrite d0/d2/f16 [8388608,4194304] 0 2023-12-09T02:35:08.070 INFO:tasks.workunit.client.1.smithi161.stdout:7/275: dwrite d0/d3/d13/d1b/f2b [4194304,4194304] 0 2023-12-09T02:35:08.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.120+0000 7fc42deae700 1 -- 172.21.15.88:0/202803871 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc428101650 con 0x7fc41006ad30 2023-12-09T02:35:08.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.121+0000 7fc40ffff700 1 -- 172.21.15.88:0/202803871 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fc428101650 con 0x7fc41006ad30 2023-12-09T02:35:08.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.123+0000 7fc42deae700 1 -- 172.21.15.88:0/202803871 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc41006ad30 msgr2=0x7fc41006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:08.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.123+0000 7fc42deae700 1 --2- 172.21.15.88:0/202803871 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc41006ad30 0x7fc41006d1e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc418013680 tx=0x7fc418009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:08.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.123+0000 7fc42deae700 1 -- 172.21.15.88:0/202803871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4280fcd00 msgr2=0x7fc428112760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:08.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.123+0000 7fc42deae700 1 --2- 172.21.15.88:0/202803871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4280fcd00 0x7fc428112760 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00eb40 tx=0x7fc41c00b040 comp rx=0 tx=0).stop 2023-12-09T02:35:08.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.123+0000 7fc42deae700 1 -- 172.21.15.88:0/202803871 shutdown_connections 2023-12-09T02:35:08.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.123+0000 7fc42deae700 1 --2- 172.21.15.88:0/202803871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4280fbaf0 0x7fc428110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.123+0000 7fc42deae700 1 --2- 172.21.15.88:0/202803871 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fc41006ad30 0x7fc41006d1e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.123+0000 7fc42deae700 1 --2- 172.21.15.88:0/202803871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4280fcd00 0x7fc428112760 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.123+0000 7fc42deae700 1 -- 172.21.15.88:0/202803871 >> 172.21.15.88:0/202803871 conn(0x7fc4280f7190 msgr2=0x7fc4280fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:08.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.123+0000 7fc42deae700 1 -- 172.21.15.88:0/202803871 shutdown_connections 2023-12-09T02:35:08.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.123+0000 7fc42deae700 1 -- 172.21.15.88:0/202803871 wait complete. 2023-12-09T02:35:08.197 INFO:tasks.workunit.client.1.smithi161.stdout:0/202: mknod d9/d25/c3c 0 2023-12-09T02:35:08.206 INFO:tasks.workunit.client.1.smithi161.stdout:6/154: mknod da/d28/d29/d2b/d31/d33/c38 0 2023-12-09T02:35:08.214 INFO:tasks.workunit.client.1.smithi161.stdout:5/138: rename d0/d2/f1b to d0/d2/de/d22/f32 0 2023-12-09T02:35:08.215 INFO:tasks.workunit.client.1.smithi161.stdout:7/276: creat d0/d3/d13/f56 x:0 0 0 2023-12-09T02:35:08.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.224+0000 7f224c919700 1 -- 172.21.15.88:0/3264319823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22480fde00 msgr2=0x7f22480fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.224+0000 7f224c919700 1 --2- 172.21.15.88:0/3264319823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22480fde00 0x7f22480fe250 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f223c004940 tx=0x7f223c009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.224+0000 7f224c919700 1 -- 172.21.15.88:0/3264319823 shutdown_connections 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.224+0000 7f224c919700 1 --2- 172.21.15.88:0/3264319823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22480fde00 0x7f22480fe250 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.224+0000 7f224c919700 1 --2- 172.21.15.88:0/3264319823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22480fcbf0 0x7f22480fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.224+0000 7f224c919700 1 -- 172.21.15.88:0/3264319823 >> 172.21.15.88:0/3264319823 conn(0x7f22480f82d0 msgr2=0x7f22480fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.224+0000 7f224c919700 1 -- 172.21.15.88:0/3264319823 shutdown_connections 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.224+0000 7f224c919700 1 -- 172.21.15.88:0/3264319823 wait complete. 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224c919700 1 Processor -- start 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224c919700 1 -- start start 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224c919700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22480fcbf0 0x7f224810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224c919700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22480fde00 0x7f224810dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224c919700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224810e140 con 0x7f22480fcbf0 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224c919700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224810e980 con 0x7f22480fde00 2023-12-09T02:35:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22480fcbf0 0x7f224810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22480fcbf0 0x7f224810d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55116/0 (socket says 172.21.15.88:55116) 2023-12-09T02:35:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224659c700 1 -- 172.21.15.88:0/3351591170 learned_addr learned my addr 172.21.15.88:0/3351591170 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224659c700 1 -- 172.21.15.88:0/3351591170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22480fde00 msgr2=0x7f224810dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224659c700 1 --2- 172.21.15.88:0/3351591170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22480fde00 0x7f224810dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224659c700 1 -- 172.21.15.88:0/3351591170 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c005040 con 0x7f22480fcbf0 2023-12-09T02:35:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224659c700 1 --2- 172.21.15.88:0/3351591170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22480fcbf0 0x7f224810d570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f223800b790 tx=0x7f2238009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f2236ffd700 1 -- 172.21.15.88:0/3351591170 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f223800f6f0 con 0x7f22480fcbf0 2023-12-09T02:35:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f2236ffd700 1 -- 172.21.15.88:0/3351591170 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f223800fd00 con 0x7f22480fcbf0 2023-12-09T02:35:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224c919700 1 -- 172.21.15.88:0/3351591170 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224810ec60 con 0x7f22480fcbf0 2023-12-09T02:35:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f2236ffd700 1 -- 172.21.15.88:0/3351591170 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22380103a0 con 0x7f22480fcbf0 2023-12-09T02:35:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.225+0000 7f224c919700 1 -- 172.21.15.88:0/3351591170 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224810f1a0 con 0x7f22480fcbf0 2023-12-09T02:35:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.226+0000 7f224c919700 1 -- 172.21.15.88:0/3351591170 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224804bb80 con 0x7f22480fcbf0 2023-12-09T02:35:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.227+0000 7f2236ffd700 1 -- 172.21.15.88:0/3351591170 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 88622+0+0 (secure 0 0 0) 0x7f223800f850 con 0x7f22480fcbf0 2023-12-09T02:35:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.227+0000 7f2236ffd700 1 --2- 172.21.15.88:0/3351591170 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f223006ad20 0x7f223006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.227+0000 7f2236ffd700 1 -- 172.21.15.88:0/3351591170 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f22380892f0 con 0x7f22480fcbf0 2023-12-09T02:35:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.227+0000 7f2245d9b700 1 --2- 172.21.15.88:0/3351591170 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f223006ad20 0x7f223006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:08.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.228+0000 7f2245d9b700 1 --2- 172.21.15.88:0/3351591170 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f223006ad20 0x7f223006d1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f223c00b3b0 tx=0x7f223c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:08.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.231+0000 7f2236ffd700 1 -- 172.21.15.88:0/3351591170 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2238059180 con 0x7f22480fcbf0 2023-12-09T02:35:08.234 INFO:tasks.workunit.client.1.smithi161.stdout:0/203: creat d9/dd/d3a/f3d x:0 0 0 2023-12-09T02:35:08.241 INFO:tasks.workunit.client.1.smithi161.stdout:6/155: mkdir da/d28/d29/d2b/d31/d33/d39 0 2023-12-09T02:35:08.241 INFO:tasks.workunit.client.1.smithi161.stdout:6/156: truncate da/df/f14 4893310 0 2023-12-09T02:35:08.241 INFO:tasks.workunit.client.1.smithi161.stdout:6/157: stat da/df/c18 0 2023-12-09T02:35:08.242 INFO:tasks.workunit.client.1.smithi161.stdout:5/139: symlink d0/d2/de/d21/l33 0 2023-12-09T02:35:08.242 INFO:tasks.workunit.client.1.smithi161.stdout:5/140: fdatasync d0/d2/f3 0 2023-12-09T02:35:08.245 INFO:tasks.workunit.client.1.smithi161.stdout:7/277: creat d0/d3/d13/d2f/d50/f57 x:0 0 0 2023-12-09T02:35:08.250 INFO:tasks.workunit.client.1.smithi161.stdout:5/141: rename d0/d2/d7/df/l29 to d0/d2/de/d22/l34 0 2023-12-09T02:35:08.253 INFO:tasks.workunit.client.1.smithi161.stdout:7/278: creat d0/d3/d13/f58 x:0 0 0 2023-12-09T02:35:08.257 INFO:tasks.workunit.client.1.smithi161.stdout:5/142: rename d0/d2/d7/df/f30 to d0/d2/d7/d11/f35 0 2023-12-09T02:35:08.258 INFO:tasks.workunit.client.1.smithi161.stdout:5/143: symlink d0/l36 0 2023-12-09T02:35:08.258 INFO:tasks.workunit.client.1.smithi161.stdout:5/144: fdatasync d0/d2/f16 0 2023-12-09T02:35:08.258 INFO:tasks.workunit.client.1.smithi161.stdout:5/145: truncate d0/d2/d7/d11/f35 322202 0 2023-12-09T02:35:08.260 INFO:tasks.workunit.client.1.smithi161.stdout:0/204: dwrite d9/d25/f22 [0,4194304] 0 2023-12-09T02:35:08.262 INFO:tasks.workunit.client.1.smithi161.stdout:6/158: dwrite da/df/f13 [0,4194304] 0 2023-12-09T02:35:08.262 INFO:tasks.workunit.client.1.smithi161.stdout:6/159: fsync da/df/d2d/f32 0 2023-12-09T02:35:08.266 INFO:tasks.workunit.client.1.smithi161.stdout:6/160: unlink c4 0 2023-12-09T02:35:08.271 INFO:tasks.workunit.client.1.smithi161.stdout:6/161: rename da/df/f11 to da/df/f3a 0 2023-12-09T02:35:08.283 INFO:tasks.workunit.client.1.smithi161.stdout:0/205: dwrite d9/d25/f33 [0,4194304] 0 2023-12-09T02:35:08.283 INFO:tasks.workunit.client.1.smithi161.stdout:0/206: readlink d9/d1f/l2c 0 2023-12-09T02:35:08.283 INFO:tasks.workunit.client.1.smithi161.stdout:0/207: chown d9/dd/f30 12502603 1 2023-12-09T02:35:08.283 INFO:tasks.workunit.client.1.smithi161.stdout:0/208: fdatasync d9/d25/f2b 0 2023-12-09T02:35:08.289 INFO:tasks.workunit.client.1.smithi161.stdout:0/209: creat d9/db/f3e x:0 0 0 2023-12-09T02:35:08.294 INFO:tasks.workunit.client.1.smithi161.stdout:0/210: rename d9/d1f/l2c to d9/dd/l3f 0 2023-12-09T02:35:08.296 INFO:tasks.workunit.client.1.smithi161.stdout:5/146: dwrite d0/d2/de/d21/f28 [0,4194304] 0 2023-12-09T02:35:08.296 INFO:tasks.workunit.client.1.smithi161.stdout:5/147: read d0/d2/d7/d11/f35 [228687,118057] 0 2023-12-09T02:35:08.297 INFO:tasks.workunit.client.1.smithi161.stdout:0/211: unlink d9/dd/d21/d26/c29 0 2023-12-09T02:35:08.297 INFO:tasks.workunit.client.1.smithi161.stdout:0/212: chown d9/d25/f22 202 1 2023-12-09T02:35:08.297 INFO:tasks.workunit.client.1.smithi161.stdout:6/162: dwrite da/d28/d29/d2b/d31/f35 [0,4194304] 0 2023-12-09T02:35:08.302 INFO:tasks.workunit.client.1.smithi161.stdout:0/213: symlink d9/db/d2a/d35/l40 0 2023-12-09T02:35:08.302 INFO:tasks.workunit.client.1.smithi161.stdout:0/214: truncate d9/db/f3e 951509 0 2023-12-09T02:35:08.307 INFO:tasks.workunit.client.1.smithi161.stdout:6/163: rmdir da 39 2023-12-09T02:35:08.311 INFO:tasks.workunit.client.1.smithi161.stdout:0/215: symlink d9/dd/d3a/l41 0 2023-12-09T02:35:08.312 INFO:tasks.workunit.client.1.smithi161.stdout:6/164: mkdir da/df/d2d/d3b 0 2023-12-09T02:35:08.312 INFO:tasks.workunit.client.1.smithi161.stdout:6/165: fdatasync da/df/f3a 0 2023-12-09T02:35:08.335 INFO:tasks.workunit.client.1.smithi161.stdout:6/166: dwrite da/d19/f23 [0,4194304] 0 2023-12-09T02:35:08.338 INFO:tasks.workunit.client.1.smithi161.stdout:5/148: getdents d0/d2 0 2023-12-09T02:35:08.343 INFO:tasks.workunit.client.1.smithi161.stdout:6/167: mkdir da/d28/d3c 0 2023-12-09T02:35:08.344 INFO:tasks.workunit.client.1.smithi161.stdout:5/149: dread d0/d1f/f23 [0,4194304] 0 2023-12-09T02:35:08.344 INFO:tasks.workunit.client.1.smithi161.stdout:5/150: truncate d0/f1a 268973 0 2023-12-09T02:35:08.344 INFO:tasks.workunit.client.1.smithi161.stdout:5/151: readlink d0/l2f 0 2023-12-09T02:35:08.346 INFO:tasks.workunit.client.1.smithi161.stdout:5/152: write d0/d2/de/d21/f28 [842337,91555] 0 2023-12-09T02:35:08.346 INFO:tasks.workunit.client.1.smithi161.stdout:0/216: truncate d9/d1f/f18 124372 0 2023-12-09T02:35:08.347 INFO:tasks.workunit.client.1.smithi161.stdout:5/153: write d0/f27 [904341,28160] 0 2023-12-09T02:35:08.347 INFO:tasks.workunit.client.1.smithi161.stdout:5/154: chown d0/d2/f3 49543 1 2023-12-09T02:35:08.347 INFO:tasks.workunit.client.1.smithi161.stdout:0/217: write d9/d25/f2d [345246,107777] 0 2023-12-09T02:35:08.347 INFO:tasks.workunit.client.1.smithi161.stdout:0/218: stat d9/c2e 0 2023-12-09T02:35:08.348 INFO:tasks.workunit.client.1.smithi161.stdout:0/219: chown d9/f11 35 1 2023-12-09T02:35:08.349 INFO:tasks.workunit.client.1.smithi161.stdout:5/155: creat d0/d2/d7/d11/f37 x:0 0 0 2023-12-09T02:35:08.353 INFO:tasks.workunit.client.1.smithi161.stdout:5/156: mknod d0/d2/c38 0 2023-12-09T02:35:08.355 INFO:tasks.workunit.client.1.smithi161.stdout:5/157: write d0/f1 [101546,127053] 0 2023-12-09T02:35:08.364 INFO:tasks.workunit.client.1.smithi161.stdout:6/168: dwrite da/df/f2f [0,4194304] 0 2023-12-09T02:35:08.364 INFO:tasks.workunit.client.1.smithi161.stdout:1/333: sync 2023-12-09T02:35:08.364 INFO:tasks.workunit.client.1.smithi161.stdout:1/334: write d6/d8/da/dd/f48 [783473,19489] 0 2023-12-09T02:35:08.364 INFO:tasks.workunit.client.1.smithi161.stdout:1/335: readlink d6/d9/l3f 0 2023-12-09T02:35:08.370 INFO:tasks.workunit.client.1.smithi161.stdout:1/336: creat d6/d9/d5c/f66 x:0 0 0 2023-12-09T02:35:08.371 INFO:tasks.workunit.client.1.smithi161.stdout:5/158: getdents d0/d2/d7/df 0 2023-12-09T02:35:08.378 INFO:tasks.workunit.client.1.smithi161.stdout:1/337: symlink d6/d8/da/d47/l67 0 2023-12-09T02:35:08.379 INFO:tasks.workunit.client.1.smithi161.stdout:1/338: dread d6/f38 [0,4194304] 0 2023-12-09T02:35:08.385 INFO:tasks.workunit.client.1.smithi161.stdout:5/159: dwrite d0/d2/de/d21/f2c [0,4194304] 0 2023-12-09T02:35:08.385 INFO:tasks.workunit.client.1.smithi161.stdout:6/169: dwrite f1 [0,4194304] 0 2023-12-09T02:35:08.389 INFO:tasks.workunit.client.1.smithi161.stdout:5/160: creat d0/d2/d7/f39 x:0 0 0 2023-12-09T02:35:08.390 INFO:tasks.workunit.client.1.smithi161.stdout:5/161: creat d0/d2/d7/df/f3a x:0 0 0 2023-12-09T02:35:08.392 INFO:tasks.workunit.client.1.smithi161.stdout:5/162: rmdir d0/d2/de/d21 39 2023-12-09T02:35:08.394 INFO:tasks.workunit.client.1.smithi161.stdout:5/163: creat d0/d1f/f3b x:0 0 0 2023-12-09T02:35:08.394 INFO:tasks.workunit.client.1.smithi161.stdout:5/164: write d0/d2/d7/df/f3a [968162,32009] 0 2023-12-09T02:35:08.395 INFO:tasks.workunit.client.1.smithi161.stdout:5/165: unlink d0/l19 0 2023-12-09T02:35:08.396 INFO:tasks.workunit.client.1.smithi161.stdout:5/166: link d0/d2/d7/c20 d0/c3c 0 2023-12-09T02:35:08.397 INFO:tasks.workunit.client.1.smithi161.stdout:6/170: truncate da/d28/d29/d2b/d31/f35 597684 0 2023-12-09T02:35:08.399 INFO:tasks.workunit.client.1.smithi161.stdout:6/171: getdents da/d19 0 2023-12-09T02:35:08.402 INFO:tasks.workunit.client.1.smithi161.stdout:0/220: rmdir d9/dd 39 2023-12-09T02:35:08.403 INFO:tasks.workunit.client.1.smithi161.stdout:0/221: chown d9/dd/d3a/f3d 1459012 1 2023-12-09T02:35:08.404 INFO:tasks.workunit.client.1.smithi161.stdout:0/222: creat d9/dd/d21/d26/f42 x:0 0 0 2023-12-09T02:35:08.404 INFO:tasks.workunit.client.1.smithi161.stdout:6/172: rmdir da/df 39 2023-12-09T02:35:08.405 INFO:tasks.workunit.client.1.smithi161.stdout:6/173: symlink da/d28/d29/d2b/d31/d33/d39/l3d 0 2023-12-09T02:35:08.406 INFO:tasks.workunit.client.1.smithi161.stdout:6/174: read da/df/f14 [4140670,113681] 0 2023-12-09T02:35:08.406 INFO:tasks.workunit.client.1.smithi161.stdout:0/223: read d9/d25/f33 [2081430,66146] 0 2023-12-09T02:35:08.408 INFO:tasks.workunit.client.1.smithi161.stdout:6/175: creat da/d28/d29/d2b/d31/d33/f3e x:0 0 0 2023-12-09T02:35:08.409 INFO:tasks.workunit.client.1.smithi161.stdout:0/224: getdents d9/db 0 2023-12-09T02:35:08.412 INFO:tasks.workunit.client.1.smithi161.stdout:6/176: creat da/df/f3f x:0 0 0 2023-12-09T02:35:08.412 INFO:tasks.workunit.client.1.smithi161.stdout:6/177: write f1 [2795547,44804] 0 2023-12-09T02:35:08.419 INFO:tasks.workunit.client.1.smithi161.stdout:5/167: dwrite d0/d2/f3 [0,4194304] 0 2023-12-09T02:35:08.423 INFO:tasks.workunit.client.1.smithi161.stdout:5/168: creat d0/f3d x:0 0 0 2023-12-09T02:35:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:5/169: write d0/f1 [480323,120579] 0 2023-12-09T02:35:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:5/170: chown d0/l2f 18 1 2023-12-09T02:35:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:5/171: write d0/d2/d7/f39 [1046176,49744] 0 2023-12-09T02:35:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:5/172: readlink d0/l2f 0 2023-12-09T02:35:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/203: sync 2023-12-09T02:35:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:4/170: sync 2023-12-09T02:35:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:4/171: chown lb 119345 1 2023-12-09T02:35:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/204: readlink d2/d4/lc 0 2023-12-09T02:35:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/205: write d2/d4/f18 [990948,10937] 0 2023-12-09T02:35:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/206: read d2/d4/d11/d28/f22 [472852,78493] 0 2023-12-09T02:35:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/207: truncate d2/d4/f27 1004755 0 2023-12-09T02:35:08.426 INFO:tasks.workunit.client.1.smithi161.stdout:5/173: mkdir d0/d3e 0 2023-12-09T02:35:08.426 INFO:tasks.workunit.client.1.smithi161.stdout:5/174: read d0/d2/d7/df/f3a [436107,23540] 0 2023-12-09T02:35:08.426 INFO:tasks.workunit.client.1.smithi161.stdout:5/175: chown d0/d2/d7/f39 10916 1 2023-12-09T02:35:08.427 INFO:tasks.workunit.client.1.smithi161.stdout:4/172: mkdir dd/d1a/d1d/d25/d3a 0 2023-12-09T02:35:08.427 INFO:tasks.workunit.client.1.smithi161.stdout:4/173: readlink dd/d1a/d1d/l20 0 2023-12-09T02:35:08.428 INFO:tasks.workunit.client.1.smithi161.stdout:5/176: creat d0/d2/de/f3f x:0 0 0 2023-12-09T02:35:08.434 INFO:tasks.workunit.client.1.smithi161.stdout:5/177: rename d0/d9/l15 to d0/l40 0 2023-12-09T02:35:08.441 INFO:tasks.workunit.client.1.smithi161.stdout:3/208: dread d2/d4/d11/d1f/f25 [0,4194304] 0 2023-12-09T02:35:08.442 INFO:tasks.workunit.client.1.smithi161.stdout:3/209: creat d2/d37/f38 x:0 0 0 2023-12-09T02:35:08.444 INFO:tasks.workunit.client.1.smithi161.stdout:4/174: dwrite dd/fe [0,4194304] 0 2023-12-09T02:35:08.444 INFO:tasks.workunit.client.1.smithi161.stdout:3/210: rename d2/d4/d11/d19/c35 to d2/c39 0 2023-12-09T02:35:08.446 INFO:tasks.workunit.client.1.smithi161.stdout:4/175: creat dd/d1a/d1d/d25/f3b x:0 0 0 2023-12-09T02:35:08.447 INFO:tasks.workunit.client.1.smithi161.stdout:3/211: rmdir d2/d4/d2c/d2d 39 2023-12-09T02:35:08.447 INFO:tasks.workunit.client.1.smithi161.stdout:3/212: truncate d2/d4/d11/f32 822405 0 2023-12-09T02:35:08.447 INFO:tasks.workunit.client.1.smithi161.stdout:3/213: write d2/d4/d11/f32 [1644083,25429] 0 2023-12-09T02:35:08.448 INFO:tasks.workunit.client.1.smithi161.stdout:4/176: mknod dd/d1a/d1d/d25/d32/d34/c3c 0 2023-12-09T02:35:08.450 INFO:tasks.workunit.client.1.smithi161.stdout:4/177: creat dd/d1a/d1d/d25/f3d x:0 0 0 2023-12-09T02:35:08.450 INFO:tasks.workunit.client.1.smithi161.stdout:4/178: chown dd/d1a 113 1 2023-12-09T02:35:08.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.448+0000 7f224c919700 1 -- 172.21.15.88:0/3351591170 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f224810f700 con 0x7f223006ad20 2023-12-09T02:35:08.451 INFO:tasks.workunit.client.1.smithi161.stdout:4/179: symlink dd/d36/l3e 0 2023-12-09T02:35:08.453 INFO:tasks.workunit.client.1.smithi161.stdout:3/214: dread d2/d4/d11/f32 [0,4194304] 0 2023-12-09T02:35:08.453 INFO:tasks.workunit.client.1.smithi161.stdout:3/215: fsync d2/d4/f23 0 2023-12-09T02:35:08.453 INFO:tasks.workunit.client.1.smithi161.stdout:4/180: mkdir dd/d36/d3f 0 2023-12-09T02:35:08.453 INFO:tasks.workunit.client.1.smithi161.stdout:4/181: fsync f9 0 2023-12-09T02:35:08.455 INFO:tasks.workunit.client.1.smithi161.stdout:3/216: creat d2/d4/d11/d19/f3a x:0 0 0 2023-12-09T02:35:08.456 INFO:tasks.workunit.client.1.smithi161.stdout:4/182: link dd/f18 dd/d1a/d1d/d25/d3a/f40 0 2023-12-09T02:35:08.456 INFO:tasks.workunit.client.1.smithi161.stdout:4/183: write dd/f19 [780875,106116] 0 2023-12-09T02:35:08.456 INFO:tasks.workunit.client.1.smithi161.stdout:4/184: write dd/d1a/d1d/d25/f30 [1005720,40618] 0 2023-12-09T02:35:08.456 INFO:tasks.workunit.client.1.smithi161.stdout:4/185: write dd/d1a/d1d/d25/f3d [443466,43772] 0 2023-12-09T02:35:08.459 INFO:tasks.workunit.client.1.smithi161.stdout:4/186: creat dd/d1a/d1d/d25/d32/f41 x:0 0 0 2023-12-09T02:35:08.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.458+0000 7f2236ffd700 1 -- 172.21.15.88:0/3351591170 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f224810f700 con 0x7f223006ad20 2023-12-09T02:35:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:35:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (5m) 2m ago 6m 28.4M - 0.25.0 c8568f914cd2 578f197f8707 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (6m) 2m ago 6m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 9098f424ee11 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (5m) 4s ago 5m 7486k - 17.2.7-119-ge2143d99 f761b6e42225 15c5154f5f2e 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (5m) 2m ago 5m 89.6M - 9.4.7 954c08fa6188 04aa719e29b6 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (2m) 2m ago 2m 11.9M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (2m) 2m ago 2m 13.3M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (2m) 4s ago 2m 2313M - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (2m) 4s ago 2m 13.6M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:9283 running (7m) 2m ago 7m 496M - 17.2.7-119-ge2143d99 f761b6e42225 0fffc89bc055 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283 running (33s) 4s ago 5m 69.7M - 19.0.0-44-g9dcc13bb f28f2b94f153 86d2f55bb861 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (7m) 2m ago 7m 74.6M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d21a10406297 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (5m) 4s ago 5m 54.5M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d6b9d9265450 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (6m) 2m ago 6m 14.8M - 1.5.0 0da6a335fe13 0a3f7cc72867 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (5m) 4s ago 5m 17.3M - 1.5.0 0da6a335fe13 43bf179905a8 2023-12-09T02:35:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (4m) 2m ago 4m 54.8M 4299M 17.2.7-119-ge2143d99 f761b6e42225 fdd606881a64 2023-12-09T02:35:08.462 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (4m) 2m ago 4m 58.0M 4299M 17.2.7-119-ge2143d99 f761b6e42225 354d4a4d3430 2023-12-09T02:35:08.462 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (4m) 2m ago 4m 57.5M 4299M 17.2.7-119-ge2143d99 f761b6e42225 0b0abbb070ec 2023-12-09T02:35:08.462 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (3m) 4s ago 3m 295M 5323M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:35:08.462 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (3m) 4s ago 3m 245M 5323M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:35:08.462 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (3m) 4s ago 3m 287M 5323M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:35:08.462 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (4m) 2m ago 5m 48.7M - 2.43.0 a07b618ecd1d 5e8226460d4a 2023-12-09T02:35:08.463 INFO:tasks.workunit.client.1.smithi161.stdout:4/187: mknod dd/d1a/d29/c42 0 2023-12-09T02:35:08.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.460+0000 7f224c919700 1 -- 172.21.15.88:0/3351591170 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f223006ad20 msgr2=0x7f223006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:08.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.460+0000 7f224c919700 1 --2- 172.21.15.88:0/3351591170 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f223006ad20 0x7f223006d1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f223c00b3b0 tx=0x7f223c009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:08.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.460+0000 7f224c919700 1 -- 172.21.15.88:0/3351591170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22480fcbf0 msgr2=0x7f224810d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:08.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.460+0000 7f224c919700 1 --2- 172.21.15.88:0/3351591170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22480fcbf0 0x7f224810d570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f223800b790 tx=0x7f2238009220 comp rx=0 tx=0).stop 2023-12-09T02:35:08.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.460+0000 7f224c919700 1 -- 172.21.15.88:0/3351591170 shutdown_connections 2023-12-09T02:35:08.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.460+0000 7f224c919700 1 --2- 172.21.15.88:0/3351591170 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f223006ad20 0x7f223006d1d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.460+0000 7f224c919700 1 --2- 172.21.15.88:0/3351591170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22480fcbf0 0x7f224810d570 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.460+0000 7f224c919700 1 --2- 172.21.15.88:0/3351591170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22480fde00 0x7f224810dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.460+0000 7f224c919700 1 -- 172.21.15.88:0/3351591170 >> 172.21.15.88:0/3351591170 conn(0x7f22480f82d0 msgr2=0x7f2248101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:08.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.460+0000 7f224c919700 1 -- 172.21.15.88:0/3351591170 shutdown_connections 2023-12-09T02:35:08.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.460+0000 7f224c919700 1 -- 172.21.15.88:0/3351591170 wait complete. 2023-12-09T02:35:08.464 INFO:tasks.workunit.client.1.smithi161.stdout:4/188: creat dd/d36/d3f/f43 x:0 0 0 2023-12-09T02:35:08.464 INFO:tasks.workunit.client.1.smithi161.stdout:4/189: write dd/d1a/d1d/d25/f2f [4826121,36265] 0 2023-12-09T02:35:08.471 INFO:tasks.workunit.client.1.smithi161.stdout:4/190: dread dd/d1a/f1c [0,4194304] 0 2023-12-09T02:35:08.472 INFO:tasks.workunit.client.1.smithi161.stdout:4/191: mknod dd/c44 0 2023-12-09T02:35:08.476 INFO:tasks.workunit.client.1.smithi161.stdout:4/192: rmdir dd/d1a/d29 39 2023-12-09T02:35:08.476 INFO:tasks.workunit.client.1.smithi161.stdout:4/193: fsync dd/f13 0 2023-12-09T02:35:08.477 INFO:tasks.workunit.client.1.smithi161.stdout:4/194: truncate dd/d1a/d1e/f21 723845 0 2023-12-09T02:35:08.487 INFO:tasks.workunit.client.1.smithi161.stdout:3/217: dwrite d2/fa [0,4194304] 0 2023-12-09T02:35:08.489 INFO:tasks.workunit.client.1.smithi161.stdout:3/218: dread d2/d4/d2c/d2d/f34 [0,4194304] 0 2023-12-09T02:35:08.491 INFO:tasks.workunit.client.1.smithi161.stdout:4/195: truncate dd/d1a/d1d/d25/f30 1038239 0 2023-12-09T02:35:08.491 INFO:tasks.workunit.client.1.smithi161.stdout:4/196: readlink dd/l16 0 2023-12-09T02:35:08.491 INFO:tasks.workunit.client.1.smithi161.stdout:4/197: chown dd/f15 78994871 1 2023-12-09T02:35:08.492 INFO:tasks.workunit.client.1.smithi161.stdout:3/219: truncate d2/d4/d11/f14 691474 0 2023-12-09T02:35:08.492 INFO:tasks.workunit.client.1.smithi161.stdout:3/220: read d2/d4/f27 [448,75038] 0 2023-12-09T02:35:08.492 INFO:tasks.workunit.client.1.smithi161.stdout:3/221: stat d2/d4/f36 0 2023-12-09T02:35:08.492 INFO:tasks.workunit.client.1.smithi161.stdout:3/222: dread - d2/d4/d11/d19/f2e zero size 2023-12-09T02:35:08.494 INFO:tasks.workunit.client.1.smithi161.stdout:4/198: mknod dd/c45 0 2023-12-09T02:35:08.494 INFO:tasks.workunit.client.1.smithi161.stdout:4/199: write dd/d1a/d1d/d25/d32/f41 [81393,33452] 0 2023-12-09T02:35:08.497 INFO:tasks.workunit.client.1.smithi161.stdout:4/200: creat dd/d1a/d1d/d25/d32/d34/f46 x:0 0 0 2023-12-09T02:35:08.497 INFO:tasks.workunit.client.1.smithi161.stdout:4/201: chown dd/d1a/d1d/d25/c31 1542410 1 2023-12-09T02:35:08.503 INFO:tasks.workunit.client.1.smithi161.stdout:4/202: mkdir dd/d1a/d1d/d25/d47 0 2023-12-09T02:35:08.508 INFO:tasks.workunit.client.1.smithi161.stdout:4/203: mknod dd/d1a/d1d/d25/c48 0 2023-12-09T02:35:08.508 INFO:tasks.workunit.client.1.smithi161.stdout:4/204: dread - dd/d36/d3f/f43 zero size 2023-12-09T02:35:08.508 INFO:tasks.workunit.client.1.smithi161.stdout:4/205: write dd/d1a/d29/f37 [639049,124035] 0 2023-12-09T02:35:08.511 INFO:tasks.workunit.client.1.smithi161.stdout:4/206: creat dd/d1a/d1d/f49 x:0 0 0 2023-12-09T02:35:08.517 INFO:tasks.workunit.client.1.smithi161.stdout:4/207: dread dd/fe [0,4194304] 0 2023-12-09T02:35:08.518 INFO:tasks.workunit.client.1.smithi161.stdout:4/208: read dd/d1a/d1d/d25/f3d [361638,43736] 0 2023-12-09T02:35:08.518 INFO:tasks.workunit.client.1.smithi161.stdout:4/209: chown dd/c44 3057 1 2023-12-09T02:35:08.518 INFO:tasks.workunit.client.1.smithi161.stdout:4/210: chown dd/d1a/f1c 34047415 1 2023-12-09T02:35:08.519 INFO:tasks.workunit.client.1.smithi161.stdout:4/211: rmdir dd/d1a/d29 39 2023-12-09T02:35:08.521 INFO:tasks.workunit.client.1.smithi161.stdout:4/212: mkdir dd/d36/d4a 0 2023-12-09T02:35:08.521 INFO:tasks.workunit.client.1.smithi161.stdout:4/213: stat dd/d1a/d1d/d25/c27 0 2023-12-09T02:35:08.528 INFO:tasks.workunit.client.1.smithi161.stdout:4/214: dread dd/f13 [0,4194304] 0 2023-12-09T02:35:08.533 INFO:tasks.workunit.client.1.smithi161.stdout:4/215: write dd/d1a/d1d/d25/d3a/f40 [2765040,11708] 0 2023-12-09T02:35:08.539 INFO:tasks.workunit.client.1.smithi161.stdout:4/216: fsync dd/d1a/d1d/d25/d3a/f40 0 2023-12-09T02:35:08.566 INFO:tasks.workunit.client.1.smithi161.stdout:4/217: dwrite dd/d1a/d1d/d25/f2f [0,4194304] 0 2023-12-09T02:35:08.567 INFO:tasks.workunit.client.1.smithi161.stdout:4/218: write dd/f19 [753635,33294] 0 2023-12-09T02:35:08.568 INFO:tasks.workunit.client.1.smithi161.stdout:4/219: truncate f8 2481342 0 2023-12-09T02:35:08.569 INFO:tasks.workunit.client.1.smithi161.stdout:4/220: creat dd/d36/d3f/f4b x:0 0 0 2023-12-09T02:35:08.576 INFO:tasks.workunit.client.1.smithi161.stdout:4/221: truncate dd/fe 2732645 0 2023-12-09T02:35:08.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 -- 172.21.15.88:0/2275545003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf040fcbf0 msgr2=0x7fdf040fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:08.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 --2- 172.21.15.88:0/2275545003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf040fcbf0 0x7fdf040fd000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdef8004940 tx=0x7fdef8009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:08.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 -- 172.21.15.88:0/2275545003 shutdown_connections 2023-12-09T02:35:08.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 --2- 172.21.15.88:0/2275545003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf040fde00 0x7fdf040fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 --2- 172.21.15.88:0/2275545003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf040fcbf0 0x7fdf040fd000 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 -- 172.21.15.88:0/2275545003 >> 172.21.15.88:0/2275545003 conn(0x7fdf040f82d0 msgr2=0x7fdf040fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:08.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 -- 172.21.15.88:0/2275545003 shutdown_connections 2023-12-09T02:35:08.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 -- 172.21.15.88:0/2275545003 wait complete. 2023-12-09T02:35:08.578 INFO:tasks.workunit.client.1.smithi161.stdout:4/222: symlink dd/l4c 0 2023-12-09T02:35:08.578 INFO:tasks.workunit.client.1.smithi161.stdout:4/223: dread dd/d1a/d1e/f21 [0,4194304] 0 2023-12-09T02:35:08.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 Processor -- start 2023-12-09T02:35:08.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 -- start start 2023-12-09T02:35:08.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf040fcbf0 0x7fdf0410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.575+0000 7fdf08dc3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf040fde00 0x7fdf0410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf08dc3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0410e010 con 0x7fdf040fcbf0 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf08dc3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0410e8b0 con 0x7fdf040fde00 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf0259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf040fcbf0 0x7fdf0410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf0259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf040fcbf0 0x7fdf0410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55132/0 (socket says 172.21.15.88:55132) 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf0259c700 1 -- 172.21.15.88:0/3923523534 learned_addr learned my addr 172.21.15.88:0/3923523534 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf01d9b700 1 --2- 172.21.15.88:0/3923523534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf040fde00 0x7fdf0410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf0259c700 1 -- 172.21.15.88:0/3923523534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf040fde00 msgr2=0x7fdf0410da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf0259c700 1 --2- 172.21.15.88:0/3923523534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf040fde00 0x7fdf0410da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf0259c700 1 -- 172.21.15.88:0/3923523534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8005040 con 0x7fdf040fcbf0 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf0259c700 1 --2- 172.21.15.88:0/3923523534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf040fcbf0 0x7fdf0410d4d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdef8008f80 tx=0x7fdef8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdef2ffd700 1 -- 172.21.15.88:0/3923523534 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdef8021070 con 0x7fdf040fcbf0 2023-12-09T02:35:08.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdef2ffd700 1 -- 172.21.15.88:0/3923523534 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdef801c400 con 0x7fdf040fcbf0 2023-12-09T02:35:08.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf08dc3700 1 -- 172.21.15.88:0/3923523534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0410eb30 con 0x7fdf040fcbf0 2023-12-09T02:35:08.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdef2ffd700 1 -- 172.21.15.88:0/3923523534 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdef800e070 con 0x7fdf040fcbf0 2023-12-09T02:35:08.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.576+0000 7fdf08dc3700 1 -- 172.21.15.88:0/3923523534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0410f010 con 0x7fdf040fcbf0 2023-12-09T02:35:08.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.577+0000 7fdf08dc3700 1 -- 172.21.15.88:0/3923523534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0404bb80 con 0x7fdf040fcbf0 2023-12-09T02:35:08.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.578+0000 7fdef2ffd700 1 -- 172.21.15.88:0/3923523534 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 88622+0+0 (secure 0 0 0) 0x7fdef801c9c0 con 0x7fdf040fcbf0 2023-12-09T02:35:08.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.578+0000 7fdef2ffd700 1 --2- 172.21.15.88:0/3923523534 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeec06ad30 0x7fdeec06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:08.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.578+0000 7fdef2ffd700 1 -- 172.21.15.88:0/3923523534 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdef808a760 con 0x7fdf040fcbf0 2023-12-09T02:35:08.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.578+0000 7fdf01d9b700 1 --2- 172.21.15.88:0/3923523534 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeec06ad30 0x7fdeec06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:08.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.578+0000 7fdf01d9b700 1 --2- 172.21.15.88:0/3923523534 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeec06ad30 0x7fdeec06d1e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdef4004600 tx=0x7fdef400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:08.582 INFO:tasks.workunit.client.1.smithi161.stdout:4/224: rmdir dd/d1a/d1d/d25/d47 0 2023-12-09T02:35:08.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.582+0000 7fdef2ffd700 1 -- 172.21.15.88:0/3923523534 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdef805a670 con 0x7fdf040fcbf0 2023-12-09T02:35:08.600 INFO:tasks.workunit.client.1.smithi161.stdout:4/225: dwrite dd/f18 [0,4194304] 0 2023-12-09T02:35:08.600 INFO:tasks.workunit.client.1.smithi161.stdout:4/226: chown f7 1569563 1 2023-12-09T02:35:08.601 INFO:tasks.workunit.client.1.smithi161.stdout:4/227: mkdir dd/d1a/d1d/d25/d32/d34/d4d 0 2023-12-09T02:35:08.611 INFO:tasks.workunit.client.1.smithi161.stdout:4/228: dread dd/d1a/d1d/d25/f2f [0,4194304] 0 2023-12-09T02:35:08.611 INFO:tasks.workunit.client.1.smithi161.stdout:4/229: truncate dd/d36/d3f/f43 29306 0 2023-12-09T02:35:08.612 INFO:tasks.workunit.client.1.smithi161.stdout:4/230: write f8 [1078620,86994] 0 2023-12-09T02:35:08.630 INFO:tasks.workunit.client.1.smithi161.stdout:4/231: dwrite dd/d1a/d1d/d25/f3b [0,4194304] 0 2023-12-09T02:35:08.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/232: stat dd/d1a/d1d/d25/d32 0 2023-12-09T02:35:08.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/233: truncate dd/d36/d3f/f4b 1032778 0 2023-12-09T02:35:08.652 INFO:tasks.workunit.client.1.smithi161.stdout:4/234: dwrite dd/d1a/d1d/d25/f30 [0,4194304] 0 2023-12-09T02:35:08.652 INFO:tasks.workunit.client.1.smithi161.stdout:4/235: chown dd/d1a/d1d 461130260 1 2023-12-09T02:35:08.657 INFO:tasks.workunit.client.1.smithi161.stdout:4/236: mkdir dd/d1a/d1d/d25/d4e 0 2023-12-09T02:35:08.673 INFO:tasks.workunit.client.1.smithi161.stdout:4/237: creat dd/d1a/d1e/f4f x:0 0 0 2023-12-09T02:35:08.674 INFO:tasks.workunit.client.1.smithi161.stdout:4/238: dread dd/d36/d3f/f43 [0,4194304] 0 2023-12-09T02:35:08.695 INFO:tasks.workunit.client.1.smithi161.stdout:4/239: dwrite dd/d1a/d1d/d25/f30 [0,4194304] 0 2023-12-09T02:35:08.707 INFO:tasks.workunit.client.1.smithi161.stdout:4/240: dwrite dd/d1a/d1d/f49 [0,4194304] 0 2023-12-09T02:35:08.711 INFO:tasks.workunit.client.1.smithi161.stdout:4/241: rmdir dd/d1a/d1d/d25/d32/d34/d4d 0 2023-12-09T02:35:08.711 INFO:tasks.workunit.client.1.smithi161.stdout:4/242: chown dd/d1a/d29/c42 267610 1 2023-12-09T02:35:08.714 INFO:tasks.workunit.client.1.smithi161.stdout:4/243: rename dd/l4c to dd/d1a/d1d/d25/d3a/l50 0 2023-12-09T02:35:08.714 INFO:tasks.workunit.client.1.smithi161.stdout:4/244: readlink la 0 2023-12-09T02:35:08.716 INFO:tasks.workunit.client.1.smithi161.stdout:4/245: creat dd/d36/d4a/f51 x:0 0 0 2023-12-09T02:35:08.718 INFO:tasks.workunit.client.1.smithi161.stdout:4/246: creat dd/d1a/d1d/d25/f52 x:0 0 0 2023-12-09T02:35:08.720 INFO:tasks.workunit.client.1.smithi161.stdout:4/247: symlink dd/d1a/d1d/l53 0 2023-12-09T02:35:08.735 INFO:tasks.workunit.client.1.smithi161.stdout:4/248: dwrite dd/d1a/d1d/f49 [0,4194304] 0 2023-12-09T02:35:08.738 INFO:tasks.workunit.client.1.smithi161.stdout:4/249: dread dd/f13 [0,4194304] 0 2023-12-09T02:35:08.739 INFO:tasks.workunit.client.1.smithi161.stdout:4/250: mkdir dd/d36/d3f/d54 0 2023-12-09T02:35:08.740 INFO:tasks.workunit.client.1.smithi161.stdout:4/251: symlink dd/d1a/d23/l55 0 2023-12-09T02:35:08.854 INFO:tasks.workunit.client.1.smithi161.stdout:2/187: sync 2023-12-09T02:35:08.855 INFO:tasks.workunit.client.1.smithi161.stdout:8/143: sync 2023-12-09T02:35:08.858 INFO:tasks.workunit.client.1.smithi161.stdout:2/188: rmdir d4/d7 39 2023-12-09T02:35:08.858 INFO:tasks.workunit.client.1.smithi161.stdout:2/189: write d4/d16/f26 [269578,36545] 0 2023-12-09T02:35:08.862 INFO:tasks.workunit.client.1.smithi161.stdout:8/144: getdents d2/d5/d22 0 2023-12-09T02:35:08.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.863+0000 7fdf08dc3700 1 -- 172.21.15.88:0/3923523534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdf0410f3b0 con 0x7fdf040fcbf0 2023-12-09T02:35:08.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.863+0000 7fdef2ffd700 1 -- 172.21.15.88:0/3923523534 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7fdef805a200 con 0x7fdf040fcbf0 2023-12-09T02:35:08.865 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 1, 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 1 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:35:08.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:35:08.867 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:35:08.867 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 13, 2023-12-09T02:35:08.867 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 1 2023-12-09T02:35:08.867 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:35:08.867 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:35:08.867 INFO:tasks.workunit.client.1.smithi161.stdout:8/145: creat d2/d5/f30 x:0 0 0 2023-12-09T02:35:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.865+0000 7fdf08dc3700 1 -- 172.21.15.88:0/3923523534 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeec06ad30 msgr2=0x7fdeec06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.865+0000 7fdf08dc3700 1 --2- 172.21.15.88:0/3923523534 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeec06ad30 0x7fdeec06d1e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdef4004600 tx=0x7fdef400b040 comp rx=0 tx=0).stop 2023-12-09T02:35:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.865+0000 7fdf08dc3700 1 -- 172.21.15.88:0/3923523534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf040fcbf0 msgr2=0x7fdf0410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.865+0000 7fdf08dc3700 1 --2- 172.21.15.88:0/3923523534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf040fcbf0 0x7fdf0410d4d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdef8008f80 tx=0x7fdef8009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.865+0000 7fdf08dc3700 1 -- 172.21.15.88:0/3923523534 shutdown_connections 2023-12-09T02:35:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.865+0000 7fdf08dc3700 1 --2- 172.21.15.88:0/3923523534 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fdeec06ad30 0x7fdeec06d1e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.865+0000 7fdf08dc3700 1 --2- 172.21.15.88:0/3923523534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf040fcbf0 0x7fdf0410d4d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.865+0000 7fdf08dc3700 1 --2- 172.21.15.88:0/3923523534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf040fde00 0x7fdf0410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.865+0000 7fdf08dc3700 1 -- 172.21.15.88:0/3923523534 >> 172.21.15.88:0/3923523534 conn(0x7fdf040f82d0 msgr2=0x7fdf04101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.865+0000 7fdf08dc3700 1 -- 172.21.15.88:0/3923523534 shutdown_connections 2023-12-09T02:35:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.865+0000 7fdf08dc3700 1 -- 172.21.15.88:0/3923523534 wait complete. 2023-12-09T02:35:08.870 INFO:tasks.workunit.client.1.smithi161.stdout:8/146: mkdir d2/d5/d22/d31 0 2023-12-09T02:35:08.871 INFO:tasks.workunit.client.1.smithi161.stdout:9/155: sync 2023-12-09T02:35:08.871 INFO:tasks.workunit.client.1.smithi161.stdout:7/279: sync 2023-12-09T02:35:08.871 INFO:tasks.workunit.client.1.smithi161.stdout:7/280: truncate d0/f42 947510 0 2023-12-09T02:35:08.872 INFO:tasks.workunit.client.1.smithi161.stdout:7/281: readlink d0/l27 0 2023-12-09T02:35:08.872 INFO:tasks.workunit.client.1.smithi161.stdout:7/282: chown d0/d3/d13/d2f/d50 53614 1 2023-12-09T02:35:08.872 INFO:tasks.workunit.client.1.smithi161.stdout:9/156: write d2/da/d22/f2d [473943,71288] 0 2023-12-09T02:35:08.872 INFO:tasks.workunit.client.1.smithi161.stdout:9/157: truncate d2/da/d22/f2d 703614 0 2023-12-09T02:35:08.872 INFO:tasks.workunit.client.1.smithi161.stdout:8/147: rename d2/l1b to d2/d23/l32 0 2023-12-09T02:35:08.873 INFO:tasks.workunit.client.1.smithi161.stdout:7/283: getdents d0/d3/d13/d2f/d50 0 2023-12-09T02:35:08.874 INFO:tasks.workunit.client.1.smithi161.stdout:7/284: read d0/f42 [352056,32385] 0 2023-12-09T02:35:08.874 INFO:tasks.workunit.client.1.smithi161.stdout:7/285: getdents d0/d3/d13/d4e 0 2023-12-09T02:35:08.874 INFO:tasks.workunit.client.1.smithi161.stdout:7/286: fdatasync d0/d3/d13/d2f/f3a 0 2023-12-09T02:35:08.876 INFO:tasks.workunit.client.1.smithi161.stdout:2/190: dwrite d4/d7/f31 [0,4194304] 0 2023-12-09T02:35:08.877 INFO:tasks.workunit.client.1.smithi161.stdout:9/158: creat d2/da/d16/f30 x:0 0 0 2023-12-09T02:35:08.877 INFO:tasks.workunit.client.1.smithi161.stdout:9/159: readlink d2/d25/l28 0 2023-12-09T02:35:08.878 INFO:tasks.workunit.client.1.smithi161.stdout:2/191: write d4/d7/db/f10 [6751358,2512] 0 2023-12-09T02:35:08.879 INFO:tasks.workunit.client.1.smithi161.stdout:8/148: creat d2/d5/f33 x:0 0 0 2023-12-09T02:35:08.881 INFO:tasks.workunit.client.1.smithi161.stdout:8/149: write d2/d5/f16 [2850199,96387] 0 2023-12-09T02:35:08.881 INFO:tasks.workunit.client.1.smithi161.stdout:9/160: mkdir d2/d25/d31 0 2023-12-09T02:35:08.882 INFO:tasks.workunit.client.1.smithi161.stdout:2/192: creat d4/d1a/f3e x:0 0 0 2023-12-09T02:35:08.890 INFO:tasks.workunit.client.1.smithi161.stdout:8/150: creat d2/d5/f34 x:0 0 0 2023-12-09T02:35:08.891 INFO:tasks.workunit.client.1.smithi161.stdout:8/151: chown d2/l24 632150377 1 2023-12-09T02:35:08.891 INFO:tasks.workunit.client.1.smithi161.stdout:8/152: fdatasync d2/d5/f34 0 2023-12-09T02:35:08.891 INFO:tasks.workunit.client.1.smithi161.stdout:2/193: rmdir d4/d7/db 39 2023-12-09T02:35:08.891 INFO:tasks.workunit.client.1.smithi161.stdout:8/153: write d2/f9 [140121,85786] 0 2023-12-09T02:35:08.894 INFO:tasks.workunit.client.1.smithi161.stdout:2/194: rename d4/d16/f2c to d4/d1a/f3f 0 2023-12-09T02:35:08.899 INFO:tasks.workunit.client.1.smithi161.stdout:9/161: dwrite d2/f9 [0,4194304] 0 2023-12-09T02:35:08.902 INFO:tasks.workunit.client.1.smithi161.stdout:7/287: dwrite d0/d3/d21/f3b [0,4194304] 0 2023-12-09T02:35:08.909 INFO:tasks.workunit.client.1.smithi161.stdout:8/154: dwrite d2/d5/f14 [4194304,4194304] 0 2023-12-09T02:35:08.910 INFO:tasks.workunit.client.1.smithi161.stdout:9/162: creat d2/f32 x:0 0 0 2023-12-09T02:35:08.910 INFO:tasks.workunit.client.1.smithi161.stdout:9/163: fsync d2/da/f21 0 2023-12-09T02:35:08.915 INFO:tasks.workunit.client.1.smithi161.stdout:8/155: creat d2/d23/f35 x:0 0 0 2023-12-09T02:35:08.915 INFO:tasks.workunit.client.1.smithi161.stdout:8/156: getdents d2/d2d 0 2023-12-09T02:35:08.915 INFO:tasks.workunit.client.1.smithi161.stdout:9/164: symlink d2/da/l33 0 2023-12-09T02:35:08.916 INFO:tasks.workunit.client.1.smithi161.stdout:8/157: mknod d2/c36 0 2023-12-09T02:35:08.916 INFO:tasks.workunit.client.1.smithi161.stdout:8/158: read - d2/d23/f2e zero size 2023-12-09T02:35:08.916 INFO:tasks.workunit.client.1.smithi161.stdout:8/159: write d2/d23/f29 [160579,59003] 0 2023-12-09T02:35:08.917 INFO:tasks.workunit.client.1.smithi161.stdout:8/160: read d2/d5/f16 [173276,60307] 0 2023-12-09T02:35:08.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:08 smithi161 ceph-mon[121170]: pgmap v202: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 81 MiB/s rd, 175 MiB/s wr, 304 op/s 2023-12-09T02:35:08.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:08 smithi161 ceph-mon[121170]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:08.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:08 smithi161 ceph-mon[121170]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:08.924 INFO:tasks.workunit.client.1.smithi161.stdout:7/288: dwrite d0/d3/d13/d2d/d43/d4a/f41 [0,4194304] 0 2023-12-09T02:35:08.926 INFO:tasks.workunit.client.1.smithi161.stdout:9/165: dread d2/da/f21 [0,4194304] 0 2023-12-09T02:35:08.926 INFO:tasks.workunit.client.1.smithi161.stdout:9/166: chown d2/f15 151 1 2023-12-09T02:35:08.926 INFO:tasks.workunit.client.1.smithi161.stdout:9/167: write d2/da/d16/f30 [158061,113643] 0 2023-12-09T02:35:08.929 INFO:tasks.workunit.client.1.smithi161.stdout:7/289: mkdir d0/d29/d59 0 2023-12-09T02:35:08.931 INFO:tasks.workunit.client.1.smithi161.stdout:8/161: dread d2/d5/f14 [4194304,4194304] 0 2023-12-09T02:35:08.933 INFO:tasks.workunit.client.1.smithi161.stdout:8/162: chown d2/d5/fb 16769070 1 2023-12-09T02:35:08.934 INFO:tasks.workunit.client.1.smithi161.stdout:8/163: creat d2/d5/d22/d31/f37 x:0 0 0 2023-12-09T02:35:08.934 INFO:tasks.workunit.client.1.smithi161.stdout:8/164: fdatasync d2/d23/f2e 0 2023-12-09T02:35:08.945 INFO:tasks.workunit.client.1.smithi161.stdout:9/168: dwrite d2/da/f14 [0,4194304] 0 2023-12-09T02:35:08.946 INFO:tasks.workunit.client.1.smithi161.stdout:9/169: stat d2/da/d22 0 2023-12-09T02:35:08.946 INFO:tasks.workunit.client.1.smithi161.stdout:9/170: chown d2/da/l18 3539 1 2023-12-09T02:35:08.946 INFO:tasks.workunit.client.1.smithi161.stdout:8/165: dread d2/f17 [0,4194304] 0 2023-12-09T02:35:08.948 INFO:tasks.workunit.client.1.smithi161.stdout:8/166: mkdir d2/d5/d22/d31/d38 0 2023-12-09T02:35:08.957 INFO:tasks.workunit.client.1.smithi161.stdout:8/167: dread d2/d5/f14 [4194304,4194304] 0 2023-12-09T02:35:08.960 INFO:tasks.workunit.client.1.smithi161.stdout:8/168: link d2/f17 d2/d5/d22/d31/f39 0 2023-12-09T02:35:08.962 INFO:tasks.workunit.client.1.smithi161.stdout:9/171: dwrite d2/da/f21 [4194304,4194304] 0 2023-12-09T02:35:08.963 INFO:tasks.workunit.client.1.smithi161.stdout:8/169: rename d2/l1c to d2/d5/d22/l3a 0 2023-12-09T02:35:08.964 INFO:tasks.workunit.client.1.smithi161.stdout:8/170: read d2/d23/f29 [156465,108244] 0 2023-12-09T02:35:08.964 INFO:tasks.workunit.client.1.smithi161.stdout:8/171: chown d2/lf 100097 1 2023-12-09T02:35:08.964 INFO:tasks.workunit.client.1.smithi161.stdout:8/172: write d2/f1d [738713,1129] 0 2023-12-09T02:35:08.964 INFO:tasks.workunit.client.1.smithi161.stdout:8/173: truncate d2/d23/f2c 272899 0 2023-12-09T02:35:08.967 INFO:tasks.workunit.client.1.smithi161.stdout:9/172: dread d2/f1b [0,4194304] 0 2023-12-09T02:35:08.968 INFO:tasks.workunit.client.1.smithi161.stdout:9/173: creat d2/d25/f34 x:0 0 0 2023-12-09T02:35:08.971 INFO:tasks.workunit.client.1.smithi161.stdout:9/174: rename d2/d25/f34 to d2/f35 0 2023-12-09T02:35:08.974 INFO:tasks.workunit.client.1.smithi161.stdout:8/174: rmdir d2/d5 39 2023-12-09T02:35:08.974 INFO:tasks.workunit.client.1.smithi161.stdout:8/175: chown d2/l25 15182822 1 2023-12-09T02:35:08.974 INFO:tasks.workunit.client.1.smithi161.stdout:8/176: chown d2/d23/l27 29666 1 2023-12-09T02:35:08.974 INFO:tasks.workunit.client.1.smithi161.stdout:8/177: dread - d2/d5/d22/d31/f37 zero size 2023-12-09T02:35:08.976 INFO:tasks.workunit.client.1.smithi161.stdout:8/178: write d2/f6 [1345436,100171] 0 2023-12-09T02:35:08.976 INFO:tasks.workunit.client.1.smithi161.stdout:8/179: stat d2/l4 0 2023-12-09T02:35:08.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:08 smithi088 ceph-mon[112028]: pgmap v202: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 81 MiB/s rd, 175 MiB/s wr, 304 op/s 2023-12-09T02:35:08.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:08 smithi088 ceph-mon[112028]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:08.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:08 smithi088 ceph-mon[112028]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:08.977 INFO:tasks.workunit.client.1.smithi161.stdout:8/180: truncate d2/d5/f14 3393643 0 2023-12-09T02:35:08.979 INFO:tasks.workunit.client.1.smithi161.stdout:8/181: creat d2/d5/d22/d31/d38/f3b x:0 0 0 2023-12-09T02:35:08.980 INFO:tasks.workunit.client.1.smithi161.stdout:8/182: mknod d2/d5/c3c 0 2023-12-09T02:35:08.983 INFO:tasks.workunit.client.1.smithi161.stdout:8/183: mkdir d2/d5/d3d 0 2023-12-09T02:35:08.983 INFO:tasks.workunit.client.1.smithi161.stdout:8/184: stat d2/l18 0 2023-12-09T02:35:08.985 INFO:tasks.workunit.client.1.smithi161.stdout:8/185: link d2/d5/d22/l28 d2/d5/d3d/l3e 0 2023-12-09T02:35:08.985 INFO:tasks.workunit.client.1.smithi161.stdout:8/186: chown d2/d5/le 948799 1 2023-12-09T02:35:08.985 INFO:tasks.workunit.client.1.smithi161.stdout:8/187: chown d2/d5/f14 617223 1 2023-12-09T02:35:08.986 INFO:tasks.workunit.client.1.smithi161.stdout:8/188: mknod d2/d5/c3f 0 2023-12-09T02:35:08.987 INFO:tasks.workunit.client.1.smithi161.stdout:8/189: getdents d2/d5/d22 0 2023-12-09T02:35:08.988 INFO:tasks.workunit.client.1.smithi161.stdout:9/175: dwrite d2/da/d22/f2d [0,4194304] 0 2023-12-09T02:35:08.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.986+0000 7f607fa81700 1 -- 172.21.15.88:0/353079674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60780fcd00 msgr2=0x7f60780fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:08.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.986+0000 7f607fa81700 1 --2- 172.21.15.88:0/353079674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60780fcd00 0x7f60780fd150 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6068004940 tx=0x7f6068009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:08.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.986+0000 7f607fa81700 1 -- 172.21.15.88:0/353079674 shutdown_connections 2023-12-09T02:35:08.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.986+0000 7f607fa81700 1 --2- 172.21.15.88:0/353079674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60780fcd00 0x7f60780fd150 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.986+0000 7f607fa81700 1 --2- 172.21.15.88:0/353079674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60780fbaf0 0x7f60780fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.987+0000 7f607fa81700 1 -- 172.21.15.88:0/353079674 >> 172.21.15.88:0/353079674 conn(0x7f60780f71b0 msgr2=0x7f60780f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:08.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.987+0000 7f607fa81700 1 -- 172.21.15.88:0/353079674 shutdown_connections 2023-12-09T02:35:08.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.987+0000 7f607fa81700 1 -- 172.21.15.88:0/353079674 wait complete. 2023-12-09T02:35:08.991 INFO:tasks.workunit.client.1.smithi161.stdout:8/190: creat d2/d5/f40 x:0 0 0 2023-12-09T02:35:08.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.987+0000 7f607fa81700 1 Processor -- start 2023-12-09T02:35:08.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.987+0000 7f607fa81700 1 -- start start 2023-12-09T02:35:08.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.987+0000 7f607fa81700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60780fbaf0 0x7f607810f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:08.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.987+0000 7f607fa81700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60780fcd00 0x7f607810fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.987+0000 7f607fa81700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60781101e0 con 0x7f60780fbaf0 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.987+0000 7f607fa81700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6078110a80 con 0x7f60780fcd00 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.988+0000 7f607d81d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60780fbaf0 0x7f607810f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.988+0000 7f607d81d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60780fbaf0 0x7f607810f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55144/0 (socket says 172.21.15.88:55144) 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.988+0000 7f607d81d700 1 -- 172.21.15.88:0/2790988650 learned_addr learned my addr 172.21.15.88:0/2790988650 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.988+0000 7f607d81d700 1 -- 172.21.15.88:0/2790988650 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60780fcd00 msgr2=0x7f607810fbe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.988+0000 7f607d81d700 1 --2- 172.21.15.88:0/2790988650 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60780fcd00 0x7f607810fbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.988+0000 7f607d81d700 1 -- 172.21.15.88:0/2790988650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6068005040 con 0x7f60780fbaf0 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.988+0000 7f607d81d700 1 --2- 172.21.15.88:0/2790988650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60780fbaf0 0x7f607810f6a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f607400eb70 tx=0x7f607400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.988+0000 7f606e7fc700 1 -- 172.21.15.88:0/2790988650 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6074007cc0 con 0x7f60780fbaf0 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.988+0000 7f607fa81700 1 -- 172.21.15.88:0/2790988650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6078110d00 con 0x7f60780fbaf0 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.988+0000 7f606e7fc700 1 -- 172.21.15.88:0/2790988650 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f607400f040 con 0x7f60780fbaf0 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.989+0000 7f606e7fc700 1 -- 172.21.15.88:0/2790988650 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f607400cad0 con 0x7f60780fbaf0 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.989+0000 7f607fa81700 1 -- 172.21.15.88:0/2790988650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6078111240 con 0x7f60780fbaf0 2023-12-09T02:35:08.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.990+0000 7f607fa81700 1 -- 172.21.15.88:0/2790988650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607804bb80 con 0x7f60780fbaf0 2023-12-09T02:35:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.990+0000 7f606e7fc700 1 -- 172.21.15.88:0/2790988650 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 88622+0+0 (secure 0 0 0) 0x7f607400cc30 con 0x7f60780fbaf0 2023-12-09T02:35:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.990+0000 7f606e7fc700 1 --2- 172.21.15.88:0/2790988650 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f606406ad20 0x7f606406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.991+0000 7f606e7fc700 1 -- 172.21.15.88:0/2790988650 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6074088fb0 con 0x7f60780fbaf0 2023-12-09T02:35:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.991+0000 7f607d01c700 1 --2- 172.21.15.88:0/2790988650 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f606406ad20 0x7f606406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.991+0000 7f607d01c700 1 --2- 172.21.15.88:0/2790988650 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f606406ad20 0x7f606406d1d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f606800b0d0 tx=0x7f6068009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:08.995 INFO:tasks.workunit.client.1.smithi161.stdout:8/191: fsync d2/f9 0 2023-12-09T02:35:08.995 INFO:tasks.workunit.client.1.smithi161.stdout:9/176: creat d2/da/d16/f36 x:0 0 0 2023-12-09T02:35:08.995 INFO:tasks.workunit.client.1.smithi161.stdout:9/177: fdatasync d2/f12 0 2023-12-09T02:35:08.995 INFO:tasks.workunit.client.1.smithi161.stdout:9/178: write d2/da/f10 [3047291,124625] 0 2023-12-09T02:35:08.995 INFO:tasks.workunit.client.1.smithi161.stdout:9/179: fsync d2/f8 0 2023-12-09T02:35:08.995 INFO:tasks.workunit.client.1.smithi161.stdout:9/180: fsync d2/f15 0 2023-12-09T02:35:08.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:08.995+0000 7f606e7fc700 1 -- 172.21.15.88:0/2790988650 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6074058ef0 con 0x7f60780fbaf0 2023-12-09T02:35:09.000 INFO:tasks.workunit.client.1.smithi161.stdout:8/192: rmdir d2/d23 39 2023-12-09T02:35:09.000 INFO:tasks.workunit.client.1.smithi161.stdout:8/193: dread - d2/d5/f34 zero size 2023-12-09T02:35:09.000 INFO:tasks.workunit.client.1.smithi161.stdout:8/194: readlink d2/l4 0 2023-12-09T02:35:09.011 INFO:tasks.workunit.client.1.smithi161.stdout:9/181: dwrite d2/da/f10 [4194304,4194304] 0 2023-12-09T02:35:09.011 INFO:tasks.workunit.client.1.smithi161.stdout:9/182: fdatasync d2/f19 0 2023-12-09T02:35:09.013 INFO:tasks.workunit.client.1.smithi161.stdout:9/183: mknod d2/c37 0 2023-12-09T02:35:09.015 INFO:tasks.workunit.client.1.smithi161.stdout:9/184: dread d2/da/d16/f30 [0,4194304] 0 2023-12-09T02:35:09.018 INFO:tasks.workunit.client.1.smithi161.stdout:9/185: symlink d2/da/d16/d2e/l38 0 2023-12-09T02:35:09.018 INFO:tasks.workunit.client.1.smithi161.stdout:9/186: getdents d2/d25/d31 0 2023-12-09T02:35:09.021 INFO:tasks.workunit.client.1.smithi161.stdout:9/187: mkdir d2/da/d16/d39 0 2023-12-09T02:35:09.024 INFO:tasks.workunit.client.1.smithi161.stdout:9/188: mkdir d2/d25/d3a 0 2023-12-09T02:35:09.025 INFO:tasks.workunit.client.1.smithi161.stdout:9/189: rename d2/da/cf to d2/c3b 0 2023-12-09T02:35:09.025 INFO:tasks.workunit.client.1.smithi161.stdout:9/190: stat d2/da/l18 0 2023-12-09T02:35:09.026 INFO:tasks.workunit.client.1.smithi161.stdout:9/191: mknod d2/c3c 0 2023-12-09T02:35:09.026 INFO:tasks.workunit.client.1.smithi161.stdout:9/192: readlink d2/da/d16/l23 0 2023-12-09T02:35:09.026 INFO:tasks.workunit.client.1.smithi161.stdout:9/193: fdatasync d2/da/f27 0 2023-12-09T02:35:09.027 INFO:tasks.workunit.client.1.smithi161.stdout:9/194: write d2/f9 [851012,120865] 0 2023-12-09T02:35:09.035 INFO:tasks.workunit.client.1.smithi161.stdout:9/195: dread d2/da/f14 [0,4194304] 0 2023-12-09T02:35:09.036 INFO:tasks.workunit.client.1.smithi161.stdout:9/196: chown d2/da/d16/f20 108805561 1 2023-12-09T02:35:09.040 INFO:tasks.workunit.client.1.smithi161.stdout:9/197: symlink d2/d25/d3a/l3d 0 2023-12-09T02:35:09.049 INFO:tasks.workunit.client.1.smithi161.stdout:1/339: sync 2023-12-09T02:35:09.049 INFO:tasks.workunit.client.1.smithi161.stdout:1/340: chown d6/d8/d63/d4d/f2f 47342450 1 2023-12-09T02:35:09.052 INFO:tasks.workunit.client.1.smithi161.stdout:9/198: dwrite d2/f1b [0,4194304] 0 2023-12-09T02:35:09.056 INFO:tasks.workunit.client.1.smithi161.stdout:9/199: dread d2/f15 [0,4194304] 0 2023-12-09T02:35:09.059 INFO:tasks.workunit.client.1.smithi161.stdout:9/200: creat d2/f3e x:0 0 0 2023-12-09T02:35:09.059 INFO:tasks.workunit.client.1.smithi161.stdout:9/201: fdatasync d2/da/d16/f20 0 2023-12-09T02:35:09.059 INFO:tasks.workunit.client.1.smithi161.stdout:9/202: chown d2/f9 39657 1 2023-12-09T02:35:09.061 INFO:tasks.workunit.client.1.smithi161.stdout:9/203: mkdir d2/da/d16/d2e/d3f 0 2023-12-09T02:35:09.063 INFO:tasks.workunit.client.1.smithi161.stdout:1/341: dwrite d6/d8/d63/d4d/d31/f3a [0,4194304] 0 2023-12-09T02:35:09.063 INFO:tasks.workunit.client.1.smithi161.stdout:1/342: chown d6/d8/d63/d35/l43 60 1 2023-12-09T02:35:09.065 INFO:tasks.workunit.client.1.smithi161.stdout:1/343: mkdir d6/d8/d68 0 2023-12-09T02:35:09.067 INFO:tasks.workunit.client.1.smithi161.stdout:1/344: rename d6/d8/d63/d35/d3d/f3e to d6/d8/d63/d1c/f69 0 2023-12-09T02:35:09.071 INFO:tasks.workunit.client.1.smithi161.stdout:9/204: dread d2/da/f1e [0,4194304] 0 2023-12-09T02:35:09.078 INFO:tasks.workunit.client.1.smithi161.stdout:1/345: dread d6/d8/f30 [0,4194304] 0 2023-12-09T02:35:09.078 INFO:tasks.workunit.client.1.smithi161.stdout:1/346: fdatasync d6/d49/f60 0 2023-12-09T02:35:09.078 INFO:tasks.workunit.client.1.smithi161.stdout:1/347: truncate d6/d8/da/dd/f21 1746417 0 2023-12-09T02:35:09.096 INFO:tasks.workunit.client.1.smithi161.stdout:9/205: dwrite d2/da/f10 [0,4194304] 0 2023-12-09T02:35:09.096 INFO:tasks.workunit.client.1.smithi161.stdout:1/348: dwrite d6/d9/f45 [0,4194304] 0 2023-12-09T02:35:09.097 INFO:tasks.workunit.client.1.smithi161.stdout:1/349: dread - d6/d9/d5c/f66 zero size 2023-12-09T02:35:09.101 INFO:tasks.workunit.client.1.smithi161.stdout:1/350: creat d6/d8/d63/d35/f6a x:0 0 0 2023-12-09T02:35:09.107 INFO:tasks.workunit.client.1.smithi161.stdout:1/351: dread d6/d8/d63/d1c/f69 [0,4194304] 0 2023-12-09T02:35:09.107 INFO:tasks.workunit.client.1.smithi161.stdout:1/352: fdatasync d6/d8/da/dd/fe 0 2023-12-09T02:35:09.110 INFO:tasks.workunit.client.1.smithi161.stdout:1/353: creat d6/d8/da/d47/d5a/f6b x:0 0 0 2023-12-09T02:35:09.110 INFO:tasks.workunit.client.1.smithi161.stdout:1/354: dread d6/f59 [0,4194304] 0 2023-12-09T02:35:09.114 INFO:tasks.workunit.client.1.smithi161.stdout:1/355: symlink d6/d8/l6c 0 2023-12-09T02:35:09.114 INFO:tasks.workunit.client.1.smithi161.stdout:1/356: fsync d6/d8/d63/d35/f3c 0 2023-12-09T02:35:09.134 INFO:tasks.workunit.client.1.smithi161.stdout:1/357: dwrite d6/d8/d63/d1c/f69 [0,4194304] 0 2023-12-09T02:35:09.135 INFO:tasks.workunit.client.1.smithi161.stdout:1/358: creat d6/d8/da/d47/f6d x:0 0 0 2023-12-09T02:35:09.135 INFO:tasks.workunit.client.1.smithi161.stdout:1/359: dread - d6/d9/d5c/f66 zero size 2023-12-09T02:35:09.147 INFO:tasks.workunit.client.1.smithi161.stdout:1/360: dwrite d6/d8/d63/f65 [0,4194304] 0 2023-12-09T02:35:09.147 INFO:tasks.workunit.client.1.smithi161.stdout:1/361: truncate d6/d8/da/d47/f6d 1007350 0 2023-12-09T02:35:09.151 INFO:tasks.workunit.client.1.smithi161.stdout:1/362: link l3 d6/d8/da/d47/d5a/l6e 0 2023-12-09T02:35:09.151 INFO:tasks.workunit.client.1.smithi161.stdout:1/363: stat d6/d8/d63/d35/l43 0 2023-12-09T02:35:09.151 INFO:tasks.workunit.client.1.smithi161.stdout:1/364: chown d6/d8/d63/d35/d3d/l52 0 1 2023-12-09T02:35:09.152 INFO:tasks.workunit.client.1.smithi161.stdout:1/365: symlink d6/d8/d63/d35/d3d/l6f 0 2023-12-09T02:35:09.152 INFO:tasks.workunit.client.1.smithi161.stdout:1/366: fdatasync d6/d8/d63/d4d/f2f 0 2023-12-09T02:35:09.152 INFO:tasks.workunit.client.1.smithi161.stdout:1/367: write d6/d8/d63/d35/f3c [4876683,12594] 0 2023-12-09T02:35:09.153 INFO:tasks.workunit.client.1.smithi161.stdout:1/368: unlink d6/f38 0 2023-12-09T02:35:09.154 INFO:tasks.workunit.client.1.smithi161.stdout:1/369: write d6/d8/d63/d4d/f2f [1827460,52163] 0 2023-12-09T02:35:09.155 INFO:tasks.workunit.client.1.smithi161.stdout:1/370: symlink d6/d9/d5c/l70 0 2023-12-09T02:35:09.156 INFO:tasks.workunit.client.1.smithi161.stdout:1/371: rename d6/d8/da/c10 to d6/d8/d68/c71 0 2023-12-09T02:35:09.173 INFO:tasks.workunit.client.1.smithi161.stdout:1/372: dwrite d6/d8/d63/f22 [0,4194304] 0 2023-12-09T02:35:09.177 INFO:tasks.workunit.client.1.smithi161.stdout:1/373: dread d6/d8/d63/d4d/f53 [0,4194304] 0 2023-12-09T02:35:09.178 INFO:tasks.workunit.client.1.smithi161.stdout:1/374: read d6/d8/d63/d4d/f53 [865507,4136] 0 2023-12-09T02:35:09.178 INFO:tasks.workunit.client.1.smithi161.stdout:1/375: truncate d6/d8/d63/d4d/f3b 1193012 0 2023-12-09T02:35:09.185 INFO:tasks.workunit.client.1.smithi161.stdout:1/376: mknod d6/d8/d63/c72 0 2023-12-09T02:35:09.190 INFO:tasks.workunit.client.1.smithi161.stdout:1/377: rename d6/d8/da to d6/d8/d63/d4d/d31/d73 0 2023-12-09T02:35:09.192 INFO:tasks.workunit.client.1.smithi161.stdout:1/378: creat d6/d8/d68/f74 x:0 0 0 2023-12-09T02:35:09.193 INFO:tasks.workunit.client.1.smithi161.stdout:1/379: mkdir d6/d8/d63/d35/d3d/d75 0 2023-12-09T02:35:09.195 INFO:tasks.workunit.client.1.smithi161.stdout:1/380: creat d6/d8/d63/d4d/d31/f76 x:0 0 0 2023-12-09T02:35:09.196 INFO:tasks.workunit.client.1.smithi161.stdout:1/381: rename d6/d8/d63/d4d/d31/d73/dd/l2a to d6/d8/d63/d4d/d31/l77 0 2023-12-09T02:35:09.197 INFO:tasks.workunit.client.1.smithi161.stdout:1/382: write d6/d8/d63/d4d/d31/f3a [4250112,27838] 0 2023-12-09T02:35:09.198 INFO:tasks.workunit.client.1.smithi161.stdout:1/383: mknod d6/d8/d63/d1c/c78 0 2023-12-09T02:35:09.199 INFO:tasks.workunit.client.1.smithi161.stdout:1/384: fsync d6/d8/d63/d4d/d31/d73/dd/fe 0 2023-12-09T02:35:09.199 INFO:tasks.workunit.client.1.smithi161.stdout:1/385: readlink d6/d8/d63/d35/l4a 0 2023-12-09T02:35:09.199 INFO:tasks.workunit.client.1.smithi161.stdout:1/386: fdatasync d6/d8/d63/d4d/f53 0 2023-12-09T02:35:09.199 INFO:tasks.workunit.client.1.smithi161.stdout:1/387: mkdir d6/d8/d63/d79 0 2023-12-09T02:35:09.199 INFO:tasks.workunit.client.1.smithi161.stdout:1/388: write d6/d49/f60 [390948,9022] 0 2023-12-09T02:35:09.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/389: read d6/d8/d63/d4d/d31/d73/d47/f6d [332335,118040] 0 2023-12-09T02:35:09.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/390: chown d6/d8/d63/l5d 485 1 2023-12-09T02:35:09.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/391: chown d6/d8/d63/d1c/c5f 16597850 1 2023-12-09T02:35:09.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/392: creat d6/d8/d63/d4d/d31/d73/d47/d5a/f7a x:0 0 0 2023-12-09T02:35:09.218 INFO:tasks.workunit.client.1.smithi161.stdout:0/225: sync 2023-12-09T02:35:09.220 INFO:tasks.workunit.client.1.smithi161.stdout:0/226: creat d9/db/d2a/d35/f43 x:0 0 0 2023-12-09T02:35:09.220 INFO:tasks.workunit.client.1.smithi161.stdout:0/227: dread - d9/db/d2a/d35/f43 zero size 2023-12-09T02:35:09.220 INFO:tasks.workunit.client.1.smithi161.stdout:0/228: fdatasync d9/f20 0 2023-12-09T02:35:09.220 INFO:tasks.workunit.client.1.smithi161.stdout:0/229: write d9/dd/f1e [5132926,93032] 0 2023-12-09T02:35:09.220 INFO:tasks.workunit.client.1.smithi161.stdout:0/230: write d9/f1d [2087581,48797] 0 2023-12-09T02:35:09.223 INFO:tasks.workunit.client.1.smithi161.stdout:1/393: dwrite d6/d8/d63/d4d/d31/d73/d47/d5a/f6b [0,4194304] 0 2023-12-09T02:35:09.223 INFO:tasks.workunit.client.1.smithi161.stdout:1/394: chown d6/d8/d63/d4d/f53 6 1 2023-12-09T02:35:09.225 INFO:tasks.workunit.client.1.smithi161.stdout:1/395: creat d6/d8/d63/d35/f7b x:0 0 0 2023-12-09T02:35:09.226 INFO:tasks.workunit.client.1.smithi161.stdout:1/396: unlink d6/d8/d68/f74 0 2023-12-09T02:35:09.228 INFO:tasks.workunit.client.1.smithi161.stdout:1/397: symlink d6/d8/d63/d35/l7c 0 2023-12-09T02:35:09.228 INFO:tasks.workunit.client.1.smithi161.stdout:1/398: chown d6/d8/d63/d35/d3d/l6f 142 1 2023-12-09T02:35:09.229 INFO:tasks.workunit.client.1.smithi161.stdout:1/399: dread d6/f59 [0,4194304] 0 2023-12-09T02:35:09.231 INFO:tasks.workunit.client.1.smithi161.stdout:1/400: rename d6/d8/d63/d4d/d31/l62 to d6/d8/d63/d4d/d31/d73/dd/l7d 0 2023-12-09T02:35:09.233 INFO:tasks.workunit.client.1.smithi161.stdout:1/401: creat d6/d8/d63/d4d/d31/d73/d47/f7e x:0 0 0 2023-12-09T02:35:09.235 INFO:tasks.workunit.client.1.smithi161.stdout:1/402: symlink d6/d8/d63/d4d/d31/d73/dd/l7f 0 2023-12-09T02:35:09.235 INFO:tasks.workunit.client.1.smithi161.stdout:1/403: mkdir d6/d8/d63/d4d/d31/d80 0 2023-12-09T02:35:09.236 INFO:tasks.workunit.client.1.smithi161.stdout:1/404: dread - d6/d8/d63/d1c/f41 zero size 2023-12-09T02:35:09.236 INFO:tasks.workunit.client.1.smithi161.stdout:1/405: fsync d6/d8/d63/d4d/d31/d73/dd/fe 0 2023-12-09T02:35:09.236 INFO:tasks.workunit.client.1.smithi161.stdout:1/406: mkdir d6/d8/d63/d1c/d81 0 2023-12-09T02:35:09.238 INFO:tasks.workunit.client.1.smithi161.stdout:1/407: rename d6/f26 to d6/d8/d63/d79/f82 0 2023-12-09T02:35:09.238 INFO:tasks.workunit.client.1.smithi161.stdout:1/408: fsync d6/d8/d63/d4d/d31/f76 0 2023-12-09T02:35:09.240 INFO:tasks.workunit.client.1.smithi161.stdout:1/409: creat d6/d8/d63/d4d/d31/d80/f83 x:0 0 0 2023-12-09T02:35:09.240 INFO:tasks.workunit.client.1.smithi161.stdout:0/231: dwrite d9/dd/d21/d26/f42 [0,4194304] 0 2023-12-09T02:35:09.243 INFO:tasks.workunit.client.1.smithi161.stdout:0/232: write d9/d25/f33 [900580,100161] 0 2023-12-09T02:35:09.252 INFO:tasks.workunit.client.1.smithi161.stdout:0/233: dread d9/dd/d21/d26/f42 [0,4194304] 0 2023-12-09T02:35:09.256 INFO:tasks.workunit.client.1.smithi161.stdout:0/234: dread d9/dd/d21/d26/f42 [0,4194304] 0 2023-12-09T02:35:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.254+0000 7f607fa81700 1 -- 172.21.15.88:0/2790988650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6078111660 con 0x7f60780fbaf0 2023-12-09T02:35:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.255+0000 7f606e7fc700 1 -- 172.21.15.88:0/2790988650 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1810 (secure 0 0 0) 0x7f6074058a80 con 0x7f60780fbaf0 2023-12-09T02:35:09.257 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:35:09.257 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:35:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:35:09.259 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:35:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:35:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:35:09.260 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:35:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:35:09.260 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:35:09.260 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:35:09.260 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:35:09.260 INFO:tasks.workunit.client.1.smithi161.stdout:0/235: rmdir d9/d25 39 2023-12-09T02:35:09.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.257+0000 7f607fa81700 1 -- 172.21.15.88:0/2790988650 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f606406ad20 msgr2=0x7f606406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:09.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.257+0000 7f607fa81700 1 --2- 172.21.15.88:0/2790988650 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f606406ad20 0x7f606406d1d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f606800b0d0 tx=0x7f6068009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:09.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.257+0000 7f607fa81700 1 -- 172.21.15.88:0/2790988650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60780fbaf0 msgr2=0x7f607810f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:09.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.257+0000 7f607fa81700 1 --2- 172.21.15.88:0/2790988650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60780fbaf0 0x7f607810f6a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f607400eb70 tx=0x7f607400b040 comp rx=0 tx=0).stop 2023-12-09T02:35:09.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.257+0000 7f607fa81700 1 -- 172.21.15.88:0/2790988650 shutdown_connections 2023-12-09T02:35:09.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.257+0000 7f607fa81700 1 --2- 172.21.15.88:0/2790988650 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7f606406ad20 0x7f606406d1d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.257+0000 7f607fa81700 1 --2- 172.21.15.88:0/2790988650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60780fbaf0 0x7f607810f6a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.257+0000 7f607fa81700 1 --2- 172.21.15.88:0/2790988650 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60780fcd00 0x7f607810fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.257+0000 7f607fa81700 1 -- 172.21.15.88:0/2790988650 >> 172.21.15.88:0/2790988650 conn(0x7f60780f71b0 msgr2=0x7f6078065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:09.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.257+0000 7f607fa81700 1 -- 172.21.15.88:0/2790988650 shutdown_connections 2023-12-09T02:35:09.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.257+0000 7f607fa81700 1 -- 172.21.15.88:0/2790988650 wait complete. 2023-12-09T02:35:09.262 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:35:09.263 INFO:tasks.workunit.client.1.smithi161.stdout:0/236: rmdir d9/d25/d32 0 2023-12-09T02:35:09.264 INFO:tasks.workunit.client.1.smithi161.stdout:0/237: dread d9/d1f/f18 [0,4194304] 0 2023-12-09T02:35:09.265 INFO:tasks.workunit.client.1.smithi161.stdout:0/238: write d9/f1d [1359869,111107] 0 2023-12-09T02:35:09.265 INFO:tasks.workunit.client.1.smithi161.stdout:0/239: read - d9/db/d2a/d35/f43 zero size 2023-12-09T02:35:09.266 INFO:tasks.workunit.client.1.smithi161.stdout:0/240: write f7 [2081374,87893] 0 2023-12-09T02:35:09.267 INFO:tasks.workunit.client.1.smithi161.stdout:0/241: mkdir d9/dd/d21/d44 0 2023-12-09T02:35:09.269 INFO:tasks.workunit.client.1.smithi161.stdout:0/242: symlink d9/dd/l45 0 2023-12-09T02:35:09.269 INFO:tasks.workunit.client.1.smithi161.stdout:0/243: chown d9/d25/f2d 54615029 1 2023-12-09T02:35:09.269 INFO:tasks.workunit.client.1.smithi161.stdout:0/244: fsync d9/dd/d21/d26/f42 0 2023-12-09T02:35:09.330 INFO:tasks.workunit.client.1.smithi161.stdout:5/178: sync 2023-12-09T02:35:09.330 INFO:tasks.workunit.client.1.smithi161.stdout:3/223: sync 2023-12-09T02:35:09.330 INFO:tasks.workunit.client.1.smithi161.stdout:6/178: sync 2023-12-09T02:35:09.330 INFO:tasks.workunit.client.1.smithi161.stdout:2/195: sync 2023-12-09T02:35:09.330 INFO:tasks.workunit.client.1.smithi161.stdout:7/290: sync 2023-12-09T02:35:09.330 INFO:tasks.workunit.client.1.smithi161.stdout:4/252: sync 2023-12-09T02:35:09.330 INFO:tasks.workunit.client.1.smithi161.stdout:7/291: stat d0/d3/d21/f3b 0 2023-12-09T02:35:09.332 INFO:tasks.workunit.client.1.smithi161.stdout:6/179: truncate da/d19/f1b 1302683 0 2023-12-09T02:35:09.333 INFO:tasks.workunit.client.1.smithi161.stdout:2/196: creat d4/d1a/f40 x:0 0 0 2023-12-09T02:35:09.334 INFO:tasks.workunit.client.1.smithi161.stdout:2/197: dread d4/d1a/f3f [0,4194304] 0 2023-12-09T02:35:09.334 INFO:tasks.workunit.client.1.smithi161.stdout:2/198: read - d4/d1a/f35 zero size 2023-12-09T02:35:09.334 INFO:tasks.workunit.client.1.smithi161.stdout:2/199: fsync f1 0 2023-12-09T02:35:09.334 INFO:tasks.workunit.client.1.smithi161.stdout:2/200: readlink d4/d1a/l21 0 2023-12-09T02:35:09.337 INFO:tasks.workunit.client.1.smithi161.stdout:3/224: creat d2/d4/d11/d1f/d2a/f3b x:0 0 0 2023-12-09T02:35:09.337 INFO:tasks.workunit.client.1.smithi161.stdout:3/225: chown d2/d4/lf 105228 1 2023-12-09T02:35:09.338 INFO:tasks.workunit.client.1.smithi161.stdout:5/179: creat d0/d2/d7/d11/f41 x:0 0 0 2023-12-09T02:35:09.338 INFO:tasks.workunit.client.1.smithi161.stdout:5/180: dread - d0/d2/d7/d11/f37 zero size 2023-12-09T02:35:09.339 INFO:tasks.workunit.client.1.smithi161.stdout:5/181: write d0/f18 [3417137,97359] 0 2023-12-09T02:35:09.339 INFO:tasks.workunit.client.1.smithi161.stdout:5/182: stat d0/d9/c2b 0 2023-12-09T02:35:09.339 INFO:tasks.workunit.client.1.smithi161.stdout:5/183: fsync d0/d2/de/d21/f2c 0 2023-12-09T02:35:09.339 INFO:tasks.workunit.client.1.smithi161.stdout:5/184: chown d0/l24 729 1 2023-12-09T02:35:09.341 INFO:tasks.workunit.client.1.smithi161.stdout:4/253: rmdir dd/d1a/d23 39 2023-12-09T02:35:09.343 INFO:tasks.workunit.client.1.smithi161.stdout:7/292: mkdir d0/d3/d13/d2d/d43/d4b/d5a 0 2023-12-09T02:35:09.343 INFO:tasks.workunit.client.1.smithi161.stdout:7/293: write d0/d3/f7 [4516068,53921] 0 2023-12-09T02:35:09.345 INFO:tasks.workunit.client.1.smithi161.stdout:2/201: unlink d4/fe 0 2023-12-09T02:35:09.347 INFO:tasks.workunit.client.1.smithi161.stdout:3/226: creat d2/d4/d11/f3c x:0 0 0 2023-12-09T02:35:09.347 INFO:tasks.workunit.client.1.smithi161.stdout:3/227: dread d2/d4/f27 [0,4194304] 0 2023-12-09T02:35:09.349 INFO:tasks.workunit.client.1.smithi161.stdout:5/185: creat d0/d1f/f42 x:0 0 0 2023-12-09T02:35:09.349 INFO:tasks.workunit.client.1.smithi161.stdout:5/186: chown d0/d2/d7/df/f3a 0 1 2023-12-09T02:35:09.351 INFO:tasks.workunit.client.1.smithi161.stdout:4/254: mknod dd/d36/d3f/d54/c56 0 2023-12-09T02:35:09.355 INFO:tasks.workunit.client.1.smithi161.stdout:7/294: creat d0/d3/d13/d2d/f5b x:0 0 0 2023-12-09T02:35:09.355 INFO:tasks.workunit.client.1.smithi161.stdout:7/295: read - d0/d3/d13/f56 zero size 2023-12-09T02:35:09.355 INFO:tasks.workunit.client.1.smithi161.stdout:7/296: readlink d0/l38 0 2023-12-09T02:35:09.355 INFO:tasks.workunit.client.1.smithi161.stdout:7/297: read d0/fc [3682448,111210] 0 2023-12-09T02:35:09.356 INFO:tasks.workunit.client.1.smithi161.stdout:2/202: creat d4/f41 x:0 0 0 2023-12-09T02:35:09.358 INFO:tasks.workunit.client.1.smithi161.stdout:3/228: creat d2/d4/d2c/d2d/f3d x:0 0 0 2023-12-09T02:35:09.361 INFO:tasks.workunit.client.1.smithi161.stdout:5/187: link d0/d2/de/d21/f2c d0/d3e/f43 0 2023-12-09T02:35:09.363 INFO:tasks.workunit.client.1.smithi161.stdout:3/229: write d2/d4/f23 [2045661,67799] 0 2023-12-09T02:35:09.364 INFO:tasks.workunit.client.1.smithi161.stdout:4/255: unlink dd/d1a/d1d/l20 0 2023-12-09T02:35:09.365 INFO:tasks.workunit.client.1.smithi161.stdout:7/298: creat d0/d3/d21/d3e/f5c x:0 0 0 2023-12-09T02:35:09.365 INFO:tasks.workunit.client.1.smithi161.stdout:7/299: chown d0/d3/d13/d2d/f45 20734332 1 2023-12-09T02:35:09.365 INFO:tasks.workunit.client.1.smithi161.stdout:7/300: chown d0/d3/d13/d2f 1588 1 2023-12-09T02:35:09.365 INFO:tasks.workunit.client.1.smithi161.stdout:7/301: chown d0/fd 204067123 1 2023-12-09T02:35:09.365 INFO:tasks.workunit.client.1.smithi161.stdout:7/302: write d0/d29/f2e [1828336,105135] 0 2023-12-09T02:35:09.365 INFO:tasks.workunit.client.1.smithi161.stdout:5/188: truncate d0/d1f/f23 2718431 0 2023-12-09T02:35:09.366 INFO:tasks.workunit.client.1.smithi161.stdout:4/256: getdents dd/d1a/d1d/d25/d3a 0 2023-12-09T02:35:09.366 INFO:tasks.workunit.client.1.smithi161.stdout:4/257: chown dd/l10 389 1 2023-12-09T02:35:09.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.365+0000 7fe853ca2700 1 -- 172.21.15.88:0/897846520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe84c0fbaf0 msgr2=0x7fe84c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:09.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.365+0000 7fe853ca2700 1 --2- 172.21.15.88:0/897846520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe84c0fbaf0 0x7fe84c0fbf00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe848004940 tx=0x7fe848009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:09.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.365+0000 7fe853ca2700 1 -- 172.21.15.88:0/897846520 shutdown_connections 2023-12-09T02:35:09.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.365+0000 7fe853ca2700 1 --2- 172.21.15.88:0/897846520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c0fcd00 0x7fe84c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.365+0000 7fe853ca2700 1 --2- 172.21.15.88:0/897846520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe84c0fbaf0 0x7fe84c0fbf00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.365+0000 7fe853ca2700 1 -- 172.21.15.88:0/897846520 >> 172.21.15.88:0/897846520 conn(0x7fe84c0f7190 msgr2=0x7fe84c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:09.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.365+0000 7fe853ca2700 1 -- 172.21.15.88:0/897846520 shutdown_connections 2023-12-09T02:35:09.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.365+0000 7fe853ca2700 1 -- 172.21.15.88:0/897846520 wait complete. 2023-12-09T02:35:09.369 INFO:tasks.workunit.client.1.smithi161.stdout:7/303: creat d0/d3/d13/d2f/f5d x:0 0 0 2023-12-09T02:35:09.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.366+0000 7fe853ca2700 1 Processor -- start 2023-12-09T02:35:09.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.366+0000 7fe853ca2700 1 -- start start 2023-12-09T02:35:09.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.366+0000 7fe853ca2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe84c0fbaf0 0x7fe84c10c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:09.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.366+0000 7fe853ca2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c0fcd00 0x7fe84c10c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:09.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe853ca2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c10cfc0 con 0x7fe84c0fbaf0 2023-12-09T02:35:09.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe853ca2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c10d860 con 0x7fe84c0fcd00 2023-12-09T02:35:09.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe851a3e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe84c0fbaf0 0x7fe84c10c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:09.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe851a3e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe84c0fbaf0 0x7fe84c10c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55164/0 (socket says 172.21.15.88:55164) 2023-12-09T02:35:09.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe851a3e700 1 -- 172.21.15.88:0/3109158682 learned_addr learned my addr 172.21.15.88:0/3109158682 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:09.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe851a3e700 1 -- 172.21.15.88:0/3109158682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c0fcd00 msgr2=0x7fe84c10c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:09.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe851a3e700 1 --2- 172.21.15.88:0/3109158682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c0fcd00 0x7fe84c10c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe851a3e700 1 -- 172.21.15.88:0/3109158682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848005040 con 0x7fe84c0fbaf0 2023-12-09T02:35:09.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe851a3e700 1 --2- 172.21.15.88:0/3109158682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe84c0fbaf0 0x7fe84c10c480 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe84800b3b0 tx=0x7fe848009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:09.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe8427fc700 1 -- 172.21.15.88:0/3109158682 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe84800e030 con 0x7fe84c0fbaf0 2023-12-09T02:35:09.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe8427fc700 1 -- 172.21.15.88:0/3109158682 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe848004290 con 0x7fe84c0fbaf0 2023-12-09T02:35:09.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.367+0000 7fe853ca2700 1 -- 172.21.15.88:0/3109158682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84c10dae0 con 0x7fe84c0fbaf0 2023-12-09T02:35:09.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.368+0000 7fe853ca2700 1 -- 172.21.15.88:0/3109158682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84c10e020 con 0x7fe84c0fbaf0 2023-12-09T02:35:09.372 INFO:tasks.workunit.client.1.smithi161.stdout:5/189: rmdir d0/d3e 39 2023-12-09T02:35:09.372 INFO:tasks.workunit.client.1.smithi161.stdout:5/190: readlink d0/d2/de/d22/l2a 0 2023-12-09T02:35:09.372 INFO:tasks.workunit.client.1.smithi161.stdout:2/203: dwrite d4/d1a/f3e [0,4194304] 0 2023-12-09T02:35:09.372 INFO:tasks.workunit.client.1.smithi161.stdout:4/258: getdents dd/d36 0 2023-12-09T02:35:09.372 INFO:tasks.workunit.client.1.smithi161.stdout:7/304: mkdir d0/d29/d59/d5e 0 2023-12-09T02:35:09.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.369+0000 7fe8427fc700 1 -- 172.21.15.88:0/3109158682 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe848013dc0 con 0x7fe84c0fbaf0 2023-12-09T02:35:09.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.370+0000 7fe8427fc700 1 -- 172.21.15.88:0/3109158682 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 88622+0+0 (secure 0 0 0) 0x7fe84801c4d0 con 0x7fe84c0fbaf0 2023-12-09T02:35:09.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.370+0000 7fe853ca2700 1 -- 172.21.15.88:0/3109158682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84c04bb80 con 0x7fe84c0fbaf0 2023-12-09T02:35:09.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.370+0000 7fe8427fc700 1 --2- 172.21.15.88:0/3109158682 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe83806acc0 0x7fe83806d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:09.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.370+0000 7fe8427fc700 1 -- 172.21.15.88:0/3109158682 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe848013690 con 0x7fe84c0fbaf0 2023-12-09T02:35:09.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.371+0000 7fe85123d700 1 --2- 172.21.15.88:0/3109158682 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe83806acc0 0x7fe83806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:09.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.372+0000 7fe85123d700 1 --2- 172.21.15.88:0/3109158682 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe83806acc0 0x7fe83806d170 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe83c004d00 tx=0x7fe83c009ce0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:09.375 INFO:tasks.workunit.client.1.smithi161.stdout:2/204: mknod d4/d1a/c42 0 2023-12-09T02:35:09.376 INFO:tasks.workunit.client.1.smithi161.stdout:4/259: mknod dd/c57 0 2023-12-09T02:35:09.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.376+0000 7fe8427fc700 1 -- 172.21.15.88:0/3109158682 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe84805be10 con 0x7fe84c0fbaf0 2023-12-09T02:35:09.378 INFO:tasks.workunit.client.1.smithi161.stdout:7/305: mknod d0/d3/d13/d4e/c5f 0 2023-12-09T02:35:09.380 INFO:tasks.workunit.client.1.smithi161.stdout:2/205: link d4/d1a/c27 d4/c43 0 2023-12-09T02:35:09.382 INFO:tasks.workunit.client.1.smithi161.stdout:3/230: dwrite d2/d4/f27 [0,4194304] 0 2023-12-09T02:35:09.382 INFO:tasks.workunit.client.1.smithi161.stdout:3/231: chown d2/d4/d11/d1f 5998 1 2023-12-09T02:35:09.383 INFO:tasks.workunit.client.1.smithi161.stdout:4/260: mkdir dd/d1a/d1d/d25/d32/d58 0 2023-12-09T02:35:09.383 INFO:tasks.workunit.client.1.smithi161.stdout:4/261: fdatasync dd/d36/d3f/f4b 0 2023-12-09T02:35:09.383 INFO:tasks.workunit.client.1.smithi161.stdout:4/262: stat dd/d1a/d1d/d25/f30 0 2023-12-09T02:35:09.383 INFO:tasks.workunit.client.1.smithi161.stdout:4/263: write dd/fe [369212,109162] 0 2023-12-09T02:35:09.385 INFO:tasks.workunit.client.1.smithi161.stdout:7/306: link d0/d3/d13/d1b/l44 d0/d29/d59/l60 0 2023-12-09T02:35:09.385 INFO:tasks.workunit.client.1.smithi161.stdout:7/307: write d0/f42 [1861590,34723] 0 2023-12-09T02:35:09.388 INFO:tasks.workunit.client.1.smithi161.stdout:2/206: creat d4/f44 x:0 0 0 2023-12-09T02:35:09.396 INFO:tasks.workunit.client.1.smithi161.stdout:2/207: dread f1 [0,4194304] 0 2023-12-09T02:35:09.396 INFO:tasks.workunit.client.1.smithi161.stdout:3/232: mkdir d2/d4/d2c/d3e 0 2023-12-09T02:35:09.398 INFO:tasks.workunit.client.1.smithi161.stdout:4/264: creat dd/f59 x:0 0 0 2023-12-09T02:35:09.398 INFO:tasks.workunit.client.1.smithi161.stdout:4/265: chown dd/d1a/d1d/d25/d3a/l50 1367535718 1 2023-12-09T02:35:09.399 INFO:tasks.workunit.client.1.smithi161.stdout:7/308: getdents d0/d3/d13/d2d 0 2023-12-09T02:35:09.399 INFO:tasks.workunit.client.1.smithi161.stdout:7/309: truncate d0/d3/d13/d1b/f3f 596161 0 2023-12-09T02:35:09.400 INFO:tasks.workunit.client.1.smithi161.stdout:7/310: write d0/d3/d13/f22 [254549,50452] 0 2023-12-09T02:35:09.402 INFO:tasks.workunit.client.1.smithi161.stdout:5/191: rename d0/d3e to d0/d2/de/d44 0 2023-12-09T02:35:09.404 INFO:tasks.workunit.client.1.smithi161.stdout:7/311: dread d0/d3/f17 [0,4194304] 0 2023-12-09T02:35:09.404 INFO:tasks.workunit.client.1.smithi161.stdout:5/192: dread d0/d2/d7/d11/f35 [0,4194304] 0 2023-12-09T02:35:09.405 INFO:tasks.workunit.client.1.smithi161.stdout:5/193: dread d0/f1a [0,4194304] 0 2023-12-09T02:35:09.406 INFO:tasks.workunit.client.1.smithi161.stdout:5/194: readlink d0/d2/de/d22/l34 0 2023-12-09T02:35:09.406 INFO:tasks.workunit.client.1.smithi161.stdout:2/208: creat d4/d7/f45 x:0 0 0 2023-12-09T02:35:09.406 INFO:tasks.workunit.client.1.smithi161.stdout:7/312: write d0/d3/d13/f1f [349601,91732] 0 2023-12-09T02:35:09.406 INFO:tasks.workunit.client.1.smithi161.stdout:7/313: stat d0/d3/d13/d2d/d43/d4b/d5a 0 2023-12-09T02:35:09.406 INFO:tasks.workunit.client.1.smithi161.stdout:7/314: chown d0/d3/d13/d1b/f3f 10720 1 2023-12-09T02:35:09.406 INFO:tasks.workunit.client.1.smithi161.stdout:7/315: dread - d0/d49/f4c zero size 2023-12-09T02:35:09.406 INFO:tasks.workunit.client.1.smithi161.stdout:7/316: fsync d0/d3/d13/d2d/f45 0 2023-12-09T02:35:09.409 INFO:tasks.workunit.client.1.smithi161.stdout:3/233: symlink d2/d4/d2c/d3e/l3f 0 2023-12-09T02:35:09.410 INFO:tasks.workunit.client.1.smithi161.stdout:4/266: mkdir dd/d5a 0 2023-12-09T02:35:09.411 INFO:tasks.workunit.client.1.smithi161.stdout:4/267: write f9 [9071,117791] 0 2023-12-09T02:35:09.411 INFO:tasks.workunit.client.1.smithi161.stdout:4/268: write dd/d36/d3f/f43 [814135,59054] 0 2023-12-09T02:35:09.412 INFO:tasks.workunit.client.1.smithi161.stdout:4/269: write dd/f18 [776509,38773] 0 2023-12-09T02:35:09.412 INFO:tasks.workunit.client.1.smithi161.stdout:4/270: read dd/d1a/d1d/d25/f30 [776616,31633] 0 2023-12-09T02:35:09.415 INFO:tasks.workunit.client.1.smithi161.stdout:5/195: mknod d0/c45 0 2023-12-09T02:35:09.416 INFO:tasks.workunit.client.1.smithi161.stdout:5/196: write d0/d2/f3 [1913435,1925] 0 2023-12-09T02:35:09.416 INFO:tasks.workunit.client.1.smithi161.stdout:5/197: write d0/d2/de/f3f [103724,56277] 0 2023-12-09T02:35:09.416 INFO:tasks.workunit.client.1.smithi161.stdout:4/271: dread dd/d36/d3f/f43 [0,4194304] 0 2023-12-09T02:35:09.419 INFO:tasks.workunit.client.1.smithi161.stdout:2/209: getdents d4/d1a 0 2023-12-09T02:35:09.433 INFO:tasks.workunit.client.1.smithi161.stdout:3/234: mkdir d2/d4/d2c/d40 0 2023-12-09T02:35:09.441 INFO:tasks.workunit.client.1.smithi161.stdout:2/210: unlink d4/d7/c2a 0 2023-12-09T02:35:09.442 INFO:tasks.workunit.client.1.smithi161.stdout:2/211: truncate d4/f30 171051 0 2023-12-09T02:35:09.443 INFO:tasks.workunit.client.1.smithi161.stdout:7/317: mknod d0/d3/c61 0 2023-12-09T02:35:09.444 INFO:tasks.workunit.client.1.smithi161.stdout:4/272: dwrite dd/d1a/d1d/d25/f30 [0,4194304] 0 2023-12-09T02:35:09.444 INFO:tasks.workunit.client.1.smithi161.stdout:4/273: stat dd/c14 0 2023-12-09T02:35:09.445 INFO:tasks.workunit.client.1.smithi161.stdout:4/274: readlink lb 0 2023-12-09T02:35:09.445 INFO:tasks.workunit.client.1.smithi161.stdout:4/275: stat dd/d1a/d1d/d25 0 2023-12-09T02:35:09.445 INFO:tasks.workunit.client.1.smithi161.stdout:4/276: write dd/d1a/d1e/f4f [66291,120586] 0 2023-12-09T02:35:09.445 INFO:tasks.workunit.client.1.smithi161.stdout:5/198: dwrite d0/d2/de/f3f [0,4194304] 0 2023-12-09T02:35:09.446 INFO:tasks.workunit.client.1.smithi161.stdout:5/199: dread d0/d2/d7/f39 [0,4194304] 0 2023-12-09T02:35:09.448 INFO:tasks.workunit.client.1.smithi161.stdout:3/235: creat d2/d37/f41 x:0 0 0 2023-12-09T02:35:09.449 INFO:tasks.workunit.client.1.smithi161.stdout:2/212: mkdir d4/d46 0 2023-12-09T02:35:09.452 INFO:tasks.workunit.client.1.smithi161.stdout:7/318: symlink d0/d29/d53/l62 0 2023-12-09T02:35:09.452 INFO:tasks.workunit.client.1.smithi161.stdout:7/319: write d0/d3/d21/d3e/f5c [595149,11198] 0 2023-12-09T02:35:09.455 INFO:tasks.workunit.client.1.smithi161.stdout:4/277: mkdir dd/d5b 0 2023-12-09T02:35:09.456 INFO:tasks.workunit.client.1.smithi161.stdout:5/200: dread d0/d2/de/f3f [0,4194304] 0 2023-12-09T02:35:09.458 INFO:tasks.workunit.client.1.smithi161.stdout:3/236: dread d2/f15 [0,4194304] 0 2023-12-09T02:35:09.468 INFO:tasks.workunit.client.1.smithi161.stdout:7/320: creat d0/d3/f63 x:0 0 0 2023-12-09T02:35:09.468 INFO:tasks.workunit.client.1.smithi161.stdout:7/321: dread - d0/d3/d13/f58 zero size 2023-12-09T02:35:09.468 INFO:tasks.workunit.client.1.smithi161.stdout:7/322: chown d0/d3/d13/f58 164427906 1 2023-12-09T02:35:09.471 INFO:tasks.workunit.client.1.smithi161.stdout:4/278: link dd/d1a/d1d/l2e dd/d36/d3f/d54/l5c 0 2023-12-09T02:35:09.471 INFO:tasks.workunit.client.1.smithi161.stdout:4/279: chown dd/c14 536865046 1 2023-12-09T02:35:09.471 INFO:tasks.workunit.client.1.smithi161.stdout:5/201: symlink d0/d1f/l46 0 2023-12-09T02:35:09.474 INFO:tasks.workunit.client.1.smithi161.stdout:7/323: creat d0/d3/d21/d54/f64 x:0 0 0 2023-12-09T02:35:09.475 INFO:tasks.workunit.client.1.smithi161.stdout:4/280: creat dd/d1a/d29/f5d x:0 0 0 2023-12-09T02:35:09.475 INFO:tasks.workunit.client.1.smithi161.stdout:4/281: stat dd/d1a/d1d/d25/d3a 0 2023-12-09T02:35:09.475 INFO:tasks.workunit.client.1.smithi161.stdout:4/282: readlink dd/d36/l3e 0 2023-12-09T02:35:09.475 INFO:tasks.workunit.client.1.smithi161.stdout:4/283: chown dd/d1a/d1d/d25/c35 53337 1 2023-12-09T02:35:09.476 INFO:tasks.workunit.client.1.smithi161.stdout:2/213: dwrite f1 [0,4194304] 0 2023-12-09T02:35:09.476 INFO:tasks.workunit.client.1.smithi161.stdout:3/237: dwrite d2/d4/d11/f3c [0,4194304] 0 2023-12-09T02:35:09.476 INFO:tasks.workunit.client.1.smithi161.stdout:3/238: write d2/d4/d11/d1f/d2a/f2b [850991,116237] 0 2023-12-09T02:35:09.477 INFO:tasks.workunit.client.1.smithi161.stdout:5/202: mknod d0/d2/d7/df/c47 0 2023-12-09T02:35:09.481 INFO:tasks.workunit.client.1.smithi161.stdout:4/284: truncate dd/d1a/d1d/d25/f3b 3798555 0 2023-12-09T02:35:09.483 INFO:tasks.workunit.client.1.smithi161.stdout:7/324: dread d0/d3/d21/d3e/f5c [0,4194304] 0 2023-12-09T02:35:09.487 INFO:tasks.workunit.client.1.smithi161.stdout:3/239: creat d2/f42 x:0 0 0 2023-12-09T02:35:09.490 INFO:tasks.workunit.client.1.smithi161.stdout:5/203: rename d0/d2/de/d22/l34 to d0/d2/d7/l48 0 2023-12-09T02:35:09.491 INFO:tasks.workunit.client.1.smithi161.stdout:2/214: dwrite d4/d7/f38 [0,4194304] 0 2023-12-09T02:35:09.492 INFO:tasks.workunit.client.1.smithi161.stdout:4/285: rmdir dd/d5b 0 2023-12-09T02:35:09.494 INFO:tasks.workunit.client.1.smithi161.stdout:7/325: mknod d0/d29/d59/c65 0 2023-12-09T02:35:09.496 INFO:tasks.workunit.client.1.smithi161.stdout:3/240: link d2/d4/l8 d2/d4/d11/d1f/l43 0 2023-12-09T02:35:09.502 INFO:tasks.workunit.client.1.smithi161.stdout:5/204: rename d0/d2/d7/df/f3a to d0/d2/de/d44/f49 0 2023-12-09T02:35:09.505 INFO:tasks.workunit.client.1.smithi161.stdout:5/205: read d0/d2/de/d22/f32 [2988006,18183] 0 2023-12-09T02:35:09.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/326: truncate d0/f42 597227 0 2023-12-09T02:35:09.520 INFO:tasks.workunit.client.1.smithi161.stdout:3/241: dwrite d2/d4/d2c/d2d/f34 [0,4194304] 0 2023-12-09T02:35:09.521 INFO:tasks.workunit.client.1.smithi161.stdout:2/215: dwrite d4/fa [0,4194304] 0 2023-12-09T02:35:09.521 INFO:tasks.workunit.client.1.smithi161.stdout:2/216: chown d4/d16 2587388 1 2023-12-09T02:35:09.522 INFO:tasks.workunit.client.1.smithi161.stdout:4/286: rename dd/c14 to dd/d5a/c5e 0 2023-12-09T02:35:09.523 INFO:tasks.workunit.client.1.smithi161.stdout:5/206: link d0/d2/d7/c20 d0/d2/de/d44/c4a 0 2023-12-09T02:35:09.529 INFO:tasks.workunit.client.1.smithi161.stdout:3/242: mkdir d2/d44 0 2023-12-09T02:35:09.529 INFO:tasks.workunit.client.1.smithi161.stdout:3/243: truncate d2/d37/f41 567522 0 2023-12-09T02:35:09.529 INFO:tasks.workunit.client.1.smithi161.stdout:3/244: read - d2/d4/d11/d19/f3a zero size 2023-12-09T02:35:09.529 INFO:tasks.workunit.client.1.smithi161.stdout:3/245: chown d2 71313797 1 2023-12-09T02:35:09.529 INFO:tasks.workunit.client.1.smithi161.stdout:7/327: dread d0/d3/d13/f1f [0,4194304] 0 2023-12-09T02:35:09.530 INFO:tasks.workunit.client.1.smithi161.stdout:4/287: mkdir dd/d36/d4a/d5f 0 2023-12-09T02:35:09.531 INFO:tasks.workunit.client.1.smithi161.stdout:3/246: symlink d2/d4/d11/d28/l45 0 2023-12-09T02:35:09.532 INFO:tasks.workunit.client.1.smithi161.stdout:4/288: creat dd/d1a/d1d/d25/d32/d34/f60 x:0 0 0 2023-12-09T02:35:09.535 INFO:tasks.workunit.client.1.smithi161.stdout:5/207: dread d0/f27 [0,4194304] 0 2023-12-09T02:35:09.536 INFO:tasks.workunit.client.1.smithi161.stdout:3/247: unlink d2/d4/d2c/d2d/f34 0 2023-12-09T02:35:09.537 INFO:tasks.workunit.client.1.smithi161.stdout:4/289: mknod dd/d1a/c61 0 2023-12-09T02:35:09.537 INFO:tasks.workunit.client.1.smithi161.stdout:4/290: stat dd/d36/d3f/d54 0 2023-12-09T02:35:09.537 INFO:tasks.workunit.client.1.smithi161.stdout:4/291: chown lc 2268 1 2023-12-09T02:35:09.537 INFO:tasks.workunit.client.1.smithi161.stdout:5/208: write d0/d2/de/d22/f32 [3522669,17184] 0 2023-12-09T02:35:09.540 INFO:tasks.workunit.client.1.smithi161.stdout:5/209: read d0/d2/f16 [1521456,113347] 0 2023-12-09T02:35:09.540 INFO:tasks.workunit.client.1.smithi161.stdout:5/210: write d0/d2/d7/d11/f37 [165250,9340] 0 2023-12-09T02:35:09.541 INFO:tasks.workunit.client.1.smithi161.stdout:5/211: chown d0/d2/d7/c20 839306 1 2023-12-09T02:35:09.542 INFO:tasks.workunit.client.1.smithi161.stdout:7/328: dread d0/d3/d13/d1b/f2b [4194304,4194304] 0 2023-12-09T02:35:09.549 INFO:tasks.workunit.client.1.smithi161.stdout:2/217: dwrite d4/f20 [0,4194304] 0 2023-12-09T02:35:09.551 INFO:tasks.workunit.client.1.smithi161.stdout:5/212: dread d0/d2/f16 [8388608,4194304] 0 2023-12-09T02:35:09.551 INFO:tasks.workunit.client.1.smithi161.stdout:5/213: truncate d0/d2/de/f3f 4638250 0 2023-12-09T02:35:09.551 INFO:tasks.workunit.client.1.smithi161.stdout:5/214: chown d0/d2/d7 15 1 2023-12-09T02:35:09.552 INFO:tasks.workunit.client.1.smithi161.stdout:5/215: dread d0/d2/d7/d11/f35 [0,4194304] 0 2023-12-09T02:35:09.552 INFO:tasks.workunit.client.1.smithi161.stdout:3/248: rename d2/d4/d2c to d2/d4/d11/d1f/d2a/d46 0 2023-12-09T02:35:09.553 INFO:tasks.workunit.client.1.smithi161.stdout:3/249: dread d2/d37/f41 [0,4194304] 0 2023-12-09T02:35:09.556 INFO:tasks.workunit.client.1.smithi161.stdout:2/218: creat d4/d1a/f47 x:0 0 0 2023-12-09T02:35:09.557 INFO:tasks.workunit.client.1.smithi161.stdout:5/216: mknod d0/d2/d7/c4b 0 2023-12-09T02:35:09.557 INFO:tasks.workunit.client.1.smithi161.stdout:9/206: sync 2023-12-09T02:35:09.558 INFO:tasks.workunit.client.1.smithi161.stdout:8/195: sync 2023-12-09T02:35:09.559 INFO:tasks.workunit.client.1.smithi161.stdout:7/329: dwrite d0/d3/d13/d2d/f45 [0,4194304] 0 2023-12-09T02:35:09.559 INFO:tasks.workunit.client.1.smithi161.stdout:4/292: dwrite dd/f15 [0,4194304] 0 2023-12-09T02:35:09.560 INFO:tasks.workunit.client.1.smithi161.stdout:3/250: unlink d2/d37/f41 0 2023-12-09T02:35:09.561 INFO:tasks.workunit.client.1.smithi161.stdout:5/217: link d0/d2/f3 d0/d2/d7/d11/f4c 0 2023-12-09T02:35:09.564 INFO:tasks.workunit.client.1.smithi161.stdout:9/207: link d2/f12 d2/da/d16/d2e/f40 0 2023-12-09T02:35:09.566 INFO:tasks.workunit.client.1.smithi161.stdout:8/196: creat d2/d5/d22/d31/f41 x:0 0 0 2023-12-09T02:35:09.573 INFO:tasks.workunit.client.1.smithi161.stdout:5/218: creat d0/d2/f4d x:0 0 0 2023-12-09T02:35:09.573 INFO:tasks.workunit.client.1.smithi161.stdout:5/219: chown d0/f1a 41103034 1 2023-12-09T02:35:09.573 INFO:tasks.workunit.client.1.smithi161.stdout:5/220: readlink d0/d2/d7/l48 0 2023-12-09T02:35:09.573 INFO:tasks.workunit.client.1.smithi161.stdout:5/221: truncate d0/f1 4676441 0 2023-12-09T02:35:09.573 INFO:tasks.workunit.client.1.smithi161.stdout:5/222: fdatasync d0/d2/f16 0 2023-12-09T02:35:09.574 INFO:tasks.workunit.client.1.smithi161.stdout:2/219: dwrite d4/d1a/f1b [0,4194304] 0 2023-12-09T02:35:09.574 INFO:tasks.workunit.client.1.smithi161.stdout:2/220: dread - d4/d7/f45 zero size 2023-12-09T02:35:09.574 INFO:tasks.workunit.client.1.smithi161.stdout:8/197: symlink d2/d5/d22/d31/l42 0 2023-12-09T02:35:09.574 INFO:tasks.workunit.client.1.smithi161.stdout:5/223: dread d0/f1a [0,4194304] 0 2023-12-09T02:35:09.576 INFO:tasks.workunit.client.1.smithi161.stdout:8/198: write d2/d5/fb [3653467,37860] 0 2023-12-09T02:35:09.576 INFO:tasks.workunit.client.1.smithi161.stdout:7/330: rename d0/d3/d13/d2f/f3a to d0/d3/f66 0 2023-12-09T02:35:09.577 INFO:tasks.workunit.client.1.smithi161.stdout:3/251: truncate d2/d4/d11/f14 3355542 0 2023-12-09T02:35:09.579 INFO:tasks.workunit.client.1.smithi161.stdout:5/224: unlink d0/d2/c38 0 2023-12-09T02:35:09.580 INFO:tasks.workunit.client.1.smithi161.stdout:4/293: rename dd/d36/l3e to dd/d1a/d29/l62 0 2023-12-09T02:35:09.580 INFO:tasks.workunit.client.1.smithi161.stdout:4/294: readlink lb 0 2023-12-09T02:35:09.581 INFO:tasks.workunit.client.1.smithi161.stdout:4/295: write dd/f19 [86729,63831] 0 2023-12-09T02:35:09.581 INFO:tasks.workunit.client.1.smithi161.stdout:7/331: mkdir d0/d49/d67 0 2023-12-09T02:35:09.581 INFO:tasks.workunit.client.1.smithi161.stdout:7/332: fdatasync d0/d3/d13/f56 0 2023-12-09T02:35:09.581 INFO:tasks.workunit.client.1.smithi161.stdout:7/333: fdatasync d0/d3/d13/d1b/f2b 0 2023-12-09T02:35:09.581 INFO:tasks.workunit.client.1.smithi161.stdout:3/252: mkdir d2/d4/d11/d1f/d2a/d46/d2d/d47 0 2023-12-09T02:35:09.582 INFO:tasks.workunit.client.1.smithi161.stdout:3/253: chown d2/d4/d11/d1f/d2a/d46/c24 5853 1 2023-12-09T02:35:09.583 INFO:tasks.workunit.client.1.smithi161.stdout:5/225: mknod d0/d2/c4e 0 2023-12-09T02:35:09.585 INFO:tasks.workunit.client.1.smithi161.stdout:9/208: rename d2/da/l33 to d2/l41 0 2023-12-09T02:35:09.585 INFO:tasks.workunit.client.1.smithi161.stdout:9/209: truncate d2/da/d16/f36 25037 0 2023-12-09T02:35:09.585 INFO:tasks.workunit.client.1.smithi161.stdout:9/210: write d2/f1b [915393,37077] 0 2023-12-09T02:35:09.586 INFO:tasks.workunit.client.1.smithi161.stdout:4/296: creat dd/d1a/d23/f63 x:0 0 0 2023-12-09T02:35:09.587 INFO:tasks.workunit.client.1.smithi161.stdout:7/334: symlink d0/d3/d21/l68 0 2023-12-09T02:35:09.588 INFO:tasks.workunit.client.1.smithi161.stdout:3/254: symlink d2/d4/d11/d28/l48 0 2023-12-09T02:35:09.589 INFO:tasks.workunit.client.1.smithi161.stdout:3/255: chown d2/d4/l10 7 1 2023-12-09T02:35:09.589 INFO:tasks.workunit.client.1.smithi161.stdout:3/256: truncate d2/d37/f38 626839 0 2023-12-09T02:35:09.590 INFO:tasks.workunit.client.1.smithi161.stdout:5/226: symlink d0/d2/de/l4f 0 2023-12-09T02:35:09.590 INFO:tasks.workunit.client.1.smithi161.stdout:5/227: chown d0/d2/d7 28 1 2023-12-09T02:35:09.590 INFO:tasks.workunit.client.1.smithi161.stdout:5/228: truncate d0/d2/d7/f39 1161942 0 2023-12-09T02:35:09.591 INFO:tasks.workunit.client.1.smithi161.stdout:4/297: creat dd/d1a/f64 x:0 0 0 2023-12-09T02:35:09.593 INFO:tasks.workunit.client.1.smithi161.stdout:9/211: dread d2/f9 [0,4194304] 0 2023-12-09T02:35:09.593 INFO:tasks.workunit.client.1.smithi161.stdout:7/335: mknod d0/d3/d13/d1b/c69 0 2023-12-09T02:35:09.595 INFO:tasks.workunit.client.1.smithi161.stdout:5/229: mkdir d0/d2/d7/d11/d50 0 2023-12-09T02:35:09.600 INFO:tasks.workunit.client.1.smithi161.stdout:4/298: rmdir dd/d36/d3f 39 2023-12-09T02:35:09.604 INFO:tasks.workunit.client.1.smithi161.stdout:4/299: stat dd/cf 0 2023-12-09T02:35:09.604 INFO:tasks.workunit.client.1.smithi161.stdout:4/300: write dd/f13 [4188214,71414] 0 2023-12-09T02:35:09.604 INFO:tasks.workunit.client.1.smithi161.stdout:4/301: write f7 [4598504,115246] 0 2023-12-09T02:35:09.604 INFO:tasks.workunit.client.1.smithi161.stdout:4/302: truncate dd/d36/d4a/f51 110423 0 2023-12-09T02:35:09.605 INFO:tasks.workunit.client.1.smithi161.stdout:7/336: mkdir d0/d3/d6a 0 2023-12-09T02:35:09.605 INFO:tasks.workunit.client.1.smithi161.stdout:5/230: dread d0/f18 [0,4194304] 0 2023-12-09T02:35:09.607 INFO:tasks.workunit.client.1.smithi161.stdout:4/303: mkdir dd/d36/d4a/d5f/d65 0 2023-12-09T02:35:09.607 INFO:tasks.workunit.client.1.smithi161.stdout:4/304: truncate dd/d1a/f64 450330 0 2023-12-09T02:35:09.609 INFO:tasks.workunit.client.1.smithi161.stdout:7/337: read d0/fc [3126420,91759] 0 2023-12-09T02:35:09.610 INFO:tasks.workunit.client.1.smithi161.stdout:9/212: dwrite d2/f35 [0,4194304] 0 2023-12-09T02:35:09.610 INFO:tasks.workunit.client.1.smithi161.stdout:9/213: readlink d2/d25/l28 0 2023-12-09T02:35:09.614 INFO:tasks.workunit.client.1.smithi161.stdout:4/305: rename dd/d1a/d1d/d25/f3d to dd/d1a/f66 0 2023-12-09T02:35:09.614 INFO:tasks.workunit.client.1.smithi161.stdout:9/214: dread d2/da/d16/d2e/f40 [0,4194304] 0 2023-12-09T02:35:09.617 INFO:tasks.workunit.client.1.smithi161.stdout:4/306: symlink dd/d1a/d1d/d25/d32/d58/l67 0 2023-12-09T02:35:09.618 INFO:tasks.workunit.client.1.smithi161.stdout:7/338: dread d0/d3/d13/f1f [0,4194304] 0 2023-12-09T02:35:09.619 INFO:tasks.workunit.client.1.smithi161.stdout:9/215: mkdir d2/d25/d31/d42 0 2023-12-09T02:35:09.621 INFO:tasks.workunit.client.1.smithi161.stdout:9/216: dread d2/da/d16/f30 [0,4194304] 0 2023-12-09T02:35:09.621 INFO:tasks.workunit.client.1.smithi161.stdout:9/217: fsync d2/da/f21 0 2023-12-09T02:35:09.624 INFO:tasks.workunit.client.1.smithi161.stdout:9/218: creat d2/d25/d31/f43 x:0 0 0 2023-12-09T02:35:09.626 INFO:tasks.workunit.client.1.smithi161.stdout:5/231: dwrite d0/f1a [0,4194304] 0 2023-12-09T02:35:09.626 INFO:tasks.workunit.client.1.smithi161.stdout:5/232: readlink d0/d2/l6 0 2023-12-09T02:35:09.628 INFO:tasks.workunit.client.1.smithi161.stdout:9/219: symlink d2/d25/l44 0 2023-12-09T02:35:09.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.628+0000 7fe853ca2700 1 -- 172.21.15.88:0/3109158682 --> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe84c10e4d0 con 0x7fe83806acc0 2023-12-09T02:35:09.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.630+0000 7fe8427fc700 1 -- 172.21.15.88:0/3109158682 <== mgr.14208 v2:172.21.15.88:6800/563213166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fe84c10e4d0 con 0x7fe83806acc0 2023-12-09T02:35:09.632 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:35:09.632 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:35:09.632 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:35:09.632 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:35:09.632 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2023-12-09T02:35:09.633 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "1/21 daemons upgraded", 2023-12-09T02:35:09.633 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mgr daemons", 2023-12-09T02:35:09.633 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:35:09.633 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:35:09.633 INFO:tasks.workunit.client.1.smithi161.stdout:5/233: mkdir d0/d2/d7/d51 0 2023-12-09T02:35:09.633 INFO:tasks.workunit.client.1.smithi161.stdout:5/234: readlink d0/l24 0 2023-12-09T02:35:09.633 INFO:tasks.workunit.client.1.smithi161.stdout:9/220: stat d2/c3b 0 2023-12-09T02:35:09.634 INFO:tasks.workunit.client.1.smithi161.stdout:7/339: dwrite d0/d3/d13/f22 [0,4194304] 0 2023-12-09T02:35:09.634 INFO:tasks.workunit.client.1.smithi161.stdout:7/340: fsync d0/d3/f17 0 2023-12-09T02:35:09.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.632+0000 7fe853ca2700 1 -- 172.21.15.88:0/3109158682 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe83806acc0 msgr2=0x7fe83806d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:09.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.632+0000 7fe853ca2700 1 --2- 172.21.15.88:0/3109158682 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe83806acc0 0x7fe83806d170 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe83c004d00 tx=0x7fe83c009ce0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.632+0000 7fe853ca2700 1 -- 172.21.15.88:0/3109158682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe84c0fbaf0 msgr2=0x7fe84c10c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:09.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.632+0000 7fe853ca2700 1 --2- 172.21.15.88:0/3109158682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe84c0fbaf0 0x7fe84c10c480 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe84800b3b0 tx=0x7fe848009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:09.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.632+0000 7fe853ca2700 1 -- 172.21.15.88:0/3109158682 shutdown_connections 2023-12-09T02:35:09.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.632+0000 7fe853ca2700 1 --2- 172.21.15.88:0/3109158682 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fe83806acc0 0x7fe83806d170 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.632+0000 7fe853ca2700 1 --2- 172.21.15.88:0/3109158682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe84c0fbaf0 0x7fe84c10c480 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.632+0000 7fe853ca2700 1 --2- 172.21.15.88:0/3109158682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c0fcd00 0x7fe84c10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.632+0000 7fe853ca2700 1 -- 172.21.15.88:0/3109158682 >> 172.21.15.88:0/3109158682 conn(0x7fe84c0f7190 msgr2=0x7fe84c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:09.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.632+0000 7fe853ca2700 1 -- 172.21.15.88:0/3109158682 shutdown_connections 2023-12-09T02:35:09.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.632+0000 7fe853ca2700 1 -- 172.21.15.88:0/3109158682 wait complete. 2023-12-09T02:35:09.637 INFO:tasks.workunit.client.1.smithi161.stdout:9/221: link d2/da/f10 d2/da/d16/d2e/f45 0 2023-12-09T02:35:09.639 INFO:tasks.workunit.client.1.smithi161.stdout:7/341: creat d0/d3/d13/d2d/d43/d4b/d5a/f6b x:0 0 0 2023-12-09T02:35:09.652 INFO:tasks.workunit.client.1.smithi161.stdout:7/342: dwrite d0/d3/d13/f58 [0,4194304] 0 2023-12-09T02:35:09.652 INFO:tasks.workunit.client.1.smithi161.stdout:4/307: fsync dd/d1a/d23/f63 0 2023-12-09T02:35:09.654 INFO:tasks.workunit.client.1.smithi161.stdout:4/308: creat dd/d36/d3f/d54/f68 x:0 0 0 2023-12-09T02:35:09.655 INFO:tasks.workunit.client.1.smithi161.stdout:4/309: dread - dd/f59 zero size 2023-12-09T02:35:09.655 INFO:tasks.workunit.client.1.smithi161.stdout:4/310: read dd/d1a/d1d/f49 [2508106,19989] 0 2023-12-09T02:35:09.655 INFO:tasks.workunit.client.1.smithi161.stdout:7/343: mkdir d0/d3/d6c 0 2023-12-09T02:35:09.668 INFO:tasks.workunit.client.1.smithi161.stdout:4/311: dread dd/f15 [0,4194304] 0 2023-12-09T02:35:09.668 INFO:tasks.workunit.client.1.smithi161.stdout:4/312: chown dd/d1a/d1d/d25 477 1 2023-12-09T02:35:09.668 INFO:tasks.workunit.client.1.smithi161.stdout:4/313: dread - dd/d1a/d1d/d25/d32/d34/f60 zero size 2023-12-09T02:35:09.668 INFO:tasks.workunit.client.1.smithi161.stdout:4/314: readlink dd/d1a/d1d/l53 0 2023-12-09T02:35:09.681 INFO:tasks.workunit.client.1.smithi161.stdout:4/315: dread dd/d1a/d1d/d25/f30 [0,4194304] 0 2023-12-09T02:35:09.681 INFO:tasks.workunit.client.1.smithi161.stdout:5/235: truncate d0/d2/d7/f39 498997 0 2023-12-09T02:35:09.682 INFO:tasks.workunit.client.1.smithi161.stdout:5/236: dread - d0/f3d zero size 2023-12-09T02:35:09.682 INFO:tasks.workunit.client.1.smithi161.stdout:5/237: readlink d0/l40 0 2023-12-09T02:35:09.682 INFO:tasks.workunit.client.1.smithi161.stdout:5/238: chown d0/d2/de/d21 0 1 2023-12-09T02:35:09.684 INFO:tasks.workunit.client.1.smithi161.stdout:5/239: symlink d0/d2/d7/d51/l52 0 2023-12-09T02:35:09.687 INFO:tasks.workunit.client.1.smithi161.stdout:7/344: dwrite d0/d3/f8 [0,4194304] 0 2023-12-09T02:35:09.693 INFO:tasks.workunit.client.1.smithi161.stdout:5/240: rename d0/d2/de/d44/c4a to d0/d2/de/c53 0 2023-12-09T02:35:09.694 INFO:tasks.workunit.client.1.smithi161.stdout:0/245: sync 2023-12-09T02:35:09.704 INFO:tasks.workunit.client.1.smithi161.stdout:7/345: creat d0/d29/d59/f6d x:0 0 0 2023-12-09T02:35:09.706 INFO:tasks.workunit.client.1.smithi161.stdout:0/246: truncate d9/f11 422115 0 2023-12-09T02:35:09.709 INFO:tasks.workunit.client.1.smithi161.stdout:7/346: mkdir d0/d3/d13/d2d/d6e 0 2023-12-09T02:35:09.709 INFO:tasks.workunit.client.1.smithi161.stdout:7/347: readlink d0/d3/d13/d1b/l44 0 2023-12-09T02:35:09.712 INFO:tasks.workunit.client.1.smithi161.stdout:5/241: dwrite d0/f3d [0,4194304] 0 2023-12-09T02:35:09.720 INFO:tasks.workunit.client.1.smithi161.stdout:4/316: truncate dd/f15 176181 0 2023-12-09T02:35:09.720 INFO:tasks.workunit.client.1.smithi161.stdout:4/317: write dd/d1a/d1d/d25/d32/d34/f60 [2336,84443] 0 2023-12-09T02:35:09.724 INFO:tasks.workunit.client.1.smithi161.stdout:4/318: symlink dd/l69 0 2023-12-09T02:35:09.729 INFO:tasks.workunit.client.1.smithi161.stdout:4/319: mkdir dd/d1a/d23/d6a 0 2023-12-09T02:35:09.729 INFO:tasks.workunit.client.1.smithi161.stdout:4/320: stat dd/d1a/d1d/d25/d3a/l50 0 2023-12-09T02:35:09.731 INFO:tasks.workunit.client.1.smithi161.stdout:0/247: write d9/f11 [543169,115632] 0 2023-12-09T02:35:09.731 INFO:tasks.workunit.client.1.smithi161.stdout:0/248: chown d9/d1f/c19 65392410 1 2023-12-09T02:35:09.734 INFO:tasks.workunit.client.1.smithi161.stdout:7/348: dread d0/d3/d13/d2d/d43/d4a/f41 [0,4194304] 0 2023-12-09T02:35:09.737 INFO:tasks.workunit.client.1.smithi161.stdout:0/249: symlink d9/dd/l46 0 2023-12-09T02:35:09.737 INFO:tasks.workunit.client.1.smithi161.stdout:0/250: chown d9/f20 938896220 1 2023-12-09T02:35:09.737 INFO:tasks.workunit.client.1.smithi161.stdout:0/251: chown f7 128545 1 2023-12-09T02:35:09.739 INFO:tasks.workunit.client.1.smithi161.stdout:0/252: mknod d9/db/d2a/d35/c47 0 2023-12-09T02:35:09.739 INFO:tasks.workunit.client.1.smithi161.stdout:0/253: write d9/db/d2a/d35/f43 [967280,96516] 0 2023-12-09T02:35:09.748 INFO:tasks.workunit.client.1.smithi161.stdout:7/349: dread d0/d3/f66 [0,4194304] 0 2023-12-09T02:35:09.750 INFO:tasks.workunit.client.1.smithi161.stdout:7/350: getdents d0/d3/d13/d2d/d43/d4b 0 2023-12-09T02:35:09.751 INFO:tasks.workunit.client.1.smithi161.stdout:5/242: dwrite d0/d2/de/d44/f49 [0,4194304] 0 2023-12-09T02:35:09.752 INFO:tasks.workunit.client.1.smithi161.stdout:7/351: read d0/d3/d13/f18 [2759699,31861] 0 2023-12-09T02:35:09.764 INFO:tasks.workunit.client.1.smithi161.stdout:7/352: mkdir d0/d3/d13/d2d/d43/d4b/d5a/d6f 0 2023-12-09T02:35:09.764 INFO:tasks.workunit.client.1.smithi161.stdout:4/321: dwrite dd/d1a/d29/f37 [0,4194304] 0 2023-12-09T02:35:09.764 INFO:tasks.workunit.client.1.smithi161.stdout:5/243: dread d0/f1a [0,4194304] 0 2023-12-09T02:35:09.767 INFO:tasks.workunit.client.1.smithi161.stdout:0/254: truncate d9/f11 276961 0 2023-12-09T02:35:09.767 INFO:tasks.workunit.client.1.smithi161.stdout:0/255: write d9/db/f3e [1616657,114557] 0 2023-12-09T02:35:09.767 INFO:tasks.workunit.client.1.smithi161.stdout:0/256: chown d9/dd/l45 332107414 1 2023-12-09T02:35:09.774 INFO:tasks.workunit.client.1.smithi161.stdout:7/353: dread d0/d3/d13/f1f [0,4194304] 0 2023-12-09T02:35:09.774 INFO:tasks.workunit.client.1.smithi161.stdout:7/354: dread d0/d3/d13/d1b/f3f [0,4194304] 0 2023-12-09T02:35:09.777 INFO:tasks.workunit.client.1.smithi161.stdout:4/322: symlink dd/d1a/d1d/d25/l6b 0 2023-12-09T02:35:09.777 INFO:tasks.workunit.client.1.smithi161.stdout:4/323: fsync dd/d1a/d1d/d25/f3b 0 2023-12-09T02:35:09.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.776+0000 7fcce69e3700 1 -- 172.21.15.88:0/3779727908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcce00fde00 msgr2=0x7fcce00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:09.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.776+0000 7fcce69e3700 1 --2- 172.21.15.88:0/3779727908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcce00fde00 0x7fcce00fe250 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fccd4004940 tx=0x7fccd4009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:09.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.777+0000 7fcce69e3700 1 -- 172.21.15.88:0/3779727908 shutdown_connections 2023-12-09T02:35:09.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.777+0000 7fcce69e3700 1 --2- 172.21.15.88:0/3779727908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcce00fde00 0x7fcce00fe250 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.777+0000 7fcce69e3700 1 --2- 172.21.15.88:0/3779727908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcce00fcbf0 0x7fcce00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.777+0000 7fcce69e3700 1 -- 172.21.15.88:0/3779727908 >> 172.21.15.88:0/3779727908 conn(0x7fcce00f82d0 msgr2=0x7fcce00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:09.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.777+0000 7fcce69e3700 1 -- 172.21.15.88:0/3779727908 shutdown_connections 2023-12-09T02:35:09.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.777+0000 7fcce69e3700 1 -- 172.21.15.88:0/3779727908 wait complete. 2023-12-09T02:35:09.780 INFO:tasks.workunit.client.1.smithi161.stdout:7/355: mkdir d0/d3/d13/d4e/d70 0 2023-12-09T02:35:09.781 INFO:tasks.workunit.client.1.smithi161.stdout:7/356: write d0/d3/d21/d54/f64 [318296,119686] 0 2023-12-09T02:35:09.781 INFO:tasks.workunit.client.1.smithi161.stdout:7/357: write d0/d3/d13/d2f/f5d [614474,48919] 0 2023-12-09T02:35:09.782 INFO:tasks.workunit.client.1.smithi161.stdout:7/358: rmdir d0/d3/d13/d2d/d43 39 2023-12-09T02:35:09.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.778+0000 7fcce69e3700 1 Processor -- start 2023-12-09T02:35:09.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.778+0000 7fcce69e3700 1 -- start start 2023-12-09T02:35:09.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.778+0000 7fcce69e3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcce00fcbf0 0x7fcce010f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:09.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.778+0000 7fcce69e3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcce00fde00 0x7fcce010fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:09.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.778+0000 7fcce69e3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0110350 con 0x7fcce00fde00 2023-12-09T02:35:09.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.778+0000 7fcce69e3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0110b90 con 0x7fcce00fcbf0 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.778+0000 7fccdf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcce00fde00 0x7fcce010fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.779+0000 7fccdf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcce00fde00 0x7fcce010fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55176/0 (socket says 172.21.15.88:55176) 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.779+0000 7fccdf7fe700 1 -- 172.21.15.88:0/2556712233 learned_addr learned my addr 172.21.15.88:0/2556712233 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.779+0000 7fccdffff700 1 --2- 172.21.15.88:0/2556712233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcce00fcbf0 0x7fcce010f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.779+0000 7fccdf7fe700 1 -- 172.21.15.88:0/2556712233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcce00fcbf0 msgr2=0x7fcce010f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.779+0000 7fccdf7fe700 1 --2- 172.21.15.88:0/2556712233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcce00fcbf0 0x7fcce010f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.779+0000 7fccdf7fe700 1 -- 172.21.15.88:0/2556712233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4005040 con 0x7fcce00fde00 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.779+0000 7fccdf7fe700 1 --2- 172.21.15.88:0/2556712233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcce00fde00 0x7fcce010fcc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009fd0 tx=0x7fccd4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.780+0000 7fccdcff9700 1 -- 172.21.15.88:0/2556712233 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccd400e040 con 0x7fcce00fde00 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.780+0000 7fccdcff9700 1 -- 172.21.15.88:0/2556712233 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fccd4004290 con 0x7fcce00fde00 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.780+0000 7fcce69e3700 1 -- 172.21.15.88:0/2556712233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce0110e10 con 0x7fcce00fde00 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.780+0000 7fccdcff9700 1 -- 172.21.15.88:0/2556712233 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccd401c3f0 con 0x7fcce00fde00 2023-12-09T02:35:09.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.780+0000 7fcce69e3700 1 -- 172.21.15.88:0/2556712233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce0111350 con 0x7fcce00fde00 2023-12-09T02:35:09.785 INFO:tasks.workunit.client.1.smithi161.stdout:0/257: write d9/f11 [741452,9289] 0 2023-12-09T02:35:09.785 INFO:tasks.workunit.client.1.smithi161.stdout:0/258: readlink d9/l23 0 2023-12-09T02:35:09.786 INFO:tasks.workunit.client.1.smithi161.stdout:0/259: mknod d9/dd/c48 0 2023-12-09T02:35:09.786 INFO:tasks.workunit.client.1.smithi161.stdout:0/260: fdatasync d9/d25/f2d 0 2023-12-09T02:35:09.786 INFO:tasks.workunit.client.1.smithi161.stdout:0/261: getdents d9/dd/d21/d26/d28 0 2023-12-09T02:35:09.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.781+0000 7fcce69e3700 1 -- 172.21.15.88:0/2556712233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce0101ea0 con 0x7fcce00fde00 2023-12-09T02:35:09.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.783+0000 7fccdcff9700 1 -- 172.21.15.88:0/2556712233 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 88622+0+0 (secure 0 0 0) 0x7fccd400bc50 con 0x7fcce00fde00 2023-12-09T02:35:09.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.784+0000 7fccdcff9700 1 --2- 172.21.15.88:0/2556712233 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fccc806ae00 0x7fccc806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:09.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.784+0000 7fccdcff9700 1 -- 172.21.15.88:0/2556712233 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fccd408a840 con 0x7fcce00fde00 2023-12-09T02:35:09.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.787+0000 7fccdffff700 1 --2- 172.21.15.88:0/2556712233 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fccc806ae00 0x7fccc806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:09.790 INFO:tasks.workunit.client.1.smithi161.stdout:0/262: creat d9/d1f/f49 x:0 0 0 2023-12-09T02:35:09.790 INFO:tasks.workunit.client.1.smithi161.stdout:0/263: stat d9/dd/l46 0 2023-12-09T02:35:09.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.788+0000 7fccdffff700 1 --2- 172.21.15.88:0/2556712233 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fccc806ae00 0x7fccc806d2b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcce00fdc60 tx=0x7fccd00091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:09.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:09.790+0000 7fccdcff9700 1 -- 172.21.15.88:0/2556712233 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fccd405a730 con 0x7fcce00fde00 2023-12-09T02:35:09.795 INFO:tasks.workunit.client.1.smithi161.stdout:0/264: write d9/f11 [272760,22242] 0 2023-12-09T02:35:09.802 INFO:tasks.workunit.client.1.smithi161.stdout:5/244: dwrite d0/f1 [0,4194304] 0 2023-12-09T02:35:09.805 INFO:tasks.workunit.client.1.smithi161.stdout:5/245: creat d0/d2/de/d22/f54 x:0 0 0 2023-12-09T02:35:09.805 INFO:tasks.workunit.client.1.smithi161.stdout:5/246: fsync d0/d2/f16 0 2023-12-09T02:35:09.805 INFO:tasks.workunit.client.1.smithi161.stdout:5/247: truncate d0/d2/f4d 692893 0 2023-12-09T02:35:09.805 INFO:tasks.workunit.client.1.smithi161.stdout:4/324: dwrite dd/d36/d3f/d54/f68 [0,4194304] 0 2023-12-09T02:35:09.807 INFO:tasks.workunit.client.1.smithi161.stdout:5/248: mkdir d0/d2/de/d22/d55 0 2023-12-09T02:35:09.810 INFO:tasks.workunit.client.1.smithi161.stdout:4/325: symlink dd/d1a/d29/l6c 0 2023-12-09T02:35:09.811 INFO:tasks.workunit.client.1.smithi161.stdout:5/249: mknod d0/d1f/c56 0 2023-12-09T02:35:09.812 INFO:tasks.workunit.client.1.smithi161.stdout:4/326: dread dd/d36/d3f/f43 [0,4194304] 0 2023-12-09T02:35:09.813 INFO:tasks.workunit.client.1.smithi161.stdout:5/250: creat d0/d2/f57 x:0 0 0 2023-12-09T02:35:09.816 INFO:tasks.workunit.client.1.smithi161.stdout:4/327: symlink dd/d36/d4a/d5f/l6d 0 2023-12-09T02:35:09.822 INFO:tasks.workunit.client.1.smithi161.stdout:0/265: dwrite d9/dd/d21/d26/f42 [0,4194304] 0 2023-12-09T02:35:09.822 INFO:tasks.workunit.client.1.smithi161.stdout:0/266: write d9/d1f/f49 [483466,20104] 0 2023-12-09T02:35:09.822 INFO:tasks.workunit.client.1.smithi161.stdout:5/251: dread d0/d2/de/d22/f32 [0,4194304] 0 2023-12-09T02:35:09.825 INFO:tasks.workunit.client.1.smithi161.stdout:0/267: mkdir d9/db/d2a/d35/d4a 0 2023-12-09T02:35:09.825 INFO:tasks.workunit.client.1.smithi161.stdout:0/268: fsync d9/db/d2a/d35/f43 0 2023-12-09T02:35:09.827 INFO:tasks.workunit.client.1.smithi161.stdout:0/269: creat d9/f4b x:0 0 0 2023-12-09T02:35:09.836 INFO:tasks.workunit.client.1.smithi161.stdout:4/328: dwrite dd/f59 [0,4194304] 0 2023-12-09T02:35:09.836 INFO:tasks.workunit.client.1.smithi161.stdout:4/329: write dd/fe [3595133,87900] 0 2023-12-09T02:35:09.838 INFO:tasks.workunit.client.1.smithi161.stdout:5/252: dread d0/f3d [0,4194304] 0 2023-12-09T02:35:09.838 INFO:tasks.workunit.client.1.smithi161.stdout:4/330: dread dd/d36/d3f/f43 [0,4194304] 0 2023-12-09T02:35:09.839 INFO:tasks.workunit.client.1.smithi161.stdout:4/331: truncate dd/d36/d3f/f43 1681321 0 2023-12-09T02:35:09.844 INFO:tasks.workunit.client.1.smithi161.stdout:5/253: link d0/d2/de/d22/l2a d0/d2/de/d44/l58 0 2023-12-09T02:35:09.844 INFO:tasks.workunit.client.1.smithi161.stdout:5/254: truncate d0/d2/d7/d11/f37 865283 0 2023-12-09T02:35:09.845 INFO:tasks.workunit.client.1.smithi161.stdout:4/332: truncate dd/d1a/d1e/f21 156607 0 2023-12-09T02:35:09.848 INFO:tasks.workunit.client.1.smithi161.stdout:4/333: truncate dd/d1a/d1d/f49 2066808 0 2023-12-09T02:35:09.848 INFO:tasks.workunit.client.1.smithi161.stdout:4/334: write dd/d36/d4a/f51 [646081,75910] 0 2023-12-09T02:35:09.849 INFO:tasks.workunit.client.1.smithi161.stdout:5/255: write d0/d2/de/d21/f2c [992323,98669] 0 2023-12-09T02:35:09.849 INFO:tasks.workunit.client.1.smithi161.stdout:0/270: dwrite d9/d1f/f49 [0,4194304] 0 2023-12-09T02:35:09.850 INFO:tasks.workunit.client.1.smithi161.stdout:5/256: truncate d0/d2/f57 958455 0 2023-12-09T02:35:09.850 INFO:tasks.workunit.client.1.smithi161.stdout:5/257: readlink d0/d2/de/d21/l26 0 2023-12-09T02:35:09.850 INFO:tasks.workunit.client.1.smithi161.stdout:4/335: fsync dd/fe 0 2023-12-09T02:35:09.862 INFO:tasks.workunit.client.1.smithi161.stdout:0/271: truncate d9/db/f3e 800772 0 2023-12-09T02:35:09.868 INFO:tasks.workunit.client.1.smithi161.stdout:5/258: rename d0/d2/f16 to d0/d2/de/d22/f59 0 2023-12-09T02:35:09.872 INFO:tasks.workunit.client.1.smithi161.stdout:6/180: sync 2023-12-09T02:35:09.872 INFO:tasks.workunit.client.1.smithi161.stdout:1/410: sync 2023-12-09T02:35:09.872 INFO:tasks.workunit.client.1.smithi161.stdout:6/181: chown da/fd 101776538 1 2023-12-09T02:35:09.872 INFO:tasks.workunit.client.1.smithi161.stdout:1/411: chown d6/d8/d63/d4d/d31/l77 154 1 2023-12-09T02:35:09.874 INFO:tasks.workunit.client.1.smithi161.stdout:0/272: symlink d9/dd/d3a/l4c 0 2023-12-09T02:35:09.875 INFO:tasks.workunit.client.1.smithi161.stdout:0/273: write d9/d25/f33 [4593046,128255] 0 2023-12-09T02:35:09.878 INFO:tasks.workunit.client.1.smithi161.stdout:4/336: rename dd/f15 to dd/d1a/d1d/d25/d3a/f6e 0 2023-12-09T02:35:09.882 INFO:tasks.workunit.client.1.smithi161.stdout:5/259: truncate d0/d2/d7/d11/f35 318879 0 2023-12-09T02:35:09.884 INFO:tasks.workunit.client.1.smithi161.stdout:6/182: creat da/d28/d29/d2b/d31/d33/d39/f40 x:0 0 0 2023-12-09T02:35:09.891 INFO:tasks.workunit.client.1.smithi161.stdout:0/274: creat d9/dd/d21/d26/f4d x:0 0 0 2023-12-09T02:35:09.891 INFO:tasks.workunit.client.1.smithi161.stdout:1/412: dwrite d6/d8/d63/f65 [0,4194304] 0 2023-12-09T02:35:09.893 INFO:tasks.workunit.client.1.smithi161.stdout:5/260: rename d0/l24 to d0/d2/de/d22/d55/l5a 0 2023-12-09T02:35:09.894 INFO:tasks.workunit.client.1.smithi161.stdout:0/275: write d9/d25/f33 [1088089,38656] 0 2023-12-09T02:35:09.896 INFO:tasks.workunit.client.1.smithi161.stdout:1/413: unlink d6/d9/l50 0 2023-12-09T02:35:09.896 INFO:tasks.workunit.client.1.smithi161.stdout:1/414: truncate d6/d8/d63/d35/f7b 729504 0 2023-12-09T02:35:09.896 INFO:tasks.workunit.client.1.smithi161.stdout:0/276: write d9/d25/f22 [2870672,64087] 0 2023-12-09T02:35:09.897 INFO:tasks.workunit.client.1.smithi161.stdout:5/261: creat d0/d2/de/f5b x:0 0 0 2023-12-09T02:35:09.899 INFO:tasks.workunit.client.1.smithi161.stdout:1/415: symlink d6/d8/d63/d61/l84 0 2023-12-09T02:35:09.901 INFO:tasks.workunit.client.1.smithi161.stdout:0/277: rename d9/dd/f30 to d9/d25/f4e 0 2023-12-09T02:35:09.902 INFO:tasks.workunit.client.1.smithi161.stdout:1/416: unlink d6/d49/l57 0 2023-12-09T02:35:09.906 INFO:tasks.workunit.client.1.smithi161.stdout:1/417: unlink d6/d8/d63/d4d/d31/d73/dd/f21 0 2023-12-09T02:35:09.906 INFO:tasks.workunit.client.1.smithi161.stdout:4/337: dwrite dd/d1a/d1d/d25/d32/f41 [0,4194304] 0 2023-12-09T02:35:09.906 INFO:tasks.workunit.client.1.smithi161.stdout:4/338: fdatasync dd/d1a/d29/f37 0 2023-12-09T02:35:09.906 INFO:tasks.workunit.client.1.smithi161.stdout:4/339: stat dd/c57 0 2023-12-09T02:35:09.909 INFO:tasks.workunit.client.1.smithi161.stdout:0/278: fsync d9/dd/d21/d26/f4d 0 2023-12-09T02:35:09.918 INFO:tasks.workunit.client.1.smithi161.stdout:6/183: dwrite da/d19/f1e [0,4194304] 0 2023-12-09T02:35:09.920 INFO:tasks.workunit.client.1.smithi161.stdout:5/262: dwrite d0/d2/d7/d11/f4c [4194304,4194304] 0 2023-12-09T02:35:09.920 INFO:tasks.workunit.client.1.smithi161.stdout:5/263: dread - d0/d2/d7/df/f31 zero size 2023-12-09T02:35:09.921 INFO:tasks.workunit.client.1.smithi161.stdout:6/184: dread da/d19/d20/f25 [0,4194304] 0 2023-12-09T02:35:09.924 INFO:tasks.workunit.client.1.smithi161.stdout:1/418: dwrite d6/d8/d63/d4d/d31/f3a [4194304,4194304] 0 2023-12-09T02:35:09.925 INFO:tasks.workunit.client.1.smithi161.stdout:4/340: rename dd/d1a/d1d/d25/f30 to dd/d36/d4a/f6f 0 2023-12-09T02:35:09.925 INFO:tasks.workunit.client.1.smithi161.stdout:4/341: chown dd/d36/d4a 14097 1 2023-12-09T02:35:09.925 INFO:tasks.workunit.client.1.smithi161.stdout:4/342: write f8 [2875292,51066] 0 2023-12-09T02:35:09.932 INFO:tasks.workunit.client.1.smithi161.stdout:0/279: mknod d9/db/d2a/c4f 0 2023-12-09T02:35:09.936 INFO:tasks.workunit.client.1.smithi161.stdout:5/264: unlink d0/d2/c4 0 2023-12-09T02:35:09.936 INFO:tasks.workunit.client.1.smithi161.stdout:6/185: getdents da/d28/d29 0 2023-12-09T02:35:09.938 INFO:tasks.workunit.client.1.smithi161.stdout:1/419: unlink d6/d8/d63/d4d/d31/d73/l2d 0 2023-12-09T02:35:09.942 INFO:tasks.workunit.client.1.smithi161.stdout:0/280: getdents d9/d1f 0 2023-12-09T02:35:09.943 INFO:tasks.workunit.client.1.smithi161.stdout:4/343: dwrite dd/d1a/d1d/d25/f52 [0,4194304] 0 2023-12-09T02:35:09.945 INFO:tasks.workunit.client.1.smithi161.stdout:5/265: link d0/d9/c12 d0/d2/de/d44/c5c 0 2023-12-09T02:35:09.947 INFO:tasks.workunit.client.1.smithi161.stdout:6/186: mknod da/d28/d3c/c41 0 2023-12-09T02:35:09.948 INFO:tasks.workunit.client.1.smithi161.stdout:1/420: truncate d6/d8/d63/d4d/d31/d80/f83 904826 0 2023-12-09T02:35:09.948 INFO:tasks.workunit.client.1.smithi161.stdout:1/421: chown d6/d8/d63/d4d 2279 1 2023-12-09T02:35:09.953 INFO:tasks.workunit.client.1.smithi161.stdout:4/344: read dd/d1a/f66 [432007,34671] 0 2023-12-09T02:35:09.953 INFO:tasks.workunit.client.1.smithi161.stdout:0/281: dread d9/f11 [0,4194304] 0 2023-12-09T02:35:09.955 INFO:tasks.workunit.client.1.smithi161.stdout:0/282: dread d9/f20 [0,4194304] 0 2023-12-09T02:35:09.956 INFO:tasks.workunit.client.1.smithi161.stdout:4/345: dread dd/fe [0,4194304] 0 2023-12-09T02:35:09.960 INFO:tasks.workunit.client.1.smithi161.stdout:4/346: dread dd/d1a/d1d/d25/f2f [0,4194304] 0 2023-12-09T02:35:09.960 INFO:tasks.workunit.client.1.smithi161.stdout:4/347: chown dd/d1a/d1d/d25/d4e 37023 1 2023-12-09T02:35:09.966 INFO:tasks.workunit.client.1.smithi161.stdout:5/266: creat d0/d2/d7/d11/f5d x:0 0 0 2023-12-09T02:35:09.967 INFO:tasks.workunit.client.1.smithi161.stdout:5/267: write d0/d2/d7/d11/f41 [704887,101949] 0 2023-12-09T02:35:09.967 INFO:tasks.workunit.client.1.smithi161.stdout:1/422: mknod d6/d8/c85 0 2023-12-09T02:35:09.968 INFO:tasks.workunit.client.1.smithi161.stdout:0/283: getdents d9/dd/d21 0 2023-12-09T02:35:09.968 INFO:tasks.workunit.client.1.smithi161.stdout:0/284: write d9/d25/f38 [644353,1872] 0 2023-12-09T02:35:09.970 INFO:tasks.workunit.client.1.smithi161.stdout:6/187: dwrite da/f1a [0,4194304] 0 2023-12-09T02:35:09.971 INFO:tasks.workunit.client.1.smithi161.stdout:4/348: symlink dd/d36/l70 0 2023-12-09T02:35:09.972 INFO:tasks.workunit.client.1.smithi161.stdout:6/188: write da/d19/f1e [1048750,91278] 0 2023-12-09T02:35:09.972 INFO:tasks.workunit.client.1.smithi161.stdout:6/189: fdatasync da/d19/f1b 0 2023-12-09T02:35:09.974 INFO:tasks.workunit.client.1.smithi161.stdout:5/268: creat d0/d2/de/f5e x:0 0 0 2023-12-09T02:35:09.974 INFO:tasks.workunit.client.1.smithi161.stdout:5/269: chown d0/d2/de/d21/f28 644 1 2023-12-09T02:35:09.974 INFO:tasks.workunit.client.1.smithi161.stdout:5/270: dread - d0/d2/de/f5e zero size 2023-12-09T02:35:09.980 INFO:tasks.workunit.client.1.smithi161.stdout:1/423: dread d6/d8/d63/d4d/d31/d73/dd/fe [0,4194304] 0 2023-12-09T02:35:09.981 INFO:tasks.workunit.client.1.smithi161.stdout:1/424: fsync d6/d8/d63/d4d/d31/f76 0 2023-12-09T02:35:09.982 INFO:tasks.workunit.client.1.smithi161.stdout:0/285: rmdir d9/d25 39 2023-12-09T02:35:09.985 INFO:tasks.workunit.client.1.smithi161.stdout:4/349: rmdir dd/d1a/d1d/d25/d32/d58 39 2023-12-09T02:35:09.986 INFO:tasks.workunit.client.1.smithi161.stdout:0/286: dread d9/d25/f38 [0,4194304] 0 2023-12-09T02:35:09.987 INFO:tasks.workunit.client.1.smithi161.stdout:6/190: creat da/df/d2d/d3b/f42 x:0 0 0 2023-12-09T02:35:09.989 INFO:tasks.workunit.client.1.smithi161.stdout:5/271: unlink d0/d2/de/f3f 0 2023-12-09T02:35:09.991 INFO:tasks.workunit.client.1.smithi161.stdout:1/425: mknod d6/d8/d63/d4d/d31/d73/c86 0 2023-12-09T02:35:09.992 INFO:tasks.workunit.client.1.smithi161.stdout:1/426: dread d6/d8/d63/d4d/d31/d80/f83 [0,4194304] 0 2023-12-09T02:35:09.994 INFO:tasks.workunit.client.1.smithi161.stdout:4/350: unlink la 0 2023-12-09T02:35:09.996 INFO:tasks.workunit.client.1.smithi161.stdout:0/287: link d9/c16 d9/dd/d21/d26/d28/c50 0 2023-12-09T02:35:09.997 INFO:tasks.workunit.client.1.smithi161.stdout:0/288: chown d9/db/d2a/d35/c47 5097 1 2023-12-09T02:35:10.000 INFO:tasks.workunit.client.1.smithi161.stdout:5/272: mkdir d0/d2/d5f 0 2023-12-09T02:35:10.007 INFO:tasks.workunit.client.1.smithi161.stdout:4/351: truncate dd/d1a/f1c 994124 0 2023-12-09T02:35:10.007 INFO:tasks.workunit.client.1.smithi161.stdout:1/427: dread d6/d8/d63/d4d/d31/d73/dd/f48 [0,4194304] 0 2023-12-09T02:35:10.007 INFO:tasks.workunit.client.1.smithi161.stdout:6/191: dwrite da/f1a [0,4194304] 0 2023-12-09T02:35:10.010 INFO:tasks.workunit.client.1.smithi161.stdout:2/221: sync 2023-12-09T02:35:10.011 INFO:tasks.workunit.client.1.smithi161.stdout:0/289: creat d9/dd/d21/f51 x:0 0 0 2023-12-09T02:35:10.011 INFO:tasks.workunit.client.1.smithi161.stdout:6/192: mknod da/df/d2d/d3b/c43 0 2023-12-09T02:35:10.011 INFO:tasks.workunit.client.1.smithi161.stdout:0/290: chown d9/d1f/f49 210 1 2023-12-09T02:35:10.012 INFO:tasks.workunit.client.1.smithi161.stdout:0/291: stat d9/dd/c48 0 2023-12-09T02:35:10.014 INFO:tasks.workunit.client.1.smithi161.stdout:0/292: dread d9/f20 [0,4194304] 0 2023-12-09T02:35:10.015 INFO:tasks.workunit.client.1.smithi161.stdout:2/222: creat d4/d7/f48 x:0 0 0 2023-12-09T02:35:10.015 INFO:tasks.workunit.client.1.smithi161.stdout:2/223: fsync d4/f17 0 2023-12-09T02:35:10.016 INFO:tasks.workunit.client.1.smithi161.stdout:6/193: write da/f26 [6715308,56953] 0 2023-12-09T02:35:10.021 INFO:tasks.workunit.client.1.smithi161.stdout:0/293: unlink c2 0 2023-12-09T02:35:10.022 INFO:tasks.workunit.client.1.smithi161.stdout:2/224: creat d4/d16/f49 x:0 0 0 2023-12-09T02:35:10.027 INFO:tasks.workunit.client.1.smithi161.stdout:8/199: sync 2023-12-09T02:35:10.027 INFO:tasks.workunit.client.1.smithi161.stdout:3/257: sync 2023-12-09T02:35:10.027 INFO:tasks.workunit.client.1.smithi161.stdout:9/222: sync 2023-12-09T02:35:10.027 INFO:tasks.workunit.client.1.smithi161.stdout:7/359: sync 2023-12-09T02:35:10.030 INFO:tasks.workunit.client.1.smithi161.stdout:1/428: dwrite d6/d8/d63/d4d/f3b [0,4194304] 0 2023-12-09T02:35:10.031 INFO:tasks.workunit.client.1.smithi161.stdout:0/294: creat d9/dd/d3a/f52 x:0 0 0 2023-12-09T02:35:10.031 INFO:tasks.workunit.client.1.smithi161.stdout:0/295: stat d9/d1f 0 2023-12-09T02:35:10.031 INFO:tasks.workunit.client.1.smithi161.stdout:2/225: mkdir d4/d1a/d4a 0 2023-12-09T02:35:10.034 INFO:tasks.workunit.client.1.smithi161.stdout:5/273: dwrite d0/f1a [0,4194304] 0 2023-12-09T02:35:10.034 INFO:tasks.workunit.client.1.smithi161.stdout:5/274: readlink d0/d2/de/l1d 0 2023-12-09T02:35:10.034 INFO:tasks.workunit.client.1.smithi161.stdout:9/223: rmdir d2/d25/d31 39 2023-12-09T02:35:10.034 INFO:tasks.workunit.client.1.smithi161.stdout:9/224: fdatasync d2/da/f21 0 2023-12-09T02:35:10.037 INFO:tasks.workunit.client.1.smithi161.stdout:4/352: dwrite dd/d36/d3f/d54/f68 [0,4194304] 0 2023-12-09T02:35:10.037 INFO:tasks.workunit.client.1.smithi161.stdout:4/353: chown dd/d1a/d1d 3681 1 2023-12-09T02:35:10.037 INFO:tasks.workunit.client.1.smithi161.stdout:8/200: link d2/d5/f16 d2/d5/f43 0 2023-12-09T02:35:10.038 INFO:tasks.workunit.client.1.smithi161.stdout:8/201: chown d2/d23/f35 312 1 2023-12-09T02:35:10.038 INFO:tasks.workunit.client.1.smithi161.stdout:7/360: mkdir d0/d49/d67/d71 0 2023-12-09T02:35:10.038 INFO:tasks.workunit.client.1.smithi161.stdout:7/361: chown d0/d3/d13/d2d/d43/d4a/f4f 60945170 1 2023-12-09T02:35:10.042 INFO:tasks.workunit.client.1.smithi161.stdout:1/429: mkdir d6/d8/d63/d4d/d31/d80/d87 0 2023-12-09T02:35:10.044 INFO:tasks.workunit.client.1.smithi161.stdout:2/226: truncate d4/f25 1693080 0 2023-12-09T02:35:10.046 INFO:tasks.workunit.client.1.smithi161.stdout:6/194: dwrite da/df/f2f [0,4194304] 0 2023-12-09T02:35:10.048 INFO:tasks.workunit.client.1.smithi161.stdout:5/275: getdents d0/d2 0 2023-12-09T02:35:10.049 INFO:tasks.workunit.client.1.smithi161.stdout:9/225: mknod d2/da/d16/c46 0 2023-12-09T02:35:10.053 INFO:tasks.workunit.client.1.smithi161.stdout:7/362: mknod d0/d29/d53/c72 0 2023-12-09T02:35:10.055 INFO:tasks.workunit.client.1.smithi161.stdout:1/430: rename d6/d9/f19 to d6/d8/d63/d4d/f88 0 2023-12-09T02:35:10.057 INFO:tasks.workunit.client.1.smithi161.stdout:2/227: creat d4/d1a/d4a/f4b x:0 0 0 2023-12-09T02:35:10.060 INFO:tasks.workunit.client.1.smithi161.stdout:8/202: dwrite d2/d5/d22/d31/f37 [0,4194304] 0 2023-12-09T02:35:10.060 INFO:tasks.workunit.client.1.smithi161.stdout:4/354: dwrite dd/d1a/d1d/d25/f2f [0,4194304] 0 2023-12-09T02:35:10.064 INFO:tasks.workunit.client.1.smithi161.stdout:6/195: link da/d28/d29/d2b/d31/d33/c38 da/d28/d29/d2b/c44 0 2023-12-09T02:35:10.064 INFO:tasks.workunit.client.1.smithi161.stdout:6/196: readlink da/d19/l1c 0 2023-12-09T02:35:10.064 INFO:tasks.workunit.client.1.smithi161.stdout:6/197: truncate da/d19/d20/f25 660024 0 2023-12-09T02:35:10.064 INFO:tasks.workunit.client.1.smithi161.stdout:5/276: mkdir d0/d2/d7/df/d60 0 2023-12-09T02:35:10.064 INFO:tasks.workunit.client.1.smithi161.stdout:5/277: write d0/d1f/f3b [1035583,71534] 0 2023-12-09T02:35:10.066 INFO:tasks.workunit.client.1.smithi161.stdout:9/226: creat d2/f47 x:0 0 0 2023-12-09T02:35:10.073 INFO:tasks.workunit.client.1.smithi161.stdout:2/228: getdents d4/d7 0 2023-12-09T02:35:10.073 INFO:tasks.workunit.client.1.smithi161.stdout:2/229: chown d4/d7/f38 50447 1 2023-12-09T02:35:10.079 INFO:tasks.workunit.client.1.smithi161.stdout:4/355: truncate dd/d36/d4a/f6f 620380 0 2023-12-09T02:35:10.079 INFO:tasks.workunit.client.1.smithi161.stdout:4/356: write dd/f19 [798150,26300] 0 2023-12-09T02:35:10.081 INFO:tasks.workunit.client.1.smithi161.stdout:5/278: mkdir d0/d2/d7/d11/d61 0 2023-12-09T02:35:10.081 INFO:tasks.workunit.client.1.smithi161.stdout:2/230: dread d4/d7/f2b [0,4194304] 0 2023-12-09T02:35:10.082 INFO:tasks.workunit.client.1.smithi161.stdout:9/227: mkdir d2/da/d16/d2e/d48 0 2023-12-09T02:35:10.083 INFO:tasks.workunit.client.1.smithi161.stdout:8/203: dwrite d2/fc [0,4194304] 0 2023-12-09T02:35:10.085 INFO:tasks.workunit.client.1.smithi161.stdout:7/363: rename d0/d3/d13/d2f/f5d to d0/d3/f73 0 2023-12-09T02:35:10.086 INFO:tasks.workunit.client.1.smithi161.stdout:8/204: dread d2/f1d [0,4194304] 0 2023-12-09T02:35:10.086 INFO:tasks.workunit.client.1.smithi161.stdout:4/357: symlink dd/d5a/l71 0 2023-12-09T02:35:10.090 INFO:tasks.workunit.client.1.smithi161.stdout:5/279: link d0/d2/f4d d0/f62 0 2023-12-09T02:35:10.091 INFO:tasks.workunit.client.1.smithi161.stdout:2/231: dread d4/f25 [0,4194304] 0 2023-12-09T02:35:10.091 INFO:tasks.workunit.client.1.smithi161.stdout:2/232: write d4/d7/db/f2f [495481,79772] 0 2023-12-09T02:35:10.092 INFO:tasks.workunit.client.1.smithi161.stdout:1/431: dread d6/d8/d63/f22 [0,4194304] 0 2023-12-09T02:35:10.092 INFO:tasks.workunit.client.1.smithi161.stdout:7/364: link d0/c5 d0/d3/d13/d2d/d43/c74 0 2023-12-09T02:35:10.096 INFO:tasks.workunit.client.1.smithi161.stdout:8/205: link d2/c13 d2/c44 0 2023-12-09T02:35:10.096 INFO:tasks.workunit.client.1.smithi161.stdout:8/206: truncate d2/d5/f30 994582 0 2023-12-09T02:35:10.096 INFO:tasks.workunit.client.1.smithi161.stdout:8/207: chown d2/d5/d3d 27 1 2023-12-09T02:35:10.096 INFO:tasks.workunit.client.1.smithi161.stdout:8/208: readlink d2/l21 0 2023-12-09T02:35:10.096 INFO:tasks.workunit.client.1.smithi161.stdout:8/209: truncate d2/d5/f33 915229 0 2023-12-09T02:35:10.097 INFO:tasks.workunit.client.1.smithi161.stdout:4/358: mknod dd/d5a/c72 0 2023-12-09T02:35:10.098 INFO:tasks.workunit.client.1.smithi161.stdout:5/280: mknod d0/d1f/c63 0 2023-12-09T02:35:10.101 INFO:tasks.workunit.client.1.smithi161.stdout:2/233: rename d4/d1a/f3d to d4/d7/f4c 0 2023-12-09T02:35:10.104 INFO:tasks.workunit.client.1.smithi161.stdout:1/432: unlink l3 0 2023-12-09T02:35:10.106 INFO:tasks.workunit.client.1.smithi161.stdout:7/365: creat d0/d3/d13/d2d/d43/d4b/f75 x:0 0 0 2023-12-09T02:35:10.106 INFO:tasks.workunit.client.1.smithi161.stdout:7/366: chown d0/d3/d13/d2d/d6e 24046 1 2023-12-09T02:35:10.107 INFO:tasks.workunit.client.1.smithi161.stdout:8/210: creat d2/d5/d22/d31/f45 x:0 0 0 2023-12-09T02:35:10.108 INFO:tasks.workunit.client.1.smithi161.stdout:8/211: write d2/f1d [729976,44894] 0 2023-12-09T02:35:10.108 INFO:tasks.workunit.client.1.smithi161.stdout:4/359: symlink dd/d1a/d23/d6a/l73 0 2023-12-09T02:35:10.109 INFO:tasks.workunit.client.1.smithi161.stdout:8/212: read d2/f3 [1635125,43102] 0 2023-12-09T02:35:10.111 INFO:tasks.workunit.client.1.smithi161.stdout:5/281: creat d0/d2/d5f/f64 x:0 0 0 2023-12-09T02:35:10.116 INFO:tasks.workunit.client.1.smithi161.stdout:7/367: truncate d0/d29/f2e 1860221 0 2023-12-09T02:35:10.118 INFO:tasks.workunit.client.1.smithi161.stdout:4/360: creat dd/d36/f74 x:0 0 0 2023-12-09T02:35:10.119 INFO:tasks.workunit.client.1.smithi161.stdout:4/361: dread dd/d1a/f64 [0,4194304] 0 2023-12-09T02:35:10.120 INFO:tasks.workunit.client.1.smithi161.stdout:5/282: creat d0/d1f/f65 x:0 0 0 2023-12-09T02:35:10.121 INFO:tasks.workunit.client.1.smithi161.stdout:1/433: creat d6/d8/d63/d1c/f89 x:0 0 0 2023-12-09T02:35:10.123 INFO:tasks.workunit.client.1.smithi161.stdout:7/368: rename d0/d3/d13/d1b/l2a to d0/d49/d67/l76 0 2023-12-09T02:35:10.125 INFO:tasks.workunit.client.1.smithi161.stdout:4/362: unlink dd/d1a/d1e/f2b 0 2023-12-09T02:35:10.126 INFO:tasks.workunit.client.1.smithi161.stdout:1/434: getdents d6 0 2023-12-09T02:35:10.131 INFO:tasks.workunit.client.1.smithi161.stdout:7/369: creat d0/d3/d13/d2f/f77 x:0 0 0 2023-12-09T02:35:10.133 INFO:tasks.workunit.client.1.smithi161.stdout:2/234: dwrite d4/d7/db/f1d [0,4194304] 0 2023-12-09T02:35:10.134 INFO:tasks.workunit.client.1.smithi161.stdout:8/213: dwrite d2/d5/f43 [0,4194304] 0 2023-12-09T02:35:10.135 INFO:tasks.workunit.client.1.smithi161.stdout:1/435: mkdir d6/d8/d63/d1c/d8a 0 2023-12-09T02:35:10.135 INFO:tasks.workunit.client.1.smithi161.stdout:1/436: fdatasync d6/f2b 0 2023-12-09T02:35:10.137 INFO:tasks.workunit.client.1.smithi161.stdout:7/370: truncate d0/d3/d13/d2d/d43/d4a/f20 1423951 0 2023-12-09T02:35:10.141 INFO:tasks.workunit.client.1.smithi161.stdout:7/371: write d0/d3/d13/f58 [2816559,78805] 0 2023-12-09T02:35:10.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.139+0000 7fcce69e3700 1 -- 172.21.15.88:0/2556712233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcce004bb80 con 0x7fcce00fde00 2023-12-09T02:35:10.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.139+0000 7fccdcff9700 1 -- 172.21.15.88:0/2556712233 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fccd405a2c0 con 0x7fcce00fde00 2023-12-09T02:35:10.142 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:35:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.141+0000 7fcce69e3700 1 -- 172.21.15.88:0/2556712233 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fccc806ae00 msgr2=0x7fccc806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.141+0000 7fcce69e3700 1 --2- 172.21.15.88:0/2556712233 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fccc806ae00 0x7fccc806d2b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcce00fdc60 tx=0x7fccd00091a0 comp rx=0 tx=0).stop 2023-12-09T02:35:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.141+0000 7fcce69e3700 1 -- 172.21.15.88:0/2556712233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcce00fde00 msgr2=0x7fcce010fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.141+0000 7fcce69e3700 1 --2- 172.21.15.88:0/2556712233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcce00fde00 0x7fcce010fcc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009fd0 tx=0x7fccd4009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.141+0000 7fcce69e3700 1 -- 172.21.15.88:0/2556712233 shutdown_connections 2023-12-09T02:35:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.141+0000 7fcce69e3700 1 --2- 172.21.15.88:0/2556712233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcce00fcbf0 0x7fcce010f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.141+0000 7fcce69e3700 1 --2- 172.21.15.88:0/2556712233 >> [v2:172.21.15.88:6800/563213166,v1:172.21.15.88:6801/563213166] conn(0x7fccc806ae00 0x7fccc806d2b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.141+0000 7fcce69e3700 1 --2- 172.21.15.88:0/2556712233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcce00fde00 0x7fcce010fcc0 secure :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009fd0 tx=0x7fccd4009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:10.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.141+0000 7fcce69e3700 1 -- 172.21.15.88:0/2556712233 >> 172.21.15.88:0/2556712233 conn(0x7fcce00f82d0 msgr2=0x7fcce00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:10.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.142+0000 7fcce69e3700 1 -- 172.21.15.88:0/2556712233 shutdown_connections 2023-12-09T02:35:10.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:10.142+0000 7fcce69e3700 1 -- 172.21.15.88:0/2556712233 wait complete. 2023-12-09T02:35:10.145 INFO:tasks.workunit.client.1.smithi161.stdout:1/437: dread d6/d8/d63/d1c/f1e [0,4194304] 0 2023-12-09T02:35:10.145 INFO:tasks.workunit.client.1.smithi161.stdout:1/438: fdatasync d6/d9/f45 0 2023-12-09T02:35:10.146 INFO:tasks.workunit.client.1.smithi161.stdout:8/214: creat d2/d5/d3d/f46 x:0 0 0 2023-12-09T02:35:10.146 INFO:tasks.workunit.client.1.smithi161.stdout:8/215: truncate d2/d5/f14 4247613 0 2023-12-09T02:35:10.146 INFO:tasks.workunit.client.1.smithi161.stdout:1/439: read f5 [4008986,61446] 0 2023-12-09T02:35:10.147 INFO:tasks.workunit.client.1.smithi161.stdout:7/372: creat d0/f78 x:0 0 0 2023-12-09T02:35:10.150 INFO:tasks.workunit.client.1.smithi161.stdout:8/216: mknod d2/d23/c47 0 2023-12-09T02:35:10.150 INFO:tasks.workunit.client.1.smithi161.stdout:8/217: stat d2/l18 0 2023-12-09T02:35:10.152 INFO:tasks.workunit.client.1.smithi161.stdout:1/440: mkdir d6/d9/d8b 0 2023-12-09T02:35:10.152 INFO:tasks.workunit.client.1.smithi161.stdout:1/441: getdents d6/d9/d8b 0 2023-12-09T02:35:10.152 INFO:tasks.workunit.client.1.smithi161.stdout:7/373: rmdir d0/d29/d53 39 2023-12-09T02:35:10.153 INFO:tasks.workunit.client.1.smithi161.stdout:7/374: chown d0/d29/d59/f6d 7 1 2023-12-09T02:35:10.154 INFO:tasks.workunit.client.1.smithi161.stdout:8/218: mkdir d2/d5/d22/d31/d38/d48 0 2023-12-09T02:35:10.154 INFO:tasks.workunit.client.1.smithi161.stdout:8/219: readlink d2/l24 0 2023-12-09T02:35:10.154 INFO:tasks.workunit.client.1.smithi161.stdout:8/220: truncate d2/d5/d22/d31/f45 265664 0 2023-12-09T02:35:10.154 INFO:tasks.workunit.client.1.smithi161.stdout:8/221: readlink d2/d5/d22/l2b 0 2023-12-09T02:35:10.161 INFO:tasks.workunit.client.1.smithi161.stdout:8/222: dread d2/f9 [0,4194304] 0 2023-12-09T02:35:10.164 INFO:tasks.workunit.client.1.smithi161.stdout:7/375: mkdir d0/d49/d79 0 2023-12-09T02:35:10.166 INFO:tasks.workunit.client.1.smithi161.stdout:1/442: dwrite d6/d8/d63/d4d/f2f [4194304,4194304] 0 2023-12-09T02:35:10.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:09 smithi161 ceph-mon[121170]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:10.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:09 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3923523534' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:35:10.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:09 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2790988650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:35:10.171 INFO:tasks.workunit.client.1.smithi161.stdout:1/443: write d6/d8/d63/d4d/d31/d73/d47/d5a/f7a [669734,2362] 0 2023-12-09T02:35:10.173 INFO:tasks.workunit.client.1.smithi161.stdout:7/376: symlink d0/d3/l7a 0 2023-12-09T02:35:10.177 INFO:tasks.workunit.client.1.smithi161.stdout:1/444: link d6/d8/d63/f65 d6/d8/d63/d4d/d31/d80/d87/f8c 0 2023-12-09T02:35:10.178 INFO:tasks.workunit.client.1.smithi161.stdout:1/445: truncate d6/d8/d63/d1c/f69 2295589 0 2023-12-09T02:35:10.179 INFO:tasks.workunit.client.1.smithi161.stdout:1/446: dread - d6/d8/d63/d35/f6a zero size 2023-12-09T02:35:10.180 INFO:tasks.workunit.client.1.smithi161.stdout:8/223: dwrite d2/f9 [0,4194304] 0 2023-12-09T02:35:10.180 INFO:tasks.workunit.client.1.smithi161.stdout:1/447: link d6/d8/c85 d6/d8/d63/d4d/d31/d80/c8d 0 2023-12-09T02:35:10.182 INFO:tasks.workunit.client.1.smithi161.stdout:8/224: creat d2/d5/d22/f49 x:0 0 0 2023-12-09T02:35:10.183 INFO:tasks.workunit.client.1.smithi161.stdout:1/448: symlink d6/d8/d68/l8e 0 2023-12-09T02:35:10.185 INFO:tasks.workunit.client.1.smithi161.stdout:1/449: dread d6/d8/d63/d4d/d31/d73/d47/f6d [0,4194304] 0 2023-12-09T02:35:10.185 INFO:tasks.workunit.client.1.smithi161.stdout:1/450: chown d6/d8/d63/d4d/d31/d73/d47/d5a/f7a 25771335 1 2023-12-09T02:35:10.185 INFO:tasks.workunit.client.1.smithi161.stdout:1/451: read d6/d49/f60 [11441,6620] 0 2023-12-09T02:35:10.186 INFO:tasks.workunit.client.1.smithi161.stdout:1/452: fdatasync d6/d8/d63/d4d/d31/d73/dd/f14 0 2023-12-09T02:35:10.188 INFO:tasks.workunit.client.1.smithi161.stdout:8/225: link d2/c13 d2/d5/d22/d31/d38/c4a 0 2023-12-09T02:35:10.189 INFO:tasks.workunit.client.1.smithi161.stdout:1/453: creat d6/d8/d63/d4d/d31/d73/dd/f8f x:0 0 0 2023-12-09T02:35:10.192 INFO:tasks.workunit.client.1.smithi161.stdout:7/377: dwrite d0/d3/f8 [0,4194304] 0 2023-12-09T02:35:10.193 INFO:tasks.workunit.client.1.smithi161.stdout:8/226: write d2/d5/d22/d31/f39 [904042,56242] 0 2023-12-09T02:35:10.197 INFO:tasks.workunit.client.1.smithi161.stdout:7/378: rename d0/d3/d13/f22 to d0/d29/d59/f7b 0 2023-12-09T02:35:10.197 INFO:tasks.workunit.client.1.smithi161.stdout:7/379: readlink d0/d3/d13/l47 0 2023-12-09T02:35:10.202 INFO:tasks.workunit.client.1.smithi161.stdout:8/227: rename d2/c26 to d2/d2d/c4b 0 2023-12-09T02:35:10.204 INFO:tasks.workunit.client.1.smithi161.stdout:7/380: creat d0/d3/d13/d2d/d43/d4b/d5a/d6f/f7c x:0 0 0 2023-12-09T02:35:10.209 INFO:tasks.workunit.client.1.smithi161.stdout:1/454: dwrite d6/d8/d63/d4d/f88 [0,4194304] 0 2023-12-09T02:35:10.209 INFO:tasks.workunit.client.1.smithi161.stdout:1/455: readlink d6/d8/d63/d35/d3d/l52 0 2023-12-09T02:35:10.211 INFO:tasks.workunit.client.1.smithi161.stdout:1/456: symlink d6/d8/d63/d1c/l90 0 2023-12-09T02:35:10.211 INFO:tasks.workunit.client.1.smithi161.stdout:7/381: write d0/d3/f8 [2285884,30491] 0 2023-12-09T02:35:10.218 INFO:tasks.workunit.client.1.smithi161.stdout:7/382: dread d0/d3/f73 [0,4194304] 0 2023-12-09T02:35:10.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:09 smithi088 ceph-mon[112028]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:10.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:09 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3923523534' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:35:10.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:09 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2790988650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:35:10.245 INFO:tasks.workunit.client.1.smithi161.stdout:8/228: dwrite d2/d5/f20 [0,4194304] 0 2023-12-09T02:35:10.246 INFO:tasks.workunit.client.1.smithi161.stdout:8/229: dread - d2/d23/f2a zero size 2023-12-09T02:35:10.246 INFO:tasks.workunit.client.1.smithi161.stdout:7/383: dwrite d0/d3/d13/d2d/f35 [0,4194304] 0 2023-12-09T02:35:10.247 INFO:tasks.workunit.client.1.smithi161.stdout:1/457: dwrite d6/d8/d63/d4d/d31/d73/d47/f7e [0,4194304] 0 2023-12-09T02:35:10.247 INFO:tasks.workunit.client.1.smithi161.stdout:1/458: stat d6/d8/d63/d4d/f53 0 2023-12-09T02:35:10.248 INFO:tasks.workunit.client.1.smithi161.stdout:8/230: link d2/d23/f2c d2/d5/d22/f4c 0 2023-12-09T02:35:10.254 INFO:tasks.workunit.client.1.smithi161.stdout:7/384: symlink d0/d3/d13/d2d/d43/d4a/l7d 0 2023-12-09T02:35:10.265 INFO:tasks.workunit.client.1.smithi161.stdout:8/231: dwrite d2/d5/d22/f4c [0,4194304] 0 2023-12-09T02:35:10.268 INFO:tasks.workunit.client.1.smithi161.stdout:7/385: link d0/d29/d59/f6d d0/d3/d13/d2f/d50/f7e 0 2023-12-09T02:35:10.268 INFO:tasks.workunit.client.1.smithi161.stdout:7/386: stat d0/d3/d13/d2d/d43 0 2023-12-09T02:35:10.271 INFO:tasks.workunit.client.1.smithi161.stdout:8/232: creat d2/d5/d22/d31/d38/f4d x:0 0 0 2023-12-09T02:35:10.272 INFO:tasks.workunit.client.1.smithi161.stdout:1/459: creat d6/d8/d63/d61/f91 x:0 0 0 2023-12-09T02:35:10.273 INFO:tasks.workunit.client.1.smithi161.stdout:8/233: mkdir d2/d5/d22/d31/d38/d48/d4e 0 2023-12-09T02:35:10.273 INFO:tasks.workunit.client.1.smithi161.stdout:8/234: truncate d2/fc 5268139 0 2023-12-09T02:35:10.274 INFO:tasks.workunit.client.1.smithi161.stdout:1/460: creat d6/d8/f92 x:0 0 0 2023-12-09T02:35:10.275 INFO:tasks.workunit.client.1.smithi161.stdout:7/387: truncate d0/d3/f8 3029586 0 2023-12-09T02:35:10.279 INFO:tasks.workunit.client.1.smithi161.stdout:7/388: rmdir d0/d3/d13 39 2023-12-09T02:35:10.279 INFO:tasks.workunit.client.1.smithi161.stdout:7/389: read - d0/d3/d13/d2f/d50/f7e zero size 2023-12-09T02:35:10.283 INFO:tasks.workunit.client.1.smithi161.stdout:8/235: rmdir d2/d5/d22 39 2023-12-09T02:35:10.284 INFO:tasks.workunit.client.1.smithi161.stdout:8/236: getdents d2/d5/d22/d31/d38/d48 0 2023-12-09T02:35:10.285 INFO:tasks.workunit.client.1.smithi161.stdout:8/237: rename d2/d23 to d2/d5/d4f 0 2023-12-09T02:35:10.285 INFO:tasks.workunit.client.1.smithi161.stdout:8/238: write d2/f1d [1173191,41172] 0 2023-12-09T02:35:10.302 INFO:tasks.workunit.client.1.smithi161.stdout:7/390: dwrite d0/d3/f73 [0,4194304] 0 2023-12-09T02:35:10.303 INFO:tasks.workunit.client.1.smithi161.stdout:7/391: write d0/fc [2619305,29198] 0 2023-12-09T02:35:10.310 INFO:tasks.workunit.client.1.smithi161.stdout:8/239: dwrite d2/d5/d22/f49 [0,4194304] 0 2023-12-09T02:35:10.318 INFO:tasks.workunit.client.1.smithi161.stdout:7/392: dwrite d0/d29/d59/f6d [0,4194304] 0 2023-12-09T02:35:10.321 INFO:tasks.workunit.client.1.smithi161.stdout:8/240: dread d2/d5/f16 [0,4194304] 0 2023-12-09T02:35:10.323 INFO:tasks.workunit.client.1.smithi161.stdout:7/393: mknod d0/d3/d13/d2d/d43/c7f 0 2023-12-09T02:35:10.324 INFO:tasks.workunit.client.1.smithi161.stdout:8/241: symlink d2/d5/l50 0 2023-12-09T02:35:10.326 INFO:tasks.workunit.client.1.smithi161.stdout:7/394: truncate d0/d3/f66 2460635 0 2023-12-09T02:35:10.330 INFO:tasks.workunit.client.1.smithi161.stdout:7/395: dread d0/d29/f2e [0,4194304] 0 2023-12-09T02:35:10.331 INFO:tasks.workunit.client.1.smithi161.stdout:2/235: sync 2023-12-09T02:35:10.332 INFO:tasks.workunit.client.1.smithi161.stdout:4/363: sync 2023-12-09T02:35:10.332 INFO:tasks.workunit.client.1.smithi161.stdout:5/283: sync 2023-12-09T02:35:10.332 INFO:tasks.workunit.client.1.smithi161.stdout:6/198: sync 2023-12-09T02:35:10.333 INFO:tasks.workunit.client.1.smithi161.stdout:3/258: sync 2023-12-09T02:35:10.333 INFO:tasks.workunit.client.1.smithi161.stdout:5/284: write d0/f62 [1712716,105154] 0 2023-12-09T02:35:10.333 INFO:tasks.workunit.client.1.smithi161.stdout:0/296: sync 2023-12-09T02:35:10.333 INFO:tasks.workunit.client.1.smithi161.stdout:9/228: sync 2023-12-09T02:35:10.333 INFO:tasks.workunit.client.1.smithi161.stdout:2/236: symlink d4/d7/l4d 0 2023-12-09T02:35:10.335 INFO:tasks.workunit.client.1.smithi161.stdout:4/364: write dd/d1a/d29/f37 [267413,123186] 0 2023-12-09T02:35:10.335 INFO:tasks.workunit.client.1.smithi161.stdout:4/365: truncate dd/d36/d4a/f6f 1325020 0 2023-12-09T02:35:10.335 INFO:tasks.workunit.client.1.smithi161.stdout:4/366: fdatasync dd/d1a/f1c 0 2023-12-09T02:35:10.335 INFO:tasks.workunit.client.1.smithi161.stdout:4/367: fsync dd/d1a/d1d/d25/d3a/f40 0 2023-12-09T02:35:10.336 INFO:tasks.workunit.client.1.smithi161.stdout:4/368: chown dd/d1a/l1b 396409 1 2023-12-09T02:35:10.338 INFO:tasks.workunit.client.1.smithi161.stdout:3/259: rename d2/d4/d11/d28/l45 to d2/d4/d11/d1f/d2a/d46/d2d/d47/l49 0 2023-12-09T02:35:10.339 INFO:tasks.workunit.client.1.smithi161.stdout:3/260: write d2/d4/d11/d1f/d2a/d46/f29 [910574,92582] 0 2023-12-09T02:35:10.339 INFO:tasks.workunit.client.1.smithi161.stdout:3/261: truncate d2/d4/d11/d1f/d2a/f2f 1021191 0 2023-12-09T02:35:10.339 INFO:tasks.workunit.client.1.smithi161.stdout:5/285: truncate d0/d2/de/d21/f2c 259249 0 2023-12-09T02:35:10.339 INFO:tasks.workunit.client.1.smithi161.stdout:2/237: dread d4/d16/f29 [0,4194304] 0 2023-12-09T02:35:10.339 INFO:tasks.workunit.client.1.smithi161.stdout:2/238: dread - d4/f44 zero size 2023-12-09T02:35:10.341 INFO:tasks.workunit.client.1.smithi161.stdout:8/242: dwrite d2/d5/d22/d31/f45 [0,4194304] 0 2023-12-09T02:35:10.342 INFO:tasks.workunit.client.1.smithi161.stdout:8/243: fdatasync d2/d5/d22/d31/d38/f4d 0 2023-12-09T02:35:10.342 INFO:tasks.workunit.client.1.smithi161.stdout:0/297: unlink d9/d1f/c19 0 2023-12-09T02:35:10.342 INFO:tasks.workunit.client.1.smithi161.stdout:0/298: dread - d9/f4b zero size 2023-12-09T02:35:10.342 INFO:tasks.workunit.client.1.smithi161.stdout:0/299: getdents d9/db 0 2023-12-09T02:35:10.349 INFO:tasks.workunit.client.1.smithi161.stdout:4/369: unlink dd/d1a/d29/c2d 0 2023-12-09T02:35:10.352 INFO:tasks.workunit.client.1.smithi161.stdout:3/262: getdents d2/d4/d11/d19 0 2023-12-09T02:35:10.355 INFO:tasks.workunit.client.1.smithi161.stdout:7/396: dwrite d0/d3/d13/f34 [0,4194304] 0 2023-12-09T02:35:10.355 INFO:tasks.workunit.client.1.smithi161.stdout:8/244: dread d2/fc [0,4194304] 0 2023-12-09T02:35:10.356 INFO:tasks.workunit.client.1.smithi161.stdout:9/229: rename d2/da/f14 to d2/d25/d31/f49 0 2023-12-09T02:35:10.357 INFO:tasks.workunit.client.1.smithi161.stdout:2/239: dwrite d4/d7/f45 [0,4194304] 0 2023-12-09T02:35:10.357 INFO:tasks.workunit.client.1.smithi161.stdout:5/286: symlink d0/d2/d7/d11/l66 0 2023-12-09T02:35:10.362 INFO:tasks.workunit.client.1.smithi161.stdout:0/300: creat d9/dd/f53 x:0 0 0 2023-12-09T02:35:10.364 INFO:tasks.workunit.client.1.smithi161.stdout:4/370: mkdir dd/d1a/d1d/d25/d32/d75 0 2023-12-09T02:35:10.366 INFO:tasks.workunit.client.1.smithi161.stdout:3/263: rmdir d2/d4/d11/d28 39 2023-12-09T02:35:10.366 INFO:tasks.workunit.client.1.smithi161.stdout:3/264: write d2/d4/d11/d1f/d2a/d46/d2d/f3d [365709,41839] 0 2023-12-09T02:35:10.368 INFO:tasks.workunit.client.1.smithi161.stdout:7/397: rmdir d0/d3/d13 39 2023-12-09T02:35:10.368 INFO:tasks.workunit.client.1.smithi161.stdout:7/398: dread - d0/d3/d13/d2d/d43/d4b/d5a/d6f/f7c zero size 2023-12-09T02:35:10.368 INFO:tasks.workunit.client.1.smithi161.stdout:2/240: dread d4/d7/db/f10 [0,4194304] 0 2023-12-09T02:35:10.369 INFO:tasks.workunit.client.1.smithi161.stdout:2/241: fsync d4/d7/f2b 0 2023-12-09T02:35:10.371 INFO:tasks.workunit.client.1.smithi161.stdout:8/245: mknod d2/d5/d22/d31/d38/c51 0 2023-12-09T02:35:10.374 INFO:tasks.workunit.client.1.smithi161.stdout:9/230: link d2/da/d16/l23 d2/da/l4a 0 2023-12-09T02:35:10.378 INFO:tasks.workunit.client.1.smithi161.stdout:9/231: dread d2/da/d16/f20 [0,4194304] 0 2023-12-09T02:35:10.380 INFO:tasks.workunit.client.1.smithi161.stdout:5/287: symlink d0/l67 0 2023-12-09T02:35:10.382 INFO:tasks.workunit.client.1.smithi161.stdout:0/301: rename d9/f4b to d9/dd/d3a/f54 0 2023-12-09T02:35:10.382 INFO:tasks.workunit.client.1.smithi161.stdout:0/302: chown d9/dd/d21/d26/d28/c50 4 1 2023-12-09T02:35:10.383 INFO:tasks.workunit.client.1.smithi161.stdout:3/265: dwrite d2/d4/d11/d1f/d2a/d46/d2d/f3d [0,4194304] 0 2023-12-09T02:35:10.393 INFO:tasks.workunit.client.1.smithi161.stdout:7/399: symlink d0/d49/d79/l80 0 2023-12-09T02:35:10.395 INFO:tasks.workunit.client.1.smithi161.stdout:2/242: link d4/d16/f26 d4/d46/f4e 0 2023-12-09T02:35:10.396 INFO:tasks.workunit.client.1.smithi161.stdout:2/243: dread - d4/d1a/f3c zero size 2023-12-09T02:35:10.396 INFO:tasks.workunit.client.1.smithi161.stdout:2/244: chown d4/d1a/d4a 0 1 2023-12-09T02:35:10.396 INFO:tasks.workunit.client.1.smithi161.stdout:2/245: readlink d4/l34 0 2023-12-09T02:35:10.396 INFO:tasks.workunit.client.1.smithi161.stdout:2/246: write d4/f30 [1088380,57265] 0 2023-12-09T02:35:10.396 INFO:tasks.workunit.client.1.smithi161.stdout:8/246: link d2/d5/f20 d2/d5/d4f/f52 0 2023-12-09T02:35:10.396 INFO:tasks.workunit.client.1.smithi161.stdout:8/247: chown d2/fc 424331679 1 2023-12-09T02:35:10.399 INFO:tasks.workunit.client.1.smithi161.stdout:9/232: rename d2/f9 to d2/d25/d31/d42/f4b 0 2023-12-09T02:35:10.402 INFO:tasks.workunit.client.1.smithi161.stdout:3/266: symlink d2/d4/d11/d1f/l4a 0 2023-12-09T02:35:10.402 INFO:tasks.workunit.client.1.smithi161.stdout:3/267: read - d2/d4/d11/d19/f3a zero size 2023-12-09T02:35:10.405 INFO:tasks.workunit.client.1.smithi161.stdout:7/400: symlink d0/l81 0 2023-12-09T02:35:10.406 INFO:tasks.workunit.client.1.smithi161.stdout:2/247: mkdir d4/d1a/d4a/d4f 0 2023-12-09T02:35:10.407 INFO:tasks.workunit.client.1.smithi161.stdout:2/248: write d4/d1a/f35 [66575,26755] 0 2023-12-09T02:35:10.407 INFO:tasks.workunit.client.1.smithi161.stdout:2/249: truncate d4/f30 1833877 0 2023-12-09T02:35:10.407 INFO:tasks.workunit.client.1.smithi161.stdout:2/250: chown d4/c6 1608634345 1 2023-12-09T02:35:10.410 INFO:tasks.workunit.client.1.smithi161.stdout:0/303: rename d9/dd/d21 to d9/d55 0 2023-12-09T02:35:10.413 INFO:tasks.workunit.client.1.smithi161.stdout:9/233: truncate d2/da/f1e 2032648 0 2023-12-09T02:35:10.414 INFO:tasks.workunit.client.1.smithi161.stdout:2/251: dread d4/d7/fc [0,4194304] 0 2023-12-09T02:35:10.416 INFO:tasks.workunit.client.1.smithi161.stdout:7/401: creat d0/d29/f82 x:0 0 0 2023-12-09T02:35:10.417 INFO:tasks.workunit.client.1.smithi161.stdout:9/234: dread d2/da/d16/f20 [0,4194304] 0 2023-12-09T02:35:10.417 INFO:tasks.workunit.client.1.smithi161.stdout:9/235: write d2/da/d16/f36 [1020058,12519] 0 2023-12-09T02:35:10.417 INFO:tasks.workunit.client.1.smithi161.stdout:8/248: rename d2/c44 to d2/d5/d22/c53 0 2023-12-09T02:35:10.419 INFO:tasks.workunit.client.1.smithi161.stdout:0/304: mknod d9/db/c56 0 2023-12-09T02:35:10.420 INFO:tasks.workunit.client.1.smithi161.stdout:2/252: creat d4/d1a/f50 x:0 0 0 2023-12-09T02:35:10.421 INFO:tasks.workunit.client.1.smithi161.stdout:7/402: mkdir d0/d3/d13/d2d/d43/d4b/d5a/d6f/d83 0 2023-12-09T02:35:10.422 INFO:tasks.workunit.client.1.smithi161.stdout:9/236: creat d2/d25/d31/d42/f4c x:0 0 0 2023-12-09T02:35:10.422 INFO:tasks.workunit.client.1.smithi161.stdout:3/268: dwrite d2/d4/d11/d1f/f25 [0,4194304] 0 2023-12-09T02:35:10.424 INFO:tasks.workunit.client.1.smithi161.stdout:8/249: mkdir d2/d5/d22/d54 0 2023-12-09T02:35:10.424 INFO:tasks.workunit.client.1.smithi161.stdout:3/269: write d2/d4/f23 [1085736,86632] 0 2023-12-09T02:35:10.426 INFO:tasks.workunit.client.1.smithi161.stdout:3/270: write d2/d4/d11/f3c [1841078,4628] 0 2023-12-09T02:35:10.426 INFO:tasks.workunit.client.1.smithi161.stdout:3/271: write d2/d4/d11/d19/f3a [389194,28369] 0 2023-12-09T02:35:10.427 INFO:tasks.workunit.client.1.smithi161.stdout:3/272: chown d2/d4/f5 4257961 1 2023-12-09T02:35:10.429 INFO:tasks.workunit.client.1.smithi161.stdout:0/305: rename d9/d25/f22 to d9/d55/d26/f57 0 2023-12-09T02:35:10.429 INFO:tasks.workunit.client.1.smithi161.stdout:3/273: read d2/f15 [156627,121982] 0 2023-12-09T02:35:10.432 INFO:tasks.workunit.client.1.smithi161.stdout:7/403: dread d0/d3/d21/f3b [0,4194304] 0 2023-12-09T02:35:10.433 INFO:tasks.workunit.client.1.smithi161.stdout:0/306: mkdir d9/d55/d26/d28/d58 0 2023-12-09T02:35:10.434 INFO:tasks.workunit.client.1.smithi161.stdout:0/307: write d9/d25/f4e [3064050,54282] 0 2023-12-09T02:35:10.434 INFO:tasks.workunit.client.1.smithi161.stdout:0/308: truncate d9/d25/f38 1562923 0 2023-12-09T02:35:10.435 INFO:tasks.workunit.client.1.smithi161.stdout:2/253: dwrite d4/d7/db/f36 [0,4194304] 0 2023-12-09T02:35:10.441 INFO:tasks.workunit.client.1.smithi161.stdout:7/404: truncate d0/d3/d13/f18 2104923 0 2023-12-09T02:35:10.441 INFO:tasks.workunit.client.1.smithi161.stdout:3/274: dread d2/d4/f23 [0,4194304] 0 2023-12-09T02:35:10.442 INFO:tasks.workunit.client.1.smithi161.stdout:9/237: getdents d2/d25/d31/d42 0 2023-12-09T02:35:10.445 INFO:tasks.workunit.client.1.smithi161.stdout:0/309: unlink d9/db/d2a/d35/f43 0 2023-12-09T02:35:10.446 INFO:tasks.workunit.client.1.smithi161.stdout:0/310: fsync d9/d55/f51 0 2023-12-09T02:35:10.447 INFO:tasks.workunit.client.1.smithi161.stdout:0/311: write d9/d25/f2b [2061924,4182] 0 2023-12-09T02:35:10.451 INFO:tasks.workunit.client.1.smithi161.stdout:2/254: unlink d4/d7/db/c33 0 2023-12-09T02:35:10.453 INFO:tasks.workunit.client.1.smithi161.stdout:7/405: rename d0/d3/d13/d2d/d43/d4b/d5a/d6f/f7c to d0/d29/d59/d5e/f84 0 2023-12-09T02:35:10.453 INFO:tasks.workunit.client.1.smithi161.stdout:2/255: write d4/d7/db/f19 [1496713,129658] 0 2023-12-09T02:35:10.454 INFO:tasks.workunit.client.1.smithi161.stdout:3/275: mknod d2/d4/d11/d1f/d2a/d46/d40/c4b 0 2023-12-09T02:35:10.455 INFO:tasks.workunit.client.1.smithi161.stdout:9/238: mkdir d2/d25/d3a/d4d 0 2023-12-09T02:35:10.455 INFO:tasks.workunit.client.1.smithi161.stdout:9/239: chown d2/d25/d31/f43 256993 1 2023-12-09T02:35:10.462 INFO:tasks.workunit.client.1.smithi161.stdout:0/312: rmdir d9 39 2023-12-09T02:35:10.462 INFO:tasks.workunit.client.1.smithi161.stdout:0/313: chown d9/d25 63 1 2023-12-09T02:35:10.462 INFO:tasks.workunit.client.1.smithi161.stdout:0/314: readlink d9/d1f/l39 0 2023-12-09T02:35:10.465 INFO:tasks.workunit.client.1.smithi161.stdout:7/406: rename d0/d29/d59/f7b to d0/d3/d13/d2d/d43/d4b/f85 0 2023-12-09T02:35:10.465 INFO:tasks.workunit.client.1.smithi161.stdout:7/407: dread - d0/d49/f4c zero size 2023-12-09T02:35:10.470 INFO:tasks.workunit.client.1.smithi161.stdout:2/256: getdents d4/d1a 0 2023-12-09T02:35:10.471 INFO:tasks.workunit.client.1.smithi161.stdout:2/257: dread d4/d16/f26 [0,4194304] 0 2023-12-09T02:35:10.471 INFO:tasks.workunit.client.1.smithi161.stdout:2/258: chown d4/d7/db/c28 339869808 1 2023-12-09T02:35:10.472 INFO:tasks.workunit.client.1.smithi161.stdout:3/276: mkdir d2/d4/d11/d1f/d4c 0 2023-12-09T02:35:10.474 INFO:tasks.workunit.client.1.smithi161.stdout:9/240: symlink d2/d25/d31/l4e 0 2023-12-09T02:35:10.475 INFO:tasks.workunit.client.1.smithi161.stdout:9/241: write d2/f35 [3144410,50433] 0 2023-12-09T02:35:10.476 INFO:tasks.workunit.client.1.smithi161.stdout:0/315: getdents d9/db 0 2023-12-09T02:35:10.477 INFO:tasks.workunit.client.1.smithi161.stdout:7/408: getdents d0/d3/d13/d2d/d43/d4a 0 2023-12-09T02:35:10.481 INFO:tasks.workunit.client.1.smithi161.stdout:2/259: link d4/d7/db/c23 d4/d1a/d4a/c51 0 2023-12-09T02:35:10.483 INFO:tasks.workunit.client.1.smithi161.stdout:3/277: unlink d2/d4/d11/d1f/d2a/d46/d2d/f3d 0 2023-12-09T02:35:10.483 INFO:tasks.workunit.client.1.smithi161.stdout:3/278: chown d2/d4/d11/d1f 2442 1 2023-12-09T02:35:10.488 INFO:tasks.workunit.client.1.smithi161.stdout:2/260: dread d4/f25 [0,4194304] 0 2023-12-09T02:35:10.488 INFO:tasks.workunit.client.1.smithi161.stdout:2/261: write d4/d1a/f3c [951992,28334] 0 2023-12-09T02:35:10.510 INFO:tasks.workunit.client.1.smithi161.stdout:9/242: truncate d2/f8 875675 0 2023-12-09T02:35:10.514 INFO:tasks.workunit.client.1.smithi161.stdout:3/279: unlink d2/f42 0 2023-12-09T02:35:10.514 INFO:tasks.workunit.client.1.smithi161.stdout:0/316: dwrite d9/d55/d26/f42 [0,4194304] 0 2023-12-09T02:35:10.519 INFO:tasks.workunit.client.1.smithi161.stdout:2/262: creat d4/d46/f52 x:0 0 0 2023-12-09T02:35:10.519 INFO:tasks.workunit.client.1.smithi161.stdout:2/263: getdents d4/d1a/d4a/d4f 0 2023-12-09T02:35:10.519 INFO:tasks.workunit.client.1.smithi161.stdout:2/264: read - d4/d7/f13 zero size 2023-12-09T02:35:10.521 INFO:tasks.workunit.client.1.smithi161.stdout:9/243: mkdir d2/d25/d31/d4f 0 2023-12-09T02:35:10.521 INFO:tasks.workunit.client.1.smithi161.stdout:9/244: chown d2/da/d16/f20 228173291 1 2023-12-09T02:35:10.534 INFO:tasks.workunit.client.1.smithi161.stdout:2/265: dread d4/d7/f38 [0,4194304] 0 2023-12-09T02:35:10.535 INFO:tasks.workunit.client.1.smithi161.stdout:9/245: dread d2/da/d16/d2e/f45 [0,4194304] 0 2023-12-09T02:35:10.536 INFO:tasks.workunit.client.1.smithi161.stdout:9/246: symlink d2/d25/d3a/l50 0 2023-12-09T02:35:10.537 INFO:tasks.workunit.client.1.smithi161.stdout:0/317: dwrite d9/d55/d26/f42 [0,4194304] 0 2023-12-09T02:35:10.538 INFO:tasks.workunit.client.1.smithi161.stdout:6/199: sync 2023-12-09T02:35:10.538 INFO:tasks.workunit.client.1.smithi161.stdout:6/200: dread - da/df/f27 zero size 2023-12-09T02:35:10.538 INFO:tasks.workunit.client.1.smithi161.stdout:1/461: sync 2023-12-09T02:35:10.538 INFO:tasks.workunit.client.1.smithi161.stdout:9/247: mkdir d2/da/d16/d51 0 2023-12-09T02:35:10.539 INFO:tasks.workunit.client.1.smithi161.stdout:3/280: dwrite d2/d4/d11/d28/f22 [0,4194304] 0 2023-12-09T02:35:10.540 INFO:tasks.workunit.client.1.smithi161.stdout:0/318: creat d9/db/d2a/f59 x:0 0 0 2023-12-09T02:35:10.541 INFO:tasks.workunit.client.1.smithi161.stdout:2/266: write d4/d7/f31 [3307847,48196] 0 2023-12-09T02:35:10.548 INFO:tasks.workunit.client.1.smithi161.stdout:3/281: write d2/d4/d11/d1f/d2a/d46/f29 [654911,45809] 0 2023-12-09T02:35:10.548 INFO:tasks.workunit.client.1.smithi161.stdout:2/267: unlink d4/d7/c3a 0 2023-12-09T02:35:10.554 INFO:tasks.workunit.client.1.smithi161.stdout:1/462: rename d6/d8/d63/d4d/d31/d73/dd to d6/d8/d63/d93 0 2023-12-09T02:35:10.559 INFO:tasks.workunit.client.1.smithi161.stdout:3/282: link d2/d4/d11/d1f/f25 d2/d37/f4d 0 2023-12-09T02:35:10.560 INFO:tasks.workunit.client.1.smithi161.stdout:9/248: dwrite d2/da/d16/f36 [0,4194304] 0 2023-12-09T02:35:10.560 INFO:tasks.workunit.client.1.smithi161.stdout:2/268: unlink d4/d7/f38 0 2023-12-09T02:35:10.560 INFO:tasks.workunit.client.1.smithi161.stdout:2/269: readlink d4/l34 0 2023-12-09T02:35:10.561 INFO:tasks.workunit.client.1.smithi161.stdout:6/201: dwrite da/d19/d20/f25 [0,4194304] 0 2023-12-09T02:35:10.563 INFO:tasks.workunit.client.1.smithi161.stdout:3/283: rmdir d2/d4/d11/d1f/d2a/d46/d40 39 2023-12-09T02:35:10.565 INFO:tasks.workunit.client.1.smithi161.stdout:3/284: write d2/d4/d11/d1f/f25 [790417,48676] 0 2023-12-09T02:35:10.566 INFO:tasks.workunit.client.1.smithi161.stdout:2/270: mkdir d4/d46/d53 0 2023-12-09T02:35:10.569 INFO:tasks.workunit.client.1.smithi161.stdout:1/463: dwrite d6/d8/d63/d4d/d31/d80/f83 [0,4194304] 0 2023-12-09T02:35:10.569 INFO:tasks.workunit.client.1.smithi161.stdout:1/464: chown d6/d8/d63/d35/l7c 10 1 2023-12-09T02:35:10.573 INFO:tasks.workunit.client.1.smithi161.stdout:3/285: getdents d2/d4/d11/d1f/d2a/d46 0 2023-12-09T02:35:10.573 INFO:tasks.workunit.client.1.smithi161.stdout:3/286: chown d2/d4/f5 17694 1 2023-12-09T02:35:10.574 INFO:tasks.workunit.client.1.smithi161.stdout:6/202: dread da/df/f2f [0,4194304] 0 2023-12-09T02:35:10.575 INFO:tasks.workunit.client.1.smithi161.stdout:2/271: creat d4/d46/f54 x:0 0 0 2023-12-09T02:35:10.581 INFO:tasks.workunit.client.1.smithi161.stdout:1/465: creat d6/d49/f94 x:0 0 0 2023-12-09T02:35:10.585 INFO:tasks.workunit.client.1.smithi161.stdout:6/203: creat da/d28/d29/f45 x:0 0 0 2023-12-09T02:35:10.585 INFO:tasks.workunit.client.1.smithi161.stdout:6/204: truncate da/d28/d29/d2b/d31/f35 1446301 0 2023-12-09T02:35:10.586 INFO:tasks.workunit.client.1.smithi161.stdout:2/272: creat d4/d7/db/f55 x:0 0 0 2023-12-09T02:35:10.586 INFO:tasks.workunit.client.1.smithi161.stdout:2/273: fsync d4/d7/db/f24 0 2023-12-09T02:35:10.589 INFO:tasks.workunit.client.1.smithi161.stdout:1/466: rename d6/d8/d63/d4d/d31/d80/c8d to d6/d9/d5c/c95 0 2023-12-09T02:35:10.589 INFO:tasks.workunit.client.1.smithi161.stdout:1/467: truncate d6/d9/d5c/f66 597335 0 2023-12-09T02:35:10.591 INFO:tasks.workunit.client.1.smithi161.stdout:6/205: rmdir da/d28/d3c 39 2023-12-09T02:35:10.593 INFO:tasks.workunit.client.1.smithi161.stdout:2/274: mkdir d4/d7/d56 0 2023-12-09T02:35:10.593 INFO:tasks.workunit.client.1.smithi161.stdout:2/275: write d4/d46/f54 [944533,94303] 0 2023-12-09T02:35:10.593 INFO:tasks.workunit.client.1.smithi161.stdout:2/276: readlink d4/d1a/l21 0 2023-12-09T02:35:10.593 INFO:tasks.workunit.client.1.smithi161.stdout:2/277: write d4/d16/f49 [255596,79127] 0 2023-12-09T02:35:10.594 INFO:tasks.workunit.client.1.smithi161.stdout:1/468: creat d6/d8/d63/d35/d3d/f96 x:0 0 0 2023-12-09T02:35:10.595 INFO:tasks.workunit.client.1.smithi161.stdout:6/206: mkdir da/d28/d3c/d46 0 2023-12-09T02:35:10.595 INFO:tasks.workunit.client.1.smithi161.stdout:6/207: dread - da/df/f27 zero size 2023-12-09T02:35:10.596 INFO:tasks.workunit.client.1.smithi161.stdout:2/278: creat d4/d1a/d4a/d4f/f57 x:0 0 0 2023-12-09T02:35:10.596 INFO:tasks.workunit.client.1.smithi161.stdout:2/279: chown d4/d1a 364 1 2023-12-09T02:35:10.596 INFO:tasks.workunit.client.1.smithi161.stdout:2/280: chown d4/d7/db/f24 78 1 2023-12-09T02:35:10.596 INFO:tasks.workunit.client.1.smithi161.stdout:2/281: truncate d4/f44 206923 0 2023-12-09T02:35:10.596 INFO:tasks.workunit.client.1.smithi161.stdout:1/469: mknod d6/d8/d63/d1c/c97 0 2023-12-09T02:35:10.598 INFO:tasks.workunit.client.1.smithi161.stdout:6/208: link da/f1a da/df/d2d/f47 0 2023-12-09T02:35:10.598 INFO:tasks.workunit.client.1.smithi161.stdout:6/209: chown da/d19/l1c 206530933 1 2023-12-09T02:35:10.600 INFO:tasks.workunit.client.1.smithi161.stdout:6/210: rename da/d28/d29/d2b/d31/d33/d39/f40 to da/d28/d3c/d46/f48 0 2023-12-09T02:35:10.601 INFO:tasks.workunit.client.1.smithi161.stdout:6/211: mkdir da/df/d2d/d49 0 2023-12-09T02:35:10.603 INFO:tasks.workunit.client.1.smithi161.stdout:6/212: creat da/df/d2d/d49/f4a x:0 0 0 2023-12-09T02:35:10.608 INFO:tasks.workunit.client.1.smithi161.stdout:1/470: dread f5 [0,4194304] 0 2023-12-09T02:35:10.610 INFO:tasks.workunit.client.1.smithi161.stdout:1/471: write d6/d8/d63/f65 [1927374,82589] 0 2023-12-09T02:35:10.619 INFO:tasks.workunit.client.1.smithi161.stdout:1/472: dread d6/d8/d63/d4d/d31/d80/f83 [0,4194304] 0 2023-12-09T02:35:10.623 INFO:tasks.workunit.client.1.smithi161.stdout:2/282: dwrite d4/d46/f54 [0,4194304] 0 2023-12-09T02:35:10.625 INFO:tasks.workunit.client.1.smithi161.stdout:6/213: dwrite da/d19/f24 [0,4194304] 0 2023-12-09T02:35:10.625 INFO:tasks.workunit.client.1.smithi161.stdout:1/473: mknod d6/d8/d63/c98 0 2023-12-09T02:35:10.628 INFO:tasks.workunit.client.1.smithi161.stdout:2/283: rmdir d4/d46/d53 0 2023-12-09T02:35:10.643 INFO:tasks.workunit.client.1.smithi161.stdout:6/214: dread da/f10 [0,4194304] 0 2023-12-09T02:35:10.648 INFO:tasks.workunit.client.1.smithi161.stdout:2/284: link d4/d1a/c27 d4/d46/c58 0 2023-12-09T02:35:10.649 INFO:tasks.workunit.client.1.smithi161.stdout:6/215: getdents da/d28 0 2023-12-09T02:35:10.652 INFO:tasks.workunit.client.1.smithi161.stdout:1/474: truncate d6/d8/d63/d4d/d31/d73/d47/d5a/f6b 1631316 0 2023-12-09T02:35:10.654 INFO:tasks.workunit.client.1.smithi161.stdout:2/285: creat d4/d1a/d4a/d4f/f59 x:0 0 0 2023-12-09T02:35:10.654 INFO:tasks.workunit.client.1.smithi161.stdout:2/286: fdatasync d4/f41 0 2023-12-09T02:35:10.661 INFO:tasks.workunit.client.1.smithi161.stdout:6/216: symlink da/d28/d3c/d46/l4b 0 2023-12-09T02:35:10.661 INFO:tasks.workunit.client.1.smithi161.stdout:6/217: write da/d28/d29/d2b/d31/d33/f3e [543269,31874] 0 2023-12-09T02:35:10.662 INFO:tasks.workunit.client.1.smithi161.stdout:2/287: mkdir d4/d7/d56/d5a 0 2023-12-09T02:35:10.664 INFO:tasks.workunit.client.1.smithi161.stdout:6/218: creat da/df/d2d/d49/f4c x:0 0 0 2023-12-09T02:35:10.667 INFO:tasks.workunit.client.1.smithi161.stdout:1/475: dwrite d6/d8/d63/d93/f8f [0,4194304] 0 2023-12-09T02:35:10.667 INFO:tasks.workunit.client.1.smithi161.stdout:1/476: readlink d6/d9/l32 0 2023-12-09T02:35:10.667 INFO:tasks.workunit.client.1.smithi161.stdout:6/219: getdents da/d28/d29/d2b 0 2023-12-09T02:35:10.673 INFO:tasks.workunit.client.1.smithi161.stdout:4/371: sync 2023-12-09T02:35:10.675 INFO:tasks.workunit.client.1.smithi161.stdout:1/477: mknod d6/d8/d63/d1c/c99 0 2023-12-09T02:35:10.676 INFO:tasks.workunit.client.1.smithi161.stdout:1/478: write d6/d8/d63/d1c/f41 [804281,98918] 0 2023-12-09T02:35:10.676 INFO:tasks.workunit.client.1.smithi161.stdout:2/288: dwrite d4/d1a/f3c [0,4194304] 0 2023-12-09T02:35:10.677 INFO:tasks.workunit.client.1.smithi161.stdout:6/220: mkdir da/d28/d4d 0 2023-12-09T02:35:10.680 INFO:tasks.workunit.client.1.smithi161.stdout:4/372: symlink dd/d1a/d23/d6a/l76 0 2023-12-09T02:35:10.681 INFO:tasks.workunit.client.1.smithi161.stdout:1/479: rename d6/d8/d63/c98 to d6/d8/d63/d35/d3d/d75/c9a 0 2023-12-09T02:35:10.682 INFO:tasks.workunit.client.1.smithi161.stdout:1/480: write d6/d8/d63/d35/f7b [652501,44226] 0 2023-12-09T02:35:10.687 INFO:tasks.workunit.client.1.smithi161.stdout:2/289: creat d4/d16/f5b x:0 0 0 2023-12-09T02:35:10.687 INFO:tasks.workunit.client.1.smithi161.stdout:2/290: chown d4/d7/c9 123453 1 2023-12-09T02:35:10.688 INFO:tasks.workunit.client.1.smithi161.stdout:6/221: unlink l5 0 2023-12-09T02:35:10.688 INFO:tasks.workunit.client.1.smithi161.stdout:6/222: truncate da/df/d2d/d3b/f42 528941 0 2023-12-09T02:35:10.689 INFO:tasks.workunit.client.1.smithi161.stdout:4/373: mknod dd/d36/d3f/d54/c77 0 2023-12-09T02:35:10.689 INFO:tasks.workunit.client.1.smithi161.stdout:1/481: dread d6/d8/d63/d4d/f3b [0,4194304] 0 2023-12-09T02:35:10.692 INFO:tasks.workunit.client.1.smithi161.stdout:2/291: creat d4/d46/f5c x:0 0 0 2023-12-09T02:35:10.693 INFO:tasks.workunit.client.1.smithi161.stdout:4/374: getdents dd/d1a/d1d/d25/d32/d34 0 2023-12-09T02:35:10.695 INFO:tasks.workunit.client.1.smithi161.stdout:1/482: creat d6/d8/d63/d4d/d31/d73/f9b x:0 0 0 2023-12-09T02:35:10.697 INFO:tasks.workunit.client.1.smithi161.stdout:2/292: rename d4/c6 to d4/d1a/c5d 0 2023-12-09T02:35:10.698 INFO:tasks.workunit.client.1.smithi161.stdout:4/375: mkdir dd/d1a/d1d/d25/d32/d34/d78 0 2023-12-09T02:35:10.699 INFO:tasks.workunit.client.1.smithi161.stdout:1/483: mkdir d6/d8/d63/d4d/d31/d80/d9c 0 2023-12-09T02:35:10.701 INFO:tasks.workunit.client.1.smithi161.stdout:2/293: link d4/d1a/c42 d4/d16/c5e 0 2023-12-09T02:35:10.702 INFO:tasks.workunit.client.1.smithi161.stdout:1/484: dread d6/d8/f30 [0,4194304] 0 2023-12-09T02:35:10.703 INFO:tasks.workunit.client.1.smithi161.stdout:4/376: truncate dd/d36/d3f/f43 361004 0 2023-12-09T02:35:10.704 INFO:tasks.workunit.client.1.smithi161.stdout:2/294: mknod d4/d46/c5f 0 2023-12-09T02:35:10.706 INFO:tasks.workunit.client.1.smithi161.stdout:2/295: dread d4/d7/db/f19 [0,4194304] 0 2023-12-09T02:35:10.707 INFO:tasks.workunit.client.1.smithi161.stdout:1/485: mkdir d6/d8/d63/d1c/d81/d9d 0 2023-12-09T02:35:10.708 INFO:tasks.workunit.client.1.smithi161.stdout:1/486: write d6/d8/d63/d93/f48 [716628,61082] 0 2023-12-09T02:35:10.708 INFO:tasks.workunit.client.1.smithi161.stdout:4/377: mkdir dd/d1a/d23/d6a/d79 0 2023-12-09T02:35:10.709 INFO:tasks.workunit.client.1.smithi161.stdout:2/296: stat d4/d1a/c27 0 2023-12-09T02:35:10.710 INFO:tasks.workunit.client.1.smithi161.stdout:6/223: dwrite f9 [0,4194304] 0 2023-12-09T02:35:10.713 INFO:tasks.workunit.client.1.smithi161.stdout:1/487: mknod d6/d8/d63/d4d/d31/d80/c9e 0 2023-12-09T02:35:10.716 INFO:tasks.workunit.client.1.smithi161.stdout:4/378: mknod dd/d1a/c7a 0 2023-12-09T02:35:10.717 INFO:tasks.workunit.client.1.smithi161.stdout:1/488: dread d6/d8/d63/d4d/f2f [0,4194304] 0 2023-12-09T02:35:10.717 INFO:tasks.workunit.client.1.smithi161.stdout:1/489: write d6/d8/d63/d4d/d31/f3a [8609914,13526] 0 2023-12-09T02:35:10.717 INFO:tasks.workunit.client.1.smithi161.stdout:2/297: mkdir d4/d7/d56/d5a/d60 0 2023-12-09T02:35:10.720 INFO:tasks.workunit.client.1.smithi161.stdout:4/379: dread dd/d36/d3f/f43 [0,4194304] 0 2023-12-09T02:35:10.728 INFO:tasks.workunit.client.1.smithi161.stdout:6/224: mknod da/df/d2d/c4e 0 2023-12-09T02:35:10.730 INFO:tasks.workunit.client.1.smithi161.stdout:1/490: mkdir d6/d8/d63/d4d/d9f 0 2023-12-09T02:35:10.733 INFO:tasks.workunit.client.1.smithi161.stdout:2/298: mknod d4/d7/d56/c61 0 2023-12-09T02:35:10.733 INFO:tasks.workunit.client.1.smithi161.stdout:2/299: dread - d4/d46/f52 zero size 2023-12-09T02:35:10.737 INFO:tasks.workunit.client.1.smithi161.stdout:6/225: mknod da/d28/d4d/c4f 0 2023-12-09T02:35:10.738 INFO:tasks.workunit.client.1.smithi161.stdout:6/226: chown da/df/d2d/d3b/f42 23 1 2023-12-09T02:35:10.738 INFO:tasks.workunit.client.1.smithi161.stdout:6/227: fsync da/df/d2d/d49/f4c 0 2023-12-09T02:35:10.740 INFO:tasks.workunit.client.1.smithi161.stdout:1/491: unlink d6/d8/d63/f22 0 2023-12-09T02:35:10.744 INFO:tasks.workunit.client.1.smithi161.stdout:6/228: rename da/f10 to da/d19/f50 0 2023-12-09T02:35:10.748 INFO:tasks.workunit.client.1.smithi161.stdout:1/492: unlink d6/d8/d68/c71 0 2023-12-09T02:35:10.750 INFO:tasks.workunit.client.1.smithi161.stdout:6/229: rename da/f26 to da/d28/d29/d2b/d31/f51 0 2023-12-09T02:35:10.751 INFO:tasks.workunit.client.1.smithi161.stdout:6/230: truncate da/d28/d3c/d46/f48 597045 0 2023-12-09T02:35:10.751 INFO:tasks.workunit.client.1.smithi161.stdout:6/231: chown f9 89545 1 2023-12-09T02:35:10.751 INFO:tasks.workunit.client.1.smithi161.stdout:2/300: dwrite d4/d7/f15 [0,4194304] 0 2023-12-09T02:35:10.753 INFO:tasks.workunit.client.1.smithi161.stdout:1/493: link d6/d8/d63/d1c/f41 d6/d8/d63/d4d/d9f/fa0 0 2023-12-09T02:35:10.754 INFO:tasks.workunit.client.1.smithi161.stdout:6/232: mknod da/d28/d29/d2b/c52 0 2023-12-09T02:35:10.755 INFO:tasks.workunit.client.1.smithi161.stdout:2/301: creat d4/d7/db/f62 x:0 0 0 2023-12-09T02:35:10.757 INFO:tasks.workunit.client.1.smithi161.stdout:6/233: creat da/d28/d29/d2b/d31/f53 x:0 0 0 2023-12-09T02:35:10.758 INFO:tasks.workunit.client.1.smithi161.stdout:2/302: mkdir d4/d7/d56/d63 0 2023-12-09T02:35:10.758 INFO:tasks.workunit.client.1.smithi161.stdout:2/303: chown d4/d1a 1 1 2023-12-09T02:35:10.764 INFO:tasks.workunit.client.1.smithi161.stdout:8/250: sync 2023-12-09T02:35:10.764 INFO:tasks.workunit.client.1.smithi161.stdout:3/287: sync 2023-12-09T02:35:10.764 INFO:tasks.workunit.client.1.smithi161.stdout:5/288: sync 2023-12-09T02:35:10.764 INFO:tasks.workunit.client.1.smithi161.stdout:9/249: sync 2023-12-09T02:35:10.764 INFO:tasks.workunit.client.1.smithi161.stdout:3/288: fsync d2/d4/f18 0 2023-12-09T02:35:10.764 INFO:tasks.workunit.client.1.smithi161.stdout:8/251: chown d2/d5/d22/d31/f41 11645531 1 2023-12-09T02:35:10.764 INFO:tasks.workunit.client.1.smithi161.stdout:7/409: sync 2023-12-09T02:35:10.764 INFO:tasks.workunit.client.1.smithi161.stdout:0/319: sync 2023-12-09T02:35:10.764 INFO:tasks.workunit.client.1.smithi161.stdout:5/289: write d0/d2/d7/d11/f5d [986902,53785] 0 2023-12-09T02:35:10.764 INFO:tasks.workunit.client.1.smithi161.stdout:7/410: fsync d0/d3/d13/d2d/d43/d4a/f4f 0 2023-12-09T02:35:10.772 INFO:tasks.workunit.client.1.smithi161.stdout:9/250: symlink d2/da/d16/d39/l52 0 2023-12-09T02:35:10.774 INFO:tasks.workunit.client.1.smithi161.stdout:8/252: creat d2/f55 x:0 0 0 2023-12-09T02:35:10.774 INFO:tasks.workunit.client.1.smithi161.stdout:8/253: chown l0 16 1 2023-12-09T02:35:10.774 INFO:tasks.workunit.client.1.smithi161.stdout:8/254: chown l0 354723 1 2023-12-09T02:35:10.777 INFO:tasks.workunit.client.1.smithi161.stdout:7/411: creat d0/d29/d59/f86 x:0 0 0 2023-12-09T02:35:10.779 INFO:tasks.workunit.client.1.smithi161.stdout:9/251: mknod d2/da/d16/d2e/d3f/c53 0 2023-12-09T02:35:10.780 INFO:tasks.workunit.client.1.smithi161.stdout:0/320: dread d9/d55/d26/f57 [0,4194304] 0 2023-12-09T02:35:10.781 INFO:tasks.workunit.client.1.smithi161.stdout:8/255: mknod d2/d5/d22/d31/d38/d48/c56 0 2023-12-09T02:35:10.785 INFO:tasks.workunit.client.1.smithi161.stdout:7/412: mknod d0/d29/d59/c87 0 2023-12-09T02:35:10.788 INFO:tasks.workunit.client.1.smithi161.stdout:0/321: mkdir d9/d55/d5a 0 2023-12-09T02:35:10.789 INFO:tasks.workunit.client.1.smithi161.stdout:8/256: creat d2/d2d/f57 x:0 0 0 2023-12-09T02:35:10.795 INFO:tasks.workunit.client.1.smithi161.stdout:8/257: creat d2/d5/d22/d31/f58 x:0 0 0 2023-12-09T02:35:10.798 INFO:tasks.workunit.client.1.smithi161.stdout:8/258: creat d2/d5/d22/d31/d38/f59 x:0 0 0 2023-12-09T02:35:10.800 INFO:tasks.workunit.client.1.smithi161.stdout:0/322: dread d9/d25/f33 [0,4194304] 0 2023-12-09T02:35:10.800 INFO:tasks.workunit.client.1.smithi161.stdout:0/323: fsync d9/d25/f2b 0 2023-12-09T02:35:10.800 INFO:tasks.workunit.client.1.smithi161.stdout:8/259: creat d2/d5/d22/d31/d38/d48/f5a x:0 0 0 2023-12-09T02:35:10.801 INFO:tasks.workunit.client.1.smithi161.stdout:0/324: mkdir d9/d5b 0 2023-12-09T02:35:10.803 INFO:tasks.workunit.client.1.smithi161.stdout:8/260: unlink d2/l25 0 2023-12-09T02:35:10.803 INFO:tasks.workunit.client.1.smithi161.stdout:1/494: dwrite d6/d8/d63/d35/f3c [0,4194304] 0 2023-12-09T02:35:10.804 INFO:tasks.workunit.client.1.smithi161.stdout:0/325: link d9/dd/d3a/l4c d9/d55/d26/d28/l5c 0 2023-12-09T02:35:10.805 INFO:tasks.workunit.client.1.smithi161.stdout:8/261: symlink d2/d5/d22/d31/l5b 0 2023-12-09T02:35:10.806 INFO:tasks.workunit.client.1.smithi161.stdout:1/495: symlink d6/d9/d8b/la1 0 2023-12-09T02:35:10.806 INFO:tasks.workunit.client.1.smithi161.stdout:1/496: truncate d6/d8/d63/f65 4932650 0 2023-12-09T02:35:10.807 INFO:tasks.workunit.client.1.smithi161.stdout:8/262: mknod d2/d5/c5c 0 2023-12-09T02:35:10.807 INFO:tasks.workunit.client.1.smithi161.stdout:8/263: stat d2/d5/d22/d31/f45 0 2023-12-09T02:35:10.807 INFO:tasks.workunit.client.1.smithi161.stdout:8/264: chown d2/d5/d22/d31/d38/d48/f5a 2 1 2023-12-09T02:35:10.808 INFO:tasks.workunit.client.1.smithi161.stdout:5/290: dwrite d0/d2/d7/d11/f4c [0,4194304] 0 2023-12-09T02:35:10.808 INFO:tasks.workunit.client.1.smithi161.stdout:1/497: getdents d6/d8/d63/d4d 0 2023-12-09T02:35:10.808 INFO:tasks.workunit.client.1.smithi161.stdout:1/498: readlink d6/d8/d63/d4d/d31/d73/d47/l67 0 2023-12-09T02:35:10.808 INFO:tasks.workunit.client.1.smithi161.stdout:1/499: write d6/d9/d5c/f66 [1285702,121396] 0 2023-12-09T02:35:10.809 INFO:tasks.workunit.client.1.smithi161.stdout:8/265: mknod d2/d5/d22/d31/d38/d48/d4e/c5d 0 2023-12-09T02:35:10.810 INFO:tasks.workunit.client.1.smithi161.stdout:3/289: dwrite d2/d4/f18 [0,4194304] 0 2023-12-09T02:35:10.810 INFO:tasks.workunit.client.1.smithi161.stdout:3/290: getdents d2/d44 0 2023-12-09T02:35:10.810 INFO:tasks.workunit.client.1.smithi161.stdout:3/291: chown d2/d4/d11 4637236 1 2023-12-09T02:35:10.810 INFO:tasks.workunit.client.1.smithi161.stdout:3/292: truncate d2/d4/d11/d1f/d2a/d46/f29 1708448 0 2023-12-09T02:35:10.811 INFO:tasks.workunit.client.1.smithi161.stdout:7/413: dwrite d0/d3/f63 [0,4194304] 0 2023-12-09T02:35:10.811 INFO:tasks.workunit.client.1.smithi161.stdout:2/304: dwrite d4/d16/f26 [0,4194304] 0 2023-12-09T02:35:10.812 INFO:tasks.workunit.client.1.smithi161.stdout:5/291: symlink d0/d2/d7/d11/d61/l68 0 2023-12-09T02:35:10.814 INFO:tasks.workunit.client.1.smithi161.stdout:1/500: creat d6/d8/d63/d1c/d81/d9d/fa2 x:0 0 0 2023-12-09T02:35:10.816 INFO:tasks.workunit.client.1.smithi161.stdout:9/252: dwrite d2/da/d16/f36 [0,4194304] 0 2023-12-09T02:35:10.816 INFO:tasks.workunit.client.1.smithi161.stdout:6/234: dwrite da/f12 [0,4194304] 0 2023-12-09T02:35:10.816 INFO:tasks.workunit.client.1.smithi161.stdout:6/235: chown da/df/d2d/f32 24208395 1 2023-12-09T02:35:10.816 INFO:tasks.workunit.client.1.smithi161.stdout:6/236: chown da/d28/d4d 64282 1 2023-12-09T02:35:10.817 INFO:tasks.workunit.client.1.smithi161.stdout:6/237: write da/df/d2d/d3b/f42 [418588,29803] 0 2023-12-09T02:35:10.819 INFO:tasks.workunit.client.1.smithi161.stdout:0/326: dread d9/d1f/f49 [0,4194304] 0 2023-12-09T02:35:10.819 INFO:tasks.workunit.client.1.smithi161.stdout:0/327: stat d9/db 0 2023-12-09T02:35:10.820 INFO:tasks.workunit.client.1.smithi161.stdout:9/253: dread d2/da/f21 [0,4194304] 0 2023-12-09T02:35:10.820 INFO:tasks.workunit.client.1.smithi161.stdout:8/266: rmdir d2/d5/d3d 39 2023-12-09T02:35:10.822 INFO:tasks.workunit.client.1.smithi161.stdout:2/305: write d4/d1a/f3c [552946,127734] 0 2023-12-09T02:35:10.822 INFO:tasks.workunit.client.1.smithi161.stdout:2/306: stat d4/c2e 0 2023-12-09T02:35:10.824 INFO:tasks.workunit.client.1.smithi161.stdout:8/267: read d2/d5/d4f/f52 [1566565,49272] 0 2023-12-09T02:35:10.833 INFO:tasks.workunit.client.1.smithi161.stdout:7/414: truncate d0/fd 190262 0 2023-12-09T02:35:10.839 INFO:tasks.workunit.client.1.smithi161.stdout:5/292: rename d0/d2/d7/df/f31 to d0/f69 0 2023-12-09T02:35:10.840 INFO:tasks.workunit.client.1.smithi161.stdout:3/293: dwrite d2/d4/d11/d1f/d2a/f2b [0,4194304] 0 2023-12-09T02:35:10.841 INFO:tasks.workunit.client.1.smithi161.stdout:6/238: dwrite da/df/d2d/d3b/f42 [0,4194304] 0 2023-12-09T02:35:10.844 INFO:tasks.workunit.client.1.smithi161.stdout:1/501: creat d6/d9/d8b/fa3 x:0 0 0 2023-12-09T02:35:10.844 INFO:tasks.workunit.client.1.smithi161.stdout:1/502: fsync d6/d8/d63/d4d/f4c 0 2023-12-09T02:35:10.849 INFO:tasks.workunit.client.1.smithi161.stdout:0/328: symlink d9/db/d2a/d35/d4a/l5d 0 2023-12-09T02:35:10.850 INFO:tasks.workunit.client.1.smithi161.stdout:9/254: symlink d2/da/d16/d51/l54 0 2023-12-09T02:35:10.851 INFO:tasks.workunit.client.1.smithi161.stdout:2/307: symlink d4/d1a/d4a/d4f/l64 0 2023-12-09T02:35:10.851 INFO:tasks.workunit.client.1.smithi161.stdout:2/308: chown d4 88 1 2023-12-09T02:35:10.853 INFO:tasks.workunit.client.1.smithi161.stdout:8/268: symlink d2/d5/d22/d31/d38/d48/l5e 0 2023-12-09T02:35:10.856 INFO:tasks.workunit.client.1.smithi161.stdout:5/293: unlink d0/d9/c12 0 2023-12-09T02:35:10.856 INFO:tasks.workunit.client.1.smithi161.stdout:5/294: readlink d0/ld 0 2023-12-09T02:35:10.869 INFO:tasks.workunit.client.1.smithi161.stdout:0/329: dwrite d9/dd/d3a/f52 [0,4194304] 0 2023-12-09T02:35:10.869 INFO:tasks.workunit.client.1.smithi161.stdout:3/294: mkdir d2/d4/d11/d1f/d2a/d46/d2d/d4e 0 2023-12-09T02:35:10.873 INFO:tasks.workunit.client.1.smithi161.stdout:6/239: symlink da/d28/d29/d2b/l54 0 2023-12-09T02:35:10.874 INFO:tasks.workunit.client.1.smithi161.stdout:1/503: creat d6/d9/fa4 x:0 0 0 2023-12-09T02:35:10.879 INFO:tasks.workunit.client.1.smithi161.stdout:9/255: mkdir d2/da/d16/d2e/d48/d55 0 2023-12-09T02:35:10.880 INFO:tasks.workunit.client.1.smithi161.stdout:9/256: stat d2/da/d16/c1a 0 2023-12-09T02:35:10.884 INFO:tasks.workunit.client.1.smithi161.stdout:2/309: mknod d4/d7/d56/d5a/d60/c65 0 2023-12-09T02:35:10.891 INFO:tasks.workunit.client.1.smithi161.stdout:8/269: unlink d2/d5/d4f/f2e 0 2023-12-09T02:35:10.893 INFO:tasks.workunit.client.1.smithi161.stdout:2/310: dread d4/fa [0,4194304] 0 2023-12-09T02:35:10.893 INFO:tasks.workunit.client.1.smithi161.stdout:2/311: fdatasync d4/d1a/d4a/f4b 0 2023-12-09T02:35:10.893 INFO:tasks.workunit.client.1.smithi161.stdout:2/312: read - d4/d7/f4c zero size 2023-12-09T02:35:10.894 INFO:tasks.workunit.client.1.smithi161.stdout:5/295: creat d0/d9/f6a x:0 0 0 2023-12-09T02:35:10.895 INFO:tasks.workunit.client.1.smithi161.stdout:5/296: read d0/d2/d7/d11/f5d [366563,6183] 0 2023-12-09T02:35:10.895 INFO:tasks.workunit.client.1.smithi161.stdout:5/297: chown d0/d2/d7/c20 92988114 1 2023-12-09T02:35:10.895 INFO:tasks.workunit.client.1.smithi161.stdout:8/270: dread d2/f3 [0,4194304] 0 2023-12-09T02:35:10.895 INFO:tasks.workunit.client.1.smithi161.stdout:8/271: truncate d2/d5/d22/d31/d38/f4d 598516 0 2023-12-09T02:35:10.895 INFO:tasks.workunit.client.1.smithi161.stdout:8/272: fsync d2/d5/f40 0 2023-12-09T02:35:10.896 INFO:tasks.workunit.client.1.smithi161.stdout:8/273: write d2/f3 [1939719,110001] 0 2023-12-09T02:35:10.896 INFO:tasks.workunit.client.1.smithi161.stdout:4/380: sync 2023-12-09T02:35:10.900 INFO:tasks.workunit.client.1.smithi161.stdout:0/330: mknod d9/d55/d26/d28/d58/c5e 0 2023-12-09T02:35:10.903 INFO:tasks.workunit.client.1.smithi161.stdout:3/295: symlink d2/d4/d11/l4f 0 2023-12-09T02:35:10.939 INFO:tasks.workunit.client.1.smithi161.stdout:9/257: rename d2/f12 to d2/da/d16/d2e/d48/f56 0 2023-12-09T02:35:10.945 INFO:tasks.workunit.client.1.smithi161.stdout:2/313: getdents d4 0 2023-12-09T02:35:10.945 INFO:tasks.workunit.client.1.smithi161.stdout:2/314: dread - d4/d46/f5c zero size 2023-12-09T02:35:10.946 INFO:tasks.workunit.client.1.smithi161.stdout:5/298: creat d0/d2/d7/d51/f6b x:0 0 0 2023-12-09T02:35:10.949 INFO:tasks.workunit.client.1.smithi161.stdout:8/274: mknod d2/d5/d4f/c5f 0 2023-12-09T02:35:10.950 INFO:tasks.workunit.client.1.smithi161.stdout:4/381: mknod dd/d36/d3f/d54/c7b 0 2023-12-09T02:35:10.952 INFO:tasks.workunit.client.1.smithi161.stdout:0/331: getdents d9/d25 0 2023-12-09T02:35:10.953 INFO:tasks.workunit.client.1.smithi161.stdout:6/240: mkdir da/d55 0 2023-12-09T02:35:10.954 INFO:tasks.workunit.client.1.smithi161.stdout:0/332: dread d9/d25/f2d [0,4194304] 0 2023-12-09T02:35:10.957 INFO:tasks.workunit.client.1.smithi161.stdout:1/504: mknod d6/d8/d63/d93/ca5 0 2023-12-09T02:35:10.960 INFO:tasks.workunit.client.1.smithi161.stdout:9/258: rename d2/c3c to d2/da/d22/c57 0 2023-12-09T02:35:10.963 INFO:tasks.workunit.client.1.smithi161.stdout:2/315: mknod d4/d7/db/c66 0 2023-12-09T02:35:10.964 INFO:tasks.workunit.client.1.smithi161.stdout:6/241: getdents da/d28/d29/d2b 0 2023-12-09T02:35:10.965 INFO:tasks.workunit.client.1.smithi161.stdout:8/275: dwrite d2/d5/d22/d31/f37 [4194304,4194304] 0 2023-12-09T02:35:10.965 INFO:tasks.workunit.client.1.smithi161.stdout:8/276: chown d2/d5/d22/d31/d38/d48 40 1 2023-12-09T02:35:10.966 INFO:tasks.workunit.client.1.smithi161.stdout:0/333: mknod d9/d1f/c5f 0 2023-12-09T02:35:10.970 INFO:tasks.workunit.client.1.smithi161.stdout:9/259: unlink d2/da/d22/c2b 0 2023-12-09T02:35:10.970 INFO:tasks.workunit.client.1.smithi161.stdout:9/260: stat d2 0 2023-12-09T02:35:10.971 INFO:tasks.workunit.client.1.smithi161.stdout:2/316: creat d4/d7/db/f67 x:0 0 0 2023-12-09T02:35:10.974 INFO:tasks.workunit.client.1.smithi161.stdout:8/277: rename d2/c13 to d2/c60 0 2023-12-09T02:35:10.975 INFO:tasks.workunit.client.1.smithi161.stdout:0/334: rmdir d9/d25 39 2023-12-09T02:35:10.978 INFO:tasks.workunit.client.1.smithi161.stdout:5/299: rename d0/d2/de/d44/f49 to d0/d9/f6c 0 2023-12-09T02:35:10.978 INFO:tasks.workunit.client.1.smithi161.stdout:5/300: write d0/d9/f6a [173998,36894] 0 2023-12-09T02:35:10.980 INFO:tasks.workunit.client.1.smithi161.stdout:2/317: mknod d4/d7/db/c68 0 2023-12-09T02:35:10.983 INFO:tasks.workunit.client.1.smithi161.stdout:8/278: symlink d2/d5/d22/d54/l61 0 2023-12-09T02:35:10.984 INFO:tasks.workunit.client.1.smithi161.stdout:8/279: write d2/d5/d4f/f29 [488719,38259] 0 2023-12-09T02:35:10.986 INFO:tasks.workunit.client.1.smithi161.stdout:1/505: rename d6/d8/d63/d61/f91 to d6/d8/d63/d4d/d31/d73/d47/fa6 0 2023-12-09T02:35:10.987 INFO:tasks.workunit.client.1.smithi161.stdout:9/261: getdents d2/da/d22 0 2023-12-09T02:35:10.989 INFO:tasks.workunit.client.1.smithi161.stdout:5/301: symlink d0/d2/d5f/l6d 0 2023-12-09T02:35:10.989 INFO:tasks.workunit.client.1.smithi161.stdout:5/302: getdents d0/d2/d7/d11/d50 0 2023-12-09T02:35:10.990 INFO:tasks.workunit.client.1.smithi161.stdout:6/242: dwrite da/d28/d29/d2b/d31/f51 [0,4194304] 0 2023-12-09T02:35:10.990 INFO:tasks.workunit.client.1.smithi161.stdout:2/318: dread d4/d1a/f3e [0,4194304] 0 2023-12-09T02:35:10.990 INFO:tasks.workunit.client.1.smithi161.stdout:6/243: fsync da/d19/f23 0 2023-12-09T02:35:10.990 INFO:tasks.workunit.client.1.smithi161.stdout:2/319: write d4/d46/f54 [4467517,28303] 0 2023-12-09T02:35:10.990 INFO:tasks.workunit.client.1.smithi161.stdout:9/262: write d2/f15 [462241,2282] 0 2023-12-09T02:35:10.993 INFO:tasks.workunit.client.1.smithi161.stdout:0/335: dwrite d9/db/f3e [0,4194304] 0 2023-12-09T02:35:10.993 INFO:tasks.workunit.client.1.smithi161.stdout:8/280: mkdir d2/d5/d4f/d62 0 2023-12-09T02:35:10.995 INFO:tasks.workunit.client.1.smithi161.stdout:8/281: write d2/d5/d22/d31/f45 [3551106,38099] 0 2023-12-09T02:35:10.995 INFO:tasks.workunit.client.1.smithi161.stdout:8/282: chown d2/d5/d4f/f29 5738 1 2023-12-09T02:35:10.995 INFO:tasks.workunit.client.1.smithi161.stdout:8/283: chown d2/d5/d22/l28 110913061 1 2023-12-09T02:35:10.996 INFO:tasks.workunit.client.1.smithi161.stdout:5/303: creat d0/d2/d7/df/d60/f6e x:0 0 0 2023-12-09T02:35:10.998 INFO:tasks.workunit.client.1.smithi161.stdout:6/244: mknod da/df/c56 0 2023-12-09T02:35:10.999 INFO:tasks.workunit.client.1.smithi161.stdout:2/320: mkdir d4/d16/d69 0 2023-12-09T02:35:11.003 INFO:tasks.workunit.client.1.smithi161.stdout:9/263: rename d2/da to d2/d25/d31/d42/d58 0 2023-12-09T02:35:11.004 INFO:tasks.workunit.client.1.smithi161.stdout:8/284: dread d2/d5/d4f/f52 [0,4194304] 0 2023-12-09T02:35:11.004 INFO:tasks.workunit.client.1.smithi161.stdout:9/264: write d2/d25/d31/d42/d58/d16/f20 [4159238,127374] 0 2023-12-09T02:35:11.004 INFO:tasks.workunit.client.1.smithi161.stdout:9/265: truncate d2/f3e 791633 0 2023-12-09T02:35:11.006 INFO:tasks.workunit.client.1.smithi161.stdout:0/336: symlink d9/db/l60 0 2023-12-09T02:35:11.006 INFO:tasks.workunit.client.1.smithi161.stdout:0/337: dread - d9/d55/f51 zero size 2023-12-09T02:35:11.007 INFO:tasks.workunit.client.1.smithi161.stdout:0/338: write d9/d25/f2d [219935,26216] 0 2023-12-09T02:35:11.008 INFO:tasks.workunit.client.1.smithi161.stdout:1/506: mknod d6/d8/d63/d4d/d31/d73/d47/d5a/ca7 0 2023-12-09T02:35:11.008 INFO:tasks.workunit.client.1.smithi161.stdout:1/507: chown d6/d8/d68/l8e 525 1 2023-12-09T02:35:11.008 INFO:tasks.workunit.client.1.smithi161.stdout:1/508: chown d6/d8/d63/d4d/d31/d73/d47/d5a 550774 1 2023-12-09T02:35:11.008 INFO:tasks.workunit.client.1.smithi161.stdout:0/339: read d9/db/f3e [1906629,10321] 0 2023-12-09T02:35:11.010 INFO:tasks.workunit.client.1.smithi161.stdout:5/304: creat d0/d2/d7/df/d60/f6f x:0 0 0 2023-12-09T02:35:11.010 INFO:tasks.workunit.client.1.smithi161.stdout:5/305: stat d0/d2/de/d22/d55 0 2023-12-09T02:35:11.011 INFO:tasks.workunit.client.1.smithi161.stdout:5/306: fdatasync d0/d9/f6a 0 2023-12-09T02:35:11.011 INFO:tasks.workunit.client.1.smithi161.stdout:6/245: rmdir da/d28/d29/d2b 39 2023-12-09T02:35:11.012 INFO:tasks.workunit.client.1.smithi161.stdout:2/321: creat d4/d16/d69/f6a x:0 0 0 2023-12-09T02:35:11.019 INFO:tasks.workunit.client.1.smithi161.stdout:8/285: rmdir d2/d5 39 2023-12-09T02:35:11.022 INFO:tasks.workunit.client.1.smithi161.stdout:9/266: mknod d2/d25/d31/d42/d58/d16/d2e/d48/d55/c59 0 2023-12-09T02:35:11.024 INFO:tasks.workunit.client.1.smithi161.stdout:5/307: mkdir d0/d2/d7/d70 0 2023-12-09T02:35:11.025 INFO:tasks.workunit.client.1.smithi161.stdout:6/246: rmdir da/df/d2d 39 2023-12-09T02:35:11.027 INFO:tasks.workunit.client.1.smithi161.stdout:2/322: unlink d4/f44 0 2023-12-09T02:35:11.028 INFO:tasks.workunit.client.1.smithi161.stdout:8/286: rmdir d2/d5/d22/d31/d38/d48 39 2023-12-09T02:35:11.031 INFO:tasks.workunit.client.1.smithi161.stdout:1/509: symlink d6/d8/d63/d4d/d31/d73/d47/d5a/la8 0 2023-12-09T02:35:11.033 INFO:tasks.workunit.client.1.smithi161.stdout:0/340: rename d9/f11 to d9/dd/f61 0 2023-12-09T02:35:11.035 INFO:tasks.workunit.client.1.smithi161.stdout:5/308: link d0/d9/f6c d0/d2/d7/d51/f71 0 2023-12-09T02:35:11.035 INFO:tasks.workunit.client.1.smithi161.stdout:6/247: mkdir da/d28/d3c/d57 0 2023-12-09T02:35:11.037 INFO:tasks.workunit.client.1.smithi161.stdout:2/323: rmdir d4/d7/d56/d5a/d60 39 2023-12-09T02:35:11.037 INFO:tasks.workunit.client.1.smithi161.stdout:2/324: fdatasync d4/d46/f4e 0 2023-12-09T02:35:11.039 INFO:tasks.workunit.client.1.smithi161.stdout:1/510: symlink d6/d8/d63/d4d/d31/d80/d87/la9 0 2023-12-09T02:35:11.041 INFO:tasks.workunit.client.1.smithi161.stdout:5/309: rename d0/d9/c8 to d0/d2/d7/d70/c72 0 2023-12-09T02:35:11.042 INFO:tasks.workunit.client.1.smithi161.stdout:9/267: dwrite d2/d25/d31/d42/d58/d16/d2e/d48/f56 [0,4194304] 0 2023-12-09T02:35:11.042 INFO:tasks.workunit.client.1.smithi161.stdout:9/268: chown d2/f1b 15 1 2023-12-09T02:35:11.043 INFO:tasks.workunit.client.1.smithi161.stdout:6/248: dread da/d28/d29/d2b/d31/f35 [0,4194304] 0 2023-12-09T02:35:11.044 INFO:tasks.workunit.client.1.smithi161.stdout:2/325: creat d4/d7/d56/f6b x:0 0 0 2023-12-09T02:35:11.046 INFO:tasks.workunit.client.1.smithi161.stdout:2/326: write d4/d7/db/f10 [3176863,116331] 0 2023-12-09T02:35:11.046 INFO:tasks.workunit.client.1.smithi161.stdout:6/249: dread da/d19/f50 [0,4194304] 0 2023-12-09T02:35:11.048 INFO:tasks.workunit.client.1.smithi161.stdout:9/269: rename d2/d25/d31/d42/d58/l18 to d2/d25/d3a/l5a 0 2023-12-09T02:35:11.050 INFO:tasks.workunit.client.1.smithi161.stdout:2/327: mknod d4/d7/d56/d5a/c6c 0 2023-12-09T02:35:11.050 INFO:tasks.workunit.client.1.smithi161.stdout:6/250: read da/df/f3a [2438753,42119] 0 2023-12-09T02:35:11.052 INFO:tasks.workunit.client.1.smithi161.stdout:2/328: rename d4/d7/d56/d5a/d60 to d4/d1a/d4a/d6d 0 2023-12-09T02:35:11.056 INFO:tasks.workunit.client.1.smithi161.stdout:1/511: dwrite d6/d9/fa4 [0,4194304] 0 2023-12-09T02:35:11.057 INFO:tasks.workunit.client.1.smithi161.stdout:6/251: creat da/d28/d29/f58 x:0 0 0 2023-12-09T02:35:11.063 INFO:tasks.workunit.client.1.smithi161.stdout:1/512: rename d6/d8/d63/d4d/d31/d73/d47/d5a to d6/d8/d63/d35/daa 0 2023-12-09T02:35:11.065 INFO:tasks.workunit.client.1.smithi161.stdout:1/513: mkdir d6/d8/d63/d4d/d31/dab 0 2023-12-09T02:35:11.070 INFO:tasks.workunit.client.1.smithi161.stdout:9/270: dwrite d2/d25/d31/d42/d58/d16/f36 [0,4194304] 0 2023-12-09T02:35:11.071 INFO:tasks.workunit.client.1.smithi161.stdout:2/329: dwrite d4/d7/f13 [0,4194304] 0 2023-12-09T02:35:11.071 INFO:tasks.workunit.client.1.smithi161.stdout:9/271: mknod d2/d25/d31/c5b 0 2023-12-09T02:35:11.079 INFO:tasks.workunit.client.1.smithi161.stdout:2/330: symlink d4/l6e 0 2023-12-09T02:35:11.081 INFO:tasks.workunit.client.1.smithi161.stdout:9/272: rename d2/d25/d31/d42/d58/d16/d2e/d48 to d2/d25/d31/d5c 0 2023-12-09T02:35:11.083 INFO:tasks.workunit.client.1.smithi161.stdout:2/331: rename d4/d7/cf to d4/d16/c6f 0 2023-12-09T02:35:11.083 INFO:tasks.workunit.client.1.smithi161.stdout:9/273: mknod d2/d25/d31/d42/d58/c5d 0 2023-12-09T02:35:11.084 INFO:tasks.workunit.client.1.smithi161.stdout:9/274: truncate d2/d25/d31/d42/f4c 862009 0 2023-12-09T02:35:11.085 INFO:tasks.workunit.client.1.smithi161.stdout:2/332: link d4/d7/db/c23 d4/d7/d56/d63/c70 0 2023-12-09T02:35:11.085 INFO:tasks.workunit.client.1.smithi161.stdout:2/333: dread - d4/d1a/d4a/d4f/f57 zero size 2023-12-09T02:35:11.085 INFO:tasks.workunit.client.1.smithi161.stdout:2/334: write d4/d7/db/f67 [997286,76339] 0 2023-12-09T02:35:11.085 INFO:tasks.workunit.client.1.smithi161.stdout:9/275: symlink d2/d25/d31/d42/l5e 0 2023-12-09T02:35:11.087 INFO:tasks.workunit.client.1.smithi161.stdout:9/276: symlink d2/d25/d31/d42/d58/d16/d51/l5f 0 2023-12-09T02:35:11.087 INFO:tasks.workunit.client.1.smithi161.stdout:2/335: dread d4/f30 [0,4194304] 0 2023-12-09T02:35:11.088 INFO:tasks.workunit.client.1.smithi161.stdout:1/514: dwrite d6/d8/d63/d4d/d9f/fa0 [0,4194304] 0 2023-12-09T02:35:11.089 INFO:tasks.workunit.client.1.smithi161.stdout:6/252: dwrite da/f2c [0,4194304] 0 2023-12-09T02:35:11.091 INFO:tasks.workunit.client.1.smithi161.stdout:6/253: write da/f1a [502730,8466] 0 2023-12-09T02:35:11.091 INFO:tasks.workunit.client.1.smithi161.stdout:9/277: mkdir d2/d25/d31/d5c/d60 0 2023-12-09T02:35:11.091 INFO:tasks.workunit.client.1.smithi161.stdout:9/278: stat d2/d25/d31/f49 0 2023-12-09T02:35:11.092 INFO:tasks.workunit.client.1.smithi161.stdout:2/336: truncate d4/f25 52203 0 2023-12-09T02:35:11.102 INFO:tasks.workunit.client.1.smithi161.stdout:6/254: dread da/df/f14 [0,4194304] 0 2023-12-09T02:35:11.103 INFO:tasks.workunit.client.1.smithi161.stdout:9/279: rmdir d2/d25/d31/d42/d58/d22 39 2023-12-09T02:35:11.105 INFO:tasks.workunit.client.1.smithi161.stdout:2/337: rename d4/d1a/d4a/f4b to d4/d7/d56/d5a/f71 0 2023-12-09T02:35:11.106 INFO:tasks.workunit.client.1.smithi161.stdout:1/515: dwrite d6/d8/d63/d4d/d31/d73/d47/f7e [0,4194304] 0 2023-12-09T02:35:11.106 INFO:tasks.workunit.client.1.smithi161.stdout:9/280: getdents d2/d25/d31/d5c/d55 0 2023-12-09T02:35:11.109 INFO:tasks.workunit.client.1.smithi161.stdout:2/338: unlink d4/d16/f26 0 2023-12-09T02:35:11.113 INFO:tasks.workunit.client.1.smithi161.stdout:2/339: dread d4/d7/f2b [0,4194304] 0 2023-12-09T02:35:11.113 INFO:tasks.workunit.client.1.smithi161.stdout:1/516: creat d6/d49/fac x:0 0 0 2023-12-09T02:35:11.114 INFO:tasks.workunit.client.1.smithi161.stdout:1/517: read - d6/d8/d63/d4d/d31/d73/d47/fa6 zero size 2023-12-09T02:35:11.114 INFO:tasks.workunit.client.1.smithi161.stdout:1/518: stat d6/d8/d63/d35/d3d/l6f 0 2023-12-09T02:35:11.114 INFO:tasks.workunit.client.1.smithi161.stdout:1/519: readlink d6/d8/d63/d35/daa/la8 0 2023-12-09T02:35:11.114 INFO:tasks.workunit.client.1.smithi161.stdout:9/281: mkdir d2/d25/d31/d42/d58/d16/d2e/d3f/d61 0 2023-12-09T02:35:11.114 INFO:tasks.workunit.client.1.smithi161.stdout:9/282: fsync d2/d25/d31/f49 0 2023-12-09T02:35:11.115 INFO:tasks.workunit.client.1.smithi161.stdout:9/283: fdatasync d2/d25/d31/d42/d58/d16/f20 0 2023-12-09T02:35:11.115 INFO:tasks.workunit.client.1.smithi161.stdout:9/284: write d2/d25/d31/f49 [3378614,125970] 0 2023-12-09T02:35:11.117 INFO:tasks.workunit.client.1.smithi161.stdout:9/285: dread d2/f8 [0,4194304] 0 2023-12-09T02:35:11.117 INFO:tasks.workunit.client.1.smithi161.stdout:6/255: dwrite da/d19/f1e [4194304,4194304] 0 2023-12-09T02:35:11.118 INFO:tasks.workunit.client.1.smithi161.stdout:2/340: rename d4/c14 to d4/d1a/d4a/d4f/c72 0 2023-12-09T02:35:11.121 INFO:tasks.workunit.client.1.smithi161.stdout:6/256: read da/f12 [3873138,43483] 0 2023-12-09T02:35:11.122 INFO:tasks.workunit.client.1.smithi161.stdout:9/286: getdents d2/d25 0 2023-12-09T02:35:11.122 INFO:tasks.workunit.client.1.smithi161.stdout:9/287: chown d2/l41 58904 1 2023-12-09T02:35:11.122 INFO:tasks.workunit.client.1.smithi161.stdout:6/257: write da/df/f13 [5942329,116679] 0 2023-12-09T02:35:11.128 INFO:tasks.workunit.client.1.smithi161.stdout:2/341: dread f1 [0,4194304] 0 2023-12-09T02:35:11.138 INFO:tasks.workunit.client.1.smithi161.stdout:6/258: dwrite da/d28/d29/d2b/d31/d33/f3e [0,4194304] 0 2023-12-09T02:35:11.146 INFO:tasks.workunit.client.1.smithi161.stdout:6/259: dread da/f2c [0,4194304] 0 2023-12-09T02:35:11.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:10 smithi161 ceph-mon[121170]: pgmap v203: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 83 MiB/s rd, 183 MiB/s wr, 364 op/s 2023-12-09T02:35:11.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:10 smithi161 ceph-mon[121170]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:11.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:10 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2556712233' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:35:11.183 INFO:tasks.workunit.client.1.smithi161.stdout:9/288: link d2/d25/d31/d42/d58/l2a d2/d25/d31/d42/d58/d16/l62 0 2023-12-09T02:35:11.184 INFO:tasks.workunit.client.1.smithi161.stdout:9/289: dread d2/d25/d31/d42/d58/d16/f30 [0,4194304] 0 2023-12-09T02:35:11.184 INFO:tasks.workunit.client.1.smithi161.stdout:9/290: readlink d2/d25/d31/d42/l5e 0 2023-12-09T02:35:11.185 INFO:tasks.workunit.client.1.smithi161.stdout:2/342: creat d4/d1a/d4a/d4f/f73 x:0 0 0 2023-12-09T02:35:11.185 INFO:tasks.workunit.client.1.smithi161.stdout:1/520: truncate d6/d8/d63/d4d/d31/d73/d47/f7e 3114884 0 2023-12-09T02:35:11.189 INFO:tasks.workunit.client.1.smithi161.stdout:6/260: mknod da/d28/d29/c59 0 2023-12-09T02:35:11.194 INFO:tasks.workunit.client.1.smithi161.stdout:9/291: mkdir d2/d25/d31/d63 0 2023-12-09T02:35:11.194 INFO:tasks.workunit.client.1.smithi161.stdout:9/292: write d2/d25/d31/d42/d58/f10 [8547996,84854] 0 2023-12-09T02:35:11.198 INFO:tasks.workunit.client.1.smithi161.stdout:2/343: link d4/d7/db/c3b d4/d1a/d4a/c74 0 2023-12-09T02:35:11.198 INFO:tasks.workunit.client.1.smithi161.stdout:2/344: chown d4/d1a/c1c 1997698 1 2023-12-09T02:35:11.198 INFO:tasks.workunit.client.1.smithi161.stdout:2/345: readlink d4/d1a/l21 0 2023-12-09T02:35:11.198 INFO:tasks.workunit.client.1.smithi161.stdout:2/346: chown d4/d1a/d4a/d4f/c72 231302364 1 2023-12-09T02:35:11.199 INFO:tasks.workunit.client.1.smithi161.stdout:1/521: truncate d6/d8/d63/d1c/f41 1641275 0 2023-12-09T02:35:11.204 INFO:tasks.workunit.client.1.smithi161.stdout:1/522: symlink d6/d8/d63/d35/daa/lad 0 2023-12-09T02:35:11.204 INFO:tasks.workunit.client.1.smithi161.stdout:1/523: dread - d6/d8/d63/d1c/d81/d9d/fa2 zero size 2023-12-09T02:35:11.205 INFO:tasks.workunit.client.1.smithi161.stdout:6/261: dwrite da/df/d2d/f32 [0,4194304] 0 2023-12-09T02:35:11.205 INFO:tasks.workunit.client.1.smithi161.stdout:6/262: chown da/d28/d3c/d46 116 1 2023-12-09T02:35:11.208 INFO:tasks.workunit.client.1.smithi161.stdout:9/293: dread d2/d25/d31/d42/d58/d16/f36 [0,4194304] 0 2023-12-09T02:35:11.208 INFO:tasks.workunit.client.1.smithi161.stdout:9/294: read - d2/f47 zero size 2023-12-09T02:35:11.208 INFO:tasks.workunit.client.1.smithi161.stdout:9/295: write d2/f32 [917406,10112] 0 2023-12-09T02:35:11.209 INFO:tasks.workunit.client.1.smithi161.stdout:1/524: creat d6/d8/d63/d1c/d8a/fae x:0 0 0 2023-12-09T02:35:11.209 INFO:tasks.workunit.client.1.smithi161.stdout:1/525: fdatasync d6/d9/d8b/fa3 0 2023-12-09T02:35:11.209 INFO:tasks.workunit.client.1.smithi161.stdout:1/526: chown d6/d8/d63/d4d/d9f 121102 1 2023-12-09T02:35:11.209 INFO:tasks.workunit.client.1.smithi161.stdout:1/527: write d6/d8/d63/d1c/d8a/fae [120659,110217] 0 2023-12-09T02:35:11.209 INFO:tasks.workunit.client.1.smithi161.stdout:2/347: dread d4/d1a/f1b [0,4194304] 0 2023-12-09T02:35:11.210 INFO:tasks.workunit.client.1.smithi161.stdout:2/348: write d4/d7/db/f55 [951362,6657] 0 2023-12-09T02:35:11.210 INFO:tasks.workunit.client.1.smithi161.stdout:9/296: write d2/f8 [154748,51423] 0 2023-12-09T02:35:11.210 INFO:tasks.workunit.client.1.smithi161.stdout:9/297: write d2/d25/d31/d42/d58/d16/d2e/f40 [5137093,84801] 0 2023-12-09T02:35:11.212 INFO:tasks.workunit.client.1.smithi161.stdout:7/415: sync 2023-12-09T02:35:11.212 INFO:tasks.workunit.client.1.smithi161.stdout:7/416: stat d0/d29/d59/c87 0 2023-12-09T02:35:11.212 INFO:tasks.workunit.client.1.smithi161.stdout:7/417: dread - d0/d3/d13/d2d/d43/d4b/f75 zero size 2023-12-09T02:35:11.216 INFO:tasks.workunit.client.1.smithi161.stdout:6/263: symlink da/d28/d3c/d46/l5a 0 2023-12-09T02:35:11.218 INFO:tasks.workunit.client.1.smithi161.stdout:1/528: creat d6/d9/faf x:0 0 0 2023-12-09T02:35:11.219 INFO:tasks.workunit.client.1.smithi161.stdout:2/349: creat d4/d1a/d4a/d4f/f75 x:0 0 0 2023-12-09T02:35:11.219 INFO:tasks.workunit.client.1.smithi161.stdout:2/350: truncate d4/d1a/f47 474095 0 2023-12-09T02:35:11.220 INFO:tasks.workunit.client.1.smithi161.stdout:9/298: link d2/c6 d2/d25/d31/d5c/c64 0 2023-12-09T02:35:11.224 INFO:tasks.workunit.client.1.smithi161.stdout:9/299: dread d2/d25/d31/d42/d58/d16/f36 [0,4194304] 0 2023-12-09T02:35:11.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:10 smithi088 ceph-mon[112028]: pgmap v203: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 83 MiB/s rd, 183 MiB/s wr, 364 op/s 2023-12-09T02:35:11.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:10 smithi088 ceph-mon[112028]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:11.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:10 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2556712233' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:35:11.229 INFO:tasks.workunit.client.1.smithi161.stdout:7/418: rename d0/d3/d13/d2d/d43/c74 to d0/d3/d13/d4e/c88 0 2023-12-09T02:35:11.229 INFO:tasks.workunit.client.1.smithi161.stdout:7/419: fdatasync d0/d3/d21/f3b 0 2023-12-09T02:35:11.232 INFO:tasks.workunit.client.1.smithi161.stdout:1/529: symlink d6/d8/d63/d4d/d31/d73/lb0 0 2023-12-09T02:35:11.235 INFO:tasks.workunit.client.1.smithi161.stdout:2/351: creat d4/d7/db/f76 x:0 0 0 2023-12-09T02:35:11.239 INFO:tasks.workunit.client.1.smithi161.stdout:6/264: rename da/df/f2f to da/d28/d29/d2b/d31/d33/f5b 0 2023-12-09T02:35:11.239 INFO:tasks.workunit.client.1.smithi161.stdout:6/265: write da/d28/d29/f58 [871676,79671] 0 2023-12-09T02:35:11.242 INFO:tasks.workunit.client.1.smithi161.stdout:9/300: rename d2/d25/d31 to d2/d25/d3a/d65 0 2023-12-09T02:35:11.242 INFO:tasks.workunit.client.1.smithi161.stdout:9/301: write d2/d25/d3a/d65/d42/d58/f27 [4586773,33153] 0 2023-12-09T02:35:11.242 INFO:tasks.workunit.client.1.smithi161.stdout:9/302: truncate d2/d25/d3a/d65/d5c/f56 5469313 0 2023-12-09T02:35:11.245 INFO:tasks.workunit.client.1.smithi161.stdout:6/266: creat da/d28/d3c/d57/f5c x:0 0 0 2023-12-09T02:35:11.250 INFO:tasks.workunit.client.1.smithi161.stdout:2/352: rename d4/d16/f5b to d4/d7/d56/f77 0 2023-12-09T02:35:11.250 INFO:tasks.workunit.client.1.smithi161.stdout:9/303: truncate d2/d25/d3a/d65/d42/d58/d16/f36 1594298 0 2023-12-09T02:35:11.251 INFO:tasks.workunit.client.1.smithi161.stdout:3/296: sync 2023-12-09T02:35:11.251 INFO:tasks.workunit.client.1.smithi161.stdout:4/382: sync 2023-12-09T02:35:11.252 INFO:tasks.workunit.client.1.smithi161.stdout:2/353: link d4/d7/d56/d5a/c6c d4/d7/d56/d63/c78 0 2023-12-09T02:35:11.252 INFO:tasks.workunit.client.1.smithi161.stdout:7/420: dwrite d0/d3/d13/f18 [0,4194304] 0 2023-12-09T02:35:11.253 INFO:tasks.workunit.client.1.smithi161.stdout:3/297: mkdir d2/d4/d50 0 2023-12-09T02:35:11.254 INFO:tasks.workunit.client.1.smithi161.stdout:1/530: dwrite d6/f59 [0,4194304] 0 2023-12-09T02:35:11.262 INFO:tasks.workunit.client.1.smithi161.stdout:2/354: dread d4/f17 [0,4194304] 0 2023-12-09T02:35:11.263 INFO:tasks.workunit.client.1.smithi161.stdout:6/267: dwrite da/d19/f23 [4194304,4194304] 0 2023-12-09T02:35:11.298 INFO:tasks.workunit.client.1.smithi161.stdout:7/421: unlink d0/d3/d13/d2d/f35 0 2023-12-09T02:35:11.299 INFO:tasks.workunit.client.1.smithi161.stdout:7/422: dread d0/d3/d13/d1b/f3f [0,4194304] 0 2023-12-09T02:35:11.299 INFO:tasks.workunit.client.1.smithi161.stdout:7/423: getdents d0/d3/d13/d4e/d70 0 2023-12-09T02:35:11.299 INFO:tasks.workunit.client.1.smithi161.stdout:3/298: mkdir d2/d51 0 2023-12-09T02:35:11.305 INFO:tasks.workunit.client.1.smithi161.stdout:1/531: symlink d6/d8/d63/d4d/d31/d80/d87/lb1 0 2023-12-09T02:35:11.310 INFO:tasks.workunit.client.1.smithi161.stdout:2/355: rename d4/d7/d56 to d4/d7/d79 0 2023-12-09T02:35:11.312 INFO:tasks.workunit.client.1.smithi161.stdout:1/532: dread d6/d8/d63/d4d/d31/d80/d87/f8c [0,4194304] 0 2023-12-09T02:35:11.316 INFO:tasks.workunit.client.1.smithi161.stdout:6/268: getdents da/df/d2d 0 2023-12-09T02:35:11.317 INFO:tasks.workunit.client.1.smithi161.stdout:6/269: write da/df/f13 [4044719,14439] 0 2023-12-09T02:35:11.321 INFO:tasks.workunit.client.1.smithi161.stdout:7/424: link d0/d3/f7 d0/d3/d13/f89 0 2023-12-09T02:35:11.322 INFO:tasks.workunit.client.1.smithi161.stdout:3/299: mknod d2/d4/d11/d1f/d2a/d46/c52 0 2023-12-09T02:35:11.326 INFO:tasks.workunit.client.1.smithi161.stdout:1/533: mkdir d6/d8/d63/d4d/d31/d73/d47/db2 0 2023-12-09T02:35:11.329 INFO:tasks.workunit.client.1.smithi161.stdout:8/287: sync 2023-12-09T02:35:11.329 INFO:tasks.workunit.client.1.smithi161.stdout:0/341: sync 2023-12-09T02:35:11.329 INFO:tasks.workunit.client.1.smithi161.stdout:6/270: mknod da/df/d2d/c5d 0 2023-12-09T02:35:11.330 INFO:tasks.workunit.client.1.smithi161.stdout:7/425: creat d0/d3/d13/d2f/d50/f8a x:0 0 0 2023-12-09T02:35:11.331 INFO:tasks.workunit.client.1.smithi161.stdout:2/356: link d4/d46/f5c d4/d1a/d4a/d6d/f7a 0 2023-12-09T02:35:11.332 INFO:tasks.workunit.client.1.smithi161.stdout:1/534: creat d6/d9/d5c/fb3 x:0 0 0 2023-12-09T02:35:11.333 INFO:tasks.workunit.client.1.smithi161.stdout:0/342: creat d9/f62 x:0 0 0 2023-12-09T02:35:11.334 INFO:tasks.workunit.client.1.smithi161.stdout:8/288: creat d2/f63 x:0 0 0 2023-12-09T02:35:11.334 INFO:tasks.workunit.client.1.smithi161.stdout:8/289: chown d2/d5/d22/d54/l61 162474 1 2023-12-09T02:35:11.336 INFO:tasks.workunit.client.1.smithi161.stdout:6/271: mkdir da/d28/d4d/d5e 0 2023-12-09T02:35:11.338 INFO:tasks.workunit.client.1.smithi161.stdout:7/426: symlink d0/d3/d13/d2d/d43/d4b/d5a/d6f/d83/l8b 0 2023-12-09T02:35:11.338 INFO:tasks.workunit.client.1.smithi161.stdout:7/427: dread - d0/d3/d13/d2f/f77 zero size 2023-12-09T02:35:11.341 INFO:tasks.workunit.client.1.smithi161.stdout:1/535: creat d6/d8/d63/d4d/d31/d73/d47/fb4 x:0 0 0 2023-12-09T02:35:11.342 INFO:tasks.workunit.client.1.smithi161.stdout:0/343: creat d9/db/d2a/d35/d4a/f63 x:0 0 0 2023-12-09T02:35:11.342 INFO:tasks.workunit.client.1.smithi161.stdout:3/300: dwrite d2/f15 [0,4194304] 0 2023-12-09T02:35:11.343 INFO:tasks.workunit.client.1.smithi161.stdout:8/290: mknod d2/d5/d22/d54/c64 0 2023-12-09T02:35:11.343 INFO:tasks.workunit.client.1.smithi161.stdout:3/301: write d2/d4/d11/f32 [492883,48378] 0 2023-12-09T02:35:11.344 INFO:tasks.workunit.client.1.smithi161.stdout:6/272: creat da/d55/f5f x:0 0 0 2023-12-09T02:35:11.345 INFO:tasks.workunit.client.1.smithi161.stdout:3/302: read d2/d4/f5 [2713130,111893] 0 2023-12-09T02:35:11.345 INFO:tasks.workunit.client.1.smithi161.stdout:6/273: write da/df/f3a [4820443,120091] 0 2023-12-09T02:35:11.346 INFO:tasks.workunit.client.1.smithi161.stdout:7/428: creat d0/d3/d13/d2d/d6e/f8c x:0 0 0 2023-12-09T02:35:11.347 INFO:tasks.workunit.client.1.smithi161.stdout:7/429: write d0/d3/d13/d2d/d43/d4a/f10 [2173510,40464] 0 2023-12-09T02:35:11.347 INFO:tasks.workunit.client.1.smithi161.stdout:2/357: rename d4/d46 to d4/d16/d69/d7b 0 2023-12-09T02:35:11.351 INFO:tasks.workunit.client.1.smithi161.stdout:8/291: unlink d2/d5/d22/d31/l42 0 2023-12-09T02:35:11.353 INFO:tasks.workunit.client.1.smithi161.stdout:3/303: link d2/d4/lc d2/d4/d11/d1f/d2a/d46/d2d/d47/l53 0 2023-12-09T02:35:11.355 INFO:tasks.workunit.client.1.smithi161.stdout:6/274: unlink da/d19/d20/c34 0 2023-12-09T02:35:11.355 INFO:tasks.workunit.client.1.smithi161.stdout:6/275: readlink da/d28/d29/d2b/l54 0 2023-12-09T02:35:11.372 INFO:tasks.workunit.client.1.smithi161.stdout:7/430: dwrite d0/d3/f7 [0,4194304] 0 2023-12-09T02:35:11.432 INFO:tasks.workunit.client.1.smithi161.stdout:1/536: rename d6/f59 to d6/d8/d63/d1c/d81/fb5 0 2023-12-09T02:35:11.432 INFO:tasks.workunit.client.1.smithi161.stdout:0/344: rmdir d9 39 2023-12-09T02:35:11.433 INFO:tasks.workunit.client.1.smithi161.stdout:2/358: mknod d4/d7/d79/c7c 0 2023-12-09T02:35:11.435 INFO:tasks.workunit.client.1.smithi161.stdout:8/292: creat d2/d5/d22/d31/f65 x:0 0 0 2023-12-09T02:35:11.435 INFO:tasks.workunit.client.1.smithi161.stdout:8/293: write d2/d5/d22/d31/d38/d48/f5a [240926,83115] 0 2023-12-09T02:35:11.435 INFO:tasks.workunit.client.1.smithi161.stdout:8/294: write d2/d5/d4f/f29 [372866,89510] 0 2023-12-09T02:35:11.435 INFO:tasks.workunit.client.1.smithi161.stdout:8/295: chown d2/d5/l50 1390 1 2023-12-09T02:35:11.435 INFO:tasks.workunit.client.1.smithi161.stdout:8/296: fsync d2/d5/f40 0 2023-12-09T02:35:11.436 INFO:tasks.workunit.client.1.smithi161.stdout:8/297: write d2/d5/d4f/f2a [218302,48960] 0 2023-12-09T02:35:11.470 INFO:tasks.workunit.client.1.smithi161.stdout:0/345: dwrite d9/db/f3e [0,4194304] 0 2023-12-09T02:35:11.470 INFO:tasks.workunit.client.1.smithi161.stdout:0/346: fsync d9/dd/f61 0 2023-12-09T02:35:11.470 INFO:tasks.workunit.client.1.smithi161.stdout:0/347: write d9/dd/f53 [296226,8925] 0 2023-12-09T02:35:11.475 INFO:tasks.workunit.client.1.smithi161.stdout:3/304: rename d2/d4/d11/d19/f3a to d2/d4/d11/d1f/d2a/d46/f54 0 2023-12-09T02:35:11.477 INFO:tasks.workunit.client.1.smithi161.stdout:1/537: rmdir d6/d9/d8b 39 2023-12-09T02:35:11.478 INFO:tasks.workunit.client.1.smithi161.stdout:3/305: dread d2/d4/d11/d1f/d2a/d46/f29 [0,4194304] 0 2023-12-09T02:35:11.478 INFO:tasks.workunit.client.1.smithi161.stdout:3/306: chown d2/d4/c9 7628294 1 2023-12-09T02:35:11.479 INFO:tasks.workunit.client.1.smithi161.stdout:2/359: creat d4/f7d x:0 0 0 2023-12-09T02:35:11.479 INFO:tasks.workunit.client.1.smithi161.stdout:2/360: chown d4/f17 1140 1 2023-12-09T02:35:11.480 INFO:tasks.workunit.client.1.smithi161.stdout:8/298: rmdir d2/d5/d4f 39 2023-12-09T02:35:11.480 INFO:tasks.workunit.client.1.smithi161.stdout:3/307: dread d2/d4/d11/d1f/d2a/d46/f29 [0,4194304] 0 2023-12-09T02:35:11.483 INFO:tasks.workunit.client.1.smithi161.stdout:6/276: dwrite da/fc [0,4194304] 0 2023-12-09T02:35:11.491 INFO:tasks.workunit.client.1.smithi161.stdout:0/348: rename d9/dd/c48 to d9/db/d2a/d35/d4a/c64 0 2023-12-09T02:35:11.491 INFO:tasks.workunit.client.1.smithi161.stdout:0/349: write d9/d55/d26/f4d [871891,129610] 0 2023-12-09T02:35:11.492 INFO:tasks.workunit.client.1.smithi161.stdout:1/538: read d6/d8/d63/d93/f48 [684864,109952] 0 2023-12-09T02:35:11.493 INFO:tasks.workunit.client.1.smithi161.stdout:2/361: creat d4/d7/db/f7e x:0 0 0 2023-12-09T02:35:11.495 INFO:tasks.workunit.client.1.smithi161.stdout:2/362: write d4/d7/db/f24 [432650,48031] 0 2023-12-09T02:35:11.495 INFO:tasks.workunit.client.1.smithi161.stdout:3/308: symlink d2/d4/d11/d1f/d2a/d46/d2d/d4e/l55 0 2023-12-09T02:35:11.495 INFO:tasks.workunit.client.1.smithi161.stdout:1/539: write d6/d8/d63/d1c/f69 [100055,51498] 0 2023-12-09T02:35:11.496 INFO:tasks.workunit.client.1.smithi161.stdout:1/540: chown d6/d9/d8b/fa3 63 1 2023-12-09T02:35:11.496 INFO:tasks.workunit.client.1.smithi161.stdout:1/541: read d6/d8/d63/d4d/f88 [1366202,47566] 0 2023-12-09T02:35:11.499 INFO:tasks.workunit.client.1.smithi161.stdout:0/350: rename d9/dd/l3f to d9/d55/d44/l65 0 2023-12-09T02:35:11.502 INFO:tasks.workunit.client.1.smithi161.stdout:8/299: dwrite d2/d5/d22/d31/d38/f59 [0,4194304] 0 2023-12-09T02:35:11.502 INFO:tasks.workunit.client.1.smithi161.stdout:2/363: link d4/d1a/c1c d4/d16/d69/c7f 0 2023-12-09T02:35:11.502 INFO:tasks.workunit.client.1.smithi161.stdout:2/364: fsync d4/d7/db/f19 0 2023-12-09T02:35:11.502 INFO:tasks.workunit.client.1.smithi161.stdout:2/365: dread - d4/f41 zero size 2023-12-09T02:35:11.504 INFO:tasks.workunit.client.1.smithi161.stdout:3/309: creat d2/d4/d11/d1f/d2a/d46/d2d/d47/f56 x:0 0 0 2023-12-09T02:35:11.508 INFO:tasks.workunit.client.1.smithi161.stdout:0/351: link d9/dd/d3a/l41 d9/db/d2a/d35/l66 0 2023-12-09T02:35:11.508 INFO:tasks.workunit.client.1.smithi161.stdout:6/277: dwrite da/d28/d29/d2b/d31/d33/f5b [4194304,4194304] 0 2023-12-09T02:35:11.508 INFO:tasks.workunit.client.1.smithi161.stdout:1/542: dread d6/d8/d63/d1c/d81/fb5 [0,4194304] 0 2023-12-09T02:35:11.510 INFO:tasks.workunit.client.1.smithi161.stdout:8/300: getdents d2/d5 0 2023-12-09T02:35:11.512 INFO:tasks.workunit.client.1.smithi161.stdout:2/366: symlink d4/d16/d69/l80 0 2023-12-09T02:35:11.512 INFO:tasks.workunit.client.1.smithi161.stdout:2/367: dread - d4/f7d zero size 2023-12-09T02:35:11.515 INFO:tasks.workunit.client.1.smithi161.stdout:3/310: truncate d2/fe 2891615 0 2023-12-09T02:35:11.525 INFO:tasks.workunit.client.1.smithi161.stdout:0/352: link d9/db/d2a/d35/d4a/f63 d9/d55/d26/d28/d58/f67 0 2023-12-09T02:35:11.526 INFO:tasks.workunit.client.1.smithi161.stdout:6/278: mkdir da/d19/d20/d60 0 2023-12-09T02:35:11.528 INFO:tasks.workunit.client.1.smithi161.stdout:1/543: rename d6/d8/d63/d4d/f2f to d6/d8/d63/d4d/d31/d80/fb6 0 2023-12-09T02:35:11.530 INFO:tasks.workunit.client.1.smithi161.stdout:5/310: sync 2023-12-09T02:35:11.531 INFO:tasks.workunit.client.1.smithi161.stdout:8/301: mkdir d2/d5/d22/d31/d38/d66 0 2023-12-09T02:35:11.532 INFO:tasks.workunit.client.1.smithi161.stdout:8/302: write d2/d5/d22/d31/d38/f3b [302159,116347] 0 2023-12-09T02:35:11.533 INFO:tasks.workunit.client.1.smithi161.stdout:5/311: write d0/d2/de/d22/f32 [3103817,14924] 0 2023-12-09T02:35:11.533 INFO:tasks.workunit.client.1.smithi161.stdout:5/312: dread - d0/d1f/f42 zero size 2023-12-09T02:35:11.533 INFO:tasks.workunit.client.1.smithi161.stdout:5/313: write d0/d2/d7/d11/f41 [1240632,21652] 0 2023-12-09T02:35:11.533 INFO:tasks.workunit.client.1.smithi161.stdout:5/314: fdatasync d0/d2/d7/d11/f37 0 2023-12-09T02:35:11.534 INFO:tasks.workunit.client.1.smithi161.stdout:2/368: unlink d4/d1a/f1b 0 2023-12-09T02:35:11.534 INFO:tasks.workunit.client.1.smithi161.stdout:2/369: chown d4/d7/db/c28 1 1 2023-12-09T02:35:11.536 INFO:tasks.workunit.client.1.smithi161.stdout:3/311: rmdir d2/d4/d11/d1f 39 2023-12-09T02:35:11.536 INFO:tasks.workunit.client.1.smithi161.stdout:3/312: dread - d2/d4/d11/d1f/d2a/d46/d2d/d47/f56 zero size 2023-12-09T02:35:11.544 INFO:tasks.workunit.client.1.smithi161.stdout:0/353: creat d9/d55/d26/d28/f68 x:0 0 0 2023-12-09T02:35:11.546 INFO:tasks.workunit.client.1.smithi161.stdout:6/279: unlink da/f15 0 2023-12-09T02:35:11.548 INFO:tasks.workunit.client.1.smithi161.stdout:8/303: mknod d2/c67 0 2023-12-09T02:35:11.548 INFO:tasks.workunit.client.1.smithi161.stdout:8/304: getdents d2/d5/d4f/d62 0 2023-12-09T02:35:11.548 INFO:tasks.workunit.client.1.smithi161.stdout:2/370: dwrite d4/d7/db/f2f [0,4194304] 0 2023-12-09T02:35:11.553 INFO:tasks.workunit.client.1.smithi161.stdout:5/315: creat d0/d2/de/d21/f73 x:0 0 0 2023-12-09T02:35:11.553 INFO:tasks.workunit.client.1.smithi161.stdout:5/316: chown d0/l36 0 1 2023-12-09T02:35:11.555 INFO:tasks.workunit.client.1.smithi161.stdout:3/313: creat d2/d4/d11/d1f/d2a/d46/f57 x:0 0 0 2023-12-09T02:35:11.555 INFO:tasks.workunit.client.1.smithi161.stdout:3/314: fsync d2/d4/f36 0 2023-12-09T02:35:11.556 INFO:tasks.workunit.client.1.smithi161.stdout:0/354: rename d9/db/l24 to d9/d25/l69 0 2023-12-09T02:35:11.558 INFO:tasks.workunit.client.1.smithi161.stdout:8/305: creat d2/d5/d22/d31/d38/d66/f68 x:0 0 0 2023-12-09T02:35:11.561 INFO:tasks.workunit.client.1.smithi161.stdout:2/371: truncate d4/d7/db/f1d 1328976 0 2023-12-09T02:35:11.569 INFO:tasks.workunit.client.1.smithi161.stdout:3/315: unlink d2/d4/f27 0 2023-12-09T02:35:11.569 INFO:tasks.workunit.client.1.smithi161.stdout:0/355: dwrite d9/d25/f2b [4194304,4194304] 0 2023-12-09T02:35:11.571 INFO:tasks.workunit.client.1.smithi161.stdout:5/317: rename d0/d2/c17 to d0/d9/c74 0 2023-12-09T02:35:11.571 INFO:tasks.workunit.client.1.smithi161.stdout:9/304: sync 2023-12-09T02:35:11.572 INFO:tasks.workunit.client.1.smithi161.stdout:8/306: unlink d2/d5/d22/l28 0 2023-12-09T02:35:11.573 INFO:tasks.workunit.client.1.smithi161.stdout:0/356: creat d9/d55/f6a x:0 0 0 2023-12-09T02:35:11.576 INFO:tasks.workunit.client.1.smithi161.stdout:9/305: mkdir d2/d25/d3a/d65/d5c/d55/d66 0 2023-12-09T02:35:11.578 INFO:tasks.workunit.client.1.smithi161.stdout:8/307: creat d2/d5/d22/d31/d38/d48/f69 x:0 0 0 2023-12-09T02:35:11.580 INFO:tasks.workunit.client.1.smithi161.stdout:0/357: creat d9/d25/f6b x:0 0 0 2023-12-09T02:35:11.580 INFO:tasks.workunit.client.1.smithi161.stdout:0/358: fdatasync d9/db/d2a/f59 0 2023-12-09T02:35:11.580 INFO:tasks.workunit.client.1.smithi161.stdout:8/308: dread d2/d5/d4f/f2a [0,4194304] 0 2023-12-09T02:35:11.580 INFO:tasks.workunit.client.1.smithi161.stdout:8/309: write d2/d5/d22/d31/d38/d48/f69 [537694,50865] 0 2023-12-09T02:35:11.580 INFO:tasks.workunit.client.1.smithi161.stdout:8/310: readlink d2/l21 0 2023-12-09T02:35:11.580 INFO:tasks.workunit.client.1.smithi161.stdout:8/311: chown d2 3990 1 2023-12-09T02:35:11.582 INFO:tasks.workunit.client.1.smithi161.stdout:8/312: getdents d2/d2d 0 2023-12-09T02:35:11.582 INFO:tasks.workunit.client.1.smithi161.stdout:8/313: write d2/d5/d22/f4c [5011480,99642] 0 2023-12-09T02:35:11.583 INFO:tasks.workunit.client.1.smithi161.stdout:3/316: dread d2/d4/d11/f14 [0,4194304] 0 2023-12-09T02:35:11.583 INFO:tasks.workunit.client.1.smithi161.stdout:3/317: fsync d2/f15 0 2023-12-09T02:35:11.583 INFO:tasks.workunit.client.1.smithi161.stdout:3/318: readlink d2/d4/d11/d1f/l4a 0 2023-12-09T02:35:11.583 INFO:tasks.workunit.client.1.smithi161.stdout:3/319: truncate d2/d4/d11/f32 2181957 0 2023-12-09T02:35:11.584 INFO:tasks.workunit.client.1.smithi161.stdout:2/372: dwrite d4/d7/fc [0,4194304] 0 2023-12-09T02:35:11.584 INFO:tasks.workunit.client.1.smithi161.stdout:2/373: write d4/d7/db/f76 [204712,52520] 0 2023-12-09T02:35:11.584 INFO:tasks.workunit.client.1.smithi161.stdout:8/314: dread d2/d5/d22/d31/d38/f4d [0,4194304] 0 2023-12-09T02:35:11.586 INFO:tasks.workunit.client.1.smithi161.stdout:2/374: link d4/d1a/f47 d4/d7/d79/d5a/f81 0 2023-12-09T02:35:11.587 INFO:tasks.workunit.client.1.smithi161.stdout:3/320: write d2/d37/f4d [5876707,45556] 0 2023-12-09T02:35:11.590 INFO:tasks.workunit.client.1.smithi161.stdout:0/359: dread d9/dd/d3a/f52 [0,4194304] 0 2023-12-09T02:35:11.592 INFO:tasks.workunit.client.1.smithi161.stdout:9/306: dwrite d2/d25/d3a/d65/d42/d58/f1e [0,4194304] 0 2023-12-09T02:35:11.594 INFO:tasks.workunit.client.1.smithi161.stdout:3/321: dread d2/d4/d11/f32 [0,4194304] 0 2023-12-09T02:35:11.596 INFO:tasks.workunit.client.1.smithi161.stdout:9/307: creat d2/d25/d3a/d4d/f67 x:0 0 0 2023-12-09T02:35:11.599 INFO:tasks.workunit.client.1.smithi161.stdout:3/322: unlink d2/d4/d11/f32 0 2023-12-09T02:35:11.599 INFO:tasks.workunit.client.1.smithi161.stdout:3/323: write d2/d4/d11/d1f/d2a/d46/d2d/d47/f56 [106825,127272] 0 2023-12-09T02:35:11.599 INFO:tasks.workunit.client.1.smithi161.stdout:3/324: read d2/d4/d11/d1f/d2a/d46/f54 [61339,76923] 0 2023-12-09T02:35:11.601 INFO:tasks.workunit.client.1.smithi161.stdout:9/308: mknod d2/d25/d3a/d4d/c68 0 2023-12-09T02:35:11.603 INFO:tasks.workunit.client.1.smithi161.stdout:0/360: dwrite d9/d25/f38 [0,4194304] 0 2023-12-09T02:35:11.604 INFO:tasks.workunit.client.1.smithi161.stdout:3/325: creat d2/d4/d11/d1f/d2a/d46/d40/f58 x:0 0 0 2023-12-09T02:35:11.604 INFO:tasks.workunit.client.1.smithi161.stdout:5/318: truncate d0/d2/de/d22/f32 1377457 0 2023-12-09T02:35:11.604 INFO:tasks.workunit.client.1.smithi161.stdout:5/319: chown d0/d1f/l2e 612 1 2023-12-09T02:35:11.605 INFO:tasks.workunit.client.1.smithi161.stdout:9/309: creat d2/d25/d3a/d65/f69 x:0 0 0 2023-12-09T02:35:11.607 INFO:tasks.workunit.client.1.smithi161.stdout:5/320: write d0/d2/de/d21/f28 [43808,92956] 0 2023-12-09T02:35:11.607 INFO:tasks.workunit.client.1.smithi161.stdout:5/321: write d0/d2/de/d21/f73 [607258,8621] 0 2023-12-09T02:35:11.610 INFO:tasks.workunit.client.1.smithi161.stdout:0/361: creat d9/d25/f6c x:0 0 0 2023-12-09T02:35:11.612 INFO:tasks.workunit.client.1.smithi161.stdout:9/310: dread d2/d25/d3a/d65/d42/d58/d16/f20 [0,4194304] 0 2023-12-09T02:35:11.612 INFO:tasks.workunit.client.1.smithi161.stdout:3/326: creat d2/d4/d11/d1f/d2a/d46/d3e/f59 x:0 0 0 2023-12-09T02:35:11.612 INFO:tasks.workunit.client.1.smithi161.stdout:3/327: fdatasync d2/d4/d11/d28/f22 0 2023-12-09T02:35:11.613 INFO:tasks.workunit.client.1.smithi161.stdout:5/322: creat d0/d2/d7/d70/f75 x:0 0 0 2023-12-09T02:35:11.617 INFO:tasks.workunit.client.1.smithi161.stdout:3/328: mkdir d2/d4/d11/d5a 0 2023-12-09T02:35:11.619 INFO:tasks.workunit.client.1.smithi161.stdout:9/311: dread d2/d25/d3a/d65/d42/d58/d16/d2e/f45 [4194304,4194304] 0 2023-12-09T02:35:11.621 INFO:tasks.workunit.client.1.smithi161.stdout:0/362: link d9/db/l14 d9/dd/l6d 0 2023-12-09T02:35:11.621 INFO:tasks.workunit.client.1.smithi161.stdout:0/363: readlink d9/d55/l27 0 2023-12-09T02:35:11.623 INFO:tasks.workunit.client.1.smithi161.stdout:3/329: creat d2/d4/d11/d1f/d4c/f5b x:0 0 0 2023-12-09T02:35:11.627 INFO:tasks.workunit.client.1.smithi161.stdout:0/364: truncate d9/d25/f2d 67241 0 2023-12-09T02:35:11.628 INFO:tasks.workunit.client.1.smithi161.stdout:0/365: readlink d9/db/l14 0 2023-12-09T02:35:11.638 INFO:tasks.workunit.client.1.smithi161.stdout:5/323: dwrite d0/d1f/f23 [0,4194304] 0 2023-12-09T02:35:11.640 INFO:tasks.workunit.client.1.smithi161.stdout:5/324: mknod d0/c76 0 2023-12-09T02:35:11.640 INFO:tasks.workunit.client.1.smithi161.stdout:5/325: readlink d0/l36 0 2023-12-09T02:35:11.640 INFO:tasks.workunit.client.1.smithi161.stdout:5/326: chown d0/d2/d7/df/d60/f6e 39 1 2023-12-09T02:35:11.641 INFO:tasks.workunit.client.1.smithi161.stdout:9/312: dwrite d2/f35 [0,4194304] 0 2023-12-09T02:35:11.641 INFO:tasks.workunit.client.1.smithi161.stdout:5/327: read d0/d2/f4d [461790,72957] 0 2023-12-09T02:35:11.641 INFO:tasks.workunit.client.1.smithi161.stdout:3/330: dread d2/d4/f1e [0,4194304] 0 2023-12-09T02:35:11.641 INFO:tasks.workunit.client.1.smithi161.stdout:3/331: truncate d2/d4/f1e 6961480 0 2023-12-09T02:35:11.641 INFO:tasks.workunit.client.1.smithi161.stdout:3/332: readlink d2/d4/d11/d1f/d2a/d46/d2d/d47/l49 0 2023-12-09T02:35:11.645 INFO:tasks.workunit.client.1.smithi161.stdout:5/328: mknod d0/d2/de/d22/d55/c77 0 2023-12-09T02:35:11.646 INFO:tasks.workunit.client.1.smithi161.stdout:0/366: dwrite d9/f62 [0,4194304] 0 2023-12-09T02:35:11.648 INFO:tasks.workunit.client.1.smithi161.stdout:5/329: unlink d0/f62 0 2023-12-09T02:35:11.655 INFO:tasks.workunit.client.1.smithi161.stdout:0/367: symlink d9/db/d2a/d35/l6e 0 2023-12-09T02:35:11.656 INFO:tasks.workunit.client.1.smithi161.stdout:5/330: getdents d0/d2/d7 0 2023-12-09T02:35:11.657 INFO:tasks.workunit.client.1.smithi161.stdout:9/313: dwrite d2/f15 [0,4194304] 0 2023-12-09T02:35:11.657 INFO:tasks.workunit.client.1.smithi161.stdout:9/314: chown d2/f1b 1896 1 2023-12-09T02:35:11.659 INFO:tasks.workunit.client.1.smithi161.stdout:0/368: rename d9/d25/l69 to d9/d55/d26/l6f 0 2023-12-09T02:35:11.663 INFO:tasks.workunit.client.1.smithi161.stdout:9/315: symlink d2/l6a 0 2023-12-09T02:35:11.663 INFO:tasks.workunit.client.1.smithi161.stdout:9/316: chown d2/d25/d3a/d65/d42/d58/d16 116739614 1 2023-12-09T02:35:11.667 INFO:tasks.workunit.client.1.smithi161.stdout:9/317: creat d2/d25/d3a/d65/d42/d58/d16/d51/f6b x:0 0 0 2023-12-09T02:35:11.671 INFO:tasks.workunit.client.1.smithi161.stdout:0/369: truncate d9/d25/f2d 311537 0 2023-12-09T02:35:11.671 INFO:tasks.workunit.client.1.smithi161.stdout:0/370: write d9/d25/f6c [296809,18310] 0 2023-12-09T02:35:11.672 INFO:tasks.workunit.client.1.smithi161.stdout:9/318: creat d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/d61/f6c x:0 0 0 2023-12-09T02:35:11.674 INFO:tasks.workunit.client.1.smithi161.stdout:0/371: mknod d9/c70 0 2023-12-09T02:35:11.675 INFO:tasks.workunit.client.1.smithi161.stdout:0/372: chown d9/db/f3e 2178942 1 2023-12-09T02:35:11.675 INFO:tasks.workunit.client.1.smithi161.stdout:0/373: write d9/dd/f1e [4858948,95942] 0 2023-12-09T02:35:11.681 INFO:tasks.workunit.client.1.smithi161.stdout:5/331: dwrite d0/d1f/f3b [0,4194304] 0 2023-12-09T02:35:11.684 INFO:tasks.workunit.client.1.smithi161.stdout:5/332: creat d0/d9/f78 x:0 0 0 2023-12-09T02:35:11.685 INFO:tasks.workunit.client.1.smithi161.stdout:5/333: chown d0/d2/d7/d11/f35 1962 1 2023-12-09T02:35:11.685 INFO:tasks.workunit.client.1.smithi161.stdout:5/334: write d0/d1f/f65 [994107,83310] 0 2023-12-09T02:35:11.685 INFO:tasks.workunit.client.1.smithi161.stdout:5/335: write d0/d9/f6a [450363,78464] 0 2023-12-09T02:35:11.685 INFO:tasks.workunit.client.1.smithi161.stdout:9/319: dread d2/f35 [0,4194304] 0 2023-12-09T02:35:11.686 INFO:tasks.workunit.client.1.smithi161.stdout:5/336: symlink d0/d2/de/d22/d55/l79 0 2023-12-09T02:35:11.686 INFO:tasks.workunit.client.1.smithi161.stdout:5/337: write d0/d1f/f65 [1858806,36734] 0 2023-12-09T02:35:11.686 INFO:tasks.workunit.client.1.smithi161.stdout:9/320: mknod d2/d25/d3a/d65/d5c/c6d 0 2023-12-09T02:35:11.687 INFO:tasks.workunit.client.1.smithi161.stdout:5/338: creat d0/d2/f7a x:0 0 0 2023-12-09T02:35:11.688 INFO:tasks.workunit.client.1.smithi161.stdout:9/321: rename d2/d25/d3a/d4d/c68 to d2/d25/d3a/d65/d4f/c6e 0 2023-12-09T02:35:11.689 INFO:tasks.workunit.client.1.smithi161.stdout:5/339: mknod d0/d2/d7/d51/c7b 0 2023-12-09T02:35:11.690 INFO:tasks.workunit.client.1.smithi161.stdout:9/322: unlink d2/f32 0 2023-12-09T02:35:11.701 INFO:tasks.workunit.client.1.smithi161.stdout:4/383: sync 2023-12-09T02:35:11.702 INFO:tasks.workunit.client.1.smithi161.stdout:5/340: dread d0/d2/d7/d11/f4c [4194304,4194304] 0 2023-12-09T02:35:11.702 INFO:tasks.workunit.client.1.smithi161.stdout:5/341: write d0/d1f/f65 [2544156,76277] 0 2023-12-09T02:35:11.719 INFO:tasks.workunit.client.1.smithi161.stdout:4/384: dread dd/d36/d3f/d54/f68 [0,4194304] 0 2023-12-09T02:35:11.722 INFO:tasks.workunit.client.1.smithi161.stdout:4/385: getdents dd/d1a/d1d/d25/d32/d58 0 2023-12-09T02:35:11.722 INFO:tasks.workunit.client.1.smithi161.stdout:4/386: write dd/d1a/f64 [110630,15801] 0 2023-12-09T02:35:11.728 INFO:tasks.workunit.client.1.smithi161.stdout:4/387: creat dd/d36/d4a/d5f/f7c x:0 0 0 2023-12-09T02:35:11.729 INFO:tasks.workunit.client.1.smithi161.stdout:4/388: read f7 [3508981,73982] 0 2023-12-09T02:35:11.730 INFO:tasks.workunit.client.1.smithi161.stdout:4/389: dread dd/d1a/d1e/f21 [0,4194304] 0 2023-12-09T02:35:11.733 INFO:tasks.workunit.client.1.smithi161.stdout:9/323: dwrite d2/d25/d3a/d4d/f67 [0,4194304] 0 2023-12-09T02:35:11.736 INFO:tasks.workunit.client.1.smithi161.stdout:3/333: dwrite d2/fe [0,4194304] 0 2023-12-09T02:35:11.741 INFO:tasks.workunit.client.1.smithi161.stdout:9/324: symlink d2/d25/d3a/d65/d42/d58/d16/d2e/l6f 0 2023-12-09T02:35:11.744 INFO:tasks.workunit.client.1.smithi161.stdout:3/334: creat d2/d4/d11/d1f/d2a/d46/d2d/d47/f5c x:0 0 0 2023-12-09T02:35:11.744 INFO:tasks.workunit.client.1.smithi161.stdout:3/335: readlink d2/d4/d11/d1f/d2a/d46/l26 0 2023-12-09T02:35:11.744 INFO:tasks.workunit.client.1.smithi161.stdout:3/336: readlink d2/d4/d11/l33 0 2023-12-09T02:35:11.744 INFO:tasks.workunit.client.1.smithi161.stdout:3/337: readlink d2/d4/d11/l4f 0 2023-12-09T02:35:11.750 INFO:tasks.workunit.client.1.smithi161.stdout:9/325: dread d2/d25/d3a/d65/f49 [0,4194304] 0 2023-12-09T02:35:11.755 INFO:tasks.workunit.client.1.smithi161.stdout:3/338: dread d2/d4/f1e [0,4194304] 0 2023-12-09T02:35:11.773 INFO:tasks.workunit.client.1.smithi161.stdout:3/339: dwrite d2/d4/d11/d1f/d2a/d46/d2d/d47/f5c [0,4194304] 0 2023-12-09T02:35:11.773 INFO:tasks.workunit.client.1.smithi161.stdout:3/340: write d2/d4/d11/d1f/d2a/d46/f57 [721185,9681] 0 2023-12-09T02:35:11.776 INFO:tasks.workunit.client.1.smithi161.stdout:3/341: creat d2/d4/d11/f5d x:0 0 0 2023-12-09T02:35:11.805 INFO:tasks.workunit.client.1.smithi161.stdout:3/342: dwrite d2/d37/f38 [0,4194304] 0 2023-12-09T02:35:11.810 INFO:tasks.workunit.client.1.smithi161.stdout:3/343: mkdir d2/d4/d11/d1f/d2a/d46/d5e 0 2023-12-09T02:35:11.834 INFO:tasks.workunit.client.1.smithi161.stdout:3/344: dwrite d2/d4/d11/d1f/d2a/d46/d2d/d47/f5c [4194304,4194304] 0 2023-12-09T02:35:11.834 INFO:tasks.workunit.client.1.smithi161.stdout:3/345: stat d2/d4/d11/d1f/d2a/d46/d2d/d4e 0 2023-12-09T02:35:11.837 INFO:tasks.workunit.client.1.smithi161.stdout:3/346: dread d2/d4/d11/f14 [0,4194304] 0 2023-12-09T02:35:11.864 INFO:tasks.workunit.client.1.smithi161.stdout:7/431: sync 2023-12-09T02:35:11.876 INFO:tasks.workunit.client.1.smithi161.stdout:7/432: dwrite d0/d3/d13/d2d/d6e/f8c [0,4194304] 0 2023-12-09T02:35:11.879 INFO:tasks.workunit.client.1.smithi161.stdout:7/433: getdents d0/d3 0 2023-12-09T02:35:11.879 INFO:tasks.workunit.client.1.smithi161.stdout:7/434: truncate d0/d29/d59/d5e/f84 516513 0 2023-12-09T02:35:11.880 INFO:tasks.workunit.client.1.smithi161.stdout:7/435: dread d0/d3/d21/d3e/f5c [0,4194304] 0 2023-12-09T02:35:11.897 INFO:tasks.workunit.client.1.smithi161.stdout:7/436: dwrite d0/d3/d13/d2f/f77 [0,4194304] 0 2023-12-09T02:35:11.899 INFO:tasks.workunit.client.1.smithi161.stdout:7/437: symlink d0/d3/d21/d3e/l8d 0 2023-12-09T02:35:12.011 INFO:tasks.workunit.client.1.smithi161.stdout:7/438: symlink d0/d49/l8e 0 2023-12-09T02:35:12.013 INFO:tasks.workunit.client.1.smithi161.stdout:7/439: truncate d0/d3/d13/d1b/f3f 21154 0 2023-12-09T02:35:12.013 INFO:tasks.workunit.client.1.smithi161.stdout:7/440: chown d0/d3/d21/l68 102734 1 2023-12-09T02:35:12.013 INFO:tasks.workunit.client.1.smithi161.stdout:7/441: rename d0 to d0/d3/d13/d2d/d43/d4b/d5a/d8f 22 2023-12-09T02:35:12.014 INFO:tasks.workunit.client.1.smithi161.stdout:7/442: dread - d0/d3/d13/d2d/d43/d4b/d5a/f6b zero size 2023-12-09T02:35:12.016 INFO:tasks.workunit.client.1.smithi161.stdout:7/443: creat d0/d49/f90 x:0 0 0 2023-12-09T02:35:12.016 INFO:tasks.workunit.client.1.smithi161.stdout:7/444: write d0/d3/d13/d2d/d43/d4b/f75 [851288,99744] 0 2023-12-09T02:35:12.018 INFO:tasks.workunit.client.1.smithi161.stdout:7/445: unlink d0/d3/d13/d1b/l40 0 2023-12-09T02:35:12.018 INFO:tasks.workunit.client.1.smithi161.stdout:7/446: chown d0/d49/d67/d71 13 1 2023-12-09T02:35:12.027 INFO:tasks.workunit.client.1.smithi161.stdout:7/447: dread d0/d3/d21/f3b [0,4194304] 0 2023-12-09T02:35:12.027 INFO:tasks.workunit.client.1.smithi161.stdout:7/448: chown d0/d3/f7 1945 1 2023-12-09T02:35:12.045 INFO:tasks.workunit.client.1.smithi161.stdout:7/449: dwrite d0/d3/d13/d2d/d43/d4a/f1c [0,4194304] 0 2023-12-09T02:35:12.045 INFO:tasks.workunit.client.1.smithi161.stdout:7/450: write d0/d3/d13/d2d/f39 [589578,120476] 0 2023-12-09T02:35:12.045 INFO:tasks.workunit.client.1.smithi161.stdout:7/451: fsync d0/fc 0 2023-12-09T02:35:12.048 INFO:tasks.workunit.client.1.smithi161.stdout:7/452: rename d0/d29/d53 to d0/d3/d21/d54/d91 0 2023-12-09T02:35:12.048 INFO:tasks.workunit.client.1.smithi161.stdout:7/453: write d0/d3/d13/d1b/f3f [226124,52499] 0 2023-12-09T02:35:12.053 INFO:tasks.workunit.client.1.smithi161.stdout:7/454: rmdir d0/d49 39 2023-12-09T02:35:12.053 INFO:tasks.workunit.client.1.smithi161.stdout:7/455: fdatasync d0/fd 0 2023-12-09T02:35:12.077 INFO:tasks.workunit.client.1.smithi161.stdout:7/456: dwrite d0/d49/f4c [0,4194304] 0 2023-12-09T02:35:12.077 INFO:tasks.workunit.client.1.smithi161.stdout:7/457: truncate d0/d3/d13/d1b/f3f 1069538 0 2023-12-09T02:35:12.077 INFO:tasks.workunit.client.1.smithi161.stdout:7/458: write d0/d3/d13/d2d/f5b [401785,123813] 0 2023-12-09T02:35:12.077 INFO:tasks.workunit.client.1.smithi161.stdout:7/459: read - d0/d3/d13/d2d/d43/d4b/d5a/f6b zero size 2023-12-09T02:35:12.077 INFO:tasks.workunit.client.1.smithi161.stdout:7/460: truncate d0/d29/f82 715472 0 2023-12-09T02:35:12.080 INFO:tasks.workunit.client.1.smithi161.stdout:1/544: sync 2023-12-09T02:35:12.080 INFO:tasks.workunit.client.1.smithi161.stdout:7/461: link d0/d3/d13/d2d/d43/d4a/f1c d0/d49/d67/f92 0 2023-12-09T02:35:12.081 INFO:tasks.workunit.client.1.smithi161.stdout:7/462: creat d0/d49/d79/f93 x:0 0 0 2023-12-09T02:35:12.083 INFO:tasks.workunit.client.1.smithi161.stdout:7/463: mkdir d0/d3/d21/d3e/d94 0 2023-12-09T02:35:12.084 INFO:tasks.workunit.client.1.smithi161.stdout:7/464: write d0/d49/d67/f92 [286753,112740] 0 2023-12-09T02:35:12.085 INFO:tasks.workunit.client.1.smithi161.stdout:7/465: rmdir d0/d3 39 2023-12-09T02:35:12.086 INFO:tasks.workunit.client.1.smithi161.stdout:1/545: dread d6/d9/fa4 [0,4194304] 0 2023-12-09T02:35:12.086 INFO:tasks.workunit.client.1.smithi161.stdout:1/546: fdatasync d6/d8/d63/d35/d3d/f96 0 2023-12-09T02:35:12.100 INFO:tasks.workunit.client.1.smithi161.stdout:7/466: dwrite d0/d3/d13/d2d/d43/d4a/f10 [0,4194304] 0 2023-12-09T02:35:12.100 INFO:tasks.workunit.client.1.smithi161.stdout:7/467: read - d0/f78 zero size 2023-12-09T02:35:12.103 INFO:tasks.workunit.client.1.smithi161.stdout:7/468: creat d0/d3/d13/d2d/d43/d4b/d5a/d6f/d83/f95 x:0 0 0 2023-12-09T02:35:12.103 INFO:tasks.workunit.client.1.smithi161.stdout:7/469: chown d0/d3 8 1 2023-12-09T02:35:12.105 INFO:tasks.workunit.client.1.smithi161.stdout:7/470: creat d0/d3/d13/f96 x:0 0 0 2023-12-09T02:35:12.106 INFO:tasks.workunit.client.1.smithi161.stdout:7/471: dread d0/d29/f82 [0,4194304] 0 2023-12-09T02:35:12.107 INFO:tasks.workunit.client.1.smithi161.stdout:7/472: chown d0/d3/c16 186 1 2023-12-09T02:35:12.123 INFO:tasks.workunit.client.1.smithi161.stdout:7/473: dwrite d0/f78 [0,4194304] 0 2023-12-09T02:35:12.149 INFO:tasks.workunit.client.1.smithi161.stdout:7/474: dwrite d0/d3/d13/f89 [0,4194304] 0 2023-12-09T02:35:12.150 INFO:tasks.workunit.client.1.smithi161.stdout:7/475: creat d0/d3/d13/d2d/d43/d4b/d5a/d6f/d83/f97 x:0 0 0 2023-12-09T02:35:12.163 INFO:tasks.workunit.client.1.smithi161.stdout:7/476: dwrite d0/d49/f4c [4194304,4194304] 0 2023-12-09T02:35:12.164 INFO:tasks.workunit.client.1.smithi161.stdout:7/477: write d0/d29/d59/f6d [4061057,71397] 0 2023-12-09T02:35:12.164 INFO:tasks.workunit.client.1.smithi161.stdout:7/478: dread - d0/d3/d13/d2d/d43/d4b/d5a/d6f/d83/f95 zero size 2023-12-09T02:35:12.164 INFO:tasks.workunit.client.1.smithi161.stdout:7/479: dread - d0/d3/d13/d2f/d50/f57 zero size 2023-12-09T02:35:12.165 INFO:tasks.workunit.client.1.smithi161.stdout:7/480: link d0/d3/d21/c55 d0/d3/d21/d54/c98 0 2023-12-09T02:35:12.167 INFO:tasks.workunit.client.1.smithi161.stdout:7/481: unlink d0/d3/d13/d2d/d43/d4a/f1c 0 2023-12-09T02:35:12.168 INFO:tasks.workunit.client.1.smithi161.stdout:7/482: mkdir d0/d3/d13/d2d/d43/d4b/d99 0 2023-12-09T02:35:12.170 INFO:tasks.workunit.client.1.smithi161.stdout:7/483: write d0/d29/f32 [2249722,6563] 0 2023-12-09T02:35:12.170 INFO:tasks.workunit.client.1.smithi161.stdout:7/484: fsync d0/d49/f4c 0 2023-12-09T02:35:12.172 INFO:tasks.workunit.client.1.smithi161.stdout:7/485: rename d0/d3/d13/d4e/c88 to d0/d3/d6c/c9a 0 2023-12-09T02:35:12.173 INFO:tasks.workunit.client.1.smithi161.stdout:7/486: write d0/d3/d13/f89 [308477,22187] 0 2023-12-09T02:35:12.174 INFO:tasks.workunit.client.1.smithi161.stdout:7/487: write d0/d3/f25 [212921,27716] 0 2023-12-09T02:35:12.177 INFO:tasks.workunit.client.1.smithi161.stdout:7/488: unlink d0/c5 0 2023-12-09T02:35:12.181 INFO:tasks.workunit.client.1.smithi161.stdout:7/489: symlink d0/d3/d13/d4e/d70/l9b 0 2023-12-09T02:35:12.181 INFO:tasks.workunit.client.1.smithi161.stdout:7/490: stat d0/d3/d13/d2d/d43/d4a/f20 0 2023-12-09T02:35:12.181 INFO:tasks.workunit.client.1.smithi161.stdout:7/491: readlink d0/l81 0 2023-12-09T02:35:12.187 INFO:tasks.workunit.client.1.smithi161.stdout:7/492: mknod d0/d3/d13/d2d/d43/d4b/d99/c9c 0 2023-12-09T02:35:12.190 INFO:tasks.workunit.client.1.smithi161.stdout:7/493: mknod d0/d3/d21/c9d 0 2023-12-09T02:35:12.191 INFO:tasks.workunit.client.1.smithi161.stdout:7/494: read - d0/d3/d13/d2d/d43/d4b/d5a/d6f/d83/f97 zero size 2023-12-09T02:35:12.194 INFO:tasks.workunit.client.1.smithi161.stdout:7/495: getdents d0/d29 0 2023-12-09T02:35:12.201 INFO:tasks.workunit.client.1.smithi161.stdout:7/496: rename d0/d29 to d0/d3/d9e 0 2023-12-09T02:35:12.202 INFO:tasks.workunit.client.1.smithi161.stdout:7/497: write d0/d3/d13/f58 [3113406,85510] 0 2023-12-09T02:35:12.202 INFO:tasks.workunit.client.1.smithi161.stdout:7/498: truncate d0/d49/f90 101262 0 2023-12-09T02:35:12.205 INFO:tasks.workunit.client.1.smithi161.stdout:7/499: write d0/d49/d67/f92 [2182264,63562] 0 2023-12-09T02:35:12.206 INFO:tasks.workunit.client.1.smithi161.stdout:7/500: mknod d0/d3/d13/d2d/d43/d4b/d99/c9f 0 2023-12-09T02:35:12.207 INFO:tasks.workunit.client.1.smithi161.stdout:7/501: symlink d0/d3/d9e/la0 0 2023-12-09T02:35:12.212 INFO:tasks.workunit.client.1.smithi161.stdout:7/502: getdents d0/d3 0 2023-12-09T02:35:12.236 INFO:tasks.workunit.client.1.smithi161.stdout:7/503: dwrite d0/d3/d13/f56 [0,4194304] 0 2023-12-09T02:35:12.244 INFO:tasks.workunit.client.1.smithi161.stdout:7/504: creat d0/d3/d13/d2d/d43/d4b/d5a/d6f/fa1 x:0 0 0 2023-12-09T02:35:12.246 INFO:tasks.workunit.client.1.smithi161.stdout:7/505: rename d0/d3/d13/d4e/l52 to d0/d49/d67/d71/la2 0 2023-12-09T02:35:12.251 INFO:tasks.workunit.client.1.smithi161.stdout:6/280: sync 2023-12-09T02:35:12.252 INFO:tasks.workunit.client.1.smithi161.stdout:8/315: sync 2023-12-09T02:35:12.252 INFO:tasks.workunit.client.1.smithi161.stdout:6/281: rename da/d28/d29/d2b/d31/d33 to da/d28/d29/d2b/d31/d33/d61 22 2023-12-09T02:35:12.252 INFO:tasks.workunit.client.1.smithi161.stdout:6/282: creat da/d28/d29/f62 x:0 0 0 2023-12-09T02:35:12.253 INFO:tasks.workunit.client.1.smithi161.stdout:8/316: write d2/d5/d22/f49 [2943891,26215] 0 2023-12-09T02:35:12.253 INFO:tasks.workunit.client.1.smithi161.stdout:8/317: fdatasync d2/d2d/f57 0 2023-12-09T02:35:12.254 INFO:tasks.workunit.client.1.smithi161.stdout:6/283: symlink da/d28/d4d/d5e/l63 0 2023-12-09T02:35:12.254 INFO:tasks.workunit.client.1.smithi161.stdout:6/284: truncate da/d28/d3c/d57/f5c 172046 0 2023-12-09T02:35:12.255 INFO:tasks.workunit.client.1.smithi161.stdout:6/285: write da/d28/d29/f58 [626605,36093] 0 2023-12-09T02:35:12.260 INFO:tasks.workunit.client.1.smithi161.stdout:6/286: rmdir da/d19/d20 39 2023-12-09T02:35:12.270 INFO:tasks.workunit.client.1.smithi161.stdout:6/287: dread da/d28/d29/d2b/d31/d33/f3e [0,4194304] 0 2023-12-09T02:35:12.272 INFO:tasks.workunit.client.1.smithi161.stdout:7/506: dwrite d0/d49/f4c [0,4194304] 0 2023-12-09T02:35:12.272 INFO:tasks.workunit.client.1.smithi161.stdout:7/507: stat d0/d3/f17 0 2023-12-09T02:35:12.273 INFO:tasks.workunit.client.1.smithi161.stdout:6/288: read da/d19/f24 [3660342,74295] 0 2023-12-09T02:35:12.274 INFO:tasks.workunit.client.1.smithi161.stdout:7/508: symlink d0/d3/d21/d54/d91/la3 0 2023-12-09T02:35:12.275 INFO:tasks.workunit.client.1.smithi161.stdout:6/289: symlink da/d55/l64 0 2023-12-09T02:35:12.277 INFO:tasks.workunit.client.1.smithi161.stdout:8/318: dwrite d2/d5/f34 [0,4194304] 0 2023-12-09T02:35:12.277 INFO:tasks.workunit.client.1.smithi161.stdout:8/319: truncate d2/d5/d22/d31/f41 921362 0 2023-12-09T02:35:12.277 INFO:tasks.workunit.client.1.smithi161.stdout:6/290: mknod da/d28/d3c/d57/c65 0 2023-12-09T02:35:12.277 INFO:tasks.workunit.client.1.smithi161.stdout:6/291: read da/d28/d29/f58 [347333,41796] 0 2023-12-09T02:35:12.284 INFO:tasks.workunit.client.1.smithi161.stdout:6/292: creat da/d28/d29/d2b/d31/f66 x:0 0 0 2023-12-09T02:35:12.285 INFO:tasks.workunit.client.1.smithi161.stdout:6/293: dread - da/d55/f5f zero size 2023-12-09T02:35:12.285 INFO:tasks.workunit.client.1.smithi161.stdout:6/294: fsync da/df/f14 0 2023-12-09T02:35:12.285 INFO:tasks.workunit.client.1.smithi161.stdout:6/295: chown da/d19/f23 4 1 2023-12-09T02:35:12.285 INFO:tasks.workunit.client.1.smithi161.stdout:6/296: chown da/d28/d3c/d46 2973 1 2023-12-09T02:35:12.287 INFO:tasks.workunit.client.1.smithi161.stdout:6/297: unlink da/d28/d29/c37 0 2023-12-09T02:35:12.290 INFO:tasks.workunit.client.1.smithi161.stdout:8/320: rmdir d2/d5/d4f/d62 0 2023-12-09T02:35:12.290 INFO:tasks.workunit.client.1.smithi161.stdout:8/321: write d2/d5/d22/d31/d38/d48/f5a [265861,116804] 0 2023-12-09T02:35:12.291 INFO:tasks.workunit.client.1.smithi161.stdout:7/509: dwrite d0/d3/d13/f34 [0,4194304] 0 2023-12-09T02:35:12.291 INFO:tasks.workunit.client.1.smithi161.stdout:7/510: fdatasync d0/d49/d79/f93 0 2023-12-09T02:35:12.291 INFO:tasks.workunit.client.1.smithi161.stdout:8/322: write d2/d5/f20 [3834461,36757] 0 2023-12-09T02:35:12.298 INFO:tasks.workunit.client.1.smithi161.stdout:6/298: dread da/d19/d20/f25 [0,4194304] 0 2023-12-09T02:35:12.299 INFO:tasks.workunit.client.1.smithi161.stdout:7/511: dread d0/d3/d21/d3e/f5c [0,4194304] 0 2023-12-09T02:35:12.300 INFO:tasks.workunit.client.1.smithi161.stdout:6/299: creat da/d28/f67 x:0 0 0 2023-12-09T02:35:12.300 INFO:tasks.workunit.client.1.smithi161.stdout:6/300: stat da/d55/f5f 0 2023-12-09T02:35:12.300 INFO:tasks.workunit.client.1.smithi161.stdout:6/301: dread - da/d55/f5f zero size 2023-12-09T02:35:12.300 INFO:tasks.workunit.client.1.smithi161.stdout:6/302: write da/d28/d29/f45 [588333,27164] 0 2023-12-09T02:35:12.304 INFO:tasks.workunit.client.1.smithi161.stdout:6/303: creat da/f68 x:0 0 0 2023-12-09T02:35:12.304 INFO:tasks.workunit.client.1.smithi161.stdout:8/323: dwrite d2/d5/d22/d31/f65 [0,4194304] 0 2023-12-09T02:35:12.310 INFO:tasks.workunit.client.1.smithi161.stdout:6/304: symlink da/d28/d29/d2b/l69 0 2023-12-09T02:35:12.313 INFO:tasks.workunit.client.1.smithi161.stdout:6/305: symlink da/df/l6a 0 2023-12-09T02:35:12.314 INFO:tasks.workunit.client.1.smithi161.stdout:6/306: link da/df/l6a da/d28/d29/d2b/l6b 0 2023-12-09T02:35:12.314 INFO:tasks.workunit.client.1.smithi161.stdout:6/307: write da/fc [4274176,77357] 0 2023-12-09T02:35:12.315 INFO:tasks.workunit.client.1.smithi161.stdout:6/308: creat da/d28/d4d/d5e/f6c x:0 0 0 2023-12-09T02:35:12.316 INFO:tasks.workunit.client.1.smithi161.stdout:6/309: mkdir da/d55/d6d 0 2023-12-09T02:35:12.316 INFO:tasks.workunit.client.1.smithi161.stdout:6/310: creat da/d28/d29/f6e x:0 0 0 2023-12-09T02:35:12.318 INFO:tasks.workunit.client.1.smithi161.stdout:8/324: dwrite d2/f17 [4194304,4194304] 0 2023-12-09T02:35:12.318 INFO:tasks.workunit.client.1.smithi161.stdout:6/311: mkdir da/d19/d20/d6f 0 2023-12-09T02:35:12.318 INFO:tasks.workunit.client.1.smithi161.stdout:6/312: truncate da/df/f3a 7192369 0 2023-12-09T02:35:12.319 INFO:tasks.workunit.client.1.smithi161.stdout:8/325: symlink d2/d5/d22/d31/d38/d48/d4e/l6a 0 2023-12-09T02:35:12.328 INFO:tasks.workunit.client.1.smithi161.stdout:6/313: dread da/d19/f1e [4194304,4194304] 0 2023-12-09T02:35:12.329 INFO:tasks.workunit.client.1.smithi161.stdout:6/314: mknod da/d55/d6d/c70 0 2023-12-09T02:35:12.329 INFO:tasks.workunit.client.1.smithi161.stdout:6/315: chown da/df/f3f 7 1 2023-12-09T02:35:12.330 INFO:tasks.workunit.client.1.smithi161.stdout:6/316: link da/d19/c2a da/d19/d20/c71 0 2023-12-09T02:35:12.331 INFO:tasks.workunit.client.1.smithi161.stdout:6/317: creat da/d19/f72 x:0 0 0 2023-12-09T02:35:12.331 INFO:tasks.workunit.client.1.smithi161.stdout:6/318: fdatasync da/d19/f1b 0 2023-12-09T02:35:12.332 INFO:tasks.workunit.client.1.smithi161.stdout:8/326: dwrite d2/d5/d22/d31/d38/d66/f68 [0,4194304] 0 2023-12-09T02:35:12.332 INFO:tasks.workunit.client.1.smithi161.stdout:6/319: creat da/d19/d20/d60/f73 x:0 0 0 2023-12-09T02:35:12.335 INFO:tasks.workunit.client.1.smithi161.stdout:8/327: creat d2/d5/f6b x:0 0 0 2023-12-09T02:35:12.336 INFO:tasks.workunit.client.1.smithi161.stdout:6/320: getdents da/df/d2d 0 2023-12-09T02:35:12.336 INFO:tasks.workunit.client.1.smithi161.stdout:6/321: write da/f1a [8495960,39647] 0 2023-12-09T02:35:12.337 INFO:tasks.workunit.client.1.smithi161.stdout:8/328: mknod d2/d5/d22/d31/d38/d66/c6c 0 2023-12-09T02:35:12.342 INFO:tasks.workunit.client.1.smithi161.stdout:8/329: link d2/l21 d2/d5/d3d/l6d 0 2023-12-09T02:35:12.342 INFO:tasks.workunit.client.1.smithi161.stdout:8/330: chown d2/d5/f40 614896 1 2023-12-09T02:35:12.342 INFO:tasks.workunit.client.1.smithi161.stdout:8/331: chown d2/d5 496798 1 2023-12-09T02:35:12.344 INFO:tasks.workunit.client.1.smithi161.stdout:8/332: rename d2/l18 to d2/d2d/l6e 0 2023-12-09T02:35:12.344 INFO:tasks.workunit.client.1.smithi161.stdout:8/333: write d2/d5/d4f/f29 [752560,118761] 0 2023-12-09T02:35:12.344 INFO:tasks.workunit.client.1.smithi161.stdout:8/334: write d2/d5/d22/d31/f58 [196985,72099] 0 2023-12-09T02:35:12.348 INFO:tasks.workunit.client.1.smithi161.stdout:8/335: link d2/d5/d22/d31/f58 d2/d5/d3d/f6f 0 2023-12-09T02:35:12.351 INFO:tasks.workunit.client.1.smithi161.stdout:6/322: truncate da/d28/d29/d2b/d31/f51 6697066 0 2023-12-09T02:35:12.351 INFO:tasks.workunit.client.1.smithi161.stdout:6/323: stat da/d55/l64 0 2023-12-09T02:35:12.352 INFO:tasks.workunit.client.1.smithi161.stdout:6/324: rmdir da/d28/d29/d2b/d31/d33 39 2023-12-09T02:35:12.352 INFO:tasks.workunit.client.1.smithi161.stdout:6/325: fdatasync da/f68 0 2023-12-09T02:35:12.354 INFO:tasks.workunit.client.1.smithi161.stdout:6/326: symlink da/d28/d3c/d46/l74 0 2023-12-09T02:35:12.356 INFO:tasks.workunit.client.1.smithi161.stdout:6/327: creat da/d55/d6d/f75 x:0 0 0 2023-12-09T02:35:12.357 INFO:tasks.workunit.client.1.smithi161.stdout:6/328: creat da/f76 x:0 0 0 2023-12-09T02:35:12.357 INFO:tasks.workunit.client.1.smithi161.stdout:6/329: read - da/df/f27 zero size 2023-12-09T02:35:12.359 INFO:tasks.workunit.client.1.smithi161.stdout:6/330: mkdir da/d28/d77 0 2023-12-09T02:35:12.359 INFO:tasks.workunit.client.1.smithi161.stdout:6/331: getdents da/d19/d20/d6f 0 2023-12-09T02:35:12.361 INFO:tasks.workunit.client.1.smithi161.stdout:6/332: unlink da/d28/d29/d2b/d31/f35 0 2023-12-09T02:35:12.362 INFO:tasks.workunit.client.1.smithi161.stdout:6/333: rename da/d28/d29/d2b to da/d28/d29/d2b/d31/d78 22 2023-12-09T02:35:12.364 INFO:tasks.workunit.client.1.smithi161.stdout:8/336: dwrite d2/d5/d22/d31/f41 [0,4194304] 0 2023-12-09T02:35:12.364 INFO:tasks.workunit.client.1.smithi161.stdout:8/337: chown d2/d5/d4f/c5f 46 1 2023-12-09T02:35:12.365 INFO:tasks.workunit.client.1.smithi161.stdout:8/338: write d2/f63 [80303,66626] 0 2023-12-09T02:35:12.365 INFO:tasks.workunit.client.1.smithi161.stdout:8/339: readlink d2/d2d/l6e 0 2023-12-09T02:35:12.365 INFO:tasks.workunit.client.1.smithi161.stdout:6/334: rename da/d28/d3c/d57 to da/d28/d77/d79 0 2023-12-09T02:35:12.365 INFO:tasks.workunit.client.1.smithi161.stdout:8/340: read d2/d5/fa [439928,78338] 0 2023-12-09T02:35:12.370 INFO:tasks.workunit.client.1.smithi161.stdout:6/335: link f1 da/d28/d77/d79/f7a 0 2023-12-09T02:35:12.371 INFO:tasks.workunit.client.1.smithi161.stdout:8/341: creat d2/d2d/f70 x:0 0 0 2023-12-09T02:35:12.372 INFO:tasks.workunit.client.1.smithi161.stdout:8/342: dread d2/d5/f33 [0,4194304] 0 2023-12-09T02:35:12.372 INFO:tasks.workunit.client.1.smithi161.stdout:6/336: fdatasync da/fc 0 2023-12-09T02:35:12.383 INFO:tasks.workunit.client.1.smithi161.stdout:8/343: unlink d2/d5/d4f/c47 0 2023-12-09T02:35:12.385 INFO:tasks.workunit.client.1.smithi161.stdout:8/344: rename d2/d5/d22/l2b to d2/d5/d22/d31/d38/d48/l71 0 2023-12-09T02:35:12.385 INFO:tasks.workunit.client.1.smithi161.stdout:8/345: fsync d2/d5/f33 0 2023-12-09T02:35:12.385 INFO:tasks.workunit.client.1.smithi161.stdout:6/337: dwrite da/d28/d3c/d46/f48 [0,4194304] 0 2023-12-09T02:35:12.387 INFO:tasks.workunit.client.1.smithi161.stdout:8/346: creat d2/d5/d22/d31/d38/d48/f72 x:0 0 0 2023-12-09T02:35:12.387 INFO:tasks.workunit.client.1.smithi161.stdout:8/347: chown d2/d5/d22/d31/f39 3 1 2023-12-09T02:35:12.392 INFO:tasks.workunit.client.1.smithi161.stdout:8/348: link d2/d2d/c4b d2/d5/d3d/c73 0 2023-12-09T02:35:12.393 INFO:tasks.workunit.client.1.smithi161.stdout:8/349: unlink d2/d5/d22/d31/f45 0 2023-12-09T02:35:12.402 INFO:tasks.workunit.client.1.smithi161.stdout:8/350: dread d2/d5/f16 [0,4194304] 0 2023-12-09T02:35:12.406 INFO:tasks.workunit.client.1.smithi161.stdout:8/351: rmdir d2/d5/d22/d31/d38 39 2023-12-09T02:35:12.408 INFO:tasks.workunit.client.1.smithi161.stdout:8/352: dread d2/d5/d22/d31/d38/d48/f5a [0,4194304] 0 2023-12-09T02:35:12.408 INFO:tasks.workunit.client.1.smithi161.stdout:8/353: write d2/f55 [475581,88889] 0 2023-12-09T02:35:12.409 INFO:tasks.workunit.client.1.smithi161.stdout:6/338: dwrite da/d19/f50 [0,4194304] 0 2023-12-09T02:35:12.409 INFO:tasks.workunit.client.1.smithi161.stdout:8/354: dread d2/d5/d4f/f2a [0,4194304] 0 2023-12-09T02:35:12.411 INFO:tasks.workunit.client.1.smithi161.stdout:6/339: truncate da/d19/f23 4539157 0 2023-12-09T02:35:12.413 INFO:tasks.workunit.client.1.smithi161.stdout:8/355: truncate d2/d5/fa 305683 0 2023-12-09T02:35:12.414 INFO:tasks.workunit.client.1.smithi161.stdout:6/340: symlink da/d28/d77/d79/l7b 0 2023-12-09T02:35:12.416 INFO:tasks.workunit.client.1.smithi161.stdout:8/356: creat d2/d5/d3d/f74 x:0 0 0 2023-12-09T02:35:12.418 INFO:tasks.workunit.client.1.smithi161.stdout:6/341: creat da/d28/d3c/d46/f7c x:0 0 0 2023-12-09T02:35:12.418 INFO:tasks.workunit.client.1.smithi161.stdout:6/342: chown da/d28/d3c/d46/l5a 6 1 2023-12-09T02:35:12.418 INFO:tasks.workunit.client.1.smithi161.stdout:6/343: fsync f9 0 2023-12-09T02:35:12.418 INFO:tasks.workunit.client.1.smithi161.stdout:6/344: read - da/d28/d29/f6e zero size 2023-12-09T02:35:12.420 INFO:tasks.workunit.client.1.smithi161.stdout:8/357: rmdir d2/d5/d22 39 2023-12-09T02:35:12.421 INFO:tasks.workunit.client.1.smithi161.stdout:8/358: fdatasync d2/d5/f30 0 2023-12-09T02:35:12.422 INFO:tasks.workunit.client.1.smithi161.stdout:6/345: creat da/df/f7d x:0 0 0 2023-12-09T02:35:12.422 INFO:tasks.workunit.client.1.smithi161.stdout:6/346: chown da/df/f14 0 1 2023-12-09T02:35:12.422 INFO:tasks.workunit.client.1.smithi161.stdout:8/359: dread d2/d5/fa [0,4194304] 0 2023-12-09T02:35:12.422 INFO:tasks.workunit.client.1.smithi161.stdout:6/347: write da/d19/f1e [5209797,2307] 0 2023-12-09T02:35:12.422 INFO:tasks.workunit.client.1.smithi161.stdout:6/348: dread - da/df/d2d/d49/f4c zero size 2023-12-09T02:35:12.424 INFO:tasks.workunit.client.1.smithi161.stdout:8/360: creat d2/d5/d22/d31/d38/d48/f75 x:0 0 0 2023-12-09T02:35:12.424 INFO:tasks.workunit.client.1.smithi161.stdout:8/361: readlink d2/l12 0 2023-12-09T02:35:12.427 INFO:tasks.workunit.client.1.smithi161.stdout:6/349: creat da/d28/d29/d2b/f7e x:0 0 0 2023-12-09T02:35:12.428 INFO:tasks.workunit.client.1.smithi161.stdout:8/362: getdents d2/d5/d22 0 2023-12-09T02:35:12.430 INFO:tasks.workunit.client.1.smithi161.stdout:6/350: symlink da/d28/d77/l7f 0 2023-12-09T02:35:12.430 INFO:tasks.workunit.client.1.smithi161.stdout:6/351: dread - da/d19/f72 zero size 2023-12-09T02:35:12.430 INFO:tasks.workunit.client.1.smithi161.stdout:6/352: truncate da/df/d2d/d49/f4a 311113 0 2023-12-09T02:35:12.430 INFO:tasks.workunit.client.1.smithi161.stdout:8/363: mkdir d2/d5/d22/d76 0 2023-12-09T02:35:12.433 INFO:tasks.workunit.client.1.smithi161.stdout:6/353: mknod da/d55/c80 0 2023-12-09T02:35:12.434 INFO:tasks.workunit.client.1.smithi161.stdout:5/342: sync 2023-12-09T02:35:12.434 INFO:tasks.workunit.client.1.smithi161.stdout:4/390: sync 2023-12-09T02:35:12.434 INFO:tasks.workunit.client.1.smithi161.stdout:9/326: sync 2023-12-09T02:35:12.434 INFO:tasks.workunit.client.1.smithi161.stdout:0/374: sync 2023-12-09T02:35:12.434 INFO:tasks.workunit.client.1.smithi161.stdout:0/375: truncate d9/dd/f53 494910 0 2023-12-09T02:35:12.434 INFO:tasks.workunit.client.1.smithi161.stdout:2/375: sync 2023-12-09T02:35:12.434 INFO:tasks.workunit.client.1.smithi161.stdout:0/376: chown d9/d25/f38 33692779 1 2023-12-09T02:35:12.439 INFO:tasks.workunit.client.1.smithi161.stdout:6/354: mknod da/d19/d20/d60/c81 0 2023-12-09T02:35:12.439 INFO:tasks.workunit.client.1.smithi161.stdout:6/355: write da/d28/d29/f58 [204231,113884] 0 2023-12-09T02:35:12.439 INFO:tasks.workunit.client.1.smithi161.stdout:6/356: chown da/d28/d29/d2b/d31/d33 56651 1 2023-12-09T02:35:12.443 INFO:tasks.workunit.client.1.smithi161.stdout:4/391: dread dd/d1a/d1d/d25/f52 [0,4194304] 0 2023-12-09T02:35:12.443 INFO:tasks.workunit.client.1.smithi161.stdout:4/392: fdatasync dd/d1a/d1d/d25/f2f 0 2023-12-09T02:35:12.444 INFO:tasks.workunit.client.1.smithi161.stdout:5/343: mknod d0/d2/d5f/c7c 0 2023-12-09T02:35:12.446 INFO:tasks.workunit.client.1.smithi161.stdout:0/377: rmdir d9 39 2023-12-09T02:35:12.447 INFO:tasks.workunit.client.1.smithi161.stdout:2/376: creat d4/d16/f82 x:0 0 0 2023-12-09T02:35:12.447 INFO:tasks.workunit.client.1.smithi161.stdout:2/377: fdatasync d4/d7/f45 0 2023-12-09T02:35:12.448 INFO:tasks.workunit.client.1.smithi161.stdout:0/378: dread d9/d25/f6c [0,4194304] 0 2023-12-09T02:35:12.448 INFO:tasks.workunit.client.1.smithi161.stdout:8/364: getdents d2/d5/d22/d31/d38 0 2023-12-09T02:35:12.451 INFO:tasks.workunit.client.1.smithi161.stdout:8/365: write d2/d5/d22/d31/f39 [1599259,96952] 0 2023-12-09T02:35:12.451 INFO:tasks.workunit.client.1.smithi161.stdout:2/378: write d4/d7/f31 [316382,130496] 0 2023-12-09T02:35:12.451 INFO:tasks.workunit.client.1.smithi161.stdout:2/379: write d4/d7/db/f1d [2092743,42019] 0 2023-12-09T02:35:12.451 INFO:tasks.workunit.client.1.smithi161.stdout:2/380: write d4/d1a/d4a/d4f/f57 [373982,80968] 0 2023-12-09T02:35:12.451 INFO:tasks.workunit.client.1.smithi161.stdout:2/381: write d4/d1a/f35 [66763,80029] 0 2023-12-09T02:35:12.451 INFO:tasks.workunit.client.1.smithi161.stdout:2/382: fsync d4/d16/f29 0 2023-12-09T02:35:12.452 INFO:tasks.workunit.client.1.smithi161.stdout:2/383: truncate d4/d7/db/f1d 2890094 0 2023-12-09T02:35:12.452 INFO:tasks.workunit.client.1.smithi161.stdout:2/384: stat d4/d1a/f40 0 2023-12-09T02:35:12.452 INFO:tasks.workunit.client.1.smithi161.stdout:9/327: dwrite d2/d25/d3a/d65/d42/d58/f1e [0,4194304] 0 2023-12-09T02:35:12.452 INFO:tasks.workunit.client.1.smithi161.stdout:6/357: mknod da/d28/d29/d2b/c82 0 2023-12-09T02:35:12.458 INFO:tasks.workunit.client.1.smithi161.stdout:0/379: dread d9/d55/d26/f42 [0,4194304] 0 2023-12-09T02:35:12.463 INFO:tasks.workunit.client.1.smithi161.stdout:4/393: write dd/d1a/d1d/d25/d32/d34/f46 [421107,72281] 0 2023-12-09T02:35:12.463 INFO:tasks.workunit.client.1.smithi161.stdout:4/394: chown dd/d36/d4a/f51 1196598984 1 2023-12-09T02:35:12.469 INFO:tasks.workunit.client.1.smithi161.stdout:8/366: getdents d2/d5/d22 0 2023-12-09T02:35:12.470 INFO:tasks.workunit.client.1.smithi161.stdout:8/367: read - d2/d2d/f70 zero size 2023-12-09T02:35:12.470 INFO:tasks.workunit.client.1.smithi161.stdout:8/368: readlink d2/d5/d4f/l27 0 2023-12-09T02:35:12.475 INFO:tasks.workunit.client.1.smithi161.stdout:2/385: symlink d4/d1a/l83 0 2023-12-09T02:35:12.476 INFO:tasks.workunit.client.1.smithi161.stdout:2/386: stat d4/d7/f13 0 2023-12-09T02:35:12.476 INFO:tasks.workunit.client.1.smithi161.stdout:9/328: unlink d2/d25/l44 0 2023-12-09T02:35:12.476 INFO:tasks.workunit.client.1.smithi161.stdout:9/329: chown d2/d25/l28 182 1 2023-12-09T02:35:12.476 INFO:tasks.workunit.client.1.smithi161.stdout:4/395: unlink dd/d1a/d1d/d25/c48 0 2023-12-09T02:35:12.476 INFO:tasks.workunit.client.1.smithi161.stdout:4/396: truncate dd/d1a/d29/f5d 4990 0 2023-12-09T02:35:12.477 INFO:tasks.workunit.client.1.smithi161.stdout:8/369: creat d2/d5/d22/f77 x:0 0 0 2023-12-09T02:35:12.479 INFO:tasks.workunit.client.1.smithi161.stdout:8/370: fsync d2/d5/d22/d31/d38/d48/f75 0 2023-12-09T02:35:12.483 INFO:tasks.workunit.client.1.smithi161.stdout:0/380: dwrite d9/d25/f33 [0,4194304] 0 2023-12-09T02:35:12.483 INFO:tasks.workunit.client.1.smithi161.stdout:8/371: rename d2/d5/f33 to d2/d5/d22/d31/d38/d48/d4e/f78 0 2023-12-09T02:35:12.483 INFO:tasks.workunit.client.1.smithi161.stdout:8/372: write d2/d5/d4f/f29 [377480,78938] 0 2023-12-09T02:35:12.489 INFO:tasks.workunit.client.1.smithi161.stdout:6/358: dwrite da/f2c [0,4194304] 0 2023-12-09T02:35:12.490 INFO:tasks.workunit.client.1.smithi161.stdout:2/387: dread d4/fa [0,4194304] 0 2023-12-09T02:35:12.490 INFO:tasks.workunit.client.1.smithi161.stdout:6/359: dread - da/d28/d29/f6e zero size 2023-12-09T02:35:12.490 INFO:tasks.workunit.client.1.smithi161.stdout:6/360: readlink da/d28/d3c/d46/l4b 0 2023-12-09T02:35:12.490 INFO:tasks.workunit.client.1.smithi161.stdout:6/361: write da/d28/d29/d2b/d31/f66 [454816,110731] 0 2023-12-09T02:35:12.490 INFO:tasks.workunit.client.1.smithi161.stdout:6/362: write da/df/d2d/d49/f4c [633453,52472] 0 2023-12-09T02:35:12.490 INFO:tasks.workunit.client.1.smithi161.stdout:6/363: readlink da/d28/d3c/d46/l5a 0 2023-12-09T02:35:12.491 INFO:tasks.workunit.client.1.smithi161.stdout:5/344: dwrite d0/d2/de/d44/f43 [0,4194304] 0 2023-12-09T02:35:12.491 INFO:tasks.workunit.client.1.smithi161.stdout:5/345: dread - d0/d2/de/d22/f54 zero size 2023-12-09T02:35:12.491 INFO:tasks.workunit.client.1.smithi161.stdout:2/388: mknod d4/d7/c84 0 2023-12-09T02:35:12.492 INFO:tasks.workunit.client.1.smithi161.stdout:6/364: symlink da/d19/d20/d60/l83 0 2023-12-09T02:35:12.493 INFO:tasks.workunit.client.1.smithi161.stdout:5/346: rename d0/d2/de/l4f to d0/d2/d7/d70/l7d 0 2023-12-09T02:35:12.493 INFO:tasks.workunit.client.1.smithi161.stdout:5/347: read d0/f3d [2652572,12488] 0 2023-12-09T02:35:12.494 INFO:tasks.workunit.client.1.smithi161.stdout:4/397: dwrite dd/d1a/d1d/f49 [0,4194304] 0 2023-12-09T02:35:12.497 INFO:tasks.workunit.client.1.smithi161.stdout:5/348: write d0/f1 [1146837,51040] 0 2023-12-09T02:35:12.499 INFO:tasks.workunit.client.1.smithi161.stdout:0/381: write d9/d25/f4e [2224744,64627] 0 2023-12-09T02:35:12.511 INFO:tasks.workunit.client.1.smithi161.stdout:8/373: dwrite d2/d5/d22/d31/d38/d48/f5a [0,4194304] 0 2023-12-09T02:35:12.511 INFO:tasks.workunit.client.1.smithi161.stdout:9/330: dwrite d2/d25/d3a/d65/d42/d58/d22/f2d [0,4194304] 0 2023-12-09T02:35:12.516 INFO:tasks.workunit.client.1.smithi161.stdout:8/374: dread d2/d5/d22/d31/f58 [0,4194304] 0 2023-12-09T02:35:12.516 INFO:tasks.workunit.client.1.smithi161.stdout:8/375: fdatasync d2/d5/d4f/f52 0 2023-12-09T02:35:12.528 INFO:tasks.workunit.client.1.smithi161.stdout:9/331: dwrite d2/d25/d3a/d65/d5c/f56 [4194304,4194304] 0 2023-12-09T02:35:12.529 INFO:tasks.workunit.client.1.smithi161.stdout:9/332: truncate d2/d25/d3a/d65/f43 78966 0 2023-12-09T02:35:12.534 INFO:tasks.workunit.client.1.smithi161.stdout:2/389: symlink d4/d7/d79/d5a/l85 0 2023-12-09T02:35:12.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/390: write d4/d16/f29 [999431,78179] 0 2023-12-09T02:35:12.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/391: readlink d4/d1a/l83 0 2023-12-09T02:35:12.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/392: chown d4/f41 514392 1 2023-12-09T02:35:12.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/393: fsync d4/d7/f31 0 2023-12-09T02:35:12.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/394: write d4/d7/db/f67 [1472080,108435] 0 2023-12-09T02:35:12.535 INFO:tasks.workunit.client.1.smithi161.stdout:6/365: truncate da/fd 1056743 0 2023-12-09T02:35:12.536 INFO:tasks.workunit.client.1.smithi161.stdout:5/349: rename d0/d2/de/f5e to d0/d2/d7/d51/f7e 0 2023-12-09T02:35:12.537 INFO:tasks.workunit.client.1.smithi161.stdout:5/350: write d0/d2/d7/df/d60/f6e [189367,108138] 0 2023-12-09T02:35:12.538 INFO:tasks.workunit.client.1.smithi161.stdout:0/382: unlink d9/d55/d26/f4d 0 2023-12-09T02:35:12.543 INFO:tasks.workunit.client.1.smithi161.stdout:8/376: creat d2/d5/d22/d31/d38/f79 x:0 0 0 2023-12-09T02:35:12.544 INFO:tasks.workunit.client.1.smithi161.stdout:6/366: dread da/f12 [0,4194304] 0 2023-12-09T02:35:12.548 INFO:tasks.workunit.client.1.smithi161.stdout:9/333: unlink d2/d25/d3a/d65/f69 0 2023-12-09T02:35:12.548 INFO:tasks.workunit.client.1.smithi161.stdout:9/334: write d2/f19 [1944158,55720] 0 2023-12-09T02:35:12.550 INFO:tasks.workunit.client.1.smithi161.stdout:2/395: mkdir d4/d7/d79/d5a/d86 0 2023-12-09T02:35:12.552 INFO:tasks.workunit.client.1.smithi161.stdout:5/351: mknod d0/c7f 0 2023-12-09T02:35:12.556 INFO:tasks.workunit.client.1.smithi161.stdout:8/377: link d2/d5/l11 d2/d5/d22/d31/d38/d66/l7a 0 2023-12-09T02:35:12.561 INFO:tasks.workunit.client.1.smithi161.stdout:9/335: rmdir d2/d25/d3a/d65/d42 39 2023-12-09T02:35:12.561 INFO:tasks.workunit.client.1.smithi161.stdout:9/336: fsync d2/d25/d3a/d65/d42/d58/d16/d51/f6b 0 2023-12-09T02:35:12.562 INFO:tasks.workunit.client.1.smithi161.stdout:0/383: mkdir d9/dd/d71 0 2023-12-09T02:35:12.562 INFO:tasks.workunit.client.1.smithi161.stdout:0/384: dread - d9/db/d2a/d35/d4a/f63 zero size 2023-12-09T02:35:12.565 INFO:tasks.workunit.client.1.smithi161.stdout:6/367: link da/d55/l64 da/l84 0 2023-12-09T02:35:12.567 INFO:tasks.workunit.client.1.smithi161.stdout:9/337: mknod d2/d25/d3a/d65/d5c/d55/c70 0 2023-12-09T02:35:12.567 INFO:tasks.workunit.client.1.smithi161.stdout:9/338: write d2/d25/d3a/d65/f49 [1616214,16977] 0 2023-12-09T02:35:12.568 INFO:tasks.workunit.client.1.smithi161.stdout:9/339: write d2/f1b [4947981,47661] 0 2023-12-09T02:35:12.569 INFO:tasks.workunit.client.1.smithi161.stdout:0/385: symlink d9/d5b/l72 0 2023-12-09T02:35:12.572 INFO:tasks.workunit.client.1.smithi161.stdout:6/368: rename da/d19/d20/d60 to da/d55/d6d/d85 0 2023-12-09T02:35:12.573 INFO:tasks.workunit.client.1.smithi161.stdout:2/396: dwrite d4/d7/fc [0,4194304] 0 2023-12-09T02:35:12.573 INFO:tasks.workunit.client.1.smithi161.stdout:5/352: dwrite d0/d2/de/d22/f59 [8388608,4194304] 0 2023-12-09T02:35:12.574 INFO:tasks.workunit.client.1.smithi161.stdout:5/353: dread d0/d2/f57 [0,4194304] 0 2023-12-09T02:35:12.575 INFO:tasks.workunit.client.1.smithi161.stdout:9/340: mkdir d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/d71 0 2023-12-09T02:35:12.580 INFO:tasks.workunit.client.1.smithi161.stdout:0/386: creat d9/d25/f73 x:0 0 0 2023-12-09T02:35:12.583 INFO:tasks.workunit.client.1.smithi161.stdout:6/369: unlink da/d28/d29/d2b/l6b 0 2023-12-09T02:35:12.583 INFO:tasks.workunit.client.1.smithi161.stdout:6/370: write da/d55/f5f [980474,110837] 0 2023-12-09T02:35:12.583 INFO:tasks.workunit.client.1.smithi161.stdout:6/371: stat da/d28/d3c/c41 0 2023-12-09T02:35:12.589 INFO:tasks.workunit.client.1.smithi161.stdout:5/354: symlink d0/d2/d7/d51/l80 0 2023-12-09T02:35:12.591 INFO:tasks.workunit.client.1.smithi161.stdout:2/397: dwrite d4/d7/f31 [0,4194304] 0 2023-12-09T02:35:12.591 INFO:tasks.workunit.client.1.smithi161.stdout:2/398: chown d4/d1a/d4a/d4f/f75 31925747 1 2023-12-09T02:35:12.593 INFO:tasks.workunit.client.1.smithi161.stdout:0/387: link d9/db/f3e d9/d25/f74 0 2023-12-09T02:35:12.593 INFO:tasks.workunit.client.1.smithi161.stdout:0/388: fdatasync d9/d25/f6c 0 2023-12-09T02:35:12.595 INFO:tasks.workunit.client.1.smithi161.stdout:6/372: link da/d28/d29/f6e da/d55/f86 0 2023-12-09T02:35:12.596 INFO:tasks.workunit.client.1.smithi161.stdout:5/355: creat d0/d1f/f81 x:0 0 0 2023-12-09T02:35:12.597 INFO:tasks.workunit.client.1.smithi161.stdout:5/356: write d0/f1 [5906694,67699] 0 2023-12-09T02:35:12.599 INFO:tasks.workunit.client.1.smithi161.stdout:2/399: getdents d4/d7 0 2023-12-09T02:35:12.600 INFO:tasks.workunit.client.1.smithi161.stdout:0/389: unlink d9/db/d2a/d35/d4a/l5d 0 2023-12-09T02:35:12.603 INFO:tasks.workunit.client.1.smithi161.stdout:5/357: mkdir d0/d2/d7/df/d82 0 2023-12-09T02:35:12.605 INFO:tasks.workunit.client.1.smithi161.stdout:2/400: rename d4/d7/d79/d63 to d4/d7/d79/d87 0 2023-12-09T02:35:12.606 INFO:tasks.workunit.client.1.smithi161.stdout:0/390: mkdir d9/db/d2a/d75 0 2023-12-09T02:35:12.607 INFO:tasks.workunit.client.1.smithi161.stdout:5/358: unlink d0/d2/de/d21/f28 0 2023-12-09T02:35:12.609 INFO:tasks.workunit.client.1.smithi161.stdout:6/373: dwrite da/df/f13 [0,4194304] 0 2023-12-09T02:35:12.609 INFO:tasks.workunit.client.1.smithi161.stdout:2/401: creat d4/d16/f88 x:0 0 0 2023-12-09T02:35:12.609 INFO:tasks.workunit.client.1.smithi161.stdout:2/402: write d4/d16/f88 [274281,110797] 0 2023-12-09T02:35:12.610 INFO:tasks.workunit.client.1.smithi161.stdout:2/403: fdatasync f1 0 2023-12-09T02:35:12.610 INFO:tasks.workunit.client.1.smithi161.stdout:0/391: mknod d9/d55/d5a/c76 0 2023-12-09T02:35:12.612 INFO:tasks.workunit.client.1.smithi161.stdout:5/359: mkdir d0/d2/d7/df/d60/d83 0 2023-12-09T02:35:12.614 INFO:tasks.workunit.client.1.smithi161.stdout:5/360: read d0/f27 [2335464,54578] 0 2023-12-09T02:35:12.614 INFO:tasks.workunit.client.1.smithi161.stdout:5/361: read - d0/f69 zero size 2023-12-09T02:35:12.615 INFO:tasks.workunit.client.1.smithi161.stdout:6/374: unlink da/d28/d29/d2b/d31/d33/f3e 0 2023-12-09T02:35:12.616 INFO:tasks.workunit.client.1.smithi161.stdout:0/392: truncate d9/d55/d26/f57 901669 0 2023-12-09T02:35:12.617 INFO:tasks.workunit.client.1.smithi161.stdout:6/375: creat da/d28/d3c/d46/f87 x:0 0 0 2023-12-09T02:35:12.619 INFO:tasks.workunit.client.1.smithi161.stdout:5/362: dread d0/d9/f6a [0,4194304] 0 2023-12-09T02:35:12.619 INFO:tasks.workunit.client.1.smithi161.stdout:6/376: rename da/df/c17 to da/d55/c88 0 2023-12-09T02:35:12.620 INFO:tasks.workunit.client.1.smithi161.stdout:0/393: link d9/dd/d3a/f52 d9/dd/f77 0 2023-12-09T02:35:12.621 INFO:tasks.workunit.client.1.smithi161.stdout:5/363: creat d0/d1f/f84 x:0 0 0 2023-12-09T02:35:12.623 INFO:tasks.workunit.client.1.smithi161.stdout:0/394: dread d9/f20 [0,4194304] 0 2023-12-09T02:35:12.626 INFO:tasks.workunit.client.1.smithi161.stdout:2/404: dwrite d4/d1a/f3f [0,4194304] 0 2023-12-09T02:35:12.635 INFO:tasks.workunit.client.1.smithi161.stdout:9/341: getdents d2/d25/d3a/d65/d42/d58/d16/d2e/d3f 0 2023-12-09T02:35:12.635 INFO:tasks.workunit.client.1.smithi161.stdout:9/342: readlink d2/l41 0 2023-12-09T02:35:12.635 INFO:tasks.workunit.client.1.smithi161.stdout:9/343: write d2/f3e [1004198,128851] 0 2023-12-09T02:35:12.636 INFO:tasks.workunit.client.1.smithi161.stdout:9/344: read d2/d25/d3a/d65/f49 [3347341,119471] 0 2023-12-09T02:35:12.638 INFO:tasks.workunit.client.1.smithi161.stdout:9/345: creat d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/f72 x:0 0 0 2023-12-09T02:35:12.639 INFO:tasks.workunit.client.1.smithi161.stdout:9/346: readlink d2/l6a 0 2023-12-09T02:35:12.639 INFO:tasks.workunit.client.1.smithi161.stdout:9/347: fdatasync d2/d25/d3a/d65/d42/d58/f1e 0 2023-12-09T02:35:12.639 INFO:tasks.workunit.client.1.smithi161.stdout:9/348: read - d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/f72 zero size 2023-12-09T02:35:12.640 INFO:tasks.workunit.client.1.smithi161.stdout:9/349: rename d2/d25/d3a/d65/d5c/c6d to d2/d25/c73 0 2023-12-09T02:35:12.642 INFO:tasks.workunit.client.1.smithi161.stdout:1/547: sync 2023-12-09T02:35:12.642 INFO:tasks.workunit.client.1.smithi161.stdout:1/548: fsync d6/d8/d63/d35/d3d/f96 0 2023-12-09T02:35:12.642 INFO:tasks.workunit.client.1.smithi161.stdout:3/347: sync 2023-12-09T02:35:12.642 INFO:tasks.workunit.client.1.smithi161.stdout:9/350: symlink d2/d25/d3a/d65/l74 0 2023-12-09T02:35:12.642 INFO:tasks.workunit.client.1.smithi161.stdout:9/351: write d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/f72 [547493,54913] 0 2023-12-09T02:35:12.643 INFO:tasks.workunit.client.1.smithi161.stdout:9/352: write d2/d25/d3a/d65/d42/d58/f21 [3133737,118869] 0 2023-12-09T02:35:12.644 INFO:tasks.workunit.client.1.smithi161.stdout:7/512: sync 2023-12-09T02:35:12.645 INFO:tasks.workunit.client.1.smithi161.stdout:1/549: rmdir d6/d8/d63/d35 39 2023-12-09T02:35:12.646 INFO:tasks.workunit.client.1.smithi161.stdout:3/348: write d2/d4/d11/d1f/f25 [1889546,128111] 0 2023-12-09T02:35:12.646 INFO:tasks.workunit.client.1.smithi161.stdout:3/349: readlink d2/d4/d11/d1f/l4a 0 2023-12-09T02:35:12.647 INFO:tasks.workunit.client.1.smithi161.stdout:9/353: rename d2/d25/d3a/d65/f49 to d2/d25/d3a/d65/d42/d58/f75 0 2023-12-09T02:35:12.648 INFO:tasks.workunit.client.1.smithi161.stdout:7/513: symlink d0/d3/d13/la4 0 2023-12-09T02:35:12.663 INFO:tasks.workunit.client.1.smithi161.stdout:5/364: dwrite d0/d2/de/d21/f73 [0,4194304] 0 2023-12-09T02:35:12.663 INFO:tasks.workunit.client.1.smithi161.stdout:5/365: write d0/f27 [4605114,63235] 0 2023-12-09T02:35:12.663 INFO:tasks.workunit.client.1.smithi161.stdout:9/354: fdatasync d2/d25/d3a/d65/d42/d58/f75 0 2023-12-09T02:35:12.663 INFO:tasks.workunit.client.1.smithi161.stdout:6/377: dwrite da/d28/d29/d2b/d31/f51 [4194304,4194304] 0 2023-12-09T02:35:12.663 INFO:tasks.workunit.client.1.smithi161.stdout:3/350: dread d2/fe [0,4194304] 0 2023-12-09T02:35:12.663 INFO:tasks.workunit.client.1.smithi161.stdout:2/405: dwrite d4/d7/d79/f6b [0,4194304] 0 2023-12-09T02:35:12.664 INFO:tasks.workunit.client.1.smithi161.stdout:6/378: read f1 [1271231,34267] 0 2023-12-09T02:35:12.664 INFO:tasks.workunit.client.1.smithi161.stdout:5/366: read d0/f3d [126652,118416] 0 2023-12-09T02:35:12.664 INFO:tasks.workunit.client.1.smithi161.stdout:5/367: write d0/d1f/f84 [674482,58086] 0 2023-12-09T02:35:12.664 INFO:tasks.workunit.client.1.smithi161.stdout:5/368: chown d0/d2/d7/df/c47 223 1 2023-12-09T02:35:12.666 INFO:tasks.workunit.client.1.smithi161.stdout:0/395: dwrite d9/db/d2a/d35/d4a/f63 [0,4194304] 0 2023-12-09T02:35:12.668 INFO:tasks.workunit.client.1.smithi161.stdout:2/406: write d4/d7/f31 [1891827,58303] 0 2023-12-09T02:35:12.671 INFO:tasks.workunit.client.1.smithi161.stdout:1/550: dwrite d6/d8/d63/d93/f14 [0,4194304] 0 2023-12-09T02:35:12.677 INFO:tasks.workunit.client.1.smithi161.stdout:3/351: symlink d2/d4/l5f 0 2023-12-09T02:35:12.677 INFO:tasks.workunit.client.1.smithi161.stdout:3/352: chown d2/d4/d11/d1f/l43 269 1 2023-12-09T02:35:12.694 INFO:tasks.workunit.client.1.smithi161.stdout:0/396: dread d9/d25/f4e [0,4194304] 0 2023-12-09T02:35:12.694 INFO:tasks.workunit.client.1.smithi161.stdout:0/397: truncate d9/d55/f51 915025 0 2023-12-09T02:35:12.694 INFO:tasks.workunit.client.1.smithi161.stdout:0/398: read - d9/dd/d3a/f54 zero size 2023-12-09T02:35:12.694 INFO:tasks.workunit.client.1.smithi161.stdout:0/399: truncate d9/d25/f6b 270937 0 2023-12-09T02:35:12.694 INFO:tasks.workunit.client.1.smithi161.stdout:0/400: stat d9/dd/f61 0 2023-12-09T02:35:12.694 INFO:tasks.workunit.client.1.smithi161.stdout:0/401: chown d9/dd/l45 1 1 2023-12-09T02:35:12.699 INFO:tasks.workunit.client.1.smithi161.stdout:6/379: dwrite da/f1a [0,4194304] 0 2023-12-09T02:35:12.699 INFO:tasks.workunit.client.1.smithi161.stdout:6/380: write da/d28/d29/f45 [1433771,118677] 0 2023-12-09T02:35:12.701 INFO:tasks.workunit.client.1.smithi161.stdout:2/407: dwrite d4/d1a/d4a/d6d/f7a [0,4194304] 0 2023-12-09T02:35:12.701 INFO:tasks.workunit.client.1.smithi161.stdout:5/369: dwrite d0/d1f/f3b [0,4194304] 0 2023-12-09T02:35:12.714 INFO:tasks.workunit.client.1.smithi161.stdout:2/408: dwrite d4/d7/db/f62 [0,4194304] 0 2023-12-09T02:35:12.714 INFO:tasks.workunit.client.1.smithi161.stdout:2/409: chown d4/d1a/d4a/d6d/f7a 30542 1 2023-12-09T02:35:12.714 INFO:tasks.workunit.client.1.smithi161.stdout:1/551: creat d6/d8/d63/d4d/d31/d73/fb7 x:0 0 0 2023-12-09T02:35:12.714 INFO:tasks.workunit.client.1.smithi161.stdout:2/410: write f1 [32896,88008] 0 2023-12-09T02:35:12.715 INFO:tasks.workunit.client.1.smithi161.stdout:3/353: creat d2/d4/d11/d1f/d2a/d46/d2d/d47/f60 x:0 0 0 2023-12-09T02:35:12.717 INFO:tasks.workunit.client.1.smithi161.stdout:0/402: getdents d9/d55/d26/d28 0 2023-12-09T02:35:12.718 INFO:tasks.workunit.client.1.smithi161.stdout:3/354: write d2/d4/d11/d1f/d2a/f2f [967349,77955] 0 2023-12-09T02:35:12.718 INFO:tasks.workunit.client.1.smithi161.stdout:6/381: rmdir da/d55/d6d/d85 39 2023-12-09T02:35:12.718 INFO:tasks.workunit.client.1.smithi161.stdout:6/382: write da/d19/f1b [2087657,58877] 0 2023-12-09T02:35:12.730 INFO:tasks.workunit.client.1.smithi161.stdout:5/370: getdents d0/d2 0 2023-12-09T02:35:12.733 INFO:tasks.workunit.client.1.smithi161.stdout:1/552: mknod d6/d8/cb8 0 2023-12-09T02:35:12.733 INFO:tasks.workunit.client.1.smithi161.stdout:1/553: chown d6/d8/d63/d35/daa/la8 43612 1 2023-12-09T02:35:12.733 INFO:tasks.workunit.client.1.smithi161.stdout:1/554: getdents d6/d8/d63/d4d/d31/dab 0 2023-12-09T02:35:12.733 INFO:tasks.workunit.client.1.smithi161.stdout:3/355: dwrite d2/d4/d11/d1f/d2a/d46/d3e/f59 [0,4194304] 0 2023-12-09T02:35:12.733 INFO:tasks.workunit.client.1.smithi161.stdout:2/411: write d4/d16/d69/d7b/f52 [580689,22223] 0 2023-12-09T02:35:12.734 INFO:tasks.workunit.client.1.smithi161.stdout:0/403: rmdir d9/d5b 39 2023-12-09T02:35:12.736 INFO:tasks.workunit.client.1.smithi161.stdout:6/383: creat da/d28/d4d/d5e/f89 x:0 0 0 2023-12-09T02:35:12.736 INFO:tasks.workunit.client.1.smithi161.stdout:6/384: symlink da/d28/d3c/d46/l8a 2 2023-12-09T02:35:12.740 INFO:tasks.workunit.client.1.smithi161.stdout:1/555: rename d6/l33 to d6/d8/d63/d4d/d31/d80/d87/lb9 0 2023-12-09T02:35:12.741 INFO:tasks.workunit.client.1.smithi161.stdout:3/356: creat d2/d4/d11/d1f/d4c/f61 x:0 0 0 2023-12-09T02:35:12.743 INFO:tasks.workunit.client.1.smithi161.stdout:2/412: mknod d4/d16/c89 0 2023-12-09T02:35:12.745 INFO:tasks.workunit.client.1.smithi161.stdout:1/556: truncate d6/d8/d63/d1c/f1e 217164 0 2023-12-09T02:35:12.745 INFO:tasks.workunit.client.1.smithi161.stdout:3/357: mknod d2/d4/d11/d1f/c62 0 2023-12-09T02:35:12.752 INFO:tasks.workunit.client.1.smithi161.stdout:1/557: dread d6/d8/d63/d93/f48 [0,4194304] 0 2023-12-09T02:35:12.752 INFO:tasks.workunit.client.1.smithi161.stdout:6/385: dread da/d19/f50 [0,4194304] 0 2023-12-09T02:35:12.754 INFO:tasks.workunit.client.1.smithi161.stdout:1/558: truncate d6/d8/d63/d35/daa/f6b 93352 0 2023-12-09T02:35:12.757 INFO:tasks.workunit.client.1.smithi161.stdout:0/404: dwrite d9/d25/f73 [0,4194304] 0 2023-12-09T02:35:12.759 INFO:tasks.workunit.client.1.smithi161.stdout:6/386: symlink da/d28/d29/l8b 0 2023-12-09T02:35:12.761 INFO:tasks.workunit.client.1.smithi161.stdout:2/413: dread d4/d7/f45 [0,4194304] 0 2023-12-09T02:35:12.761 INFO:tasks.workunit.client.1.smithi161.stdout:5/371: dwrite d0/d1f/f65 [0,4194304] 0 2023-12-09T02:35:12.766 INFO:tasks.workunit.client.1.smithi161.stdout:5/372: creat d0/d2/de/d21/f85 x:0 0 0 2023-12-09T02:35:12.773 INFO:tasks.workunit.client.1.smithi161.stdout:5/373: mknod d0/d2/d5f/c86 0 2023-12-09T02:35:12.778 INFO:tasks.workunit.client.1.smithi161.stdout:5/374: rename d0/d2/d5f/l6d to d0/d2/de/d22/l87 0 2023-12-09T02:35:12.783 INFO:tasks.workunit.client.1.smithi161.stdout:0/405: dwrite d9/db/d2a/d35/d4a/f63 [0,4194304] 0 2023-12-09T02:35:12.783 INFO:tasks.workunit.client.1.smithi161.stdout:5/375: creat d0/d1f/f88 x:0 0 0 2023-12-09T02:35:12.785 INFO:tasks.workunit.client.1.smithi161.stdout:5/376: write d0/d2/d7/d51/f71 [3861495,27466] 0 2023-12-09T02:35:12.786 INFO:tasks.workunit.client.1.smithi161.stdout:6/387: truncate da/df/f13 4297358 0 2023-12-09T02:35:12.787 INFO:tasks.workunit.client.1.smithi161.stdout:6/388: write da/d28/d29/f62 [431503,83118] 0 2023-12-09T02:35:12.787 INFO:tasks.workunit.client.1.smithi161.stdout:6/389: fdatasync da/d28/d29/f58 0 2023-12-09T02:35:12.790 INFO:tasks.workunit.client.1.smithi161.stdout:0/406: rename d9/d55/d26/l3b to d9/db/l78 0 2023-12-09T02:35:12.790 INFO:tasks.workunit.client.1.smithi161.stdout:0/407: write d9/d25/f2d [507754,37316] 0 2023-12-09T02:35:12.797 INFO:tasks.workunit.client.1.smithi161.stdout:2/414: dwrite d4/d7/d79/d5a/f71 [0,4194304] 0 2023-12-09T02:35:12.801 INFO:tasks.workunit.client.1.smithi161.stdout:2/415: dread d4/d7/db/f55 [0,4194304] 0 2023-12-09T02:35:12.801 INFO:tasks.workunit.client.1.smithi161.stdout:2/416: truncate d4/d1a/d4a/d6d/f7a 4463178 0 2023-12-09T02:35:12.801 INFO:tasks.workunit.client.1.smithi161.stdout:5/377: rename d0/d9/f6c to d0/d2/de/f89 0 2023-12-09T02:35:12.802 INFO:tasks.workunit.client.1.smithi161.stdout:5/378: write d0/d2/f57 [1246890,17055] 0 2023-12-09T02:35:12.804 INFO:tasks.workunit.client.1.smithi161.stdout:0/408: link d9/dd/d3a/f52 d9/db/d2a/d35/d4a/f79 0 2023-12-09T02:35:12.809 INFO:tasks.workunit.client.1.smithi161.stdout:2/417: rename d4/d1a/c1c to d4/d16/c8a 0 2023-12-09T02:35:12.811 INFO:tasks.workunit.client.1.smithi161.stdout:5/379: mkdir d0/d2/d7/d11/d50/d8a 0 2023-12-09T02:35:12.813 INFO:tasks.workunit.client.1.smithi161.stdout:6/390: dwrite da/fd [0,4194304] 0 2023-12-09T02:35:12.816 INFO:tasks.workunit.client.1.smithi161.stdout:5/380: mknod d0/d2/de/c8b 0 2023-12-09T02:35:12.816 INFO:tasks.workunit.client.1.smithi161.stdout:5/381: stat d0/d9/f6a 0 2023-12-09T02:35:12.816 INFO:tasks.workunit.client.1.smithi161.stdout:0/409: write d9/d1f/f49 [220279,49230] 0 2023-12-09T02:35:12.820 INFO:tasks.workunit.client.1.smithi161.stdout:6/391: creat da/f8c x:0 0 0 2023-12-09T02:35:12.823 INFO:tasks.workunit.client.1.smithi161.stdout:2/418: dread d4/d7/d79/d5a/f71 [0,4194304] 0 2023-12-09T02:35:12.823 INFO:tasks.workunit.client.1.smithi161.stdout:6/392: dread da/df/d2d/d49/f4c [0,4194304] 0 2023-12-09T02:35:12.826 INFO:tasks.workunit.client.1.smithi161.stdout:5/382: rename d0/d2/d7/d51/f6b to d0/d2/d7/d11/d50/f8c 0 2023-12-09T02:35:12.827 INFO:tasks.workunit.client.1.smithi161.stdout:0/410: mkdir d9/d25/d7a 0 2023-12-09T02:35:12.830 INFO:tasks.workunit.client.1.smithi161.stdout:0/411: read d9/d25/f38 [1271090,128407] 0 2023-12-09T02:35:12.833 INFO:tasks.workunit.client.1.smithi161.stdout:2/419: truncate d4/f30 791810 0 2023-12-09T02:35:12.833 INFO:tasks.workunit.client.1.smithi161.stdout:6/393: mknod da/df/d2d/d3b/c8d 0 2023-12-09T02:35:12.833 INFO:tasks.workunit.client.1.smithi161.stdout:5/383: symlink d0/d2/d7/l8d 0 2023-12-09T02:35:12.835 INFO:tasks.workunit.client.1.smithi161.stdout:0/412: rename d9/db/d2a/d75 to d9/db/d2a/d35/d7b 0 2023-12-09T02:35:12.835 INFO:tasks.workunit.client.1.smithi161.stdout:0/413: stat d9/d55/d26/d28/c31 0 2023-12-09T02:35:12.841 INFO:tasks.workunit.client.1.smithi161.stdout:6/394: symlink da/d28/d4d/d5e/l8e 0 2023-12-09T02:35:12.851 INFO:tasks.workunit.client.1.smithi161.stdout:3/358: rmdir d2/d4/d11/d1f/d2a/d46/d2d 39 2023-12-09T02:35:12.855 INFO:tasks.workunit.client.1.smithi161.stdout:0/414: dwrite d9/d55/d26/d28/f68 [0,4194304] 0 2023-12-09T02:35:12.856 INFO:tasks.workunit.client.1.smithi161.stdout:0/415: write d9/dd/f53 [424798,125091] 0 2023-12-09T02:35:12.857 INFO:tasks.workunit.client.1.smithi161.stdout:2/420: symlink d4/d16/d69/d7b/l8b 0 2023-12-09T02:35:12.860 INFO:tasks.workunit.client.1.smithi161.stdout:2/421: rename d4/d7/d79 to d4/d16/d69/d8c 0 2023-12-09T02:35:12.861 INFO:tasks.workunit.client.1.smithi161.stdout:6/395: mknod da/c8f 0 2023-12-09T02:35:12.866 INFO:tasks.workunit.client.1.smithi161.stdout:2/422: mknod d4/d1a/c8d 0 2023-12-09T02:35:12.868 INFO:tasks.workunit.client.1.smithi161.stdout:6/396: getdents da/d28 0 2023-12-09T02:35:12.868 INFO:tasks.workunit.client.1.smithi161.stdout:6/397: chown da/d28/d29/l8b 1371724209 1 2023-12-09T02:35:12.868 INFO:tasks.workunit.client.1.smithi161.stdout:6/398: write da/d55/f86 [678284,55949] 0 2023-12-09T02:35:12.868 INFO:tasks.workunit.client.1.smithi161.stdout:6/399: chown da/df/c56 0 1 2023-12-09T02:35:12.872 INFO:tasks.workunit.client.1.smithi161.stdout:2/423: unlink d4/d7/db/f7e 0 2023-12-09T02:35:12.872 INFO:tasks.workunit.client.1.smithi161.stdout:2/424: chown d4/d16/d69/d8c/d87/c78 3677 1 2023-12-09T02:35:12.872 INFO:tasks.workunit.client.1.smithi161.stdout:2/425: fdatasync d4/d7/db/f67 0 2023-12-09T02:35:12.872 INFO:tasks.workunit.client.1.smithi161.stdout:2/426: fsync d4/fa 0 2023-12-09T02:35:12.872 INFO:tasks.workunit.client.1.smithi161.stdout:2/427: dread - d4/d1a/f40 zero size 2023-12-09T02:35:12.876 INFO:tasks.workunit.client.1.smithi161.stdout:6/400: write da/fc [141023,74688] 0 2023-12-09T02:35:12.876 INFO:tasks.workunit.client.1.smithi161.stdout:2/428: write d4/d16/d69/d7b/f5c [3884689,2685] 0 2023-12-09T02:35:12.876 INFO:tasks.workunit.client.1.smithi161.stdout:2/429: fsync d4/d7/f31 0 2023-12-09T02:35:12.882 INFO:tasks.workunit.client.1.smithi161.stdout:3/359: dwrite d2/d4/d11/d1f/d2a/d46/d2d/d47/f5c [8388608,4194304] 0 2023-12-09T02:35:12.887 INFO:tasks.workunit.client.1.smithi161.stdout:0/416: dwrite d9/d25/f38 [0,4194304] 0 2023-12-09T02:35:12.888 INFO:tasks.workunit.client.1.smithi161.stdout:6/401: creat da/d28/d3c/f90 x:0 0 0 2023-12-09T02:35:12.888 INFO:tasks.workunit.client.1.smithi161.stdout:6/402: chown da/d28/d3c/d46/f48 178 1 2023-12-09T02:35:12.888 INFO:tasks.workunit.client.1.smithi161.stdout:6/403: chown da/df/d2d/d49/f4c 15 1 2023-12-09T02:35:12.894 INFO:tasks.workunit.client.1.smithi161.stdout:0/417: write d9/d25/f74 [2037644,109660] 0 2023-12-09T02:35:12.895 INFO:tasks.workunit.client.1.smithi161.stdout:3/360: creat d2/d4/d11/d1f/d2a/f63 x:0 0 0 2023-12-09T02:35:12.895 INFO:tasks.workunit.client.1.smithi161.stdout:3/361: chown d2/d4/l8 486 1 2023-12-09T02:35:12.897 INFO:tasks.workunit.client.1.smithi161.stdout:6/404: link da/d55/d6d/d85/f73 da/d28/d3c/f91 0 2023-12-09T02:35:12.906 INFO:tasks.workunit.client.1.smithi161.stdout:3/362: dread d2/d4/f18 [0,4194304] 0 2023-12-09T02:35:12.908 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:12 smithi161 ceph-mon[121170]: pgmap v204: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 30 MiB/s rd, 71 MiB/s wr, 149 op/s 2023-12-09T02:35:12.908 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:12 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:12.908 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:12 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:12.908 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:12 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:35:12.909 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:12 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:35:12.909 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:12 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:12.911 INFO:tasks.workunit.client.1.smithi161.stdout:6/405: mkdir da/d28/d29/d92 0 2023-12-09T02:35:12.914 INFO:tasks.workunit.client.1.smithi161.stdout:3/363: rename d2/d4/d11/d1f/f25 to d2/d4/d11/f64 0 2023-12-09T02:35:12.914 INFO:tasks.workunit.client.1.smithi161.stdout:3/364: write d2/d4/d11/d1f/d2a/d46/f57 [1186838,99397] 0 2023-12-09T02:35:12.917 INFO:tasks.workunit.client.1.smithi161.stdout:6/406: symlink da/d19/d20/d6f/l93 0 2023-12-09T02:35:12.918 INFO:tasks.workunit.client.1.smithi161.stdout:0/418: dwrite d9/f1d [0,4194304] 0 2023-12-09T02:35:12.918 INFO:tasks.workunit.client.1.smithi161.stdout:0/419: fdatasync d9/d55/d26/d28/f68 0 2023-12-09T02:35:12.919 INFO:tasks.workunit.client.1.smithi161.stdout:3/365: rename d2/fa to d2/d4/d11/d1f/d2a/d46/d2d/d4e/f65 0 2023-12-09T02:35:12.925 INFO:tasks.workunit.client.1.smithi161.stdout:6/407: dread f1 [0,4194304] 0 2023-12-09T02:35:13.003 INFO:tasks.workunit.client.1.smithi161.stdout:4/398: sync 2023-12-09T02:35:13.003 INFO:tasks.workunit.client.1.smithi161.stdout:4/399: chown dd/d1a/d1d/d25/d32 233 1 2023-12-09T02:35:13.003 INFO:tasks.workunit.client.1.smithi161.stdout:4/400: fdatasync dd/d1a/d29/f37 0 2023-12-09T02:35:13.014 INFO:tasks.workunit.client.1.smithi161.stdout:4/401: dread dd/d1a/d1d/d25/f2f [4194304,4194304] 0 2023-12-09T02:35:13.014 INFO:tasks.workunit.client.1.smithi161.stdout:4/402: getdents dd/d1a/d1d/d25/d32/d58 0 2023-12-09T02:35:13.016 INFO:tasks.workunit.client.1.smithi161.stdout:3/366: write d2/d4/d11/d28/f22 [2584091,106805] 0 2023-12-09T02:35:13.016 INFO:tasks.workunit.client.1.smithi161.stdout:3/367: chown d2/d4/d11/d1f/c62 12967939 1 2023-12-09T02:35:13.017 INFO:tasks.workunit.client.1.smithi161.stdout:0/420: write d9/f20 [559892,44335] 0 2023-12-09T02:35:13.018 INFO:tasks.workunit.client.1.smithi161.stdout:4/403: rename dd/d1a/d23/d6a/l76 to dd/d36/d3f/l7d 0 2023-12-09T02:35:13.021 INFO:tasks.workunit.client.1.smithi161.stdout:4/404: unlink c2 0 2023-12-09T02:35:13.021 INFO:tasks.workunit.client.1.smithi161.stdout:2/430: dwrite d4/d16/d69/d7b/f54 [0,4194304] 0 2023-12-09T02:35:13.026 INFO:tasks.workunit.client.1.smithi161.stdout:0/421: rename d9/d25 to d9/d55/d7c 0 2023-12-09T02:35:13.026 INFO:tasks.workunit.client.1.smithi161.stdout:0/422: chown d9/d55/d44 1 1 2023-12-09T02:35:13.026 INFO:tasks.workunit.client.1.smithi161.stdout:0/423: write d9/d1f/f18 [396905,42705] 0 2023-12-09T02:35:13.026 INFO:tasks.workunit.client.1.smithi161.stdout:4/405: stat dd/d1a/d1d/l2e 0 2023-12-09T02:35:13.030 INFO:tasks.workunit.client.1.smithi161.stdout:2/431: getdents d4/d1a/d4a/d4f 0 2023-12-09T02:35:13.030 INFO:tasks.workunit.client.1.smithi161.stdout:2/432: fsync d4/d16/d69/d7b/f52 0 2023-12-09T02:35:13.032 INFO:tasks.workunit.client.1.smithi161.stdout:3/368: dread d2/f15 [0,4194304] 0 2023-12-09T02:35:13.033 INFO:tasks.workunit.client.1.smithi161.stdout:0/424: getdents d9/d55/d5a 0 2023-12-09T02:35:13.034 INFO:tasks.workunit.client.1.smithi161.stdout:2/433: read d4/d1a/f3c [509748,179] 0 2023-12-09T02:35:13.039 INFO:tasks.workunit.client.1.smithi161.stdout:2/434: link d4/d7/db/c66 d4/d16/d69/c8e 0 2023-12-09T02:35:13.041 INFO:tasks.workunit.client.1.smithi161.stdout:0/425: symlink d9/dd/l7d 0 2023-12-09T02:35:13.042 INFO:tasks.workunit.client.1.smithi161.stdout:2/435: unlink d4/d16/d69/d8c/d87/c78 0 2023-12-09T02:35:13.042 INFO:tasks.workunit.client.1.smithi161.stdout:2/436: readlink d4/d16/d69/d7b/l8b 0 2023-12-09T02:35:13.044 INFO:tasks.workunit.client.1.smithi161.stdout:0/426: link d9/d1f/l39 d9/db/d2a/d35/l7e 0 2023-12-09T02:35:13.047 INFO:tasks.workunit.client.1.smithi161.stdout:2/437: mkdir d4/d7/d8f 0 2023-12-09T02:35:13.047 INFO:tasks.workunit.client.1.smithi161.stdout:0/427: symlink d9/db/d2a/d35/l7f 0 2023-12-09T02:35:13.047 INFO:tasks.workunit.client.1.smithi161.stdout:0/428: stat d9/d55/d26/d28 0 2023-12-09T02:35:13.048 INFO:tasks.workunit.client.1.smithi161.stdout:4/406: dwrite dd/d1a/d1d/d25/d3a/f40 [0,4194304] 0 2023-12-09T02:35:13.052 INFO:tasks.workunit.client.1.smithi161.stdout:2/438: truncate d4/f17 2093864 0 2023-12-09T02:35:13.053 INFO:tasks.workunit.client.1.smithi161.stdout:0/429: creat d9/dd/f80 x:0 0 0 2023-12-09T02:35:13.053 INFO:tasks.workunit.client.1.smithi161.stdout:0/430: truncate d9/d55/d7c/f2d 1101717 0 2023-12-09T02:35:13.054 INFO:tasks.workunit.client.1.smithi161.stdout:4/407: creat dd/d1a/d1d/d25/d32/f7e x:0 0 0 2023-12-09T02:35:13.055 INFO:tasks.workunit.client.1.smithi161.stdout:0/431: symlink d9/l81 0 2023-12-09T02:35:13.055 INFO:tasks.workunit.client.1.smithi161.stdout:4/408: write dd/d1a/d1d/d25/d32/d34/f60 [406092,26342] 0 2023-12-09T02:35:13.056 INFO:tasks.workunit.client.1.smithi161.stdout:4/409: write f8 [2547815,68419] 0 2023-12-09T02:35:13.060 INFO:tasks.workunit.client.1.smithi161.stdout:4/410: dread dd/d1a/d29/f5d [0,4194304] 0 2023-12-09T02:35:13.065 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:12 smithi088 ceph-mon[112028]: pgmap v204: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 30 MiB/s rd, 71 MiB/s wr, 149 op/s 2023-12-09T02:35:13.065 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:12 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:13.065 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:12 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:13.065 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:12 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:35:13.065 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:12 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:35:13.065 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:12 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:13.066 INFO:tasks.workunit.client.1.smithi161.stdout:4/411: link dd/f19 dd/d36/d3f/f7f 0 2023-12-09T02:35:13.066 INFO:tasks.workunit.client.1.smithi161.stdout:4/412: fsync dd/d1a/d23/f63 0 2023-12-09T02:35:13.066 INFO:tasks.workunit.client.1.smithi161.stdout:4/413: write dd/d1a/d1d/d25/f52 [4314817,106686] 0 2023-12-09T02:35:13.071 INFO:tasks.workunit.client.1.smithi161.stdout:4/414: creat dd/d1a/d1d/d25/f80 x:0 0 0 2023-12-09T02:35:13.075 INFO:tasks.workunit.client.1.smithi161.stdout:4/415: rename dd/d1a/l1b to dd/d1a/d1d/d25/d32/d34/d78/l81 0 2023-12-09T02:35:13.075 INFO:tasks.workunit.client.1.smithi161.stdout:4/416: truncate dd/d36/d3f/f43 493817 0 2023-12-09T02:35:13.075 INFO:tasks.workunit.client.1.smithi161.stdout:4/417: fdatasync dd/d1a/d29/f37 0 2023-12-09T02:35:13.076 INFO:tasks.workunit.client.1.smithi161.stdout:2/439: dwrite d4/d1a/d4a/d4f/f73 [0,4194304] 0 2023-12-09T02:35:13.091 INFO:tasks.workunit.client.1.smithi161.stdout:4/418: dread dd/d1a/d1d/d25/f3b [0,4194304] 0 2023-12-09T02:35:13.093 INFO:tasks.workunit.client.1.smithi161.stdout:4/419: mknod dd/d36/d4a/d5f/c82 0 2023-12-09T02:35:13.093 INFO:tasks.workunit.client.1.smithi161.stdout:2/440: dwrite d4/fa [4194304,4194304] 0 2023-12-09T02:35:13.098 INFO:tasks.workunit.client.1.smithi161.stdout:2/441: write d4/d7/f31 [2924997,25991] 0 2023-12-09T02:35:13.098 INFO:tasks.workunit.client.1.smithi161.stdout:2/442: write d4/d1a/d4a/d4f/f57 [680618,36230] 0 2023-12-09T02:35:13.100 INFO:tasks.workunit.client.1.smithi161.stdout:4/420: dread dd/d1a/d1d/d25/f52 [0,4194304] 0 2023-12-09T02:35:13.100 INFO:tasks.workunit.client.1.smithi161.stdout:4/421: chown dd/d5a/c5e 333339204 1 2023-12-09T02:35:13.106 INFO:tasks.workunit.client.1.smithi161.stdout:2/443: unlink d4/d16/d69/d8c/d5a/l85 0 2023-12-09T02:35:13.111 INFO:tasks.workunit.client.1.smithi161.stdout:4/422: getdents dd/d5a 0 2023-12-09T02:35:13.111 INFO:tasks.workunit.client.1.smithi161.stdout:4/423: chown dd/d36/d4a/f6f 6214 1 2023-12-09T02:35:13.112 INFO:tasks.workunit.client.1.smithi161.stdout:2/444: truncate d4/d1a/d4a/d4f/f73 954778 0 2023-12-09T02:35:13.113 INFO:tasks.workunit.client.1.smithi161.stdout:2/445: chown d4/d7/db/f62 1 1 2023-12-09T02:35:13.113 INFO:tasks.workunit.client.1.smithi161.stdout:2/446: fsync d4/d16/f82 0 2023-12-09T02:35:13.113 INFO:tasks.workunit.client.1.smithi161.stdout:9/355: sync 2023-12-09T02:35:13.113 INFO:tasks.workunit.client.1.smithi161.stdout:7/514: sync 2023-12-09T02:35:13.115 INFO:tasks.workunit.client.1.smithi161.stdout:4/424: symlink dd/d1a/d23/d6a/l83 0 2023-12-09T02:35:13.117 INFO:tasks.workunit.client.1.smithi161.stdout:2/447: link d4/d1a/c27 d4/d16/d69/d8c/d87/c90 0 2023-12-09T02:35:13.118 INFO:tasks.workunit.client.1.smithi161.stdout:2/448: chown d4/d1a/f3e 229587058 1 2023-12-09T02:35:13.120 INFO:tasks.workunit.client.1.smithi161.stdout:8/378: sync 2023-12-09T02:35:13.120 INFO:tasks.workunit.client.1.smithi161.stdout:8/379: stat d2 0 2023-12-09T02:35:13.121 INFO:tasks.workunit.client.1.smithi161.stdout:9/356: link d2/d25/d3a/d65/d42/d58/d16/d39/l52 d2/d25/d3a/d65/d42/l76 0 2023-12-09T02:35:13.122 INFO:tasks.workunit.client.1.smithi161.stdout:9/357: truncate d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/f72 692668 0 2023-12-09T02:35:13.122 INFO:tasks.workunit.client.1.smithi161.stdout:9/358: fsync d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/f72 0 2023-12-09T02:35:13.123 INFO:tasks.workunit.client.1.smithi161.stdout:8/380: write d2/d5/d22/d31/d38/d48/f5a [2197569,127691] 0 2023-12-09T02:35:13.125 INFO:tasks.workunit.client.1.smithi161.stdout:7/515: symlink d0/d3/d13/d2d/d43/d4a/la5 0 2023-12-09T02:35:13.126 INFO:tasks.workunit.client.1.smithi161.stdout:8/381: dread d2/d5/d3d/f6f [0,4194304] 0 2023-12-09T02:35:13.126 INFO:tasks.workunit.client.1.smithi161.stdout:8/382: fsync d2/f9 0 2023-12-09T02:35:13.126 INFO:tasks.workunit.client.1.smithi161.stdout:8/383: write d2/d5/f43 [1124809,42551] 0 2023-12-09T02:35:13.129 INFO:tasks.workunit.client.1.smithi161.stdout:7/516: creat d0/d3/d9e/d59/d5e/fa6 x:0 0 0 2023-12-09T02:35:13.138 INFO:tasks.workunit.client.1.smithi161.stdout:7/517: write d0/d3/f17 [508741,34415] 0 2023-12-09T02:35:13.139 INFO:tasks.workunit.client.1.smithi161.stdout:7/518: unlink d0/d3/d13/d2d/f39 0 2023-12-09T02:35:13.140 INFO:tasks.workunit.client.1.smithi161.stdout:2/449: dread d4/d1a/d4a/d4f/f73 [0,4194304] 0 2023-12-09T02:35:13.141 INFO:tasks.workunit.client.1.smithi161.stdout:7/519: mkdir d0/d3/d13/d2d/d43/d4a/da7 0 2023-12-09T02:35:13.143 INFO:tasks.workunit.client.1.smithi161.stdout:2/450: rename d4/d16/c5e to d4/d16/d69/d8c/d87/c91 0 2023-12-09T02:35:13.144 INFO:tasks.workunit.client.1.smithi161.stdout:9/359: dwrite d2/f47 [0,4194304] 0 2023-12-09T02:35:13.145 INFO:tasks.workunit.client.1.smithi161.stdout:4/425: dwrite dd/d36/d3f/f7f [0,4194304] 0 2023-12-09T02:35:13.145 INFO:tasks.workunit.client.1.smithi161.stdout:4/426: write dd/d1a/d1d/d25/d32/f7e [623489,102930] 0 2023-12-09T02:35:13.145 INFO:tasks.workunit.client.1.smithi161.stdout:4/427: fdatasync dd/f19 0 2023-12-09T02:35:13.146 INFO:tasks.workunit.client.1.smithi161.stdout:4/428: write f8 [436506,2548] 0 2023-12-09T02:35:13.146 INFO:tasks.workunit.client.1.smithi161.stdout:4/429: readlink dd/d1a/l22 0 2023-12-09T02:35:13.146 INFO:tasks.workunit.client.1.smithi161.stdout:2/451: rename d4/c43 to d4/d1a/d4a/d4f/c92 0 2023-12-09T02:35:13.157 INFO:tasks.workunit.client.1.smithi161.stdout:8/384: dwrite d2/d5/d22/f4c [0,4194304] 0 2023-12-09T02:35:13.172 INFO:tasks.workunit.client.1.smithi161.stdout:7/520: dwrite d0/d3/f73 [0,4194304] 0 2023-12-09T02:35:13.186 INFO:tasks.workunit.client.1.smithi161.stdout:7/521: dread d0/d3/d13/d2d/d43/d4a/f41 [0,4194304] 0 2023-12-09T02:35:13.186 INFO:tasks.workunit.client.1.smithi161.stdout:7/522: fdatasync d0/d3/d13/d2d/d6e/f8c 0 2023-12-09T02:35:13.206 INFO:tasks.workunit.client.1.smithi161.stdout:9/360: symlink d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/d61/l77 0 2023-12-09T02:35:13.210 INFO:tasks.workunit.client.1.smithi161.stdout:4/430: creat dd/d36/d4a/f84 x:0 0 0 2023-12-09T02:35:13.212 INFO:tasks.workunit.client.1.smithi161.stdout:2/452: symlink d4/d16/d69/d8c/d87/l93 0 2023-12-09T02:35:13.212 INFO:tasks.workunit.client.1.smithi161.stdout:2/453: readlink d4/d16/d69/d8c/d87/l93 0 2023-12-09T02:35:13.212 INFO:tasks.workunit.client.1.smithi161.stdout:2/454: dread - d4/d1a/d4a/d4f/f59 zero size 2023-12-09T02:35:13.218 INFO:tasks.workunit.client.1.smithi161.stdout:2/455: dread d4/d16/d69/d8c/d5a/f71 [0,4194304] 0 2023-12-09T02:35:13.225 INFO:tasks.workunit.client.1.smithi161.stdout:7/523: mknod d0/ca8 0 2023-12-09T02:35:13.236 INFO:tasks.workunit.client.1.smithi161.stdout:4/431: dwrite dd/d36/d4a/f84 [0,4194304] 0 2023-12-09T02:35:13.236 INFO:tasks.workunit.client.1.smithi161.stdout:9/361: creat d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/d61/f78 x:0 0 0 2023-12-09T02:35:13.238 INFO:tasks.workunit.client.1.smithi161.stdout:8/385: symlink d2/d5/d22/d76/l7b 0 2023-12-09T02:35:13.242 INFO:tasks.workunit.client.1.smithi161.stdout:2/456: dwrite d4/f25 [0,4194304] 0 2023-12-09T02:35:13.244 INFO:tasks.workunit.client.1.smithi161.stdout:9/362: symlink d2/d25/d3a/d65/d42/d58/d16/d39/l79 0 2023-12-09T02:35:13.244 INFO:tasks.workunit.client.1.smithi161.stdout:9/363: write d2/d25/d3a/d65/d5c/f56 [2769619,72211] 0 2023-12-09T02:35:13.250 INFO:tasks.workunit.client.1.smithi161.stdout:2/457: link d4/d1a/d4a/c74 d4/d16/d69/c94 0 2023-12-09T02:35:13.255 INFO:tasks.workunit.client.1.smithi161.stdout:9/364: mknod d2/d25/d3a/d4d/c7a 0 2023-12-09T02:35:13.255 INFO:tasks.workunit.client.1.smithi161.stdout:9/365: chown d2/d25/d3a/d65/d42/f4b 4854677 1 2023-12-09T02:35:13.257 INFO:tasks.workunit.client.1.smithi161.stdout:2/458: getdents d4/d1a/d4a/d4f 0 2023-12-09T02:35:13.260 INFO:tasks.workunit.client.1.smithi161.stdout:9/366: link d2/d25/d3a/d65/d42/d58/f21 d2/d25/d3a/f7b 0 2023-12-09T02:35:13.264 INFO:tasks.workunit.client.1.smithi161.stdout:2/459: symlink d4/d16/d69/d7b/l95 0 2023-12-09T02:35:13.404 INFO:tasks.workunit.client.1.smithi161.stdout:1/559: sync 2023-12-09T02:35:13.421 INFO:tasks.workunit.client.1.smithi161.stdout:1/560: stat d6/d9/l44 0 2023-12-09T02:35:13.421 INFO:tasks.workunit.client.1.smithi161.stdout:1/561: write d6/d8/d63/d4d/d31/d73/d47/f6d [675640,53626] 0 2023-12-09T02:35:13.423 INFO:tasks.workunit.client.1.smithi161.stdout:1/562: mkdir d6/d9/d8b/dba 0 2023-12-09T02:35:13.425 INFO:tasks.workunit.client.1.smithi161.stdout:1/563: symlink d6/d9/d8b/dba/lbb 0 2023-12-09T02:35:13.426 INFO:tasks.workunit.client.1.smithi161.stdout:9/367: truncate d2/d25/d3a/d65/d42/d58/d16/f20 2629807 0 2023-12-09T02:35:13.426 INFO:tasks.workunit.client.1.smithi161.stdout:9/368: dread - d2/d25/d3a/d65/d42/d58/d16/d51/f6b zero size 2023-12-09T02:35:13.428 INFO:tasks.workunit.client.1.smithi161.stdout:1/564: getdents d6/d8/d68 0 2023-12-09T02:35:13.438 INFO:tasks.workunit.client.1.smithi161.stdout:9/369: mkdir d2/d25/d3a/d65/d7c 0 2023-12-09T02:35:13.439 INFO:tasks.workunit.client.1.smithi161.stdout:2/460: link d4/d16/d69/d8c/c7c d4/d7/c96 0 2023-12-09T02:35:13.440 INFO:tasks.workunit.client.1.smithi161.stdout:1/565: getdents d6/d9 0 2023-12-09T02:35:13.441 INFO:tasks.workunit.client.1.smithi161.stdout:9/370: mkdir d2/d25/d3a/d4d/d7d 0 2023-12-09T02:35:13.441 INFO:tasks.workunit.client.1.smithi161.stdout:9/371: chown d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/f72 166507 1 2023-12-09T02:35:13.442 INFO:tasks.workunit.client.1.smithi161.stdout:9/372: truncate d2/d25/d3a/d65/d42/d58/d16/d51/f6b 1009240 0 2023-12-09T02:35:13.442 INFO:tasks.workunit.client.1.smithi161.stdout:2/461: creat d4/d16/d69/d8c/d87/f97 x:0 0 0 2023-12-09T02:35:13.442 INFO:tasks.workunit.client.1.smithi161.stdout:2/462: chown d4/d7/c96 854672462 1 2023-12-09T02:35:13.443 INFO:tasks.workunit.client.1.smithi161.stdout:1/566: mknod d6/d8/d63/d1c/cbc 0 2023-12-09T02:35:13.444 INFO:tasks.workunit.client.1.smithi161.stdout:1/567: getdents d6/d8/d63/d4d/d31/d73 0 2023-12-09T02:35:13.444 INFO:tasks.workunit.client.1.smithi161.stdout:1/568: fsync d6/d8/d63/d4d/f88 0 2023-12-09T02:35:13.444 INFO:tasks.workunit.client.1.smithi161.stdout:1/569: truncate d6/d8/d63/d4d/d31/d73/f9b 791756 0 2023-12-09T02:35:13.445 INFO:tasks.workunit.client.1.smithi161.stdout:1/570: mknod d6/d9/d8b/cbd 0 2023-12-09T02:35:13.446 INFO:tasks.workunit.client.1.smithi161.stdout:1/571: creat d6/d8/d63/d35/daa/fbe x:0 0 0 2023-12-09T02:35:13.447 INFO:tasks.workunit.client.1.smithi161.stdout:1/572: chown d6/d8/d63/d93/l7f 3883021 1 2023-12-09T02:35:13.448 INFO:tasks.workunit.client.1.smithi161.stdout:1/573: creat d6/d8/d63/d4d/d31/fbf x:0 0 0 2023-12-09T02:35:13.448 INFO:tasks.workunit.client.1.smithi161.stdout:1/574: chown d6/d8/d63/d35/c4b 193 1 2023-12-09T02:35:13.448 INFO:tasks.workunit.client.1.smithi161.stdout:1/575: chown d6/d8/d63/d35/d3d 4155007 1 2023-12-09T02:35:13.450 INFO:tasks.workunit.client.1.smithi161.stdout:8/386: unlink d2/d5/l50 0 2023-12-09T02:35:13.450 INFO:tasks.workunit.client.1.smithi161.stdout:8/387: fdatasync d2/f3 0 2023-12-09T02:35:13.453 INFO:tasks.workunit.client.1.smithi161.stdout:8/388: symlink d2/d5/d4f/l7c 0 2023-12-09T02:35:13.453 INFO:tasks.workunit.client.1.smithi161.stdout:8/389: stat d2/d2d/f57 0 2023-12-09T02:35:13.453 INFO:tasks.workunit.client.1.smithi161.stdout:8/390: fsync d2/d5/d22/f4c 0 2023-12-09T02:35:13.454 INFO:tasks.workunit.client.1.smithi161.stdout:9/373: dread d2/d25/d3a/d4d/f67 [0,4194304] 0 2023-12-09T02:35:13.454 INFO:tasks.workunit.client.1.smithi161.stdout:2/463: dread d4/d1a/d4a/d6d/f7a [0,4194304] 0 2023-12-09T02:35:13.455 INFO:tasks.workunit.client.1.smithi161.stdout:2/464: read d4/d16/f1e [3098763,83610] 0 2023-12-09T02:35:13.456 INFO:tasks.workunit.client.1.smithi161.stdout:9/374: symlink d2/d25/l7e 0 2023-12-09T02:35:13.458 INFO:tasks.workunit.client.1.smithi161.stdout:1/576: rmdir d6/d8/d63/d4d/d31/dab 0 2023-12-09T02:35:13.461 INFO:tasks.workunit.client.1.smithi161.stdout:8/391: symlink d2/d5/d22/d54/l7d 0 2023-12-09T02:35:13.461 INFO:tasks.workunit.client.1.smithi161.stdout:1/577: dread d6/d9/d5c/f66 [0,4194304] 0 2023-12-09T02:35:13.465 INFO:tasks.workunit.client.1.smithi161.stdout:8/392: truncate d2/d5/d22/f49 3808895 0 2023-12-09T02:35:13.470 INFO:tasks.workunit.client.1.smithi161.stdout:9/375: fsync d2/d25/d3a/d65/d42/d58/d16/d2e/f40 0 2023-12-09T02:35:13.480 INFO:tasks.workunit.client.1.smithi161.stdout:9/376: mkdir d2/d25/d3a/d65/d5c/d60/d7f 0 2023-12-09T02:35:13.490 INFO:tasks.workunit.client.1.smithi161.stdout:5/384: sync 2023-12-09T02:35:13.491 INFO:tasks.workunit.client.1.smithi161.stdout:1/578: dwrite d6/d8/d63/d1c/d81/d9d/fa2 [0,4194304] 0 2023-12-09T02:35:13.493 INFO:tasks.workunit.client.1.smithi161.stdout:8/393: dwrite d2/d5/d22/d31/f39 [4194304,4194304] 0 2023-12-09T02:35:13.494 INFO:tasks.workunit.client.1.smithi161.stdout:2/465: dwrite d4/f41 [0,4194304] 0 2023-12-09T02:35:13.507 INFO:tasks.workunit.client.1.smithi161.stdout:2/466: link d4/l6e d4/d7/d8f/l98 0 2023-12-09T02:35:13.509 INFO:tasks.workunit.client.1.smithi161.stdout:9/377: dwrite d2/d25/d3a/d65/d42/d58/f21 [4194304,4194304] 0 2023-12-09T02:35:13.510 INFO:tasks.workunit.client.1.smithi161.stdout:2/467: mknod d4/d16/d69/c99 0 2023-12-09T02:35:13.513 INFO:tasks.workunit.client.1.smithi161.stdout:2/468: rmdir d4 39 2023-12-09T02:35:13.525 INFO:tasks.workunit.client.1.smithi161.stdout:1/579: dwrite d6/d8/d63/d4d/d31/fbf [0,4194304] 0 2023-12-09T02:35:13.527 INFO:tasks.workunit.client.1.smithi161.stdout:8/394: dwrite d2/d5/d3d/f46 [0,4194304] 0 2023-12-09T02:35:13.528 INFO:tasks.workunit.client.1.smithi161.stdout:5/385: dwrite d0/d2/d7/df/d60/f6f [0,4194304] 0 2023-12-09T02:35:13.529 INFO:tasks.workunit.client.1.smithi161.stdout:1/580: chown d6/d8/d63/d93/f8f 325 1 2023-12-09T02:35:13.529 INFO:tasks.workunit.client.1.smithi161.stdout:8/395: dread d2/d5/d22/d31/d38/d48/f69 [0,4194304] 0 2023-12-09T02:35:13.534 INFO:tasks.workunit.client.1.smithi161.stdout:5/386: mkdir d0/d2/de/d22/d8e 0 2023-12-09T02:35:13.534 INFO:tasks.workunit.client.1.smithi161.stdout:5/387: chown d0/d2/de/d44 123 1 2023-12-09T02:35:13.534 INFO:tasks.workunit.client.1.smithi161.stdout:5/388: chown d0/d2/de/f5b 1863373 1 2023-12-09T02:35:13.536 INFO:tasks.workunit.client.1.smithi161.stdout:2/469: dwrite d4/d7/f31 [0,4194304] 0 2023-12-09T02:35:13.541 INFO:tasks.workunit.client.1.smithi161.stdout:2/470: getdents d4/d7/d8f 0 2023-12-09T02:35:13.542 INFO:tasks.workunit.client.1.smithi161.stdout:2/471: symlink d4/d16/d69/d8c/d5a/l9a 0 2023-12-09T02:35:13.546 INFO:tasks.workunit.client.1.smithi161.stdout:2/472: dread d4/d1a/f3e [0,4194304] 0 2023-12-09T02:35:13.550 INFO:tasks.workunit.client.1.smithi161.stdout:5/389: dread d0/d2/d7/d51/f71 [0,4194304] 0 2023-12-09T02:35:13.555 INFO:tasks.workunit.client.1.smithi161.stdout:5/390: rename d0/d2/d7/df/d82 to d0/d2/de/d22/d8e/d8f 0 2023-12-09T02:35:13.557 INFO:tasks.workunit.client.1.smithi161.stdout:8/396: dwrite d2/d5/d4f/f29 [0,4194304] 0 2023-12-09T02:35:13.568 INFO:tasks.workunit.client.1.smithi161.stdout:8/397: rmdir d2/d5/d22/d31/d38/d48/d4e 39 2023-12-09T02:35:13.569 INFO:tasks.workunit.client.1.smithi161.stdout:8/398: unlink d2/f9 0 2023-12-09T02:35:13.570 INFO:tasks.workunit.client.1.smithi161.stdout:8/399: dread d2/d5/d22/d31/d38/d48/d4e/f78 [0,4194304] 0 2023-12-09T02:35:13.572 INFO:tasks.workunit.client.1.smithi161.stdout:8/400: rmdir d2/d5/d3d 39 2023-12-09T02:35:13.573 INFO:tasks.workunit.client.1.smithi161.stdout:8/401: chown d2/d5/d22/d31/f65 120003 1 2023-12-09T02:35:13.573 INFO:tasks.workunit.client.1.smithi161.stdout:8/402: write d2/d5/d22/d31/d38/f4d [1117854,85187] 0 2023-12-09T02:35:13.574 INFO:tasks.workunit.client.1.smithi161.stdout:5/391: dwrite d0/d2/d7/d11/d50/f8c [0,4194304] 0 2023-12-09T02:35:13.574 INFO:tasks.workunit.client.1.smithi161.stdout:2/473: dwrite d4/d16/d69/d8c/f77 [0,4194304] 0 2023-12-09T02:35:13.578 INFO:tasks.workunit.client.1.smithi161.stdout:5/392: truncate d0/d9/f6a 454701 0 2023-12-09T02:35:13.578 INFO:tasks.workunit.client.1.smithi161.stdout:5/393: dread - d0/f69 zero size 2023-12-09T02:35:13.581 INFO:tasks.workunit.client.1.smithi161.stdout:8/403: dread d2/d5/f34 [0,4194304] 0 2023-12-09T02:35:13.585 INFO:tasks.workunit.client.1.smithi161.stdout:2/474: symlink d4/d16/d69/d8c/d5a/d86/l9b 0 2023-12-09T02:35:13.585 INFO:tasks.workunit.client.1.smithi161.stdout:2/475: fsync d4/d7/db/f67 0 2023-12-09T02:35:13.585 INFO:tasks.workunit.client.1.smithi161.stdout:2/476: chown c0 32204 1 2023-12-09T02:35:13.588 INFO:tasks.workunit.client.1.smithi161.stdout:5/394: rename d0/d2/de/d21/f85 to d0/d2/f90 0 2023-12-09T02:35:13.594 INFO:tasks.workunit.client.1.smithi161.stdout:2/477: creat d4/d1a/d4a/d4f/f9c x:0 0 0 2023-12-09T02:35:13.594 INFO:tasks.workunit.client.1.smithi161.stdout:2/478: stat d4/f17 0 2023-12-09T02:35:13.594 INFO:tasks.workunit.client.1.smithi161.stdout:2/479: dread - d4/d1a/f40 zero size 2023-12-09T02:35:13.594 INFO:tasks.workunit.client.1.smithi161.stdout:2/480: truncate d4/f7d 26181 0 2023-12-09T02:35:13.597 INFO:tasks.workunit.client.1.smithi161.stdout:5/395: dread d0/d2/d7/d11/d50/f8c [0,4194304] 0 2023-12-09T02:35:13.599 INFO:tasks.workunit.client.1.smithi161.stdout:5/396: creat d0/d2/f91 x:0 0 0 2023-12-09T02:35:13.599 INFO:tasks.workunit.client.1.smithi161.stdout:5/397: write d0/d1f/f42 [1005667,97177] 0 2023-12-09T02:35:13.602 INFO:tasks.workunit.client.1.smithi161.stdout:5/398: truncate d0/d2/d7/d11/f4c 234336 0 2023-12-09T02:35:13.602 INFO:tasks.workunit.client.1.smithi161.stdout:5/399: chown d0/d2/d7/d70/f75 8404878 1 2023-12-09T02:35:13.605 INFO:tasks.workunit.client.1.smithi161.stdout:5/400: truncate d0/d2/de/d21/f2c 3862838 0 2023-12-09T02:35:13.607 INFO:tasks.workunit.client.1.smithi161.stdout:5/401: mknod d0/c92 0 2023-12-09T02:35:13.610 INFO:tasks.workunit.client.1.smithi161.stdout:5/402: creat d0/d2/d7/df/d60/f93 x:0 0 0 2023-12-09T02:35:13.612 INFO:tasks.workunit.client.1.smithi161.stdout:5/403: mkdir d0/d1f/d94 0 2023-12-09T02:35:13.616 INFO:tasks.workunit.client.1.smithi161.stdout:5/404: link d0/d2/f57 d0/d2/d7/df/d60/f95 0 2023-12-09T02:35:13.617 INFO:tasks.workunit.client.1.smithi161.stdout:5/405: readlink d0/d2/l6 0 2023-12-09T02:35:13.617 INFO:tasks.workunit.client.1.smithi161.stdout:5/406: dread - d0/d2/d5f/f64 zero size 2023-12-09T02:35:13.617 INFO:tasks.workunit.client.1.smithi161.stdout:5/407: write d0/d2/de/d22/f54 [822619,101323] 0 2023-12-09T02:35:13.750 INFO:tasks.workunit.client.1.smithi161.stdout:7/524: sync 2023-12-09T02:35:13.750 INFO:tasks.workunit.client.1.smithi161.stdout:3/369: sync 2023-12-09T02:35:13.750 INFO:tasks.workunit.client.1.smithi161.stdout:0/432: sync 2023-12-09T02:35:13.750 INFO:tasks.workunit.client.1.smithi161.stdout:4/432: sync 2023-12-09T02:35:13.750 INFO:tasks.workunit.client.1.smithi161.stdout:4/433: fdatasync dd/fe 0 2023-12-09T02:35:13.750 INFO:tasks.workunit.client.1.smithi161.stdout:6/408: sync 2023-12-09T02:35:13.751 INFO:tasks.workunit.client.1.smithi161.stdout:3/370: dread d2/d4/d11/d1f/d2a/d46/d2d/d47/f56 [0,4194304] 0 2023-12-09T02:35:13.752 INFO:tasks.workunit.client.1.smithi161.stdout:0/433: mkdir d9/d55/d26/d82 0 2023-12-09T02:35:13.752 INFO:tasks.workunit.client.1.smithi161.stdout:6/409: rmdir da/d28/d29/d2b 39 2023-12-09T02:35:13.757 INFO:tasks.workunit.client.1.smithi161.stdout:0/434: dread d9/dd/f77 [0,4194304] 0 2023-12-09T02:35:13.762 INFO:tasks.workunit.client.1.smithi161.stdout:4/434: write dd/f19 [4116225,70743] 0 2023-12-09T02:35:13.762 INFO:tasks.workunit.client.1.smithi161.stdout:3/371: dread d2/d4/d11/d1f/d2a/d46/f54 [0,4194304] 0 2023-12-09T02:35:13.762 INFO:tasks.workunit.client.1.smithi161.stdout:4/435: write dd/d1a/d1d/d25/f52 [3963602,41230] 0 2023-12-09T02:35:13.763 INFO:tasks.workunit.client.1.smithi161.stdout:7/525: dread d0/d3/d13/d2d/d43/d4a/f41 [0,4194304] 0 2023-12-09T02:35:13.769 INFO:tasks.workunit.client.1.smithi161.stdout:6/410: link da/f2c da/d28/d29/d2b/d31/f94 0 2023-12-09T02:35:13.769 INFO:tasks.workunit.client.1.smithi161.stdout:0/435: mknod d9/d55/d26/d82/c83 0 2023-12-09T02:35:13.770 INFO:tasks.workunit.client.1.smithi161.stdout:0/436: fsync d9/f20 0 2023-12-09T02:35:13.770 INFO:tasks.workunit.client.1.smithi161.stdout:0/437: stat d9/dd/l45 0 2023-12-09T02:35:13.771 INFO:tasks.workunit.client.1.smithi161.stdout:3/372: truncate d2/d4/d11/f14 2074543 0 2023-12-09T02:35:13.773 INFO:tasks.workunit.client.1.smithi161.stdout:4/436: creat dd/d1a/d1d/f85 x:0 0 0 2023-12-09T02:35:13.773 INFO:tasks.workunit.client.1.smithi161.stdout:4/437: write dd/d1a/d1d/d25/f2f [5885772,119367] 0 2023-12-09T02:35:13.775 INFO:tasks.workunit.client.1.smithi161.stdout:0/438: creat d9/db/f84 x:0 0 0 2023-12-09T02:35:13.775 INFO:tasks.workunit.client.1.smithi161.stdout:0/439: fdatasync d9/d1f/f18 0 2023-12-09T02:35:13.778 INFO:tasks.workunit.client.1.smithi161.stdout:3/373: mknod d2/d4/d11/d5a/c66 0 2023-12-09T02:35:13.778 INFO:tasks.workunit.client.1.smithi161.stdout:3/374: dread - d2/d4/d11/d1f/d4c/f5b zero size 2023-12-09T02:35:13.778 INFO:tasks.workunit.client.1.smithi161.stdout:3/375: write d2/d4/d11/d1f/d4c/f61 [365583,48500] 0 2023-12-09T02:35:13.779 INFO:tasks.workunit.client.1.smithi161.stdout:4/438: rmdir dd/d1a/d1e 39 2023-12-09T02:35:13.782 INFO:tasks.workunit.client.1.smithi161.stdout:0/440: mkdir d9/d55/d44/d85 0 2023-12-09T02:35:13.785 INFO:tasks.workunit.client.1.smithi161.stdout:3/376: unlink d2/d4/f23 0 2023-12-09T02:35:13.792 INFO:tasks.workunit.client.1.smithi161.stdout:0/441: dread d9/dd/f77 [0,4194304] 0 2023-12-09T02:35:13.792 INFO:tasks.workunit.client.1.smithi161.stdout:6/411: dwrite da/d28/d3c/f91 [0,4194304] 0 2023-12-09T02:35:13.792 INFO:tasks.workunit.client.1.smithi161.stdout:6/412: write da/d55/f5f [1203668,78841] 0 2023-12-09T02:35:13.796 INFO:tasks.workunit.client.1.smithi161.stdout:6/413: rmdir da/df 39 2023-12-09T02:35:13.796 INFO:tasks.workunit.client.1.smithi161.stdout:0/442: dread d9/d55/d7c/f2d [0,4194304] 0 2023-12-09T02:35:13.796 INFO:tasks.workunit.client.1.smithi161.stdout:0/443: chown d9/l81 27068854 1 2023-12-09T02:35:13.797 INFO:tasks.workunit.client.1.smithi161.stdout:3/377: dread d2/d4/d11/d1f/d2a/f2b [0,4194304] 0 2023-12-09T02:35:13.798 INFO:tasks.workunit.client.1.smithi161.stdout:4/439: dwrite dd/d36/f74 [0,4194304] 0 2023-12-09T02:35:13.798 INFO:tasks.workunit.client.1.smithi161.stdout:4/440: fsync dd/d1a/d1d/d25/d32/f7e 0 2023-12-09T02:35:13.800 INFO:tasks.workunit.client.1.smithi161.stdout:0/444: mkdir d9/d55/d86 0 2023-12-09T02:35:13.802 INFO:tasks.workunit.client.1.smithi161.stdout:3/378: rename d2/d4/d11/f14 to d2/d4/d11/d5a/f67 0 2023-12-09T02:35:13.807 INFO:tasks.workunit.client.1.smithi161.stdout:0/445: symlink d9/l87 0 2023-12-09T02:35:13.807 INFO:tasks.workunit.client.1.smithi161.stdout:0/446: chown d9/d55/d7c/f74 80454 1 2023-12-09T02:35:13.810 INFO:tasks.workunit.client.1.smithi161.stdout:4/441: rename dd/d1a/d1d/l53 to dd/l86 0 2023-12-09T02:35:13.811 INFO:tasks.workunit.client.1.smithi161.stdout:3/379: mknod d2/d4/d11/d1f/d2a/d46/d40/c68 0 2023-12-09T02:35:13.812 INFO:tasks.workunit.client.1.smithi161.stdout:3/380: read d2/d4/d11/d1f/d2a/d46/f54 [35914,94276] 0 2023-12-09T02:35:13.813 INFO:tasks.workunit.client.1.smithi161.stdout:6/414: dwrite da/d28/d29/d2b/d31/f53 [0,4194304] 0 2023-12-09T02:35:13.814 INFO:tasks.workunit.client.1.smithi161.stdout:0/447: mknod d9/dd/d71/c88 0 2023-12-09T02:35:13.815 INFO:tasks.workunit.client.1.smithi161.stdout:4/442: symlink dd/d5a/l87 0 2023-12-09T02:35:13.818 INFO:tasks.workunit.client.1.smithi161.stdout:4/443: dread dd/d1a/f1c [0,4194304] 0 2023-12-09T02:35:13.819 INFO:tasks.workunit.client.1.smithi161.stdout:6/415: symlink da/d19/l95 0 2023-12-09T02:35:13.820 INFO:tasks.workunit.client.1.smithi161.stdout:0/448: creat d9/db/d2a/d35/f89 x:0 0 0 2023-12-09T02:35:13.821 INFO:tasks.workunit.client.1.smithi161.stdout:4/444: mkdir dd/d36/d4a/d88 0 2023-12-09T02:35:13.821 INFO:tasks.workunit.client.1.smithi161.stdout:4/445: chown dd/c45 148412615 1 2023-12-09T02:35:13.824 INFO:tasks.workunit.client.1.smithi161.stdout:0/449: unlink d9/dd/f61 0 2023-12-09T02:35:13.830 INFO:tasks.workunit.client.1.smithi161.stdout:6/416: dread da/fc [0,4194304] 0 2023-12-09T02:35:13.832 INFO:tasks.workunit.client.1.smithi161.stdout:0/450: unlink d9/f20 0 2023-12-09T02:35:13.837 INFO:tasks.workunit.client.1.smithi161.stdout:0/451: link d9/d55/d7c/f4e d9/d55/d26/d28/d58/f8a 0 2023-12-09T02:35:13.849 INFO:tasks.workunit.client.1.smithi161.stdout:4/446: dwrite f9 [0,4194304] 0 2023-12-09T02:35:13.849 INFO:tasks.workunit.client.1.smithi161.stdout:6/417: dwrite da/d55/d6d/f75 [0,4194304] 0 2023-12-09T02:35:13.850 INFO:tasks.workunit.client.1.smithi161.stdout:6/418: write da/d19/d20/f25 [5106643,19801] 0 2023-12-09T02:35:13.850 INFO:tasks.workunit.client.1.smithi161.stdout:3/381: dwrite d2/fe [0,4194304] 0 2023-12-09T02:35:13.850 INFO:tasks.workunit.client.1.smithi161.stdout:0/452: dread d9/db/f3e [0,4194304] 0 2023-12-09T02:35:13.851 INFO:tasks.workunit.client.1.smithi161.stdout:4/447: creat dd/d1a/d1d/d25/d3a/f89 x:0 0 0 2023-12-09T02:35:13.855 INFO:tasks.workunit.client.1.smithi161.stdout:6/419: symlink da/d28/d29/d92/l96 0 2023-12-09T02:35:13.857 INFO:tasks.workunit.client.1.smithi161.stdout:4/448: mkdir dd/d36/d4a/d88/d8a 0 2023-12-09T02:35:13.862 INFO:tasks.workunit.client.1.smithi161.stdout:6/420: creat da/d28/d29/d2b/f97 x:0 0 0 2023-12-09T02:35:13.864 INFO:tasks.workunit.client.1.smithi161.stdout:0/453: symlink d9/dd/l8b 0 2023-12-09T02:35:13.881 INFO:tasks.workunit.client.1.smithi161.stdout:4/449: dwrite dd/d1a/d1d/d25/f3b [4194304,4194304] 0 2023-12-09T02:35:13.882 INFO:tasks.workunit.client.1.smithi161.stdout:4/450: symlink dd/d36/d4a/d88/d8a/l8b 0 2023-12-09T02:35:13.884 INFO:tasks.workunit.client.1.smithi161.stdout:4/451: dread dd/d1a/d1e/f21 [0,4194304] 0 2023-12-09T02:35:13.893 INFO:tasks.workunit.client.1.smithi161.stdout:0/454: dwrite d9/d55/d7c/f74 [0,4194304] 0 2023-12-09T02:35:13.894 INFO:tasks.workunit.client.1.smithi161.stdout:6/421: dwrite da/d55/f86 [0,4194304] 0 2023-12-09T02:35:13.894 INFO:tasks.workunit.client.1.smithi161.stdout:6/422: truncate da/d28/d3c/f90 849979 0 2023-12-09T02:35:13.897 INFO:tasks.workunit.client.1.smithi161.stdout:6/423: read da/d19/f24 [325959,20632] 0 2023-12-09T02:35:13.898 INFO:tasks.workunit.client.1.smithi161.stdout:6/424: creat da/d28/d4d/d5e/f98 x:0 0 0 2023-12-09T02:35:13.900 INFO:tasks.workunit.client.1.smithi161.stdout:6/425: truncate da/d19/f24 2052108 0 2023-12-09T02:35:13.900 INFO:tasks.workunit.client.1.smithi161.stdout:6/426: stat da/df/d2d/f32 0 2023-12-09T02:35:13.903 INFO:tasks.workunit.client.1.smithi161.stdout:6/427: link da/f12 da/df/f99 0 2023-12-09T02:35:13.905 INFO:tasks.workunit.client.1.smithi161.stdout:6/428: rename da/d28/d29/d2b/d31/f53 to da/d28/d77/f9a 0 2023-12-09T02:35:13.907 INFO:tasks.workunit.client.1.smithi161.stdout:4/452: dwrite dd/d1a/d1d/f49 [0,4194304] 0 2023-12-09T02:35:13.909 INFO:tasks.workunit.client.1.smithi161.stdout:6/429: write da/d28/d3c/f91 [143062,124018] 0 2023-12-09T02:35:13.909 INFO:tasks.workunit.client.1.smithi161.stdout:6/430: chown da/d28/d3c/c41 9224 1 2023-12-09T02:35:13.909 INFO:tasks.workunit.client.1.smithi161.stdout:6/431: chown da/d28/d29/d92 4136553 1 2023-12-09T02:35:13.915 INFO:tasks.workunit.client.1.smithi161.stdout:6/432: rmdir da/d55/d6d 39 2023-12-09T02:35:13.917 INFO:tasks.workunit.client.1.smithi161.stdout:6/433: symlink da/d28/d4d/d5e/l9b 0 2023-12-09T02:35:13.921 INFO:tasks.workunit.client.1.smithi161.stdout:0/455: dwrite d9/f1d [0,4194304] 0 2023-12-09T02:35:13.922 INFO:tasks.workunit.client.1.smithi161.stdout:6/434: creat da/df/f9c x:0 0 0 2023-12-09T02:35:13.922 INFO:tasks.workunit.client.1.smithi161.stdout:6/435: readlink da/d19/d20/d6f/l93 0 2023-12-09T02:35:13.925 INFO:tasks.workunit.client.1.smithi161.stdout:4/453: dwrite dd/d1a/d1e/f21 [0,4194304] 0 2023-12-09T02:35:13.937 INFO:tasks.workunit.client.1.smithi161.stdout:0/456: creat d9/d55/d26/f8c x:0 0 0 2023-12-09T02:35:13.937 INFO:tasks.workunit.client.1.smithi161.stdout:0/457: read d9/d55/f51 [669388,58440] 0 2023-12-09T02:35:13.938 INFO:tasks.workunit.client.1.smithi161.stdout:0/458: write d9/d55/d7c/f2b [370218,17612] 0 2023-12-09T02:35:13.938 INFO:tasks.workunit.client.1.smithi161.stdout:0/459: chown d9/d55/d26/d82/c83 48 1 2023-12-09T02:35:13.938 INFO:tasks.workunit.client.1.smithi161.stdout:6/436: link da/d19/f72 da/d28/d29/d2b/d31/d33/d39/f9d 0 2023-12-09T02:35:13.942 INFO:tasks.workunit.client.1.smithi161.stdout:0/460: rename d9/db/d2a/c4f to d9/d55/d44/d85/c8d 0 2023-12-09T02:35:13.944 INFO:tasks.workunit.client.1.smithi161.stdout:6/437: rename da/d19/d20/d6f to da/d28/d9e 0 2023-12-09T02:35:13.946 INFO:tasks.workunit.client.1.smithi161.stdout:0/461: mkdir d9/d55/d26/d28/d58/d8e 0 2023-12-09T02:35:13.947 INFO:tasks.workunit.client.1.smithi161.stdout:4/454: dwrite dd/f19 [4194304,4194304] 0 2023-12-09T02:35:13.952 INFO:tasks.workunit.client.1.smithi161.stdout:0/462: read d9/d55/d7c/f4e [3085,122728] 0 2023-12-09T02:35:13.955 INFO:tasks.workunit.client.1.smithi161.stdout:4/455: rename dd/d36/d4a/d88/d8a/l8b to dd/d1a/d1d/d25/d32/l8c 0 2023-12-09T02:35:13.959 INFO:tasks.workunit.client.1.smithi161.stdout:4/456: rename dd/d36/d3f/d54/l5c to dd/d1a/d1d/d25/l8d 0 2023-12-09T02:35:13.962 INFO:tasks.workunit.client.1.smithi161.stdout:4/457: creat dd/d1a/d1d/f8e x:0 0 0 2023-12-09T02:35:13.962 INFO:tasks.workunit.client.1.smithi161.stdout:0/463: dread d9/dd/f1e [0,4194304] 0 2023-12-09T02:35:13.966 INFO:tasks.workunit.client.1.smithi161.stdout:0/464: dread d9/d1f/f18 [0,4194304] 0 2023-12-09T02:35:13.966 INFO:tasks.workunit.client.1.smithi161.stdout:4/458: symlink dd/d1a/d1d/d25/d32/d34/l8f 0 2023-12-09T02:35:13.966 INFO:tasks.workunit.client.1.smithi161.stdout:4/459: chown dd/d1a/d1d/d25 469 1 2023-12-09T02:35:13.969 INFO:tasks.workunit.client.1.smithi161.stdout:0/465: link d9/d55/d26/f8c d9/d55/d7c/f8f 0 2023-12-09T02:35:13.971 INFO:tasks.workunit.client.1.smithi161.stdout:4/460: symlink dd/d1a/d1e/l90 0 2023-12-09T02:35:13.972 INFO:tasks.workunit.client.1.smithi161.stdout:4/461: chown dd/d36/d4a/f51 3 1 2023-12-09T02:35:13.972 INFO:tasks.workunit.client.1.smithi161.stdout:0/466: symlink d9/d55/d26/d28/d58/l90 0 2023-12-09T02:35:13.972 INFO:tasks.workunit.client.1.smithi161.stdout:6/438: dwrite da/d28/d29/d2b/d31/f66 [0,4194304] 0 2023-12-09T02:35:13.975 INFO:tasks.workunit.client.1.smithi161.stdout:4/462: rmdir dd/d1a/d23/d6a/d79 0 2023-12-09T02:35:13.975 INFO:tasks.workunit.client.1.smithi161.stdout:1/581: sync 2023-12-09T02:35:13.976 INFO:tasks.workunit.client.1.smithi161.stdout:9/378: sync 2023-12-09T02:35:13.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:13.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr fail", "who": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: osdmap e47: 6 total, 6 up, 6 in 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "mgr fail", "who": "smithi088.jwlofb"}]': finished 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: mgrmap e21: smithi161.qmxtmg(active, starting, since 0.0193208s) 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.zfojux"}]: dispatch 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.utskxh"}]: dispatch 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.dhvdif"}]: dispatch 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.posrbq"}]: dispatch 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mgr metadata", "who": "smithi161.qmxtmg", "id": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:35:13.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: Manager daemon smithi161.qmxtmg is now available 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.qmxtmg/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.qmxtmg/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:35:13.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.qmxtmg/trash_purge_schedule"}]: dispatch 2023-12-09T02:35:13.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.qmxtmg/trash_purge_schedule"}]: dispatch 2023-12-09T02:35:13.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:13.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:13 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:13.979 INFO:tasks.workunit.client.1.smithi161.stdout:4/463: write dd/d1a/d1d/d25/d32/f7e [428201,93081] 0 2023-12-09T02:35:13.980 INFO:tasks.workunit.client.1.smithi161.stdout:6/439: mknod da/d28/d3c/d46/c9f 0 2023-12-09T02:35:13.982 INFO:tasks.workunit.client.1.smithi161.stdout:0/467: dread d9/db/f3e [0,4194304] 0 2023-12-09T02:35:13.983 INFO:tasks.workunit.client.1.smithi161.stdout:1/582: chown d6/d8/d63/d79 1225998 1 2023-12-09T02:35:13.986 INFO:tasks.workunit.client.1.smithi161.stdout:9/379: mkdir d2/d25/d3a/d65/d42/d58/d16/d2e/d80 0 2023-12-09T02:35:13.988 INFO:tasks.workunit.client.1.smithi161.stdout:9/380: read d2/f1b [1460042,127887] 0 2023-12-09T02:35:13.988 INFO:tasks.workunit.client.1.smithi161.stdout:9/381: stat d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/d71 0 2023-12-09T02:35:13.989 INFO:tasks.workunit.client.1.smithi161.stdout:0/468: dread d9/d55/d26/d28/d58/f8a [0,4194304] 0 2023-12-09T02:35:13.989 INFO:tasks.workunit.client.1.smithi161.stdout:0/469: readlink d9/db/l78 0 2023-12-09T02:35:13.989 INFO:tasks.workunit.client.1.smithi161.stdout:0/470: read - d9/dd/d3a/f3d zero size 2023-12-09T02:35:13.991 INFO:tasks.workunit.client.1.smithi161.stdout:0/471: dread d9/d55/d7c/f2b [0,4194304] 0 2023-12-09T02:35:13.991 INFO:tasks.workunit.client.1.smithi161.stdout:4/464: mknod dd/d1a/d23/c91 0 2023-12-09T02:35:13.991 INFO:tasks.workunit.client.1.smithi161.stdout:0/472: stat d9/dd/l7d 0 2023-12-09T02:35:13.991 INFO:tasks.workunit.client.1.smithi161.stdout:0/473: readlink d9/dd/d3a/l4c 0 2023-12-09T02:35:13.991 INFO:tasks.workunit.client.1.smithi161.stdout:0/474: write d9/d55/d26/f57 [1275264,116889] 0 2023-12-09T02:35:13.992 INFO:tasks.workunit.client.1.smithi161.stdout:1/583: dread d6/d8/d63/d4d/d31/f3a [0,4194304] 0 2023-12-09T02:35:13.994 INFO:tasks.workunit.client.1.smithi161.stdout:6/440: symlink da/d28/d3c/la0 0 2023-12-09T02:35:13.999 INFO:tasks.workunit.client.1.smithi161.stdout:9/382: mknod d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/d71/c81 0 2023-12-09T02:35:14.002 INFO:tasks.workunit.client.1.smithi161.stdout:0/475: truncate d9/f1d 2936596 0 2023-12-09T02:35:14.003 INFO:tasks.workunit.client.1.smithi161.stdout:1/584: symlink d6/d9/d8b/lc0 0 2023-12-09T02:35:14.004 INFO:tasks.workunit.client.1.smithi161.stdout:6/441: getdents da/d28/d4d/d5e 0 2023-12-09T02:35:14.005 INFO:tasks.workunit.client.1.smithi161.stdout:4/465: dwrite dd/d1a/d1d/d25/d3a/f89 [0,4194304] 0 2023-12-09T02:35:14.008 INFO:tasks.workunit.client.1.smithi161.stdout:9/383: rename d2/d25/d3a/d65/d42/d58/d16/l62 to d2/d25/d3a/d65/d7c/l82 0 2023-12-09T02:35:14.009 INFO:tasks.workunit.client.1.smithi161.stdout:9/384: write d2/d25/d3a/d65/d5c/f56 [59098,46808] 0 2023-12-09T02:35:14.010 INFO:tasks.workunit.client.1.smithi161.stdout:0/476: creat d9/db/d2a/d35/f91 x:0 0 0 2023-12-09T02:35:14.016 INFO:tasks.workunit.client.1.smithi161.stdout:4/466: symlink dd/d36/d4a/d5f/d65/l92 0 2023-12-09T02:35:14.025 INFO:tasks.workunit.client.1.smithi161.stdout:9/385: mkdir d2/d25/d3a/d65/d5c/d55/d66/d83 0 2023-12-09T02:35:14.025 INFO:tasks.workunit.client.1.smithi161.stdout:0/477: dwrite d9/d55/d7c/f6c [0,4194304] 0 2023-12-09T02:35:14.025 INFO:tasks.workunit.client.1.smithi161.stdout:0/478: write d9/db/f84 [750714,254] 0 2023-12-09T02:35:14.027 INFO:tasks.workunit.client.1.smithi161.stdout:0/479: write d9/db/d2a/d35/d4a/f63 [3370189,82255] 0 2023-12-09T02:35:14.029 INFO:tasks.workunit.client.1.smithi161.stdout:4/467: mknod dd/d1a/d23/c93 0 2023-12-09T02:35:14.029 INFO:tasks.workunit.client.1.smithi161.stdout:4/468: write dd/d36/f74 [943534,47299] 0 2023-12-09T02:35:14.032 INFO:tasks.workunit.client.1.smithi161.stdout:1/585: rename d6/d8/d63/d93/c5b to d6/d8/d63/d4d/cc1 0 2023-12-09T02:35:14.033 INFO:tasks.workunit.client.1.smithi161.stdout:1/586: write d6/d8/f92 [461259,118403] 0 2023-12-09T02:35:14.035 INFO:tasks.workunit.client.1.smithi161.stdout:1/587: dread d6/d8/d63/d93/f48 [0,4194304] 0 2023-12-09T02:35:14.037 INFO:tasks.workunit.client.1.smithi161.stdout:9/386: mknod d2/d25/d3a/d65/d42/d58/d22/c84 0 2023-12-09T02:35:14.037 INFO:tasks.workunit.client.1.smithi161.stdout:9/387: stat d2/d25/d3a/d65/d5c/f56 0 2023-12-09T02:35:14.038 INFO:tasks.workunit.client.1.smithi161.stdout:4/469: dread dd/d1a/d1d/d25/f3b [0,4194304] 0 2023-12-09T02:35:14.038 INFO:tasks.workunit.client.1.smithi161.stdout:4/470: write dd/fe [4055821,105836] 0 2023-12-09T02:35:14.042 INFO:tasks.workunit.client.1.smithi161.stdout:0/480: mknod d9/db/d2a/d35/d4a/c92 0 2023-12-09T02:35:14.044 INFO:tasks.workunit.client.1.smithi161.stdout:6/442: rename da/f2c to da/d55/d6d/fa1 0 2023-12-09T02:35:14.044 INFO:tasks.workunit.client.1.smithi161.stdout:6/443: chown da/d19/l1c 1665928 1 2023-12-09T02:35:14.044 INFO:tasks.workunit.client.1.smithi161.stdout:6/444: stat da/d28/d29/d2b/d31/f51 0 2023-12-09T02:35:14.045 INFO:tasks.workunit.client.1.smithi161.stdout:6/445: write da/df/d2d/f32 [2751642,102010] 0 2023-12-09T02:35:14.047 INFO:tasks.workunit.client.1.smithi161.stdout:4/471: dread dd/d1a/d1e/f21 [0,4194304] 0 2023-12-09T02:35:14.048 INFO:tasks.workunit.client.1.smithi161.stdout:1/588: creat d6/d8/d63/d4d/d31/d73/fc2 x:0 0 0 2023-12-09T02:35:14.048 INFO:tasks.workunit.client.1.smithi161.stdout:1/589: readlink d6/d8/l6c 0 2023-12-09T02:35:14.053 INFO:tasks.workunit.client.1.smithi161.stdout:9/388: truncate d2/f8 643135 0 2023-12-09T02:35:14.056 INFO:tasks.workunit.client.1.smithi161.stdout:0/481: creat d9/d55/d26/d28/d58/f93 x:0 0 0 2023-12-09T02:35:14.056 INFO:tasks.workunit.client.1.smithi161.stdout:0/482: write d9/dd/f80 [218148,50974] 0 2023-12-09T02:35:14.059 INFO:tasks.workunit.client.1.smithi161.stdout:6/446: creat da/d28/d29/d92/fa2 x:0 0 0 2023-12-09T02:35:14.063 INFO:tasks.workunit.client.1.smithi161.stdout:4/472: unlink dd/d1a/f64 0 2023-12-09T02:35:14.065 INFO:tasks.workunit.client.1.smithi161.stdout:1/590: unlink d6/d8/d63/d35/c4b 0 2023-12-09T02:35:14.066 INFO:tasks.workunit.client.1.smithi161.stdout:8/404: sync 2023-12-09T02:35:14.068 INFO:tasks.workunit.client.1.smithi161.stdout:0/483: dread d9/d55/d26/d28/d58/f8a [0,4194304] 0 2023-12-09T02:35:14.068 INFO:tasks.workunit.client.1.smithi161.stdout:0/484: dread - d9/d55/d26/d28/d58/f93 zero size 2023-12-09T02:35:14.070 INFO:tasks.workunit.client.1.smithi161.stdout:9/389: creat d2/d25/d3a/f85 x:0 0 0 2023-12-09T02:35:14.071 INFO:tasks.workunit.client.1.smithi161.stdout:4/473: link dd/d1a/c2a dd/d36/d3f/c94 0 2023-12-09T02:35:14.071 INFO:tasks.workunit.client.1.smithi161.stdout:4/474: fdatasync dd/d36/d3f/f4b 0 2023-12-09T02:35:14.083 INFO:tasks.workunit.client.1.smithi161.stdout:1/591: rename d6/d8/d63/d79 to d6/d8/d63/d35/d3d/dc3 0 2023-12-09T02:35:14.083 INFO:tasks.workunit.client.1.smithi161.stdout:9/390: creat d2/d25/d3a/d65/d42/d58/d16/f86 x:0 0 0 2023-12-09T02:35:14.085 INFO:tasks.workunit.client.1.smithi161.stdout:1/592: link d6/d8/d63/d1c/f41 d6/d8/d63/d4d/fc4 0 2023-12-09T02:35:14.086 INFO:tasks.workunit.client.1.smithi161.stdout:9/391: creat d2/d25/d3a/d4d/d7d/f87 x:0 0 0 2023-12-09T02:35:14.088 INFO:tasks.workunit.client.1.smithi161.stdout:1/593: mknod d6/d8/d63/d1c/d81/cc5 0 2023-12-09T02:35:14.093 INFO:tasks.workunit.client.1.smithi161.stdout:9/392: rmdir d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/d71 39 2023-12-09T02:35:14.093 INFO:tasks.workunit.client.1.smithi161.stdout:9/393: chown d2/d25/d3a/d65/d42/d58/d16/d2e/d80 19428049 1 2023-12-09T02:35:14.094 INFO:tasks.workunit.client.1.smithi161.stdout:8/405: dwrite d2/f3 [0,4194304] 0 2023-12-09T02:35:14.094 INFO:tasks.workunit.client.1.smithi161.stdout:6/447: dwrite da/f76 [0,4194304] 0 2023-12-09T02:35:14.095 INFO:tasks.workunit.client.1.smithi161.stdout:1/594: unlink d6/d8/d63/d4d/d31/d73/fc2 0 2023-12-09T02:35:14.095 INFO:tasks.workunit.client.1.smithi161.stdout:1/595: write d6/d8/d63/d35/daa/f6b [251514,25285] 0 2023-12-09T02:35:14.095 INFO:tasks.workunit.client.1.smithi161.stdout:1/596: fdatasync d6/d8/d63/d4d/d31/fbf 0 2023-12-09T02:35:14.096 INFO:tasks.workunit.client.1.smithi161.stdout:9/394: mkdir d2/d25/d3a/d65/d88 0 2023-12-09T02:35:14.097 INFO:tasks.workunit.client.1.smithi161.stdout:4/475: dwrite dd/d1a/d23/f63 [0,4194304] 0 2023-12-09T02:35:14.097 INFO:tasks.workunit.client.1.smithi161.stdout:8/406: mknod d2/d5/c7e 0 2023-12-09T02:35:14.105 INFO:tasks.workunit.client.1.smithi161.stdout:5/408: sync 2023-12-09T02:35:14.105 INFO:tasks.workunit.client.1.smithi161.stdout:2/481: sync 2023-12-09T02:35:14.105 INFO:tasks.workunit.client.1.smithi161.stdout:2/482: truncate d4/d1a/d4a/d4f/f57 1632912 0 2023-12-09T02:35:14.105 INFO:tasks.workunit.client.1.smithi161.stdout:2/483: write d4/f20 [4216580,55717] 0 2023-12-09T02:35:14.105 INFO:tasks.workunit.client.1.smithi161.stdout:7/526: sync 2023-12-09T02:35:14.105 INFO:tasks.workunit.client.1.smithi161.stdout:3/382: sync 2023-12-09T02:35:14.105 INFO:tasks.workunit.client.1.smithi161.stdout:3/383: write d2/d4/f36 [2734657,66966] 0 2023-12-09T02:35:14.105 INFO:tasks.workunit.client.1.smithi161.stdout:1/597: mknod d6/d8/d63/d4d/d9f/cc6 0 2023-12-09T02:35:14.106 INFO:tasks.workunit.client.1.smithi161.stdout:7/527: read d0/d3/d9e/d59/f6d [268568,28713] 0 2023-12-09T02:35:14.106 INFO:tasks.workunit.client.1.smithi161.stdout:5/409: dread d0/d2/d7/d11/f35 [0,4194304] 0 2023-12-09T02:35:14.106 INFO:tasks.workunit.client.1.smithi161.stdout:5/410: truncate d0/d2/d7/df/d60/f6e 1254592 0 2023-12-09T02:35:14.107 INFO:tasks.workunit.client.1.smithi161.stdout:5/411: chown d0/d2/de/c53 394913916 1 2023-12-09T02:35:14.107 INFO:tasks.workunit.client.1.smithi161.stdout:5/412: dread - d0/d2/d7/d70/f75 zero size 2023-12-09T02:35:14.107 INFO:tasks.workunit.client.1.smithi161.stdout:9/395: creat d2/d25/d3a/d65/d5c/d60/d7f/f89 x:0 0 0 2023-12-09T02:35:14.107 INFO:tasks.workunit.client.1.smithi161.stdout:9/396: chown d2/d25/d3a/d65/d42/d58/l2a 22 1 2023-12-09T02:35:14.110 INFO:tasks.workunit.client.1.smithi161.stdout:3/384: dread d2/d4/d11/d1f/d2a/f2f [0,4194304] 0 2023-12-09T02:35:14.112 INFO:tasks.workunit.client.1.smithi161.stdout:4/476: rename dd/l69 to dd/d1a/d1d/d25/d32/d34/d78/l95 0 2023-12-09T02:35:14.115 INFO:tasks.workunit.client.1.smithi161.stdout:2/484: creat d4/d1a/d4a/d4f/f9d x:0 0 0 2023-12-09T02:35:14.118 INFO:tasks.workunit.client.1.smithi161.stdout:7/528: creat d0/d49/d79/fa9 x:0 0 0 2023-12-09T02:35:14.119 INFO:tasks.workunit.client.1.smithi161.stdout:5/413: creat d0/d2/d7/df/f96 x:0 0 0 2023-12-09T02:35:14.120 INFO:tasks.workunit.client.1.smithi161.stdout:5/414: fsync d0/d1f/f81 0 2023-12-09T02:35:14.121 INFO:tasks.workunit.client.1.smithi161.stdout:6/448: dwrite da/d28/d4d/d5e/f98 [0,4194304] 0 2023-12-09T02:35:14.122 INFO:tasks.workunit.client.1.smithi161.stdout:9/397: stat d2/d25/d3a/d65/d42/d58/d16/l23 0 2023-12-09T02:35:14.123 INFO:tasks.workunit.client.1.smithi161.stdout:4/477: symlink dd/d36/d4a/d88/l96 0 2023-12-09T02:35:14.125 INFO:tasks.workunit.client.1.smithi161.stdout:6/449: dread da/d28/d77/d79/f7a [4194304,4194304] 0 2023-12-09T02:35:14.130 INFO:tasks.workunit.client.1.smithi161.stdout:2/485: write d4/d16/d69/d7b/f4e [3841128,15638] 0 2023-12-09T02:35:14.130 INFO:tasks.workunit.client.1.smithi161.stdout:6/450: write da/d19/d20/f25 [1086120,90074] 0 2023-12-09T02:35:14.130 INFO:tasks.workunit.client.1.smithi161.stdout:6/451: stat da/f76 0 2023-12-09T02:35:14.130 INFO:tasks.workunit.client.1.smithi161.stdout:9/398: rmdir d2/d25/d3a/d65/d5c/d60 39 2023-12-09T02:35:14.132 INFO:tasks.workunit.client.1.smithi161.stdout:4/478: creat dd/d1a/d1d/d25/d32/d34/f97 x:0 0 0 2023-12-09T02:35:14.137 INFO:tasks.workunit.client.1.smithi161.stdout:2/486: rmdir d4/d7/db 39 2023-12-09T02:35:14.143 INFO:tasks.workunit.client.1.smithi161.stdout:8/407: dwrite d2/d5/d22/d31/d38/f79 [0,4194304] 0 2023-12-09T02:35:14.143 INFO:tasks.workunit.client.1.smithi161.stdout:9/399: symlink d2/d25/d3a/d65/d42/d58/d16/l8a 0 2023-12-09T02:35:14.145 INFO:tasks.workunit.client.1.smithi161.stdout:9/400: read d2/d25/d3a/d4d/f67 [4108790,12981] 0 2023-12-09T02:35:14.146 INFO:tasks.workunit.client.1.smithi161.stdout:4/479: dread dd/f13 [0,4194304] 0 2023-12-09T02:35:14.146 INFO:tasks.workunit.client.1.smithi161.stdout:4/480: truncate dd/d36/d4a/f6f 1985954 0 2023-12-09T02:35:14.146 INFO:tasks.workunit.client.1.smithi161.stdout:4/481: readlink dd/d1a/d1d/d25/d3a/l50 0 2023-12-09T02:35:14.148 INFO:tasks.workunit.client.1.smithi161.stdout:6/452: mkdir da/da3 0 2023-12-09T02:35:14.153 INFO:tasks.workunit.client.1.smithi161.stdout:9/401: mknod d2/d25/d3a/d4d/d7d/c8b 0 2023-12-09T02:35:14.153 INFO:tasks.workunit.client.1.smithi161.stdout:9/402: read - d2/d25/d3a/f85 zero size 2023-12-09T02:35:14.158 INFO:tasks.workunit.client.1.smithi161.stdout:7/529: dwrite d0/d3/d13/f96 [0,4194304] 0 2023-12-09T02:35:14.160 INFO:tasks.workunit.client.1.smithi161.stdout:4/482: creat dd/d1a/d23/d6a/f98 x:0 0 0 2023-12-09T02:35:14.162 INFO:tasks.workunit.client.1.smithi161.stdout:5/415: dwrite d0/d2/d7/f39 [0,4194304] 0 2023-12-09T02:35:14.169 INFO:tasks.workunit.client.1.smithi161.stdout:4/483: rename dd/d1a/d23/f63 to dd/d1a/d1d/d25/d32/f99 0 2023-12-09T02:35:14.169 INFO:tasks.workunit.client.1.smithi161.stdout:7/530: getdents d0/d49/d79 0 2023-12-09T02:35:14.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:14.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr fail", "who": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:35:14.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: osdmap e47: 6 total, 6 up, 6 in 2023-12-09T02:35:14.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.14208 172.21.15.88:0/776319262' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "mgr fail", "who": "smithi088.jwlofb"}]': finished 2023-12-09T02:35:14.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: mgrmap e21: smithi161.qmxtmg(active, starting, since 0.0193208s) 2023-12-09T02:35:14.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.zfojux"}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.utskxh"}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.dhvdif"}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.posrbq"}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mgr metadata", "who": "smithi161.qmxtmg", "id": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-09T02:35:14.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-09T02:35:14.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: Manager daemon smithi161.qmxtmg is now available 2023-12-09T02:35:14.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:14.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:14.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:14.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:35:14.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.qmxtmg/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:35:14.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.qmxtmg/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:35:14.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.qmxtmg/trash_purge_schedule"}]: dispatch 2023-12-09T02:35:14.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.qmxtmg/trash_purge_schedule"}]: dispatch 2023-12-09T02:35:14.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:14.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:13 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:14.176 INFO:tasks.workunit.client.1.smithi161.stdout:5/416: rename d0/c92 to d0/d2/d7/c97 0 2023-12-09T02:35:14.176 INFO:tasks.workunit.client.1.smithi161.stdout:5/417: readlink d0/l67 0 2023-12-09T02:35:14.176 INFO:tasks.workunit.client.1.smithi161.stdout:4/484: symlink dd/d1a/d1d/d25/d3a/l9a 0 2023-12-09T02:35:14.179 INFO:tasks.workunit.client.1.smithi161.stdout:2/487: dwrite d4/d7/db/f36 [0,4194304] 0 2023-12-09T02:35:14.179 INFO:tasks.workunit.client.1.smithi161.stdout:2/488: readlink d4/d16/d69/d8c/d5a/l9a 0 2023-12-09T02:35:14.179 INFO:tasks.workunit.client.1.smithi161.stdout:2/489: chown d4/fa 15 1 2023-12-09T02:35:14.179 INFO:tasks.workunit.client.1.smithi161.stdout:6/453: dwrite da/d28/d4d/d5e/f6c [0,4194304] 0 2023-12-09T02:35:14.180 INFO:tasks.workunit.client.1.smithi161.stdout:7/531: mkdir d0/d3/daa 0 2023-12-09T02:35:14.180 INFO:tasks.workunit.client.1.smithi161.stdout:7/532: chown d0/d3/d9e/d59/f6d 643 1 2023-12-09T02:35:14.180 INFO:tasks.workunit.client.1.smithi161.stdout:8/408: dwrite d2/d2d/f70 [0,4194304] 0 2023-12-09T02:35:14.181 INFO:tasks.workunit.client.1.smithi161.stdout:5/418: symlink d0/d1f/l98 0 2023-12-09T02:35:14.181 INFO:tasks.workunit.client.1.smithi161.stdout:9/403: dwrite d2/f19 [0,4194304] 0 2023-12-09T02:35:14.181 INFO:tasks.workunit.client.1.smithi161.stdout:9/404: fdatasync d2/d25/d3a/d4d/f67 0 2023-12-09T02:35:14.182 INFO:tasks.workunit.client.1.smithi161.stdout:9/405: fsync d2/f1b 0 2023-12-09T02:35:14.184 INFO:tasks.workunit.client.1.smithi161.stdout:4/485: rename dd/c44 to dd/d1a/d1d/d25/c9b 0 2023-12-09T02:35:14.189 INFO:tasks.workunit.client.1.smithi161.stdout:2/490: mknod d4/d1a/d4a/d4f/c9e 0 2023-12-09T02:35:14.194 INFO:tasks.workunit.client.1.smithi161.stdout:7/533: truncate d0/d3/d13/d1b/f3f 545548 0 2023-12-09T02:35:14.200 INFO:tasks.workunit.client.1.smithi161.stdout:9/406: mknod d2/d25/d3a/d65/c8c 0 2023-12-09T02:35:14.205 INFO:tasks.workunit.client.1.smithi161.stdout:4/486: mknod dd/d1a/d1e/c9c 0 2023-12-09T02:35:14.212 INFO:tasks.workunit.client.1.smithi161.stdout:7/534: rename d0/d3/d21/d3e to d0/d3/d13/d2d/d43/dab 0 2023-12-09T02:35:14.213 INFO:tasks.workunit.client.1.smithi161.stdout:2/491: dread d4/d1a/d4a/d6d/f7a [0,4194304] 0 2023-12-09T02:35:14.213 INFO:tasks.workunit.client.1.smithi161.stdout:2/492: write d4/f7d [622228,14124] 0 2023-12-09T02:35:14.214 INFO:tasks.workunit.client.1.smithi161.stdout:4/487: truncate dd/d1a/d1d/d25/d32/f99 1179119 0 2023-12-09T02:35:14.218 INFO:tasks.workunit.client.1.smithi161.stdout:4/488: mkdir dd/d1a/d1d/d25/d32/d9d 0 2023-12-09T02:35:14.221 INFO:tasks.workunit.client.1.smithi161.stdout:2/493: dread d4/d16/d69/d8c/d5a/f71 [0,4194304] 0 2023-12-09T02:35:14.221 INFO:tasks.workunit.client.1.smithi161.stdout:2/494: readlink d4/l34 0 2023-12-09T02:35:14.221 INFO:tasks.workunit.client.1.smithi161.stdout:4/489: creat dd/d36/d3f/f9e x:0 0 0 2023-12-09T02:35:14.224 INFO:tasks.workunit.client.1.smithi161.stdout:4/490: getdents dd/d1a/d23 0 2023-12-09T02:35:14.224 INFO:tasks.workunit.client.1.smithi161.stdout:4/491: chown dd/d1a/d29/c39 117102074 1 2023-12-09T02:35:14.226 INFO:tasks.workunit.client.1.smithi161.stdout:4/492: creat dd/d1a/d23/f9f x:0 0 0 2023-12-09T02:35:14.226 INFO:tasks.workunit.client.1.smithi161.stdout:4/493: fdatasync dd/d36/d4a/f84 0 2023-12-09T02:35:14.226 INFO:tasks.workunit.client.1.smithi161.stdout:2/495: write d4/d16/d69/d7b/f54 [2268349,52237] 0 2023-12-09T02:35:14.229 INFO:tasks.workunit.client.1.smithi161.stdout:6/454: dwrite da/df/d2d/d3b/f42 [4194304,4194304] 0 2023-12-09T02:35:14.229 INFO:tasks.workunit.client.1.smithi161.stdout:4/494: truncate f9 1190599 0 2023-12-09T02:35:14.234 INFO:tasks.workunit.client.1.smithi161.stdout:8/409: dwrite d2/d5/d22/d31/f37 [0,4194304] 0 2023-12-09T02:35:14.234 INFO:tasks.workunit.client.1.smithi161.stdout:5/419: dwrite d0/d1f/f84 [0,4194304] 0 2023-12-09T02:35:14.234 INFO:tasks.workunit.client.1.smithi161.stdout:5/420: read - d0/d9/f78 zero size 2023-12-09T02:35:14.234 INFO:tasks.workunit.client.1.smithi161.stdout:5/421: chown d0/d2/d7/df/d60/f95 281 1 2023-12-09T02:35:14.236 INFO:tasks.workunit.client.1.smithi161.stdout:4/495: rmdir dd/d1a/d1d/d25/d32/d9d 0 2023-12-09T02:35:14.238 INFO:tasks.workunit.client.1.smithi161.stdout:8/410: symlink d2/l7f 0 2023-12-09T02:35:14.238 INFO:tasks.workunit.client.1.smithi161.stdout:9/407: dwrite d2/d25/d3a/d65/d42/d58/f10 [4194304,4194304] 0 2023-12-09T02:35:14.238 INFO:tasks.workunit.client.1.smithi161.stdout:8/411: write d2/d5/d22/f77 [44652,47939] 0 2023-12-09T02:35:14.238 INFO:tasks.workunit.client.1.smithi161.stdout:5/422: dread d0/d1f/f42 [0,4194304] 0 2023-12-09T02:35:14.238 INFO:tasks.workunit.client.1.smithi161.stdout:5/423: chown d0 8641695 1 2023-12-09T02:35:14.240 INFO:tasks.workunit.client.1.smithi161.stdout:2/496: dread d4/d1a/f3f [0,4194304] 0 2023-12-09T02:35:14.244 INFO:tasks.workunit.client.1.smithi161.stdout:4/496: rmdir dd 39 2023-12-09T02:35:14.244 INFO:tasks.workunit.client.1.smithi161.stdout:4/497: dread - dd/d1a/d1d/d25/d32/d34/f97 zero size 2023-12-09T02:35:14.244 INFO:tasks.workunit.client.1.smithi161.stdout:6/455: dread da/d28/d29/d2b/d31/f51 [0,4194304] 0 2023-12-09T02:35:14.247 INFO:tasks.workunit.client.1.smithi161.stdout:9/408: unlink d2/d25/d3a/d65/d42/d58/d22/c57 0 2023-12-09T02:35:14.250 INFO:tasks.workunit.client.1.smithi161.stdout:9/409: read d2/d25/d3a/d65/d42/d58/d16/d51/f6b [741296,78079] 0 2023-12-09T02:35:14.252 INFO:tasks.workunit.client.1.smithi161.stdout:2/497: link d4/d16/d69/d8c/d5a/f71 d4/d16/d69/d8c/d87/f9f 0 2023-12-09T02:35:14.252 INFO:tasks.workunit.client.1.smithi161.stdout:2/498: chown d4/d16 108 1 2023-12-09T02:35:14.253 INFO:tasks.workunit.client.1.smithi161.stdout:2/499: write d4/f7d [293229,13738] 0 2023-12-09T02:35:14.255 INFO:tasks.workunit.client.1.smithi161.stdout:4/498: rename dd/d1a/d1d/d25/f52 to dd/d36/d4a/d88/fa0 0 2023-12-09T02:35:14.256 INFO:tasks.workunit.client.1.smithi161.stdout:5/424: dwrite d0/d2/de/d22/f59 [0,4194304] 0 2023-12-09T02:35:14.260 INFO:tasks.workunit.client.1.smithi161.stdout:5/425: dread d0/d2/d7/df/d60/f95 [0,4194304] 0 2023-12-09T02:35:14.260 INFO:tasks.workunit.client.1.smithi161.stdout:5/426: truncate d0/d2/f90 94667 0 2023-12-09T02:35:14.261 INFO:tasks.workunit.client.1.smithi161.stdout:9/410: link d2/f3e d2/d25/d3a/d65/d4f/f8d 0 2023-12-09T02:35:14.266 INFO:tasks.workunit.client.1.smithi161.stdout:2/500: creat d4/fa0 x:0 0 0 2023-12-09T02:35:14.266 INFO:tasks.workunit.client.1.smithi161.stdout:2/501: write d4/d1a/d4a/d4f/f73 [831917,6952] 0 2023-12-09T02:35:14.267 INFO:tasks.workunit.client.1.smithi161.stdout:2/502: dread - d4/d1a/f50 zero size 2023-12-09T02:35:14.268 INFO:tasks.workunit.client.1.smithi161.stdout:6/456: rename da/d28/d29/d2b/d31/d33/d39/f9d to da/d28/d3c/fa4 0 2023-12-09T02:35:14.269 INFO:tasks.workunit.client.1.smithi161.stdout:4/499: link dd/d1a/d1d/d25/d32/d34/d78/l95 dd/d1a/d1d/d25/d32/d34/d78/la1 0 2023-12-09T02:35:14.272 INFO:tasks.workunit.client.1.smithi161.stdout:5/427: symlink d0/d2/d7/df/d60/d83/l99 0 2023-12-09T02:35:14.273 INFO:tasks.workunit.client.1.smithi161.stdout:5/428: write d0/d2/d7/df/d60/f95 [910473,124760] 0 2023-12-09T02:35:14.274 INFO:tasks.workunit.client.1.smithi161.stdout:2/503: mknod d4/d7/d8f/ca1 0 2023-12-09T02:35:14.276 INFO:tasks.workunit.client.1.smithi161.stdout:9/411: rename d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/d61/f78 to d2/d25/d3a/f8e 0 2023-12-09T02:35:14.278 INFO:tasks.workunit.client.1.smithi161.stdout:6/457: mknod da/d28/d29/d2b/d31/d33/ca5 0 2023-12-09T02:35:14.279 INFO:tasks.workunit.client.1.smithi161.stdout:6/458: dread - da/d28/d29/d2b/f97 zero size 2023-12-09T02:35:14.281 INFO:tasks.workunit.client.1.smithi161.stdout:5/429: mkdir d0/d2/d7/d9a 0 2023-12-09T02:35:14.283 INFO:tasks.workunit.client.1.smithi161.stdout:2/504: stat d4/d16/d69/c8e 0 2023-12-09T02:35:14.284 INFO:tasks.workunit.client.1.smithi161.stdout:4/500: dwrite f8 [0,4194304] 0 2023-12-09T02:35:14.284 INFO:tasks.workunit.client.1.smithi161.stdout:4/501: fdatasync dd/d1a/d1d/f8e 0 2023-12-09T02:35:14.285 INFO:tasks.workunit.client.1.smithi161.stdout:4/502: write dd/f13 [1270646,63788] 0 2023-12-09T02:35:14.287 INFO:tasks.workunit.client.1.smithi161.stdout:9/412: dread d2/d25/d3a/d65/d42/d58/d16/d2e/f45 [4194304,4194304] 0 2023-12-09T02:35:14.287 INFO:tasks.workunit.client.1.smithi161.stdout:6/459: creat da/d55/d6d/fa6 x:0 0 0 2023-12-09T02:35:14.288 INFO:tasks.workunit.client.1.smithi161.stdout:5/430: creat d0/d2/de/d22/f9b x:0 0 0 2023-12-09T02:35:14.288 INFO:tasks.workunit.client.1.smithi161.stdout:5/431: write d0/d9/f6a [572269,125735] 0 2023-12-09T02:35:14.289 INFO:tasks.workunit.client.1.smithi161.stdout:4/503: dread dd/d1a/d1e/f21 [0,4194304] 0 2023-12-09T02:35:14.291 INFO:tasks.workunit.client.1.smithi161.stdout:2/505: symlink d4/d16/la2 0 2023-12-09T02:35:14.299 INFO:tasks.workunit.client.1.smithi161.stdout:5/432: rmdir d0/d2/de 39 2023-12-09T02:35:14.301 INFO:tasks.workunit.client.1.smithi161.stdout:6/460: getdents da/d28/d3c 0 2023-12-09T02:35:14.305 INFO:tasks.workunit.client.1.smithi161.stdout:4/504: mknod dd/d36/d4a/d88/ca2 0 2023-12-09T02:35:14.306 INFO:tasks.workunit.client.1.smithi161.stdout:5/433: creat d0/d2/d7/d9a/f9c x:0 0 0 2023-12-09T02:35:14.310 INFO:tasks.workunit.client.1.smithi161.stdout:6/461: symlink da/d28/d29/d2b/d31/la7 0 2023-12-09T02:35:14.310 INFO:tasks.workunit.client.1.smithi161.stdout:6/462: write da/f12 [4997111,110665] 0 2023-12-09T02:35:14.314 INFO:tasks.workunit.client.1.smithi161.stdout:5/434: mknod d0/d2/d7/c9d 0 2023-12-09T02:35:14.316 INFO:tasks.workunit.client.1.smithi161.stdout:9/413: dwrite d2/d25/d3a/d65/d42/d58/d16/f30 [0,4194304] 0 2023-12-09T02:35:14.317 INFO:tasks.workunit.client.1.smithi161.stdout:2/506: dwrite d4/d16/d69/d8c/d5a/f81 [0,4194304] 0 2023-12-09T02:35:14.317 INFO:tasks.workunit.client.1.smithi161.stdout:4/505: creat dd/d1a/d23/d6a/fa3 x:0 0 0 2023-12-09T02:35:14.318 INFO:tasks.workunit.client.1.smithi161.stdout:4/506: read dd/d36/d3f/d54/f68 [2073508,47263] 0 2023-12-09T02:35:14.321 INFO:tasks.workunit.client.1.smithi161.stdout:5/435: rename d0/d2/f91 to d0/f9e 0 2023-12-09T02:35:14.334 INFO:tasks.workunit.client.1.smithi161.stdout:2/507: dwrite d4/d7/db/f67 [0,4194304] 0 2023-12-09T02:35:14.334 INFO:tasks.workunit.client.1.smithi161.stdout:2/508: fsync d4/d7/db/f24 0 2023-12-09T02:35:14.335 INFO:tasks.workunit.client.1.smithi161.stdout:2/509: readlink d4/l34 0 2023-12-09T02:35:14.335 INFO:tasks.workunit.client.1.smithi161.stdout:2/510: dread - d4/d1a/f40 zero size 2023-12-09T02:35:14.338 INFO:tasks.workunit.client.1.smithi161.stdout:9/414: rmdir d2 39 2023-12-09T02:35:14.340 INFO:tasks.workunit.client.1.smithi161.stdout:6/463: truncate da/f12 3253657 0 2023-12-09T02:35:14.340 INFO:tasks.workunit.client.1.smithi161.stdout:4/507: creat dd/d36/d3f/fa4 x:0 0 0 2023-12-09T02:35:14.341 INFO:tasks.workunit.client.1.smithi161.stdout:5/436: creat d0/d2/d7/df/f9f x:0 0 0 2023-12-09T02:35:14.344 INFO:tasks.workunit.client.1.smithi161.stdout:2/511: rename d4/d7/db/f55 to d4/d16/d69/fa3 0 2023-12-09T02:35:14.345 INFO:tasks.workunit.client.1.smithi161.stdout:9/415: rmdir d2/d25/d3a/d65/d5c 39 2023-12-09T02:35:14.345 INFO:tasks.workunit.client.1.smithi161.stdout:9/416: stat d2/d25/d3a/d65/d42/d58/d22 0 2023-12-09T02:35:14.347 INFO:tasks.workunit.client.1.smithi161.stdout:4/508: unlink dd/c57 0 2023-12-09T02:35:14.349 INFO:tasks.workunit.client.1.smithi161.stdout:6/464: rename da/df/f3f to da/d28/d4d/fa8 0 2023-12-09T02:35:14.349 INFO:tasks.workunit.client.1.smithi161.stdout:6/465: read - da/d28/f67 zero size 2023-12-09T02:35:14.349 INFO:tasks.workunit.client.1.smithi161.stdout:2/512: dread d4/d1a/d4a/d6d/f7a [0,4194304] 0 2023-12-09T02:35:14.350 INFO:tasks.workunit.client.1.smithi161.stdout:9/417: mkdir d2/d25/d3a/d65/d42/d58/d16/d2e/d3f/d61/d8f 0 2023-12-09T02:35:14.351 INFO:tasks.workunit.client.1.smithi161.stdout:4/509: mknod dd/d36/ca5 0 2023-12-09T02:35:14.352 INFO:tasks.workunit.client.1.smithi161.stdout:4/510: read dd/d1a/d1d/d25/d32/d34/f46 [247910,57581] 0 2023-12-09T02:35:14.353 INFO:tasks.workunit.client.1.smithi161.stdout:6/466: truncate da/df/d2d/d49/f4c 375418 0 2023-12-09T02:35:14.354 INFO:tasks.workunit.client.1.smithi161.stdout:2/513: creat d4/d16/d69/d8c/d87/fa4 x:0 0 0 2023-12-09T02:35:14.355 INFO:tasks.workunit.client.1.smithi161.stdout:9/418: mkdir d2/d25/d3a/d65/d5c/d55/d66/d83/d90 0 2023-12-09T02:35:14.359 INFO:tasks.workunit.client.1.smithi161.stdout:4/511: creat dd/d1a/d1d/d25/d4e/fa6 x:0 0 0 2023-12-09T02:35:14.360 INFO:tasks.workunit.client.1.smithi161.stdout:6/467: symlink da/d28/d29/la9 0 2023-12-09T02:35:14.367 INFO:tasks.workunit.client.1.smithi161.stdout:4/512: creat dd/d1a/d23/d6a/fa7 x:0 0 0 2023-12-09T02:35:14.369 INFO:tasks.workunit.client.1.smithi161.stdout:9/419: rename d2/d25/d3a/d65/d42/d58/d16 to d2/d25/d3a/d65/d42/d58/d91 0 2023-12-09T02:35:14.371 INFO:tasks.workunit.client.1.smithi161.stdout:6/468: rename da/d28/d29/l8b to da/d28/d3c/laa 0 2023-12-09T02:35:14.372 INFO:tasks.workunit.client.1.smithi161.stdout:9/420: truncate d2/d25/d3a/d65/d42/d58/d91/f36 1010200 0 2023-12-09T02:35:14.374 INFO:tasks.workunit.client.1.smithi161.stdout:6/469: symlink da/df/d2d/d3b/lab 0 2023-12-09T02:35:14.376 INFO:tasks.workunit.client.1.smithi161.stdout:6/470: mkdir da/d55/d6d/dac 0 2023-12-09T02:35:14.377 INFO:tasks.workunit.client.1.smithi161.stdout:6/471: symlink da/d55/d6d/dac/lad 0 2023-12-09T02:35:14.392 INFO:tasks.workunit.client.1.smithi161.stdout:4/513: dwrite dd/d1a/d1d/d25/f3b [4194304,4194304] 0 2023-12-09T02:35:14.392 INFO:tasks.workunit.client.1.smithi161.stdout:9/421: dwrite d2/d25/d3a/d4d/f67 [4194304,4194304] 0 2023-12-09T02:35:14.393 INFO:tasks.workunit.client.1.smithi161.stdout:4/514: symlink dd/la8 0 2023-12-09T02:35:14.395 INFO:tasks.workunit.client.1.smithi161.stdout:9/422: creat d2/d25/d3a/d65/d5c/d55/f92 x:0 0 0 2023-12-09T02:35:14.398 INFO:tasks.workunit.client.1.smithi161.stdout:9/423: mknod d2/d25/d3a/d65/d5c/d55/d66/d83/d90/c93 0 2023-12-09T02:35:14.410 INFO:tasks.workunit.client.1.smithi161.stdout:4/515: dwrite dd/d36/d3f/fa4 [0,4194304] 0 2023-12-09T02:35:14.412 INFO:tasks.workunit.client.1.smithi161.stdout:4/516: creat dd/d36/d3f/fa9 x:0 0 0 2023-12-09T02:35:14.413 INFO:tasks.workunit.client.1.smithi161.stdout:4/517: stat dd/d36/d3f/fa4 0 2023-12-09T02:35:14.414 INFO:tasks.workunit.client.1.smithi161.stdout:4/518: rmdir dd/d36/d4a/d5f 39 2023-12-09T02:35:14.414 INFO:tasks.workunit.client.1.smithi161.stdout:4/519: chown dd/d1a/d1d/f8e 30275 1 2023-12-09T02:35:14.414 INFO:tasks.workunit.client.1.smithi161.stdout:9/424: dwrite d2/d25/d3a/d65/d42/d58/f10 [0,4194304] 0 2023-12-09T02:35:14.415 INFO:tasks.workunit.client.1.smithi161.stdout:4/520: symlink dd/d1a/d1d/laa 0 2023-12-09T02:35:14.417 INFO:tasks.workunit.client.1.smithi161.stdout:9/425: symlink d2/d25/d3a/d65/d42/d58/d91/d39/l94 0 2023-12-09T02:35:14.419 INFO:tasks.workunit.client.1.smithi161.stdout:9/426: mkdir d2/d25/d3a/d65/d5c/d55/d66/d83/d90/d95 0 2023-12-09T02:35:14.421 INFO:tasks.workunit.client.1.smithi161.stdout:9/427: getdents d2/d25/d3a/d65/d5c/d55 0 2023-12-09T02:35:14.422 INFO:tasks.workunit.client.1.smithi161.stdout:9/428: creat d2/d25/d3a/d65/d5c/d55/d66/d83/f96 x:0 0 0 2023-12-09T02:35:14.424 INFO:tasks.workunit.client.1.smithi161.stdout:9/429: creat d2/d25/d3a/d65/d42/d58/d91/d2e/d3f/d71/f97 x:0 0 0 2023-12-09T02:35:14.424 INFO:tasks.workunit.client.1.smithi161.stdout:9/430: dread - d2/d25/d3a/f8e zero size 2023-12-09T02:35:14.424 INFO:tasks.workunit.client.1.smithi161.stdout:9/431: rename d2 to d2/d25/d3a/d65/d42/d58/d91/d51/d98 22 2023-12-09T02:35:14.426 INFO:tasks.workunit.client.1.smithi161.stdout:9/432: rename d2/f35 to d2/d25/d3a/d65/d42/d58/d91/f99 0 2023-12-09T02:35:14.426 INFO:tasks.workunit.client.1.smithi161.stdout:9/433: readlink d2/d25/d3a/d65/d42/d58/d91/l23 0 2023-12-09T02:35:14.427 INFO:tasks.workunit.client.1.smithi161.stdout:9/434: rename d2/d25/d3a/d65/d42/d58/d91/d39/l52 to d2/d25/l9a 0 2023-12-09T02:35:14.430 INFO:tasks.workunit.client.1.smithi161.stdout:9/435: dread d2/d25/d3a/d65/d5c/f56 [0,4194304] 0 2023-12-09T02:35:14.431 INFO:tasks.workunit.client.1.smithi161.stdout:9/436: write d2/d25/d3a/d65/d42/d58/f10 [3540476,39453] 0 2023-12-09T02:35:14.434 INFO:tasks.workunit.client.1.smithi161.stdout:9/437: getdents d2/d25/d3a/d4d 0 2023-12-09T02:35:14.434 INFO:tasks.workunit.client.1.smithi161.stdout:4/521: dwrite dd/d36/d3f/fa9 [0,4194304] 0 2023-12-09T02:35:14.437 INFO:tasks.workunit.client.1.smithi161.stdout:9/438: creat d2/d25/d3a/d65/d88/f9b x:0 0 0 2023-12-09T02:35:14.446 INFO:tasks.workunit.client.1.smithi161.stdout:4/522: mknod dd/cab 0 2023-12-09T02:35:14.446 INFO:tasks.workunit.client.1.smithi161.stdout:4/523: readlink dd/l10 0 2023-12-09T02:35:14.446 INFO:tasks.workunit.client.1.smithi161.stdout:4/524: chown dd/d1a/d1d/d25/c27 0 1 2023-12-09T02:35:14.449 INFO:tasks.workunit.client.1.smithi161.stdout:9/439: unlink d2/d25/d3a/d65/d42/d58/d91/f30 0 2023-12-09T02:35:14.450 INFO:tasks.workunit.client.1.smithi161.stdout:4/525: link dd/d1a/d1d/d25/d32/f7e dd/d1a/d23/d6a/fac 0 2023-12-09T02:35:14.452 INFO:tasks.workunit.client.1.smithi161.stdout:9/440: symlink d2/d25/d3a/d65/d42/d58/d91/d2e/d80/l9c 0 2023-12-09T02:35:14.454 INFO:tasks.workunit.client.1.smithi161.stdout:4/526: creat dd/d1a/d29/fad x:0 0 0 2023-12-09T02:35:14.454 INFO:tasks.workunit.client.1.smithi161.stdout:4/527: fsync dd/d36/d3f/f43 0 2023-12-09T02:35:14.455 INFO:tasks.workunit.client.1.smithi161.stdout:4/528: write dd/d1a/f1c [12130,30773] 0 2023-12-09T02:35:14.456 INFO:tasks.workunit.client.1.smithi161.stdout:4/529: mknod dd/d1a/cae 0 2023-12-09T02:35:14.456 INFO:tasks.workunit.client.1.smithi161.stdout:4/530: dread dd/d1a/d29/f5d [0,4194304] 0 2023-12-09T02:35:14.462 INFO:tasks.workunit.client.1.smithi161.stdout:1/598: sync 2023-12-09T02:35:14.462 INFO:tasks.workunit.client.1.smithi161.stdout:3/385: sync 2023-12-09T02:35:14.462 INFO:tasks.workunit.client.1.smithi161.stdout:0/485: sync 2023-12-09T02:35:14.462 INFO:tasks.workunit.client.1.smithi161.stdout:0/486: read - d9/db/d2a/d35/f89 zero size 2023-12-09T02:35:14.463 INFO:tasks.workunit.client.1.smithi161.stdout:1/599: read d6/d49/f60 [162390,51716] 0 2023-12-09T02:35:14.475 INFO:tasks.workunit.client.1.smithi161.stdout:4/531: dwrite f7 [4194304,4194304] 0 2023-12-09T02:35:14.480 INFO:tasks.workunit.client.1.smithi161.stdout:4/532: link dd/d1a/d1e/l24 dd/d36/d4a/d5f/laf 0 2023-12-09T02:35:14.482 INFO:tasks.workunit.client.1.smithi161.stdout:9/441: dwrite d2/d25/d3a/d4d/d7d/f87 [0,4194304] 0 2023-12-09T02:35:14.490 INFO:tasks.workunit.client.1.smithi161.stdout:9/442: creat d2/d25/d3a/d65/d88/f9d x:0 0 0 2023-12-09T02:35:14.490 INFO:tasks.workunit.client.1.smithi161.stdout:9/443: chown d2/d25/d3a/d65/c5b 118 1 2023-12-09T02:35:14.490 INFO:tasks.workunit.client.1.smithi161.stdout:9/444: stat d2/f3e 0 2023-12-09T02:35:14.492 INFO:tasks.workunit.client.1.smithi161.stdout:9/445: unlink d2/f15 0 2023-12-09T02:35:14.494 INFO:tasks.workunit.client.1.smithi161.stdout:9/446: creat d2/d25/d3a/d65/d63/f9e x:0 0 0 2023-12-09T02:35:14.494 INFO:tasks.workunit.client.1.smithi161.stdout:9/447: stat d2/d25/d3a/d65/d42/d58/d91/d2e/l6f 0 2023-12-09T02:35:14.496 INFO:tasks.workunit.client.1.smithi161.stdout:4/533: dread dd/d36/d3f/d54/f68 [0,4194304] 0 2023-12-09T02:35:14.497 INFO:tasks.workunit.client.1.smithi161.stdout:3/386: dwrite d2/d4/d11/d1f/d2a/d46/d2d/d47/f5c [8388608,4194304] 0 2023-12-09T02:35:14.498 INFO:tasks.workunit.client.1.smithi161.stdout:1/600: dwrite d6/d8/d63/d1c/f41 [0,4194304] 0 2023-12-09T02:35:14.498 INFO:tasks.workunit.client.1.smithi161.stdout:0/487: dwrite d9/d55/d7c/f33 [4194304,4194304] 0 2023-12-09T02:35:14.498 INFO:tasks.workunit.client.1.smithi161.stdout:0/488: write d9/d55/d7c/f6b [1232039,117506] 0 2023-12-09T02:35:14.499 INFO:tasks.workunit.client.1.smithi161.stdout:3/387: getdents d2/d37 0 2023-12-09T02:35:14.502 INFO:tasks.workunit.client.1.smithi161.stdout:1/601: creat d6/d9/d8b/fc7 x:0 0 0 2023-12-09T02:35:14.506 INFO:tasks.workunit.client.1.smithi161.stdout:4/534: dread dd/d1a/d1d/f49 [0,4194304] 0 2023-12-09T02:35:14.506 INFO:tasks.workunit.client.1.smithi161.stdout:4/535: stat dd/d36/d4a/d5f/l6d 0 2023-12-09T02:35:14.506 INFO:tasks.workunit.client.1.smithi161.stdout:9/448: dread d2/d25/d3a/d65/d42/d58/f10 [0,4194304] 0 2023-12-09T02:35:14.507 INFO:tasks.workunit.client.1.smithi161.stdout:0/489: mkdir d9/db/d2a/d35/d4a/d94 0 2023-12-09T02:35:14.508 INFO:tasks.workunit.client.1.smithi161.stdout:3/388: mkdir d2/d4/d50/d69 0 2023-12-09T02:35:14.508 INFO:tasks.workunit.client.1.smithi161.stdout:3/389: fsync d2/d4/f36 0 2023-12-09T02:35:14.510 INFO:tasks.workunit.client.1.smithi161.stdout:1/602: creat d6/d8/d63/d4d/fc8 x:0 0 0 2023-12-09T02:35:14.512 INFO:tasks.workunit.client.1.smithi161.stdout:4/536: rmdir dd/d1a/d1d/d25/d32 39 2023-12-09T02:35:14.517 INFO:tasks.workunit.client.1.smithi161.stdout:9/449: creat d2/d25/d3a/d65/d42/d58/d22/f9f x:0 0 0 2023-12-09T02:35:14.517 INFO:tasks.workunit.client.1.smithi161.stdout:9/450: readlink d2/d25/d3a/d65/d42/l76 0 2023-12-09T02:35:14.518 INFO:tasks.workunit.client.1.smithi161.stdout:0/490: creat d9/d55/d5a/f95 x:0 0 0 2023-12-09T02:35:14.521 INFO:tasks.workunit.client.1.smithi161.stdout:1/603: creat d6/d9/d8b/dba/fc9 x:0 0 0 2023-12-09T02:35:14.521 INFO:tasks.workunit.client.1.smithi161.stdout:1/604: truncate d6/d49/f60 909772 0 2023-12-09T02:35:14.522 INFO:tasks.workunit.client.1.smithi161.stdout:9/451: creat d2/d25/d3a/fa0 x:0 0 0 2023-12-09T02:35:14.524 INFO:tasks.workunit.client.1.smithi161.stdout:0/491: getdents d9/d5b 0 2023-12-09T02:35:14.533 INFO:tasks.workunit.client.1.smithi161.stdout:9/452: dread d2/f19 [0,4194304] 0 2023-12-09T02:35:14.533 INFO:tasks.workunit.client.1.smithi161.stdout:3/390: dwrite d2/d4/d11/d5a/f67 [0,4194304] 0 2023-12-09T02:35:14.535 INFO:tasks.workunit.client.1.smithi161.stdout:4/537: dwrite dd/d1a/d1d/d25/f80 [0,4194304] 0 2023-12-09T02:35:14.544 INFO:tasks.workunit.client.1.smithi161.stdout:3/391: mknod d2/d4/c6a 0 2023-12-09T02:35:14.549 INFO:tasks.workunit.client.1.smithi161.stdout:1/605: dwrite d6/d8/d63/d35/d3d/f96 [0,4194304] 0 2023-12-09T02:35:14.550 INFO:tasks.workunit.client.1.smithi161.stdout:1/606: write d6/d8/d63/d35/f6a [1029355,59819] 0 2023-12-09T02:35:14.550 INFO:tasks.workunit.client.1.smithi161.stdout:1/607: write d6/d8/d63/d4d/d31/f3a [8843721,49091] 0 2023-12-09T02:35:14.550 INFO:tasks.workunit.client.1.smithi161.stdout:4/538: creat dd/d1a/fb0 x:0 0 0 2023-12-09T02:35:14.551 INFO:tasks.workunit.client.1.smithi161.stdout:1/608: read d6/d8/d63/d1c/f41 [1799262,84391] 0 2023-12-09T02:35:14.553 INFO:tasks.workunit.client.1.smithi161.stdout:3/392: rename d2/d4/d11/d1f/d2a/d46/d2d/d47/l53 to d2/d4/d11/d1f/d2a/d46/d5e/l6b 0 2023-12-09T02:35:14.556 INFO:tasks.workunit.client.1.smithi161.stdout:3/393: dread d2/d4/d11/d1f/d2a/d46/f57 [0,4194304] 0 2023-12-09T02:35:14.557 INFO:tasks.workunit.client.1.smithi161.stdout:3/394: write d2/fe [4618796,125627] 0 2023-12-09T02:35:14.559 INFO:tasks.workunit.client.1.smithi161.stdout:1/609: truncate d6/d8/d63/d4d/f88 1129765 0 2023-12-09T02:35:14.559 INFO:tasks.workunit.client.1.smithi161.stdout:1/610: fdatasync d6/d9/d5c/f66 0 2023-12-09T02:35:14.559 INFO:tasks.workunit.client.1.smithi161.stdout:9/453: dwrite d2/d25/d3a/d65/f43 [0,4194304] 0 2023-12-09T02:35:14.560 INFO:tasks.workunit.client.1.smithi161.stdout:0/492: dwrite d9/db/d2a/d35/f91 [0,4194304] 0 2023-12-09T02:35:14.561 INFO:tasks.workunit.client.1.smithi161.stdout:4/539: rename dd/d1a/d1d/d25/d3a/f89 to dd/d36/d3f/fb1 0 2023-12-09T02:35:14.569 INFO:tasks.workunit.client.1.smithi161.stdout:9/454: symlink d2/d25/d3a/d65/d5c/d60/d7f/la1 0 2023-12-09T02:35:14.571 INFO:tasks.workunit.client.1.smithi161.stdout:9/455: dread d2/d25/d3a/d65/d42/d58/d91/d2e/f40 [0,4194304] 0 2023-12-09T02:35:14.575 INFO:tasks.workunit.client.1.smithi161.stdout:0/493: symlink d9/dd/d3a/l96 0 2023-12-09T02:35:14.576 INFO:tasks.workunit.client.1.smithi161.stdout:4/540: truncate dd/d36/f74 3892438 0 2023-12-09T02:35:14.576 INFO:tasks.workunit.client.1.smithi161.stdout:4/541: chown dd/d1a/d1d/laa 3111 1 2023-12-09T02:35:14.576 INFO:tasks.workunit.client.1.smithi161.stdout:4/542: fsync dd/d1a/d1d/f85 0 2023-12-09T02:35:14.579 INFO:tasks.workunit.client.1.smithi161.stdout:7/535: sync 2023-12-09T02:35:14.579 INFO:tasks.workunit.client.1.smithi161.stdout:7/536: chown d0/d3/d9e/f32 1993 1 2023-12-09T02:35:14.579 INFO:tasks.workunit.client.1.smithi161.stdout:3/395: link d2/d4/d11/d1f/d2a/d46/d5e/l6b d2/d4/d11/d1f/l6c 0 2023-12-09T02:35:14.580 INFO:tasks.workunit.client.1.smithi161.stdout:9/456: creat d2/d25/d3a/d65/d42/d58/d91/d2e/d80/fa2 x:0 0 0 2023-12-09T02:35:14.582 INFO:tasks.workunit.client.1.smithi161.stdout:4/543: creat dd/d1a/d1d/d25/d4e/fb2 x:0 0 0 2023-12-09T02:35:14.583 INFO:tasks.workunit.client.1.smithi161.stdout:1/611: dwrite d6/d9/faf [0,4194304] 0 2023-12-09T02:35:14.583 INFO:tasks.workunit.client.1.smithi161.stdout:7/537: creat d0/d49/d67/d71/fac x:0 0 0 2023-12-09T02:35:14.585 INFO:tasks.workunit.client.1.smithi161.stdout:4/544: dread dd/d36/d4a/f6f [0,4194304] 0 2023-12-09T02:35:14.587 INFO:tasks.workunit.client.1.smithi161.stdout:3/396: rename d2/fe to d2/d4/d11/d1f/d2a/d46/d40/f6d 0 2023-12-09T02:35:14.588 INFO:tasks.workunit.client.1.smithi161.stdout:9/457: symlink d2/d25/d3a/d65/d5c/d55/d66/la3 0 2023-12-09T02:35:14.588 INFO:tasks.workunit.client.1.smithi161.stdout:9/458: write d2/f3e [1127737,68275] 0 2023-12-09T02:35:14.589 INFO:tasks.workunit.client.1.smithi161.stdout:3/397: read d2/d4/d11/d1f/d2a/d46/d2d/d47/f5c [11093875,5673] 0 2023-12-09T02:35:14.589 INFO:tasks.workunit.client.1.smithi161.stdout:3/398: fsync d2/d4/d11/d1f/d2a/d46/d2d/d4e/f65 0 2023-12-09T02:35:14.589 INFO:tasks.workunit.client.1.smithi161.stdout:3/399: chown d2/d4/d11/d1f/d2a/d46/d2d/d47/f56 1869697 1 2023-12-09T02:35:14.589 INFO:tasks.workunit.client.1.smithi161.stdout:0/494: dread d9/d55/d7c/f33 [4194304,4194304] 0 2023-12-09T02:35:14.604 INFO:tasks.workunit.client.1.smithi161.stdout:7/538: mkdir d0/d3/d21/d54/dad 0 2023-12-09T02:35:14.606 INFO:tasks.workunit.client.1.smithi161.stdout:4/545: unlink dd/d36/d3f/f7f 0 2023-12-09T02:35:14.606 INFO:tasks.workunit.client.1.smithi161.stdout:4/546: chown dd/d1a/d1d/d25/d4e 13 1 2023-12-09T02:35:14.608 INFO:tasks.workunit.client.1.smithi161.stdout:9/459: mkdir d2/d25/d3a/d65/d42/d58/d91/d2e/d3f/d61/da4 0 2023-12-09T02:35:14.608 INFO:tasks.workunit.client.1.smithi161.stdout:9/460: readlink d2/d25/d3a/d65/d42/d58/d91/d51/l54 0 2023-12-09T02:35:14.608 INFO:tasks.workunit.client.1.smithi161.stdout:9/461: write d2/d25/d3a/d65/d42/d58/d91/d51/f6b [1159224,102551] 0 2023-12-09T02:35:14.608 INFO:tasks.workunit.client.1.smithi161.stdout:9/462: stat d2/d25/d3a/d65/d42/d58/d91/d51/l54 0 2023-12-09T02:35:14.608 INFO:tasks.workunit.client.1.smithi161.stdout:9/463: truncate d2/d25/d3a/d65/d88/f9d 319319 0 2023-12-09T02:35:14.610 INFO:tasks.workunit.client.1.smithi161.stdout:3/400: truncate d2/d4/d11/d28/f22 457727 0 2023-12-09T02:35:14.610 INFO:tasks.workunit.client.1.smithi161.stdout:3/401: chown d2/d4/f36 988569 1 2023-12-09T02:35:14.612 INFO:tasks.workunit.client.1.smithi161.stdout:0/495: creat d9/f97 x:0 0 0 2023-12-09T02:35:14.612 INFO:tasks.workunit.client.1.smithi161.stdout:7/539: dread d0/d3/d13/d2d/d6e/f8c [0,4194304] 0 2023-12-09T02:35:14.616 INFO:tasks.workunit.client.1.smithi161.stdout:1/612: unlink d6/d8/d63/c5e 0 2023-12-09T02:35:14.624 INFO:tasks.workunit.client.1.smithi161.stdout:3/402: creat d2/d4/d11/d19/f6e x:0 0 0 2023-12-09T02:35:14.624 INFO:tasks.workunit.client.1.smithi161.stdout:3/403: read d2/d4/f18 [2736213,17545] 0 2023-12-09T02:35:14.624 INFO:tasks.workunit.client.1.smithi161.stdout:3/404: fsync d2/d37/f38 0 2023-12-09T02:35:14.627 INFO:tasks.workunit.client.1.smithi161.stdout:0/496: mkdir d9/d55/d86/d98 0 2023-12-09T02:35:14.629 INFO:tasks.workunit.client.1.smithi161.stdout:3/405: creat d2/d4/d11/d19/f6f x:0 0 0 2023-12-09T02:35:14.635 INFO:tasks.workunit.client.1.smithi161.stdout:3/406: truncate d2/d4/d11/f3c 1042905 0 2023-12-09T02:35:14.635 INFO:tasks.workunit.client.1.smithi161.stdout:0/497: link d9/d55/d7c/c3c d9/db/d2a/c99 0 2023-12-09T02:35:14.638 INFO:tasks.workunit.client.1.smithi161.stdout:7/540: dwrite d0/d3/f66 [0,4194304] 0 2023-12-09T02:35:14.638 INFO:tasks.workunit.client.1.smithi161.stdout:3/407: rmdir d2/d4/d11/d1f 39 2023-12-09T02:35:14.638 INFO:tasks.workunit.client.1.smithi161.stdout:3/408: chown d2/d4/l10 8072609 1 2023-12-09T02:35:14.640 INFO:tasks.workunit.client.1.smithi161.stdout:7/541: creat d0/d3/d9e/d59/d5e/fae x:0 0 0 2023-12-09T02:35:14.644 INFO:tasks.workunit.client.1.smithi161.stdout:3/409: rename d2/d4/d11/d1f/d4c/f61 to d2/d37/f70 0 2023-12-09T02:35:14.644 INFO:tasks.workunit.client.1.smithi161.stdout:3/410: truncate d2/d4/d11/d1f/d2a/f63 249492 0 2023-12-09T02:35:14.645 INFO:tasks.workunit.client.1.smithi161.stdout:0/498: dread d9/d55/d7c/f4e [0,4194304] 0 2023-12-09T02:35:14.652 INFO:tasks.workunit.client.1.smithi161.stdout:7/542: dread d0/d3/d13/d2d/d43/d4a/f10 [0,4194304] 0 2023-12-09T02:35:14.658 INFO:tasks.workunit.client.1.smithi161.stdout:4/547: getdents dd/d36/d3f 0 2023-12-09T02:35:14.663 INFO:tasks.workunit.client.1.smithi161.stdout:4/548: mkdir dd/d36/d4a/d88/d8a/db3 0 2023-12-09T02:35:14.668 INFO:tasks.workunit.client.1.smithi161.stdout:1/613: dwrite d6/d8/d63/d4d/d31/d73/d47/fb4 [0,4194304] 0 2023-12-09T02:35:14.671 INFO:tasks.workunit.client.1.smithi161.stdout:3/411: dwrite d2/d4/d11/d1f/d2a/d46/d2d/d47/f5c [4194304,4194304] 0 2023-12-09T02:35:14.681 INFO:tasks.workunit.client.1.smithi161.stdout:1/614: creat d6/d8/d63/d4d/d31/d73/d47/fca x:0 0 0 2023-12-09T02:35:14.681 INFO:tasks.workunit.client.1.smithi161.stdout:0/499: getdents d9/db/d2a 0 2023-12-09T02:35:14.681 INFO:tasks.workunit.client.1.smithi161.stdout:0/500: write d9/d55/f6a [892641,106031] 0 2023-12-09T02:35:14.681 INFO:tasks.workunit.client.1.smithi161.stdout:3/412: creat d2/d37/f71 x:0 0 0 2023-12-09T02:35:14.681 INFO:tasks.workunit.client.1.smithi161.stdout:3/413: write d2/d4/d11/d1f/d4c/f5b [53441,117279] 0 2023-12-09T02:35:14.687 INFO:tasks.workunit.client.1.smithi161.stdout:3/414: dread d2/d4/f36 [0,4194304] 0 2023-12-09T02:35:14.687 INFO:tasks.workunit.client.1.smithi161.stdout:3/415: getdents d2/d51 0 2023-12-09T02:35:14.687 INFO:tasks.workunit.client.1.smithi161.stdout:3/416: chown d2/d4/l10 6 1 2023-12-09T02:35:14.687 INFO:tasks.workunit.client.1.smithi161.stdout:3/417: chown d2/d4/d11/f3c 89 1 2023-12-09T02:35:14.687 INFO:tasks.workunit.client.1.smithi161.stdout:3/418: chown d2/d4/d11/d1f/d2a/d46/d2d/d47 52107356 1 2023-12-09T02:35:14.689 INFO:tasks.workunit.client.1.smithi161.stdout:4/549: dwrite dd/d1a/d1d/d25/d3a/f6e [0,4194304] 0 2023-12-09T02:35:14.689 INFO:tasks.workunit.client.1.smithi161.stdout:4/550: readlink dd/d5a/l87 0 2023-12-09T02:35:14.690 INFO:tasks.workunit.client.1.smithi161.stdout:8/412: sync 2023-12-09T02:35:14.694 INFO:tasks.workunit.client.1.smithi161.stdout:8/413: truncate d2/f6 2230603 0 2023-12-09T02:35:14.694 INFO:tasks.workunit.client.1.smithi161.stdout:8/414: fsync d2/d5/d22/d31/d38/d48/d4e/f78 0 2023-12-09T02:35:14.694 INFO:tasks.workunit.client.1.smithi161.stdout:8/415: fsync d2/d5/d22/d31/d38/d66/f68 0 2023-12-09T02:35:14.695 INFO:tasks.workunit.client.1.smithi161.stdout:8/416: creat d2/d5/d22/d31/f80 x:0 0 0 2023-12-09T02:35:14.696 INFO:tasks.workunit.client.1.smithi161.stdout:0/501: dread f7 [0,4194304] 0 2023-12-09T02:35:14.697 INFO:tasks.workunit.client.1.smithi161.stdout:8/417: creat d2/d5/d22/f81 x:0 0 0 2023-12-09T02:35:14.697 INFO:tasks.workunit.client.1.smithi161.stdout:8/418: readlink d2/d5/d22/d54/l61 0 2023-12-09T02:35:14.700 INFO:tasks.workunit.client.1.smithi161.stdout:0/502: rename d9/d55/d26/d28/f68 to d9/d55/f9a 0 2023-12-09T02:35:14.703 INFO:tasks.workunit.client.1.smithi161.stdout:1/615: dwrite d6/d9/d8b/dba/fc9 [0,4194304] 0 2023-12-09T02:35:14.703 INFO:tasks.workunit.client.1.smithi161.stdout:8/419: creat d2/d5/d4f/f82 x:0 0 0 2023-12-09T02:35:14.705 INFO:tasks.workunit.client.1.smithi161.stdout:0/503: write d9/db/d2a/d35/d4a/f63 [2513433,102337] 0 2023-12-09T02:35:14.709 INFO:tasks.workunit.client.1.smithi161.stdout:0/504: creat d9/db/d2a/d35/d7b/f9b x:0 0 0 2023-12-09T02:35:14.714 INFO:tasks.workunit.client.1.smithi161.stdout:8/420: mknod d2/d5/d3d/c83 0 2023-12-09T02:35:14.718 INFO:tasks.workunit.client.1.smithi161.stdout:0/505: mkdir d9/d9c 0 2023-12-09T02:35:14.718 INFO:tasks.workunit.client.1.smithi161.stdout:0/506: readlink d9/d55/d26/d28/d58/l90 0 2023-12-09T02:35:14.719 INFO:tasks.workunit.client.1.smithi161.stdout:8/421: mkdir d2/d5/d22/d31/d38/d84 0 2023-12-09T02:35:14.720 INFO:tasks.workunit.client.1.smithi161.stdout:0/507: mkdir d9/db/d2a/d9d 0 2023-12-09T02:35:14.720 INFO:tasks.workunit.client.1.smithi161.stdout:4/551: dwrite dd/d1a/f66 [0,4194304] 0 2023-12-09T02:35:14.721 INFO:tasks.workunit.client.1.smithi161.stdout:8/422: creat d2/d5/d22/d76/f85 x:0 0 0 2023-12-09T02:35:14.723 INFO:tasks.workunit.client.1.smithi161.stdout:0/508: mknod d9/d55/d26/c9e 0 2023-12-09T02:35:14.734 INFO:tasks.workunit.client.1.smithi161.stdout:4/552: mknod dd/d1a/d1d/d25/d32/d58/cb4 0 2023-12-09T02:35:14.735 INFO:tasks.workunit.client.1.smithi161.stdout:4/553: rename dd/d1a/d1d/d25/d3a/f6e to dd/d1a/d1e/fb5 0 2023-12-09T02:35:14.737 INFO:tasks.workunit.client.1.smithi161.stdout:8/423: mkdir d2/d5/d22/d86 0 2023-12-09T02:35:14.738 INFO:tasks.workunit.client.1.smithi161.stdout:8/424: read d2/d5/d22/f49 [493618,27008] 0 2023-12-09T02:35:14.741 INFO:tasks.workunit.client.1.smithi161.stdout:8/425: symlink d2/d5/d22/l87 0 2023-12-09T02:35:14.748 INFO:tasks.workunit.client.1.smithi161.stdout:0/509: dwrite d9/dd/f1e [0,4194304] 0 2023-12-09T02:35:14.752 INFO:tasks.workunit.client.1.smithi161.stdout:4/554: dwrite dd/f18 [4194304,4194304] 0 2023-12-09T02:35:14.752 INFO:tasks.workunit.client.1.smithi161.stdout:4/555: stat dd/d1a/d1d/f49 0 2023-12-09T02:35:14.752 INFO:tasks.workunit.client.1.smithi161.stdout:4/556: write dd/d1a/d1d/d25/d4e/fa6 [372188,62687] 0 2023-12-09T02:35:14.752 INFO:tasks.workunit.client.1.smithi161.stdout:0/510: dread d9/d55/f6a [0,4194304] 0 2023-12-09T02:35:14.753 INFO:tasks.workunit.client.1.smithi161.stdout:0/511: read d9/f1d [2131662,42527] 0 2023-12-09T02:35:14.753 INFO:tasks.workunit.client.1.smithi161.stdout:0/512: write d9/d55/d26/d28/d58/f67 [4451327,38553] 0 2023-12-09T02:35:14.768 INFO:tasks.workunit.client.1.smithi161.stdout:8/426: dwrite d2/d5/d4f/f2c [0,4194304] 0 2023-12-09T02:35:14.769 INFO:tasks.workunit.client.1.smithi161.stdout:8/427: chown d2/c36 15 1 2023-12-09T02:35:14.770 INFO:tasks.workunit.client.1.smithi161.stdout:8/428: mkdir d2/d5/d22/d31/d38/d66/d88 0 2023-12-09T02:35:14.770 INFO:tasks.workunit.client.1.smithi161.stdout:8/429: write d2/d5/d22/d31/d38/f3b [646823,110228] 0 2023-12-09T02:35:14.772 INFO:tasks.workunit.client.1.smithi161.stdout:8/430: unlink d2/d5/d22/f4c 0 2023-12-09T02:35:14.774 INFO:tasks.workunit.client.1.smithi161.stdout:8/431: unlink d2/d5/d22/d31/d38/d48/l5e 0 2023-12-09T02:35:14.774 INFO:tasks.workunit.client.1.smithi161.stdout:8/432: fdatasync d2/d5/d3d/f6f 0 2023-12-09T02:35:14.774 INFO:tasks.workunit.client.1.smithi161.stdout:8/433: write d2/d5/d22/d31/f58 [555743,103932] 0 2023-12-09T02:35:14.775 INFO:tasks.workunit.client.1.smithi161.stdout:8/434: dread - d2/d5/d22/d31/f80 zero size 2023-12-09T02:35:14.775 INFO:tasks.workunit.client.1.smithi161.stdout:8/435: truncate d2/d5/d22/d31/d38/d48/f5a 3999016 0 2023-12-09T02:35:14.776 INFO:tasks.workunit.client.1.smithi161.stdout:8/436: getdents d2 0 2023-12-09T02:35:14.777 INFO:tasks.workunit.client.1.smithi161.stdout:8/437: creat d2/d5/d22/d31/d38/f89 x:0 0 0 2023-12-09T02:35:14.778 INFO:tasks.workunit.client.1.smithi161.stdout:8/438: readlink d2/d5/l11 0 2023-12-09T02:35:14.778 INFO:tasks.workunit.client.1.smithi161.stdout:8/439: chown d2/f63 662332 1 2023-12-09T02:35:14.778 INFO:tasks.workunit.client.1.smithi161.stdout:4/557: dwrite dd/d1a/d1d/d25/d32/d34/f97 [0,4194304] 0 2023-12-09T02:35:14.778 INFO:tasks.workunit.client.1.smithi161.stdout:4/558: chown dd/d36/d4a/d5f/c82 8017023 1 2023-12-09T02:35:14.779 INFO:tasks.workunit.client.1.smithi161.stdout:0/513: dwrite d9/d55/d7c/f33 [4194304,4194304] 0 2023-12-09T02:35:14.782 INFO:tasks.workunit.client.1.smithi161.stdout:8/440: read d2/d5/d22/f49 [98263,16956] 0 2023-12-09T02:35:14.782 INFO:tasks.workunit.client.1.smithi161.stdout:8/441: write d2/d5/d22/d31/d38/d48/f75 [136001,125467] 0 2023-12-09T02:35:14.782 INFO:tasks.workunit.client.1.smithi161.stdout:4/559: dread dd/d1a/d1e/f21 [0,4194304] 0 2023-12-09T02:35:14.783 INFO:tasks.workunit.client.1.smithi161.stdout:4/560: write dd/d36/d3f/fa4 [3780903,124677] 0 2023-12-09T02:35:14.783 INFO:tasks.workunit.client.1.smithi161.stdout:4/561: stat dd/d1a/d1d/d25/d32/f99 0 2023-12-09T02:35:14.788 INFO:tasks.workunit.client.1.smithi161.stdout:0/514: symlink d9/dd/d3a/l9f 0 2023-12-09T02:35:14.788 INFO:tasks.workunit.client.1.smithi161.stdout:0/515: chown d9/dd/l46 185 1 2023-12-09T02:35:14.793 INFO:tasks.workunit.client.1.smithi161.stdout:8/442: getdents d2/d5/d22 0 2023-12-09T02:35:14.795 INFO:tasks.workunit.client.1.smithi161.stdout:4/562: symlink dd/d36/d4a/d5f/d65/lb6 0 2023-12-09T02:35:14.806 INFO:tasks.workunit.client.1.smithi161.stdout:8/443: dwrite d2/f55 [0,4194304] 0 2023-12-09T02:35:14.869 INFO:tasks.workunit.client.1.smithi161.stdout:4/563: link dd/d1a/d23/d6a/fac dd/d1a/d1d/d25/d4e/fb7 0 2023-12-09T02:35:14.878 INFO:tasks.workunit.client.1.smithi161.stdout:8/444: mkdir d2/d8a 0 2023-12-09T02:35:14.881 INFO:tasks.workunit.client.1.smithi161.stdout:4/564: stat dd/d1a/d29/l62 0 2023-12-09T02:35:14.881 INFO:tasks.workunit.client.1.smithi161.stdout:4/565: chown dd/d36/d3f 0 1 2023-12-09T02:35:14.882 INFO:tasks.workunit.client.1.smithi161.stdout:8/445: write d2/d5/fa [146137,64070] 0 2023-12-09T02:35:14.884 INFO:tasks.workunit.client.1.smithi161.stdout:8/446: truncate d2/d5/d4f/f52 3871075 0 2023-12-09T02:35:14.886 INFO:tasks.workunit.client.1.smithi161.stdout:8/447: creat d2/d5/d22/d31/f8b x:0 0 0 2023-12-09T02:35:14.889 INFO:tasks.workunit.client.1.smithi161.stdout:4/566: dread dd/d36/d3f/fa9 [0,4194304] 0 2023-12-09T02:35:14.889 INFO:tasks.workunit.client.1.smithi161.stdout:8/448: mknod d2/d5/d22/d31/c8c 0 2023-12-09T02:35:14.890 INFO:tasks.workunit.client.1.smithi161.stdout:8/449: mknod d2/d5/d22/c8d 0 2023-12-09T02:35:14.892 INFO:tasks.workunit.client.1.smithi161.stdout:8/450: symlink d2/d5/d4f/l8e 0 2023-12-09T02:35:14.893 INFO:tasks.workunit.client.1.smithi161.stdout:8/451: symlink d2/d5/d22/d31/d38/d48/l8f 0 2023-12-09T02:35:14.894 INFO:tasks.workunit.client.1.smithi161.stdout:8/452: truncate d2/f1d 332794 0 2023-12-09T02:35:14.910 INFO:tasks.workunit.client.1.smithi161.stdout:4/567: dwrite dd/d1a/fb0 [0,4194304] 0 2023-12-09T02:35:14.911 INFO:tasks.workunit.client.1.smithi161.stdout:8/453: dwrite d2/d2d/f57 [0,4194304] 0 2023-12-09T02:35:14.916 INFO:tasks.workunit.client.1.smithi161.stdout:6/472: sync 2023-12-09T02:35:14.916 INFO:tasks.workunit.client.1.smithi161.stdout:2/514: sync 2023-12-09T02:35:14.916 INFO:tasks.workunit.client.1.smithi161.stdout:5/437: sync 2023-12-09T02:35:14.916 INFO:tasks.workunit.client.1.smithi161.stdout:5/438: fdatasync d0/d2/d7/df/d60/f95 0 2023-12-09T02:35:14.918 INFO:tasks.workunit.client.1.smithi161.stdout:8/454: creat d2/d5/d22/f90 x:0 0 0 2023-12-09T02:35:14.921 INFO:tasks.workunit.client.1.smithi161.stdout:4/568: dread dd/d1a/d1d/d25/f2f [0,4194304] 0 2023-12-09T02:35:14.921 INFO:tasks.workunit.client.1.smithi161.stdout:4/569: chown dd/fe 6 1 2023-12-09T02:35:14.922 INFO:tasks.workunit.client.1.smithi161.stdout:6/473: symlink da/d19/lae 0 2023-12-09T02:35:14.922 INFO:tasks.workunit.client.1.smithi161.stdout:2/515: truncate d4/d1a/f3f 1858338 0 2023-12-09T02:35:14.927 INFO:tasks.workunit.client.1.smithi161.stdout:4/570: link dd/d36/d4a/d5f/l6d dd/d36/d4a/d88/d8a/lb8 0 2023-12-09T02:35:14.928 INFO:tasks.workunit.client.1.smithi161.stdout:4/571: write dd/d1a/d1d/d25/f2f [3883881,123209] 0 2023-12-09T02:35:14.930 INFO:tasks.workunit.client.1.smithi161.stdout:5/439: rename d0/d2/de/d44/l58 to d0/d9/la0 0 2023-12-09T02:35:14.934 INFO:tasks.workunit.client.1.smithi161.stdout:4/572: dread dd/d1a/d1d/f49 [0,4194304] 0 2023-12-09T02:35:14.934 INFO:tasks.workunit.client.1.smithi161.stdout:4/573: chown dd/d1a/d1d/d25/d32/d34/f46 114682 1 2023-12-09T02:35:14.935 INFO:tasks.workunit.client.1.smithi161.stdout:8/455: rename d2/d5/d3d/f74 to d2/d5/d22/d54/f91 0 2023-12-09T02:35:14.942 INFO:tasks.workunit.client.1.smithi161.stdout:4/574: mknod dd/d36/d4a/d5f/cb9 0 2023-12-09T02:35:14.942 INFO:tasks.workunit.client.1.smithi161.stdout:6/474: rename da/d28/d29/la9 to da/d55/d6d/d85/laf 0 2023-12-09T02:35:14.942 INFO:tasks.workunit.client.1.smithi161.stdout:8/456: rename d2/d5/d22 to d2/d5/d22/d31/d92 22 2023-12-09T02:35:14.942 INFO:tasks.workunit.client.1.smithi161.stdout:6/475: chown da/d55/d6d 113 1 2023-12-09T02:35:14.943 INFO:tasks.workunit.client.1.smithi161.stdout:6/476: readlink da/d28/d29/d2b/d31/d33/d39/l3d 0 2023-12-09T02:35:14.943 INFO:tasks.workunit.client.1.smithi161.stdout:6/477: dread da/d28/d3c/f90 [0,4194304] 0 2023-12-09T02:35:14.943 INFO:tasks.workunit.client.1.smithi161.stdout:4/575: creat dd/d36/d4a/d5f/fba x:0 0 0 2023-12-09T02:35:14.943 INFO:tasks.workunit.client.1.smithi161.stdout:4/576: readlink dd/d1a/d1d/l2e 0 2023-12-09T02:35:14.943 INFO:tasks.workunit.client.1.smithi161.stdout:4/577: write dd/d36/d3f/f43 [891702,18103] 0 2023-12-09T02:35:14.943 INFO:tasks.workunit.client.1.smithi161.stdout:6/478: rename da/d28/d3c/d46/l5a to da/d28/d4d/lb0 0 2023-12-09T02:35:14.943 INFO:tasks.workunit.client.1.smithi161.stdout:6/479: truncate da/d28/d4d/d5e/f98 4288392 0 2023-12-09T02:35:14.943 INFO:tasks.workunit.client.1.smithi161.stdout:6/480: read - da/d28/d3c/d46/f87 zero size 2023-12-09T02:35:14.943 INFO:tasks.workunit.client.1.smithi161.stdout:6/481: dread - da/d28/d29/d2b/f7e zero size 2023-12-09T02:35:14.944 INFO:tasks.workunit.client.1.smithi161.stdout:4/578: dread dd/d1a/d1d/d25/d32/d34/f60 [0,4194304] 0 2023-12-09T02:35:14.946 INFO:tasks.workunit.client.1.smithi161.stdout:4/579: mkdir dd/d1a/d1d/d25/d4e/dbb 0 2023-12-09T02:35:14.946 INFO:tasks.workunit.client.1.smithi161.stdout:4/580: fdatasync dd/d1a/d1d/d25/d32/d34/f60 0 2023-12-09T02:35:14.947 INFO:tasks.workunit.client.1.smithi161.stdout:5/440: dwrite d0/d9/f6a [0,4194304] 0 2023-12-09T02:35:14.947 INFO:tasks.workunit.client.1.smithi161.stdout:5/441: chown d0/d2/f90 86 1 2023-12-09T02:35:14.949 INFO:tasks.workunit.client.1.smithi161.stdout:8/457: dread d2/d5/d22/d31/d38/f79 [0,4194304] 0 2023-12-09T02:35:14.953 INFO:tasks.workunit.client.1.smithi161.stdout:5/442: write d0/d2/f4d [47327,87066] 0 2023-12-09T02:35:14.954 INFO:tasks.workunit.client.1.smithi161.stdout:5/443: chown d0/d2/de/d22/d8e/d8f 900905 1 2023-12-09T02:35:14.954 INFO:tasks.workunit.client.1.smithi161.stdout:4/581: symlink dd/d1a/d23/lbc 0 2023-12-09T02:35:14.957 INFO:tasks.workunit.client.1.smithi161.stdout:5/444: rmdir d0 39 2023-12-09T02:35:14.957 INFO:tasks.workunit.client.1.smithi161.stdout:8/458: dread d2/d5/d4f/f52 [0,4194304] 0 2023-12-09T02:35:14.958 INFO:tasks.workunit.client.1.smithi161.stdout:4/582: creat dd/d36/fbd x:0 0 0 2023-12-09T02:35:14.958 INFO:tasks.workunit.client.1.smithi161.stdout:4/583: readlink dd/d1a/d23/d6a/l83 0 2023-12-09T02:35:14.963 INFO:tasks.workunit.client.1.smithi161.stdout:5/445: creat d0/d2/de/d22/d8e/d8f/fa1 x:0 0 0 2023-12-09T02:35:14.964 INFO:tasks.workunit.client.1.smithi161.stdout:5/446: chown d0/d2/d7/c20 1048776 1 2023-12-09T02:35:14.964 INFO:tasks.workunit.client.1.smithi161.stdout:5/447: dread - d0/f69 zero size 2023-12-09T02:35:14.965 INFO:tasks.workunit.client.1.smithi161.stdout:9/464: sync 2023-12-09T02:35:14.966 INFO:tasks.workunit.client.1.smithi161.stdout:8/459: truncate d2/d5/d22/d31/d38/d48/d4e/f78 456466 0 2023-12-09T02:35:14.966 INFO:tasks.workunit.client.1.smithi161.stdout:8/460: write d2/d5/d3d/f6f [716594,7484] 0 2023-12-09T02:35:14.967 INFO:tasks.workunit.client.1.smithi161.stdout:9/465: unlink d2/d25/d3a/d65/l74 0 2023-12-09T02:35:14.967 INFO:tasks.workunit.client.1.smithi161.stdout:9/466: truncate d2/d25/d3a/d65/d4f/f8d 2152246 0 2023-12-09T02:35:14.968 INFO:tasks.workunit.client.1.smithi161.stdout:8/461: mknod d2/d5/c93 0 2023-12-09T02:35:14.968 INFO:tasks.workunit.client.1.smithi161.stdout:8/462: fsync d2/d5/d22/d76/f85 0 2023-12-09T02:35:14.969 INFO:tasks.workunit.client.1.smithi161.stdout:9/467: unlink d2/d25/d3a/d65/d42/d58/d22/f2d 0 2023-12-09T02:35:14.969 INFO:tasks.workunit.client.1.smithi161.stdout:9/468: fsync d2/d25/d3a/d65/d42/d58/d91/d2e/f45 0 2023-12-09T02:35:14.970 INFO:tasks.workunit.client.1.smithi161.stdout:8/463: symlink d2/d5/d22/d31/d38/d84/l94 0 2023-12-09T02:35:14.971 INFO:tasks.workunit.client.1.smithi161.stdout:5/448: dread d0/f18 [0,4194304] 0 2023-12-09T02:35:14.971 INFO:tasks.workunit.client.1.smithi161.stdout:9/469: mkdir d2/d25/d3a/d65/d5c/d55/da5 0 2023-12-09T02:35:14.974 INFO:tasks.workunit.client.1.smithi161.stdout:8/464: write d2/d5/d22/d31/d38/d48/f5a [2363860,92300] 0 2023-12-09T02:35:14.976 INFO:tasks.workunit.client.1.smithi161.stdout:9/470: link d2/d25/d3a/d65/d42/d58/d91/d2e/d3f/d71/c81 d2/d25/d3a/d65/d42/d58/d91/d2e/d3f/d61/ca6 0 2023-12-09T02:35:14.977 INFO:tasks.workunit.client.1.smithi161.stdout:8/465: creat d2/d2d/f95 x:0 0 0 2023-12-09T02:35:14.978 INFO:tasks.workunit.client.1.smithi161.stdout:5/449: rmdir d0/d2/de/d22/d8e/d8f 39 2023-12-09T02:35:14.978 INFO:tasks.workunit.client.1.smithi161.stdout:5/450: dread - d0/f69 zero size 2023-12-09T02:35:14.980 INFO:tasks.workunit.client.1.smithi161.stdout:4/584: dwrite dd/d1a/d1d/f49 [4194304,4194304] 0 2023-12-09T02:35:14.980 INFO:tasks.workunit.client.1.smithi161.stdout:4/585: chown dd/d36/d4a/f84 63 1 2023-12-09T02:35:14.980 INFO:tasks.workunit.client.1.smithi161.stdout:4/586: fsync dd/d36/d4a/d88/fa0 0 2023-12-09T02:35:14.981 INFO:tasks.workunit.client.1.smithi161.stdout:5/451: unlink d0/d2/de/d22/f9b 0 2023-12-09T02:35:14.983 INFO:tasks.workunit.client.1.smithi161.stdout:9/471: dread d2/d25/d3a/f7b [0,4194304] 0 2023-12-09T02:35:14.985 INFO:tasks.workunit.client.1.smithi161.stdout:4/587: mknod dd/d36/d4a/d88/cbe 0 2023-12-09T02:35:14.985 INFO:tasks.workunit.client.1.smithi161.stdout:4/588: chown dd/d1a/f1c 92360 1 2023-12-09T02:35:14.985 INFO:tasks.workunit.client.1.smithi161.stdout:4/589: chown dd/d1a/d1d/f49 40525 1 2023-12-09T02:35:14.987 INFO:tasks.workunit.client.1.smithi161.stdout:9/472: dread d2/d25/d3a/d65/d42/d58/d91/f99 [0,4194304] 0 2023-12-09T02:35:14.987 INFO:tasks.workunit.client.1.smithi161.stdout:8/466: dread d2/f55 [0,4194304] 0 2023-12-09T02:35:14.988 INFO:tasks.workunit.client.1.smithi161.stdout:5/452: symlink d0/d2/d7/d11/d50/d8a/la2 0 2023-12-09T02:35:14.989 INFO:tasks.workunit.client.1.smithi161.stdout:4/590: write dd/d36/d3f/fa9 [2065832,12901] 0 2023-12-09T02:35:14.993 INFO:tasks.workunit.client.1.smithi161.stdout:9/473: link d2/d25/d3a/f8e d2/d25/d3a/d65/d42/d58/d91/d2e/d3f/fa7 0 2023-12-09T02:35:14.996 INFO:tasks.workunit.client.1.smithi161.stdout:8/467: stat d2/l21 0 2023-12-09T02:35:14.999 INFO:tasks.workunit.client.1.smithi161.stdout:5/453: creat d0/d2/de/d22/fa3 x:0 0 0 2023-12-09T02:35:15.003 INFO:tasks.workunit.client.1.smithi161.stdout:4/591: unlink dd/d1a/c2a 0 2023-12-09T02:35:15.004 INFO:tasks.workunit.client.1.smithi161.stdout:9/474: unlink d2/d25/d3a/d65/d42/d58/d91/d51/l5f 0 2023-12-09T02:35:15.007 INFO:tasks.workunit.client.1.smithi161.stdout:8/468: creat d2/d5/d22/d54/f96 x:0 0 0 2023-12-09T02:35:15.009 INFO:tasks.workunit.client.1.smithi161.stdout:4/592: creat dd/d1a/d23/d6a/fbf x:0 0 0 2023-12-09T02:35:15.009 INFO:tasks.workunit.client.1.smithi161.stdout:4/593: chown dd/d1a/d23/d6a/fac 5 1 2023-12-09T02:35:15.009 INFO:tasks.workunit.client.1.smithi161.stdout:4/594: fsync dd/d36/d4a/d5f/fba 0 2023-12-09T02:35:15.012 INFO:tasks.workunit.client.1.smithi161.stdout:8/469: mkdir d2/d5/d22/d86/d97 0 2023-12-09T02:35:15.012 INFO:tasks.workunit.client.1.smithi161.stdout:8/470: write d2/d5/d22/d31/d38/f89 [944110,68108] 0 2023-12-09T02:35:15.013 INFO:tasks.workunit.client.1.smithi161.stdout:8/471: read d2/d5/f16 [2902268,23829] 0 2023-12-09T02:35:15.013 INFO:tasks.workunit.client.1.smithi161.stdout:4/595: creat dd/d1a/d29/fc0 x:0 0 0 2023-12-09T02:35:15.013 INFO:tasks.workunit.client.1.smithi161.stdout:4/596: write dd/d1a/d29/fc0 [801488,32286] 0 2023-12-09T02:35:15.015 INFO:tasks.workunit.client.1.smithi161.stdout:8/472: creat d2/d5/d22/f98 x:0 0 0 2023-12-09T02:35:15.019 INFO:tasks.workunit.client.1.smithi161.stdout:8/473: link d2/d5/d22/d31/d38/d48/d4e/l6a d2/d5/d22/d76/l99 0 2023-12-09T02:35:15.021 INFO:tasks.workunit.client.1.smithi161.stdout:5/454: dwrite d0/d2/de/d21/f73 [0,4194304] 0 2023-12-09T02:35:15.021 INFO:tasks.workunit.client.1.smithi161.stdout:5/455: chown d0/d2/de/d22/f32 4763 1 2023-12-09T02:35:15.021 INFO:tasks.workunit.client.1.smithi161.stdout:5/456: chown d0/d2/de/d22/d55/l79 978326 1 2023-12-09T02:35:15.037 INFO:tasks.workunit.client.1.smithi161.stdout:4/597: dwrite dd/d1a/d29/f5d [0,4194304] 0 2023-12-09T02:35:15.041 INFO:tasks.workunit.client.1.smithi161.stdout:4/598: dread dd/d1a/d1d/d25/d4e/fa6 [0,4194304] 0 2023-12-09T02:35:15.049 INFO:tasks.workunit.client.1.smithi161.stdout:8/474: dwrite d2/d2d/f57 [0,4194304] 0 2023-12-09T02:35:15.049 INFO:tasks.workunit.client.1.smithi161.stdout:5/457: dwrite d0/d2/d7/d11/f4c [0,4194304] 0 2023-12-09T02:35:15.049 INFO:tasks.workunit.client.1.smithi161.stdout:8/475: dread - d2/d5/d22/d76/f85 zero size 2023-12-09T02:35:15.055 INFO:tasks.workunit.client.1.smithi161.stdout:4/599: dwrite dd/d36/d3f/d54/f68 [4194304,4194304] 0 2023-12-09T02:35:15.057 INFO:tasks.workunit.client.1.smithi161.stdout:5/458: symlink d0/d2/d7/df/d60/d83/la4 0 2023-12-09T02:35:15.061 INFO:tasks.workunit.client.1.smithi161.stdout:4/600: creat dd/d36/d3f/fc1 x:0 0 0 2023-12-09T02:35:15.061 INFO:tasks.workunit.client.1.smithi161.stdout:4/601: chown dd/d5a 126601590 1 2023-12-09T02:35:15.065 INFO:tasks.workunit.client.1.smithi161.stdout:4/602: creat dd/d1a/d1d/d25/d32/fc2 x:0 0 0 2023-12-09T02:35:15.066 INFO:tasks.workunit.client.1.smithi161.stdout:8/476: dwrite d2/d5/f30 [0,4194304] 0 2023-12-09T02:35:15.066 INFO:tasks.workunit.client.1.smithi161.stdout:5/459: symlink d0/d2/de/d44/la5 0 2023-12-09T02:35:15.072 INFO:tasks.workunit.client.1.smithi161.stdout:4/603: rmdir dd/d36/d4a/d88/d8a 39 2023-12-09T02:35:15.082 INFO:tasks.workunit.client.1.smithi161.stdout:8/477: mknod d2/d5/d22/d31/c9a 0 2023-12-09T02:35:15.082 INFO:tasks.workunit.client.1.smithi161.stdout:8/478: stat d2/d5/c3f 0 2023-12-09T02:35:15.085 INFO:tasks.workunit.client.1.smithi161.stdout:8/479: symlink d2/d5/d22/d86/l9b 0 2023-12-09T02:35:15.087 INFO:tasks.workunit.client.1.smithi161.stdout:8/480: rmdir d2/d5/d22/d31/d38/d84 39 2023-12-09T02:35:15.090 INFO:tasks.workunit.client.1.smithi161.stdout:5/460: dwrite d0/d2/de/d22/f32 [0,4194304] 0 2023-12-09T02:35:15.090 INFO:tasks.workunit.client.1.smithi161.stdout:8/481: write d2/f3 [2951400,19837] 0 2023-12-09T02:35:15.091 INFO:tasks.workunit.client.1.smithi161.stdout:4/604: dwrite dd/d1a/d29/fad [0,4194304] 0 2023-12-09T02:35:15.091 INFO:tasks.workunit.client.1.smithi161.stdout:8/482: write d2/d5/f20 [1092675,57520] 0 2023-12-09T02:35:15.096 INFO:tasks.workunit.client.1.smithi161.stdout:4/605: symlink dd/d36/d4a/lc3 0 2023-12-09T02:35:15.096 INFO:tasks.workunit.client.1.smithi161.stdout:4/606: write dd/d1a/d23/d6a/f98 [879650,50928] 0 2023-12-09T02:35:15.096 INFO:tasks.workunit.client.1.smithi161.stdout:4/607: chown dd/d36/d4a/d5f/f7c 555595 1 2023-12-09T02:35:15.097 INFO:tasks.workunit.client.1.smithi161.stdout:5/461: mkdir d0/d2/de/d44/da6 0 2023-12-09T02:35:15.100 INFO:tasks.workunit.client.1.smithi161.stdout:8/483: link d2/d5/d22/l3a d2/d2d/l9c 0 2023-12-09T02:35:15.102 INFO:tasks.workunit.client.1.smithi161.stdout:4/608: creat dd/d36/d4a/d88/d8a/fc4 x:0 0 0 2023-12-09T02:35:15.103 INFO:tasks.workunit.client.1.smithi161.stdout:5/462: mknod d0/d2/de/d22/d55/ca7 0 2023-12-09T02:35:15.107 INFO:tasks.workunit.client.1.smithi161.stdout:5/463: rmdir d0/d2/d7/df/d60/d83 39 2023-12-09T02:35:15.109 INFO:tasks.workunit.client.1.smithi161.stdout:5/464: mkdir d0/d2/d7/df/d60/da8 0 2023-12-09T02:35:15.115 INFO:tasks.workunit.client.1.smithi161.stdout:8/484: dwrite d2/d5/d4f/f35 [0,4194304] 0 2023-12-09T02:35:15.122 INFO:tasks.workunit.client.1.smithi161.stdout:8/485: unlink d2/d5/l11 0 2023-12-09T02:35:15.125 INFO:tasks.workunit.client.1.smithi161.stdout:8/486: rename d2/f63 to d2/d5/d22/d86/f9d 0 2023-12-09T02:35:15.127 INFO:tasks.workunit.client.1.smithi161.stdout:4/609: dwrite dd/d36/d3f/f9e [0,4194304] 0 2023-12-09T02:35:15.133 INFO:tasks.workunit.client.1.smithi161.stdout:4/610: truncate dd/d36/d4a/f84 3787793 0 2023-12-09T02:35:15.133 INFO:tasks.workunit.client.1.smithi161.stdout:4/611: truncate dd/d36/fbd 226207 0 2023-12-09T02:35:15.134 INFO:tasks.workunit.client.1.smithi161.stdout:4/612: write dd/f13 [993309,83094] 0 2023-12-09T02:35:15.135 INFO:tasks.workunit.client.1.smithi161.stdout:4/613: write dd/d1a/d1d/f49 [3218289,98321] 0 2023-12-09T02:35:15.145 INFO:tasks.workunit.client.1.smithi161.stdout:5/465: dwrite d0/d2/d7/d51/f71 [0,4194304] 0 2023-12-09T02:35:15.146 INFO:tasks.workunit.client.1.smithi161.stdout:8/487: getdents d2 0 2023-12-09T02:35:15.146 INFO:tasks.workunit.client.1.smithi161.stdout:8/488: truncate d2/d5/d22/d76/f85 652928 0 2023-12-09T02:35:15.146 INFO:tasks.workunit.client.1.smithi161.stdout:8/489: readlink d2/lf 0 2023-12-09T02:35:15.146 INFO:tasks.workunit.client.1.smithi161.stdout:8/490: dread - d2/d5/f6b zero size 2023-12-09T02:35:15.147 INFO:tasks.workunit.client.1.smithi161.stdout:5/466: truncate d0/d2/f3 3983615 0 2023-12-09T02:35:15.149 INFO:tasks.workunit.client.1.smithi161.stdout:8/491: mkdir d2/d5/d22/d54/d9e 0 2023-12-09T02:35:15.154 INFO:tasks.workunit.client.1.smithi161.stdout:4/614: dwrite dd/d1a/fb0 [0,4194304] 0 2023-12-09T02:35:15.154 INFO:tasks.workunit.client.1.smithi161.stdout:8/492: dread d2/d5/f16 [0,4194304] 0 2023-12-09T02:35:15.154 INFO:tasks.workunit.client.1.smithi161.stdout:8/493: readlink d2/l21 0 2023-12-09T02:35:15.157 INFO:tasks.workunit.client.1.smithi161.stdout:8/494: truncate d2/d5/d22/d31/f39 6491483 0 2023-12-09T02:35:15.160 INFO:tasks.workunit.client.1.smithi161.stdout:8/495: rename d2/d5/d22/d31/d38/d66/f68 to d2/d5/d22/d31/d38/d66/d88/f9f 0 2023-12-09T02:35:15.162 INFO:tasks.workunit.client.1.smithi161.stdout:8/496: mkdir d2/d5/d22/d31/da0 0 2023-12-09T02:35:15.163 INFO:tasks.workunit.client.1.smithi161.stdout:5/467: dread d0/f1a [0,4194304] 0 2023-12-09T02:35:15.163 INFO:tasks.workunit.client.1.smithi161.stdout:5/468: chown d0/d2/d7/d11/d50/f8c 359917 1 2023-12-09T02:35:15.164 INFO:tasks.workunit.client.1.smithi161.stdout:5/469: write d0/d1f/f65 [3254073,34943] 0 2023-12-09T02:35:15.164 INFO:tasks.workunit.client.1.smithi161.stdout:5/470: chown d0/d2/de/d21 84044 1 2023-12-09T02:35:15.164 INFO:tasks.workunit.client.1.smithi161.stdout:5/471: write d0/d2/d7/d11/f5d [1507990,57395] 0 2023-12-09T02:35:15.165 INFO:tasks.workunit.client.1.smithi161.stdout:8/497: mkdir d2/d5/d22/d31/d38/d66/d88/da1 0 2023-12-09T02:35:15.168 INFO:tasks.workunit.client.1.smithi161.stdout:4/615: dread dd/f59 [0,4194304] 0 2023-12-09T02:35:15.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:14 smithi161 ceph-mon[121170]: Deploying cephadm binary to smithi088 2023-12-09T02:35:15.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:14 smithi161 ceph-mon[121170]: Deploying cephadm binary to smithi161 2023-12-09T02:35:15.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:14 smithi161 ceph-mon[121170]: mgrmap e22: smithi161.qmxtmg(active, since 1.03814s) 2023-12-09T02:35:15.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:14 smithi161 ceph-mon[121170]: pgmap v3: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail 2023-12-09T02:35:15.170 INFO:tasks.workunit.client.1.smithi161.stdout:8/498: mkdir d2/d5/d22/d31/d38/d48/da2 0 2023-12-09T02:35:15.175 INFO:tasks.workunit.client.1.smithi161.stdout:8/499: rename d2/d5/d4f/f52 to d2/d5/d22/fa3 0 2023-12-09T02:35:15.175 INFO:tasks.workunit.client.1.smithi161.stdout:8/500: fsync d2/d5/fb 0 2023-12-09T02:35:15.177 INFO:tasks.workunit.client.1.smithi161.stdout:8/501: dread d2/f1d [0,4194304] 0 2023-12-09T02:35:15.177 INFO:tasks.workunit.client.1.smithi161.stdout:8/502: chown d2/d5/d4f/f35 141546379 1 2023-12-09T02:35:15.178 INFO:tasks.workunit.client.1.smithi161.stdout:4/616: dread f8 [0,4194304] 0 2023-12-09T02:35:15.179 INFO:tasks.workunit.client.1.smithi161.stdout:8/503: creat d2/d5/d22/d86/fa4 x:0 0 0 2023-12-09T02:35:15.179 INFO:tasks.workunit.client.1.smithi161.stdout:8/504: chown d2/d5/d22/d54/l61 6526 1 2023-12-09T02:35:15.179 INFO:tasks.workunit.client.1.smithi161.stdout:8/505: write d2/d5/d22/d31/d38/f4d [1693327,17018] 0 2023-12-09T02:35:15.179 INFO:tasks.workunit.client.1.smithi161.stdout:8/506: chown d2/d5/fa 4 1 2023-12-09T02:35:15.180 INFO:tasks.workunit.client.1.smithi161.stdout:8/507: truncate d2/d5/f30 5084798 0 2023-12-09T02:35:15.181 INFO:tasks.workunit.client.1.smithi161.stdout:4/617: rename dd/d1a/d1d/d25/d32/l8c to dd/d1a/d1d/lc5 0 2023-12-09T02:35:15.181 INFO:tasks.workunit.client.1.smithi161.stdout:4/618: dread - dd/d36/d4a/d5f/f7c zero size 2023-12-09T02:35:15.182 INFO:tasks.workunit.client.1.smithi161.stdout:8/508: mkdir d2/d5/d22/d31/d38/d66/d88/da5 0 2023-12-09T02:35:15.187 INFO:tasks.workunit.client.1.smithi161.stdout:8/509: creat d2/d5/d22/d31/d38/d66/d88/da1/fa6 x:0 0 0 2023-12-09T02:35:15.187 INFO:tasks.workunit.client.1.smithi161.stdout:8/510: readlink d2/d5/d4f/l32 0 2023-12-09T02:35:15.188 INFO:tasks.workunit.client.1.smithi161.stdout:4/619: rename dd/d1a/cae to dd/d36/d3f/cc6 0 2023-12-09T02:35:15.191 INFO:tasks.workunit.client.1.smithi161.stdout:5/472: dwrite d0/d2/d7/d11/f4c [0,4194304] 0 2023-12-09T02:35:15.192 INFO:tasks.workunit.client.1.smithi161.stdout:5/473: truncate d0/d2/d7/df/d60/f95 460605 0 2023-12-09T02:35:15.192 INFO:tasks.workunit.client.1.smithi161.stdout:5/474: dread - d0/d2/de/f5b zero size 2023-12-09T02:35:15.192 INFO:tasks.workunit.client.1.smithi161.stdout:5/475: mknod d0/d2/d7/ca9 0 2023-12-09T02:35:15.195 INFO:tasks.workunit.client.1.smithi161.stdout:8/511: dread d2/f6 [0,4194304] 0 2023-12-09T02:35:15.197 INFO:tasks.workunit.client.1.smithi161.stdout:8/512: rmdir d2 39 2023-12-09T02:35:15.201 INFO:tasks.workunit.client.1.smithi161.stdout:8/513: dread d2/f6 [0,4194304] 0 2023-12-09T02:35:15.201 INFO:tasks.workunit.client.1.smithi161.stdout:8/514: stat d2/d5/d22/d31/f8b 0 2023-12-09T02:35:15.201 INFO:tasks.workunit.client.1.smithi161.stdout:5/476: dread d0/d2/d7/d11/d50/f8c [0,4194304] 0 2023-12-09T02:35:15.203 INFO:tasks.workunit.client.1.smithi161.stdout:1/616: sync 2023-12-09T02:35:15.204 INFO:tasks.workunit.client.1.smithi161.stdout:3/419: sync 2023-12-09T02:35:15.204 INFO:tasks.workunit.client.1.smithi161.stdout:0/516: sync 2023-12-09T02:35:15.204 INFO:tasks.workunit.client.1.smithi161.stdout:7/543: sync 2023-12-09T02:35:15.204 INFO:tasks.workunit.client.1.smithi161.stdout:7/544: write d0/d3/d13/d2d/d43/d4b/d5a/d6f/d83/f95 [203515,86041] 0 2023-12-09T02:35:15.204 INFO:tasks.workunit.client.1.smithi161.stdout:1/617: write d6/d8/f30 [2857907,130920] 0 2023-12-09T02:35:15.204 INFO:tasks.workunit.client.1.smithi161.stdout:1/618: truncate d6/d8/d63/d35/daa/f6b 1312013 0 2023-12-09T02:35:15.204 INFO:tasks.workunit.client.1.smithi161.stdout:8/515: creat d2/d5/d22/d31/d38/d84/fa7 x:0 0 0 2023-12-09T02:35:15.207 INFO:tasks.workunit.client.1.smithi161.stdout:3/420: link d2/d4/d11/d19/f2e d2/f72 0 2023-12-09T02:35:15.207 INFO:tasks.workunit.client.1.smithi161.stdout:3/421: readlink d2/d4/d11/d1f/d2a/d46/d3e/l3f 0 2023-12-09T02:35:15.208 INFO:tasks.workunit.client.1.smithi161.stdout:0/517: symlink d9/d55/d7c/d7a/la0 0 2023-12-09T02:35:15.209 INFO:tasks.workunit.client.1.smithi161.stdout:4/620: dwrite dd/d1a/d1d/d25/d32/f7e [0,4194304] 0 2023-12-09T02:35:15.209 INFO:tasks.workunit.client.1.smithi161.stdout:4/621: chown dd/d1a/d1d/d25/d32/d58/l67 4985318 1 2023-12-09T02:35:15.211 INFO:tasks.workunit.client.1.smithi161.stdout:7/545: getdents d0/d49/d67/d71 0 2023-12-09T02:35:15.213 INFO:tasks.workunit.client.1.smithi161.stdout:7/546: read d0/d3/d21/d54/f64 [214038,130153] 0 2023-12-09T02:35:15.214 INFO:tasks.workunit.client.1.smithi161.stdout:1/619: mknod d6/d8/d63/d4d/d31/d80/d9c/ccb 0 2023-12-09T02:35:15.215 INFO:tasks.workunit.client.1.smithi161.stdout:8/516: creat d2/d5/d22/d86/d97/fa8 x:0 0 0 2023-12-09T02:35:15.215 INFO:tasks.workunit.client.1.smithi161.stdout:8/517: dread - d2/d5/d22/d31/d38/d48/f72 zero size 2023-12-09T02:35:15.220 INFO:tasks.workunit.client.1.smithi161.stdout:0/518: creat d9/d55/d44/fa1 x:0 0 0 2023-12-09T02:35:15.224 INFO:tasks.workunit.client.1.smithi161.stdout:4/622: getdents dd/d1a/d29 0 2023-12-09T02:35:15.224 INFO:tasks.workunit.client.1.smithi161.stdout:4/623: write dd/d1a/d1e/f4f [279311,3336] 0 2023-12-09T02:35:15.224 INFO:tasks.workunit.client.1.smithi161.stdout:4/624: readlink dd/d36/d4a/d88/l96 0 2023-12-09T02:35:15.225 INFO:tasks.workunit.client.1.smithi161.stdout:7/547: mkdir d0/d3/daa/daf 0 2023-12-09T02:35:15.226 INFO:tasks.workunit.client.1.smithi161.stdout:7/548: write d0/d3/f46 [613132,73140] 0 2023-12-09T02:35:15.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:14 smithi088 ceph-mon[112028]: Deploying cephadm binary to smithi088 2023-12-09T02:35:15.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:14 smithi088 ceph-mon[112028]: Deploying cephadm binary to smithi161 2023-12-09T02:35:15.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:14 smithi088 ceph-mon[112028]: mgrmap e22: smithi161.qmxtmg(active, since 1.03814s) 2023-12-09T02:35:15.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:14 smithi088 ceph-mon[112028]: pgmap v3: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail 2023-12-09T02:35:15.227 INFO:tasks.workunit.client.1.smithi161.stdout:5/477: dwrite d0/d2/d7/d9a/f9c [0,4194304] 0 2023-12-09T02:35:15.227 INFO:tasks.workunit.client.1.smithi161.stdout:5/478: write d0/d2/d7/df/f96 [1023777,6911] 0 2023-12-09T02:35:15.228 INFO:tasks.workunit.client.1.smithi161.stdout:3/422: dwrite d2/d4/d11/d1f/d2a/f2f [0,4194304] 0 2023-12-09T02:35:15.228 INFO:tasks.workunit.client.1.smithi161.stdout:3/423: chown d2/l30 631 1 2023-12-09T02:35:15.230 INFO:tasks.workunit.client.1.smithi161.stdout:1/620: creat d6/d8/d63/fcc x:0 0 0 2023-12-09T02:35:15.230 INFO:tasks.workunit.client.1.smithi161.stdout:1/621: chown d6/d8/d63/d4d/d31/d80/d87/lb9 54025 1 2023-12-09T02:35:15.230 INFO:tasks.workunit.client.1.smithi161.stdout:1/622: write d6/d8/d63/d1c/d8a/fae [474859,23988] 0 2023-12-09T02:35:15.231 INFO:tasks.workunit.client.1.smithi161.stdout:1/623: write d6/d8/d63/d35/daa/fbe [498844,104607] 0 2023-12-09T02:35:15.233 INFO:tasks.workunit.client.1.smithi161.stdout:8/518: mkdir d2/d5/d22/d31/d38/d48/da2/da9 0 2023-12-09T02:35:15.233 INFO:tasks.workunit.client.1.smithi161.stdout:8/519: write d2/d5/d22/f77 [693236,71080] 0 2023-12-09T02:35:15.236 INFO:tasks.workunit.client.1.smithi161.stdout:0/519: link d9/d1f/f49 d9/db/d2a/fa2 0 2023-12-09T02:35:15.236 INFO:tasks.workunit.client.1.smithi161.stdout:0/520: chown d9/dd/f77 272807 1 2023-12-09T02:35:15.238 INFO:tasks.workunit.client.1.smithi161.stdout:4/625: mkdir dd/d36/d4a/d5f/dc7 0 2023-12-09T02:35:15.240 INFO:tasks.workunit.client.1.smithi161.stdout:4/626: write dd/d36/d4a/f84 [143728,85527] 0 2023-12-09T02:35:15.244 INFO:tasks.workunit.client.1.smithi161.stdout:7/549: symlink d0/d3/d9e/d59/d5e/lb0 0 2023-12-09T02:35:15.244 INFO:tasks.workunit.client.1.smithi161.stdout:7/550: write d0/d3/d13/d1b/f3f [890184,45048] 0 2023-12-09T02:35:15.251 INFO:tasks.workunit.client.1.smithi161.stdout:5/479: dwrite d0/d2/d7/d11/f41 [0,4194304] 0 2023-12-09T02:35:15.251 INFO:tasks.workunit.client.1.smithi161.stdout:5/480: write d0/f3d [3360552,3772] 0 2023-12-09T02:35:15.252 INFO:tasks.workunit.client.1.smithi161.stdout:5/481: truncate d0/f1 4845745 0 2023-12-09T02:35:15.252 INFO:tasks.workunit.client.1.smithi161.stdout:5/482: write d0/d1f/f42 [1529812,45518] 0 2023-12-09T02:35:15.252 INFO:tasks.workunit.client.1.smithi161.stdout:5/483: chown d0/d2/de/d21/l26 432 1 2023-12-09T02:35:15.257 INFO:tasks.workunit.client.1.smithi161.stdout:3/424: rename d2/d4/f5 to d2/d4/d11/d1f/d2a/d46/d5e/f73 0 2023-12-09T02:35:15.263 INFO:tasks.workunit.client.1.smithi161.stdout:0/521: mkdir d9/d55/d7c/d7a/da3 0 2023-12-09T02:35:15.263 INFO:tasks.workunit.client.1.smithi161.stdout:0/522: chown d9/d55/d44/l65 15551 1 2023-12-09T02:35:15.263 INFO:tasks.workunit.client.1.smithi161.stdout:0/523: chown d9/db/l78 7142025 1 2023-12-09T02:35:15.263 INFO:tasks.workunit.client.1.smithi161.stdout:0/524: write d9/d1f/f18 [1434850,81113] 0 2023-12-09T02:35:15.263 INFO:tasks.workunit.client.1.smithi161.stdout:0/525: chown d9/d55/d26/d28/d58/f67 0 1 2023-12-09T02:35:15.263 INFO:tasks.workunit.client.1.smithi161.stdout:0/526: dread - d9/d55/d7c/f8f zero size 2023-12-09T02:35:15.266 INFO:tasks.workunit.client.1.smithi161.stdout:4/627: symlink dd/d36/lc8 0 2023-12-09T02:35:15.268 INFO:tasks.workunit.client.1.smithi161.stdout:7/551: creat d0/d3/d13/d2f/d50/fb1 x:0 0 0 2023-12-09T02:35:15.268 INFO:tasks.workunit.client.1.smithi161.stdout:7/552: chown d0/d3/d13/d2d/d43/d4a/da7 556 1 2023-12-09T02:35:15.279 INFO:tasks.workunit.client.1.smithi161.stdout:3/425: dwrite d2/d37/f38 [0,4194304] 0 2023-12-09T02:35:15.279 INFO:tasks.workunit.client.1.smithi161.stdout:3/426: write d2/d4/d11/f5d [523979,24108] 0 2023-12-09T02:35:15.280 INFO:tasks.workunit.client.1.smithi161.stdout:5/484: truncate d0/d1f/f3b 132441 0 2023-12-09T02:35:15.282 INFO:tasks.workunit.client.1.smithi161.stdout:1/624: rename d6/d8/d63/d1c/d81 to d6/d8/d63/d1c/d8a/dcd 0 2023-12-09T02:35:15.282 INFO:tasks.workunit.client.1.smithi161.stdout:1/625: fdatasync d6/d8/d63/d35/d3d/f96 0 2023-12-09T02:35:15.283 INFO:tasks.workunit.client.1.smithi161.stdout:3/427: dread d2/d4/d11/d1f/d2a/f63 [0,4194304] 0 2023-12-09T02:35:15.283 INFO:tasks.workunit.client.1.smithi161.stdout:3/428: chown d2/d4/d11/l4f 196712334 1 2023-12-09T02:35:15.284 INFO:tasks.workunit.client.1.smithi161.stdout:3/429: write d2/d4/d11/d1f/d2a/d46/d2d/d47/f5c [12834666,55724] 0 2023-12-09T02:35:15.286 INFO:tasks.workunit.client.1.smithi161.stdout:8/520: link d2/c67 d2/d5/d3d/caa 0 2023-12-09T02:35:15.290 INFO:tasks.workunit.client.1.smithi161.stdout:0/527: unlink d9/dd/d3a/l41 0 2023-12-09T02:35:15.292 INFO:tasks.workunit.client.1.smithi161.stdout:4/628: creat dd/d36/d4a/fc9 x:0 0 0 2023-12-09T02:35:15.293 INFO:tasks.workunit.client.1.smithi161.stdout:5/485: getdents d0/d2/de/d22 0 2023-12-09T02:35:15.293 INFO:tasks.workunit.client.1.smithi161.stdout:5/486: fsync d0/d2/d7/d9a/f9c 0 2023-12-09T02:35:15.296 INFO:tasks.workunit.client.1.smithi161.stdout:7/553: rename d0/d3/d13/d2d/d43/d4a to d0/d3/d13/d4e/db2 0 2023-12-09T02:35:15.298 INFO:tasks.workunit.client.1.smithi161.stdout:1/626: mknod d6/d8/cce 0 2023-12-09T02:35:15.300 INFO:tasks.workunit.client.1.smithi161.stdout:5/487: dread d0/d2/de/d44/f43 [0,4194304] 0 2023-12-09T02:35:15.300 INFO:tasks.workunit.client.1.smithi161.stdout:5/488: fsync d0/f1a 0 2023-12-09T02:35:15.301 INFO:tasks.workunit.client.1.smithi161.stdout:8/521: link d2/l4 d2/d5/d22/d31/d38/d48/lab 0 2023-12-09T02:35:15.302 INFO:tasks.workunit.client.1.smithi161.stdout:4/629: getdents dd/d1a/d1d/d25/d32/d34 0 2023-12-09T02:35:15.305 INFO:tasks.workunit.client.1.smithi161.stdout:3/430: dwrite d2/d4/d11/d1f/d2a/d46/f57 [0,4194304] 0 2023-12-09T02:35:15.306 INFO:tasks.workunit.client.1.smithi161.stdout:7/554: creat d0/d3/d13/d4e/db2/da7/fb3 x:0 0 0 2023-12-09T02:35:15.307 INFO:tasks.workunit.client.1.smithi161.stdout:8/522: mkdir d2/d5/dac 0 2023-12-09T02:35:15.308 INFO:tasks.workunit.client.1.smithi161.stdout:8/523: write d2/d5/d22/fa3 [1373405,29117] 0 2023-12-09T02:35:15.309 INFO:tasks.workunit.client.1.smithi161.stdout:8/524: truncate d2/d5/f6b 37811 0 2023-12-09T02:35:15.309 INFO:tasks.workunit.client.1.smithi161.stdout:8/525: truncate d2/d5/d22/d76/f85 1550780 0 2023-12-09T02:35:15.319 INFO:tasks.workunit.client.1.smithi161.stdout:3/431: mkdir d2/d4/d11/d1f/d74 0 2023-12-09T02:35:15.323 INFO:tasks.workunit.client.1.smithi161.stdout:7/555: mkdir d0/d3/d9e/db4 0 2023-12-09T02:35:15.325 INFO:tasks.workunit.client.1.smithi161.stdout:3/432: truncate d2/d4/d11/d1f/d2a/d46/f29 2562872 0 2023-12-09T02:35:15.325 INFO:tasks.workunit.client.1.smithi161.stdout:3/433: readlink d2/d4/d11/d1f/d2a/d46/d5e/l6b 0 2023-12-09T02:35:15.328 INFO:tasks.workunit.client.1.smithi161.stdout:3/434: write d2/d4/d11/d1f/d2a/d46/d40/f6d [415995,58310] 0 2023-12-09T02:35:15.329 INFO:tasks.workunit.client.1.smithi161.stdout:0/528: dwrite d9/dd/f77 [0,4194304] 0 2023-12-09T02:35:15.330 INFO:tasks.workunit.client.1.smithi161.stdout:7/556: rename d0/d3/d13/d2d/d43/d4b/d5a/d6f to d0/d3/d13/d4e/db5 0 2023-12-09T02:35:15.335 INFO:tasks.workunit.client.1.smithi161.stdout:1/627: dwrite d6/d9/d8b/fc7 [0,4194304] 0 2023-12-09T02:35:15.335 INFO:tasks.workunit.client.1.smithi161.stdout:9/475: sync 2023-12-09T02:35:15.335 INFO:tasks.workunit.client.1.smithi161.stdout:6/482: sync 2023-12-09T02:35:15.336 INFO:tasks.workunit.client.1.smithi161.stdout:2/516: sync 2023-12-09T02:35:15.336 INFO:tasks.workunit.client.1.smithi161.stdout:4/630: dwrite dd/f13 [0,4194304] 0 2023-12-09T02:35:15.337 INFO:tasks.workunit.client.1.smithi161.stdout:8/526: dwrite d2/d5/f16 [0,4194304] 0 2023-12-09T02:35:15.338 INFO:tasks.workunit.client.1.smithi161.stdout:5/489: dwrite d0/d2/d7/d70/f75 [0,4194304] 0 2023-12-09T02:35:15.339 INFO:tasks.workunit.client.1.smithi161.stdout:0/529: unlink d9/d55/f51 0 2023-12-09T02:35:15.345 INFO:tasks.workunit.client.1.smithi161.stdout:7/557: unlink d0/d3/f63 0 2023-12-09T02:35:15.349 INFO:tasks.workunit.client.1.smithi161.stdout:1/628: rmdir d6/d8/d63/d35 39 2023-12-09T02:35:15.350 INFO:tasks.workunit.client.1.smithi161.stdout:6/483: creat da/d55/d6d/dac/fb1 x:0 0 0 2023-12-09T02:35:15.351 INFO:tasks.workunit.client.1.smithi161.stdout:2/517: getdents d4/d7/db 0 2023-12-09T02:35:15.352 INFO:tasks.workunit.client.1.smithi161.stdout:2/518: chown d4/d1a/d4a 295 1 2023-12-09T02:35:15.353 INFO:tasks.workunit.client.1.smithi161.stdout:4/631: symlink dd/d36/d4a/d5f/lca 0 2023-12-09T02:35:15.354 INFO:tasks.workunit.client.1.smithi161.stdout:9/476: dwrite d2/d25/d3a/d65/d42/d58/d91/d2e/d3f/d61/f6c [0,4194304] 0 2023-12-09T02:35:15.356 INFO:tasks.workunit.client.1.smithi161.stdout:8/527: mknod d2/d5/d22/d86/d97/cad 0 2023-12-09T02:35:15.358 INFO:tasks.workunit.client.1.smithi161.stdout:5/490: creat d0/d2/de/d22/faa x:0 0 0 2023-12-09T02:35:15.359 INFO:tasks.workunit.client.1.smithi161.stdout:5/491: chown d0/f27 0 1 2023-12-09T02:35:15.362 INFO:tasks.workunit.client.1.smithi161.stdout:3/435: rename d2/d4 to d2/d51/d75 0 2023-12-09T02:35:15.363 INFO:tasks.workunit.client.1.smithi161.stdout:7/558: creat d0/d3/d9e/db4/fb6 x:0 0 0 2023-12-09T02:35:15.363 INFO:tasks.workunit.client.1.smithi161.stdout:9/477: dread d2/d25/d3a/d65/d42/d58/d91/f20 [0,4194304] 0 2023-12-09T02:35:15.371 INFO:tasks.workunit.client.1.smithi161.stdout:1/629: creat d6/d8/d63/d4d/d31/d80/d87/fcf x:0 0 0 2023-12-09T02:35:15.371 INFO:tasks.workunit.client.1.smithi161.stdout:1/630: chown d6/d8/d63/d1c 13595 1 2023-12-09T02:35:15.372 INFO:tasks.workunit.client.1.smithi161.stdout:1/631: write d6/d8/d63/d4d/fc4 [3667036,5670] 0 2023-12-09T02:35:15.373 INFO:tasks.workunit.client.1.smithi161.stdout:6/484: truncate da/d28/d3c/f90 61275 0 2023-12-09T02:35:15.376 INFO:tasks.workunit.client.1.smithi161.stdout:4/632: dread dd/d1a/f66 [0,4194304] 0 2023-12-09T02:35:15.377 INFO:tasks.workunit.client.1.smithi161.stdout:2/519: unlink d4/d1a/c27 0 2023-12-09T02:35:15.382 INFO:tasks.workunit.client.1.smithi161.stdout:8/528: creat d2/d5/d22/d31/d38/d66/d88/da5/fae x:0 0 0 2023-12-09T02:35:15.389 INFO:tasks.workunit.client.1.smithi161.stdout:7/559: dwrite d0/d3/d13/d1b/f3f [0,4194304] 0 2023-12-09T02:35:15.389 INFO:tasks.workunit.client.1.smithi161.stdout:7/560: write d0/d3/d13/d2f/d50/fb1 [778648,61589] 0 2023-12-09T02:35:15.389 INFO:tasks.workunit.client.1.smithi161.stdout:0/530: link d9/d55/d7c/d7a/la0 d9/dd/la4 0 2023-12-09T02:35:15.389 INFO:tasks.workunit.client.1.smithi161.stdout:5/492: dwrite d0/d1f/f3b [0,4194304] 0 2023-12-09T02:35:15.392 INFO:tasks.workunit.client.1.smithi161.stdout:3/436: creat d2/d51/d75/d11/d5a/f76 x:0 0 0 2023-12-09T02:35:15.396 INFO:tasks.workunit.client.1.smithi161.stdout:9/478: rename d2/d25/d3a/d65/d4f/f8d to d2/d25/d3a/d65/fa8 0 2023-12-09T02:35:15.396 INFO:tasks.workunit.client.1.smithi161.stdout:9/479: write d2/d25/d3a/d65/d42/d58/d91/f36 [1218543,8489] 0 2023-12-09T02:35:15.396 INFO:tasks.workunit.client.1.smithi161.stdout:3/437: dread d2/d51/d75/f36 [0,4194304] 0 2023-12-09T02:35:15.397 INFO:tasks.workunit.client.1.smithi161.stdout:1/632: mkdir d6/d8/d63/d4d/dd0 0 2023-12-09T02:35:15.397 INFO:tasks.workunit.client.1.smithi161.stdout:1/633: stat d6/d8/d63/d4d/d31/d80/c9e 0 2023-12-09T02:35:15.401 INFO:tasks.workunit.client.1.smithi161.stdout:6/485: creat da/d28/d4d/fb2 x:0 0 0 2023-12-09T02:35:15.403 INFO:tasks.workunit.client.1.smithi161.stdout:4/633: fdatasync dd/d36/d3f/f4b 0 2023-12-09T02:35:15.403 INFO:tasks.workunit.client.1.smithi161.stdout:4/634: dread - dd/d1a/d1d/f8e zero size 2023-12-09T02:35:15.407 INFO:tasks.workunit.client.1.smithi161.stdout:2/520: creat d4/d7/d8f/fa5 x:0 0 0 2023-12-09T02:35:15.408 INFO:tasks.workunit.client.1.smithi161.stdout:2/521: write d4/d7/f13 [324026,123622] 0 2023-12-09T02:35:15.413 INFO:tasks.workunit.client.1.smithi161.stdout:6/486: dread da/f76 [0,4194304] 0 2023-12-09T02:35:15.413 INFO:tasks.workunit.client.1.smithi161.stdout:7/561: mknod d0/cb7 0 2023-12-09T02:35:15.414 INFO:tasks.workunit.client.1.smithi161.stdout:0/531: mkdir d9/d5b/da5 0 2023-12-09T02:35:15.414 INFO:tasks.workunit.client.1.smithi161.stdout:0/532: truncate d9/d55/d26/d28/d58/f93 100867 0 2023-12-09T02:35:15.415 INFO:tasks.workunit.client.1.smithi161.stdout:2/522: write d4/d7/db/f67 [482702,108253] 0 2023-12-09T02:35:15.416 INFO:tasks.workunit.client.1.smithi161.stdout:2/523: chown d4/d1a/l83 0 1 2023-12-09T02:35:15.416 INFO:tasks.workunit.client.1.smithi161.stdout:9/480: dwrite d2/d25/d3a/d65/d88/f9b [0,4194304] 0 2023-12-09T02:35:15.420 INFO:tasks.workunit.client.1.smithi161.stdout:5/493: creat d0/d2/de/d22/d8e/d8f/fab x:0 0 0 2023-12-09T02:35:15.426 INFO:tasks.workunit.client.1.smithi161.stdout:9/481: dread d2/d25/d3a/d65/d88/f9b [0,4194304] 0 2023-12-09T02:35:15.429 INFO:tasks.workunit.client.1.smithi161.stdout:4/635: dwrite dd/d36/d3f/fc1 [0,4194304] 0 2023-12-09T02:35:15.429 INFO:tasks.workunit.client.1.smithi161.stdout:0/533: dread d9/d55/d7c/f6b [0,4194304] 0 2023-12-09T02:35:15.429 INFO:tasks.workunit.client.1.smithi161.stdout:4/636: chown dd/d1a/fb0 1 1 2023-12-09T02:35:15.430 INFO:tasks.workunit.client.1.smithi161.stdout:0/534: dread d9/d55/f6a [0,4194304] 0 2023-12-09T02:35:15.440 INFO:tasks.workunit.client.1.smithi161.stdout:3/438: unlink d2/d51/d75/d11/d19/f6f 0 2023-12-09T02:35:15.441 INFO:tasks.workunit.client.1.smithi161.stdout:1/634: symlink d6/d9/d8b/ld1 0 2023-12-09T02:35:15.441 INFO:tasks.workunit.client.1.smithi161.stdout:1/635: chown d6/d8/d63/d4d/d31/d80/d87/fcf 140360 1 2023-12-09T02:35:15.446 INFO:tasks.workunit.client.1.smithi161.stdout:7/562: rmdir d0/d3/d13/d4e/d70 39 2023-12-09T02:35:15.450 INFO:tasks.workunit.client.1.smithi161.stdout:2/524: mkdir d4/da6 0 2023-12-09T02:35:15.450 INFO:tasks.workunit.client.1.smithi161.stdout:2/525: chown d4/d16/d69/d8c/d5a/l9a 26 1 2023-12-09T02:35:15.451 INFO:tasks.workunit.client.1.smithi161.stdout:2/526: read - d4/d16/f82 zero size 2023-12-09T02:35:15.451 INFO:tasks.workunit.client.1.smithi161.stdout:2/527: chown d4/d7/db/f2f 128524 1 2023-12-09T02:35:15.451 INFO:tasks.workunit.client.1.smithi161.stdout:2/528: chown d4/fa0 4 1 2023-12-09T02:35:15.451 INFO:tasks.workunit.client.1.smithi161.stdout:2/529: fdatasync d4/d16/f1e 0 2023-12-09T02:35:15.451 INFO:tasks.workunit.client.1.smithi161.stdout:6/487: dwrite da/d19/f72 [0,4194304] 0 2023-12-09T02:35:15.454 INFO:tasks.workunit.client.1.smithi161.stdout:5/494: symlink d0/d2/d7/df/d60/da8/lac 0 2023-12-09T02:35:15.454 INFO:tasks.workunit.client.1.smithi161.stdout:1/636: dread d6/d9/f45 [0,4194304] 0 2023-12-09T02:35:15.455 INFO:tasks.workunit.client.1.smithi161.stdout:9/482: symlink d2/d25/d3a/d65/d42/d58/d91/d39/la9 0 2023-12-09T02:35:15.456 INFO:tasks.workunit.client.1.smithi161.stdout:4/637: dwrite dd/d36/d4a/d88/fa0 [0,4194304] 0 2023-12-09T02:35:15.457 INFO:tasks.workunit.client.1.smithi161.stdout:0/535: dwrite d9/db/d2a/f59 [0,4194304] 0 2023-12-09T02:35:15.459 INFO:tasks.workunit.client.1.smithi161.stdout:3/439: rename d2/d51/d75/d11/d1f/c21 to d2/d51/d75/d11/d1f/d2a/d46/d2d/d47/c77 0 2023-12-09T02:35:15.463 INFO:tasks.workunit.client.1.smithi161.stdout:1/637: rmdir d6/d8/d63/d1c/d8a/dcd/d9d 39 2023-12-09T02:35:15.464 INFO:tasks.workunit.client.1.smithi161.stdout:9/483: creat d2/d25/d3a/d65/d4f/faa x:0 0 0 2023-12-09T02:35:15.464 INFO:tasks.workunit.client.1.smithi161.stdout:9/484: truncate d2/d25/d3a/d65/d63/f9e 628397 0 2023-12-09T02:35:15.465 INFO:tasks.workunit.client.1.smithi161.stdout:9/485: write d2/d25/d3a/d65/d42/d58/f10 [645846,1862] 0 2023-12-09T02:35:15.468 INFO:tasks.workunit.client.1.smithi161.stdout:3/440: mkdir d2/d51/d75/d11/d5a/d78 0 2023-12-09T02:35:15.472 INFO:tasks.workunit.client.1.smithi161.stdout:5/495: rename d0/d2/d7/d51/l80 to d0/d2/d7/d9a/lad 0 2023-12-09T02:35:15.472 INFO:tasks.workunit.client.1.smithi161.stdout:5/496: read - d0/d2/de/d22/d8e/d8f/fab zero size 2023-12-09T02:35:15.475 INFO:tasks.workunit.client.1.smithi161.stdout:7/563: dwrite d0/d3/d13/f89 [0,4194304] 0 2023-12-09T02:35:15.475 INFO:tasks.workunit.client.1.smithi161.stdout:6/488: mknod da/cb3 0 2023-12-09T02:35:15.476 INFO:tasks.workunit.client.1.smithi161.stdout:6/489: write da/d19/f50 [4176369,2541] 0 2023-12-09T02:35:15.476 INFO:tasks.workunit.client.1.smithi161.stdout:6/490: chown da/d55/d6d/d85/l83 352298298 1 2023-12-09T02:35:15.477 INFO:tasks.workunit.client.1.smithi161.stdout:6/491: write da/d19/f1e [4994610,28254] 0 2023-12-09T02:35:15.479 INFO:tasks.workunit.client.1.smithi161.stdout:1/638: mkdir d6/d9/d8b/dba/dd2 0 2023-12-09T02:35:15.483 INFO:tasks.workunit.client.1.smithi161.stdout:3/441: creat d2/d51/d75/d11/d1f/d2a/d46/d5e/f79 x:0 0 0 2023-12-09T02:35:15.483 INFO:tasks.workunit.client.1.smithi161.stdout:3/442: fsync d2/d51/d75/d11/d1f/d2a/d46/d5e/f73 0 2023-12-09T02:35:15.483 INFO:tasks.workunit.client.1.smithi161.stdout:4/638: dwrite dd/d36/d3f/fa4 [0,4194304] 0 2023-12-09T02:35:15.484 INFO:tasks.workunit.client.1.smithi161.stdout:4/639: fdatasync dd/d1a/d1e/f21 0 2023-12-09T02:35:15.486 INFO:tasks.workunit.client.1.smithi161.stdout:9/486: rename d2/d25/d3a/d65/d42/d58/d91/d2e/d3f/f72 to d2/d25/d3a/d65/d5c/d55/d66/d83/fab 0 2023-12-09T02:35:15.488 INFO:tasks.workunit.client.1.smithi161.stdout:5/497: rmdir d0/d1f/d94 0 2023-12-09T02:35:15.492 INFO:tasks.workunit.client.1.smithi161.stdout:7/564: mkdir d0/d3/d13/d1b/db8 0 2023-12-09T02:35:15.496 INFO:tasks.workunit.client.1.smithi161.stdout:1/639: creat d6/d8/d63/d4d/d31/d73/d47/db2/fd3 x:0 0 0 2023-12-09T02:35:15.499 INFO:tasks.workunit.client.1.smithi161.stdout:6/492: dwrite da/d19/f1e [8388608,4194304] 0 2023-12-09T02:35:15.500 INFO:tasks.workunit.client.1.smithi161.stdout:3/443: mkdir d2/d51/d75/d11/d1f/d7a 0 2023-12-09T02:35:15.500 INFO:tasks.workunit.client.1.smithi161.stdout:3/444: write d2/d51/d75/d11/d1f/d2a/d46/d40/f58 [26698,7261] 0 2023-12-09T02:35:15.500 INFO:tasks.workunit.client.1.smithi161.stdout:3/445: chown d2/d51/d75/d11/d1f/d2a/d46/d40/c4b 33 1 2023-12-09T02:35:15.500 INFO:tasks.workunit.client.1.smithi161.stdout:3/446: write d2/d51/d75/d11/d1f/d2a/f2f [4396896,112627] 0 2023-12-09T02:35:15.502 INFO:tasks.workunit.client.1.smithi161.stdout:6/493: write da/fc [3973800,22279] 0 2023-12-09T02:35:15.502 INFO:tasks.workunit.client.1.smithi161.stdout:4/640: creat dd/d36/d4a/d88/d8a/db3/fcb x:0 0 0 2023-12-09T02:35:15.504 INFO:tasks.workunit.client.1.smithi161.stdout:9/487: mkdir d2/d25/d3a/d65/d5c/dac 0 2023-12-09T02:35:15.504 INFO:tasks.workunit.client.1.smithi161.stdout:9/488: fsync d2/d25/d3a/d65/d42/f4c 0 2023-12-09T02:35:15.504 INFO:tasks.workunit.client.1.smithi161.stdout:9/489: truncate d2/d25/d3a/d65/d42/d58/d22/f9f 744913 0 2023-12-09T02:35:15.504 INFO:tasks.workunit.client.1.smithi161.stdout:9/490: fdatasync d2/d25/d3a/d4d/d7d/f87 0 2023-12-09T02:35:15.507 INFO:tasks.workunit.client.1.smithi161.stdout:1/640: mkdir d6/d9/dd4 0 2023-12-09T02:35:15.509 INFO:tasks.workunit.client.1.smithi161.stdout:5/498: dwrite d0/d1f/f65 [0,4194304] 0 2023-12-09T02:35:15.509 INFO:tasks.workunit.client.1.smithi161.stdout:5/499: read - d0/d9/f78 zero size 2023-12-09T02:35:15.515 INFO:tasks.workunit.client.1.smithi161.stdout:6/494: mkdir da/d28/d29/d2b/db4 0 2023-12-09T02:35:15.515 INFO:tasks.workunit.client.1.smithi161.stdout:6/495: chown da/df/l1f 5454 1 2023-12-09T02:35:15.515 INFO:tasks.workunit.client.1.smithi161.stdout:6/496: truncate da/d55/d6d/fa6 1009410 0 2023-12-09T02:35:15.516 INFO:tasks.workunit.client.1.smithi161.stdout:4/641: truncate f9 126962 0 2023-12-09T02:35:15.517 INFO:tasks.workunit.client.1.smithi161.stdout:3/447: dwrite d2/d51/d75/d11/d19/f6e [0,4194304] 0 2023-12-09T02:35:15.520 INFO:tasks.workunit.client.1.smithi161.stdout:9/491: rmdir d2/d25/d3a/d65/d42/d58/d91/d51 39 2023-12-09T02:35:15.523 INFO:tasks.workunit.client.1.smithi161.stdout:5/500: unlink d0/d2/de/d44/la5 0 2023-12-09T02:35:15.527 INFO:tasks.workunit.client.1.smithi161.stdout:1/641: dwrite d6/d8/d63/d4d/d31/d73/fb7 [0,4194304] 0 2023-12-09T02:35:15.527 INFO:tasks.workunit.client.1.smithi161.stdout:1/642: fdatasync d6/d9/f45 0 2023-12-09T02:35:15.528 INFO:tasks.workunit.client.1.smithi161.stdout:6/497: symlink da/d28/d3c/d46/lb5 0 2023-12-09T02:35:15.533 INFO:tasks.workunit.client.1.smithi161.stdout:3/448: mkdir d2/d51/d75/d11/d7b 0 2023-12-09T02:35:15.534 INFO:tasks.workunit.client.1.smithi161.stdout:3/449: write d2/d51/d75/d11/f64 [2620619,82336] 0 2023-12-09T02:35:15.535 INFO:tasks.workunit.client.1.smithi161.stdout:4/642: dwrite f7 [4194304,4194304] 0 2023-12-09T02:35:15.536 INFO:tasks.workunit.client.1.smithi161.stdout:9/492: mknod d2/d25/d3a/d65/d42/d58/d91/d51/cad 0 2023-12-09T02:35:15.537 INFO:tasks.workunit.client.1.smithi161.stdout:9/493: truncate d2/d25/d3a/fa0 1014534 0 2023-12-09T02:35:15.541 INFO:tasks.workunit.client.1.smithi161.stdout:5/501: getdents d0/d2/de/d22/d8e/d8f 0 2023-12-09T02:35:15.542 INFO:tasks.workunit.client.1.smithi161.stdout:6/498: dread da/df/d2d/f32 [0,4194304] 0 2023-12-09T02:35:15.552 INFO:tasks.workunit.client.1.smithi161.stdout:3/450: dwrite d2/d51/d75/d11/f3c [0,4194304] 0 2023-12-09T02:35:15.552 INFO:tasks.workunit.client.1.smithi161.stdout:3/451: write d2/f72 [937844,35770] 0 2023-12-09T02:35:15.552 INFO:tasks.workunit.client.1.smithi161.stdout:1/643: mkdir d6/d8/d63/d4d/dd5 0 2023-12-09T02:35:15.558 INFO:tasks.workunit.client.1.smithi161.stdout:4/643: creat dd/d36/d4a/fcc x:0 0 0 2023-12-09T02:35:15.558 INFO:tasks.workunit.client.1.smithi161.stdout:9/494: symlink d2/d25/d3a/d65/d42/lae 0 2023-12-09T02:35:15.558 INFO:tasks.workunit.client.1.smithi161.stdout:1/644: dread d6/d8/d63/d4d/fc4 [0,4194304] 0 2023-12-09T02:35:15.560 INFO:tasks.workunit.client.1.smithi161.stdout:5/502: mknod d0/d2/d7/d51/cae 0 2023-12-09T02:35:15.560 INFO:tasks.workunit.client.1.smithi161.stdout:5/503: chown d0/d2/de/d22/d8e 7786096 1 2023-12-09T02:35:15.563 INFO:tasks.workunit.client.1.smithi161.stdout:5/504: write d0/d2/de/f89 [2508806,25101] 0 2023-12-09T02:35:15.563 INFO:tasks.workunit.client.1.smithi161.stdout:5/505: write d0/f9e [1047115,6056] 0 2023-12-09T02:35:15.563 INFO:tasks.workunit.client.1.smithi161.stdout:6/499: creat da/d55/d6d/d85/fb6 x:0 0 0 2023-12-09T02:35:15.573 INFO:tasks.workunit.client.1.smithi161.stdout:3/452: symlink d2/d51/d75/d11/d1f/d2a/d46/d2d/d47/l7c 0 2023-12-09T02:35:15.573 INFO:tasks.workunit.client.1.smithi161.stdout:3/453: dread - d2/d51/d75/d11/d5a/f76 zero size 2023-12-09T02:35:15.575 INFO:tasks.workunit.client.1.smithi161.stdout:4/644: rename dd/d1a/d1d/d25/d32/d34/d78 to dd/d36/d4a/d88/dcd 0 2023-12-09T02:35:15.578 INFO:tasks.workunit.client.1.smithi161.stdout:9/495: creat d2/d25/d3a/d4d/d7d/faf x:0 0 0 2023-12-09T02:35:15.578 INFO:tasks.workunit.client.1.smithi161.stdout:9/496: write d2/d25/d3a/d65/d42/d58/d91/f20 [3137046,38879] 0 2023-12-09T02:35:15.578 INFO:tasks.workunit.client.1.smithi161.stdout:9/497: write d2/d25/d3a/d65/d5c/d60/d7f/f89 [153784,41575] 0 2023-12-09T02:35:15.581 INFO:tasks.workunit.client.1.smithi161.stdout:4/645: dread dd/fe [0,4194304] 0 2023-12-09T02:35:15.602 INFO:tasks.workunit.client.1.smithi161.stdout:1/645: mkdir d6/d9/dd6 0 2023-12-09T02:35:15.602 INFO:tasks.workunit.client.1.smithi161.stdout:1/646: chown d6/d8/d63/d35/d3d/l6f 1566707 1 2023-12-09T02:35:15.606 INFO:tasks.workunit.client.1.smithi161.stdout:5/506: rename d0/d2/d7/c4b to d0/d9/caf 0 2023-12-09T02:35:15.608 INFO:tasks.workunit.client.1.smithi161.stdout:5/507: dread d0/d2/d7/df/d60/f6e [0,4194304] 0 2023-12-09T02:35:15.608 INFO:tasks.workunit.client.1.smithi161.stdout:9/498: getdents d2/d25/d3a/d65/d42/d58/d22 0 2023-12-09T02:35:15.612 INFO:tasks.workunit.client.1.smithi161.stdout:6/500: rename da/df/f13 to da/d19/d20/fb7 0 2023-12-09T02:35:15.613 INFO:tasks.workunit.client.1.smithi161.stdout:5/508: mknod d0/d2/d7/df/cb0 0 2023-12-09T02:35:15.615 INFO:tasks.workunit.client.1.smithi161.stdout:9/499: symlink d2/d25/d3a/d65/d88/lb0 0 2023-12-09T02:35:15.615 INFO:tasks.workunit.client.1.smithi161.stdout:9/500: chown d2/d25/d3a/d65/d42/d58/d91/d51/f6b 1465 1 2023-12-09T02:35:15.617 INFO:tasks.workunit.client.1.smithi161.stdout:4/646: rename dd/d1a/d29/fad to dd/d36/d4a/d5f/d65/fce 0 2023-12-09T02:35:15.617 INFO:tasks.workunit.client.1.smithi161.stdout:4/647: chown dd/d1a/d1d/laa 6 1 2023-12-09T02:35:15.617 INFO:tasks.workunit.client.1.smithi161.stdout:4/648: chown dd/d1a/d1d/d25/c9b 1379 1 2023-12-09T02:35:15.617 INFO:tasks.workunit.client.1.smithi161.stdout:4/649: truncate dd/d36/d4a/d5f/fba 650684 0 2023-12-09T02:35:15.618 INFO:tasks.workunit.client.1.smithi161.stdout:5/509: rmdir d0/d2/de/d22 39 2023-12-09T02:35:15.625 INFO:tasks.workunit.client.1.smithi161.stdout:6/501: dwrite da/d55/f5f [0,4194304] 0 2023-12-09T02:35:15.626 INFO:tasks.workunit.client.1.smithi161.stdout:4/650: rmdir dd/d1a/d29 39 2023-12-09T02:35:15.627 INFO:tasks.workunit.client.1.smithi161.stdout:5/510: creat d0/d2/de/d22/d8e/d8f/fb1 x:0 0 0 2023-12-09T02:35:15.627 INFO:tasks.workunit.client.1.smithi161.stdout:5/511: chown d0/d2/d7/d11/f37 114021 1 2023-12-09T02:35:15.627 INFO:tasks.workunit.client.1.smithi161.stdout:5/512: chown d0 116136 1 2023-12-09T02:35:15.630 INFO:tasks.workunit.client.1.smithi161.stdout:1/647: rename l0 to d6/d8/d63/d35/d3d/d75/ld7 0 2023-12-09T02:35:15.634 INFO:tasks.workunit.client.1.smithi161.stdout:6/502: mkdir da/d28/d3c/db8 0 2023-12-09T02:35:15.635 INFO:tasks.workunit.client.1.smithi161.stdout:4/651: truncate dd/d1a/d1d/d25/d32/f99 506611 0 2023-12-09T02:35:15.640 INFO:tasks.workunit.client.1.smithi161.stdout:3/454: truncate d2/d51/d75/d11/d1f/d2a/f2f 1511468 0 2023-12-09T02:35:15.640 INFO:tasks.workunit.client.1.smithi161.stdout:3/455: truncate d2/d51/d75/d11/d1f/d2a/d46/d5e/f79 539546 0 2023-12-09T02:35:15.640 INFO:tasks.workunit.client.1.smithi161.stdout:6/503: rmdir da/d28/d77 39 2023-12-09T02:35:15.641 INFO:tasks.workunit.client.1.smithi161.stdout:6/504: chown da/df/c56 422444330 1 2023-12-09T02:35:15.641 INFO:tasks.workunit.client.1.smithi161.stdout:6/505: chown da/d28/d29/d2b 94 1 2023-12-09T02:35:15.642 INFO:tasks.workunit.client.1.smithi161.stdout:3/456: creat d2/d51/d75/d11/d1f/d2a/f7d x:0 0 0 2023-12-09T02:35:15.644 INFO:tasks.workunit.client.1.smithi161.stdout:6/506: creat da/d19/d20/fb9 x:0 0 0 2023-12-09T02:35:15.646 INFO:tasks.workunit.client.1.smithi161.stdout:6/507: creat da/d55/fba x:0 0 0 2023-12-09T02:35:15.646 INFO:tasks.workunit.client.1.smithi161.stdout:6/508: truncate da/d28/d4d/fb2 232052 0 2023-12-09T02:35:15.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/509: dread da/f12 [0,4194304] 0 2023-12-09T02:35:15.659 INFO:tasks.workunit.client.1.smithi161.stdout:1/648: dwrite f5 [4194304,4194304] 0 2023-12-09T02:35:15.659 INFO:tasks.workunit.client.1.smithi161.stdout:1/649: dread - d6/d9/d8b/fa3 zero size 2023-12-09T02:35:15.659 INFO:tasks.workunit.client.1.smithi161.stdout:6/510: mkdir da/d55/dbb 0 2023-12-09T02:35:15.661 INFO:tasks.workunit.client.1.smithi161.stdout:4/652: dwrite f9 [0,4194304] 0 2023-12-09T02:35:15.662 INFO:tasks.workunit.client.1.smithi161.stdout:5/513: dwrite d0/f1a [0,4194304] 0 2023-12-09T02:35:15.662 INFO:tasks.workunit.client.1.smithi161.stdout:3/457: dread d2/d51/d75/d11/f64 [0,4194304] 0 2023-12-09T02:35:15.663 INFO:tasks.workunit.client.1.smithi161.stdout:5/514: fsync d0/d2/de/d22/d8e/d8f/fab 0 2023-12-09T02:35:15.663 INFO:tasks.workunit.client.1.smithi161.stdout:5/515: write d0/d2/d7/d51/f71 [4264281,89053] 0 2023-12-09T02:35:15.663 INFO:tasks.workunit.client.1.smithi161.stdout:1/650: truncate d6/d8/d63/d4d/d31/d73/fb7 3830148 0 2023-12-09T02:35:15.665 INFO:tasks.workunit.client.1.smithi161.stdout:5/516: write d0/f1 [942715,69821] 0 2023-12-09T02:35:15.667 INFO:tasks.workunit.client.1.smithi161.stdout:4/653: creat dd/d36/d4a/d5f/dc7/fcf x:0 0 0 2023-12-09T02:35:15.667 INFO:tasks.workunit.client.1.smithi161.stdout:4/654: stat dd/d36/d4a/f84 0 2023-12-09T02:35:15.667 INFO:tasks.workunit.client.1.smithi161.stdout:1/651: dread d6/d8/d63/d1c/d8a/fae [0,4194304] 0 2023-12-09T02:35:15.669 INFO:tasks.workunit.client.1.smithi161.stdout:3/458: symlink d2/d51/d75/d11/d1f/d2a/l7e 0 2023-12-09T02:35:15.669 INFO:tasks.workunit.client.1.smithi161.stdout:3/459: truncate d2/d51/d75/d11/d1f/d2a/d46/d5e/f79 948315 0 2023-12-09T02:35:15.673 INFO:tasks.workunit.client.1.smithi161.stdout:5/517: symlink d0/d2/d7/lb2 0 2023-12-09T02:35:15.673 INFO:tasks.workunit.client.1.smithi161.stdout:5/518: dread - d0/d2/de/d22/faa zero size 2023-12-09T02:35:15.673 INFO:tasks.workunit.client.1.smithi161.stdout:5/519: truncate d0/d2/d7/d51/f7e 637966 0 2023-12-09T02:35:15.674 INFO:tasks.workunit.client.1.smithi161.stdout:5/520: chown d0/d2/d7/d9a 28329956 1 2023-12-09T02:35:15.675 INFO:tasks.workunit.client.1.smithi161.stdout:4/655: write dd/d36/d4a/f84 [458191,37871] 0 2023-12-09T02:35:15.677 INFO:tasks.workunit.client.1.smithi161.stdout:6/511: dwrite da/d28/d4d/d5e/f98 [4194304,4194304] 0 2023-12-09T02:35:15.691 INFO:tasks.workunit.client.1.smithi161.stdout:1/652: dwrite d6/d8/d63/d1c/d8a/fae [0,4194304] 0 2023-12-09T02:35:15.691 INFO:tasks.workunit.client.1.smithi161.stdout:3/460: dwrite d2/d51/d75/d11/d28/f22 [0,4194304] 0 2023-12-09T02:35:15.691 INFO:tasks.workunit.client.1.smithi161.stdout:1/653: write f5 [1079094,98339] 0 2023-12-09T02:35:15.691 INFO:tasks.workunit.client.1.smithi161.stdout:1/654: readlink d6/d9/d8b/lc0 0 2023-12-09T02:35:15.696 INFO:tasks.workunit.client.1.smithi161.stdout:9/501: rename d2/d25/d3a to d2/d25/db1 0 2023-12-09T02:35:15.696 INFO:tasks.workunit.client.1.smithi161.stdout:9/502: dread - d2/d25/db1/f8e zero size 2023-12-09T02:35:15.697 INFO:tasks.workunit.client.1.smithi161.stdout:4/656: dwrite dd/d1a/d23/f9f [0,4194304] 0 2023-12-09T02:35:15.705 INFO:tasks.workunit.client.1.smithi161.stdout:3/461: creat d2/d37/f7f x:0 0 0 2023-12-09T02:35:15.711 INFO:tasks.workunit.client.1.smithi161.stdout:1/655: creat d6/d9/d5c/fd8 x:0 0 0 2023-12-09T02:35:15.711 INFO:tasks.workunit.client.1.smithi161.stdout:1/656: fsync d6/d8/d63/d4d/d31/d73/d47/db2/fd3 0 2023-12-09T02:35:15.711 INFO:tasks.workunit.client.1.smithi161.stdout:1/657: write d6/d8/d63/fcc [177114,98373] 0 2023-12-09T02:35:15.721 INFO:tasks.workunit.client.1.smithi161.stdout:9/503: dwrite d2/f3e [0,4194304] 0 2023-12-09T02:35:15.721 INFO:tasks.workunit.client.1.smithi161.stdout:4/657: dwrite dd/d36/d4a/d5f/fba [0,4194304] 0 2023-12-09T02:35:15.727 INFO:tasks.workunit.client.1.smithi161.stdout:3/462: symlink d2/d51/d75/l80 0 2023-12-09T02:35:15.732 INFO:tasks.workunit.client.1.smithi161.stdout:4/658: mkdir dd/d1a/d1d/d25/d32/dd0 0 2023-12-09T02:35:15.732 INFO:tasks.workunit.client.1.smithi161.stdout:4/659: chown dd/d1a/d1e/f4f 795542 1 2023-12-09T02:35:15.732 INFO:tasks.workunit.client.1.smithi161.stdout:3/463: write d2/d51/d75/d11/d1f/d2a/f2f [110037,84476] 0 2023-12-09T02:35:15.732 INFO:tasks.workunit.client.1.smithi161.stdout:3/464: stat d2/f72 0 2023-12-09T02:35:15.732 INFO:tasks.workunit.client.1.smithi161.stdout:3/465: fdatasync d2/d51/d75/f18 0 2023-12-09T02:35:15.734 INFO:tasks.workunit.client.1.smithi161.stdout:4/660: mknod dd/d36/d4a/d5f/d65/cd1 0 2023-12-09T02:35:15.734 INFO:tasks.workunit.client.1.smithi161.stdout:4/661: chown f9 291006036 1 2023-12-09T02:35:15.737 INFO:tasks.workunit.client.1.smithi161.stdout:4/662: write dd/d1a/d29/f5d [4109785,97076] 0 2023-12-09T02:35:15.738 INFO:tasks.workunit.client.1.smithi161.stdout:4/663: fsync dd/d36/d4a/d88/fa0 0 2023-12-09T02:35:15.738 INFO:tasks.workunit.client.1.smithi161.stdout:9/504: dwrite d2/d25/db1/d65/d42/d58/f21 [0,4194304] 0 2023-12-09T02:35:15.738 INFO:tasks.workunit.client.1.smithi161.stdout:9/505: dread - d2/d25/db1/d65/d42/d58/d91/d2e/d80/fa2 zero size 2023-12-09T02:35:15.738 INFO:tasks.workunit.client.1.smithi161.stdout:9/506: write d2/d25/db1/f8e [218070,21173] 0 2023-12-09T02:35:15.738 INFO:tasks.workunit.client.1.smithi161.stdout:9/507: stat d2/d25/db1/d65/d5c/d55/d66 0 2023-12-09T02:35:15.738 INFO:tasks.workunit.client.1.smithi161.stdout:4/664: write dd/d36/d3f/f43 [1181999,48980] 0 2023-12-09T02:35:15.741 INFO:tasks.workunit.client.1.smithi161.stdout:1/658: dread d6/d8/d63/d4d/d31/fbf [0,4194304] 0 2023-12-09T02:35:15.743 INFO:tasks.workunit.client.1.smithi161.stdout:1/659: symlink d6/d8/d63/d4d/ld9 0 2023-12-09T02:35:15.750 INFO:tasks.workunit.client.1.smithi161.stdout:1/660: link d6/d8/d63/d4d/d31/d73/d47/fa6 d6/d8/fda 0 2023-12-09T02:35:15.755 INFO:tasks.workunit.client.1.smithi161.stdout:3/466: dwrite d2/d51/d75/d11/d19/f2e [0,4194304] 0 2023-12-09T02:35:15.757 INFO:tasks.workunit.client.1.smithi161.stdout:1/661: creat d6/d8/d63/d4d/dd0/fdb x:0 0 0 2023-12-09T02:35:15.760 INFO:tasks.workunit.client.1.smithi161.stdout:3/467: mknod d2/d51/d75/d11/d1f/d2a/c81 0 2023-12-09T02:35:15.761 INFO:tasks.workunit.client.1.smithi161.stdout:9/508: dwrite d2/d25/db1/f7b [0,4194304] 0 2023-12-09T02:35:15.763 INFO:tasks.workunit.client.1.smithi161.stdout:4/665: dwrite dd/f13 [4194304,4194304] 0 2023-12-09T02:35:15.764 INFO:tasks.workunit.client.1.smithi161.stdout:1/662: rename d6/d8/d63/d35 to d6/d8/d63/d4d/d9f/ddc 0 2023-12-09T02:35:15.764 INFO:tasks.workunit.client.1.smithi161.stdout:1/663: write d6/d8/d63/d4d/d31/d73/d47/db2/fd3 [959287,109180] 0 2023-12-09T02:35:15.766 INFO:tasks.workunit.client.1.smithi161.stdout:3/468: link d2/d51/d75/d11/d1f/d2a/f7d d2/f82 0 2023-12-09T02:35:15.769 INFO:tasks.workunit.client.1.smithi161.stdout:9/509: symlink d2/d25/db1/d65/d7c/lb2 0 2023-12-09T02:35:15.770 INFO:tasks.workunit.client.1.smithi161.stdout:4/666: truncate dd/d36/f74 1142156 0 2023-12-09T02:35:15.772 INFO:tasks.workunit.client.1.smithi161.stdout:3/469: symlink d2/d51/d75/d11/d1f/d4c/l83 0 2023-12-09T02:35:15.775 INFO:tasks.workunit.client.1.smithi161.stdout:9/510: write d2/d25/db1/d65/d42/d58/d91/f99 [1025567,63799] 0 2023-12-09T02:35:15.776 INFO:tasks.workunit.client.1.smithi161.stdout:5/521: truncate d0/d2/f3 4048218 0 2023-12-09T02:35:15.777 INFO:tasks.workunit.client.1.smithi161.stdout:3/470: truncate d2/d51/d75/d11/d1f/d2a/d46/f29 1145148 0 2023-12-09T02:35:15.779 INFO:tasks.workunit.client.1.smithi161.stdout:1/664: dread d6/d8/d63/d1c/d8a/dcd/fb5 [0,4194304] 0 2023-12-09T02:35:15.784 INFO:tasks.workunit.client.1.smithi161.stdout:9/511: symlink d2/d25/lb3 0 2023-12-09T02:35:15.784 INFO:tasks.workunit.client.1.smithi161.stdout:9/512: readlink d2/d25/db1/d65/d42/d58/l1c 0 2023-12-09T02:35:15.785 INFO:tasks.workunit.client.1.smithi161.stdout:3/471: creat d2/d51/d75/d11/d19/f84 x:0 0 0 2023-12-09T02:35:15.788 INFO:tasks.workunit.client.1.smithi161.stdout:3/472: truncate d2/d51/d75/d11/f3c 526569 0 2023-12-09T02:35:15.790 INFO:tasks.workunit.client.1.smithi161.stdout:9/513: dread d2/f8 [0,4194304] 0 2023-12-09T02:35:15.791 INFO:tasks.workunit.client.1.smithi161.stdout:9/514: stat d2/d25/db1/d65/d42/d58/f75 0 2023-12-09T02:35:15.792 INFO:tasks.workunit.client.1.smithi161.stdout:3/473: read d2/d37/f4d [8146862,84822] 0 2023-12-09T02:35:15.795 INFO:tasks.workunit.client.1.smithi161.stdout:4/667: dwrite dd/d36/d3f/fa4 [0,4194304] 0 2023-12-09T02:35:15.796 INFO:tasks.workunit.client.1.smithi161.stdout:9/515: rename d2/d25/db1/l5a to d2/d25/db1/d65/d7c/lb4 0 2023-12-09T02:35:15.797 INFO:tasks.workunit.client.1.smithi161.stdout:3/474: creat d2/d51/d75/d11/d7b/f85 x:0 0 0 2023-12-09T02:35:15.797 INFO:tasks.workunit.client.1.smithi161.stdout:3/475: fdatasync d2/d51/d75/f36 0 2023-12-09T02:35:15.797 INFO:tasks.workunit.client.1.smithi161.stdout:3/476: fsync d2/d51/d75/d11/d5a/f76 0 2023-12-09T02:35:15.798 INFO:tasks.workunit.client.1.smithi161.stdout:4/668: mkdir dd/d5a/dd2 0 2023-12-09T02:35:15.801 INFO:tasks.workunit.client.1.smithi161.stdout:3/477: mknod d2/d51/d75/d50/d69/c86 0 2023-12-09T02:35:15.802 INFO:tasks.workunit.client.1.smithi161.stdout:9/516: dread d2/d25/db1/d65/d42/d58/d91/d2e/f40 [0,4194304] 0 2023-12-09T02:35:15.802 INFO:tasks.workunit.client.1.smithi161.stdout:5/522: dwrite d0/d2/de/d22/d8e/d8f/fab [0,4194304] 0 2023-12-09T02:35:15.815 INFO:tasks.workunit.client.1.smithi161.stdout:5/523: creat d0/d2/d7/d51/fb3 x:0 0 0 2023-12-09T02:35:15.817 INFO:tasks.workunit.client.1.smithi161.stdout:9/517: rename d2/d25/db1/d65/d42/d58/d91/d2e/d3f/c53 to d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/d8f/cb5 0 2023-12-09T02:35:15.817 INFO:tasks.workunit.client.1.smithi161.stdout:9/518: fsync d2/d25/db1/d65/d88/f9b 0 2023-12-09T02:35:15.820 INFO:tasks.workunit.client.1.smithi161.stdout:5/524: creat d0/d2/d7/d11/d61/fb4 x:0 0 0 2023-12-09T02:35:15.820 INFO:tasks.workunit.client.1.smithi161.stdout:5/525: write d0/d2/d7/d11/f35 [153532,73223] 0 2023-12-09T02:35:15.821 INFO:tasks.workunit.client.1.smithi161.stdout:5/526: read d0/d1f/f23 [157212,101995] 0 2023-12-09T02:35:15.821 INFO:tasks.workunit.client.1.smithi161.stdout:5/527: truncate d0/d2/de/d22/d8e/d8f/fb1 859024 0 2023-12-09T02:35:15.822 INFO:tasks.workunit.client.1.smithi161.stdout:9/519: mknod d2/d25/db1/cb6 0 2023-12-09T02:35:15.823 INFO:tasks.workunit.client.1.smithi161.stdout:3/478: rmdir d2/d44 0 2023-12-09T02:35:15.831 INFO:tasks.workunit.client.1.smithi161.stdout:3/479: link d2/d51/d75/f18 d2/d51/d75/d11/d7b/f87 0 2023-12-09T02:35:15.832 INFO:tasks.workunit.client.1.smithi161.stdout:5/528: dread d0/f18 [0,4194304] 0 2023-12-09T02:35:15.835 INFO:tasks.workunit.client.1.smithi161.stdout:5/529: symlink d0/d2/de/d44/da6/lb5 0 2023-12-09T02:35:15.844 INFO:tasks.workunit.client.1.smithi161.stdout:3/480: dread d2/d51/d75/d11/d1f/d2a/d46/d40/f6d [0,4194304] 0 2023-12-09T02:35:15.850 INFO:tasks.workunit.client.1.smithi161.stdout:3/481: getdents d2/d51/d75/d11/d1f/d2a/d46 0 2023-12-09T02:35:15.853 INFO:tasks.workunit.client.1.smithi161.stdout:3/482: mknod d2/d51/d75/d11/c88 0 2023-12-09T02:35:15.859 INFO:tasks.workunit.client.1.smithi161.stdout:3/483: rmdir d2/d51/d75/d50 39 2023-12-09T02:35:15.859 INFO:tasks.workunit.client.1.smithi161.stdout:3/484: chown d2/c39 1339378 1 2023-12-09T02:35:15.860 INFO:tasks.workunit.client.1.smithi161.stdout:3/485: chown d2/d51/d75/d11/d1f/d2a 3947 1 2023-12-09T02:35:15.860 INFO:tasks.workunit.client.1.smithi161.stdout:3/486: stat d2/d51/d75/d11/d28/l48 0 2023-12-09T02:35:15.865 INFO:tasks.workunit.client.1.smithi161.stdout:3/487: rename d2/l30 to d2/d51/d75/d11/d1f/d2a/d46/d2d/d4e/l89 0 2023-12-09T02:35:15.867 INFO:tasks.workunit.client.1.smithi161.stdout:3/488: dread d2/d51/d75/d11/d1f/d2a/d46/f54 [0,4194304] 0 2023-12-09T02:35:15.879 INFO:tasks.workunit.client.1.smithi161.stdout:3/489: truncate d2/d51/d75/d11/d1f/d2a/d46/d5e/f73 1690887 0 2023-12-09T02:35:15.884 INFO:tasks.workunit.client.1.smithi161.stdout:3/490: rename d2/d51/d75/d11/d28/f22 to d2/d51/d75/d11/d28/f8a 0 2023-12-09T02:35:15.886 INFO:tasks.workunit.client.1.smithi161.stdout:8/529: sync 2023-12-09T02:35:15.886 INFO:tasks.workunit.client.1.smithi161.stdout:7/565: sync 2023-12-09T02:35:15.886 INFO:tasks.workunit.client.1.smithi161.stdout:0/536: sync 2023-12-09T02:35:15.887 INFO:tasks.workunit.client.1.smithi161.stdout:2/530: sync 2023-12-09T02:35:15.892 INFO:tasks.workunit.client.1.smithi161.stdout:0/537: link d9/d55/d26/d28/d58/c5e d9/dd/d3a/ca6 0 2023-12-09T02:35:15.892 INFO:tasks.workunit.client.1.smithi161.stdout:2/531: creat d4/d16/d69/d8c/fa7 x:0 0 0 2023-12-09T02:35:15.896 INFO:tasks.workunit.client.1.smithi161.stdout:2/532: creat d4/d16/d69/d8c/d87/fa8 x:0 0 0 2023-12-09T02:35:15.896 INFO:tasks.workunit.client.1.smithi161.stdout:2/533: chown d4/d16/c6f 1 1 2023-12-09T02:35:15.896 INFO:tasks.workunit.client.1.smithi161.stdout:2/534: fdatasync d4/d1a/d4a/d4f/f73 0 2023-12-09T02:35:15.898 INFO:tasks.workunit.client.1.smithi161.stdout:7/566: dread d0/d3/f66 [0,4194304] 0 2023-12-09T02:35:15.898 INFO:tasks.workunit.client.1.smithi161.stdout:7/567: stat d0/d3/d13/d4e/db2/l7d 0 2023-12-09T02:35:15.899 INFO:tasks.workunit.client.1.smithi161.stdout:8/530: read d2/f17 [6090844,58810] 0 2023-12-09T02:35:15.922 INFO:tasks.workunit.client.1.smithi161.stdout:6/512: sync 2023-12-09T02:35:15.922 INFO:tasks.workunit.client.1.smithi161.stdout:6/513: stat da/d28/d3c/d46/f87 0 2023-12-09T02:35:15.922 INFO:tasks.workunit.client.1.smithi161.stdout:0/538: dwrite d9/d55/d5a/f95 [0,4194304] 0 2023-12-09T02:35:15.922 INFO:tasks.workunit.client.1.smithi161.stdout:6/514: creat da/d28/d3c/d46/fbc x:0 0 0 2023-12-09T02:35:15.926 INFO:tasks.workunit.client.1.smithi161.stdout:2/535: dwrite d4/f17 [0,4194304] 0 2023-12-09T02:35:15.926 INFO:tasks.workunit.client.1.smithi161.stdout:2/536: readlink d4/d1a/l21 0 2023-12-09T02:35:15.926 INFO:tasks.workunit.client.1.smithi161.stdout:6/515: rmdir da/d28/d29 39 2023-12-09T02:35:15.929 INFO:tasks.workunit.client.1.smithi161.stdout:0/539: rmdir d9/db/d2a/d35/d4a 39 2023-12-09T02:35:15.929 INFO:tasks.workunit.client.1.smithi161.stdout:0/540: stat d9/dd/d71 0 2023-12-09T02:35:15.929 INFO:tasks.workunit.client.1.smithi161.stdout:8/531: dwrite d2/d5/d4f/f2c [4194304,4194304] 0 2023-12-09T02:35:15.931 INFO:tasks.workunit.client.1.smithi161.stdout:8/532: write d2/d5/f14 [1060629,36435] 0 2023-12-09T02:35:15.932 INFO:tasks.workunit.client.1.smithi161.stdout:2/537: creat d4/d16/d69/fa9 x:0 0 0 2023-12-09T02:35:15.933 INFO:tasks.workunit.client.1.smithi161.stdout:0/541: getdents d9/d55/d44 0 2023-12-09T02:35:15.933 INFO:tasks.workunit.client.1.smithi161.stdout:0/542: dread - d9/d55/d7c/f8f zero size 2023-12-09T02:35:15.935 INFO:tasks.workunit.client.1.smithi161.stdout:8/533: mknod d2/d5/d22/d31/caf 0 2023-12-09T02:35:15.938 INFO:tasks.workunit.client.1.smithi161.stdout:2/538: rename d4/d16/d69/d8c/d5a/d86 to d4/d1a/d4a/daa 0 2023-12-09T02:35:15.939 INFO:tasks.workunit.client.1.smithi161.stdout:8/534: creat d2/d5/d22/d31/d38/d66/d88/da1/fb0 x:0 0 0 2023-12-09T02:35:15.940 INFO:tasks.workunit.client.1.smithi161.stdout:2/539: creat d4/d16/d69/d7b/fab x:0 0 0 2023-12-09T02:35:15.942 INFO:tasks.workunit.client.1.smithi161.stdout:8/535: creat d2/fb1 x:0 0 0 2023-12-09T02:35:15.942 INFO:tasks.workunit.client.1.smithi161.stdout:6/516: dwrite da/d55/d6d/fa6 [0,4194304] 0 2023-12-09T02:35:15.942 INFO:tasks.workunit.client.1.smithi161.stdout:6/517: fsync da/df/d2d/f47 0 2023-12-09T02:35:15.944 INFO:tasks.workunit.client.1.smithi161.stdout:0/543: dread d9/d55/d7c/f74 [0,4194304] 0 2023-12-09T02:35:15.946 INFO:tasks.workunit.client.1.smithi161.stdout:6/518: truncate da/df/f14 2623561 0 2023-12-09T02:35:15.957 INFO:tasks.workunit.client.1.smithi161.stdout:2/540: dread d4/d16/d69/d7b/f4e [0,4194304] 0 2023-12-09T02:35:15.961 INFO:tasks.workunit.client.1.smithi161.stdout:2/541: symlink d4/d16/d69/d7b/lac 0 2023-12-09T02:35:15.963 INFO:tasks.workunit.client.1.smithi161.stdout:2/542: dread d4/d7/db/f24 [0,4194304] 0 2023-12-09T02:35:15.963 INFO:tasks.workunit.client.1.smithi161.stdout:2/543: chown d4/c2e 28 1 2023-12-09T02:35:15.963 INFO:tasks.workunit.client.1.smithi161.stdout:2/544: chown d4/d7/f4c 59385770 1 2023-12-09T02:35:15.964 INFO:tasks.workunit.client.1.smithi161.stdout:0/544: dwrite d9/d55/d26/f57 [0,4194304] 0 2023-12-09T02:35:15.964 INFO:tasks.workunit.client.1.smithi161.stdout:0/545: truncate d9/d55/d7c/f8f 660991 0 2023-12-09T02:35:15.965 INFO:tasks.workunit.client.1.smithi161.stdout:0/546: write d9/db/d2a/d35/d4a/f63 [1533915,120667] 0 2023-12-09T02:35:15.966 INFO:tasks.workunit.client.1.smithi161.stdout:0/547: rmdir d9/db/d2a/d35/d4a 39 2023-12-09T02:35:15.975 INFO:tasks.workunit.client.1.smithi161.stdout:6/519: dwrite da/d28/d29/f45 [0,4194304] 0 2023-12-09T02:35:15.976 INFO:tasks.workunit.client.1.smithi161.stdout:2/545: dread d4/d16/d69/d7b/f5c [0,4194304] 0 2023-12-09T02:35:15.980 INFO:tasks.workunit.client.1.smithi161.stdout:2/546: symlink d4/d16/d69/d8c/d87/lad 0 2023-12-09T02:35:15.983 INFO:tasks.workunit.client.1.smithi161.stdout:2/547: mknod d4/d7/cae 0 2023-12-09T02:35:15.983 INFO:tasks.workunit.client.1.smithi161.stdout:2/548: chown d4/d16/d69/c99 115 1 2023-12-09T02:35:15.983 INFO:tasks.workunit.client.1.smithi161.stdout:0/548: dwrite d9/d55/d7c/f73 [0,4194304] 0 2023-12-09T02:35:15.990 INFO:tasks.workunit.client.1.smithi161.stdout:0/549: creat d9/d55/d26/fa7 x:0 0 0 2023-12-09T02:35:15.990 INFO:tasks.workunit.client.1.smithi161.stdout:6/520: dread f9 [0,4194304] 0 2023-12-09T02:35:15.993 INFO:tasks.workunit.client.1.smithi161.stdout:0/550: write d9/d55/d7c/f73 [1503977,9104] 0 2023-12-09T02:35:15.995 INFO:tasks.workunit.client.1.smithi161.stdout:0/551: mknod d9/db/d2a/d9d/ca8 0 2023-12-09T02:35:15.997 INFO:tasks.workunit.client.1.smithi161.stdout:2/549: dwrite d4/d16/f1e [0,4194304] 0 2023-12-09T02:35:15.999 INFO:tasks.workunit.client.1.smithi161.stdout:2/550: creat d4/d16/d69/faf x:0 0 0 2023-12-09T02:35:15.999 INFO:tasks.workunit.client.1.smithi161.stdout:0/552: write d9/d55/d7c/f33 [4281564,109965] 0 2023-12-09T02:35:15.999 INFO:tasks.workunit.client.1.smithi161.stdout:2/551: read d4/d16/d69/fa3 [931960,10229] 0 2023-12-09T02:35:15.999 INFO:tasks.workunit.client.1.smithi161.stdout:2/552: stat d4/d1a/f3f 0 2023-12-09T02:35:16.000 INFO:tasks.workunit.client.1.smithi161.stdout:0/553: creat d9/d55/d7c/d7a/da3/fa9 x:0 0 0 2023-12-09T02:35:16.001 INFO:tasks.workunit.client.1.smithi161.stdout:0/554: write d9/d55/d7c/f73 [4161250,121403] 0 2023-12-09T02:35:16.001 INFO:tasks.workunit.client.1.smithi161.stdout:2/553: rmdir d4/d7 39 2023-12-09T02:35:16.003 INFO:tasks.workunit.client.1.smithi161.stdout:2/554: mknod d4/d7/d8f/cb0 0 2023-12-09T02:35:16.014 INFO:tasks.workunit.client.1.smithi161.stdout:0/555: dread d9/d55/d7c/f74 [0,4194304] 0 2023-12-09T02:35:16.017 INFO:tasks.workunit.client.1.smithi161.stdout:0/556: mkdir d9/d55/d26/d28/daa 0 2023-12-09T02:35:16.017 INFO:tasks.workunit.client.1.smithi161.stdout:0/557: chown d9/f1d 110 1 2023-12-09T02:35:16.017 INFO:tasks.workunit.client.1.smithi161.stdout:0/558: chown d9/c16 5543182 1 2023-12-09T02:35:16.018 INFO:tasks.workunit.client.1.smithi161.stdout:0/559: rmdir d9/db 39 2023-12-09T02:35:16.020 INFO:tasks.workunit.client.1.smithi161.stdout:0/560: write d9/d55/d7c/f2b [224908,87787] 0 2023-12-09T02:35:16.021 INFO:tasks.workunit.client.1.smithi161.stdout:0/561: creat d9/d55/d26/d28/d58/d8e/fab x:0 0 0 2023-12-09T02:35:16.025 INFO:tasks.workunit.client.1.smithi161.stdout:0/562: creat d9/d55/d86/d98/fac x:0 0 0 2023-12-09T02:35:16.039 INFO:tasks.workunit.client.1.smithi161.stdout:0/563: dwrite d9/dd/f80 [0,4194304] 0 2023-12-09T02:35:16.044 INFO:tasks.workunit.client.1.smithi161.stdout:0/564: mknod d9/db/d2a/d35/d7b/cad 0 2023-12-09T02:35:16.047 INFO:tasks.workunit.client.1.smithi161.stdout:0/565: mkdir d9/d55/d44/dae 0 2023-12-09T02:35:16.048 INFO:tasks.workunit.client.1.smithi161.stdout:0/566: write d9/db/f3e [1004648,23954] 0 2023-12-09T02:35:16.059 INFO:tasks.workunit.client.1.smithi161.stdout:1/665: sync 2023-12-09T02:35:16.060 INFO:tasks.workunit.client.1.smithi161.stdout:0/567: dwrite d9/dd/f53 [0,4194304] 0 2023-12-09T02:35:16.061 INFO:tasks.workunit.client.1.smithi161.stdout:1/666: creat d6/d8/d63/d4d/d31/d80/fdd x:0 0 0 2023-12-09T02:35:16.061 INFO:tasks.workunit.client.1.smithi161.stdout:1/667: truncate d6/d8/d63/d4d/d9f/ddc/d3d/dc3/f82 1943454 0 2023-12-09T02:35:16.064 INFO:tasks.workunit.client.1.smithi161.stdout:0/568: symlink d9/d55/d86/d98/laf 0 2023-12-09T02:35:16.064 INFO:tasks.workunit.client.1.smithi161.stdout:0/569: getdents d9/d9c 0 2023-12-09T02:35:16.065 INFO:tasks.workunit.client.1.smithi161.stdout:1/668: mkdir d6/d9/dd4/dde 0 2023-12-09T02:35:16.067 INFO:tasks.workunit.client.1.smithi161.stdout:0/570: rmdir d9/d5b/da5 0 2023-12-09T02:35:16.069 INFO:tasks.workunit.client.1.smithi161.stdout:1/669: creat d6/d8/d63/d4d/d9f/fdf x:0 0 0 2023-12-09T02:35:16.071 INFO:tasks.workunit.client.1.smithi161.stdout:0/571: rmdir d9/d55/d26/d28/d58/d8e 39 2023-12-09T02:35:16.072 INFO:tasks.workunit.client.1.smithi161.stdout:0/572: fsync d9/d55/d26/fa7 0 2023-12-09T02:35:16.074 INFO:tasks.workunit.client.1.smithi161.stdout:1/670: link d6/d8/d63/d4d/d9f/fdf d6/d9/d5c/fe0 0 2023-12-09T02:35:16.084 INFO:tasks.workunit.client.1.smithi161.stdout:0/573: dread d9/d55/d7c/f74 [0,4194304] 0 2023-12-09T02:35:16.091 INFO:tasks.workunit.client.1.smithi161.stdout:0/574: dread d9/db/d2a/fa2 [0,4194304] 0 2023-12-09T02:35:16.092 INFO:tasks.workunit.client.1.smithi161.stdout:0/575: link d9/db/d2a/f59 d9/db/d2a/d9d/fb0 0 2023-12-09T02:35:16.095 INFO:tasks.workunit.client.1.smithi161.stdout:1/671: dwrite d6/d8/d63/d1c/f89 [0,4194304] 0 2023-12-09T02:35:16.098 INFO:tasks.workunit.client.1.smithi161.stdout:1/672: link d6/d8/d63/d4d/d9f/ddc/daa/la8 d6/d8/d68/le1 0 2023-12-09T02:35:16.100 INFO:tasks.workunit.client.1.smithi161.stdout:1/673: creat d6/d8/d63/d93/fe2 x:0 0 0 2023-12-09T02:35:16.102 INFO:tasks.workunit.client.1.smithi161.stdout:1/674: mkdir d6/d8/d63/d4d/d31/d80/d87/de3 0 2023-12-09T02:35:16.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:15 smithi088 ceph-mon[112028]: [09/Dec/2023:02:35:14] ENGINE Bus STARTING 2023-12-09T02:35:16.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:15 smithi088 ceph-mon[112028]: pgmap v4: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail 2023-12-09T02:35:16.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:15 smithi088 ceph-mon[112028]: mgrmap e23: smithi161.qmxtmg(active, since 2s) 2023-12-09T02:35:16.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:15 smithi088 ceph-mon[112028]: [09/Dec/2023:02:35:15] ENGINE Serving on http://172.21.15.161:8765 2023-12-09T02:35:16.255 INFO:tasks.workunit.client.1.smithi161.stdout:9/520: sync 2023-12-09T02:35:16.256 INFO:tasks.workunit.client.1.smithi161.stdout:4/669: sync 2023-12-09T02:35:16.256 INFO:tasks.workunit.client.1.smithi161.stdout:4/670: chown dd/d1a/d29/c39 21853 1 2023-12-09T02:35:16.256 INFO:tasks.workunit.client.1.smithi161.stdout:9/521: read d2/d25/db1/d65/d42/f4c [477377,40361] 0 2023-12-09T02:35:16.256 INFO:tasks.workunit.client.1.smithi161.stdout:9/522: dread d2/d25/db1/d65/d42/d58/d22/f9f [0,4194304] 0 2023-12-09T02:35:16.256 INFO:tasks.workunit.client.1.smithi161.stdout:9/523: chown d2/d25/db1/d65/fa8 36155 1 2023-12-09T02:35:16.259 INFO:tasks.workunit.client.1.smithi161.stdout:4/671: write dd/d1a/d23/f9f [3167628,2784] 0 2023-12-09T02:35:16.263 INFO:tasks.workunit.client.1.smithi161.stdout:4/672: rmdir dd/d1a/d1d 39 2023-12-09T02:35:16.263 INFO:tasks.workunit.client.1.smithi161.stdout:9/524: dread d2/d25/db1/d65/fa8 [0,4194304] 0 2023-12-09T02:35:16.264 INFO:tasks.workunit.client.1.smithi161.stdout:9/525: readlink d2/d25/db1/d65/d42/d58/d91/d39/l94 0 2023-12-09T02:35:16.264 INFO:tasks.workunit.client.1.smithi161.stdout:9/526: dread d2/d25/db1/d65/d42/f4c [0,4194304] 0 2023-12-09T02:35:16.264 INFO:tasks.workunit.client.1.smithi161.stdout:9/527: fdatasync d2/d25/db1/d65/d42/d58/d91/d2e/f40 0 2023-12-09T02:35:16.266 INFO:tasks.workunit.client.1.smithi161.stdout:4/673: symlink dd/d1a/d1d/d25/d32/d58/ld3 0 2023-12-09T02:35:16.270 INFO:tasks.workunit.client.1.smithi161.stdout:9/528: mknod d2/d25/cb7 0 2023-12-09T02:35:16.271 INFO:tasks.workunit.client.1.smithi161.stdout:9/529: readlink d2/d25/db1/d65/d5c/d55/d66/la3 0 2023-12-09T02:35:16.285 INFO:tasks.workunit.client.1.smithi161.stdout:4/674: dread dd/d36/d3f/d54/f68 [0,4194304] 0 2023-12-09T02:35:16.290 INFO:tasks.workunit.client.1.smithi161.stdout:9/530: dwrite d2/d25/db1/fa0 [0,4194304] 0 2023-12-09T02:35:16.364 INFO:tasks.workunit.client.1.smithi161.stdout:4/675: creat dd/d5a/dd2/fd4 x:0 0 0 2023-12-09T02:35:16.370 INFO:tasks.workunit.client.1.smithi161.stdout:9/531: mkdir d2/d25/db1/d65/d42/d58/d91/d2e/db8 0 2023-12-09T02:35:16.370 INFO:tasks.workunit.client.1.smithi161.stdout:9/532: readlink d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/l77 0 2023-12-09T02:35:16.391 INFO:tasks.workunit.client.1.smithi161.stdout:9/533: dwrite d2/d25/db1/d65/f43 [0,4194304] 0 2023-12-09T02:35:16.391 INFO:tasks.workunit.client.1.smithi161.stdout:9/534: fdatasync d2/d25/db1/d65/d5c/d60/d7f/f89 0 2023-12-09T02:35:16.391 INFO:tasks.workunit.client.1.smithi161.stdout:9/535: write d2/d25/db1/d4d/d7d/faf [46551,13851] 0 2023-12-09T02:35:16.392 INFO:tasks.workunit.client.1.smithi161.stdout:9/536: creat d2/d25/db1/d65/d5c/dac/fb9 x:0 0 0 2023-12-09T02:35:16.392 INFO:tasks.workunit.client.1.smithi161.stdout:4/676: dwrite dd/d1a/d29/f37 [0,4194304] 0 2023-12-09T02:35:16.393 INFO:tasks.workunit.client.1.smithi161.stdout:4/677: write dd/d1a/f1c [1603129,124372] 0 2023-12-09T02:35:16.393 INFO:tasks.workunit.client.1.smithi161.stdout:9/537: truncate d2/d25/db1/d65/d42/d58/d91/d51/f6b 895799 0 2023-12-09T02:35:16.394 INFO:tasks.workunit.client.1.smithi161.stdout:9/538: symlink d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/lba 0 2023-12-09T02:35:16.394 INFO:tasks.workunit.client.1.smithi161.stdout:9/539: write d2/d25/db1/d65/d42/f4c [485986,25334] 0 2023-12-09T02:35:16.396 INFO:tasks.workunit.client.1.smithi161.stdout:4/678: mknod dd/d1a/d23/cd5 0 2023-12-09T02:35:16.398 INFO:tasks.workunit.client.1.smithi161.stdout:9/540: link d2/d25/db1/d65/d42/d58/d91/f86 d2/d25/db1/d4d/d7d/fbb 0 2023-12-09T02:35:16.398 INFO:tasks.workunit.client.1.smithi161.stdout:9/541: truncate d2/d25/db1/d4d/d7d/fbb 413586 0 2023-12-09T02:35:16.399 INFO:tasks.workunit.client.1.smithi161.stdout:4/679: symlink dd/d1a/d1e/ld6 0 2023-12-09T02:35:16.399 INFO:tasks.workunit.client.1.smithi161.stdout:9/542: write d2/d25/db1/d65/d42/d58/d22/f9f [358958,12944] 0 2023-12-09T02:35:16.402 INFO:tasks.workunit.client.1.smithi161.stdout:4/680: unlink dd/d36/d4a/d5f/d65/cd1 0 2023-12-09T02:35:16.403 INFO:tasks.workunit.client.1.smithi161.stdout:9/543: creat d2/d25/db1/d65/d5c/d55/d66/fbc x:0 0 0 2023-12-09T02:35:16.406 INFO:tasks.workunit.client.1.smithi161.stdout:4/681: creat dd/d36/d4a/d88/d8a/db3/fd7 x:0 0 0 2023-12-09T02:35:16.406 INFO:tasks.workunit.client.1.smithi161.stdout:4/682: fsync f7 0 2023-12-09T02:35:16.406 INFO:tasks.workunit.client.1.smithi161.stdout:4/683: truncate dd/fe 4915799 0 2023-12-09T02:35:16.406 INFO:tasks.workunit.client.1.smithi161.stdout:4/684: getdents dd/d1a/d1d/d25/d32/dd0 0 2023-12-09T02:35:16.406 INFO:tasks.workunit.client.1.smithi161.stdout:4/685: read dd/d1a/d1d/d25/d32/f41 [3576053,47433] 0 2023-12-09T02:35:16.406 INFO:tasks.workunit.client.1.smithi161.stdout:4/686: readlink dd/d36/d4a/d88/d8a/lb8 0 2023-12-09T02:35:16.410 INFO:tasks.workunit.client.1.smithi161.stdout:4/687: creat dd/d1a/d1d/d25/d3a/fd8 x:0 0 0 2023-12-09T02:35:16.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:15 smithi161 ceph-mon[121170]: [09/Dec/2023:02:35:14] ENGINE Bus STARTING 2023-12-09T02:35:16.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:15 smithi161 ceph-mon[121170]: pgmap v4: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail 2023-12-09T02:35:16.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:15 smithi161 ceph-mon[121170]: mgrmap e23: smithi161.qmxtmg(active, since 2s) 2023-12-09T02:35:16.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:15 smithi161 ceph-mon[121170]: [09/Dec/2023:02:35:15] ENGINE Serving on http://172.21.15.161:8765 2023-12-09T02:35:16.430 INFO:tasks.workunit.client.1.smithi161.stdout:5/530: sync 2023-12-09T02:35:16.431 INFO:tasks.workunit.client.1.smithi161.stdout:4/688: dwrite dd/d1a/d1d/d25/d32/f41 [0,4194304] 0 2023-12-09T02:35:16.431 INFO:tasks.workunit.client.1.smithi161.stdout:5/531: mkdir d0/d2/d7/d70/db6 0 2023-12-09T02:35:16.434 INFO:tasks.workunit.client.1.smithi161.stdout:4/689: mknod dd/d36/d4a/d88/d8a/cd9 0 2023-12-09T02:35:16.438 INFO:tasks.workunit.client.1.smithi161.stdout:4/690: rmdir dd/d36/d4a/d5f 39 2023-12-09T02:35:16.438 INFO:tasks.workunit.client.1.smithi161.stdout:4/691: chown dd/d1a/d1d/d25/d3a 507952 1 2023-12-09T02:35:16.442 INFO:tasks.workunit.client.1.smithi161.stdout:4/692: rename f8 to dd/d1a/d1d/fda 0 2023-12-09T02:35:16.445 INFO:tasks.workunit.client.1.smithi161.stdout:4/693: mkdir dd/d5a/ddb 0 2023-12-09T02:35:16.445 INFO:tasks.workunit.client.1.smithi161.stdout:4/694: dread - dd/d1a/d1d/f8e zero size 2023-12-09T02:35:16.445 INFO:tasks.workunit.client.1.smithi161.stdout:5/532: dwrite d0/d2/d7/f39 [0,4194304] 0 2023-12-09T02:35:16.448 INFO:tasks.workunit.client.1.smithi161.stdout:5/533: mkdir d0/d2/d7/df/d60/da8/db7 0 2023-12-09T02:35:16.449 INFO:tasks.workunit.client.1.smithi161.stdout:5/534: symlink d0/d2/d7/d11/d61/lb8 0 2023-12-09T02:35:16.450 INFO:tasks.workunit.client.1.smithi161.stdout:5/535: creat d0/d2/d7/d11/d50/fb9 x:0 0 0 2023-12-09T02:35:16.450 INFO:tasks.workunit.client.1.smithi161.stdout:5/536: write d0/d2/f7a [85029,48177] 0 2023-12-09T02:35:16.453 INFO:tasks.workunit.client.1.smithi161.stdout:5/537: fsync d0/d2/f7a 0 2023-12-09T02:35:16.454 INFO:tasks.workunit.client.1.smithi161.stdout:4/695: dread dd/d36/d3f/fc1 [0,4194304] 0 2023-12-09T02:35:16.456 INFO:tasks.workunit.client.1.smithi161.stdout:5/538: link d0/d2/de/d22/faa d0/d2/d7/df/d60/da8/fba 0 2023-12-09T02:35:16.457 INFO:tasks.workunit.client.1.smithi161.stdout:5/539: symlink d0/d2/de/d44/da6/lbb 0 2023-12-09T02:35:16.459 INFO:tasks.workunit.client.1.smithi161.stdout:5/540: truncate d0/d2/de/d21/f73 789610 0 2023-12-09T02:35:16.459 INFO:tasks.workunit.client.1.smithi161.stdout:5/541: readlink d0/d2/de/d22/l87 0 2023-12-09T02:35:16.459 INFO:tasks.workunit.client.1.smithi161.stdout:5/542: write d0/d1f/f42 [2218208,74298] 0 2023-12-09T02:35:16.459 INFO:tasks.workunit.client.1.smithi161.stdout:5/543: dread - d0/d2/d7/d11/d50/fb9 zero size 2023-12-09T02:35:16.459 INFO:tasks.workunit.client.1.smithi161.stdout:5/544: creat d0/d9/fbc x:0 0 0 2023-12-09T02:35:16.460 INFO:tasks.workunit.client.1.smithi161.stdout:5/545: write d0/f27 [2126931,83286] 0 2023-12-09T02:35:16.462 INFO:tasks.workunit.client.1.smithi161.stdout:5/546: symlink d0/d2/d7/df/d60/lbd 0 2023-12-09T02:35:16.464 INFO:tasks.workunit.client.1.smithi161.stdout:5/547: unlink d0/d2/de/d21/l26 0 2023-12-09T02:35:16.466 INFO:tasks.workunit.client.1.smithi161.stdout:5/548: dread d0/d2/d7/df/f96 [0,4194304] 0 2023-12-09T02:35:16.468 INFO:tasks.workunit.client.1.smithi161.stdout:5/549: creat d0/d2/de/d22/d55/fbe x:0 0 0 2023-12-09T02:35:16.469 INFO:tasks.workunit.client.1.smithi161.stdout:5/550: creat d0/d2/d7/df/d60/fbf x:0 0 0 2023-12-09T02:35:16.472 INFO:tasks.workunit.client.1.smithi161.stdout:5/551: creat d0/d2/d5f/fc0 x:0 0 0 2023-12-09T02:35:16.472 INFO:tasks.workunit.client.1.smithi161.stdout:5/552: write d0/f1a [4603396,111032] 0 2023-12-09T02:35:16.472 INFO:tasks.workunit.client.1.smithi161.stdout:5/553: chown d0/d1f/f65 3177901 1 2023-12-09T02:35:16.473 INFO:tasks.workunit.client.1.smithi161.stdout:5/554: truncate d0/d2/d7/d51/f7e 827780 0 2023-12-09T02:35:16.484 INFO:tasks.workunit.client.1.smithi161.stdout:5/555: dread d0/d1f/f65 [0,4194304] 0 2023-12-09T02:35:16.485 INFO:tasks.workunit.client.1.smithi161.stdout:5/556: getdents d0/d9 0 2023-12-09T02:35:16.486 INFO:tasks.workunit.client.1.smithi161.stdout:5/557: rename d0/f1 to d0/d1f/fc1 0 2023-12-09T02:35:16.499 INFO:tasks.workunit.client.1.smithi161.stdout:5/558: dwrite d0/d2/d7/df/d60/f95 [0,4194304] 0 2023-12-09T02:35:16.502 INFO:tasks.workunit.client.1.smithi161.stdout:5/559: rename d0/d2/f90 to d0/d2/d7/df/d60/da8/fc2 0 2023-12-09T02:35:16.506 INFO:tasks.workunit.client.1.smithi161.stdout:5/560: rename d0/d2/d7/d70 to d0/d2/d7/d11/dc3 0 2023-12-09T02:35:16.612 INFO:tasks.workunit.client.1.smithi161.stdout:3/491: sync 2023-12-09T02:35:16.612 INFO:tasks.workunit.client.1.smithi161.stdout:6/521: sync 2023-12-09T02:35:16.612 INFO:tasks.workunit.client.1.smithi161.stdout:7/568: sync 2023-12-09T02:35:16.612 INFO:tasks.workunit.client.1.smithi161.stdout:8/536: sync 2023-12-09T02:35:16.612 INFO:tasks.workunit.client.1.smithi161.stdout:6/522: truncate da/d28/d4d/d5e/f89 120884 0 2023-12-09T02:35:16.612 INFO:tasks.workunit.client.1.smithi161.stdout:3/492: write d2/d51/d75/d11/d1f/d2a/d46/d2d/d47/f60 [781786,42764] 0 2023-12-09T02:35:16.613 INFO:tasks.workunit.client.1.smithi161.stdout:3/493: chown d2/d51/d75/d11/d1f/d2a/d46/d2d 289 1 2023-12-09T02:35:16.613 INFO:tasks.workunit.client.1.smithi161.stdout:6/523: write da/d28/d29/d2b/d31/d33/f5b [4401006,70596] 0 2023-12-09T02:35:16.614 INFO:tasks.workunit.client.1.smithi161.stdout:3/494: creat d2/d51/d75/d11/d1f/d2a/d46/d2d/d47/f8b x:0 0 0 2023-12-09T02:35:16.614 INFO:tasks.workunit.client.1.smithi161.stdout:3/495: write d2/d37/f71 [905425,128949] 0 2023-12-09T02:35:16.614 INFO:tasks.workunit.client.1.smithi161.stdout:3/496: truncate d2/d51/d75/d11/d1f/d2a/f63 1007095 0 2023-12-09T02:35:16.614 INFO:tasks.workunit.client.1.smithi161.stdout:3/497: fsync d2/d51/d75/d11/d1f/d2a/d46/d40/f58 0 2023-12-09T02:35:16.614 INFO:tasks.workunit.client.1.smithi161.stdout:3/498: fsync d2/d51/d75/d11/d1f/d2a/f2f 0 2023-12-09T02:35:16.614 INFO:tasks.workunit.client.1.smithi161.stdout:3/499: chown d2/d51/d75/d11/d5a/f67 69 1 2023-12-09T02:35:16.614 INFO:tasks.workunit.client.1.smithi161.stdout:3/500: write d2/d51/d75/d11/d1f/d2a/d46/d2d/d47/f8b [402262,57498] 0 2023-12-09T02:35:16.614 INFO:tasks.workunit.client.1.smithi161.stdout:3/501: write d2/d51/d75/d11/f3c [269607,28414] 0 2023-12-09T02:35:16.622 INFO:tasks.workunit.client.1.smithi161.stdout:6/524: getdents da/d28/d29 0 2023-12-09T02:35:16.624 INFO:tasks.workunit.client.1.smithi161.stdout:3/502: mkdir d2/d51/d75/d11/d1f/d2a/d46/d2d/d47/d8c 0 2023-12-09T02:35:16.626 INFO:tasks.workunit.client.1.smithi161.stdout:6/525: creat da/d55/fbd x:0 0 0 2023-12-09T02:35:16.626 INFO:tasks.workunit.client.1.smithi161.stdout:7/569: dwrite d0/d3/d9e/d59/f6d [0,4194304] 0 2023-12-09T02:35:16.627 INFO:tasks.workunit.client.1.smithi161.stdout:6/526: dread da/d28/d77/d79/f5c [0,4194304] 0 2023-12-09T02:35:16.627 INFO:tasks.workunit.client.1.smithi161.stdout:3/503: rename d2/d51/d75/d11/d1f/d2a/d46/f57 to d2/d51/d75/d11/f8d 0 2023-12-09T02:35:16.627 INFO:tasks.workunit.client.1.smithi161.stdout:7/570: getdents d0/d3/d13/d2d/d43 0 2023-12-09T02:35:16.628 INFO:tasks.workunit.client.1.smithi161.stdout:3/504: dread d2/d51/d75/d11/d1f/d2a/d46/d5e/f79 [0,4194304] 0 2023-12-09T02:35:16.628 INFO:tasks.workunit.client.1.smithi161.stdout:3/505: chown d2/d51/d75/d11/d1f/d2a/d46/d40/f6d 1277311 1 2023-12-09T02:35:16.629 INFO:tasks.workunit.client.1.smithi161.stdout:6/527: mknod da/d28/d77/d79/cbe 0 2023-12-09T02:35:16.630 INFO:tasks.workunit.client.1.smithi161.stdout:7/571: creat d0/d3/d9e/fb9 x:0 0 0 2023-12-09T02:35:16.631 INFO:tasks.workunit.client.1.smithi161.stdout:3/506: symlink d2/d51/d75/d11/d1f/d2a/l8e 0 2023-12-09T02:35:16.634 INFO:tasks.workunit.client.1.smithi161.stdout:7/572: read d0/d3/d13/d1b/f2b [4313546,15024] 0 2023-12-09T02:35:16.638 INFO:tasks.workunit.client.1.smithi161.stdout:6/528: dread da/df/d2d/f47 [0,4194304] 0 2023-12-09T02:35:16.638 INFO:tasks.workunit.client.1.smithi161.stdout:6/529: readlink da/d28/d29/d92/l96 0 2023-12-09T02:35:16.643 INFO:tasks.workunit.client.1.smithi161.stdout:7/573: dread d0/d3/f8 [0,4194304] 0 2023-12-09T02:35:16.643 INFO:tasks.workunit.client.1.smithi161.stdout:7/574: chown d0/d3/d13/d4e/d70 2682 1 2023-12-09T02:35:16.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/530: dwrite da/df/f7d [0,4194304] 0 2023-12-09T02:35:16.667 INFO:tasks.workunit.client.1.smithi161.stdout:7/575: dwrite d0/d3/d13/d2d/f45 [0,4194304] 0 2023-12-09T02:35:16.671 INFO:tasks.workunit.client.1.smithi161.stdout:7/576: mknod d0/d3/d13/d2d/d43/dab/cba 0 2023-12-09T02:35:16.672 INFO:tasks.workunit.client.1.smithi161.stdout:7/577: fsync d0/d3/d13/d4e/db5/d83/f95 0 2023-12-09T02:35:16.672 INFO:tasks.workunit.client.1.smithi161.stdout:6/531: dread da/d28/d77/f9a [0,4194304] 0 2023-12-09T02:35:16.673 INFO:tasks.workunit.client.1.smithi161.stdout:7/578: unlink d0/d3/d13/d2d/d43/d4b/f85 0 2023-12-09T02:35:16.673 INFO:tasks.workunit.client.1.smithi161.stdout:7/579: write d0/d3/d9e/f82 [756650,107114] 0 2023-12-09T02:35:16.676 INFO:tasks.workunit.client.1.smithi161.stdout:6/532: mkdir da/d19/d20/dbf 0 2023-12-09T02:35:16.676 INFO:tasks.workunit.client.1.smithi161.stdout:6/533: write da/d28/d29/f58 [1203093,22208] 0 2023-12-09T02:35:16.676 INFO:tasks.workunit.client.1.smithi161.stdout:7/580: mknod d0/d3/d13/d4e/db2/cbb 0 2023-12-09T02:35:16.683 INFO:tasks.workunit.client.1.smithi161.stdout:7/581: rename d0/d3/c11 to d0/d3/d13/d2d/d43/d4b/d99/cbc 0 2023-12-09T02:35:16.683 INFO:tasks.workunit.client.1.smithi161.stdout:7/582: chown d0/d3/d21/d54/d91/c72 2028503 1 2023-12-09T02:35:16.686 INFO:tasks.workunit.client.1.smithi161.stdout:6/534: dread da/d19/f24 [0,4194304] 0 2023-12-09T02:35:16.692 INFO:tasks.workunit.client.1.smithi161.stdout:6/535: rename da/d55/dbb to da/d28/d29/d2b/db4/dc0 0 2023-12-09T02:35:16.692 INFO:tasks.workunit.client.1.smithi161.stdout:6/536: readlink da/d28/d29/d2b/d31/d33/d39/l3d 0 2023-12-09T02:35:16.699 INFO:tasks.workunit.client.1.smithi161.stdout:6/537: write da/df/d2d/f47 [8336273,68200] 0 2023-12-09T02:35:16.706 INFO:tasks.workunit.client.1.smithi161.stdout:6/538: write da/d55/d6d/f75 [257819,47144] 0 2023-12-09T02:35:16.706 INFO:tasks.workunit.client.1.smithi161.stdout:6/539: fdatasync da/d19/d20/fb7 0 2023-12-09T02:35:16.707 INFO:tasks.workunit.client.1.smithi161.stdout:7/583: dwrite d0/d3/d13/d2d/d43/dab/f5c [0,4194304] 0 2023-12-09T02:35:16.713 INFO:tasks.workunit.client.1.smithi161.stdout:6/540: fdatasync da/d28/d29/f58 0 2023-12-09T02:35:16.714 INFO:tasks.workunit.client.1.smithi161.stdout:7/584: symlink d0/d3/d13/d2d/d43/lbd 0 2023-12-09T02:35:16.714 INFO:tasks.workunit.client.1.smithi161.stdout:7/585: chown d0/d3/d13/d2d/d43/d4b/d99/c9f 1391196 1 2023-12-09T02:35:16.718 INFO:tasks.workunit.client.1.smithi161.stdout:6/541: unlink da/d28/d3c/d46/f48 0 2023-12-09T02:35:16.722 INFO:tasks.workunit.client.1.smithi161.stdout:7/586: mkdir d0/d3/d6c/dbe 0 2023-12-09T02:35:16.723 INFO:tasks.workunit.client.1.smithi161.stdout:7/587: write d0/d3/d9e/d59/d5e/f84 [212494,90802] 0 2023-12-09T02:35:16.725 INFO:tasks.workunit.client.1.smithi161.stdout:7/588: getdents d0/d49 0 2023-12-09T02:35:16.727 INFO:tasks.workunit.client.1.smithi161.stdout:7/589: mkdir d0/d3/d13/dbf 0 2023-12-09T02:35:16.890 INFO:tasks.workunit.client.1.smithi161.stdout:2/555: sync 2023-12-09T02:35:16.891 INFO:tasks.workunit.client.1.smithi161.stdout:0/576: sync 2023-12-09T02:35:16.892 INFO:tasks.workunit.client.1.smithi161.stdout:2/556: rename d4/d7/db/f24 to d4/d7/db/fb1 0 2023-12-09T02:35:16.892 INFO:tasks.workunit.client.1.smithi161.stdout:2/557: dread - d4/d1a/d4a/d4f/f9d zero size 2023-12-09T02:35:16.892 INFO:tasks.workunit.client.1.smithi161.stdout:2/558: fdatasync d4/d7/d8f/fa5 0 2023-12-09T02:35:16.892 INFO:tasks.workunit.client.1.smithi161.stdout:0/577: dread d9/db/f84 [0,4194304] 0 2023-12-09T02:35:16.893 INFO:tasks.workunit.client.1.smithi161.stdout:2/559: write d4/d16/d69/fa3 [220821,70122] 0 2023-12-09T02:35:16.893 INFO:tasks.workunit.client.1.smithi161.stdout:2/560: fsync d4/d1a/d4a/d4f/f59 0 2023-12-09T02:35:16.894 INFO:tasks.workunit.client.1.smithi161.stdout:0/578: mkdir d9/d55/d5a/db1 0 2023-12-09T02:35:16.894 INFO:tasks.workunit.client.1.smithi161.stdout:0/579: readlink d9/d55/d26/d28/l5c 0 2023-12-09T02:35:16.896 INFO:tasks.workunit.client.1.smithi161.stdout:2/561: rename d4/d16/d69/d8c/f6b to d4/d16/d69/d8c/fb2 0 2023-12-09T02:35:16.898 INFO:tasks.workunit.client.1.smithi161.stdout:0/580: rmdir d9/d55/d26 39 2023-12-09T02:35:16.899 INFO:tasks.workunit.client.1.smithi161.stdout:2/562: symlink d4/d1a/d4a/d6d/lb3 0 2023-12-09T02:35:16.903 INFO:tasks.workunit.client.1.smithi161.stdout:0/581: rename d9/db/d2a/f59 to d9/d5b/fb2 0 2023-12-09T02:35:16.903 INFO:tasks.workunit.client.1.smithi161.stdout:0/582: chown d9/dd/c34 364543 1 2023-12-09T02:35:16.904 INFO:tasks.workunit.client.1.smithi161.stdout:2/563: unlink d4/d7/c8 0 2023-12-09T02:35:16.905 INFO:tasks.workunit.client.1.smithi161.stdout:0/583: write d9/db/d2a/d35/f89 [840692,77099] 0 2023-12-09T02:35:16.905 INFO:tasks.workunit.client.1.smithi161.stdout:0/584: readlink d9/l23 0 2023-12-09T02:35:16.905 INFO:tasks.workunit.client.1.smithi161.stdout:0/585: truncate d9/d55/d26/f57 4530091 0 2023-12-09T02:35:16.905 INFO:tasks.workunit.client.1.smithi161.stdout:2/564: symlink d4/d1a/d4a/daa/lb4 0 2023-12-09T02:35:16.906 INFO:tasks.workunit.client.1.smithi161.stdout:2/565: creat d4/fb5 x:0 0 0 2023-12-09T02:35:16.907 INFO:tasks.workunit.client.1.smithi161.stdout:2/566: creat d4/d16/d69/fb6 x:0 0 0 2023-12-09T02:35:16.907 INFO:tasks.workunit.client.1.smithi161.stdout:2/567: chown d4/fa0 94 1 2023-12-09T02:35:16.909 INFO:tasks.workunit.client.1.smithi161.stdout:0/586: read d9/db/f3e [525703,42295] 0 2023-12-09T02:35:16.911 INFO:tasks.workunit.client.1.smithi161.stdout:0/587: symlink d9/dd/d71/lb3 0 2023-12-09T02:35:16.913 INFO:tasks.workunit.client.1.smithi161.stdout:0/588: symlink d9/db/d2a/d35/lb4 0 2023-12-09T02:35:16.921 INFO:tasks.workunit.client.1.smithi161.stdout:2/568: dwrite d4/d7/db/f2f [0,4194304] 0 2023-12-09T02:35:16.921 INFO:tasks.workunit.client.1.smithi161.stdout:0/589: getdents d9/dd/d71 0 2023-12-09T02:35:16.921 INFO:tasks.workunit.client.1.smithi161.stdout:0/590: fsync d9/d55/d26/fa7 0 2023-12-09T02:35:16.921 INFO:tasks.workunit.client.1.smithi161.stdout:0/591: chown d9/d55/d86/d98/fac 1017 1 2023-12-09T02:35:16.923 INFO:tasks.workunit.client.1.smithi161.stdout:2/569: rmdir d4/d7 39 2023-12-09T02:35:16.924 INFO:tasks.workunit.client.1.smithi161.stdout:0/592: symlink d9/d55/d7c/lb5 0 2023-12-09T02:35:16.927 INFO:tasks.workunit.client.1.smithi161.stdout:2/570: write d4/d16/d69/d8c/f77 [699656,103236] 0 2023-12-09T02:35:16.928 INFO:tasks.workunit.client.1.smithi161.stdout:2/571: write d4/d16/d69/d8c/d5a/f71 [1758924,49840] 0 2023-12-09T02:35:16.928 INFO:tasks.workunit.client.1.smithi161.stdout:2/572: dread - d4/d16/d69/d8c/d87/f97 zero size 2023-12-09T02:35:16.929 INFO:tasks.workunit.client.1.smithi161.stdout:2/573: read - d4/d1a/d4a/d4f/f59 zero size 2023-12-09T02:35:16.929 INFO:tasks.workunit.client.1.smithi161.stdout:2/574: readlink d4/d16/d69/d8c/d87/lad 0 2023-12-09T02:35:16.930 INFO:tasks.workunit.client.1.smithi161.stdout:2/575: truncate d4/d7/fc 2632949 0 2023-12-09T02:35:16.931 INFO:tasks.workunit.client.1.smithi161.stdout:2/576: write d4/d16/d69/fa3 [500807,50472] 0 2023-12-09T02:35:16.931 INFO:tasks.workunit.client.1.smithi161.stdout:2/577: truncate d4/f7d 1478589 0 2023-12-09T02:35:16.932 INFO:tasks.workunit.client.1.smithi161.stdout:2/578: write d4/d16/d69/d8c/f77 [3228404,29548] 0 2023-12-09T02:35:17.022 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:16 smithi088 ceph-mon[112028]: [09/Dec/2023:02:35:15] ENGINE Serving on https://172.21.15.161:7150 2023-12-09T02:35:17.022 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:16 smithi088 ceph-mon[112028]: [09/Dec/2023:02:35:15] ENGINE Bus STARTED 2023-12-09T02:35:17.048 INFO:tasks.workunit.client.1.smithi161.stdout:2/579: getdents d4/d1a/d4a/d6d 0 2023-12-09T02:35:17.060 INFO:tasks.workunit.client.1.smithi161.stdout:2/580: dread d4/d16/d69/d7b/f4e [0,4194304] 0 2023-12-09T02:35:17.063 INFO:tasks.workunit.client.1.smithi161.stdout:2/581: rename d4/f7d to d4/d7/db/fb7 0 2023-12-09T02:35:17.063 INFO:tasks.workunit.client.1.smithi161.stdout:2/582: chown d4/d16/d69/faf 30 1 2023-12-09T02:35:17.063 INFO:tasks.workunit.client.1.smithi161.stdout:2/583: readlink d4/d16/d69/d7b/lac 0 2023-12-09T02:35:17.066 INFO:tasks.workunit.client.1.smithi161.stdout:2/584: unlink d4/d7/db/f10 0 2023-12-09T02:35:17.066 INFO:tasks.workunit.client.1.smithi161.stdout:2/585: fsync d4/d1a/d4a/d4f/f59 0 2023-12-09T02:35:17.067 INFO:tasks.workunit.client.1.smithi161.stdout:2/586: chown d4/d16/d69/d7b/f54 7115452 1 2023-12-09T02:35:17.069 INFO:tasks.workunit.client.1.smithi161.stdout:2/587: mknod d4/d16/d69/d8c/d5a/cb8 0 2023-12-09T02:35:17.086 INFO:tasks.workunit.client.1.smithi161.stdout:2/588: dwrite d4/d7/db/f62 [0,4194304] 0 2023-12-09T02:35:17.088 INFO:tasks.workunit.client.1.smithi161.stdout:2/589: rename d4/d1a/d4a/d4f to d4/da6/db9 0 2023-12-09T02:35:17.089 INFO:tasks.workunit.client.1.smithi161.stdout:2/590: write d4/fa [395486,43238] 0 2023-12-09T02:35:17.090 INFO:tasks.workunit.client.1.smithi161.stdout:2/591: creat d4/fba x:0 0 0 2023-12-09T02:35:17.091 INFO:tasks.workunit.client.1.smithi161.stdout:2/592: symlink d4/da6/db9/lbb 0 2023-12-09T02:35:17.092 INFO:tasks.workunit.client.1.smithi161.stdout:1/675: sync 2023-12-09T02:35:17.092 INFO:tasks.workunit.client.1.smithi161.stdout:9/544: sync 2023-12-09T02:35:17.097 INFO:tasks.workunit.client.1.smithi161.stdout:9/545: symlink d2/d25/db1/d65/d42/d58/d91/d2e/d80/lbd 0 2023-12-09T02:35:17.099 INFO:tasks.workunit.client.1.smithi161.stdout:9/546: mknod d2/d25/db1/d65/d5c/d60/cbe 0 2023-12-09T02:35:17.101 INFO:tasks.workunit.client.1.smithi161.stdout:9/547: write d2/d25/db1/d65/d42/d58/f27 [3798434,71737] 0 2023-12-09T02:35:17.102 INFO:tasks.workunit.client.1.smithi161.stdout:9/548: write d2/d25/db1/d65/d42/d58/d91/d2e/f40 [1913898,58542] 0 2023-12-09T02:35:17.102 INFO:tasks.workunit.client.1.smithi161.stdout:9/549: chown d2/d25/db1/f85 106 1 2023-12-09T02:35:17.102 INFO:tasks.workunit.client.1.smithi161.stdout:9/550: readlink d2/d25/l7e 0 2023-12-09T02:35:17.102 INFO:tasks.workunit.client.1.smithi161.stdout:9/551: readlink d2/d25/db1/d65/d42/d58/l4a 0 2023-12-09T02:35:17.103 INFO:tasks.workunit.client.1.smithi161.stdout:9/552: read d2/d25/db1/d65/d42/d58/f27 [2192581,35024] 0 2023-12-09T02:35:17.106 INFO:tasks.workunit.client.1.smithi161.stdout:9/553: mkdir d2/d25/dbf 0 2023-12-09T02:35:17.108 INFO:tasks.workunit.client.1.smithi161.stdout:9/554: creat d2/d25/dbf/fc0 x:0 0 0 2023-12-09T02:35:17.110 INFO:tasks.workunit.client.1.smithi161.stdout:9/555: getdents d2/d25/db1/d65/d5c/d55/d66/d83/d90 0 2023-12-09T02:35:17.113 INFO:tasks.workunit.client.1.smithi161.stdout:2/593: dwrite d4/d1a/f3e [0,4194304] 0 2023-12-09T02:35:17.115 INFO:tasks.workunit.client.1.smithi161.stdout:2/594: mknod d4/d1a/d4a/daa/cbc 0 2023-12-09T02:35:17.118 INFO:tasks.workunit.client.1.smithi161.stdout:2/595: truncate d4/d16/d69/d7b/f52 326845 0 2023-12-09T02:35:17.119 INFO:tasks.workunit.client.1.smithi161.stdout:2/596: creat d4/d16/d69/d8c/fbd x:0 0 0 2023-12-09T02:35:17.122 INFO:tasks.workunit.client.1.smithi161.stdout:1/676: dwrite d6/d8/d63/d4d/d9f/ddc/f7b [0,4194304] 0 2023-12-09T02:35:17.127 INFO:tasks.workunit.client.1.smithi161.stdout:1/677: link d6/d8/d63/d1c/d8a/dcd/cc5 d6/d8/d63/d4d/d9f/ddc/d3d/ce4 0 2023-12-09T02:35:17.129 INFO:tasks.workunit.client.1.smithi161.stdout:2/597: dread d4/d7/f13 [0,4194304] 0 2023-12-09T02:35:17.129 INFO:tasks.workunit.client.1.smithi161.stdout:2/598: readlink d4/l6e 0 2023-12-09T02:35:17.132 INFO:tasks.workunit.client.1.smithi161.stdout:2/599: rename d4/d16/d69/d8c/d5a/l9a to d4/d16/d69/d8c/lbe 0 2023-12-09T02:35:17.133 INFO:tasks.workunit.client.1.smithi161.stdout:2/600: creat d4/d16/d69/d8c/fbf x:0 0 0 2023-12-09T02:35:17.133 INFO:tasks.workunit.client.1.smithi161.stdout:2/601: chown f1 681629 1 2023-12-09T02:35:17.136 INFO:tasks.workunit.client.1.smithi161.stdout:2/602: creat d4/d16/d69/d7b/fc0 x:0 0 0 2023-12-09T02:35:17.138 INFO:tasks.workunit.client.1.smithi161.stdout:2/603: creat d4/fc1 x:0 0 0 2023-12-09T02:35:17.141 INFO:tasks.workunit.client.1.smithi161.stdout:2/604: mkdir d4/d1a/dc2 0 2023-12-09T02:35:17.141 INFO:tasks.workunit.client.1.smithi161.stdout:2/605: readlink d4/d16/d69/d7b/lac 0 2023-12-09T02:35:17.141 INFO:tasks.workunit.client.1.smithi161.stdout:2/606: chown d4/d16/d69/d8c/fbd 60033 1 2023-12-09T02:35:17.142 INFO:tasks.workunit.client.1.smithi161.stdout:2/607: creat d4/d1a/dc2/fc3 x:0 0 0 2023-12-09T02:35:17.152 INFO:tasks.workunit.client.1.smithi161.stdout:1/678: dwrite d6/d8/d63/d93/f16 [0,4194304] 0 2023-12-09T02:35:17.153 INFO:tasks.workunit.client.1.smithi161.stdout:1/679: write d6/d8/d63/d4d/d9f/ddc/d3d/f96 [3684940,20972] 0 2023-12-09T02:35:17.155 INFO:tasks.workunit.client.1.smithi161.stdout:1/680: creat d6/d9/fe5 x:0 0 0 2023-12-09T02:35:17.155 INFO:tasks.workunit.client.1.smithi161.stdout:1/681: write d6/d9/d5c/fb3 [759622,89438] 0 2023-12-09T02:35:17.158 INFO:tasks.workunit.client.1.smithi161.stdout:1/682: unlink d6/d8/cce 0 2023-12-09T02:35:17.161 INFO:tasks.workunit.client.1.smithi161.stdout:1/683: rmdir d6/d8/d63/d4d/d31/d73/d47 39 2023-12-09T02:35:17.163 INFO:tasks.workunit.client.1.smithi161.stdout:1/684: rmdir d6/d8/d63/d4d/d31/d73 39 2023-12-09T02:35:17.164 INFO:tasks.workunit.client.1.smithi161.stdout:2/608: dwrite d4/f25 [0,4194304] 0 2023-12-09T02:35:17.168 INFO:tasks.workunit.client.1.smithi161.stdout:2/609: creat d4/d16/d69/d7b/fc4 x:0 0 0 2023-12-09T02:35:17.170 INFO:tasks.workunit.client.1.smithi161.stdout:2/610: truncate d4/d16/d69/d7b/f5c 414268 0 2023-12-09T02:35:17.173 INFO:tasks.workunit.client.1.smithi161.stdout:2/611: rename d4/fba to d4/d1a/d4a/daa/fc5 0 2023-12-09T02:35:17.176 INFO:tasks.workunit.client.1.smithi161.stdout:2/612: mknod d4/d16/d69/cc6 0 2023-12-09T02:35:17.179 INFO:tasks.workunit.client.1.smithi161.stdout:2/613: rename d4/d16/d69/d8c/d87/c70 to d4/d16/d69/d8c/d5a/cc7 0 2023-12-09T02:35:17.183 INFO:tasks.workunit.client.1.smithi161.stdout:2/614: mkdir d4/da6/dc8 0 2023-12-09T02:35:17.193 INFO:tasks.workunit.client.1.smithi161.stdout:2/615: dread d4/f25 [0,4194304] 0 2023-12-09T02:35:17.196 INFO:tasks.workunit.client.1.smithi161.stdout:2/616: symlink d4/d16/d69/d8c/d87/lc9 0 2023-12-09T02:35:17.204 INFO:tasks.workunit.client.1.smithi161.stdout:1/685: dwrite d6/d8/d63/d4d/d9f/ddc/d3d/dc3/f82 [0,4194304] 0 2023-12-09T02:35:17.209 INFO:tasks.workunit.client.1.smithi161.stdout:1/686: write d6/d9/d8b/fc7 [1917702,12238] 0 2023-12-09T02:35:17.210 INFO:tasks.workunit.client.1.smithi161.stdout:1/687: dread - d6/d9/d8b/fa3 zero size 2023-12-09T02:35:17.210 INFO:tasks.workunit.client.1.smithi161.stdout:1/688: stat d6/d8/d63/d1c/d8a 0 2023-12-09T02:35:17.210 INFO:tasks.workunit.client.1.smithi161.stdout:1/689: write d6/d8/d63/d4d/d9f/ddc/d3d/f96 [5185047,128573] 0 2023-12-09T02:35:17.210 INFO:tasks.workunit.client.1.smithi161.stdout:1/690: chown d6/d8/d63/d1c/f41 127249 1 2023-12-09T02:35:17.210 INFO:tasks.workunit.client.1.smithi161.stdout:1/691: fsync d6/d8/f92 0 2023-12-09T02:35:17.210 INFO:tasks.workunit.client.1.smithi161.stdout:1/692: write d6/d9/d5c/fb3 [497323,18882] 0 2023-12-09T02:35:17.285 INFO:tasks.workunit.client.1.smithi161.stdout:2/617: mknod d4/d1a/d4a/cca 0 2023-12-09T02:35:17.298 INFO:tasks.workunit.client.1.smithi161.stdout:1/693: readlink d6/d8/d63/d4d/d9f/ddc/daa/l6e 0 2023-12-09T02:35:17.309 INFO:tasks.workunit.client.1.smithi161.stdout:2/618: symlink d4/d16/d69/d7b/lcb 0 2023-12-09T02:35:17.314 INFO:tasks.workunit.client.1.smithi161.stdout:1/694: rename d6/f2b to d6/d8/d63/d93/fe6 0 2023-12-09T02:35:17.317 INFO:tasks.workunit.client.1.smithi161.stdout:1/695: creat d6/d8/d63/d4d/d9f/ddc/daa/fe7 x:0 0 0 2023-12-09T02:35:17.321 INFO:tasks.workunit.client.1.smithi161.stdout:1/696: symlink d6/d9/d5c/le8 0 2023-12-09T02:35:17.338 INFO:tasks.workunit.client.1.smithi161.stdout:4/696: sync 2023-12-09T02:35:17.338 INFO:tasks.workunit.client.1.smithi161.stdout:5/561: sync 2023-12-09T02:35:17.338 INFO:tasks.workunit.client.1.smithi161.stdout:3/507: sync 2023-12-09T02:35:17.338 INFO:tasks.workunit.client.1.smithi161.stdout:8/537: sync 2023-12-09T02:35:17.338 INFO:tasks.workunit.client.1.smithi161.stdout:3/508: write d2/d51/d75/d11/d1f/d2a/f3b [787627,70841] 0 2023-12-09T02:35:17.339 INFO:tasks.workunit.client.1.smithi161.stdout:5/562: symlink d0/d1f/lc4 0 2023-12-09T02:35:17.341 INFO:tasks.workunit.client.1.smithi161.stdout:4/697: mkdir dd/d1a/d1d/d25/d32/dd0/ddc 0 2023-12-09T02:35:17.341 INFO:tasks.workunit.client.1.smithi161.stdout:4/698: readlink dd/d36/d4a/d5f/d65/lb6 0 2023-12-09T02:35:17.342 INFO:tasks.workunit.client.1.smithi161.stdout:5/563: rename d0/c7f to d0/d2/d7/d11/d50/d8a/cc5 0 2023-12-09T02:35:17.343 INFO:tasks.workunit.client.1.smithi161.stdout:5/564: stat d0/l2f 0 2023-12-09T02:35:17.345 INFO:tasks.workunit.client.1.smithi161.stdout:4/699: symlink dd/d1a/d1e/ldd 0 2023-12-09T02:35:17.347 INFO:tasks.workunit.client.1.smithi161.stdout:5/565: dread d0/d2/de/d44/f43 [0,4194304] 0 2023-12-09T02:35:17.347 INFO:tasks.workunit.client.1.smithi161.stdout:4/700: link dd/d1a/d29/f37 dd/d36/d4a/d88/d8a/db3/fde 0 2023-12-09T02:35:17.350 INFO:tasks.workunit.client.1.smithi161.stdout:5/566: rename d0/d2/d7/d11/f35 to d0/d2/d7/d11/dc3/fc6 0 2023-12-09T02:35:17.352 INFO:tasks.workunit.client.1.smithi161.stdout:4/701: creat dd/d1a/d1d/d25/d32/dd0/fdf x:0 0 0 2023-12-09T02:35:17.353 INFO:tasks.workunit.client.1.smithi161.stdout:5/567: unlink d0/d2/de/d22/d55/l79 0 2023-12-09T02:35:17.355 INFO:tasks.workunit.client.1.smithi161.stdout:4/702: mknod dd/d1a/d1d/d25/ce0 0 2023-12-09T02:35:17.375 INFO:tasks.workunit.client.1.smithi161.stdout:3/509: dwrite d2/d51/d75/d11/d1f/d2a/d46/d40/f6d [0,4194304] 0 2023-12-09T02:35:17.375 INFO:tasks.workunit.client.1.smithi161.stdout:3/510: stat d2/d51/d75/c9 0 2023-12-09T02:35:17.375 INFO:tasks.workunit.client.1.smithi161.stdout:8/538: dwrite d2/d5/d22/d54/f91 [0,4194304] 0 2023-12-09T02:35:17.376 INFO:tasks.workunit.client.1.smithi161.stdout:8/539: truncate d2/d5/d22/d54/f96 786882 0 2023-12-09T02:35:17.376 INFO:tasks.workunit.client.1.smithi161.stdout:4/703: dwrite dd/d36/d4a/d5f/f7c [0,4194304] 0 2023-12-09T02:35:17.377 INFO:tasks.workunit.client.1.smithi161.stdout:4/704: write dd/d36/d3f/fa4 [2772872,95739] 0 2023-12-09T02:35:17.390 INFO:tasks.workunit.client.1.smithi161.stdout:4/705: dwrite dd/d1a/d1d/d25/d4e/fb2 [0,4194304] 0 2023-12-09T02:35:17.419 INFO:tasks.workunit.client.1.smithi161.stdout:5/568: creat d0/d2/d7/df/d60/fc7 x:0 0 0 2023-12-09T02:35:17.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:16 smithi161 ceph-mon[121170]: [09/Dec/2023:02:35:15] ENGINE Serving on https://172.21.15.161:7150 2023-12-09T02:35:17.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:16 smithi161 ceph-mon[121170]: [09/Dec/2023:02:35:15] ENGINE Bus STARTED 2023-12-09T02:35:17.420 INFO:tasks.workunit.client.1.smithi161.stdout:3/511: creat d2/d51/d75/d11/d1f/f8f x:0 0 0 2023-12-09T02:35:17.420 INFO:tasks.workunit.client.1.smithi161.stdout:3/512: chown d2/d51/d75/d11/d28/f8a 142506202 1 2023-12-09T02:35:17.425 INFO:tasks.workunit.client.1.smithi161.stdout:8/540: stat d2/d5/d3d/c73 0 2023-12-09T02:35:17.425 INFO:tasks.workunit.client.1.smithi161.stdout:8/541: write d2/d5/f16 [4364904,12282] 0 2023-12-09T02:35:17.436 INFO:tasks.workunit.client.1.smithi161.stdout:4/706: getdents dd/d36/d4a 0 2023-12-09T02:35:17.436 INFO:tasks.workunit.client.1.smithi161.stdout:4/707: chown dd/d36/d4a/d88/d8a/db3/fde 4246431 1 2023-12-09T02:35:17.439 INFO:tasks.workunit.client.1.smithi161.stdout:8/542: dwrite d2/fb1 [0,4194304] 0 2023-12-09T02:35:17.440 INFO:tasks.workunit.client.1.smithi161.stdout:5/569: rename d0/d1f/f84 to d0/d2/d7/d9a/fc8 0 2023-12-09T02:35:17.440 INFO:tasks.workunit.client.1.smithi161.stdout:5/570: chown d0/d2/f7a 0 1 2023-12-09T02:35:17.441 INFO:tasks.workunit.client.1.smithi161.stdout:3/513: mknod d2/d51/d75/d11/d1f/d74/c90 0 2023-12-09T02:35:17.442 INFO:tasks.workunit.client.1.smithi161.stdout:4/708: creat dd/d36/d4a/d88/d8a/fe1 x:0 0 0 2023-12-09T02:35:17.443 INFO:tasks.workunit.client.1.smithi161.stdout:4/709: write dd/d36/d4a/d88/d8a/db3/fcb [756849,107156] 0 2023-12-09T02:35:17.452 INFO:tasks.workunit.client.1.smithi161.stdout:4/710: dread dd/d1a/d1e/fb5 [0,4194304] 0 2023-12-09T02:35:17.452 INFO:tasks.workunit.client.1.smithi161.stdout:4/711: write dd/d1a/d23/d6a/fa3 [821342,33244] 0 2023-12-09T02:35:17.492 INFO:tasks.workunit.client.1.smithi161.stdout:5/571: symlink d0/d2/d5f/lc9 0 2023-12-09T02:35:17.493 INFO:tasks.workunit.client.1.smithi161.stdout:7/590: sync 2023-12-09T02:35:17.494 INFO:tasks.workunit.client.1.smithi161.stdout:6/542: sync 2023-12-09T02:35:17.494 INFO:tasks.workunit.client.1.smithi161.stdout:0/593: sync 2023-12-09T02:35:17.494 INFO:tasks.workunit.client.1.smithi161.stdout:0/594: dread - d9/db/d2a/d35/d7b/f9b zero size 2023-12-09T02:35:17.497 INFO:tasks.workunit.client.1.smithi161.stdout:3/514: rename d2/d51/d75/d11/d1f/d2a to d2/d51/d75/d11/d19/d91 0 2023-12-09T02:35:17.501 INFO:tasks.workunit.client.1.smithi161.stdout:4/712: unlink dd/d1a/f66 0 2023-12-09T02:35:17.501 INFO:tasks.workunit.client.1.smithi161.stdout:4/713: write dd/d1a/d1d/d25/d32/d34/f60 [841491,112856] 0 2023-12-09T02:35:17.506 INFO:tasks.workunit.client.1.smithi161.stdout:5/572: symlink d0/d2/d7/df/d60/da8/db7/lca 0 2023-12-09T02:35:17.508 INFO:tasks.workunit.client.1.smithi161.stdout:6/543: mknod da/d28/d3c/cc1 0 2023-12-09T02:35:17.510 INFO:tasks.workunit.client.1.smithi161.stdout:7/591: mkdir d0/d49/d67/d71/dc0 0 2023-12-09T02:35:17.510 INFO:tasks.workunit.client.1.smithi161.stdout:7/592: write d0/d3/d9e/db4/fb6 [698755,100704] 0 2023-12-09T02:35:17.512 INFO:tasks.workunit.client.1.smithi161.stdout:4/714: creat dd/d1a/fe2 x:0 0 0 2023-12-09T02:35:17.512 INFO:tasks.workunit.client.1.smithi161.stdout:4/715: fdatasync dd/d1a/d1d/d25/d3a/fd8 0 2023-12-09T02:35:17.512 INFO:tasks.workunit.client.1.smithi161.stdout:0/595: dwrite d9/d55/f6a [0,4194304] 0 2023-12-09T02:35:17.515 INFO:tasks.workunit.client.1.smithi161.stdout:4/716: creat dd/d1a/fe3 x:0 0 0 2023-12-09T02:35:17.515 INFO:tasks.workunit.client.1.smithi161.stdout:4/717: chown dd/d5a 17 1 2023-12-09T02:35:17.515 INFO:tasks.workunit.client.1.smithi161.stdout:4/718: dread - dd/d1a/fe2 zero size 2023-12-09T02:35:17.517 INFO:tasks.workunit.client.1.smithi161.stdout:6/544: rmdir da/d28 39 2023-12-09T02:35:17.520 INFO:tasks.workunit.client.1.smithi161.stdout:0/596: mkdir d9/db/d2a/d35/d4a/d94/db6 0 2023-12-09T02:35:17.521 INFO:tasks.workunit.client.1.smithi161.stdout:4/719: chown dd/d36/d3f/fb1 234727 1 2023-12-09T02:35:17.522 INFO:tasks.workunit.client.1.smithi161.stdout:3/515: dwrite d2/d51/d75/d11/d19/d91/f2b [0,4194304] 0 2023-12-09T02:35:17.528 INFO:tasks.workunit.client.1.smithi161.stdout:7/593: dwrite d0/d49/d67/f92 [0,4194304] 0 2023-12-09T02:35:17.528 INFO:tasks.workunit.client.1.smithi161.stdout:0/597: mkdir d9/d55/db7 0 2023-12-09T02:35:17.530 INFO:tasks.workunit.client.1.smithi161.stdout:7/594: dread d0/d3/d21/d54/f64 [0,4194304] 0 2023-12-09T02:35:17.535 INFO:tasks.workunit.client.1.smithi161.stdout:4/720: mknod dd/d36/d4a/d88/ce4 0 2023-12-09T02:35:17.535 INFO:tasks.workunit.client.1.smithi161.stdout:4/721: readlink dd/d1a/d1d/d25/d32/d58/l67 0 2023-12-09T02:35:17.536 INFO:tasks.workunit.client.1.smithi161.stdout:6/545: rename da/d28 to da/d19/dc2 0 2023-12-09T02:35:17.542 INFO:tasks.workunit.client.1.smithi161.stdout:4/722: dread f7 [0,4194304] 0 2023-12-09T02:35:17.543 INFO:tasks.workunit.client.1.smithi161.stdout:4/723: chown dd/d1a/d1d/d25/d32/dd0 249645 1 2023-12-09T02:35:17.543 INFO:tasks.workunit.client.1.smithi161.stdout:3/516: creat d2/d51/d75/d50/f92 x:0 0 0 2023-12-09T02:35:17.546 INFO:tasks.workunit.client.1.smithi161.stdout:0/598: symlink d9/d9c/lb8 0 2023-12-09T02:35:17.548 INFO:tasks.workunit.client.1.smithi161.stdout:7/595: creat d0/fc1 x:0 0 0 2023-12-09T02:35:17.548 INFO:tasks.workunit.client.1.smithi161.stdout:7/596: chown d0/d3/d9e/c51 0 1 2023-12-09T02:35:17.548 INFO:tasks.workunit.client.1.smithi161.stdout:7/597: read d0/d3/d13/f58 [3923374,25797] 0 2023-12-09T02:35:17.549 INFO:tasks.workunit.client.1.smithi161.stdout:6/546: rename da/df/d2d/d3b/c43 to da/d19/dc2/d29/cc3 0 2023-12-09T02:35:17.552 INFO:tasks.workunit.client.1.smithi161.stdout:4/724: creat dd/d1a/d1d/d25/d4e/dbb/fe5 x:0 0 0 2023-12-09T02:35:17.554 INFO:tasks.workunit.client.1.smithi161.stdout:3/517: link d2/d51/d75/d11/d19/d91/d46/d40/c68 d2/d51/d75/d11/d19/d91/d46/d3e/c93 0 2023-12-09T02:35:17.558 INFO:tasks.workunit.client.1.smithi161.stdout:0/599: unlink d9/dd/d3a/f3d 0 2023-12-09T02:35:17.562 INFO:tasks.workunit.client.1.smithi161.stdout:7/598: mknod d0/d3/d21/d54/cc2 0 2023-12-09T02:35:17.564 INFO:tasks.workunit.client.1.smithi161.stdout:6/547: unlink da/d19/dc2/d77/d79/f5c 0 2023-12-09T02:35:17.574 INFO:tasks.workunit.client.1.smithi161.stdout:4/725: symlink dd/d36/d4a/d88/d8a/le6 0 2023-12-09T02:35:17.575 INFO:tasks.workunit.client.1.smithi161.stdout:4/726: read dd/f13 [4392534,57272] 0 2023-12-09T02:35:17.576 INFO:tasks.workunit.client.1.smithi161.stdout:4/727: write dd/d1a/d1d/d25/d4e/fb2 [2212634,103954] 0 2023-12-09T02:35:17.576 INFO:tasks.workunit.client.1.smithi161.stdout:3/518: truncate d2/d51/d75/d11/d19/d91/d46/d40/f6d 4532532 0 2023-12-09T02:35:17.577 INFO:tasks.workunit.client.1.smithi161.stdout:7/599: rmdir d0/d49/d79 39 2023-12-09T02:35:17.577 INFO:tasks.workunit.client.1.smithi161.stdout:7/600: read d0/d3/d13/d2f/d50/fb1 [443368,97379] 0 2023-12-09T02:35:17.578 INFO:tasks.workunit.client.1.smithi161.stdout:6/548: getdents da/d19 0 2023-12-09T02:35:17.582 INFO:tasks.workunit.client.1.smithi161.stdout:3/519: symlink d2/d51/d75/d11/d19/d91/d46/d5e/l94 0 2023-12-09T02:35:17.583 INFO:tasks.workunit.client.1.smithi161.stdout:6/549: mknod da/d19/dc2/d29/d2b/d31/cc4 0 2023-12-09T02:35:17.583 INFO:tasks.workunit.client.1.smithi161.stdout:6/550: write da/d19/dc2/d29/d2b/f97 [847589,40471] 0 2023-12-09T02:35:17.584 INFO:tasks.workunit.client.1.smithi161.stdout:6/551: fsync da/d19/f1b 0 2023-12-09T02:35:17.584 INFO:tasks.workunit.client.1.smithi161.stdout:6/552: read - da/df/f9c zero size 2023-12-09T02:35:17.584 INFO:tasks.workunit.client.1.smithi161.stdout:4/728: mknod dd/d1a/d23/ce7 0 2023-12-09T02:35:17.585 INFO:tasks.workunit.client.1.smithi161.stdout:4/729: write dd/d1a/d1d/d25/d3a/fd8 [504049,37139] 0 2023-12-09T02:35:17.586 INFO:tasks.workunit.client.1.smithi161.stdout:7/601: dread d0/d49/d67/f92 [0,4194304] 0 2023-12-09T02:35:17.586 INFO:tasks.workunit.client.1.smithi161.stdout:3/520: link d2/d51/d75/d11/d19/d91/f63 d2/d51/d75/d11/d5a/f95 0 2023-12-09T02:35:17.590 INFO:tasks.workunit.client.1.smithi161.stdout:4/730: truncate dd/f13 1806785 0 2023-12-09T02:35:17.591 INFO:tasks.workunit.client.1.smithi161.stdout:6/553: creat da/d19/dc2/d3c/fc5 x:0 0 0 2023-12-09T02:35:17.591 INFO:tasks.workunit.client.1.smithi161.stdout:6/554: fdatasync da/d19/f1e 0 2023-12-09T02:35:17.591 INFO:tasks.workunit.client.1.smithi161.stdout:4/731: dread - dd/d1a/fe2 zero size 2023-12-09T02:35:17.591 INFO:tasks.workunit.client.1.smithi161.stdout:4/732: readlink dd/d1a/d1e/l33 0 2023-12-09T02:35:17.594 INFO:tasks.workunit.client.1.smithi161.stdout:4/733: mkdir dd/d36/d4a/de8 0 2023-12-09T02:35:17.598 INFO:tasks.workunit.client.1.smithi161.stdout:6/555: dread da/d19/f1b [0,4194304] 0 2023-12-09T02:35:17.598 INFO:tasks.workunit.client.1.smithi161.stdout:6/556: link da/df/d2d/d49/f4c da/d55/fc6 0 2023-12-09T02:35:17.608 INFO:tasks.workunit.client.1.smithi161.stdout:3/521: dwrite d2/d51/d75/d11/d19/f2e [4194304,4194304] 0 2023-12-09T02:35:17.608 INFO:tasks.workunit.client.1.smithi161.stdout:3/522: write d2/d51/d75/d11/d7b/f87 [2074444,35067] 0 2023-12-09T02:35:17.608 INFO:tasks.workunit.client.1.smithi161.stdout:3/523: write d2/d51/d75/d11/d19/d91/f63 [2023262,76367] 0 2023-12-09T02:35:17.610 INFO:tasks.workunit.client.1.smithi161.stdout:3/524: unlink d2/d51/d75/d11/d19/d91/d46/d2d/d47/l7c 0 2023-12-09T02:35:17.610 INFO:tasks.workunit.client.1.smithi161.stdout:3/525: truncate d2/d51/d75/d11/f5d 1000181 0 2023-12-09T02:35:17.612 INFO:tasks.workunit.client.1.smithi161.stdout:3/526: rename d2/d51/d75/d11/d5a to d2/d51/d75/d11/d1f/d7a/d96 0 2023-12-09T02:35:17.729 INFO:tasks.workunit.client.1.smithi161.stdout:9/556: sync 2023-12-09T02:35:17.732 INFO:tasks.workunit.client.1.smithi161.stdout:4/734: dwrite dd/d36/d4a/d5f/fba [4194304,4194304] 0 2023-12-09T02:35:17.732 INFO:tasks.workunit.client.1.smithi161.stdout:9/557: dread d2/d25/db1/d65/d42/d58/d91/f36 [0,4194304] 0 2023-12-09T02:35:17.734 INFO:tasks.workunit.client.1.smithi161.stdout:4/735: mkdir dd/d1a/d23/de9 0 2023-12-09T02:35:17.736 INFO:tasks.workunit.client.1.smithi161.stdout:4/736: write dd/d36/d4a/d5f/f7c [4882009,42684] 0 2023-12-09T02:35:17.739 INFO:tasks.workunit.client.1.smithi161.stdout:4/737: rename dd/d1a/c61 to dd/d1a/d1d/d25/d4e/dbb/cea 0 2023-12-09T02:35:17.739 INFO:tasks.workunit.client.1.smithi161.stdout:4/738: fdatasync dd/d1a/d1d/d25/d32/dd0/fdf 0 2023-12-09T02:35:17.743 INFO:tasks.workunit.client.1.smithi161.stdout:4/739: write dd/f13 [779824,84679] 0 2023-12-09T02:35:17.745 INFO:tasks.workunit.client.1.smithi161.stdout:4/740: rename dd/d1a/d1d/d25/d32/d34 to dd/d1a/d1d/d25/d32/d75/deb 0 2023-12-09T02:35:17.746 INFO:tasks.workunit.client.1.smithi161.stdout:6/557: dwrite da/d19/dc2/d3c/d46/f7c [0,4194304] 0 2023-12-09T02:35:17.746 INFO:tasks.workunit.client.1.smithi161.stdout:4/741: rename dd/d1a/d1d/d25/d32/d75/deb/c3c to dd/d36/d4a/d88/cec 0 2023-12-09T02:35:17.749 INFO:tasks.workunit.client.1.smithi161.stdout:9/558: dwrite d2/d25/db1/d65/d5c/d55/d66/d83/fab [0,4194304] 0 2023-12-09T02:35:17.749 INFO:tasks.workunit.client.1.smithi161.stdout:9/559: chown d2/d25/db1/d4d/d7d/f87 0 1 2023-12-09T02:35:17.751 INFO:tasks.workunit.client.1.smithi161.stdout:4/742: creat dd/d5a/dd2/fed x:0 0 0 2023-12-09T02:35:17.755 INFO:tasks.workunit.client.1.smithi161.stdout:9/560: rename d2/d25/cb7 to d2/d25/db1/d65/d42/d58/d91/d51/cc1 0 2023-12-09T02:35:17.755 INFO:tasks.workunit.client.1.smithi161.stdout:9/561: write d2/d25/db1/d65/d42/d58/d91/f20 [3628855,85699] 0 2023-12-09T02:35:17.757 INFO:tasks.workunit.client.1.smithi161.stdout:4/743: creat dd/fee x:0 0 0 2023-12-09T02:35:17.763 INFO:tasks.workunit.client.1.smithi161.stdout:9/562: link d2/d25/db1/d65/d42/l76 d2/d25/db1/d65/d63/lc2 0 2023-12-09T02:35:17.764 INFO:tasks.workunit.client.1.smithi161.stdout:9/563: read d2/d25/db1/d65/d42/d58/d91/d2e/f45 [3711068,1396] 0 2023-12-09T02:35:17.764 INFO:tasks.workunit.client.1.smithi161.stdout:9/564: chown d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61 5707 1 2023-12-09T02:35:17.764 INFO:tasks.workunit.client.1.smithi161.stdout:9/565: readlink d2/d25/db1/d65/d42/l5e 0 2023-12-09T02:35:17.769 INFO:tasks.workunit.client.1.smithi161.stdout:2/619: sync 2023-12-09T02:35:17.769 INFO:tasks.workunit.client.1.smithi161.stdout:1/697: sync 2023-12-09T02:35:17.769 INFO:tasks.workunit.client.1.smithi161.stdout:1/698: chown d6/d8/d63/d4d/d31/d80/d9c 19582353 1 2023-12-09T02:35:17.769 INFO:tasks.workunit.client.1.smithi161.stdout:2/620: creat d4/d16/d69/d8c/fcc x:0 0 0 2023-12-09T02:35:17.769 INFO:tasks.workunit.client.1.smithi161.stdout:2/621: chown d4/d16/d69/d7b/f4e 59342 1 2023-12-09T02:35:17.769 INFO:tasks.workunit.client.1.smithi161.stdout:2/622: stat d4/d7/d8f/ca1 0 2023-12-09T02:35:17.771 INFO:tasks.workunit.client.1.smithi161.stdout:2/623: symlink d4/d7/db/lcd 0 2023-12-09T02:35:17.772 INFO:tasks.workunit.client.1.smithi161.stdout:2/624: creat d4/d16/d69/d7b/fce x:0 0 0 2023-12-09T02:35:17.773 INFO:tasks.workunit.client.1.smithi161.stdout:1/699: write f5 [6207089,7035] 0 2023-12-09T02:35:17.773 INFO:tasks.workunit.client.1.smithi161.stdout:1/700: truncate d6/d8/d63/d4d/d31/fbf 4368134 0 2023-12-09T02:35:17.773 INFO:tasks.workunit.client.1.smithi161.stdout:1/701: readlink d6/d9/l44 0 2023-12-09T02:35:17.773 INFO:tasks.workunit.client.1.smithi161.stdout:2/625: creat d4/d7/db/fcf x:0 0 0 2023-12-09T02:35:17.775 INFO:tasks.workunit.client.1.smithi161.stdout:2/626: truncate d4/f30 278910 0 2023-12-09T02:35:17.775 INFO:tasks.workunit.client.1.smithi161.stdout:2/627: write d4/d16/d69/fa9 [704175,93583] 0 2023-12-09T02:35:17.776 INFO:tasks.workunit.client.1.smithi161.stdout:4/744: dwrite dd/d1a/d29/f5d [0,4194304] 0 2023-12-09T02:35:17.777 INFO:tasks.workunit.client.1.smithi161.stdout:2/628: rmdir d4/da6/db9 39 2023-12-09T02:35:17.778 INFO:tasks.workunit.client.1.smithi161.stdout:4/745: creat dd/d1a/d29/fef x:0 0 0 2023-12-09T02:35:17.779 INFO:tasks.workunit.client.1.smithi161.stdout:4/746: readlink dd/d36/d4a/d88/d8a/le6 0 2023-12-09T02:35:17.787 INFO:tasks.workunit.client.1.smithi161.stdout:1/702: dread d6/d8/d63/d1c/f89 [0,4194304] 0 2023-12-09T02:35:17.788 INFO:tasks.workunit.client.1.smithi161.stdout:1/703: symlink d6/d8/d63/d4d/d9f/le9 0 2023-12-09T02:35:17.788 INFO:tasks.workunit.client.1.smithi161.stdout:1/704: chown d6/d8/d63/d4d/d31/d73/lb0 29436575 1 2023-12-09T02:35:17.788 INFO:tasks.workunit.client.1.smithi161.stdout:1/705: truncate d6/d8/f92 1293318 0 2023-12-09T02:35:17.789 INFO:tasks.workunit.client.1.smithi161.stdout:1/706: creat d6/d9/dd4/fea x:0 0 0 2023-12-09T02:35:17.791 INFO:tasks.workunit.client.1.smithi161.stdout:1/707: unlink d6/d8/d63/d4d/d31/d73/lb0 0 2023-12-09T02:35:17.792 INFO:tasks.workunit.client.1.smithi161.stdout:1/708: read d6/d8/f30 [1600418,111397] 0 2023-12-09T02:35:17.792 INFO:tasks.workunit.client.1.smithi161.stdout:1/709: fsync d6/d8/d63/d4d/d31/d80/fb6 0 2023-12-09T02:35:17.793 INFO:tasks.workunit.client.1.smithi161.stdout:1/710: truncate d6/d8/d63/d4d/d31/f3a 1724800 0 2023-12-09T02:35:17.794 INFO:tasks.workunit.client.1.smithi161.stdout:4/747: dread dd/d1a/d1d/d25/d32/d75/deb/f97 [0,4194304] 0 2023-12-09T02:35:17.794 INFO:tasks.workunit.client.1.smithi161.stdout:4/748: read - dd/d1a/d23/d6a/fbf zero size 2023-12-09T02:35:17.797 INFO:tasks.workunit.client.1.smithi161.stdout:9/566: dwrite d2/d25/db1/d65/d42/d58/d91/d2e/d80/fa2 [0,4194304] 0 2023-12-09T02:35:17.797 INFO:tasks.workunit.client.1.smithi161.stdout:9/567: getdents d2/d25/db1/d65/d5c/d55/d66/d83/d90/d95 0 2023-12-09T02:35:17.798 INFO:tasks.workunit.client.1.smithi161.stdout:1/711: rename d6/d8/d63/d61/l84 to d6/d8/d63/d4d/d31/d80/d87/de3/leb 0 2023-12-09T02:35:17.798 INFO:tasks.workunit.client.1.smithi161.stdout:1/712: readlink d6/d8/d63/d4d/d9f/ddc/d3d/l6f 0 2023-12-09T02:35:17.798 INFO:tasks.workunit.client.1.smithi161.stdout:9/568: write d2/d25/db1/d65/d42/d58/d91/d2e/f45 [4372594,102693] 0 2023-12-09T02:35:17.802 INFO:tasks.workunit.client.1.smithi161.stdout:2/629: dwrite d4/d16/d69/f6a [0,4194304] 0 2023-12-09T02:35:17.802 INFO:tasks.workunit.client.1.smithi161.stdout:2/630: write d4/da6/db9/f73 [1091428,69711] 0 2023-12-09T02:35:17.803 INFO:tasks.workunit.client.1.smithi161.stdout:1/713: rename d6/d8/d63/d4d/d9f/fdf to d6/d8/d63/d4d/d9f/ddc/d3d/d75/fec 0 2023-12-09T02:35:17.803 INFO:tasks.workunit.client.1.smithi161.stdout:1/714: fsync d6/d9/faf 0 2023-12-09T02:35:17.803 INFO:tasks.workunit.client.1.smithi161.stdout:1/715: write d6/d9/d5c/fb3 [1279192,5527] 0 2023-12-09T02:35:17.807 INFO:tasks.workunit.client.1.smithi161.stdout:2/631: creat d4/d1a/d4a/fd0 x:0 0 0 2023-12-09T02:35:17.822 INFO:tasks.workunit.client.1.smithi161.stdout:4/749: dwrite dd/d1a/d1d/f49 [4194304,4194304] 0 2023-12-09T02:35:17.826 INFO:tasks.workunit.client.1.smithi161.stdout:4/750: write dd/d1a/d1d/d25/d4e/fb2 [3353587,1321] 0 2023-12-09T02:35:17.826 INFO:tasks.workunit.client.1.smithi161.stdout:4/751: truncate dd/d1a/d1e/f4f 514271 0 2023-12-09T02:35:17.828 INFO:tasks.workunit.client.1.smithi161.stdout:4/752: mkdir dd/d1a/d1d/d25/d3a/df0 0 2023-12-09T02:35:17.830 INFO:tasks.workunit.client.1.smithi161.stdout:4/753: mkdir dd/d1a/d23/de9/df1 0 2023-12-09T02:35:17.838 INFO:tasks.workunit.client.1.smithi161.stdout:2/632: dwrite d4/d1a/f3f [0,4194304] 0 2023-12-09T02:35:17.840 INFO:tasks.workunit.client.1.smithi161.stdout:1/716: dwrite d6/d8/d63/d93/f48 [0,4194304] 0 2023-12-09T02:35:17.842 INFO:tasks.workunit.client.1.smithi161.stdout:2/633: readlink d4/d16/d69/d7b/l95 0 2023-12-09T02:35:17.842 INFO:tasks.workunit.client.1.smithi161.stdout:1/717: dread d6/d8/d63/fcc [0,4194304] 0 2023-12-09T02:35:17.843 INFO:tasks.workunit.client.1.smithi161.stdout:4/754: dread dd/d1a/d1d/d25/f2f [0,4194304] 0 2023-12-09T02:35:17.853 INFO:tasks.workunit.client.1.smithi161.stdout:2/634: creat d4/d16/d69/d8c/fd1 x:0 0 0 2023-12-09T02:35:17.853 INFO:tasks.workunit.client.1.smithi161.stdout:2/635: dread - d4/d1a/f40 zero size 2023-12-09T02:35:17.853 INFO:tasks.workunit.client.1.smithi161.stdout:2/636: readlink d4/da6/db9/l64 0 2023-12-09T02:35:17.853 INFO:tasks.workunit.client.1.smithi161.stdout:2/637: write d4/d16/d69/d8c/d87/fa4 [217216,85658] 0 2023-12-09T02:35:17.853 INFO:tasks.workunit.client.1.smithi161.stdout:2/638: chown d4/da6/dc8 249204 1 2023-12-09T02:35:17.853 INFO:tasks.workunit.client.1.smithi161.stdout:2/639: read - d4/d1a/d4a/daa/fc5 zero size 2023-12-09T02:35:17.854 INFO:tasks.workunit.client.1.smithi161.stdout:1/718: symlink d6/d8/d63/d4d/d9f/ddc/d3d/led 0 2023-12-09T02:35:17.855 INFO:tasks.workunit.client.1.smithi161.stdout:4/755: mknod dd/d36/cf2 0 2023-12-09T02:35:17.856 INFO:tasks.workunit.client.1.smithi161.stdout:4/756: readlink dd/la8 0 2023-12-09T02:35:17.856 INFO:tasks.workunit.client.1.smithi161.stdout:4/757: fdatasync dd/d1a/d1d/d25/d3a/f40 0 2023-12-09T02:35:17.859 INFO:tasks.workunit.client.1.smithi161.stdout:2/640: mkdir d4/d7/d8f/dd2 0 2023-12-09T02:35:17.859 INFO:tasks.workunit.client.1.smithi161.stdout:2/641: readlink d4/d16/d69/d8c/lbe 0 2023-12-09T02:35:17.860 INFO:tasks.workunit.client.1.smithi161.stdout:1/719: creat d6/d8/d63/d4d/fee x:0 0 0 2023-12-09T02:35:17.862 INFO:tasks.workunit.client.1.smithi161.stdout:4/758: creat dd/d1a/d1d/d25/d32/dd0/ff3 x:0 0 0 2023-12-09T02:35:17.866 INFO:tasks.workunit.client.1.smithi161.stdout:2/642: symlink d4/d1a/d4a/d6d/ld3 0 2023-12-09T02:35:17.866 INFO:tasks.workunit.client.1.smithi161.stdout:2/643: chown d4/d1a/d4a/d6d/lb3 26871573 1 2023-12-09T02:35:17.869 INFO:tasks.workunit.client.1.smithi161.stdout:4/759: creat dd/d36/d3f/d54/ff4 x:0 0 0 2023-12-09T02:35:17.869 INFO:tasks.workunit.client.1.smithi161.stdout:1/720: dread d6/d8/d63/d93/f48 [0,4194304] 0 2023-12-09T02:35:17.870 INFO:tasks.workunit.client.1.smithi161.stdout:2/644: mknod d4/d1a/cd4 0 2023-12-09T02:35:17.870 INFO:tasks.workunit.client.1.smithi161.stdout:2/645: stat d4/cd 0 2023-12-09T02:35:17.871 INFO:tasks.workunit.client.1.smithi161.stdout:4/760: rmdir dd/d1a/d1e 39 2023-12-09T02:35:17.871 INFO:tasks.workunit.client.1.smithi161.stdout:1/721: readlink d6/d8/d63/d93/l13 0 2023-12-09T02:35:17.873 INFO:tasks.workunit.client.1.smithi161.stdout:2/646: symlink d4/d16/d69/ld5 0 2023-12-09T02:35:17.877 INFO:tasks.workunit.client.1.smithi161.stdout:1/722: creat d6/fef x:0 0 0 2023-12-09T02:35:17.880 INFO:tasks.workunit.client.1.smithi161.stdout:4/761: read dd/d36/d3f/fa9 [1597622,78427] 0 2023-12-09T02:35:17.880 INFO:tasks.workunit.client.1.smithi161.stdout:1/723: mknod d6/d8/d63/d4d/dd0/cf0 0 2023-12-09T02:35:17.884 INFO:tasks.workunit.client.1.smithi161.stdout:4/762: mknod dd/d1a/d1d/d25/d32/cf5 0 2023-12-09T02:35:17.886 INFO:tasks.workunit.client.1.smithi161.stdout:1/724: getdents d6/d8/d63/d4d/d31/d80/d87 0 2023-12-09T02:35:17.888 INFO:tasks.workunit.client.1.smithi161.stdout:4/763: creat dd/d1a/d1d/d25/d32/dd0/ff6 x:0 0 0 2023-12-09T02:35:17.889 INFO:tasks.workunit.client.1.smithi161.stdout:4/764: dread - dd/d1a/d1d/f8e zero size 2023-12-09T02:35:17.893 INFO:tasks.workunit.client.1.smithi161.stdout:2/647: dwrite f1 [0,4194304] 0 2023-12-09T02:35:17.893 INFO:tasks.workunit.client.1.smithi161.stdout:1/725: creat d6/d8/d63/d4d/dd0/ff1 x:0 0 0 2023-12-09T02:35:17.893 INFO:tasks.workunit.client.1.smithi161.stdout:4/765: mknod dd/d36/d3f/d54/cf7 0 2023-12-09T02:35:17.895 INFO:tasks.workunit.client.1.smithi161.stdout:2/648: creat d4/d1a/dc2/fd6 x:0 0 0 2023-12-09T02:35:17.900 INFO:tasks.workunit.client.1.smithi161.stdout:1/726: mkdir d6/d8/df2 0 2023-12-09T02:35:17.901 INFO:tasks.workunit.client.1.smithi161.stdout:1/727: chown d6/d8/d63/d4d/f3b 229 1 2023-12-09T02:35:17.901 INFO:tasks.workunit.client.1.smithi161.stdout:4/766: dread dd/d36/d4a/d5f/f7c [0,4194304] 0 2023-12-09T02:35:17.901 INFO:tasks.workunit.client.1.smithi161.stdout:4/767: rename dd/d1a/d1d to dd/d1a/d1d/d25/d3a/df0/df8 22 2023-12-09T02:35:17.908 INFO:tasks.workunit.client.1.smithi161.stdout:2/649: dread d4/d16/d69/d7b/f54 [0,4194304] 0 2023-12-09T02:35:17.908 INFO:tasks.workunit.client.1.smithi161.stdout:2/650: truncate d4/d16/d69/d8c/d87/f97 139695 0 2023-12-09T02:35:17.908 INFO:tasks.workunit.client.1.smithi161.stdout:2/651: truncate d4/d16/d69/d7b/fab 1001785 0 2023-12-09T02:35:17.928 INFO:tasks.workunit.client.1.smithi161.stdout:1/728: dwrite d6/d8/d63/d4d/d31/d73/d47/fa6 [0,4194304] 0 2023-12-09T02:35:17.929 INFO:tasks.workunit.client.1.smithi161.stdout:4/768: dwrite dd/fee [0,4194304] 0 2023-12-09T02:35:17.929 INFO:tasks.workunit.client.1.smithi161.stdout:4/769: stat dd/d5a/ddb 0 2023-12-09T02:35:17.929 INFO:tasks.workunit.client.1.smithi161.stdout:2/652: dwrite d4/d7/f2b [0,4194304] 0 2023-12-09T02:35:17.930 INFO:tasks.workunit.client.1.smithi161.stdout:2/653: write d4/d16/d69/d7b/f4e [3604912,48913] 0 2023-12-09T02:35:17.937 INFO:tasks.workunit.client.1.smithi161.stdout:2/654: mknod d4/d16/d69/cd7 0 2023-12-09T02:35:17.939 INFO:tasks.workunit.client.1.smithi161.stdout:1/729: rename d6/d8/df2 to d6/d8/d63/d93/df3 0 2023-12-09T02:35:17.942 INFO:tasks.workunit.client.1.smithi161.stdout:4/770: rename dd/d5a to dd/d36/d4a/d5f/d65/df9 0 2023-12-09T02:35:17.942 INFO:tasks.workunit.client.1.smithi161.stdout:4/771: write dd/d36/d4a/d88/d8a/db3/fd7 [735930,103234] 0 2023-12-09T02:35:17.943 INFO:tasks.workunit.client.1.smithi161.stdout:4/772: rename dd/d1a/d1d/d25/d32/cf5 to dd/d36/d4a/d88/dcd/cfa 0 2023-12-09T02:35:17.946 INFO:tasks.workunit.client.1.smithi161.stdout:4/773: mknod dd/d1a/cfb 0 2023-12-09T02:35:17.948 INFO:tasks.workunit.client.1.smithi161.stdout:4/774: unlink dd/d36/d4a/d5f/d65/fce 0 2023-12-09T02:35:17.949 INFO:tasks.workunit.client.1.smithi161.stdout:4/775: write dd/d1a/d1d/d25/d32/f41 [820645,12293] 0 2023-12-09T02:35:17.965 INFO:tasks.workunit.client.1.smithi161.stdout:4/776: dwrite dd/d36/d3f/fc1 [0,4194304] 0 2023-12-09T02:35:17.968 INFO:tasks.workunit.client.1.smithi161.stdout:4/777: mkdir dd/d1a/d1d/d25/dfc 0 2023-12-09T02:35:17.969 INFO:tasks.workunit.client.1.smithi161.stdout:4/778: symlink dd/d36/d4a/d5f/d65/lfd 0 2023-12-09T02:35:17.971 INFO:tasks.workunit.client.1.smithi161.stdout:4/779: unlink dd/d1a/d1d/f49 0 2023-12-09T02:35:17.972 INFO:tasks.workunit.client.1.smithi161.stdout:4/780: rmdir dd/d1a/d1d/d25/d32 39 2023-12-09T02:35:17.974 INFO:tasks.workunit.client.1.smithi161.stdout:4/781: creat dd/d1a/d1d/d25/d3a/ffe x:0 0 0 2023-12-09T02:35:17.974 INFO:tasks.workunit.client.1.smithi161.stdout:4/782: write dd/d1a/d23/d6a/fa7 [220536,64101] 0 2023-12-09T02:35:17.974 INFO:tasks.workunit.client.1.smithi161.stdout:4/783: dread - dd/d36/d4a/fc9 zero size 2023-12-09T02:35:17.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:17 smithi088 ceph-mon[112028]: pgmap v5: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail 2023-12-09T02:35:17.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:17 smithi088 ceph-mon[112028]: mgrmap e24: smithi161.qmxtmg(active, since 4s) 2023-12-09T02:35:18.033 INFO:tasks.workunit.client.1.smithi161.stdout:4/784: dwrite dd/d1a/d1d/d25/d4e/fb2 [0,4194304] 0 2023-12-09T02:35:18.035 INFO:tasks.workunit.client.1.smithi161.stdout:4/785: mkdir dd/d36/d3f/d54/dff 0 2023-12-09T02:35:18.040 INFO:tasks.workunit.client.1.smithi161.stdout:8/543: sync 2023-12-09T02:35:18.040 INFO:tasks.workunit.client.1.smithi161.stdout:8/544: getdents d2/d5/d22/d31/da0 0 2023-12-09T02:35:18.040 INFO:tasks.workunit.client.1.smithi161.stdout:8/545: chown d2/d5/c3f 121 1 2023-12-09T02:35:18.044 INFO:tasks.workunit.client.1.smithi161.stdout:4/786: dread dd/d1a/d1d/d25/d4e/fb7 [0,4194304] 0 2023-12-09T02:35:18.045 INFO:tasks.workunit.client.1.smithi161.stdout:8/546: dread d2/d5/d3d/f6f [0,4194304] 0 2023-12-09T02:35:18.046 INFO:tasks.workunit.client.1.smithi161.stdout:4/787: symlink dd/d1a/d1d/d25/l100 0 2023-12-09T02:35:18.050 INFO:tasks.workunit.client.1.smithi161.stdout:8/547: rename d2/d5/d22/d31/d38/d48/da2 to d2/d5/d4f/db2 0 2023-12-09T02:35:18.050 INFO:tasks.workunit.client.1.smithi161.stdout:8/548: chown d2/d5/d22/d54/d9e 235688371 1 2023-12-09T02:35:18.053 INFO:tasks.workunit.client.1.smithi161.stdout:4/788: mkdir dd/d36/d4a/d5f/dc7/d101 0 2023-12-09T02:35:18.055 INFO:tasks.workunit.client.1.smithi161.stdout:8/549: creat d2/d5/d22/d31/da0/fb3 x:0 0 0 2023-12-09T02:35:18.062 INFO:tasks.workunit.client.1.smithi161.stdout:4/789: rename dd/d1a/d1d to dd/d36/d3f/d54/d102 0 2023-12-09T02:35:18.066 INFO:tasks.workunit.client.1.smithi161.stdout:8/550: rename d2/d5/d22/d31/d38/d48/d4e to d2/d5/d22/d54/db4 0 2023-12-09T02:35:18.070 INFO:tasks.workunit.client.1.smithi161.stdout:4/790: creat dd/d36/d3f/d54/d102/d25/d3a/f103 x:0 0 0 2023-12-09T02:35:18.074 INFO:tasks.workunit.client.1.smithi161.stdout:8/551: mknod d2/d5/d22/d31/da0/cb5 0 2023-12-09T02:35:18.077 INFO:tasks.workunit.client.1.smithi161.stdout:4/791: write dd/f19 [6459606,20155] 0 2023-12-09T02:35:18.080 INFO:tasks.workunit.client.1.smithi161.stdout:8/552: unlink d2/d5/d22/d31/d38/f89 0 2023-12-09T02:35:18.080 INFO:tasks.workunit.client.1.smithi161.stdout:8/553: write d2/d5/d22/fa3 [3314754,120829] 0 2023-12-09T02:35:18.081 INFO:tasks.workunit.client.1.smithi161.stdout:8/554: truncate d2/d5/d22/d31/d38/d48/f75 689916 0 2023-12-09T02:35:18.083 INFO:tasks.workunit.client.1.smithi161.stdout:8/555: rmdir d2/d5/d22/d31/d38/d84 39 2023-12-09T02:35:18.083 INFO:tasks.workunit.client.1.smithi161.stdout:8/556: chown d2/d5/d3d/c83 0 1 2023-12-09T02:35:18.083 INFO:tasks.workunit.client.1.smithi161.stdout:8/557: write d2/d5/d22/d31/d38/f4d [2680620,71027] 0 2023-12-09T02:35:18.083 INFO:tasks.workunit.client.1.smithi161.stdout:8/558: chown d2/d5/d22/d31/c9a 11 1 2023-12-09T02:35:18.084 INFO:tasks.workunit.client.1.smithi161.stdout:8/559: write d2/d5/d22/d76/f85 [795075,70088] 0 2023-12-09T02:35:18.084 INFO:tasks.workunit.client.1.smithi161.stdout:8/560: chown d2/d5/le 69505 1 2023-12-09T02:35:18.097 INFO:tasks.workunit.client.1.smithi161.stdout:8/561: dwrite d2/d5/d22/d31/d38/d66/d88/da5/fae [0,4194304] 0 2023-12-09T02:35:18.102 INFO:tasks.workunit.client.1.smithi161.stdout:8/562: rename d2/d5/d22/d86/l9b to d2/lb6 0 2023-12-09T02:35:18.102 INFO:tasks.workunit.client.1.smithi161.stdout:8/563: write d2/d5/d22/d31/d38/d66/d88/da1/fb0 [640287,57126] 0 2023-12-09T02:35:18.102 INFO:tasks.workunit.client.1.smithi161.stdout:8/564: fdatasync d2/d5/d22/d54/db4/f78 0 2023-12-09T02:35:18.106 INFO:tasks.workunit.client.1.smithi161.stdout:8/565: symlink d2/d5/d22/d31/d38/d48/lb7 0 2023-12-09T02:35:18.109 INFO:tasks.workunit.client.1.smithi161.stdout:8/566: symlink d2/d5/d22/d54/d9e/lb8 0 2023-12-09T02:35:18.109 INFO:tasks.workunit.client.1.smithi161.stdout:8/567: write d2/d5/d22/d86/f9d [526340,58334] 0 2023-12-09T02:35:18.114 INFO:tasks.workunit.client.1.smithi161.stdout:8/568: mknod d2/d5/d22/d31/d38/d66/cb9 0 2023-12-09T02:35:18.114 INFO:tasks.workunit.client.1.smithi161.stdout:8/569: chown d2/d5/d22/d31/f37 58336542 1 2023-12-09T02:35:18.114 INFO:tasks.workunit.client.1.smithi161.stdout:8/570: chown d2/d5/d22/d31 2851 1 2023-12-09T02:35:18.114 INFO:tasks.workunit.client.1.smithi161.stdout:8/571: stat d2/d5/d22/d31/da0/fb3 0 2023-12-09T02:35:18.114 INFO:tasks.workunit.client.1.smithi161.stdout:8/572: fsync d2/fc 0 2023-12-09T02:35:18.119 INFO:tasks.workunit.client.1.smithi161.stdout:8/573: dread d2/d5/d22/d76/f85 [0,4194304] 0 2023-12-09T02:35:18.124 INFO:tasks.workunit.client.1.smithi161.stdout:8/574: creat d2/d5/d22/d31/d38/d66/d88/da1/fba x:0 0 0 2023-12-09T02:35:18.124 INFO:tasks.workunit.client.1.smithi161.stdout:8/575: fdatasync d2/d5/f6b 0 2023-12-09T02:35:18.124 INFO:tasks.workunit.client.1.smithi161.stdout:8/576: chown d2/d5/d22/d31/d38/d48/f75 183263539 1 2023-12-09T02:35:18.124 INFO:tasks.workunit.client.1.smithi161.stdout:8/577: read - d2/d5/d22/d31/f8b zero size 2023-12-09T02:35:18.164 INFO:tasks.workunit.client.1.smithi161.stdout:5/573: sync 2023-12-09T02:35:18.164 INFO:tasks.workunit.client.1.smithi161.stdout:6/558: sync 2023-12-09T02:35:18.165 INFO:tasks.workunit.client.1.smithi161.stdout:7/602: sync 2023-12-09T02:35:18.165 INFO:tasks.workunit.client.1.smithi161.stdout:6/559: chown da/d19/dc2/d4d/d5e/f98 3 1 2023-12-09T02:35:18.165 INFO:tasks.workunit.client.1.smithi161.stdout:7/603: write d0/d49/f4c [9407938,13180] 0 2023-12-09T02:35:18.165 INFO:tasks.workunit.client.1.smithi161.stdout:7/604: fsync d0/d3/d13/d2f/d50/f7e 0 2023-12-09T02:35:18.165 INFO:tasks.workunit.client.1.smithi161.stdout:0/600: sync 2023-12-09T02:35:18.165 INFO:tasks.workunit.client.1.smithi161.stdout:3/527: sync 2023-12-09T02:35:18.165 INFO:tasks.workunit.client.1.smithi161.stdout:0/601: dread - d9/d55/d86/d98/fac zero size 2023-12-09T02:35:18.185 INFO:tasks.workunit.client.1.smithi161.stdout:5/574: mknod d0/d2/de/d44/da6/ccb 0 2023-12-09T02:35:18.186 INFO:tasks.workunit.client.1.smithi161.stdout:6/560: creat da/d19/fc7 x:0 0 0 2023-12-09T02:35:18.187 INFO:tasks.workunit.client.1.smithi161.stdout:6/561: write da/d19/dc2/d29/d2b/d31/f51 [1186065,22682] 0 2023-12-09T02:35:18.187 INFO:tasks.workunit.client.1.smithi161.stdout:6/562: truncate da/d19/dc2/d29/f62 638939 0 2023-12-09T02:35:18.187 INFO:tasks.workunit.client.1.smithi161.stdout:6/563: chown da/d19/dc2/d29/d2b 20756 1 2023-12-09T02:35:18.188 INFO:tasks.workunit.client.1.smithi161.stdout:7/605: mkdir d0/d49/d79/dc3 0 2023-12-09T02:35:18.188 INFO:tasks.workunit.client.1.smithi161.stdout:7/606: readlink d0/d49/d67/d71/la2 0 2023-12-09T02:35:18.189 INFO:tasks.workunit.client.1.smithi161.stdout:3/528: link d2/d51/d75/d11/d19/d91/d46/c52 d2/d51/d75/d11/d1f/d74/c97 0 2023-12-09T02:35:18.189 INFO:tasks.workunit.client.1.smithi161.stdout:3/529: fsync d2/d51/d75/d11/d7b/f85 0 2023-12-09T02:35:18.192 INFO:tasks.workunit.client.1.smithi161.stdout:5/575: creat d0/d2/fcc x:0 0 0 2023-12-09T02:35:18.192 INFO:tasks.workunit.client.1.smithi161.stdout:5/576: stat d0/d2/d7/lb2 0 2023-12-09T02:35:18.200 INFO:tasks.workunit.client.1.smithi161.stdout:7/607: creat d0/d3/d6a/fc4 x:0 0 0 2023-12-09T02:35:18.200 INFO:tasks.workunit.client.1.smithi161.stdout:7/608: write d0/d3/f17 [2103113,64724] 0 2023-12-09T02:35:18.201 INFO:tasks.workunit.client.1.smithi161.stdout:7/609: truncate d0/d3/d9e/d59/d5e/fa6 999868 0 2023-12-09T02:35:18.202 INFO:tasks.workunit.client.1.smithi161.stdout:3/530: mknod d2/d51/d75/d11/d19/c98 0 2023-12-09T02:35:18.202 INFO:tasks.workunit.client.1.smithi161.stdout:3/531: fsync d2/d51/d75/d11/d1f/d7a/d96/f67 0 2023-12-09T02:35:18.212 INFO:tasks.workunit.client.1.smithi161.stdout:5/577: dwrite d0/d2/de/d22/f59 [8388608,4194304] 0 2023-12-09T02:35:18.223 INFO:tasks.workunit.client.1.smithi161.stdout:3/532: dwrite d2/d51/d75/d11/d1f/d7a/d96/f67 [0,4194304] 0 2023-12-09T02:35:18.228 INFO:tasks.workunit.client.1.smithi161.stdout:7/610: dwrite d0/d49/d79/f93 [0,4194304] 0 2023-12-09T02:35:18.234 INFO:tasks.workunit.client.1.smithi161.stdout:7/611: mknod d0/d49/d67/cc5 0 2023-12-09T02:35:18.248 INFO:tasks.workunit.client.1.smithi161.stdout:7/612: dread d0/d3/f7 [0,4194304] 0 2023-12-09T02:35:18.249 INFO:tasks.workunit.client.1.smithi161.stdout:7/613: creat d0/d3/d13/d2d/d43/d4b/d5a/fc6 x:0 0 0 2023-12-09T02:35:18.251 INFO:tasks.workunit.client.1.smithi161.stdout:5/578: rename d0/d2/d7/df/d60 to d0/d2/de/d22/d8e/d8f/dcd 0 2023-12-09T02:35:18.253 INFO:tasks.workunit.client.1.smithi161.stdout:5/579: mkdir d0/d2/de/d21/dce 0 2023-12-09T02:35:18.254 INFO:tasks.workunit.client.1.smithi161.stdout:5/580: rmdir d0/d2/d7/d11/d61 39 2023-12-09T02:35:18.256 INFO:tasks.workunit.client.1.smithi161.stdout:5/581: link d0/d2/d7/l8d d0/d2/de/d22/d8e/d8f/dcd/d83/lcf 0 2023-12-09T02:35:18.256 INFO:tasks.workunit.client.1.smithi161.stdout:5/582: chown d0/d2/d7/d11/d50/f8c 15 1 2023-12-09T02:35:18.256 INFO:tasks.workunit.client.1.smithi161.stdout:5/583: fsync d0/d2/d7/d51/f7e 0 2023-12-09T02:35:18.259 INFO:tasks.workunit.client.1.smithi161.stdout:5/584: creat d0/d2/de/d44/fd0 x:0 0 0 2023-12-09T02:35:18.260 INFO:tasks.workunit.client.1.smithi161.stdout:5/585: creat d0/d2/d5f/fd1 x:0 0 0 2023-12-09T02:35:18.268 INFO:tasks.workunit.client.1.smithi161.stdout:6/564: truncate da/d19/dc2/d29/d2b/d31/f51 1618211 0 2023-12-09T02:35:18.269 INFO:tasks.workunit.client.1.smithi161.stdout:6/565: read da/d55/f86 [1529332,15692] 0 2023-12-09T02:35:18.271 INFO:tasks.workunit.client.1.smithi161.stdout:6/566: creat da/d19/dc2/d77/fc8 x:0 0 0 2023-12-09T02:35:18.285 INFO:tasks.workunit.client.1.smithi161.stdout:3/533: rename d2/d51/d75/d11/d19/d91/d46/d3e to d2/d37/d99 0 2023-12-09T02:35:18.285 INFO:tasks.workunit.client.1.smithi161.stdout:3/534: stat d2 0 2023-12-09T02:35:18.289 INFO:tasks.workunit.client.1.smithi161.stdout:7/614: rename d0/d3/d13/d2f/d50 to d0/d3/d13/dc7 0 2023-12-09T02:35:18.291 INFO:tasks.workunit.client.1.smithi161.stdout:6/567: rename da/d19/dc2/d4d/d5e/l8e to da/d19/dc2/d9e/lc9 0 2023-12-09T02:35:18.292 INFO:tasks.workunit.client.1.smithi161.stdout:6/568: fsync da/d19/dc2/d29/f62 0 2023-12-09T02:35:18.292 INFO:tasks.workunit.client.1.smithi161.stdout:3/535: dread d2/d51/d75/d11/d19/d91/f2b [0,4194304] 0 2023-12-09T02:35:18.292 INFO:tasks.workunit.client.1.smithi161.stdout:3/536: stat d2/d51/d75/d11/d1f/d7a/d96/d78 0 2023-12-09T02:35:18.292 INFO:tasks.workunit.client.1.smithi161.stdout:3/537: stat d2/d51/d75 0 2023-12-09T02:35:18.293 INFO:tasks.workunit.client.1.smithi161.stdout:7/615: mkdir d0/d3/d13/dc7/dc8 0 2023-12-09T02:35:18.294 INFO:tasks.workunit.client.1.smithi161.stdout:6/569: write da/d19/dc2/d3c/f91 [2001758,76176] 0 2023-12-09T02:35:18.296 INFO:tasks.workunit.client.1.smithi161.stdout:3/538: link d2/d51/d75/d11/d19/d91/d46/d2d/d47/f60 d2/d51/d75/d11/d19/d91/d46/d5e/f9a 0 2023-12-09T02:35:18.297 INFO:tasks.workunit.client.1.smithi161.stdout:7/616: truncate d0/d3/d13/d1b/f3f 4106274 0 2023-12-09T02:35:18.300 INFO:tasks.workunit.client.1.smithi161.stdout:6/570: symlink da/d19/dc2/d9e/lca 0 2023-12-09T02:35:18.302 INFO:tasks.workunit.client.1.smithi161.stdout:3/539: rename d2/d51/d75/d11/d19/d91/d46/d2d/d4e/l55 to d2/d51/d75/d50/d69/l9b 0 2023-12-09T02:35:18.304 INFO:tasks.workunit.client.1.smithi161.stdout:6/571: link da/df/d2d/c5d da/d19/dc2/d4d/d5e/ccb 0 2023-12-09T02:35:18.304 INFO:tasks.workunit.client.1.smithi161.stdout:6/572: dread - da/df/f27 zero size 2023-12-09T02:35:18.305 INFO:tasks.workunit.client.1.smithi161.stdout:6/573: unlink da/d19/dc2/d29/cc3 0 2023-12-09T02:35:18.307 INFO:tasks.workunit.client.1.smithi161.stdout:6/574: link da/d55/d6d/d85/fb6 da/df/d2d/d49/fcc 0 2023-12-09T02:35:18.307 INFO:tasks.workunit.client.1.smithi161.stdout:6/575: dread - da/d19/dc2/d29/d2b/f7e zero size 2023-12-09T02:35:18.307 INFO:tasks.workunit.client.1.smithi161.stdout:6/576: write da/fd [4524828,20128] 0 2023-12-09T02:35:18.307 INFO:tasks.workunit.client.1.smithi161.stdout:6/577: fsync da/d19/dc2/d4d/d5e/f6c 0 2023-12-09T02:35:18.312 INFO:tasks.workunit.client.1.smithi161.stdout:5/586: getdents d0/d2/de/d21 0 2023-12-09T02:35:18.313 INFO:tasks.workunit.client.1.smithi161.stdout:5/587: creat d0/d2/fd2 x:0 0 0 2023-12-09T02:35:18.313 INFO:tasks.workunit.client.1.smithi161.stdout:5/588: fdatasync d0/d2/d7/d9a/f9c 0 2023-12-09T02:35:18.323 INFO:tasks.workunit.client.1.smithi161.stdout:5/589: write d0/d2/d7/d11/f41 [2612057,66659] 0 2023-12-09T02:35:18.323 INFO:tasks.workunit.client.1.smithi161.stdout:7/617: dwrite d0/d3/d13/d1b/f2b [4194304,4194304] 0 2023-12-09T02:35:18.323 INFO:tasks.workunit.client.1.smithi161.stdout:7/618: readlink d0/d3/d13/d2d/d43/lbd 0 2023-12-09T02:35:18.325 INFO:tasks.workunit.client.1.smithi161.stdout:5/590: unlink d0/f3d 0 2023-12-09T02:35:18.326 INFO:tasks.workunit.client.1.smithi161.stdout:5/591: write d0/d2/fcc [633608,112911] 0 2023-12-09T02:35:18.326 INFO:tasks.workunit.client.1.smithi161.stdout:5/592: chown d0/d2/d5f/f64 9701901 1 2023-12-09T02:35:18.334 INFO:tasks.workunit.client.1.smithi161.stdout:6/578: dwrite da/f12 [0,4194304] 0 2023-12-09T02:35:18.334 INFO:tasks.workunit.client.1.smithi161.stdout:6/579: dread - da/df/f9c zero size 2023-12-09T02:35:18.335 INFO:tasks.workunit.client.1.smithi161.stdout:6/580: chown da/d19/dc2/d77/d79/l7b 120 1 2023-12-09T02:35:18.343 INFO:tasks.workunit.client.1.smithi161.stdout:5/593: dwrite d0/d2/d5f/f64 [0,4194304] 0 2023-12-09T02:35:18.343 INFO:tasks.workunit.client.1.smithi161.stdout:5/594: readlink d0/d2/d7/d51/l52 0 2023-12-09T02:35:18.385 INFO:tasks.workunit.client.1.smithi161.stdout:7/619: dwrite d0/d3/d13/f26 [0,4194304] 0 2023-12-09T02:35:18.385 INFO:tasks.workunit.client.1.smithi161.stdout:5/595: mknod d0/d2/d7/df/cd3 0 2023-12-09T02:35:18.390 INFO:tasks.workunit.client.1.smithi161.stdout:6/581: dwrite da/d19/dc2/d77/d79/f7a [0,4194304] 0 2023-12-09T02:35:18.392 INFO:tasks.workunit.client.1.smithi161.stdout:7/620: mkdir d0/d3/d6a/dc9 0 2023-12-09T02:35:18.393 INFO:tasks.workunit.client.1.smithi161.stdout:7/621: dread d0/d49/f90 [0,4194304] 0 2023-12-09T02:35:18.394 INFO:tasks.workunit.client.1.smithi161.stdout:5/596: symlink d0/d2/d7/d11/dc3/db6/ld4 0 2023-12-09T02:35:18.396 INFO:tasks.workunit.client.1.smithi161.stdout:6/582: symlink da/d55/d6d/d85/lcd 0 2023-12-09T02:35:18.396 INFO:tasks.workunit.client.1.smithi161.stdout:6/583: write da/d19/dc2/d4d/d5e/f98 [8391545,113559] 0 2023-12-09T02:35:18.398 INFO:tasks.workunit.client.1.smithi161.stdout:7/622: creat d0/d3/d13/d2d/d43/d4b/d99/fca x:0 0 0 2023-12-09T02:35:18.399 INFO:tasks.workunit.client.1.smithi161.stdout:5/597: creat d0/d2/d7/d11/dc3/db6/fd5 x:0 0 0 2023-12-09T02:35:18.399 INFO:tasks.workunit.client.1.smithi161.stdout:5/598: fdatasync d0/d2/de/d22/d8e/d8f/dcd/f93 0 2023-12-09T02:35:18.400 INFO:tasks.workunit.client.1.smithi161.stdout:5/599: dread d0/d2/de/d22/d8e/d8f/dcd/da8/fc2 [0,4194304] 0 2023-12-09T02:35:18.401 INFO:tasks.workunit.client.1.smithi161.stdout:6/584: truncate da/df/f99 2389521 0 2023-12-09T02:35:18.411 INFO:tasks.workunit.client.1.smithi161.stdout:6/585: dread f1 [0,4194304] 0 2023-12-09T02:35:18.413 INFO:tasks.workunit.client.1.smithi161.stdout:6/586: creat da/d55/d6d/d85/fce x:0 0 0 2023-12-09T02:35:18.413 INFO:tasks.workunit.client.1.smithi161.stdout:6/587: write da/d19/f23 [4935217,24177] 0 2023-12-09T02:35:18.419 INFO:tasks.workunit.client.1.smithi161.stdout:5/600: dwrite d0/d2/d5f/f64 [4194304,4194304] 0 2023-12-09T02:35:18.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:17 smithi161 ceph-mon[121170]: pgmap v5: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail 2023-12-09T02:35:18.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:17 smithi161 ceph-mon[121170]: mgrmap e24: smithi161.qmxtmg(active, since 4s) 2023-12-09T02:35:18.422 INFO:tasks.workunit.client.1.smithi161.stdout:5/601: write d0/d2/de/d21/f73 [570946,76207] 0 2023-12-09T02:35:18.423 INFO:tasks.workunit.client.1.smithi161.stdout:9/569: sync 2023-12-09T02:35:18.423 INFO:tasks.workunit.client.1.smithi161.stdout:2/655: sync 2023-12-09T02:35:18.424 INFO:tasks.workunit.client.1.smithi161.stdout:5/602: symlink d0/d2/de/d22/d55/ld6 0 2023-12-09T02:35:18.425 INFO:tasks.workunit.client.1.smithi161.stdout:9/570: mkdir d2/dc3 0 2023-12-09T02:35:18.425 INFO:tasks.workunit.client.1.smithi161.stdout:9/571: write d2/d25/db1/f85 [1025460,86287] 0 2023-12-09T02:35:18.426 INFO:tasks.workunit.client.1.smithi161.stdout:7/623: dwrite d0/d3/d9e/f82 [0,4194304] 0 2023-12-09T02:35:18.426 INFO:tasks.workunit.client.1.smithi161.stdout:5/603: dread d0/d2/d7/df/f96 [0,4194304] 0 2023-12-09T02:35:18.426 INFO:tasks.workunit.client.1.smithi161.stdout:5/604: chown d0/l2f 3317 1 2023-12-09T02:35:18.427 INFO:tasks.workunit.client.1.smithi161.stdout:9/572: mknod d2/d25/db1/d65/d42/cc4 0 2023-12-09T02:35:18.430 INFO:tasks.workunit.client.1.smithi161.stdout:7/624: truncate d0/d3/f8 1320676 0 2023-12-09T02:35:18.432 INFO:tasks.workunit.client.1.smithi161.stdout:5/605: creat d0/d2/d7/d9a/fd7 x:0 0 0 2023-12-09T02:35:18.433 INFO:tasks.workunit.client.1.smithi161.stdout:9/573: creat d2/d25/db1/d65/d5c/d55/d66/d83/d90/d95/fc5 x:0 0 0 2023-12-09T02:35:18.439 INFO:tasks.workunit.client.1.smithi161.stdout:9/574: dread d2/d25/db1/f8e [0,4194304] 0 2023-12-09T02:35:18.440 INFO:tasks.workunit.client.1.smithi161.stdout:7/625: rename d0/d3/d9e to d0/d3/d13/d2d/d43/dcb 0 2023-12-09T02:35:18.443 INFO:tasks.workunit.client.1.smithi161.stdout:6/588: dwrite da/d19/dc2/d29/d2b/d31/f66 [0,4194304] 0 2023-12-09T02:35:18.443 INFO:tasks.workunit.client.1.smithi161.stdout:6/589: chown da/df/f14 325 1 2023-12-09T02:35:18.444 INFO:tasks.workunit.client.1.smithi161.stdout:6/590: write da/d19/dc2/f67 [482750,58741] 0 2023-12-09T02:35:18.444 INFO:tasks.workunit.client.1.smithi161.stdout:6/591: write da/d55/d6d/d85/fb6 [744290,81606] 0 2023-12-09T02:35:18.445 INFO:tasks.workunit.client.1.smithi161.stdout:9/575: truncate d2/d25/db1/d65/d42/d58/d91/d2e/f45 299647 0 2023-12-09T02:35:18.445 INFO:tasks.workunit.client.1.smithi161.stdout:2/656: dwrite d4/d16/d69/d8c/fd1 [0,4194304] 0 2023-12-09T02:35:18.447 INFO:tasks.workunit.client.1.smithi161.stdout:6/592: write da/d19/dc2/d3c/f91 [2682941,3768] 0 2023-12-09T02:35:18.447 INFO:tasks.workunit.client.1.smithi161.stdout:5/606: dwrite d0/f9e [0,4194304] 0 2023-12-09T02:35:18.447 INFO:tasks.workunit.client.1.smithi161.stdout:9/576: creat d2/d25/db1/d65/d42/d58/d91/d51/fc6 x:0 0 0 2023-12-09T02:35:18.452 INFO:tasks.workunit.client.1.smithi161.stdout:2/657: symlink d4/d16/d69/d8c/d87/ld8 0 2023-12-09T02:35:18.452 INFO:tasks.workunit.client.1.smithi161.stdout:2/658: chown d4/d16/d69/d7b/fc4 60 1 2023-12-09T02:35:18.461 INFO:tasks.workunit.client.1.smithi161.stdout:7/626: dwrite d0/d3/d13/d4e/db5/d83/f97 [0,4194304] 0 2023-12-09T02:35:18.461 INFO:tasks.workunit.client.1.smithi161.stdout:7/627: readlink d0/d3/d13/d2d/d43/dcb/d59/l60 0 2023-12-09T02:35:18.461 INFO:tasks.workunit.client.1.smithi161.stdout:6/593: fsync da/d19/dc2/d4d/d5e/f98 0 2023-12-09T02:35:18.466 INFO:tasks.workunit.client.1.smithi161.stdout:5/607: creat d0/d2/de/d22/d8e/fd8 x:0 0 0 2023-12-09T02:35:18.466 INFO:tasks.workunit.client.1.smithi161.stdout:9/577: symlink d2/d25/db1/d4d/lc7 0 2023-12-09T02:35:18.469 INFO:tasks.workunit.client.1.smithi161.stdout:2/659: rename d4/d7/f2b to d4/d7/d8f/dd2/fd9 0 2023-12-09T02:35:18.477 INFO:tasks.workunit.client.1.smithi161.stdout:7/628: symlink d0/d3/d13/d4e/db5/d83/lcc 0 2023-12-09T02:35:18.478 INFO:tasks.workunit.client.1.smithi161.stdout:7/629: write d0/d3/d13/f1f [2405758,28621] 0 2023-12-09T02:35:18.478 INFO:tasks.workunit.client.1.smithi161.stdout:6/594: truncate da/df/f99 1600179 0 2023-12-09T02:35:18.480 INFO:tasks.workunit.client.1.smithi161.stdout:7/630: read d0/d3/d13/d4e/db2/f41 [3075258,108512] 0 2023-12-09T02:35:18.480 INFO:tasks.workunit.client.1.smithi161.stdout:7/631: fdatasync d0/d3/f66 0 2023-12-09T02:35:18.482 INFO:tasks.workunit.client.1.smithi161.stdout:5/608: mkdir d0/d2/d7/d9a/dd9 0 2023-12-09T02:35:18.482 INFO:tasks.workunit.client.1.smithi161.stdout:5/609: write d0/d9/fbc [491307,37504] 0 2023-12-09T02:35:18.484 INFO:tasks.workunit.client.1.smithi161.stdout:9/578: mkdir d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/dc8 0 2023-12-09T02:35:18.486 INFO:tasks.workunit.client.1.smithi161.stdout:7/632: creat d0/d3/d13/d4e/db5/d83/fcd x:0 0 0 2023-12-09T02:35:18.489 INFO:tasks.workunit.client.1.smithi161.stdout:5/610: creat d0/d2/d7/fda x:0 0 0 2023-12-09T02:35:18.491 INFO:tasks.workunit.client.1.smithi161.stdout:9/579: truncate d2/d25/db1/d65/d42/d58/d91/d51/f6b 265912 0 2023-12-09T02:35:18.494 INFO:tasks.workunit.client.1.smithi161.stdout:7/633: unlink d0/fd 0 2023-12-09T02:35:18.494 INFO:tasks.workunit.client.1.smithi161.stdout:5/611: dread d0/d2/d7/d11/f37 [0,4194304] 0 2023-12-09T02:35:18.496 INFO:tasks.workunit.client.1.smithi161.stdout:9/580: symlink d2/d25/db1/d65/d5c/d55/d66/d83/d90/d95/lc9 0 2023-12-09T02:35:18.497 INFO:tasks.workunit.client.1.smithi161.stdout:9/581: fsync d2/d25/db1/d65/d88/f9d 0 2023-12-09T02:35:18.498 INFO:tasks.workunit.client.1.smithi161.stdout:5/612: rmdir d0/d2/d7/d9a/dd9 0 2023-12-09T02:35:18.498 INFO:tasks.workunit.client.1.smithi161.stdout:2/660: dwrite d4/d16/d69/d7b/f5c [0,4194304] 0 2023-12-09T02:35:18.499 INFO:tasks.workunit.client.1.smithi161.stdout:9/582: getdents d2/d25/db1/d65/d5c/d60/d7f 0 2023-12-09T02:35:18.501 INFO:tasks.workunit.client.1.smithi161.stdout:5/613: getdents d0/d2/de/d22/d8e/d8f/dcd/d83 0 2023-12-09T02:35:18.508 INFO:tasks.workunit.client.1.smithi161.stdout:2/661: creat d4/fda x:0 0 0 2023-12-09T02:35:18.508 INFO:tasks.workunit.client.1.smithi161.stdout:2/662: fdatasync d4/d16/d69/d8c/d87/f97 0 2023-12-09T02:35:18.511 INFO:tasks.workunit.client.1.smithi161.stdout:9/583: dread d2/d25/db1/d65/f43 [0,4194304] 0 2023-12-09T02:35:18.512 INFO:tasks.workunit.client.1.smithi161.stdout:2/663: link d4/fa0 d4/d1a/dc2/fdb 0 2023-12-09T02:35:18.512 INFO:tasks.workunit.client.1.smithi161.stdout:2/664: chown d4/d16/d69/c8e 195 1 2023-12-09T02:35:18.513 INFO:tasks.workunit.client.1.smithi161.stdout:6/595: dwrite da/d55/fc6 [0,4194304] 0 2023-12-09T02:35:18.513 INFO:tasks.workunit.client.1.smithi161.stdout:6/596: readlink da/d19/dc2/d29/d2b/l69 0 2023-12-09T02:35:18.515 INFO:tasks.workunit.client.1.smithi161.stdout:9/584: getdents d2/d25/db1/d65/d42/d58/d91/d51 0 2023-12-09T02:35:18.517 INFO:tasks.workunit.client.1.smithi161.stdout:2/665: unlink d4/d16/d69/d7b/fce 0 2023-12-09T02:35:18.519 INFO:tasks.workunit.client.1.smithi161.stdout:5/614: dwrite d0/d2/d7/df/f96 [0,4194304] 0 2023-12-09T02:35:18.524 INFO:tasks.workunit.client.1.smithi161.stdout:6/597: dread da/d55/d6d/fa6 [0,4194304] 0 2023-12-09T02:35:18.534 INFO:tasks.workunit.client.1.smithi161.stdout:9/585: creat d2/d25/dbf/fca x:0 0 0 2023-12-09T02:35:18.534 INFO:tasks.workunit.client.1.smithi161.stdout:9/586: stat d2/d25/db1/d65/d42/d58/d91/d2e/f45 0 2023-12-09T02:35:18.534 INFO:tasks.workunit.client.1.smithi161.stdout:9/587: chown d2/d25/db1/d65/d42/d58/c5d 2699 1 2023-12-09T02:35:18.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/666: symlink d4/d7/db/ldc 0 2023-12-09T02:35:18.537 INFO:tasks.workunit.client.1.smithi161.stdout:5/615: dwrite d0/d2/d7/d11/f37 [0,4194304] 0 2023-12-09T02:35:18.539 INFO:tasks.workunit.client.1.smithi161.stdout:6/598: dread da/d19/f72 [0,4194304] 0 2023-12-09T02:35:18.541 INFO:tasks.workunit.client.1.smithi161.stdout:9/588: mkdir d2/d25/db1/d65/d88/dcb 0 2023-12-09T02:35:18.542 INFO:tasks.workunit.client.1.smithi161.stdout:2/667: mknod d4/d1a/d4a/d6d/cdd 0 2023-12-09T02:35:18.549 INFO:tasks.workunit.client.1.smithi161.stdout:5/616: mknod d0/d2/d7/d9a/cdb 0 2023-12-09T02:35:18.550 INFO:tasks.workunit.client.1.smithi161.stdout:6/599: rename da/df/d2d/c4e to da/d19/d20/dbf/ccf 0 2023-12-09T02:35:18.553 INFO:tasks.workunit.client.1.smithi161.stdout:9/589: mkdir d2/d25/dbf/dcc 0 2023-12-09T02:35:18.553 INFO:tasks.workunit.client.1.smithi161.stdout:9/590: truncate d2/d25/dbf/fca 590134 0 2023-12-09T02:35:18.553 INFO:tasks.workunit.client.1.smithi161.stdout:9/591: fsync d2/d25/db1/d65/d42/d58/f21 0 2023-12-09T02:35:18.554 INFO:tasks.workunit.client.1.smithi161.stdout:2/668: creat d4/d7/d8f/dd2/fde x:0 0 0 2023-12-09T02:35:18.555 INFO:tasks.workunit.client.1.smithi161.stdout:5/617: symlink d0/d2/d7/d11/ldc 0 2023-12-09T02:35:18.556 INFO:tasks.workunit.client.1.smithi161.stdout:6/600: mknod da/d55/d6d/d85/cd0 0 2023-12-09T02:35:18.556 INFO:tasks.workunit.client.1.smithi161.stdout:6/601: write da/d19/dc2/d29/d2b/f7e [546468,13801] 0 2023-12-09T02:35:18.565 INFO:tasks.workunit.client.1.smithi161.stdout:9/592: creat d2/d25/db1/d65/d5c/fcd x:0 0 0 2023-12-09T02:35:18.569 INFO:tasks.workunit.client.1.smithi161.stdout:2/669: unlink f1 0 2023-12-09T02:35:18.569 INFO:tasks.workunit.client.1.smithi161.stdout:2/670: write d4/d16/d69/d8c/fd1 [5057165,14289] 0 2023-12-09T02:35:18.570 INFO:tasks.workunit.client.1.smithi161.stdout:2/671: chown d4/d16/d69/d7b 175 1 2023-12-09T02:35:18.570 INFO:tasks.workunit.client.1.smithi161.stdout:2/672: write d4/d16/d69/d8c/fb2 [3317512,111444] 0 2023-12-09T02:35:18.573 INFO:tasks.workunit.client.1.smithi161.stdout:6/602: mkdir da/d19/dc2/d3c/dd1 0 2023-12-09T02:35:18.573 INFO:tasks.workunit.client.1.smithi161.stdout:6/603: chown da/d19/dc2/d29/d2b/d31/cc4 18840660 1 2023-12-09T02:35:18.575 INFO:tasks.workunit.client.1.smithi161.stdout:9/593: unlink d2/d25/db1/d65/d42/d58/d91/d51/cad 0 2023-12-09T02:35:18.575 INFO:tasks.workunit.client.1.smithi161.stdout:9/594: truncate d2/d25/db1/d65/d5c/d55/d66/fbc 537098 0 2023-12-09T02:35:18.575 INFO:tasks.workunit.client.1.smithi161.stdout:9/595: fdatasync d2/d25/db1/d65/d42/d58/d91/f99 0 2023-12-09T02:35:18.577 INFO:tasks.workunit.client.1.smithi161.stdout:5/618: mkdir d0/d2/de/d44/ddd 0 2023-12-09T02:35:18.579 INFO:tasks.workunit.client.1.smithi161.stdout:6/604: dread da/d19/dc2/d29/d2b/f7e [0,4194304] 0 2023-12-09T02:35:18.580 INFO:tasks.workunit.client.1.smithi161.stdout:2/673: rename d4/d16/d69/d8c/d5a to d4/d16/d69/d8c/ddf 0 2023-12-09T02:35:18.580 INFO:tasks.workunit.client.1.smithi161.stdout:2/674: write d4/d16/d69/d8c/fcc [482476,101582] 0 2023-12-09T02:35:18.581 INFO:tasks.workunit.client.1.smithi161.stdout:2/675: chown d4/fb5 224 1 2023-12-09T02:35:18.581 INFO:tasks.workunit.client.1.smithi161.stdout:2/676: fsync d4/d7/db/fb1 0 2023-12-09T02:35:18.581 INFO:tasks.workunit.client.1.smithi161.stdout:9/596: symlink d2/d25/db1/d4d/d7d/lce 0 2023-12-09T02:35:18.582 INFO:tasks.workunit.client.1.smithi161.stdout:9/597: readlink d2/d25/db1/d65/d42/d58/d91/d2e/d80/l9c 0 2023-12-09T02:35:18.582 INFO:tasks.workunit.client.1.smithi161.stdout:5/619: mknod d0/d2/de/d21/cde 0 2023-12-09T02:35:18.582 INFO:tasks.workunit.client.1.smithi161.stdout:5/620: write d0/d2/d7/d11/d50/fb9 [558558,18456] 0 2023-12-09T02:35:18.585 INFO:tasks.workunit.client.1.smithi161.stdout:6/605: mkdir da/d19/dc2/dd2 0 2023-12-09T02:35:18.585 INFO:tasks.workunit.client.1.smithi161.stdout:6/606: write da/df/f9c [972886,110752] 0 2023-12-09T02:35:18.586 INFO:tasks.workunit.client.1.smithi161.stdout:2/677: truncate d4/d7/f31 3855786 0 2023-12-09T02:35:18.587 INFO:tasks.workunit.client.1.smithi161.stdout:9/598: symlink d2/d25/lcf 0 2023-12-09T02:35:18.590 INFO:tasks.workunit.client.1.smithi161.stdout:2/678: mkdir d4/d16/de0 0 2023-12-09T02:35:18.591 INFO:tasks.workunit.client.1.smithi161.stdout:9/599: mkdir d2/d25/db1/d65/d42/d58/d91/dd0 0 2023-12-09T02:35:18.592 INFO:tasks.workunit.client.1.smithi161.stdout:9/600: truncate d2/f3e 2673246 0 2023-12-09T02:35:18.595 INFO:tasks.workunit.client.1.smithi161.stdout:9/601: mkdir d2/d25/db1/d65/d5c/d55/d66/d83/dd1 0 2023-12-09T02:35:18.596 INFO:tasks.workunit.client.1.smithi161.stdout:9/602: getdents d2/d25/db1/d65/d42/d58/d91/d2e/d3f 0 2023-12-09T02:35:18.599 INFO:tasks.workunit.client.1.smithi161.stdout:1/730: sync 2023-12-09T02:35:18.599 INFO:tasks.workunit.client.1.smithi161.stdout:4/792: sync 2023-12-09T02:35:18.599 INFO:tasks.workunit.client.1.smithi161.stdout:8/578: sync 2023-12-09T02:35:18.599 INFO:tasks.workunit.client.1.smithi161.stdout:4/793: dread - dd/d36/d4a/d88/d8a/fe1 zero size 2023-12-09T02:35:18.600 INFO:tasks.workunit.client.1.smithi161.stdout:9/603: creat d2/d25/db1/d65/d42/d58/d91/d51/fd2 x:0 0 0 2023-12-09T02:35:18.601 INFO:tasks.workunit.client.1.smithi161.stdout:1/731: write d6/d8/d63/d93/f48 [1654207,12209] 0 2023-12-09T02:35:18.604 INFO:tasks.workunit.client.1.smithi161.stdout:4/794: symlink dd/d36/d4a/d88/dcd/l104 0 2023-12-09T02:35:18.604 INFO:tasks.workunit.client.1.smithi161.stdout:9/604: rmdir d2/d25/db1/d65/d5c/dac 39 2023-12-09T02:35:18.605 INFO:tasks.workunit.client.1.smithi161.stdout:9/605: dread d2/d25/db1/f8e [0,4194304] 0 2023-12-09T02:35:18.605 INFO:tasks.workunit.client.1.smithi161.stdout:9/606: chown d2/d25/db1/fa0 71012 1 2023-12-09T02:35:18.608 INFO:tasks.workunit.client.1.smithi161.stdout:1/732: rename d6/d8/d63/d4d/d31/d80/d87/de3/leb to d6/d8/d63/d1c/d8a/dcd/d9d/lf4 0 2023-12-09T02:35:18.608 INFO:tasks.workunit.client.1.smithi161.stdout:4/795: rmdir dd/d36/d4a/d5f/d65/df9 39 2023-12-09T02:35:18.613 INFO:tasks.workunit.client.1.smithi161.stdout:9/607: getdents d2/d25/db1/d65/d88 0 2023-12-09T02:35:18.613 INFO:tasks.workunit.client.1.smithi161.stdout:2/679: dwrite d4/d7/f4c [0,4194304] 0 2023-12-09T02:35:18.613 INFO:tasks.workunit.client.1.smithi161.stdout:1/733: creat d6/d9/ff5 x:0 0 0 2023-12-09T02:35:18.615 INFO:tasks.workunit.client.1.smithi161.stdout:9/608: mknod d2/d25/db1/d65/d5c/dac/cd3 0 2023-12-09T02:35:18.615 INFO:tasks.workunit.client.1.smithi161.stdout:9/609: write d2/d25/db1/d65/d42/f4b [4298275,66879] 0 2023-12-09T02:35:18.618 INFO:tasks.workunit.client.1.smithi161.stdout:5/621: dwrite d0/d1f/f23 [0,4194304] 0 2023-12-09T02:35:18.618 INFO:tasks.workunit.client.1.smithi161.stdout:5/622: getdents d0/d2/de/d21/dce 0 2023-12-09T02:35:18.619 INFO:tasks.workunit.client.1.smithi161.stdout:6/607: dwrite da/d55/d6d/d85/f73 [0,4194304] 0 2023-12-09T02:35:18.619 INFO:tasks.workunit.client.1.smithi161.stdout:1/734: mkdir d6/d8/d68/df6 0 2023-12-09T02:35:18.619 INFO:tasks.workunit.client.1.smithi161.stdout:1/735: stat d6/d8/d63/d93/l7f 0 2023-12-09T02:35:18.619 INFO:tasks.workunit.client.1.smithi161.stdout:1/736: read - d6/d8/d63/d4d/fc8 zero size 2023-12-09T02:35:18.623 INFO:tasks.workunit.client.1.smithi161.stdout:6/608: truncate da/d19/f23 1569849 0 2023-12-09T02:35:18.623 INFO:tasks.workunit.client.1.smithi161.stdout:6/609: chown da/d19/dc2/d77/f9a 24 1 2023-12-09T02:35:18.625 INFO:tasks.workunit.client.1.smithi161.stdout:8/579: dwrite d2/d5/d22/d31/d38/d66/d88/da1/fa6 [0,4194304] 0 2023-12-09T02:35:18.625 INFO:tasks.workunit.client.1.smithi161.stdout:8/580: chown d2/d5/d22/d31/d38/c51 38 1 2023-12-09T02:35:18.628 INFO:tasks.workunit.client.1.smithi161.stdout:1/737: unlink d6/d8/d68/le1 0 2023-12-09T02:35:18.628 INFO:tasks.workunit.client.1.smithi161.stdout:1/738: truncate d6/d49/f60 1133189 0 2023-12-09T02:35:18.628 INFO:tasks.workunit.client.1.smithi161.stdout:1/739: chown d6/d8/d63/d4d/d9f/ddc/f6a 2919 1 2023-12-09T02:35:18.628 INFO:tasks.workunit.client.1.smithi161.stdout:1/740: readlink d6/d9/d8b/la1 0 2023-12-09T02:35:18.629 INFO:tasks.workunit.client.1.smithi161.stdout:8/581: write d2/d5/f34 [697630,60034] 0 2023-12-09T02:35:18.636 INFO:tasks.workunit.client.1.smithi161.stdout:2/680: dread d4/d16/d69/d8c/fd1 [0,4194304] 0 2023-12-09T02:35:18.665 INFO:tasks.workunit.client.1.smithi161.stdout:6/610: dread da/d55/f5f [0,4194304] 0 2023-12-09T02:35:18.673 INFO:tasks.workunit.client.1.smithi161.stdout:1/741: creat d6/d8/d63/d4d/d9f/ddc/ff7 x:0 0 0 2023-12-09T02:35:18.675 INFO:tasks.workunit.client.1.smithi161.stdout:6/611: mknod da/d19/dc2/d29/d2b/d31/cd3 0 2023-12-09T02:35:18.675 INFO:tasks.workunit.client.1.smithi161.stdout:6/612: write da/d55/fbd [636333,95697] 0 2023-12-09T02:35:18.690 INFO:tasks.workunit.client.1.smithi161.stdout:9/610: dwrite d2/d25/db1/d65/d42/d58/d91/d2e/f40 [0,4194304] 0 2023-12-09T02:35:18.692 INFO:tasks.workunit.client.1.smithi161.stdout:9/611: creat d2/d25/db1/d65/d5c/d60/fd4 x:0 0 0 2023-12-09T02:35:18.693 INFO:tasks.workunit.client.1.smithi161.stdout:9/612: link d2/d25/l28 d2/d25/dbf/ld5 0 2023-12-09T02:35:18.703 INFO:tasks.workunit.client.1.smithi161.stdout:2/681: dwrite d4/d16/d69/faf [0,4194304] 0 2023-12-09T02:35:18.704 INFO:tasks.workunit.client.1.smithi161.stdout:5/623: dwrite d0/d2/de/f89 [0,4194304] 0 2023-12-09T02:35:18.707 INFO:tasks.workunit.client.1.smithi161.stdout:2/682: write d4/f17 [3023356,42557] 0 2023-12-09T02:35:18.712 INFO:tasks.workunit.client.1.smithi161.stdout:8/582: dwrite d2/d5/f16 [0,4194304] 0 2023-12-09T02:35:18.715 INFO:tasks.workunit.client.1.smithi161.stdout:9/613: dwrite d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/f6c [4194304,4194304] 0 2023-12-09T02:35:18.715 INFO:tasks.workunit.client.1.smithi161.stdout:1/742: dwrite d6/d9/dd4/fea [0,4194304] 0 2023-12-09T02:35:18.715 INFO:tasks.workunit.client.1.smithi161.stdout:6/613: dwrite da/d55/f86 [0,4194304] 0 2023-12-09T02:35:18.715 INFO:tasks.workunit.client.1.smithi161.stdout:9/614: write d2/d25/db1/d4d/d7d/fbb [359318,101366] 0 2023-12-09T02:35:18.715 INFO:tasks.workunit.client.1.smithi161.stdout:9/615: readlink d2/d25/db1/d65/d42/d58/l1f 0 2023-12-09T02:35:18.716 INFO:tasks.workunit.client.1.smithi161.stdout:9/616: readlink d2/d25/db1/d4d/d7d/lce 0 2023-12-09T02:35:18.716 INFO:tasks.workunit.client.1.smithi161.stdout:6/614: write da/d19/dc2/d3c/fa4 [1658976,36751] 0 2023-12-09T02:35:18.716 INFO:tasks.workunit.client.1.smithi161.stdout:6/615: readlink da/d19/dc2/d3c/d46/lb5 0 2023-12-09T02:35:18.717 INFO:tasks.workunit.client.1.smithi161.stdout:5/624: unlink d0/d1f/l46 0 2023-12-09T02:35:18.720 INFO:tasks.workunit.client.1.smithi161.stdout:1/743: write d6/d8/d63/d4d/f88 [788462,80578] 0 2023-12-09T02:35:18.720 INFO:tasks.workunit.client.1.smithi161.stdout:2/683: rename d4/f20 to d4/d16/d69/d8c/d87/fe1 0 2023-12-09T02:35:18.723 INFO:tasks.workunit.client.1.smithi161.stdout:8/583: mknod d2/d5/d4f/cbb 0 2023-12-09T02:35:18.731 INFO:tasks.workunit.client.1.smithi161.stdout:9/617: symlink d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/ld6 0 2023-12-09T02:35:18.732 INFO:tasks.workunit.client.1.smithi161.stdout:6/616: mkdir da/df/d2d/d3b/dd4 0 2023-12-09T02:35:18.732 INFO:tasks.workunit.client.1.smithi161.stdout:6/617: stat da/d19/dc2/d29/f45 0 2023-12-09T02:35:18.732 INFO:tasks.workunit.client.1.smithi161.stdout:6/618: truncate da/f68 165801 0 2023-12-09T02:35:18.734 INFO:tasks.workunit.client.1.smithi161.stdout:1/744: chown d6/d8/d63/d93/c1a 12 1 2023-12-09T02:35:18.734 INFO:tasks.workunit.client.1.smithi161.stdout:8/584: truncate d2/fb1 1106299 0 2023-12-09T02:35:18.736 INFO:tasks.workunit.client.1.smithi161.stdout:5/625: dwrite d0/d9/f78 [0,4194304] 0 2023-12-09T02:35:18.737 INFO:tasks.workunit.client.1.smithi161.stdout:5/626: truncate d0/d2/f7a 782280 0 2023-12-09T02:35:18.738 INFO:tasks.workunit.client.1.smithi161.stdout:1/745: creat d6/d49/ff8 x:0 0 0 2023-12-09T02:35:18.739 INFO:tasks.workunit.client.1.smithi161.stdout:8/585: symlink d2/d5/d22/d86/d97/lbc 0 2023-12-09T02:35:18.742 INFO:tasks.workunit.client.1.smithi161.stdout:1/746: dread d6/d8/d63/d4d/f88 [0,4194304] 0 2023-12-09T02:35:18.742 INFO:tasks.workunit.client.1.smithi161.stdout:6/619: dread da/d19/f50 [0,4194304] 0 2023-12-09T02:35:18.742 INFO:tasks.workunit.client.1.smithi161.stdout:1/747: write d6/d8/f92 [577821,6255] 0 2023-12-09T02:35:18.742 INFO:tasks.workunit.client.1.smithi161.stdout:1/748: write d6/d9/d5c/fd8 [129733,52463] 0 2023-12-09T02:35:18.743 INFO:tasks.workunit.client.1.smithi161.stdout:5/627: symlink d0/d2/de/ldf 0 2023-12-09T02:35:18.743 INFO:tasks.workunit.client.1.smithi161.stdout:5/628: stat d0/d2/d7/d51 0 2023-12-09T02:35:18.744 INFO:tasks.workunit.client.1.smithi161.stdout:6/620: rmdir da/d19/dc2 39 2023-12-09T02:35:18.750 INFO:tasks.workunit.client.1.smithi161.stdout:8/586: dread d2/d5/d4f/f2c [4194304,4194304] 0 2023-12-09T02:35:18.753 INFO:tasks.workunit.client.1.smithi161.stdout:5/629: rmdir d0/d2/d5f 39 2023-12-09T02:35:18.753 INFO:tasks.workunit.client.1.smithi161.stdout:8/587: dread d2/d5/d22/d54/db4/f78 [0,4194304] 0 2023-12-09T02:35:18.753 INFO:tasks.workunit.client.1.smithi161.stdout:5/630: readlink d0/d2/d7/d51/l52 0 2023-12-09T02:35:18.754 INFO:tasks.workunit.client.1.smithi161.stdout:8/588: fsync d2/d5/d22/d31/da0/fb3 0 2023-12-09T02:35:18.754 INFO:tasks.workunit.client.1.smithi161.stdout:5/631: fsync d0/d2/de/f5b 0 2023-12-09T02:35:18.754 INFO:tasks.workunit.client.1.smithi161.stdout:1/749: symlink d6/d9/d5c/lf9 0 2023-12-09T02:35:18.754 INFO:tasks.workunit.client.1.smithi161.stdout:1/750: truncate d6/d9/fa4 4831489 0 2023-12-09T02:35:18.757 INFO:tasks.workunit.client.1.smithi161.stdout:8/589: mkdir d2/d8a/dbd 0 2023-12-09T02:35:18.758 INFO:tasks.workunit.client.1.smithi161.stdout:6/621: write da/d19/dc2/d4d/d5e/f6c [2573115,20647] 0 2023-12-09T02:35:18.760 INFO:tasks.workunit.client.1.smithi161.stdout:5/632: mknod d0/d2/d7/d11/dc3/ce0 0 2023-12-09T02:35:18.760 INFO:tasks.workunit.client.1.smithi161.stdout:5/633: chown d0/d2/de/d22/faa 7400899 1 2023-12-09T02:35:18.767 INFO:tasks.workunit.client.1.smithi161.stdout:1/751: dread d6/d8/d63/d4d/d9f/ddc/d3d/f96 [0,4194304] 0 2023-12-09T02:35:18.768 INFO:tasks.workunit.client.1.smithi161.stdout:8/590: dread d2/d5/d22/d31/f65 [0,4194304] 0 2023-12-09T02:35:18.773 INFO:tasks.workunit.client.1.smithi161.stdout:5/634: dread d0/d9/f6a [0,4194304] 0 2023-12-09T02:35:18.776 INFO:tasks.workunit.client.1.smithi161.stdout:6/622: creat da/d19/dc2/fd5 x:0 0 0 2023-12-09T02:35:18.776 INFO:tasks.workunit.client.1.smithi161.stdout:8/591: mknod d2/d5/d22/d31/d38/d84/cbe 0 2023-12-09T02:35:18.777 INFO:tasks.workunit.client.1.smithi161.stdout:8/592: write d2/d5/d22/d31/d38/d66/d88/da1/fb0 [455582,90617] 0 2023-12-09T02:35:18.777 INFO:tasks.workunit.client.1.smithi161.stdout:8/593: dread - d2/d5/d22/f98 zero size 2023-12-09T02:35:18.783 INFO:tasks.workunit.client.1.smithi161.stdout:5/635: mkdir d0/d2/de/d22/d8e/d8f/dcd/de1 0 2023-12-09T02:35:18.784 INFO:tasks.workunit.client.1.smithi161.stdout:6/623: creat da/df/fd6 x:0 0 0 2023-12-09T02:35:18.787 INFO:tasks.workunit.client.1.smithi161.stdout:1/752: dwrite d6/d8/d63/d4d/d31/d80/fb6 [4194304,4194304] 0 2023-12-09T02:35:18.788 INFO:tasks.workunit.client.1.smithi161.stdout:8/594: creat d2/d5/d22/fbf x:0 0 0 2023-12-09T02:35:18.791 INFO:tasks.workunit.client.1.smithi161.stdout:6/624: rmdir da/d19/dc2/d4d 39 2023-12-09T02:35:18.791 INFO:tasks.workunit.client.1.smithi161.stdout:5/636: truncate d0/d2/de/d22/f32 2277948 0 2023-12-09T02:35:18.792 INFO:tasks.workunit.client.1.smithi161.stdout:8/595: mkdir d2/d5/dc0 0 2023-12-09T02:35:18.794 INFO:tasks.workunit.client.1.smithi161.stdout:0/602: sync 2023-12-09T02:35:18.795 INFO:tasks.workunit.client.1.smithi161.stdout:1/753: write d6/d8/d63/d93/fe6 [1160081,48874] 0 2023-12-09T02:35:18.797 INFO:tasks.workunit.client.1.smithi161.stdout:8/596: creat d2/d8a/fc1 x:0 0 0 2023-12-09T02:35:18.800 INFO:tasks.workunit.client.1.smithi161.stdout:0/603: symlink d9/d55/d5a/db1/lb9 0 2023-12-09T02:35:18.800 INFO:tasks.workunit.client.1.smithi161.stdout:0/604: fsync d9/d55/d7c/f8f 0 2023-12-09T02:35:18.803 INFO:tasks.workunit.client.1.smithi161.stdout:8/597: stat d2/d5/d22/d54/db4/l6a 0 2023-12-09T02:35:18.803 INFO:tasks.workunit.client.1.smithi161.stdout:1/754: symlink d6/d9/d8b/dba/dd2/lfa 0 2023-12-09T02:35:18.807 INFO:tasks.workunit.client.1.smithi161.stdout:8/598: creat d2/d5/d22/d31/fc2 x:0 0 0 2023-12-09T02:35:18.810 INFO:tasks.workunit.client.1.smithi161.stdout:1/755: unlink d6/d8/d63/d93/fe6 0 2023-12-09T02:35:18.822 INFO:tasks.workunit.client.1.smithi161.stdout:6/625: dwrite da/df/d2d/d3b/f42 [0,4194304] 0 2023-12-09T02:35:18.826 INFO:tasks.workunit.client.1.smithi161.stdout:1/756: creat d6/d8/d63/d4d/dd5/ffb x:0 0 0 2023-12-09T02:35:18.826 INFO:tasks.workunit.client.1.smithi161.stdout:6/626: unlink da/d19/dc2/d3c/fa4 0 2023-12-09T02:35:18.834 INFO:tasks.workunit.client.1.smithi161.stdout:7/634: sync 2023-12-09T02:35:18.834 INFO:tasks.workunit.client.1.smithi161.stdout:7/635: rename d0/d3/d13/d2d to d0/d3/d13/d2d/d6e/dce 22 2023-12-09T02:35:18.835 INFO:tasks.workunit.client.1.smithi161.stdout:3/540: sync 2023-12-09T02:35:18.835 INFO:tasks.workunit.client.1.smithi161.stdout:6/627: dread da/f76 [0,4194304] 0 2023-12-09T02:35:18.843 INFO:tasks.workunit.client.1.smithi161.stdout:3/541: dread d2/d51/d75/d11/f3c [0,4194304] 0 2023-12-09T02:35:18.844 INFO:tasks.workunit.client.1.smithi161.stdout:7/636: symlink d0/d3/d13/d1b/lcf 0 2023-12-09T02:35:18.846 INFO:tasks.workunit.client.1.smithi161.stdout:7/637: getdents d0/d3/d13/d4e/db2 0 2023-12-09T02:35:18.848 INFO:tasks.workunit.client.1.smithi161.stdout:1/757: dread d6/d8/d63/d93/f16 [0,4194304] 0 2023-12-09T02:35:18.848 INFO:tasks.workunit.client.1.smithi161.stdout:1/758: write d6/d8/d63/d4d/d9f/ddc/f7b [4842357,121791] 0 2023-12-09T02:35:18.848 INFO:tasks.workunit.client.1.smithi161.stdout:1/759: dread - d6/d8/d63/d4d/d31/d80/fdd zero size 2023-12-09T02:35:18.848 INFO:tasks.workunit.client.1.smithi161.stdout:1/760: dread - d6/d8/d63/d4d/d31/f76 zero size 2023-12-09T02:35:18.849 INFO:tasks.workunit.client.1.smithi161.stdout:0/605: dwrite d9/d55/d5a/f95 [0,4194304] 0 2023-12-09T02:35:18.850 INFO:tasks.workunit.client.1.smithi161.stdout:1/761: symlink d6/d8/d63/d4d/d31/d80/lfc 0 2023-12-09T02:35:18.850 INFO:tasks.workunit.client.1.smithi161.stdout:1/762: fdatasync d6/d8/fda 0 2023-12-09T02:35:18.850 INFO:tasks.workunit.client.1.smithi161.stdout:7/638: symlink d0/d3/d21/d54/d91/ld0 0 2023-12-09T02:35:18.854 INFO:tasks.workunit.client.1.smithi161.stdout:0/606: rename d9/db/d2a/d35/d4a to d9/db/d2a/d9d/dba 0 2023-12-09T02:35:18.855 INFO:tasks.workunit.client.1.smithi161.stdout:3/542: dread d2/d51/d75/d11/d19/d91/d46/d2d/d47/f5c [4194304,4194304] 0 2023-12-09T02:35:18.855 INFO:tasks.workunit.client.1.smithi161.stdout:8/599: dwrite d2/d5/fb [0,4194304] 0 2023-12-09T02:35:18.855 INFO:tasks.workunit.client.1.smithi161.stdout:8/600: truncate d2/f1d 946786 0 2023-12-09T02:35:18.855 INFO:tasks.workunit.client.1.smithi161.stdout:3/543: truncate d2/d51/d75/d11/d19/d91/d46/d40/f58 722329 0 2023-12-09T02:35:18.856 INFO:tasks.workunit.client.1.smithi161.stdout:1/763: stat d6/d8/d63/c20 0 2023-12-09T02:35:18.857 INFO:tasks.workunit.client.1.smithi161.stdout:0/607: mknod d9/d55/cbb 0 2023-12-09T02:35:18.859 INFO:tasks.workunit.client.1.smithi161.stdout:8/601: truncate d2/d5/d3d/f46 2583332 0 2023-12-09T02:35:18.859 INFO:tasks.workunit.client.1.smithi161.stdout:8/602: fdatasync d2/d5/fa 0 2023-12-09T02:35:18.862 INFO:tasks.workunit.client.1.smithi161.stdout:0/608: dread d9/d55/d7c/f2d [0,4194304] 0 2023-12-09T02:35:18.863 INFO:tasks.workunit.client.1.smithi161.stdout:3/544: mkdir d2/d51/d75/d11/d19/d91/d46/d9c 0 2023-12-09T02:35:18.863 INFO:tasks.workunit.client.1.smithi161.stdout:3/545: truncate d2/d51/d75/d11/d19/d91/f7d 895248 0 2023-12-09T02:35:18.863 INFO:tasks.workunit.client.1.smithi161.stdout:6/628: dwrite da/d19/dc2/d4d/fb2 [0,4194304] 0 2023-12-09T02:35:18.863 INFO:tasks.workunit.client.1.smithi161.stdout:6/629: read - da/d55/d6d/dac/fb1 zero size 2023-12-09T02:35:18.866 INFO:tasks.workunit.client.1.smithi161.stdout:1/764: rename d6/d8/d63/d4d/fc4 to d6/d8/d63/d4d/d31/d80/d9c/ffd 0 2023-12-09T02:35:18.869 INFO:tasks.workunit.client.1.smithi161.stdout:8/603: rmdir d2/d5/d22/d31/d38/d66 39 2023-12-09T02:35:18.869 INFO:tasks.workunit.client.1.smithi161.stdout:8/604: write d2/d5/d22/d31/d38/f79 [4983929,127553] 0 2023-12-09T02:35:18.870 INFO:tasks.workunit.client.1.smithi161.stdout:6/630: write f1 [3204444,118095] 0 2023-12-09T02:35:18.870 INFO:tasks.workunit.client.1.smithi161.stdout:8/605: read d2/f6 [284186,55918] 0 2023-12-09T02:35:18.875 INFO:tasks.workunit.client.1.smithi161.stdout:0/609: symlink d9/d55/d7c/d7a/da3/lbc 0 2023-12-09T02:35:18.881 INFO:tasks.workunit.client.1.smithi161.stdout:1/765: creat d6/d8/d63/d4d/d31/d80/d87/de3/ffe x:0 0 0 2023-12-09T02:35:18.887 INFO:tasks.workunit.client.1.smithi161.stdout:7/639: dwrite d0/d3/d13/d4e/db5/fa1 [0,4194304] 0 2023-12-09T02:35:18.887 INFO:tasks.workunit.client.1.smithi161.stdout:6/631: dread da/d19/f50 [0,4194304] 0 2023-12-09T02:35:18.898 INFO:tasks.workunit.client.1.smithi161.stdout:0/610: dwrite d9/dd/f53 [0,4194304] 0 2023-12-09T02:35:18.898 INFO:tasks.workunit.client.1.smithi161.stdout:0/611: readlink d9/dd/l46 0 2023-12-09T02:35:18.900 INFO:tasks.workunit.client.1.smithi161.stdout:6/632: rename da/d19/dc2/d4d/d5e/f6c to da/d55/d6d/dac/fd7 0 2023-12-09T02:35:18.902 INFO:tasks.workunit.client.1.smithi161.stdout:1/766: dread d6/d8/d63/d93/fe [0,4194304] 0 2023-12-09T02:35:18.907 INFO:tasks.workunit.client.1.smithi161.stdout:7/640: mkdir d0/d3/d13/d2f/dd1 0 2023-12-09T02:35:18.907 INFO:tasks.workunit.client.1.smithi161.stdout:7/641: chown d0/d3/d13/f18 1 1 2023-12-09T02:35:18.907 INFO:tasks.workunit.client.1.smithi161.stdout:7/642: chown d0/d3/d21/l68 86 1 2023-12-09T02:35:18.908 INFO:tasks.workunit.client.1.smithi161.stdout:8/606: rmdir d2/d5 39 2023-12-09T02:35:18.913 INFO:tasks.workunit.client.1.smithi161.stdout:6/633: link da/df/l1f da/d19/dc2/ld8 0 2023-12-09T02:35:18.913 INFO:tasks.workunit.client.1.smithi161.stdout:8/607: write d2/d5/d22/d54/db4/f78 [225972,117595] 0 2023-12-09T02:35:18.913 INFO:tasks.workunit.client.1.smithi161.stdout:8/608: chown d2/d5/d22/d31/d38/f4d 9375326 1 2023-12-09T02:35:18.913 INFO:tasks.workunit.client.1.smithi161.stdout:6/634: write da/d19/d20/fb9 [353713,105570] 0 2023-12-09T02:35:18.919 INFO:tasks.workunit.client.1.smithi161.stdout:1/767: mkdir d6/d8/d68/df6/dff 0 2023-12-09T02:35:18.921 INFO:tasks.workunit.client.1.smithi161.stdout:6/635: dread da/d55/d6d/d85/fb6 [0,4194304] 0 2023-12-09T02:35:18.921 INFO:tasks.workunit.client.1.smithi161.stdout:6/636: fdatasync da/d19/d20/fb9 0 2023-12-09T02:35:18.927 INFO:tasks.workunit.client.1.smithi161.stdout:7/643: truncate d0/d3/d13/f58 3596551 0 2023-12-09T02:35:18.928 INFO:tasks.workunit.client.1.smithi161.stdout:1/768: dread d6/d8/d63/fcc [0,4194304] 0 2023-12-09T02:35:18.932 INFO:tasks.workunit.client.1.smithi161.stdout:6/637: symlink da/d19/dc2/d29/d2b/ld9 0 2023-12-09T02:35:18.936 INFO:tasks.workunit.client.1.smithi161.stdout:7/644: link d0/d3/d13/d4e/db2/f41 d0/d3/d6a/dc9/fd2 0 2023-12-09T02:35:18.939 INFO:tasks.workunit.client.1.smithi161.stdout:1/769: getdents d6/d9/d8b 0 2023-12-09T02:35:18.940 INFO:tasks.workunit.client.1.smithi161.stdout:6/638: rename da/d19/f50 to da/d55/fda 0 2023-12-09T02:35:18.943 INFO:tasks.workunit.client.1.smithi161.stdout:7/645: truncate d0/d3/d13/f26 1601966 0 2023-12-09T02:35:18.945 INFO:tasks.workunit.client.1.smithi161.stdout:1/770: rmdir d6/d8/d63/d4d/d9f/ddc/daa 39 2023-12-09T02:35:18.947 INFO:tasks.workunit.client.1.smithi161.stdout:6/639: symlink da/d19/dc2/d29/d2b/db4/ldb 0 2023-12-09T02:35:18.950 INFO:tasks.workunit.client.1.smithi161.stdout:7/646: getdents d0/d3/d13/d2d/d43/d4b/d5a 0 2023-12-09T02:35:18.951 INFO:tasks.workunit.client.1.smithi161.stdout:1/771: symlink d6/d8/d63/d4d/d31/d80/d87/de3/l100 0 2023-12-09T02:35:18.953 INFO:tasks.workunit.client.1.smithi161.stdout:1/772: dread d6/d8/d63/d4d/d31/d73/d47/f6d [0,4194304] 0 2023-12-09T02:35:18.953 INFO:tasks.workunit.client.1.smithi161.stdout:1/773: fsync d6/d8/d63/d4d/d31/d73/d47/fca 0 2023-12-09T02:35:18.953 INFO:tasks.workunit.client.1.smithi161.stdout:1/774: write d6/d9/d8b/fa3 [828055,105811] 0 2023-12-09T02:35:19.001 INFO:tasks.workunit.client.1.smithi161.stdout:1/775: dwrite f5 [8388608,4194304] 0 2023-12-09T02:35:19.002 INFO:tasks.workunit.client.1.smithi161.stdout:6/640: rmdir da/d55/d6d/d85 39 2023-12-09T02:35:19.002 INFO:tasks.workunit.client.1.smithi161.stdout:6/641: chown da/d19/dc2/d4d/fa8 17 1 2023-12-09T02:35:19.006 INFO:tasks.workunit.client.1.smithi161.stdout:7/647: symlink d0/d3/d6c/dbe/ld3 0 2023-12-09T02:35:19.006 INFO:tasks.workunit.client.1.smithi161.stdout:7/648: chown d0/d49/d67/cc5 21 1 2023-12-09T02:35:19.007 INFO:tasks.workunit.client.1.smithi161.stdout:6/642: dread da/d55/f5f [0,4194304] 0 2023-12-09T02:35:19.010 INFO:tasks.workunit.client.1.smithi161.stdout:7/649: mknod d0/d3/d6c/dbe/cd4 0 2023-12-09T02:35:19.013 INFO:tasks.workunit.client.1.smithi161.stdout:6/643: creat da/d19/dc2/d3c/fdc x:0 0 0 2023-12-09T02:35:19.013 INFO:tasks.workunit.client.1.smithi161.stdout:4/796: sync 2023-12-09T02:35:19.014 INFO:tasks.workunit.client.1.smithi161.stdout:4/797: chown dd/d36/d4a/d88/d8a/db3/fd7 38838 1 2023-12-09T02:35:19.014 INFO:tasks.workunit.client.1.smithi161.stdout:6/644: dread da/d19/d20/fb7 [0,4194304] 0 2023-12-09T02:35:19.014 INFO:tasks.workunit.client.1.smithi161.stdout:7/650: mknod d0/cd5 0 2023-12-09T02:35:19.018 INFO:tasks.workunit.client.1.smithi161.stdout:6/645: rename da/d19/dc2/d3c/la0 to da/df/d2d/ldd 0 2023-12-09T02:35:19.018 INFO:tasks.workunit.client.1.smithi161.stdout:6/646: stat da/d55/d6d/dac 0 2023-12-09T02:35:19.019 INFO:tasks.workunit.client.1.smithi161.stdout:6/647: chown da/l22 1814 1 2023-12-09T02:35:19.020 INFO:tasks.workunit.client.1.smithi161.stdout:1/776: truncate f5 457649 0 2023-12-09T02:35:19.023 INFO:tasks.workunit.client.1.smithi161.stdout:4/798: dread dd/d36/d3f/f9e [0,4194304] 0 2023-12-09T02:35:19.023 INFO:tasks.workunit.client.1.smithi161.stdout:4/799: readlink dd/l16 0 2023-12-09T02:35:19.023 INFO:tasks.workunit.client.1.smithi161.stdout:4/800: read dd/d36/d3f/d54/d102/d25/d32/d75/deb/f46 [454181,101869] 0 2023-12-09T02:35:19.024 INFO:tasks.workunit.client.1.smithi161.stdout:6/648: rmdir da/d19/dc2/d29 39 2023-12-09T02:35:19.024 INFO:tasks.workunit.client.1.smithi161.stdout:6/649: truncate da/d55/d6d/dac/fd7 4664787 0 2023-12-09T02:35:19.025 INFO:tasks.workunit.client.1.smithi161.stdout:1/777: creat d6/f101 x:0 0 0 2023-12-09T02:35:19.025 INFO:tasks.workunit.client.1.smithi161.stdout:1/778: readlink d6/d9/d8b/lc0 0 2023-12-09T02:35:19.025 INFO:tasks.workunit.client.1.smithi161.stdout:1/779: truncate d6/d8/d63/d4d/d9f/ddc/f6a 2114229 0 2023-12-09T02:35:19.025 INFO:tasks.workunit.client.1.smithi161.stdout:1/780: write d6/d8/d63/d4d/d9f/ddc/f7b [5471896,70476] 0 2023-12-09T02:35:19.026 INFO:tasks.workunit.client.1.smithi161.stdout:1/781: write d6/d8/d63/d4d/f4c [2495545,87208] 0 2023-12-09T02:35:19.028 INFO:tasks.workunit.client.1.smithi161.stdout:4/801: creat dd/d36/d4a/d88/f105 x:0 0 0 2023-12-09T02:35:19.030 INFO:tasks.workunit.client.1.smithi161.stdout:6/650: symlink da/d19/dc2/d29/d2b/d31/lde 0 2023-12-09T02:35:19.037 INFO:tasks.workunit.client.1.smithi161.stdout:1/782: rename d6/d8/d63/d4d/d31/d80/d87 to d6/d8/d63/d4d/d31/d73/d47/d102 0 2023-12-09T02:35:19.037 INFO:tasks.workunit.client.1.smithi161.stdout:1/783: chown d6/d8/d63/d4d/d31/d80 0 1 2023-12-09T02:35:19.038 INFO:tasks.workunit.client.1.smithi161.stdout:4/802: creat dd/d36/d3f/d54/d102/d25/d32/dd0/f106 x:0 0 0 2023-12-09T02:35:19.040 INFO:tasks.workunit.client.1.smithi161.stdout:1/784: creat d6/d8/d63/d4d/dd5/f103 x:0 0 0 2023-12-09T02:35:19.040 INFO:tasks.workunit.client.1.smithi161.stdout:1/785: dread - d6/d8/d63/d4d/d31/d73/d47/d102/fcf zero size 2023-12-09T02:35:19.042 INFO:tasks.workunit.client.1.smithi161.stdout:4/803: mkdir dd/d1a/d23/d6a/d107 0 2023-12-09T02:35:19.048 INFO:tasks.workunit.client.1.smithi161.stdout:1/786: rename d6/d8/fda to d6/d8/d63/d93/f104 0 2023-12-09T02:35:19.048 INFO:tasks.workunit.client.1.smithi161.stdout:1/787: fsync d6/d9/d5c/fe0 0 2023-12-09T02:35:19.051 INFO:tasks.workunit.client.1.smithi161.stdout:1/788: write d6/d8/d63/d4d/d31/d73/d47/f7e [677007,103731] 0 2023-12-09T02:35:19.070 INFO:tasks.workunit.client.1.smithi161.stdout:6/651: dwrite da/d19/dc2/d29/d2b/f97 [0,4194304] 0 2023-12-09T02:35:19.070 INFO:tasks.workunit.client.1.smithi161.stdout:4/804: dwrite dd/d1a/d29/fef [0,4194304] 0 2023-12-09T02:35:19.070 INFO:tasks.workunit.client.1.smithi161.stdout:1/789: dwrite d6/d8/d63/d1c/d8a/fae [4194304,4194304] 0 2023-12-09T02:35:19.157 INFO:tasks.workunit.client.1.smithi161.stdout:6/652: creat da/d19/fdf x:0 0 0 2023-12-09T02:35:19.161 INFO:tasks.workunit.client.1.smithi161.stdout:4/805: link dd/d36/d4a/d88/f105 dd/d1a/d23/de9/f108 0 2023-12-09T02:35:19.164 INFO:tasks.workunit.client.1.smithi161.stdout:1/790: unlink d6/d8/d63/d4d/d31/f76 0 2023-12-09T02:35:19.164 INFO:tasks.workunit.client.1.smithi161.stdout:1/791: write d6/d9/d5c/f66 [1173927,11194] 0 2023-12-09T02:35:19.164 INFO:tasks.workunit.client.1.smithi161.stdout:1/792: chown d6/d8/d63/d1c/f89 106516911 1 2023-12-09T02:35:19.168 INFO:tasks.workunit.client.1.smithi161.stdout:4/806: dread dd/d36/d3f/d54/d102/d25/d4e/fb2 [0,4194304] 0 2023-12-09T02:35:19.173 INFO:tasks.workunit.client.1.smithi161.stdout:1/793: getdents d6/d8/d63/d4d/dd0 0 2023-12-09T02:35:19.176 INFO:tasks.workunit.client.1.smithi161.stdout:4/807: mknod dd/d36/d4a/d88/d8a/c109 0 2023-12-09T02:35:19.176 INFO:tasks.workunit.client.1.smithi161.stdout:4/808: chown dd/d36/d4a/d88/d8a/le6 397219 1 2023-12-09T02:35:19.176 INFO:tasks.workunit.client.1.smithi161.stdout:4/809: readlink dd/l10 0 2023-12-09T02:35:19.177 INFO:tasks.workunit.client.1.smithi161.stdout:1/794: symlink d6/d8/d63/d4d/d31/d80/d9c/l105 0 2023-12-09T02:35:19.179 INFO:tasks.workunit.client.1.smithi161.stdout:6/653: dwrite da/d55/d6d/fa1 [0,4194304] 0 2023-12-09T02:35:19.180 INFO:tasks.workunit.client.1.smithi161.stdout:1/795: creat d6/d8/d63/d1c/d8a/dcd/d9d/f106 x:0 0 0 2023-12-09T02:35:19.187 INFO:tasks.workunit.client.1.smithi161.stdout:1/796: mknod d6/d8/d63/d1c/d8a/c107 0 2023-12-09T02:35:19.187 INFO:tasks.workunit.client.1.smithi161.stdout:1/797: chown d6/d8/d68/l8e 884961473 1 2023-12-09T02:35:19.187 INFO:tasks.workunit.client.1.smithi161.stdout:1/798: stat d6/d9/d8b/la1 0 2023-12-09T02:35:19.188 INFO:tasks.workunit.client.1.smithi161.stdout:9/618: sync 2023-12-09T02:35:19.188 INFO:tasks.workunit.client.1.smithi161.stdout:2/684: sync 2023-12-09T02:35:19.188 INFO:tasks.workunit.client.1.smithi161.stdout:2/685: write d4/d16/d69/faf [4532936,24404] 0 2023-12-09T02:35:19.193 INFO:tasks.workunit.client.1.smithi161.stdout:1/799: write d6/d49/f60 [803823,69401] 0 2023-12-09T02:35:19.193 INFO:tasks.workunit.client.1.smithi161.stdout:2/686: creat d4/d1a/dc2/fe2 x:0 0 0 2023-12-09T02:35:19.197 INFO:tasks.workunit.client.1.smithi161.stdout:1/800: creat d6/d8/d63/d4d/d31/d80/f108 x:0 0 0 2023-12-09T02:35:19.198 INFO:tasks.workunit.client.1.smithi161.stdout:2/687: truncate d4/d7/db/f19 2300616 0 2023-12-09T02:35:19.212 INFO:tasks.workunit.client.1.smithi161.stdout:6/654: dwrite da/d19/dc2/d3c/f90 [0,4194304] 0 2023-12-09T02:35:19.222 INFO:tasks.workunit.client.1.smithi161.stdout:1/801: dwrite d6/d8/d63/d4d/fee [0,4194304] 0 2023-12-09T02:35:19.222 INFO:tasks.workunit.client.1.smithi161.stdout:1/802: chown d6/d8/d63/d4d/d31/d80 2017721 1 2023-12-09T02:35:19.222 INFO:tasks.workunit.client.1.smithi161.stdout:1/803: write d6/d8/d63/d4d/d9f/ddc/daa/f7a [705005,122706] 0 2023-12-09T02:35:19.223 INFO:tasks.workunit.client.1.smithi161.stdout:9/619: dwrite d2/d25/db1/d65/d42/d58/d91/d2e/d80/fa2 [0,4194304] 0 2023-12-09T02:35:19.223 INFO:tasks.workunit.client.1.smithi161.stdout:9/620: chown d2/d25/db1/d65/d42/d58/d91/c1a 1 1 2023-12-09T02:35:19.232 INFO:tasks.workunit.client.1.smithi161.stdout:6/655: dwrite da/df/f3a [0,4194304] 0 2023-12-09T02:35:19.251 INFO:tasks.workunit.client.1.smithi161.stdout:9/621: dwrite d2/d25/db1/d65/d42/d58/d91/f86 [0,4194304] 0 2023-12-09T02:35:19.252 INFO:tasks.workunit.client.1.smithi161.stdout:1/804: dwrite d6/d8/d63/d1c/f1e [0,4194304] 0 2023-12-09T02:35:19.252 INFO:tasks.workunit.client.1.smithi161.stdout:1/805: chown d6/d8/d63/d1c/c54 623095 1 2023-12-09T02:35:19.252 INFO:tasks.workunit.client.1.smithi161.stdout:1/806: truncate d6/d9/ff5 230622 0 2023-12-09T02:35:19.252 INFO:tasks.workunit.client.1.smithi161.stdout:1/807: chown d6/d9/dd6 39 1 2023-12-09T02:35:19.259 INFO:tasks.workunit.client.1.smithi161.stdout:9/622: mknod d2/d25/db1/d65/d5c/d55/d66/cd7 0 2023-12-09T02:35:19.259 INFO:tasks.workunit.client.1.smithi161.stdout:9/623: dread - d2/d25/db1/d65/d5c/d55/d66/d83/d90/d95/fc5 zero size 2023-12-09T02:35:19.261 INFO:tasks.workunit.client.1.smithi161.stdout:9/624: truncate d2/d25/db1/d65/d42/d58/f1e 1292727 0 2023-12-09T02:35:19.264 INFO:tasks.workunit.client.1.smithi161.stdout:9/625: dread d2/d25/db1/d65/d42/f4c [0,4194304] 0 2023-12-09T02:35:19.264 INFO:tasks.workunit.client.1.smithi161.stdout:9/626: chown d2/d25/dbf 54034 1 2023-12-09T02:35:19.264 INFO:tasks.workunit.client.1.smithi161.stdout:9/627: chown d2/d25/db1/d65/d5c/d55/d66/d83/fab 23696 1 2023-12-09T02:35:19.264 INFO:tasks.workunit.client.1.smithi161.stdout:9/628: write d2/d25/db1/d65/d5c/d60/fd4 [19475,113078] 0 2023-12-09T02:35:19.265 INFO:tasks.workunit.client.1.smithi161.stdout:1/808: dwrite d6/d8/d63/d4d/d9f/ddc/d3d/dc3/f82 [4194304,4194304] 0 2023-12-09T02:35:19.267 INFO:tasks.workunit.client.1.smithi161.stdout:9/629: creat d2/d25/db1/d65/d7c/fd8 x:0 0 0 2023-12-09T02:35:19.270 INFO:tasks.workunit.client.1.smithi161.stdout:9/630: creat d2/d25/db1/d65/d5c/d55/d66/fd9 x:0 0 0 2023-12-09T02:35:19.270 INFO:tasks.workunit.client.1.smithi161.stdout:9/631: chown d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/l77 0 1 2023-12-09T02:35:19.271 INFO:tasks.workunit.client.1.smithi161.stdout:9/632: mknod d2/d25/db1/d65/d42/d58/d91/cda 0 2023-12-09T02:35:19.274 INFO:tasks.workunit.client.1.smithi161.stdout:9/633: unlink d2/d25/db1/d65/d4f/faa 0 2023-12-09T02:35:19.274 INFO:tasks.workunit.client.1.smithi161.stdout:1/809: dread d6/d9/d8b/fc7 [0,4194304] 0 2023-12-09T02:35:19.275 INFO:tasks.workunit.client.1.smithi161.stdout:1/810: write d6/d8/d63/d1c/d8a/fae [187035,117161] 0 2023-12-09T02:35:19.281 INFO:tasks.workunit.client.1.smithi161.stdout:9/634: creat d2/d25/db1/d65/d5c/d60/fdb x:0 0 0 2023-12-09T02:35:19.281 INFO:tasks.workunit.client.1.smithi161.stdout:9/635: dread - d2/d25/db1/d65/d5c/d55/f92 zero size 2023-12-09T02:35:19.286 INFO:tasks.workunit.client.1.smithi161.stdout:9/636: write d2/d25/db1/d65/d42/d58/f21 [2059811,88610] 0 2023-12-09T02:35:19.291 INFO:tasks.workunit.client.1.smithi161.stdout:1/811: dwrite d6/d8/d63/d4d/d9f/fa0 [0,4194304] 0 2023-12-09T02:35:19.292 INFO:tasks.workunit.client.1.smithi161.stdout:1/812: write d6/d8/d63/d4d/d9f/ddc/daa/f7a [543849,99035] 0 2023-12-09T02:35:19.293 INFO:tasks.workunit.client.1.smithi161.stdout:1/813: mknod d6/d9/d8b/dba/c109 0 2023-12-09T02:35:19.312 INFO:tasks.workunit.client.1.smithi161.stdout:1/814: dwrite d6/d8/d63/d1c/f1e [0,4194304] 0 2023-12-09T02:35:19.314 INFO:tasks.workunit.client.1.smithi161.stdout:1/815: getdents d6/d9/d8b/dba/dd2 0 2023-12-09T02:35:19.316 INFO:tasks.workunit.client.1.smithi161.stdout:1/816: mknod d6/d8/d63/d4d/dd0/c10a 0 2023-12-09T02:35:19.316 INFO:tasks.workunit.client.1.smithi161.stdout:1/817: stat d6/d8/d63/d1c/c78 0 2023-12-09T02:35:19.317 INFO:tasks.workunit.client.1.smithi161.stdout:1/818: stat d6/d8/d63/d1c/d8a/dcd/cc5 0 2023-12-09T02:35:19.317 INFO:tasks.workunit.client.1.smithi161.stdout:1/819: read d6/d8/d63/d93/f48 [3967004,52791] 0 2023-12-09T02:35:19.319 INFO:tasks.workunit.client.1.smithi161.stdout:1/820: link d6/d9/d8b/fc7 d6/d8/d63/d1c/d8a/dcd/d9d/f10b 0 2023-12-09T02:35:19.327 INFO:tasks.workunit.client.1.smithi161.stdout:1/821: dread d6/d8/d63/d1c/f1e [0,4194304] 0 2023-12-09T02:35:19.328 INFO:tasks.workunit.client.1.smithi161.stdout:1/822: creat d6/d9/d8b/dba/dd2/f10c x:0 0 0 2023-12-09T02:35:19.328 INFO:tasks.workunit.client.1.smithi161.stdout:1/823: fdatasync d6/d8/d63/d4d/d9f/ddc/d3d/dc3/f82 0 2023-12-09T02:35:19.330 INFO:tasks.workunit.client.1.smithi161.stdout:1/824: mkdir d6/d8/d63/d4d/d31/d73/d47/db2/d10d 0 2023-12-09T02:35:19.331 INFO:tasks.workunit.client.1.smithi161.stdout:1/825: write d6/d8/d63/d4d/d31/d73/d47/fa6 [2802587,46212] 0 2023-12-09T02:35:19.331 INFO:tasks.workunit.client.1.smithi161.stdout:1/826: mknod d6/d8/d63/d4d/d9f/ddc/c10e 0 2023-12-09T02:35:19.333 INFO:tasks.workunit.client.1.smithi161.stdout:1/827: creat d6/d8/d63/d4d/d31/d73/f10f x:0 0 0 2023-12-09T02:35:19.344 INFO:tasks.workunit.client.1.smithi161.stdout:3/546: sync 2023-12-09T02:35:19.344 INFO:tasks.workunit.client.1.smithi161.stdout:5/637: sync 2023-12-09T02:35:19.344 INFO:tasks.workunit.client.1.smithi161.stdout:3/547: dread - d2/d51/d75/d11/d1f/d7a/d96/f76 zero size 2023-12-09T02:35:19.344 INFO:tasks.workunit.client.1.smithi161.stdout:3/548: truncate d2/f72 8844378 0 2023-12-09T02:35:19.345 INFO:tasks.workunit.client.1.smithi161.stdout:5/638: creat d0/fe2 x:0 0 0 2023-12-09T02:35:19.346 INFO:tasks.workunit.client.1.smithi161.stdout:3/549: mknod d2/d51/c9d 0 2023-12-09T02:35:19.347 INFO:tasks.workunit.client.1.smithi161.stdout:3/550: chown d2/d51/d75/d11/d19/d91/d46/f29 11325203 1 2023-12-09T02:35:19.348 INFO:tasks.workunit.client.1.smithi161.stdout:5/639: rename d0/d2/d7/d9a/f9c to d0/d2/de/d22/d55/fe3 0 2023-12-09T02:35:19.349 INFO:tasks.workunit.client.1.smithi161.stdout:5/640: read d0/d2/d7/d11/f4c [1996624,122246] 0 2023-12-09T02:35:19.350 INFO:tasks.workunit.client.1.smithi161.stdout:3/551: rename d2/d51/d75/lc to d2/d51/d75/d11/d1f/d74/l9e 0 2023-12-09T02:35:19.351 INFO:tasks.workunit.client.1.smithi161.stdout:5/641: symlink d0/d9/le4 0 2023-12-09T02:35:19.352 INFO:tasks.workunit.client.1.smithi161.stdout:5/642: write d0/d2/d7/d11/f41 [4027156,10282] 0 2023-12-09T02:35:19.354 INFO:tasks.workunit.client.1.smithi161.stdout:5/643: getdents d0/d2/de/d44/da6 0 2023-12-09T02:35:19.357 INFO:tasks.workunit.client.1.smithi161.stdout:5/644: mkdir d0/d2/de/d22/d8e/d8f/dcd/da8/db7/de5 0 2023-12-09T02:35:19.357 INFO:tasks.workunit.client.1.smithi161.stdout:5/645: write d0/d2/de/d22/d55/fbe [269549,99932] 0 2023-12-09T02:35:19.365 INFO:tasks.workunit.client.1.smithi161.stdout:3/552: dwrite d2/d51/d75/f1e [4194304,4194304] 0 2023-12-09T02:35:19.365 INFO:tasks.workunit.client.1.smithi161.stdout:3/553: dread - d2/d51/d75/d11/d7b/f85 zero size 2023-12-09T02:35:19.366 INFO:tasks.workunit.client.1.smithi161.stdout:3/554: mknod d2/d51/d75/d11/c9f 0 2023-12-09T02:35:19.367 INFO:tasks.workunit.client.1.smithi161.stdout:3/555: fsync d2/d51/d75/d11/d19/d91/d46/d5e/f79 0 2023-12-09T02:35:19.367 INFO:tasks.workunit.client.1.smithi161.stdout:3/556: write d2/d51/d75/d11/d19/d91/d46/d5e/f9a [36859,103003] 0 2023-12-09T02:35:19.368 INFO:tasks.workunit.client.1.smithi161.stdout:3/557: unlink d2/d51/d75/d50/d69/l9b 0 2023-12-09T02:35:19.370 INFO:tasks.workunit.client.1.smithi161.stdout:3/558: rmdir d2/d51/d75/d11/d28 39 2023-12-09T02:35:19.372 INFO:tasks.workunit.client.1.smithi161.stdout:3/559: creat d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/fa0 x:0 0 0 2023-12-09T02:35:19.374 INFO:tasks.workunit.client.1.smithi161.stdout:5/646: dwrite d0/d2/de/d21/f2c [0,4194304] 0 2023-12-09T02:35:19.375 INFO:tasks.workunit.client.1.smithi161.stdout:3/560: creat d2/fa1 x:0 0 0 2023-12-09T02:35:19.375 INFO:tasks.workunit.client.1.smithi161.stdout:3/561: truncate d2/d37/f70 418113 0 2023-12-09T02:35:19.378 INFO:tasks.workunit.client.1.smithi161.stdout:3/562: dread d2/d51/d75/d11/d19/d91/d46/d2d/d47/f8b [0,4194304] 0 2023-12-09T02:35:19.378 INFO:tasks.workunit.client.1.smithi161.stdout:3/563: stat d2/d51/d75/d11/d28 0 2023-12-09T02:35:19.379 INFO:tasks.workunit.client.1.smithi161.stdout:3/564: getdents d2/d51/d75/d11/d1f/d7a 0 2023-12-09T02:35:19.382 INFO:tasks.workunit.client.1.smithi161.stdout:3/565: mknod d2/d51/d75/d11/d19/d91/d46/d2d/d47/ca2 0 2023-12-09T02:35:19.382 INFO:tasks.workunit.client.1.smithi161.stdout:5/647: dread d0/d2/d7/d11/f4c [0,4194304] 0 2023-12-09T02:35:19.384 INFO:tasks.workunit.client.1.smithi161.stdout:5/648: symlink d0/d2/de/d44/ddd/le6 0 2023-12-09T02:35:19.388 INFO:tasks.workunit.client.1.smithi161.stdout:5/649: mkdir d0/d2/de/d22/d8e/d8f/de7 0 2023-12-09T02:35:19.395 INFO:tasks.workunit.client.1.smithi161.stdout:5/650: dread d0/f18 [0,4194304] 0 2023-12-09T02:35:19.395 INFO:tasks.workunit.client.1.smithi161.stdout:3/566: dwrite d2/f82 [0,4194304] 0 2023-12-09T02:35:19.396 INFO:tasks.workunit.client.1.smithi161.stdout:5/651: creat d0/d2/d7/fe8 x:0 0 0 2023-12-09T02:35:19.399 INFO:tasks.workunit.client.1.smithi161.stdout:3/567: symlink d2/d51/d75/d11/d1f/d7a/d96/la3 0 2023-12-09T02:35:19.406 INFO:tasks.workunit.client.1.smithi161.stdout:5/652: dread d0/d2/d5f/f64 [0,4194304] 0 2023-12-09T02:35:19.407 INFO:tasks.workunit.client.1.smithi161.stdout:5/653: truncate d0/d2/d7/d11/dc3/fc6 18448 0 2023-12-09T02:35:19.409 INFO:tasks.workunit.client.1.smithi161.stdout:5/654: symlink d0/d2/d7/le9 0 2023-12-09T02:35:19.409 INFO:tasks.workunit.client.1.smithi161.stdout:5/655: write d0/fe2 [517658,6924] 0 2023-12-09T02:35:19.414 INFO:tasks.workunit.client.1.smithi161.stdout:3/568: dwrite d2/d51/d75/d11/d19/d91/d46/d5e/f73 [0,4194304] 0 2023-12-09T02:35:19.414 INFO:tasks.workunit.client.1.smithi161.stdout:3/569: chown d2/d51/d75/d11/d1f/d7a/d96 29179 1 2023-12-09T02:35:19.414 INFO:tasks.workunit.client.1.smithi161.stdout:3/570: truncate d2/d51/d75/d11/f3c 1067598 0 2023-12-09T02:35:19.414 INFO:tasks.workunit.client.1.smithi161.stdout:3/571: read - d2/d37/f7f zero size 2023-12-09T02:35:19.414 INFO:tasks.workunit.client.1.smithi161.stdout:5/656: dread d0/d2/de/d21/f73 [0,4194304] 0 2023-12-09T02:35:19.415 INFO:tasks.workunit.client.1.smithi161.stdout:5/657: chown d0/d2/d7/ca9 1519 1 2023-12-09T02:35:19.416 INFO:tasks.workunit.client.1.smithi161.stdout:5/658: creat d0/d1f/fea x:0 0 0 2023-12-09T02:35:19.417 INFO:tasks.workunit.client.1.smithi161.stdout:5/659: creat d0/d2/d7/d11/d50/d8a/feb x:0 0 0 2023-12-09T02:35:19.418 INFO:tasks.workunit.client.1.smithi161.stdout:5/660: mknod d0/d2/de/d22/d8e/d8f/dcd/cec 0 2023-12-09T02:35:19.418 INFO:tasks.workunit.client.1.smithi161.stdout:5/661: chown d0/d1f/f3b 5 1 2023-12-09T02:35:19.428 INFO:tasks.workunit.client.1.smithi161.stdout:5/662: dread d0/d2/de/d22/d8e/d8f/fab [0,4194304] 0 2023-12-09T02:35:19.433 INFO:tasks.workunit.client.1.smithi161.stdout:5/663: rename d0/d1f to d0/d2/d7/d11/d50/d8a/ded 0 2023-12-09T02:35:19.433 INFO:tasks.workunit.client.1.smithi161.stdout:5/664: write d0/d2/d7/d9a/fd7 [668628,12015] 0 2023-12-09T02:35:19.433 INFO:tasks.workunit.client.1.smithi161.stdout:5/665: stat d0/d2/d7/d11/d61/lb8 0 2023-12-09T02:35:19.433 INFO:tasks.workunit.client.1.smithi161.stdout:5/666: write d0/d2/d7/d11/d50/d8a/ded/fea [598765,66367] 0 2023-12-09T02:35:19.434 INFO:tasks.workunit.client.1.smithi161.stdout:5/667: symlink d0/d2/de/lee 0 2023-12-09T02:35:19.434 INFO:tasks.workunit.client.1.smithi161.stdout:5/668: read - d0/d2/d5f/fc0 zero size 2023-12-09T02:35:19.442 INFO:tasks.workunit.client.1.smithi161.stdout:3/572: dwrite d2/d51/d75/d11/d19/d91/f7d [4194304,4194304] 0 2023-12-09T02:35:19.448 INFO:tasks.workunit.client.1.smithi161.stdout:3/573: creat d2/d51/d75/d11/d19/d91/fa4 x:0 0 0 2023-12-09T02:35:19.450 INFO:tasks.workunit.client.1.smithi161.stdout:3/574: creat d2/d51/d75/d11/d19/d91/d46/d5e/fa5 x:0 0 0 2023-12-09T02:35:19.451 INFO:tasks.workunit.client.1.smithi161.stdout:3/575: creat d2/d37/fa6 x:0 0 0 2023-12-09T02:35:19.452 INFO:tasks.workunit.client.1.smithi161.stdout:3/576: mknod d2/d51/d75/d11/d19/d91/d46/d5e/ca7 0 2023-12-09T02:35:19.457 INFO:tasks.workunit.client.1.smithi161.stdout:5/669: dwrite d0/d2/de/d22/f59 [4194304,4194304] 0 2023-12-09T02:35:19.458 INFO:tasks.workunit.client.1.smithi161.stdout:5/670: getdents d0/d2/de/d22 0 2023-12-09T02:35:19.458 INFO:tasks.workunit.client.1.smithi161.stdout:5/671: mkdir d0/d2/d7/d11/d61/def 0 2023-12-09T02:35:19.466 INFO:tasks.workunit.client.1.smithi161.stdout:5/672: dread d0/d2/de/d22/d8e/d8f/dcd/f95 [0,4194304] 0 2023-12-09T02:35:19.466 INFO:tasks.workunit.client.1.smithi161.stdout:5/673: truncate d0/f9e 4217933 0 2023-12-09T02:35:19.468 INFO:tasks.workunit.client.1.smithi161.stdout:5/674: creat d0/d2/de/d22/ff0 x:0 0 0 2023-12-09T02:35:19.468 INFO:tasks.workunit.client.1.smithi161.stdout:0/612: sync 2023-12-09T02:35:19.469 INFO:tasks.workunit.client.1.smithi161.stdout:8/609: sync 2023-12-09T02:35:19.471 INFO:tasks.workunit.client.1.smithi161.stdout:8/610: mkdir d2/d5/d22/dc3 0 2023-12-09T02:35:19.471 INFO:tasks.workunit.client.1.smithi161.stdout:8/611: chown d2/d5/d22/d31/d38/d66/l7a 63 1 2023-12-09T02:35:19.471 INFO:tasks.workunit.client.1.smithi161.stdout:8/612: chown d2/d5/d22/d76 237827 1 2023-12-09T02:35:19.471 INFO:tasks.workunit.client.1.smithi161.stdout:8/613: readlink d2/d5/d22/d54/l61 0 2023-12-09T02:35:19.472 INFO:tasks.workunit.client.1.smithi161.stdout:5/675: write d0/d2/d7/d9a/fc8 [4130136,125363] 0 2023-12-09T02:35:19.472 INFO:tasks.workunit.client.1.smithi161.stdout:5/676: fsync d0/d2/f7a 0 2023-12-09T02:35:19.473 INFO:tasks.workunit.client.1.smithi161.stdout:5/677: truncate d0/d2/d7/d9a/fd7 974654 0 2023-12-09T02:35:19.473 INFO:tasks.workunit.client.1.smithi161.stdout:0/613: write d9/d55/d7c/f2b [1106971,62649] 0 2023-12-09T02:35:19.473 INFO:tasks.workunit.client.1.smithi161.stdout:8/614: write d2/d5/d22/d31/d38/f59 [843382,20920] 0 2023-12-09T02:35:19.473 INFO:tasks.workunit.client.1.smithi161.stdout:3/577: dwrite d2/f82 [4194304,4194304] 0 2023-12-09T02:35:19.473 INFO:tasks.workunit.client.1.smithi161.stdout:3/578: readlink d2/d51/d75/d11/d1f/d4c/l83 0 2023-12-09T02:35:19.474 INFO:tasks.workunit.client.1.smithi161.stdout:3/579: write d2/d51/d75/d11/d19/f2e [3573576,28474] 0 2023-12-09T02:35:19.479 INFO:tasks.workunit.client.1.smithi161.stdout:0/614: symlink d9/db/lbd 0 2023-12-09T02:35:19.481 INFO:tasks.workunit.client.1.smithi161.stdout:8/615: symlink d2/d5/d22/d31/lc4 0 2023-12-09T02:35:19.482 INFO:tasks.workunit.client.1.smithi161.stdout:8/616: stat d2/fb1 0 2023-12-09T02:35:19.485 INFO:tasks.workunit.client.1.smithi161.stdout:5/678: dwrite d0/d2/de/d22/d8e/d8f/dcd/da8/fba [0,4194304] 0 2023-12-09T02:35:19.485 INFO:tasks.workunit.client.1.smithi161.stdout:5/679: chown d0/d2/d7/d9a/fc8 28 1 2023-12-09T02:35:19.485 INFO:tasks.workunit.client.1.smithi161.stdout:5/680: chown d0/d2/de/d22/d8e/d8f/dcd/cec 4 1 2023-12-09T02:35:19.485 INFO:tasks.workunit.client.1.smithi161.stdout:5/681: write d0/d2/de/d22/d8e/d8f/dcd/f95 [4614099,123642] 0 2023-12-09T02:35:19.485 INFO:tasks.workunit.client.1.smithi161.stdout:5/682: truncate d0/d2/d7/d11/d50/fb9 1361786 0 2023-12-09T02:35:19.485 INFO:tasks.workunit.client.1.smithi161.stdout:3/580: link d2/d51/d75/d11/d19/d91/d46/d2d/d4e/f65 d2/fa8 0 2023-12-09T02:35:19.486 INFO:tasks.workunit.client.1.smithi161.stdout:0/615: rename d9/l23 to d9/d55/d26/d28/d58/d8e/lbe 0 2023-12-09T02:35:19.494 INFO:tasks.workunit.client.1.smithi161.stdout:5/683: dread d0/d2/de/d22/f59 [8388608,4194304] 0 2023-12-09T02:35:19.494 INFO:tasks.workunit.client.1.smithi161.stdout:5/684: dread - d0/d2/d7/d11/d50/d8a/ded/f88 zero size 2023-12-09T02:35:19.494 INFO:tasks.workunit.client.1.smithi161.stdout:8/617: rename d2/d5/d22/d31/c9a to d2/d8a/cc5 0 2023-12-09T02:35:19.494 INFO:tasks.workunit.client.1.smithi161.stdout:8/618: fsync d2/d5/f40 0 2023-12-09T02:35:19.496 INFO:tasks.workunit.client.1.smithi161.stdout:5/685: read d0/d2/d7/d11/dc3/f75 [537048,52123] 0 2023-12-09T02:35:19.497 INFO:tasks.workunit.client.1.smithi161.stdout:8/619: rmdir d2/d5/d22/d54/db4 39 2023-12-09T02:35:19.499 INFO:tasks.workunit.client.1.smithi161.stdout:5/686: creat d0/d2/d7/d11/dc3/ff1 x:0 0 0 2023-12-09T02:35:19.499 INFO:tasks.workunit.client.1.smithi161.stdout:5/687: stat d0/d2/de/d22/d55/ca7 0 2023-12-09T02:35:19.499 INFO:tasks.workunit.client.1.smithi161.stdout:3/581: dread d2/f72 [0,4194304] 0 2023-12-09T02:35:19.500 INFO:tasks.workunit.client.1.smithi161.stdout:3/582: write d2/d51/d75/f18 [4824347,42884] 0 2023-12-09T02:35:19.503 INFO:tasks.workunit.client.1.smithi161.stdout:3/583: write d2/d51/d75/d11/d7b/f87 [205997,10129] 0 2023-12-09T02:35:19.505 INFO:tasks.workunit.client.1.smithi161.stdout:5/688: unlink d0/d2/de/d22/d8e/d8f/dcd/cec 0 2023-12-09T02:35:19.507 INFO:tasks.workunit.client.1.smithi161.stdout:0/616: dwrite d9/dd/f80 [0,4194304] 0 2023-12-09T02:35:19.510 INFO:tasks.workunit.client.1.smithi161.stdout:5/689: rmdir d0/d2/de 39 2023-12-09T02:35:19.513 INFO:tasks.workunit.client.1.smithi161.stdout:0/617: rename d9/dd/l8b to d9/d55/d86/d98/lbf 0 2023-12-09T02:35:19.515 INFO:tasks.workunit.client.1.smithi161.stdout:5/690: truncate d0/d2/de/d44/f43 4021812 0 2023-12-09T02:35:19.516 INFO:tasks.workunit.client.1.smithi161.stdout:5/691: creat d0/d2/de/d22/d8e/d8f/dcd/da8/db7/de5/ff2 x:0 0 0 2023-12-09T02:35:19.517 INFO:tasks.workunit.client.1.smithi161.stdout:5/692: read d0/d9/f78 [480258,28133] 0 2023-12-09T02:35:19.517 INFO:tasks.workunit.client.1.smithi161.stdout:5/693: getdents d0/d2/de/d22/d8e/d8f/dcd/d83 0 2023-12-09T02:35:19.517 INFO:tasks.workunit.client.1.smithi161.stdout:5/694: read d0/d2/d7/d11/dc3/fc6 [14355,24602] 0 2023-12-09T02:35:19.518 INFO:tasks.workunit.client.1.smithi161.stdout:8/620: rmdir d2 39 2023-12-09T02:35:19.519 INFO:tasks.workunit.client.1.smithi161.stdout:5/695: mkdir d0/d2/d7/df3 0 2023-12-09T02:35:19.521 INFO:tasks.workunit.client.1.smithi161.stdout:3/584: dwrite d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/fa0 [0,4194304] 0 2023-12-09T02:35:19.522 INFO:tasks.workunit.client.1.smithi161.stdout:3/585: fsync d2/d51/d75/d11/d19/d91/f63 0 2023-12-09T02:35:19.523 INFO:tasks.workunit.client.1.smithi161.stdout:5/696: mknod d0/d2/de/d44/da6/cf4 0 2023-12-09T02:35:19.532 INFO:tasks.workunit.client.1.smithi161.stdout:0/618: dread d9/dd/f77 [0,4194304] 0 2023-12-09T02:35:19.547 INFO:tasks.workunit.client.1.smithi161.stdout:0/619: dread d9/d55/d26/f57 [0,4194304] 0 2023-12-09T02:35:19.548 INFO:tasks.workunit.client.1.smithi161.stdout:0/620: rmdir d9/d55/d26/d82 39 2023-12-09T02:35:19.555 INFO:tasks.workunit.client.1.smithi161.stdout:3/586: dwrite d2/d37/f38 [0,4194304] 0 2023-12-09T02:35:19.555 INFO:tasks.workunit.client.1.smithi161.stdout:5/697: dwrite d0/d2/de/d44/f43 [4194304,4194304] 0 2023-12-09T02:35:19.555 INFO:tasks.workunit.client.1.smithi161.stdout:5/698: chown d0/d2/de/d22/d8e/d8f/dcd/d83/lcf 155870456 1 2023-12-09T02:35:19.555 INFO:tasks.workunit.client.1.smithi161.stdout:8/621: dwrite d2/f17 [4194304,4194304] 0 2023-12-09T02:35:19.555 INFO:tasks.workunit.client.1.smithi161.stdout:0/621: dread d9/d55/d7c/f73 [0,4194304] 0 2023-12-09T02:35:19.555 INFO:tasks.workunit.client.1.smithi161.stdout:8/622: fsync d2/d5/d3d/f6f 0 2023-12-09T02:35:19.562 INFO:tasks.workunit.client.1.smithi161.stdout:3/587: creat d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/fa9 x:0 0 0 2023-12-09T02:35:19.562 INFO:tasks.workunit.client.1.smithi161.stdout:0/622: creat d9/d55/d44/d85/fc0 x:0 0 0 2023-12-09T02:35:19.563 INFO:tasks.workunit.client.1.smithi161.stdout:8/623: mknod d2/d5/d22/d54/cc6 0 2023-12-09T02:35:19.567 INFO:tasks.workunit.client.1.smithi161.stdout:3/588: rename d2/d51/d75/d11/d19/d91/d46/c52 to d2/d51/d75/d11/d19/caa 0 2023-12-09T02:35:19.568 INFO:tasks.workunit.client.1.smithi161.stdout:0/623: symlink d9/d55/d26/d28/daa/lc1 0 2023-12-09T02:35:19.569 INFO:tasks.workunit.client.1.smithi161.stdout:5/699: dwrite d0/f27 [4194304,4194304] 0 2023-12-09T02:35:19.569 INFO:tasks.workunit.client.1.smithi161.stdout:5/700: fsync d0/d9/f6a 0 2023-12-09T02:35:19.572 INFO:tasks.workunit.client.1.smithi161.stdout:3/589: mkdir d2/d51/d75/d11/d19/d91/d46/d40/dab 0 2023-12-09T02:35:19.575 INFO:tasks.workunit.client.1.smithi161.stdout:0/624: write d9/db/d2a/d35/f91 [3980742,59543] 0 2023-12-09T02:35:19.576 INFO:tasks.workunit.client.1.smithi161.stdout:5/701: mknod d0/d2/de/d22/d8e/d8f/cf5 0 2023-12-09T02:35:19.577 INFO:tasks.workunit.client.1.smithi161.stdout:8/624: mkdir d2/d5/d3d/dc7 0 2023-12-09T02:35:19.577 INFO:tasks.workunit.client.1.smithi161.stdout:8/625: fdatasync d2/f17 0 2023-12-09T02:35:19.577 INFO:tasks.workunit.client.1.smithi161.stdout:8/626: fsync d2/d5/d22/d31/d38/d48/f72 0 2023-12-09T02:35:19.578 INFO:tasks.workunit.client.1.smithi161.stdout:3/590: creat d2/fac x:0 0 0 2023-12-09T02:35:19.578 INFO:tasks.workunit.client.1.smithi161.stdout:3/591: dread - d2/d51/d75/d11/d19/d91/fa4 zero size 2023-12-09T02:35:19.592 INFO:tasks.workunit.client.1.smithi161.stdout:5/702: dread d0/d2/d7/d11/dc3/f75 [0,4194304] 0 2023-12-09T02:35:19.592 INFO:tasks.workunit.client.1.smithi161.stdout:5/703: truncate d0/d2/de/d22/fa3 854824 0 2023-12-09T02:35:19.592 INFO:tasks.workunit.client.1.smithi161.stdout:8/627: creat d2/d5/d4f/fc8 x:0 0 0 2023-12-09T02:35:19.594 INFO:tasks.workunit.client.1.smithi161.stdout:3/592: creat d2/d51/d75/fad x:0 0 0 2023-12-09T02:35:19.594 INFO:tasks.workunit.client.1.smithi161.stdout:3/593: write d2/d51/d75/d11/d19/d91/d46/d5e/f9a [80091,126058] 0 2023-12-09T02:35:19.594 INFO:tasks.workunit.client.1.smithi161.stdout:0/625: mkdir d9/db/d2a/d35/dc2 0 2023-12-09T02:35:19.595 INFO:tasks.workunit.client.1.smithi161.stdout:5/704: symlink d0/d2/d7/lf6 0 2023-12-09T02:35:19.596 INFO:tasks.workunit.client.1.smithi161.stdout:8/628: truncate d2/d2d/f70 2243401 0 2023-12-09T02:35:19.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/629: stat d2/d8a/dbd 0 2023-12-09T02:35:19.598 INFO:tasks.workunit.client.1.smithi161.stdout:3/594: unlink d2/f15 0 2023-12-09T02:35:19.599 INFO:tasks.workunit.client.1.smithi161.stdout:0/626: truncate d9/d1f/f18 641976 0 2023-12-09T02:35:19.599 INFO:tasks.workunit.client.1.smithi161.stdout:0/627: readlink d9/db/l14 0 2023-12-09T02:35:19.601 INFO:tasks.workunit.client.1.smithi161.stdout:5/705: rename d0/d2/de/d44/da6/cf4 to d0/d2/de/d22/d8e/d8f/dcd/da8/db7/de5/cf7 0 2023-12-09T02:35:19.603 INFO:tasks.workunit.client.1.smithi161.stdout:8/630: symlink d2/d5/d22/d76/lc9 0 2023-12-09T02:35:19.607 INFO:tasks.workunit.client.1.smithi161.stdout:0/628: mknod d9/d55/d26/cc3 0 2023-12-09T02:35:19.610 INFO:tasks.workunit.client.1.smithi161.stdout:8/631: rename d2/d5/le to d2/d5/d22/d86/lca 0 2023-12-09T02:35:19.610 INFO:tasks.workunit.client.1.smithi161.stdout:8/632: chown d2/d5/d22/d31/d38/d48/f5a 18819510 1 2023-12-09T02:35:19.613 INFO:tasks.workunit.client.1.smithi161.stdout:8/633: write d2/d5/d22/d54/f91 [187662,17592] 0 2023-12-09T02:35:19.617 INFO:tasks.workunit.client.1.smithi161.stdout:8/634: rename d2/d5/d3d/l6d to d2/d5/d4f/db2/da9/lcb 0 2023-12-09T02:35:19.620 INFO:tasks.workunit.client.1.smithi161.stdout:8/635: mknod d2/d5/dac/ccc 0 2023-12-09T02:35:19.621 INFO:tasks.workunit.client.1.smithi161.stdout:0/629: dread d9/d55/d7c/f38 [0,4194304] 0 2023-12-09T02:35:19.621 INFO:tasks.workunit.client.1.smithi161.stdout:0/630: write d9/d55/d26/fa7 [974243,116435] 0 2023-12-09T02:35:19.621 INFO:tasks.workunit.client.1.smithi161.stdout:3/595: dwrite d2/d51/d75/d11/d19/d91/d46/d40/f58 [0,4194304] 0 2023-12-09T02:35:19.622 INFO:tasks.workunit.client.1.smithi161.stdout:3/596: fsync d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/fa9 0 2023-12-09T02:35:19.625 INFO:tasks.workunit.client.1.smithi161.stdout:8/636: mkdir d2/d5/d22/d54/db4/dcd 0 2023-12-09T02:35:19.627 INFO:tasks.workunit.client.1.smithi161.stdout:0/631: rename d9/d1f/f49 to d9/d55/d26/d28/daa/fc4 0 2023-12-09T02:35:19.627 INFO:tasks.workunit.client.1.smithi161.stdout:0/632: fdatasync d9/d55/d7c/f74 0 2023-12-09T02:35:19.631 INFO:tasks.workunit.client.1.smithi161.stdout:3/597: truncate d2/d37/f70 547560 0 2023-12-09T02:35:19.635 INFO:tasks.workunit.client.1.smithi161.stdout:0/633: creat d9/dd/fc5 x:0 0 0 2023-12-09T02:35:19.637 INFO:tasks.workunit.client.1.smithi161.stdout:8/637: rename d2/d5/d22/d31/f80 to d2/d5/d4f/db2/da9/fce 0 2023-12-09T02:35:19.640 INFO:tasks.workunit.client.1.smithi161.stdout:3/598: symlink d2/d37/lae 0 2023-12-09T02:35:19.640 INFO:tasks.workunit.client.1.smithi161.stdout:3/599: dread - d2/d51/d75/d11/d1f/d7a/d96/f76 zero size 2023-12-09T02:35:19.641 INFO:tasks.workunit.client.1.smithi161.stdout:0/634: mknod d9/d5b/cc6 0 2023-12-09T02:35:19.641 INFO:tasks.workunit.client.1.smithi161.stdout:0/635: fdatasync d9/d55/d44/d85/fc0 0 2023-12-09T02:35:19.643 INFO:tasks.workunit.client.1.smithi161.stdout:3/600: mkdir d2/daf 0 2023-12-09T02:35:19.647 INFO:tasks.workunit.client.1.smithi161.stdout:0/636: write d9/d55/d7c/f2b [149079,86512] 0 2023-12-09T02:35:19.653 INFO:tasks.workunit.client.1.smithi161.stdout:8/638: dread d2/d5/f34 [0,4194304] 0 2023-12-09T02:35:19.653 INFO:tasks.workunit.client.1.smithi161.stdout:0/637: write d9/db/f84 [499478,39874] 0 2023-12-09T02:35:19.653 INFO:tasks.workunit.client.1.smithi161.stdout:0/638: truncate d9/f97 678646 0 2023-12-09T02:35:19.653 INFO:tasks.workunit.client.1.smithi161.stdout:0/639: readlink d9/db/lbd 0 2023-12-09T02:35:19.653 INFO:tasks.workunit.client.1.smithi161.stdout:8/639: write d2/d5/d22/f77 [165726,40521] 0 2023-12-09T02:35:19.655 INFO:tasks.workunit.client.1.smithi161.stdout:7/651: sync 2023-12-09T02:35:19.656 INFO:tasks.workunit.client.1.smithi161.stdout:0/640: getdents d9/db/d2a/d35/d7b 0 2023-12-09T02:35:19.657 INFO:tasks.workunit.client.1.smithi161.stdout:8/640: creat d2/d5/dc0/fcf x:0 0 0 2023-12-09T02:35:19.657 INFO:tasks.workunit.client.1.smithi161.stdout:7/652: read d0/d3/d13/d2d/d43/dcb/d59/d5e/fa6 [70684,8704] 0 2023-12-09T02:35:19.657 INFO:tasks.workunit.client.1.smithi161.stdout:7/653: rename d0/d3/d13/d4e/db2/da7 to d0/d3/d13/d4e/db2/da7/dd6 22 2023-12-09T02:35:19.658 INFO:tasks.workunit.client.1.smithi161.stdout:7/654: stat d0/d3/d13/d4e/db5/d83/l8b 0 2023-12-09T02:35:19.659 INFO:tasks.workunit.client.1.smithi161.stdout:0/641: creat d9/d1f/fc7 x:0 0 0 2023-12-09T02:35:19.661 INFO:tasks.workunit.client.1.smithi161.stdout:7/655: read d0/d3/d13/f34 [1681275,30879] 0 2023-12-09T02:35:19.664 INFO:tasks.workunit.client.1.smithi161.stdout:7/656: mknod d0/d49/d67/d71/dc0/cd7 0 2023-12-09T02:35:19.674 INFO:tasks.workunit.client.1.smithi161.stdout:3/601: dwrite d2/d51/d75/fad [0,4194304] 0 2023-12-09T02:35:19.674 INFO:tasks.workunit.client.1.smithi161.stdout:3/602: truncate d2/d51/d75/d11/d19/d91/fa4 614958 0 2023-12-09T02:35:19.677 INFO:tasks.workunit.client.1.smithi161.stdout:0/642: dread d9/db/d2a/d9d/dba/f79 [0,4194304] 0 2023-12-09T02:35:19.677 INFO:tasks.workunit.client.1.smithi161.stdout:3/603: truncate d2/fa8 2295521 0 2023-12-09T02:35:19.680 INFO:tasks.workunit.client.1.smithi161.stdout:0/643: creat d9/d9c/fc8 x:0 0 0 2023-12-09T02:35:19.681 INFO:tasks.workunit.client.1.smithi161.stdout:8/641: dwrite d2/d5/d22/d31/fc2 [0,4194304] 0 2023-12-09T02:35:19.683 INFO:tasks.workunit.client.1.smithi161.stdout:0/644: mknod d9/d55/d26/cc9 0 2023-12-09T02:35:19.685 INFO:tasks.workunit.client.1.smithi161.stdout:8/642: mkdir d2/d5/d22/d86/dd0 0 2023-12-09T02:35:19.688 INFO:tasks.workunit.client.1.smithi161.stdout:7/657: dwrite d0/d3/d13/d2d/d6e/f8c [0,4194304] 0 2023-12-09T02:35:19.690 INFO:tasks.workunit.client.1.smithi161.stdout:8/643: write d2/d5/f14 [847112,91903] 0 2023-12-09T02:35:19.690 INFO:tasks.workunit.client.1.smithi161.stdout:8/644: write d2/d5/d22/d31/d38/d66/d88/da1/fba [655677,23494] 0 2023-12-09T02:35:19.692 INFO:tasks.workunit.client.1.smithi161.stdout:8/645: mknod d2/d5/d22/d54/d9e/cd1 0 2023-12-09T02:35:19.695 INFO:tasks.workunit.client.1.smithi161.stdout:3/604: dwrite d2/d51/d75/d11/d19/d91/d46/d2d/d47/f56 [0,4194304] 0 2023-12-09T02:35:19.695 INFO:tasks.workunit.client.1.smithi161.stdout:8/646: stat d2/d5/d3d/f46 0 2023-12-09T02:35:19.706 INFO:tasks.workunit.client.1.smithi161.stdout:3/605: creat d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/fb0 x:0 0 0 2023-12-09T02:35:19.708 INFO:tasks.workunit.client.1.smithi161.stdout:8/647: symlink d2/d5/d22/d31/d38/ld2 0 2023-12-09T02:35:19.710 INFO:tasks.workunit.client.1.smithi161.stdout:3/606: write d2/d51/d75/d11/d19/f6e [1940365,58593] 0 2023-12-09T02:35:19.710 INFO:tasks.workunit.client.1.smithi161.stdout:3/607: fdatasync d2/d51/d75/d11/d19/d91/fa4 0 2023-12-09T02:35:19.715 INFO:tasks.workunit.client.1.smithi161.stdout:3/608: symlink d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/lb1 0 2023-12-09T02:35:19.728 INFO:tasks.workunit.client.1.smithi161.stdout:8/648: dwrite d2/d5/d22/d54/f91 [0,4194304] 0 2023-12-09T02:35:19.730 INFO:tasks.workunit.client.1.smithi161.stdout:8/649: creat d2/d5/d22/fd3 x:0 0 0 2023-12-09T02:35:19.730 INFO:tasks.workunit.client.1.smithi161.stdout:8/650: readlink d2/d2d/l9c 0 2023-12-09T02:35:19.731 INFO:tasks.workunit.client.1.smithi161.stdout:8/651: creat d2/d5/d22/d54/db4/dcd/fd4 x:0 0 0 2023-12-09T02:35:19.731 INFO:tasks.workunit.client.1.smithi161.stdout:8/652: dread - d2/d5/d22/fbf zero size 2023-12-09T02:35:19.731 INFO:tasks.workunit.client.1.smithi161.stdout:8/653: dread - d2/d5/d22/d54/db4/dcd/fd4 zero size 2023-12-09T02:35:19.731 INFO:tasks.workunit.client.1.smithi161.stdout:8/654: chown d2/d5/c93 22208 1 2023-12-09T02:35:19.734 INFO:tasks.workunit.client.1.smithi161.stdout:8/655: dread d2/f6 [0,4194304] 0 2023-12-09T02:35:19.736 INFO:tasks.workunit.client.1.smithi161.stdout:3/609: dwrite d2/d51/d75/d11/d28/f8a [4194304,4194304] 0 2023-12-09T02:35:19.828 INFO:tasks.workunit.client.1.smithi161.stdout:3/610: symlink d2/d51/d75/d11/d7b/lb2 0 2023-12-09T02:35:19.828 INFO:tasks.workunit.client.1.smithi161.stdout:3/611: stat d2/d51/d75/d11/d19/d91 0 2023-12-09T02:35:19.844 INFO:tasks.workunit.client.1.smithi161.stdout:3/612: dwrite d2/d51/d75/f1e [4194304,4194304] 0 2023-12-09T02:35:19.882 INFO:tasks.workunit.client.1.smithi161.stdout:3/613: creat d2/d51/d75/d11/d1f/fb3 x:0 0 0 2023-12-09T02:35:19.882 INFO:tasks.workunit.client.1.smithi161.stdout:3/614: readlink d2/d51/d75/d11/d28/l48 0 2023-12-09T02:35:19.882 INFO:tasks.workunit.client.1.smithi161.stdout:3/615: readlink d2/d51/d75/d11/d19/d91/d46/d2d/d4e/l89 0 2023-12-09T02:35:19.884 INFO:tasks.workunit.client.1.smithi161.stdout:3/616: truncate d2/d51/d75/d11/f5d 708700 0 2023-12-09T02:35:19.884 INFO:tasks.workunit.client.1.smithi161.stdout:3/617: readlink d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/lb1 0 2023-12-09T02:35:19.884 INFO:tasks.workunit.client.1.smithi161.stdout:3/618: read - d2/fa1 zero size 2023-12-09T02:35:19.884 INFO:tasks.workunit.client.1.smithi161.stdout:3/619: fsync d2/d51/d75/d11/d7b/f85 0 2023-12-09T02:35:19.884 INFO:tasks.workunit.client.1.smithi161.stdout:3/620: fsync d2/f72 0 2023-12-09T02:35:19.886 INFO:tasks.workunit.client.1.smithi161.stdout:3/621: rmdir d2/d51/d75/d11/d1f/d7a/d96/d78 0 2023-12-09T02:35:19.888 INFO:tasks.workunit.client.1.smithi161.stdout:3/622: unlink d2/d51/d75/d11/d1f/d74/l9e 0 2023-12-09T02:35:19.890 INFO:tasks.workunit.client.1.smithi161.stdout:3/623: truncate d2/d51/d75/d11/d19/f6e 1823560 0 2023-12-09T02:35:19.892 INFO:tasks.workunit.client.1.smithi161.stdout:6/656: sync 2023-12-09T02:35:19.892 INFO:tasks.workunit.client.1.smithi161.stdout:2/688: sync 2023-12-09T02:35:19.892 INFO:tasks.workunit.client.1.smithi161.stdout:4/810: sync 2023-12-09T02:35:19.892 INFO:tasks.workunit.client.1.smithi161.stdout:6/657: fdatasync da/d19/dc2/f67 0 2023-12-09T02:35:19.892 INFO:tasks.workunit.client.1.smithi161.stdout:4/811: truncate dd/d36/d3f/d54/d102/d25/d32/dd0/ff6 583266 0 2023-12-09T02:35:19.895 INFO:tasks.workunit.client.1.smithi161.stdout:6/658: creat da/df/d2d/d3b/fe0 x:0 0 0 2023-12-09T02:35:19.895 INFO:tasks.workunit.client.1.smithi161.stdout:6/659: chown da/d19/dc2/d77/f9a 1134036 1 2023-12-09T02:35:19.897 INFO:tasks.workunit.client.1.smithi161.stdout:4/812: symlink dd/d36/d3f/l10a 0 2023-12-09T02:35:19.899 INFO:tasks.workunit.client.1.smithi161.stdout:6/660: link da/d19/d20/f25 da/d19/dc2/d3c/db8/fe1 0 2023-12-09T02:35:19.900 INFO:tasks.workunit.client.1.smithi161.stdout:2/689: dread d4/d7/db/f36 [0,4194304] 0 2023-12-09T02:35:19.904 INFO:tasks.workunit.client.1.smithi161.stdout:6/661: write da/df/d2d/f47 [5592452,121323] 0 2023-12-09T02:35:19.904 INFO:tasks.workunit.client.1.smithi161.stdout:4/813: symlink dd/d36/d4a/d88/l10b 0 2023-12-09T02:35:19.911 INFO:tasks.workunit.client.1.smithi161.stdout:6/662: creat da/d19/dc2/d3c/dd1/fe2 x:0 0 0 2023-12-09T02:35:19.912 INFO:tasks.workunit.client.1.smithi161.stdout:6/663: truncate da/d19/dc2/d29/d92/fa2 727840 0 2023-12-09T02:35:19.912 INFO:tasks.workunit.client.1.smithi161.stdout:4/814: mkdir dd/d1a/d10c 0 2023-12-09T02:35:19.916 INFO:tasks.workunit.client.1.smithi161.stdout:6/664: symlink da/da3/le3 0 2023-12-09T02:35:19.916 INFO:tasks.workunit.client.1.smithi161.stdout:6/665: write da/f12 [2282950,83419] 0 2023-12-09T02:35:19.917 INFO:tasks.workunit.client.1.smithi161.stdout:4/815: symlink dd/d1a/l10d 0 2023-12-09T02:35:19.919 INFO:tasks.workunit.client.1.smithi161.stdout:3/624: dwrite d2/d51/d75/d11/f8d [0,4194304] 0 2023-12-09T02:35:19.920 INFO:tasks.workunit.client.1.smithi161.stdout:3/625: dread - d2/d51/d75/d11/d1f/fb3 zero size 2023-12-09T02:35:19.920 INFO:tasks.workunit.client.1.smithi161.stdout:3/626: readlink d2/d51/d75/l80 0 2023-12-09T02:35:19.920 INFO:tasks.workunit.client.1.smithi161.stdout:2/690: dwrite d4/d16/d69/d8c/d87/f97 [0,4194304] 0 2023-12-09T02:35:19.923 INFO:tasks.workunit.client.1.smithi161.stdout:6/666: symlink da/d19/le4 0 2023-12-09T02:35:19.924 INFO:tasks.workunit.client.1.smithi161.stdout:6/667: read da/d19/dc2/d77/f9a [3339671,92783] 0 2023-12-09T02:35:19.927 INFO:tasks.workunit.client.1.smithi161.stdout:4/816: rmdir dd/d1a/d29 39 2023-12-09T02:35:19.927 INFO:tasks.workunit.client.1.smithi161.stdout:4/817: write dd/d36/d4a/d88/f105 [54161,60498] 0 2023-12-09T02:35:19.928 INFO:tasks.workunit.client.1.smithi161.stdout:3/627: truncate d2/d51/d75/d11/d19/d91/d46/d2d/d47/f56 2798189 0 2023-12-09T02:35:19.946 INFO:tasks.workunit.client.1.smithi161.stdout:2/691: mkdir d4/d1a/d4a/de3 0 2023-12-09T02:35:19.946 INFO:tasks.workunit.client.1.smithi161.stdout:2/692: dread - d4/fc1 zero size 2023-12-09T02:35:19.949 INFO:tasks.workunit.client.1.smithi161.stdout:6/668: symlink da/d55/d6d/dac/le5 0 2023-12-09T02:35:19.950 INFO:tasks.workunit.client.1.smithi161.stdout:6/669: write da/df/d2d/d49/f4a [188614,28461] 0 2023-12-09T02:35:19.950 INFO:tasks.workunit.client.1.smithi161.stdout:4/818: truncate f9 3800671 0 2023-12-09T02:35:19.953 INFO:tasks.workunit.client.1.smithi161.stdout:3/628: creat d2/d51/d75/d11/d1f/d7a/fb4 x:0 0 0 2023-12-09T02:35:19.958 INFO:tasks.workunit.client.1.smithi161.stdout:2/693: unlink d4/d1a/c5d 0 2023-12-09T02:35:19.960 INFO:tasks.workunit.client.1.smithi161.stdout:6/670: creat da/d19/dc2/d9e/fe6 x:0 0 0 2023-12-09T02:35:19.961 INFO:tasks.workunit.client.1.smithi161.stdout:9/637: sync 2023-12-09T02:35:19.964 INFO:tasks.workunit.client.1.smithi161.stdout:4/819: rename dd/d36/d3f/d54/d102/d25/d3a/l9a to dd/d36/d3f/d54/d102/d25/d3a/l10e 0 2023-12-09T02:35:19.964 INFO:tasks.workunit.client.1.smithi161.stdout:4/820: dread - dd/d36/d3f/d54/d102/f8e zero size 2023-12-09T02:35:19.966 INFO:tasks.workunit.client.1.smithi161.stdout:2/694: rename d4/d16/c8a to d4/d1a/d4a/ce4 0 2023-12-09T02:35:19.969 INFO:tasks.workunit.client.1.smithi161.stdout:6/671: creat da/d19/dc2/d77/d79/fe7 x:0 0 0 2023-12-09T02:35:19.969 INFO:tasks.workunit.client.1.smithi161.stdout:6/672: dread - da/d19/dc2/d4d/fa8 zero size 2023-12-09T02:35:19.969 INFO:tasks.workunit.client.1.smithi161.stdout:6/673: fdatasync da/d55/d6d/d85/f73 0 2023-12-09T02:35:19.969 INFO:tasks.workunit.client.1.smithi161.stdout:6/674: chown da/d19/dc2/d29/d2b/d31/d33/ca5 129405 1 2023-12-09T02:35:19.970 INFO:tasks.workunit.client.1.smithi161.stdout:9/638: mknod d2/d25/db1/d65/d42/d58/d91/cdc 0 2023-12-09T02:35:19.971 INFO:tasks.workunit.client.1.smithi161.stdout:9/639: readlink d2/d25/db1/d65/d42/d58/l4a 0 2023-12-09T02:35:19.971 INFO:tasks.workunit.client.1.smithi161.stdout:5/706: sync 2023-12-09T02:35:19.971 INFO:tasks.workunit.client.1.smithi161.stdout:1/828: sync 2023-12-09T02:35:19.971 INFO:tasks.workunit.client.1.smithi161.stdout:4/821: symlink dd/d1a/d23/de9/l10f 0 2023-12-09T02:35:19.971 INFO:tasks.workunit.client.1.smithi161.stdout:5/707: write d0/d2/de/d22/d8e/d8f/fb1 [771981,120223] 0 2023-12-09T02:35:19.972 INFO:tasks.workunit.client.1.smithi161.stdout:4/822: chown dd/d1a/d23/d6a/l73 5583 1 2023-12-09T02:35:19.972 INFO:tasks.workunit.client.1.smithi161.stdout:3/629: dwrite d2/d51/d75/d11/d19/d91/f63 [0,4194304] 0 2023-12-09T02:35:19.972 INFO:tasks.workunit.client.1.smithi161.stdout:6/675: dread da/df/f9c [0,4194304] 0 2023-12-09T02:35:19.973 INFO:tasks.workunit.client.1.smithi161.stdout:2/695: link d4/d1a/d4a/daa/l9b d4/da6/le5 0 2023-12-09T02:35:19.975 INFO:tasks.workunit.client.1.smithi161.stdout:9/640: creat d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/fdd x:0 0 0 2023-12-09T02:35:19.976 INFO:tasks.workunit.client.1.smithi161.stdout:9/641: write d2/d25/db1/d4d/d7d/fbb [1137889,101352] 0 2023-12-09T02:35:19.976 INFO:tasks.workunit.client.1.smithi161.stdout:1/829: chown d6/d8/d63/l5d 0 1 2023-12-09T02:35:19.983 INFO:tasks.workunit.client.1.smithi161.stdout:5/708: creat d0/d2/d7/d11/d50/ff8 x:0 0 0 2023-12-09T02:35:19.983 INFO:tasks.workunit.client.1.smithi161.stdout:3/630: dread d2/d51/d75/d11/d28/f8a [4194304,4194304] 0 2023-12-09T02:35:19.984 INFO:tasks.workunit.client.1.smithi161.stdout:4/823: creat dd/d36/d4a/d88/d8a/f110 x:0 0 0 2023-12-09T02:35:19.984 INFO:tasks.workunit.client.1.smithi161.stdout:4/824: read dd/d36/fbd [92201,85190] 0 2023-12-09T02:35:19.985 INFO:tasks.workunit.client.1.smithi161.stdout:4/825: write f9 [105048,93455] 0 2023-12-09T02:35:19.986 INFO:tasks.workunit.client.1.smithi161.stdout:4/826: write dd/d36/d3f/d54/d102/fda [1262276,61293] 0 2023-12-09T02:35:19.988 INFO:tasks.workunit.client.1.smithi161.stdout:6/676: rename da/da3 to da/d19/dc2/d4d/d5e/de8 0 2023-12-09T02:35:19.989 INFO:tasks.workunit.client.1.smithi161.stdout:2/696: mkdir d4/da6/de6 0 2023-12-09T02:35:19.993 INFO:tasks.workunit.client.1.smithi161.stdout:9/642: link d2/d25/db1/d65/d5c/d55/d66/la3 d2/d25/dbf/dcc/lde 0 2023-12-09T02:35:19.994 INFO:tasks.workunit.client.1.smithi161.stdout:9/643: stat d2/d25/db1/d65/d42/d58/d91/d51/cc1 0 2023-12-09T02:35:19.994 INFO:tasks.workunit.client.1.smithi161.stdout:9/644: readlink d2/d25/l7e 0 2023-12-09T02:35:19.995 INFO:tasks.workunit.client.1.smithi161.stdout:1/830: truncate d6/d8/d63/d4d/d31/d73/d47/fa6 2464380 0 2023-12-09T02:35:19.995 INFO:tasks.workunit.client.1.smithi161.stdout:1/831: chown d6/d8/d63/d4d/d9f/ddc/d3d/l6f 2 1 2023-12-09T02:35:19.995 INFO:tasks.workunit.client.1.smithi161.stdout:1/832: chown d6/d9/dd4/fea 38101 1 2023-12-09T02:35:19.998 INFO:tasks.workunit.client.1.smithi161.stdout:7/658: sync 2023-12-09T02:35:19.998 INFO:tasks.workunit.client.1.smithi161.stdout:7/659: fdatasync d0/d3/d13/d2d/d43/d4b/d5a/f6b 0 2023-12-09T02:35:19.998 INFO:tasks.workunit.client.1.smithi161.stdout:7/660: fdatasync d0/d3/d13/d2d/d43/d4b/d99/fca 0 2023-12-09T02:35:19.999 INFO:tasks.workunit.client.1.smithi161.stdout:3/631: readlink d2/d51/d75/d11/d19/d91/d46/d5e/l94 0 2023-12-09T02:35:20.001 INFO:tasks.workunit.client.1.smithi161.stdout:4/827: symlink dd/d36/d4a/d5f/d65/df9/dd2/l111 0 2023-12-09T02:35:20.002 INFO:tasks.workunit.client.1.smithi161.stdout:5/709: dwrite d0/d2/d7/fe8 [0,4194304] 0 2023-12-09T02:35:20.004 INFO:tasks.workunit.client.1.smithi161.stdout:6/677: creat da/d19/dc2/d9e/fe9 x:0 0 0 2023-12-09T02:35:20.004 INFO:tasks.workunit.client.1.smithi161.stdout:6/678: chown da/d19/dc2/d4d/d5e/ccb 0 1 2023-12-09T02:35:20.004 INFO:tasks.workunit.client.1.smithi161.stdout:8/656: sync 2023-12-09T02:35:20.005 INFO:tasks.workunit.client.1.smithi161.stdout:0/645: sync 2023-12-09T02:35:20.005 INFO:tasks.workunit.client.1.smithi161.stdout:1/833: link d6/d8/d63/c20 d6/d8/d63/d4d/d9f/ddc/c110 0 2023-12-09T02:35:20.007 INFO:tasks.workunit.client.1.smithi161.stdout:1/834: write d6/d8/d63/d4d/d31/d80/f83 [2733644,73281] 0 2023-12-09T02:35:20.008 INFO:tasks.workunit.client.1.smithi161.stdout:0/646: dread d9/d55/d7c/f38 [0,4194304] 0 2023-12-09T02:35:20.009 INFO:tasks.workunit.client.1.smithi161.stdout:7/661: getdents d0/d3/d13/d2d/d43/d4b/d99 0 2023-12-09T02:35:20.019 INFO:tasks.workunit.client.1.smithi161.stdout:4/828: rename dd/d36/d4a/d88/cbe to dd/d36/d4a/d5f/d65/df9/ddb/c112 0 2023-12-09T02:35:20.020 INFO:tasks.workunit.client.1.smithi161.stdout:4/829: chown dd/d36/d3f/d54/dff 15558 1 2023-12-09T02:35:20.020 INFO:tasks.workunit.client.1.smithi161.stdout:4/830: stat dd/d36/d3f/d54/d102 0 2023-12-09T02:35:20.026 INFO:tasks.workunit.client.1.smithi161.stdout:6/679: mkdir da/d55/dea 0 2023-12-09T02:35:20.029 INFO:tasks.workunit.client.1.smithi161.stdout:2/697: link d4/da6/db9/c9e d4/d7/d8f/ce7 0 2023-12-09T02:35:20.029 INFO:tasks.workunit.client.1.smithi161.stdout:2/698: write d4/d7/d8f/dd2/fde [465085,69114] 0 2023-12-09T02:35:20.029 INFO:tasks.workunit.client.1.smithi161.stdout:2/699: dread - d4/fc1 zero size 2023-12-09T02:35:20.032 INFO:tasks.workunit.client.1.smithi161.stdout:1/835: dwrite d6/d8/d63/d4d/f88 [0,4194304] 0 2023-12-09T02:35:20.032 INFO:tasks.workunit.client.1.smithi161.stdout:1/836: chown d6/d8/d63/d4d/dd0/c10a 5629 1 2023-12-09T02:35:20.032 INFO:tasks.workunit.client.1.smithi161.stdout:8/657: rename d2/d2d/f95 to d2/d5/d4f/fd5 0 2023-12-09T02:35:20.034 INFO:tasks.workunit.client.1.smithi161.stdout:4/831: creat dd/d36/d3f/d54/d102/d25/dfc/f113 x:0 0 0 2023-12-09T02:35:20.036 INFO:tasks.workunit.client.1.smithi161.stdout:6/680: unlink da/d19/dc2/d4d/d5e/l63 0 2023-12-09T02:35:20.036 INFO:tasks.workunit.client.1.smithi161.stdout:3/632: dwrite d2/d51/d75/d11/d19/d91/d46/d40/f6d [0,4194304] 0 2023-12-09T02:35:20.036 INFO:tasks.workunit.client.1.smithi161.stdout:3/633: truncate d2/d37/fa6 863847 0 2023-12-09T02:35:20.036 INFO:tasks.workunit.client.1.smithi161.stdout:5/710: dwrite d0/d2/de/d22/f59 [0,4194304] 0 2023-12-09T02:35:20.038 INFO:tasks.workunit.client.1.smithi161.stdout:2/700: mknod d4/d7/db/ce8 0 2023-12-09T02:35:20.038 INFO:tasks.workunit.client.1.smithi161.stdout:2/701: write d4/d1a/dc2/fdb [798434,96278] 0 2023-12-09T02:35:20.038 INFO:tasks.workunit.client.1.smithi161.stdout:2/702: truncate d4/d16/d69/d7b/fc0 526589 0 2023-12-09T02:35:20.038 INFO:tasks.workunit.client.1.smithi161.stdout:2/703: write d4/d16/f1e [4532494,48266] 0 2023-12-09T02:35:20.041 INFO:tasks.workunit.client.1.smithi161.stdout:1/837: symlink d6/d9/d8b/dba/dd2/l111 0 2023-12-09T02:35:20.046 INFO:tasks.workunit.client.1.smithi161.stdout:8/658: mkdir d2/d5/d22/d86/dd6 0 2023-12-09T02:35:20.046 INFO:tasks.workunit.client.1.smithi161.stdout:8/659: read d2/d5/d22/d54/db4/f78 [273921,41263] 0 2023-12-09T02:35:20.049 INFO:tasks.workunit.client.1.smithi161.stdout:4/832: mknod dd/d36/d4a/d5f/d65/df9/dd2/c114 0 2023-12-09T02:35:20.050 INFO:tasks.workunit.client.1.smithi161.stdout:6/681: rmdir da/d19/dc2/d3c 39 2023-12-09T02:35:20.050 INFO:tasks.workunit.client.1.smithi161.stdout:6/682: chown da/d55/d6d/dac/lad 177148 1 2023-12-09T02:35:20.050 INFO:tasks.workunit.client.1.smithi161.stdout:6/683: chown da/d19/dc2/d29/d2b/d31/f66 42 1 2023-12-09T02:35:20.052 INFO:tasks.workunit.client.1.smithi161.stdout:1/838: dread d6/d8/d63/d4d/d9f/ddc/d3d/f96 [0,4194304] 0 2023-12-09T02:35:20.052 INFO:tasks.workunit.client.1.smithi161.stdout:1/839: readlink d6/d9/d8b/ld1 0 2023-12-09T02:35:20.052 INFO:tasks.workunit.client.1.smithi161.stdout:1/840: chown d6/d8/d63/d4d/d31/d73/d47/d102/de3/ffe 8081169 1 2023-12-09T02:35:20.053 INFO:tasks.workunit.client.1.smithi161.stdout:3/634: symlink d2/d51/d75/d11/d1f/d7a/d96/lb5 0 2023-12-09T02:35:20.053 INFO:tasks.workunit.client.1.smithi161.stdout:5/711: creat d0/d2/d5f/ff9 x:0 0 0 2023-12-09T02:35:20.054 INFO:tasks.workunit.client.1.smithi161.stdout:3/635: write d2/d51/d75/d11/d19/d91/d46/d40/f6d [4374476,22498] 0 2023-12-09T02:35:20.057 INFO:tasks.workunit.client.1.smithi161.stdout:2/704: mknod d4/da6/de6/ce9 0 2023-12-09T02:35:20.058 INFO:tasks.workunit.client.1.smithi161.stdout:0/647: rename d9/d55/d44/dae to d9/dd/dca 0 2023-12-09T02:35:20.059 INFO:tasks.workunit.client.1.smithi161.stdout:4/833: mknod dd/d1a/d23/d6a/c115 0 2023-12-09T02:35:20.064 INFO:tasks.workunit.client.1.smithi161.stdout:4/834: dread dd/d36/d3f/d54/d102/d25/d4e/fb2 [0,4194304] 0 2023-12-09T02:35:20.064 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:19 smithi088 ceph-mon[112028]: pgmap v6: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 5.8 MiB/s rd, 20 MiB/s wr, 109 op/s 2023-12-09T02:35:20.064 INFO:tasks.workunit.client.1.smithi161.stdout:8/660: dwrite d2/d5/dc0/fcf [0,4194304] 0 2023-12-09T02:35:20.065 INFO:tasks.workunit.client.1.smithi161.stdout:2/705: stat d4/d16/d69/d8c/d87/c91 0 2023-12-09T02:35:20.068 INFO:tasks.workunit.client.1.smithi161.stdout:1/841: dread d6/d8/d63/d4d/fee [0,4194304] 0 2023-12-09T02:35:20.068 INFO:tasks.workunit.client.1.smithi161.stdout:1/842: dread - d6/d8/d63/d4d/d31/d80/f108 zero size 2023-12-09T02:35:20.070 INFO:tasks.workunit.client.1.smithi161.stdout:2/706: write d4/fa [131679,107527] 0 2023-12-09T02:35:20.071 INFO:tasks.workunit.client.1.smithi161.stdout:6/684: rename da/d19/f1b to da/d19/dc2/dd2/feb 0 2023-12-09T02:35:20.071 INFO:tasks.workunit.client.1.smithi161.stdout:6/685: write da/d19/dc2/d3c/fc5 [475090,11305] 0 2023-12-09T02:35:20.071 INFO:tasks.workunit.client.1.smithi161.stdout:6/686: dread - da/d19/dc2/d9e/fe9 zero size 2023-12-09T02:35:20.071 INFO:tasks.workunit.client.1.smithi161.stdout:6/687: truncate da/d19/dc2/d9e/fe9 675637 0 2023-12-09T02:35:20.071 INFO:tasks.workunit.client.1.smithi161.stdout:6/688: truncate da/d55/d6d/dac/fb1 779625 0 2023-12-09T02:35:20.073 INFO:tasks.workunit.client.1.smithi161.stdout:3/636: dwrite d2/fac [0,4194304] 0 2023-12-09T02:35:20.074 INFO:tasks.workunit.client.1.smithi161.stdout:0/648: unlink d9/dd/d3a/f52 0 2023-12-09T02:35:20.075 INFO:tasks.workunit.client.1.smithi161.stdout:0/649: readlink d9/dd/l6d 0 2023-12-09T02:35:20.086 INFO:tasks.workunit.client.1.smithi161.stdout:8/661: mkdir d2/d5/d22/d86/dd6/dd7 0 2023-12-09T02:35:20.092 INFO:tasks.workunit.client.1.smithi161.stdout:1/843: truncate d6/d8/f30 1215819 0 2023-12-09T02:35:20.094 INFO:tasks.workunit.client.1.smithi161.stdout:2/707: unlink d4/d7/d8f/ce7 0 2023-12-09T02:35:20.097 INFO:tasks.workunit.client.1.smithi161.stdout:5/712: rename d0/d2/de/d22/d8e/d8f/de7 to d0/d2/de/d22/d8e/d8f/dcd/d83/dfa 0 2023-12-09T02:35:20.098 INFO:tasks.workunit.client.1.smithi161.stdout:5/713: fdatasync d0/d9/f78 0 2023-12-09T02:35:20.098 INFO:tasks.workunit.client.1.smithi161.stdout:5/714: stat d0/d2/d7/d11/f41 0 2023-12-09T02:35:20.104 INFO:tasks.workunit.client.1.smithi161.stdout:3/637: unlink d2/d51/d75/d11/d19/d91/f63 0 2023-12-09T02:35:20.105 INFO:tasks.workunit.client.1.smithi161.stdout:0/650: creat d9/d55/d44/fcb x:0 0 0 2023-12-09T02:35:20.106 INFO:tasks.workunit.client.1.smithi161.stdout:0/651: write d9/d55/d7c/f2b [2923533,14890] 0 2023-12-09T02:35:20.106 INFO:tasks.workunit.client.1.smithi161.stdout:0/652: chown d9/db/d2a/d9d/fb0 2825330 1 2023-12-09T02:35:20.117 INFO:tasks.workunit.client.1.smithi161.stdout:2/708: rmdir d4/d1a/d4a/d6d 39 2023-12-09T02:35:20.121 INFO:tasks.workunit.client.1.smithi161.stdout:4/835: rename dd/l86 to dd/d36/d4a/d5f/d65/df9/ddb/l116 0 2023-12-09T02:35:20.122 INFO:tasks.workunit.client.1.smithi161.stdout:5/715: mkdir d0/d2/d7/d11/d50/dfb 0 2023-12-09T02:35:20.127 INFO:tasks.workunit.client.1.smithi161.stdout:3/638: creat d2/d51/d75/d11/d19/d91/d46/d40/fb6 x:0 0 0 2023-12-09T02:35:20.129 INFO:tasks.workunit.client.1.smithi161.stdout:0/653: truncate d9/d55/d26/fa7 938179 0 2023-12-09T02:35:20.133 INFO:tasks.workunit.client.1.smithi161.stdout:2/709: unlink d4/d7/db/c3b 0 2023-12-09T02:35:20.136 INFO:tasks.workunit.client.1.smithi161.stdout:2/710: dread d4/d16/d69/d8c/d87/fa4 [0,4194304] 0 2023-12-09T02:35:20.136 INFO:tasks.workunit.client.1.smithi161.stdout:2/711: chown d4/d16/d69/cd7 1013 1 2023-12-09T02:35:20.136 INFO:tasks.workunit.client.1.smithi161.stdout:2/712: chown d4/d16/de0 303 1 2023-12-09T02:35:20.137 INFO:tasks.workunit.client.1.smithi161.stdout:2/713: dread d4/d16/d69/d7b/fab [0,4194304] 0 2023-12-09T02:35:20.137 INFO:tasks.workunit.client.1.smithi161.stdout:4/836: mknod dd/d36/d3f/d54/d102/d25/d32/c117 0 2023-12-09T02:35:20.137 INFO:tasks.workunit.client.1.smithi161.stdout:4/837: stat dd/d36/d3f/d54/c56 0 2023-12-09T02:35:20.137 INFO:tasks.workunit.client.1.smithi161.stdout:4/838: write dd/d36/d3f/d54/ff4 [491478,80695] 0 2023-12-09T02:35:20.138 INFO:tasks.workunit.client.1.smithi161.stdout:4/839: dread - dd/d36/d3f/d54/d102/d25/d32/dd0/fdf zero size 2023-12-09T02:35:20.138 INFO:tasks.workunit.client.1.smithi161.stdout:4/840: readlink dd/d1a/d23/lbc 0 2023-12-09T02:35:20.138 INFO:tasks.workunit.client.1.smithi161.stdout:5/716: creat d0/d2/d7/d11/d50/dfb/ffc x:0 0 0 2023-12-09T02:35:20.138 INFO:tasks.workunit.client.1.smithi161.stdout:5/717: fsync d0/d9/f6a 0 2023-12-09T02:35:20.138 INFO:tasks.workunit.client.1.smithi161.stdout:8/662: write d2/d5/d3d/f46 [1433141,3434] 0 2023-12-09T02:35:20.142 INFO:tasks.workunit.client.1.smithi161.stdout:3/639: mkdir d2/d51/d75/d50/d69/db7 0 2023-12-09T02:35:20.146 INFO:tasks.workunit.client.1.smithi161.stdout:2/714: mkdir d4/da6/dc8/dea 0 2023-12-09T02:35:20.149 INFO:tasks.workunit.client.1.smithi161.stdout:4/841: creat dd/d36/d3f/d54/d102/d25/f118 x:0 0 0 2023-12-09T02:35:20.150 INFO:tasks.workunit.client.1.smithi161.stdout:5/718: mknod d0/d2/d7/d11/d50/d8a/cfd 0 2023-12-09T02:35:20.154 INFO:tasks.workunit.client.1.smithi161.stdout:3/640: creat d2/d37/d99/fb8 x:0 0 0 2023-12-09T02:35:20.155 INFO:tasks.workunit.client.1.smithi161.stdout:0/654: creat d9/db/d2a/d9d/dba/d94/fcc x:0 0 0 2023-12-09T02:35:20.159 INFO:tasks.workunit.client.1.smithi161.stdout:2/715: mknod d4/d1a/ceb 0 2023-12-09T02:35:20.159 INFO:tasks.workunit.client.1.smithi161.stdout:2/716: fdatasync d4/d1a/dc2/fdb 0 2023-12-09T02:35:20.159 INFO:tasks.workunit.client.1.smithi161.stdout:5/719: dread d0/f27 [0,4194304] 0 2023-12-09T02:35:20.160 INFO:tasks.workunit.client.1.smithi161.stdout:4/842: rmdir dd/d36/d3f/d54/d102/d25/d3a/df0 0 2023-12-09T02:35:20.161 INFO:tasks.workunit.client.1.smithi161.stdout:5/720: dread d0/d2/d7/d11/d50/d8a/ded/fea [0,4194304] 0 2023-12-09T02:35:20.163 INFO:tasks.workunit.client.1.smithi161.stdout:3/641: mknod d2/d51/d75/d50/d69/cb9 0 2023-12-09T02:35:20.163 INFO:tasks.workunit.client.1.smithi161.stdout:3/642: truncate d2/d51/d75/d11/d1f/d7a/fb4 762987 0 2023-12-09T02:35:20.165 INFO:tasks.workunit.client.1.smithi161.stdout:0/655: symlink d9/db/d2a/d35/d7b/lcd 0 2023-12-09T02:35:20.169 INFO:tasks.workunit.client.1.smithi161.stdout:4/843: creat dd/d36/d4a/d88/dcd/f119 x:0 0 0 2023-12-09T02:35:20.169 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:19 smithi161 ceph-mon[121170]: pgmap v6: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 5.8 MiB/s rd, 20 MiB/s wr, 109 op/s 2023-12-09T02:35:20.171 INFO:tasks.workunit.client.1.smithi161.stdout:5/721: mkdir d0/d2/de/d22/d8e/dfe 0 2023-12-09T02:35:20.172 INFO:tasks.workunit.client.1.smithi161.stdout:3/643: mknod d2/d51/d75/d11/d19/d91/d46/d9c/cba 0 2023-12-09T02:35:20.174 INFO:tasks.workunit.client.1.smithi161.stdout:0/656: creat d9/d55/d44/d85/fce x:0 0 0 2023-12-09T02:35:20.178 INFO:tasks.workunit.client.1.smithi161.stdout:4/844: link dd/d36/d4a/f6f dd/d1a/d23/d6a/d107/f11a 0 2023-12-09T02:35:20.178 INFO:tasks.workunit.client.1.smithi161.stdout:4/845: fdatasync dd/d36/d3f/d54/d102/d25/d4e/dbb/fe5 0 2023-12-09T02:35:20.187 INFO:tasks.workunit.client.1.smithi161.stdout:3/644: unlink d2/d51/d75/c6a 0 2023-12-09T02:35:20.199 INFO:tasks.workunit.client.1.smithi161.stdout:4/846: dwrite dd/d36/d4a/d88/d8a/db3/fd7 [0,4194304] 0 2023-12-09T02:35:20.200 INFO:tasks.workunit.client.1.smithi161.stdout:4/847: fdatasync dd/d1a/d1e/f4f 0 2023-12-09T02:35:20.200 INFO:tasks.workunit.client.1.smithi161.stdout:4/848: chown dd/d36/d4a/d5f/c82 9465531 1 2023-12-09T02:35:20.200 INFO:tasks.workunit.client.1.smithi161.stdout:4/849: chown dd/d1a/d29/c42 24 1 2023-12-09T02:35:20.200 INFO:tasks.workunit.client.1.smithi161.stdout:0/657: mknod d9/d55/db7/ccf 0 2023-12-09T02:35:20.200 INFO:tasks.workunit.client.1.smithi161.stdout:4/850: dread dd/d36/d3f/d54/d102/d25/d32/dd0/ff6 [0,4194304] 0 2023-12-09T02:35:20.202 INFO:tasks.workunit.client.1.smithi161.stdout:0/658: write d9/d55/d7c/f33 [6389380,48166] 0 2023-12-09T02:35:20.202 INFO:tasks.workunit.client.1.smithi161.stdout:0/659: fsync d9/db/d2a/fa2 0 2023-12-09T02:35:20.202 INFO:tasks.workunit.client.1.smithi161.stdout:0/660: chown d9/db/d2a/d35/d7b 5967 1 2023-12-09T02:35:20.202 INFO:tasks.workunit.client.1.smithi161.stdout:4/851: dread dd/d1a/d23/de9/f108 [0,4194304] 0 2023-12-09T02:35:20.202 INFO:tasks.workunit.client.1.smithi161.stdout:0/661: read d9/d55/d26/f57 [1286319,113982] 0 2023-12-09T02:35:20.204 INFO:tasks.workunit.client.1.smithi161.stdout:2/717: rename d4/d16/d69/c94 to d4/d1a/cec 0 2023-12-09T02:35:20.316 INFO:tasks.workunit.client.1.smithi161.stdout:3/645: mknod d2/cbb 0 2023-12-09T02:35:20.316 INFO:tasks.workunit.client.1.smithi161.stdout:3/646: chown d2/d51/d75/d11/d1f/f8f 37595080 1 2023-12-09T02:35:20.385 INFO:tasks.workunit.client.1.smithi161.stdout:4/852: creat dd/d36/d4a/d5f/dc7/d101/f11b x:0 0 0 2023-12-09T02:35:20.387 INFO:tasks.workunit.client.1.smithi161.stdout:0/662: creat d9/db/d2a/d9d/fd0 x:0 0 0 2023-12-09T02:35:20.389 INFO:tasks.workunit.client.1.smithi161.stdout:2/718: creat d4/d1a/d4a/daa/fed x:0 0 0 2023-12-09T02:35:20.394 INFO:tasks.workunit.client.1.smithi161.stdout:4/853: rmdir dd/d36/d3f/d54/d102/d25/d32/d75/deb 39 2023-12-09T02:35:20.399 INFO:tasks.workunit.client.1.smithi161.stdout:5/722: rename d0/d2/de/d22/d8e/d8f/dcd/da8/db7 to d0/d2/de/d44/dff 0 2023-12-09T02:35:20.399 INFO:tasks.workunit.client.1.smithi161.stdout:5/723: chown d0/d2/de/d22/l87 30164697 1 2023-12-09T02:35:20.400 INFO:tasks.workunit.client.1.smithi161.stdout:5/724: chown d0/d2/d7/lb2 64584 1 2023-12-09T02:35:20.403 INFO:tasks.workunit.client.1.smithi161.stdout:2/719: creat d4/d16/fee x:0 0 0 2023-12-09T02:35:20.404 INFO:tasks.workunit.client.1.smithi161.stdout:4/854: creat dd/d1a/d1e/f11c x:0 0 0 2023-12-09T02:35:20.407 INFO:tasks.workunit.client.1.smithi161.stdout:5/725: mkdir d0/d2/d7/d11/d61/def/d100 0 2023-12-09T02:35:20.407 INFO:tasks.workunit.client.1.smithi161.stdout:5/726: write d0/d2/d7/d11/dc3/fc6 [352561,56309] 0 2023-12-09T02:35:20.407 INFO:tasks.workunit.client.1.smithi161.stdout:5/727: fsync d0/d2/d7/d9a/fd7 0 2023-12-09T02:35:20.407 INFO:tasks.workunit.client.1.smithi161.stdout:5/728: write d0/d2/de/d44/dff/de5/ff2 [724920,4100] 0 2023-12-09T02:35:20.408 INFO:tasks.workunit.client.1.smithi161.stdout:4/855: write dd/d36/d3f/d54/d102/d25/d32/f41 [961554,28225] 0 2023-12-09T02:35:20.411 INFO:tasks.workunit.client.1.smithi161.stdout:9/645: sync 2023-12-09T02:35:20.412 INFO:tasks.workunit.client.1.smithi161.stdout:4/856: creat dd/d36/d4a/de8/f11d x:0 0 0 2023-12-09T02:35:20.413 INFO:tasks.workunit.client.1.smithi161.stdout:2/720: truncate d4/d7/f15 4201685 0 2023-12-09T02:35:20.415 INFO:tasks.workunit.client.1.smithi161.stdout:3/647: dwrite d2/d51/d75/d11/d19/d91/d46/d5e/f79 [0,4194304] 0 2023-12-09T02:35:20.415 INFO:tasks.workunit.client.1.smithi161.stdout:3/648: chown d2/d51/d75/d11/d19/d91/d46/d2d/d47/f60 12 1 2023-12-09T02:35:20.415 INFO:tasks.workunit.client.1.smithi161.stdout:5/729: dread d0/d2/d7/d11/f5d [0,4194304] 0 2023-12-09T02:35:20.416 INFO:tasks.workunit.client.1.smithi161.stdout:9/646: rename d2/d25/db1/d4d/d7d to d2/d25/db1/d65/d88/dcb/ddf 0 2023-12-09T02:35:20.416 INFO:tasks.workunit.client.1.smithi161.stdout:5/730: rename d0/d2/d7/d11 to d0/d2/d7/d11/dc3/d101 22 2023-12-09T02:35:20.421 INFO:tasks.workunit.client.1.smithi161.stdout:4/857: link dd/d36/d3f/d54/d102/d25/d32/dd0/f106 dd/d36/d4a/d5f/d65/f11e 0 2023-12-09T02:35:20.421 INFO:tasks.workunit.client.1.smithi161.stdout:4/858: dread - dd/d36/d4a/d5f/dc7/d101/f11b zero size 2023-12-09T02:35:20.425 INFO:tasks.workunit.client.1.smithi161.stdout:2/721: creat d4/d1a/fef x:0 0 0 2023-12-09T02:35:20.427 INFO:tasks.workunit.client.1.smithi161.stdout:3/649: dread - d2/d51/d75/d11/d19/d91/d46/d5e/fa5 zero size 2023-12-09T02:35:20.429 INFO:tasks.workunit.client.1.smithi161.stdout:9/647: creat d2/d25/db1/d65/d42/d58/d91/d2e/fe0 x:0 0 0 2023-12-09T02:35:20.431 INFO:tasks.workunit.client.1.smithi161.stdout:5/731: creat d0/d2/de/d44/dff/f102 x:0 0 0 2023-12-09T02:35:20.434 INFO:tasks.workunit.client.1.smithi161.stdout:5/732: write d0/d2/d7/d11/d50/d8a/ded/f3b [1948223,72071] 0 2023-12-09T02:35:20.437 INFO:tasks.workunit.client.1.smithi161.stdout:9/648: mkdir d2/d25/db1/d65/d5c/d55/d66/d83/d90/d95/de1 0 2023-12-09T02:35:20.438 INFO:tasks.workunit.client.1.smithi161.stdout:9/649: dread d2/d25/db1/f8e [0,4194304] 0 2023-12-09T02:35:20.438 INFO:tasks.workunit.client.1.smithi161.stdout:9/650: write d2/d25/db1/d65/d63/f9e [1533336,13505] 0 2023-12-09T02:35:20.440 INFO:tasks.workunit.client.1.smithi161.stdout:4/859: dwrite dd/d1a/d23/f9f [0,4194304] 0 2023-12-09T02:35:20.441 INFO:tasks.workunit.client.1.smithi161.stdout:5/733: mknod d0/d2/d7/d11/d61/def/c103 0 2023-12-09T02:35:20.446 INFO:tasks.workunit.client.1.smithi161.stdout:4/860: mkdir dd/d36/d3f/d54/d102/d25/d11f 0 2023-12-09T02:35:20.446 INFO:tasks.workunit.client.1.smithi161.stdout:4/861: dread - dd/d36/d3f/d54/d102/f85 zero size 2023-12-09T02:35:20.446 INFO:tasks.workunit.client.1.smithi161.stdout:4/862: readlink dd/d36/d4a/d5f/d65/df9/ddb/l116 0 2023-12-09T02:35:20.450 INFO:tasks.workunit.client.1.smithi161.stdout:9/651: dread d2/d25/db1/d65/d42/f4b [0,4194304] 0 2023-12-09T02:35:20.451 INFO:tasks.workunit.client.1.smithi161.stdout:9/652: creat d2/d25/db1/d65/d88/fe2 x:0 0 0 2023-12-09T02:35:20.454 INFO:tasks.workunit.client.1.smithi161.stdout:3/650: dwrite d2/d51/d75/d11/d19/d91/d46/d2d/d47/f60 [0,4194304] 0 2023-12-09T02:35:20.464 INFO:tasks.workunit.client.1.smithi161.stdout:3/651: dread d2/d51/d75/d11/d19/d91/d46/d2d/d47/f56 [0,4194304] 0 2023-12-09T02:35:20.465 INFO:tasks.workunit.client.1.smithi161.stdout:3/652: mknod d2/d51/d75/d11/d19/d91/cbc 0 2023-12-09T02:35:20.467 INFO:tasks.workunit.client.1.smithi161.stdout:3/653: getdents d2/d37/d99 0 2023-12-09T02:35:20.467 INFO:tasks.workunit.client.1.smithi161.stdout:3/654: fdatasync d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/fa9 0 2023-12-09T02:35:20.468 INFO:tasks.workunit.client.1.smithi161.stdout:3/655: creat d2/d51/d75/d11/d19/fbd x:0 0 0 2023-12-09T02:35:20.469 INFO:tasks.workunit.client.1.smithi161.stdout:3/656: stat d2/d51/d75/d11/f5d 0 2023-12-09T02:35:20.470 INFO:tasks.workunit.client.1.smithi161.stdout:3/657: rename d2/d51/d75/d11/d1f/l6c to d2/d51/lbe 0 2023-12-09T02:35:20.471 INFO:tasks.workunit.client.1.smithi161.stdout:3/658: chown d2/d51/d75/d11/d1f/d7a/d96/lb5 600012153 1 2023-12-09T02:35:20.472 INFO:tasks.workunit.client.1.smithi161.stdout:3/659: creat d2/d51/d75/d11/d1f/d4c/fbf x:0 0 0 2023-12-09T02:35:20.472 INFO:tasks.workunit.client.1.smithi161.stdout:3/660: dread - d2/fa1 zero size 2023-12-09T02:35:20.472 INFO:tasks.workunit.client.1.smithi161.stdout:3/661: truncate d2/d51/d75/d11/d1f/d7a/fb4 792901 0 2023-12-09T02:35:20.472 INFO:tasks.workunit.client.1.smithi161.stdout:3/662: mkdir d2/d51/dc0 0 2023-12-09T02:35:20.473 INFO:tasks.workunit.client.1.smithi161.stdout:3/663: chown d2/d51/d75/d11/f64 334 1 2023-12-09T02:35:20.478 INFO:tasks.workunit.client.1.smithi161.stdout:5/734: dwrite d0/d2/de/d22/d8e/d8f/dcd/fc7 [0,4194304] 0 2023-12-09T02:35:20.479 INFO:tasks.workunit.client.1.smithi161.stdout:9/653: dwrite d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/fdd [0,4194304] 0 2023-12-09T02:35:20.479 INFO:tasks.workunit.client.1.smithi161.stdout:9/654: chown d2/d25/db1/d4d/f67 2735441 1 2023-12-09T02:35:20.479 INFO:tasks.workunit.client.1.smithi161.stdout:2/722: dwrite d4/d16/d69/d8c/d87/f9f [0,4194304] 0 2023-12-09T02:35:20.480 INFO:tasks.workunit.client.1.smithi161.stdout:4/863: dwrite dd/d1a/d23/d6a/fa3 [0,4194304] 0 2023-12-09T02:35:20.486 INFO:tasks.workunit.client.1.smithi161.stdout:9/655: creat d2/d25/db1/d65/d5c/d55/d66/d83/dd1/fe3 x:0 0 0 2023-12-09T02:35:20.491 INFO:tasks.workunit.client.1.smithi161.stdout:4/864: creat dd/d36/d3f/d54/d102/d25/d32/d75/deb/f120 x:0 0 0 2023-12-09T02:35:20.494 INFO:tasks.workunit.client.1.smithi161.stdout:4/865: rename dd/d36/d4a/d5f/d65/lfd to dd/d36/d4a/de8/l121 0 2023-12-09T02:35:20.496 INFO:tasks.workunit.client.1.smithi161.stdout:4/866: getdents dd/d1a/d23/de9 0 2023-12-09T02:35:20.496 INFO:tasks.workunit.client.1.smithi161.stdout:4/867: chown dd/la8 848 1 2023-12-09T02:35:20.496 INFO:tasks.workunit.client.1.smithi161.stdout:4/868: write dd/d36/d4a/fcc [348674,40973] 0 2023-12-09T02:35:20.497 INFO:tasks.workunit.client.1.smithi161.stdout:4/869: creat dd/d1a/d10c/f122 x:0 0 0 2023-12-09T02:35:20.497 INFO:tasks.workunit.client.1.smithi161.stdout:4/870: chown dd/d1a/d23 1 1 2023-12-09T02:35:20.500 INFO:tasks.workunit.client.1.smithi161.stdout:4/871: rename dd/d36/d4a/d88/d8a/fc4 to dd/d36/d3f/d54/d102/d25/d32/dd0/f123 0 2023-12-09T02:35:20.502 INFO:tasks.workunit.client.1.smithi161.stdout:5/735: dwrite d0/d2/d7/d11/dc3/fc6 [0,4194304] 0 2023-12-09T02:35:20.503 INFO:tasks.workunit.client.1.smithi161.stdout:4/872: creat dd/d36/d3f/d54/d102/d25/d32/dd0/ddc/f124 x:0 0 0 2023-12-09T02:35:20.503 INFO:tasks.workunit.client.1.smithi161.stdout:4/873: fsync f9 0 2023-12-09T02:35:20.503 INFO:tasks.workunit.client.1.smithi161.stdout:9/656: dread d2/f47 [0,4194304] 0 2023-12-09T02:35:20.504 INFO:tasks.workunit.client.1.smithi161.stdout:4/874: write dd/d1a/d29/f37 [1663467,49377] 0 2023-12-09T02:35:20.509 INFO:tasks.workunit.client.1.smithi161.stdout:5/736: rename d0/d2/de/d22/d8e/d8f/dcd/f6f to d0/d2/de/d21/dce/f104 0 2023-12-09T02:35:20.509 INFO:tasks.workunit.client.1.smithi161.stdout:5/737: dread - d0/d2/de/d22/ff0 zero size 2023-12-09T02:35:20.510 INFO:tasks.workunit.client.1.smithi161.stdout:9/657: truncate d2/d25/db1/d65/d42/d58/d91/d2e/f40 3458451 0 2023-12-09T02:35:20.510 INFO:tasks.workunit.client.1.smithi161.stdout:9/658: chown d2/d25/db1/d65/d42/d58/d91/d2e/l38 469017 1 2023-12-09T02:35:20.514 INFO:tasks.workunit.client.1.smithi161.stdout:5/738: mknod d0/d2/d7/d11/dc3/db6/c105 0 2023-12-09T02:35:20.516 INFO:tasks.workunit.client.1.smithi161.stdout:9/659: symlink d2/d25/db1/d65/d5c/d60/le4 0 2023-12-09T02:35:20.516 INFO:tasks.workunit.client.1.smithi161.stdout:9/660: truncate d2/d25/db1/d65/d42/f4c 1552788 0 2023-12-09T02:35:20.517 INFO:tasks.workunit.client.1.smithi161.stdout:2/723: dwrite d4/d7/db/f62 [4194304,4194304] 0 2023-12-09T02:35:20.517 INFO:tasks.workunit.client.1.smithi161.stdout:2/724: truncate d4/d1a/dc2/fc3 566693 0 2023-12-09T02:35:20.518 INFO:tasks.workunit.client.1.smithi161.stdout:5/739: creat d0/d2/de/d22/d55/f106 x:0 0 0 2023-12-09T02:35:20.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/662: sync 2023-12-09T02:35:20.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/663: stat d0/d3/d13 0 2023-12-09T02:35:20.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/664: fdatasync d0/d3/d13/d2d/d43/dcb/d59/f6d 0 2023-12-09T02:35:20.519 INFO:tasks.workunit.client.1.smithi161.stdout:9/661: mkdir d2/d25/db1/d65/d88/dcb/ddf/de5 0 2023-12-09T02:35:20.519 INFO:tasks.workunit.client.1.smithi161.stdout:9/662: chown d2/l41 162071849 1 2023-12-09T02:35:20.519 INFO:tasks.workunit.client.1.smithi161.stdout:9/663: chown d2/d25/db1/d65/d63/f9e 3636 1 2023-12-09T02:35:20.519 INFO:tasks.workunit.client.1.smithi161.stdout:9/664: write d2/d25/db1/d65/d88/fe2 [165962,94990] 0 2023-12-09T02:35:20.524 INFO:tasks.workunit.client.1.smithi161.stdout:5/740: mkdir d0/d2/d7/d11/d61/d107 0 2023-12-09T02:35:20.525 INFO:tasks.workunit.client.1.smithi161.stdout:7/665: symlink d0/d3/daa/ld8 0 2023-12-09T02:35:20.526 INFO:tasks.workunit.client.1.smithi161.stdout:4/875: dwrite dd/d36/d3f/d54/d102/d25/d4e/fb7 [0,4194304] 0 2023-12-09T02:35:20.527 INFO:tasks.workunit.client.1.smithi161.stdout:9/665: creat d2/d25/db1/d65/fe6 x:0 0 0 2023-12-09T02:35:20.531 INFO:tasks.workunit.client.1.smithi161.stdout:5/741: rmdir d0/d2/de/d21 39 2023-12-09T02:35:20.533 INFO:tasks.workunit.client.1.smithi161.stdout:7/666: mkdir d0/d3/d13/dc7/dc8/dd9 0 2023-12-09T02:35:20.535 INFO:tasks.workunit.client.1.smithi161.stdout:5/742: rmdir d0/d2/de 39 2023-12-09T02:35:20.539 INFO:tasks.workunit.client.1.smithi161.stdout:2/725: dwrite d4/d16/f49 [0,4194304] 0 2023-12-09T02:35:20.541 INFO:tasks.workunit.client.1.smithi161.stdout:4/876: dread dd/f18 [4194304,4194304] 0 2023-12-09T02:35:20.555 INFO:tasks.workunit.client.1.smithi161.stdout:9/666: dwrite d2/d25/dbf/fca [0,4194304] 0 2023-12-09T02:35:20.555 INFO:tasks.workunit.client.1.smithi161.stdout:4/877: dwrite dd/d1a/d23/d6a/fa3 [4194304,4194304] 0 2023-12-09T02:35:20.555 INFO:tasks.workunit.client.1.smithi161.stdout:4/878: dread - dd/d1a/d10c/f122 zero size 2023-12-09T02:35:20.556 INFO:tasks.workunit.client.1.smithi161.stdout:4/879: write dd/d36/d4a/d88/d8a/fe1 [514769,6080] 0 2023-12-09T02:35:20.563 INFO:tasks.workunit.client.1.smithi161.stdout:4/880: dread dd/d36/d3f/fc1 [0,4194304] 0 2023-12-09T02:35:20.602 INFO:tasks.workunit.client.1.smithi161.stdout:5/743: getdents d0/d2/d7/d11/d61 0 2023-12-09T02:35:20.602 INFO:tasks.workunit.client.1.smithi161.stdout:5/744: chown d0/d2/d7/d11/d50/dfb/ffc 11609600 1 2023-12-09T02:35:20.604 INFO:tasks.workunit.client.1.smithi161.stdout:9/667: symlink d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/le7 0 2023-12-09T02:35:20.605 INFO:tasks.workunit.client.1.smithi161.stdout:9/668: chown d2/d25/db1/d65/d7c/lb4 326 1 2023-12-09T02:35:20.605 INFO:tasks.workunit.client.1.smithi161.stdout:9/669: readlink d2/d25/db1/l50 0 2023-12-09T02:35:20.607 INFO:tasks.workunit.client.1.smithi161.stdout:4/881: getdents dd/d1a/d23/d6a/d107 0 2023-12-09T02:35:20.610 INFO:tasks.workunit.client.1.smithi161.stdout:5/745: dread d0/d2/d7/d51/f71 [0,4194304] 0 2023-12-09T02:35:20.616 INFO:tasks.workunit.client.1.smithi161.stdout:5/746: dread d0/d2/de/d22/f32 [0,4194304] 0 2023-12-09T02:35:20.616 INFO:tasks.workunit.client.1.smithi161.stdout:5/747: write d0/d2/de/d22/d8e/fd8 [33322,69624] 0 2023-12-09T02:35:20.616 INFO:tasks.workunit.client.1.smithi161.stdout:5/748: truncate d0/f69 252438 0 2023-12-09T02:35:20.616 INFO:tasks.workunit.client.1.smithi161.stdout:5/749: dread - d0/d2/de/f5b zero size 2023-12-09T02:35:20.616 INFO:tasks.workunit.client.1.smithi161.stdout:5/750: stat d0/l36 0 2023-12-09T02:35:20.617 INFO:tasks.workunit.client.1.smithi161.stdout:9/670: link d2/c6 d2/dc3/ce8 0 2023-12-09T02:35:20.617 INFO:tasks.workunit.client.1.smithi161.stdout:9/671: chown d2/d25/db1/d65/d42/d58/f1e 851350007 1 2023-12-09T02:35:20.618 INFO:tasks.workunit.client.1.smithi161.stdout:5/751: mknod d0/d2/de/d22/d8e/d8f/dcd/de1/c108 0 2023-12-09T02:35:20.619 INFO:tasks.workunit.client.1.smithi161.stdout:9/672: mknod d2/d25/db1/d65/d42/d58/d91/d39/ce9 0 2023-12-09T02:35:20.620 INFO:tasks.workunit.client.1.smithi161.stdout:9/673: write d2/d25/db1/d65/f43 [3882470,36295] 0 2023-12-09T02:35:20.621 INFO:tasks.workunit.client.1.smithi161.stdout:5/752: symlink d0/d2/de/d22/l109 0 2023-12-09T02:35:20.621 INFO:tasks.workunit.client.1.smithi161.stdout:5/753: stat d0/d2/de/d22/d8e/d8f/dcd/de1/c108 0 2023-12-09T02:35:20.621 INFO:tasks.workunit.client.1.smithi161.stdout:5/754: fsync d0/f69 0 2023-12-09T02:35:20.622 INFO:tasks.workunit.client.1.smithi161.stdout:5/755: dread - d0/d2/de/d22/d8e/d8f/dcd/fbf zero size 2023-12-09T02:35:20.622 INFO:tasks.workunit.client.1.smithi161.stdout:9/674: unlink d2/d25/db1/d65/d42/d58/l4a 0 2023-12-09T02:35:20.623 INFO:tasks.workunit.client.1.smithi161.stdout:4/882: dwrite dd/d1a/d1e/f11c [0,4194304] 0 2023-12-09T02:35:20.623 INFO:tasks.workunit.client.1.smithi161.stdout:4/883: read - dd/d36/d4a/d5f/d65/df9/dd2/fd4 zero size 2023-12-09T02:35:20.623 INFO:tasks.workunit.client.1.smithi161.stdout:4/884: readlink dd/d36/d3f/d54/d102/lc5 0 2023-12-09T02:35:20.626 INFO:tasks.workunit.client.1.smithi161.stdout:5/756: symlink d0/d2/de/d22/d8e/d8f/dcd/d83/l10a 0 2023-12-09T02:35:20.626 INFO:tasks.workunit.client.1.smithi161.stdout:5/757: read - d0/d2/de/d22/d8e/d8f/dcd/fbf zero size 2023-12-09T02:35:20.628 INFO:tasks.workunit.client.1.smithi161.stdout:9/675: unlink d2/d25/db1/d65/d42/d58/d91/d2e/f45 0 2023-12-09T02:35:20.634 INFO:tasks.workunit.client.1.smithi161.stdout:5/758: link d0/d2/d7/d11/d50/d8a/ded/f81 d0/d2/de/d44/ddd/f10b 0 2023-12-09T02:35:20.637 INFO:tasks.workunit.client.1.smithi161.stdout:9/676: mkdir d2/d25/db1/d65/d5c/d55/d66/d83/d90/d95/dea 0 2023-12-09T02:35:20.638 INFO:tasks.workunit.client.1.smithi161.stdout:5/759: mknod d0/d2/de/d44/ddd/c10c 0 2023-12-09T02:35:20.641 INFO:tasks.workunit.client.1.smithi161.stdout:9/677: mknod d2/d25/db1/d65/d42/d58/d91/d39/ceb 0 2023-12-09T02:35:20.641 INFO:tasks.workunit.client.1.smithi161.stdout:8/663: sync 2023-12-09T02:35:20.641 INFO:tasks.workunit.client.1.smithi161.stdout:6/689: sync 2023-12-09T02:35:20.642 INFO:tasks.workunit.client.1.smithi161.stdout:1/844: sync 2023-12-09T02:35:20.642 INFO:tasks.workunit.client.1.smithi161.stdout:9/678: write d2/d25/db1/d65/fa8 [1989483,108887] 0 2023-12-09T02:35:20.642 INFO:tasks.workunit.client.1.smithi161.stdout:5/760: creat d0/d2/de/d44/f10d x:0 0 0 2023-12-09T02:35:20.643 INFO:tasks.workunit.client.1.smithi161.stdout:6/690: mknod da/d19/dc2/d3c/d46/cec 0 2023-12-09T02:35:20.645 INFO:tasks.workunit.client.1.smithi161.stdout:1/845: symlink d6/d8/d68/l112 0 2023-12-09T02:35:20.645 INFO:tasks.workunit.client.1.smithi161.stdout:5/761: dread d0/d2/de/d44/dff/de5/ff2 [0,4194304] 0 2023-12-09T02:35:20.646 INFO:tasks.workunit.client.1.smithi161.stdout:5/762: write d0/d2/de/d22/f59 [6555597,10210] 0 2023-12-09T02:35:20.646 INFO:tasks.workunit.client.1.smithi161.stdout:5/763: write d0/d2/d7/d11/d50/ff8 [65593,4501] 0 2023-12-09T02:35:20.646 INFO:tasks.workunit.client.1.smithi161.stdout:8/664: symlink d2/d5/d22/d31/d38/d66/ld8 0 2023-12-09T02:35:20.646 INFO:tasks.workunit.client.1.smithi161.stdout:8/665: fdatasync d2/d5/d4f/f2c 0 2023-12-09T02:35:20.646 INFO:tasks.workunit.client.1.smithi161.stdout:8/666: chown d2/d5/d22/f49 7538 1 2023-12-09T02:35:20.653 INFO:tasks.workunit.client.1.smithi161.stdout:9/679: stat d2/d25/db1/d65/d4f/c6e 0 2023-12-09T02:35:20.658 INFO:tasks.workunit.client.1.smithi161.stdout:1/846: unlink d6/d8/d63/d4d/l36 0 2023-12-09T02:35:20.661 INFO:tasks.workunit.client.1.smithi161.stdout:9/680: link d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/le7 d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/lec 0 2023-12-09T02:35:20.665 INFO:tasks.workunit.client.1.smithi161.stdout:9/681: truncate d2/d25/db1/d65/d42/d58/d91/f36 392034 0 2023-12-09T02:35:20.666 INFO:tasks.workunit.client.1.smithi161.stdout:6/691: dread da/d19/f72 [0,4194304] 0 2023-12-09T02:35:20.671 INFO:tasks.workunit.client.1.smithi161.stdout:9/682: symlink d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/d8f/led 0 2023-12-09T02:35:20.671 INFO:tasks.workunit.client.1.smithi161.stdout:8/667: dwrite d2/d5/dc0/fcf [0,4194304] 0 2023-12-09T02:35:20.671 INFO:tasks.workunit.client.1.smithi161.stdout:8/668: dread - d2/d5/d4f/f82 zero size 2023-12-09T02:35:20.671 INFO:tasks.workunit.client.1.smithi161.stdout:5/764: dwrite d0/d2/de/d22/d8e/d8f/dcd/fbf [0,4194304] 0 2023-12-09T02:35:20.671 INFO:tasks.workunit.client.1.smithi161.stdout:5/765: chown d0/d2/de/d22/d8e/d8f/dcd/da8/fc2 1037 1 2023-12-09T02:35:20.672 INFO:tasks.workunit.client.1.smithi161.stdout:5/766: readlink d0/d2/d7/d9a/lad 0 2023-12-09T02:35:20.672 INFO:tasks.workunit.client.1.smithi161.stdout:5/767: fdatasync d0/d2/de/d22/d8e/d8f/dcd/da8/fc2 0 2023-12-09T02:35:20.674 INFO:tasks.workunit.client.1.smithi161.stdout:9/683: rename d2/d25/db1/d65/d42/f4c to d2/d25/db1/d65/d7c/fee 0 2023-12-09T02:35:20.674 INFO:tasks.workunit.client.1.smithi161.stdout:9/684: read - d2/d25/db1/d65/d5c/dac/fb9 zero size 2023-12-09T02:35:20.674 INFO:tasks.workunit.client.1.smithi161.stdout:9/685: write d2/f8 [1578912,14173] 0 2023-12-09T02:35:20.674 INFO:tasks.workunit.client.1.smithi161.stdout:8/669: getdents d2/d5/d22/d31/d38/d66/d88/da5 0 2023-12-09T02:35:20.679 INFO:tasks.workunit.client.1.smithi161.stdout:9/686: truncate d2/d25/db1/d65/d42/d58/d22/f9f 420058 0 2023-12-09T02:35:20.680 INFO:tasks.workunit.client.1.smithi161.stdout:8/670: truncate d2/d5/d22/d31/d38/f59 2378496 0 2023-12-09T02:35:20.680 INFO:tasks.workunit.client.1.smithi161.stdout:8/671: write d2/d5/d22/d31/d38/f4d [3360049,16908] 0 2023-12-09T02:35:20.682 INFO:tasks.workunit.client.1.smithi161.stdout:1/847: dwrite d6/d8/d63/d4d/fee [0,4194304] 0 2023-12-09T02:35:20.687 INFO:tasks.workunit.client.1.smithi161.stdout:5/768: mknod d0/d2/de/d44/c10e 0 2023-12-09T02:35:20.689 INFO:tasks.workunit.client.1.smithi161.stdout:9/687: rename d2/d25/db1/d65/d63/lc2 to d2/d25/db1/d65/d4f/lef 0 2023-12-09T02:35:20.691 INFO:tasks.workunit.client.1.smithi161.stdout:1/848: mkdir d6/d9/dd6/d113 0 2023-12-09T02:35:20.697 INFO:tasks.workunit.client.1.smithi161.stdout:8/672: dwrite d2/d5/d22/f98 [0,4194304] 0 2023-12-09T02:35:20.698 INFO:tasks.workunit.client.1.smithi161.stdout:5/769: rename d0/d2/de/ldf to d0/d2/d7/l10f 0 2023-12-09T02:35:20.698 INFO:tasks.workunit.client.1.smithi161.stdout:5/770: stat d0/d2/de/d22/f32 0 2023-12-09T02:35:20.699 INFO:tasks.workunit.client.1.smithi161.stdout:1/849: mkdir d6/d8/d63/d4d/d9f/d114 0 2023-12-09T02:35:20.709 INFO:tasks.workunit.client.1.smithi161.stdout:1/850: dread d6/d9/d5c/f66 [0,4194304] 0 2023-12-09T02:35:20.711 INFO:tasks.workunit.client.1.smithi161.stdout:8/673: dread d2/d5/f16 [0,4194304] 0 2023-12-09T02:35:20.713 INFO:tasks.workunit.client.1.smithi161.stdout:8/674: creat d2/d5/d3d/fd9 x:0 0 0 2023-12-09T02:35:20.713 INFO:tasks.workunit.client.1.smithi161.stdout:8/675: write d2/d5/d22/d86/fa4 [963515,98914] 0 2023-12-09T02:35:20.714 INFO:tasks.workunit.client.1.smithi161.stdout:8/676: chown d2/d5/d3d/dc7 110450 1 2023-12-09T02:35:20.715 INFO:tasks.workunit.client.1.smithi161.stdout:8/677: stat d2/d8a/cc5 0 2023-12-09T02:35:20.715 INFO:tasks.workunit.client.1.smithi161.stdout:8/678: readlink d2/d5/d4f/l32 0 2023-12-09T02:35:20.716 INFO:tasks.workunit.client.1.smithi161.stdout:8/679: creat d2/d5/d22/dc3/fda x:0 0 0 2023-12-09T02:35:20.717 INFO:tasks.workunit.client.1.smithi161.stdout:8/680: write d2/d5/dc0/fcf [557043,100700] 0 2023-12-09T02:35:20.719 INFO:tasks.workunit.client.1.smithi161.stdout:5/771: dwrite d0/d2/de/d44/ddd/f10b [0,4194304] 0 2023-12-09T02:35:20.720 INFO:tasks.workunit.client.1.smithi161.stdout:9/688: dwrite d2/d25/db1/d65/d5c/d60/d7f/f89 [0,4194304] 0 2023-12-09T02:35:20.722 INFO:tasks.workunit.client.1.smithi161.stdout:1/851: dread d6/d8/d63/d4d/d9f/fa0 [0,4194304] 0 2023-12-09T02:35:20.724 INFO:tasks.workunit.client.1.smithi161.stdout:8/681: mkdir d2/d8a/dbd/ddb 0 2023-12-09T02:35:20.724 INFO:tasks.workunit.client.1.smithi161.stdout:8/682: fdatasync d2/d8a/fc1 0 2023-12-09T02:35:20.725 INFO:tasks.workunit.client.1.smithi161.stdout:1/852: dread d6/d8/d63/d4d/d31/d80/d9c/ffd [0,4194304] 0 2023-12-09T02:35:20.728 INFO:tasks.workunit.client.1.smithi161.stdout:5/772: symlink d0/d2/de/d22/d8e/d8f/dcd/l110 0 2023-12-09T02:35:20.733 INFO:tasks.workunit.client.1.smithi161.stdout:9/689: link d2/f1b d2/d25/db1/d65/d5c/d55/d66/d83/dd1/ff0 0 2023-12-09T02:35:20.734 INFO:tasks.workunit.client.1.smithi161.stdout:8/683: rename d2/d5/d4f/l8e to d2/d2d/ldc 0 2023-12-09T02:35:20.734 INFO:tasks.workunit.client.1.smithi161.stdout:8/684: write d2/d5/d22/d86/d97/fa8 [422211,77079] 0 2023-12-09T02:35:20.736 INFO:tasks.workunit.client.1.smithi161.stdout:9/690: mkdir d2/d25/db1/d65/d42/d58/d91/df1 0 2023-12-09T02:35:20.736 INFO:tasks.workunit.client.1.smithi161.stdout:9/691: fdatasync d2/d25/db1/d65/d42/d58/f1e 0 2023-12-09T02:35:20.737 INFO:tasks.workunit.client.1.smithi161.stdout:5/773: rename d0/d2/fcc to d0/d2/de/d22/d8e/d8f/dcd/d83/f111 0 2023-12-09T02:35:20.737 INFO:tasks.workunit.client.1.smithi161.stdout:5/774: chown d0/d2/d7/d11/d50/f8c 283 1 2023-12-09T02:35:20.738 INFO:tasks.workunit.client.1.smithi161.stdout:8/685: mknod d2/d5/d22/d86/dd0/cdd 0 2023-12-09T02:35:20.741 INFO:tasks.workunit.client.1.smithi161.stdout:9/692: rename d2/d25/db1/d65/f43 to d2/d25/db1/d65/d5c/d55/d66/d83/ff2 0 2023-12-09T02:35:20.743 INFO:tasks.workunit.client.1.smithi161.stdout:8/686: mknod d2/d5/d22/d31/d38/d48/cde 0 2023-12-09T02:35:20.745 INFO:tasks.workunit.client.1.smithi161.stdout:8/687: creat d2/d5/dac/fdf x:0 0 0 2023-12-09T02:35:20.746 INFO:tasks.workunit.client.1.smithi161.stdout:9/693: dread d2/d25/db1/f85 [0,4194304] 0 2023-12-09T02:35:20.748 INFO:tasks.workunit.client.1.smithi161.stdout:9/694: link d2/d25/db1/d65/d5c/d55/d66/d83/dd1/fe3 d2/d25/db1/d65/d7c/ff3 0 2023-12-09T02:35:20.750 INFO:tasks.workunit.client.1.smithi161.stdout:9/695: unlink d2/d25/db1/d65/d42/d58/d91/d51/cc1 0 2023-12-09T02:35:20.766 INFO:tasks.workunit.client.1.smithi161.stdout:9/696: dread d2/d25/db1/d65/d42/d58/f75 [0,4194304] 0 2023-12-09T02:35:20.766 INFO:tasks.workunit.client.1.smithi161.stdout:5/775: dwrite d0/d2/de/d44/dff/de5/ff2 [0,4194304] 0 2023-12-09T02:35:20.774 INFO:tasks.workunit.client.1.smithi161.stdout:9/697: creat d2/d25/db1/d65/d4f/ff4 x:0 0 0 2023-12-09T02:35:20.774 INFO:tasks.workunit.client.1.smithi161.stdout:9/698: readlink d2/d25/db1/d65/d5c/d55/d66/la3 0 2023-12-09T02:35:20.777 INFO:tasks.workunit.client.1.smithi161.stdout:5/776: creat d0/f112 x:0 0 0 2023-12-09T02:35:20.792 INFO:tasks.workunit.client.1.smithi161.stdout:9/699: dwrite d2/d25/db1/d65/d5c/d55/d66/d83/fab [0,4194304] 0 2023-12-09T02:35:20.793 INFO:tasks.workunit.client.1.smithi161.stdout:9/700: fsync d2/d25/db1/d65/d42/d58/d91/d2e/f40 0 2023-12-09T02:35:20.797 INFO:tasks.workunit.client.1.smithi161.stdout:3/664: sync 2023-12-09T02:35:20.797 INFO:tasks.workunit.client.1.smithi161.stdout:0/663: sync 2023-12-09T02:35:20.798 INFO:tasks.workunit.client.1.smithi161.stdout:3/665: chown d2/d51/d75/d11/d19/d91/d46/d5e/l94 5 1 2023-12-09T02:35:20.799 INFO:tasks.workunit.client.1.smithi161.stdout:0/664: rmdir d9/db/d2a/d9d/dba 39 2023-12-09T02:35:20.799 INFO:tasks.workunit.client.1.smithi161.stdout:0/665: truncate d9/db/d2a/d9d/dba/d94/fcc 150007 0 2023-12-09T02:35:20.800 INFO:tasks.workunit.client.1.smithi161.stdout:3/666: creat d2/d51/d75/d50/fc1 x:0 0 0 2023-12-09T02:35:20.802 INFO:tasks.workunit.client.1.smithi161.stdout:5/777: dwrite d0/d2/d7/d51/fb3 [0,4194304] 0 2023-12-09T02:35:20.803 INFO:tasks.workunit.client.1.smithi161.stdout:3/667: symlink d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/lc2 0 2023-12-09T02:35:20.807 INFO:tasks.workunit.client.1.smithi161.stdout:9/701: dread d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/fdd [0,4194304] 0 2023-12-09T02:35:20.807 INFO:tasks.workunit.client.1.smithi161.stdout:9/702: dread - d2/d25/db1/d65/d5c/fcd zero size 2023-12-09T02:35:20.807 INFO:tasks.workunit.client.1.smithi161.stdout:9/703: fsync d2/d25/db1/d65/fa8 0 2023-12-09T02:35:20.808 INFO:tasks.workunit.client.1.smithi161.stdout:5/778: dread d0/d2/f7a [0,4194304] 0 2023-12-09T02:35:20.812 INFO:tasks.workunit.client.1.smithi161.stdout:5/779: dread d0/d2/d7/d11/d50/d8a/ded/fc1 [0,4194304] 0 2023-12-09T02:35:20.812 INFO:tasks.workunit.client.1.smithi161.stdout:5/780: write d0/d2/d7/d11/dc3/f75 [4939931,128713] 0 2023-12-09T02:35:20.814 INFO:tasks.workunit.client.1.smithi161.stdout:3/668: creat d2/d51/d75/d11/d1f/d7a/d96/fc3 x:0 0 0 2023-12-09T02:35:20.815 INFO:tasks.workunit.client.1.smithi161.stdout:9/704: write d2/d25/db1/d65/d42/d58/d91/f99 [3866486,108734] 0 2023-12-09T02:35:20.815 INFO:tasks.workunit.client.1.smithi161.stdout:9/705: fsync d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/f97 0 2023-12-09T02:35:20.816 INFO:tasks.workunit.client.1.smithi161.stdout:3/669: read d2/d51/d75/d11/d19/d91/f7d [7247175,52535] 0 2023-12-09T02:35:20.818 INFO:tasks.workunit.client.1.smithi161.stdout:8/688: write d2/d2d/f70 [1915221,38081] 0 2023-12-09T02:35:20.819 INFO:tasks.workunit.client.1.smithi161.stdout:5/781: creat d0/d2/d7/d11/d50/dfb/f113 x:0 0 0 2023-12-09T02:35:20.819 INFO:tasks.workunit.client.1.smithi161.stdout:5/782: chown d0 3435 1 2023-12-09T02:35:20.821 INFO:tasks.workunit.client.1.smithi161.stdout:0/666: dwrite d9/dd/fc5 [0,4194304] 0 2023-12-09T02:35:20.823 INFO:tasks.workunit.client.1.smithi161.stdout:9/706: link d2/d25/db1/d65/d42/d58/d91/d51/l54 d2/d25/db1/d65/d5c/d55/d66/d83/lf5 0 2023-12-09T02:35:20.825 INFO:tasks.workunit.client.1.smithi161.stdout:0/667: read d9/d55/f9a [107362,18016] 0 2023-12-09T02:35:20.828 INFO:tasks.workunit.client.1.smithi161.stdout:3/670: symlink d2/d51/d75/d11/d19/lc4 0 2023-12-09T02:35:20.833 INFO:tasks.workunit.client.1.smithi161.stdout:8/689: mkdir d2/d5/d22/d86/d97/de0 0 2023-12-09T02:35:20.837 INFO:tasks.workunit.client.1.smithi161.stdout:9/707: creat d2/d25/db1/d65/d42/d58/ff6 x:0 0 0 2023-12-09T02:35:20.837 INFO:tasks.workunit.client.1.smithi161.stdout:9/708: readlink d2/d25/db1/d4d/lc7 0 2023-12-09T02:35:20.845 INFO:tasks.workunit.client.1.smithi161.stdout:5/783: dwrite d0/d2/de/d22/d55/f106 [0,4194304] 0 2023-12-09T02:35:20.845 INFO:tasks.workunit.client.1.smithi161.stdout:8/690: write d2/d5/fa [49473,63087] 0 2023-12-09T02:35:20.848 INFO:tasks.workunit.client.1.smithi161.stdout:9/709: rename d2/d25/db1/d65/d5c/d55/da5 to d2/d25/db1/d65/d4f/df7 0 2023-12-09T02:35:20.854 INFO:tasks.workunit.client.1.smithi161.stdout:5/784: link d0/d2/de/d44/fd0 d0/d2/de/d22/d8e/dfe/f114 0 2023-12-09T02:35:20.858 INFO:tasks.workunit.client.1.smithi161.stdout:8/691: symlink d2/d8a/dbd/le1 0 2023-12-09T02:35:20.863 INFO:tasks.workunit.client.1.smithi161.stdout:9/710: mknod d2/d25/db1/d65/d42/d58/d91/d51/cf8 0 2023-12-09T02:35:20.863 INFO:tasks.workunit.client.1.smithi161.stdout:9/711: chown d2/d25/db1/d65/d5c/d55/d66/d83/ff2 16 1 2023-12-09T02:35:20.863 INFO:tasks.workunit.client.1.smithi161.stdout:9/712: fsync d2/d25/db1/d65/d88/f9b 0 2023-12-09T02:35:20.866 INFO:tasks.workunit.client.1.smithi161.stdout:3/671: dwrite d2/d51/d75/d11/d19/d91/fa4 [0,4194304] 0 2023-12-09T02:35:20.867 INFO:tasks.workunit.client.1.smithi161.stdout:0/668: dwrite d9/f62 [0,4194304] 0 2023-12-09T02:35:20.867 INFO:tasks.workunit.client.1.smithi161.stdout:0/669: chown d9/d55/d86/d98/lbf 841872 1 2023-12-09T02:35:20.868 INFO:tasks.workunit.client.1.smithi161.stdout:5/785: creat d0/d2/d7/d11/d61/def/f115 x:0 0 0 2023-12-09T02:35:20.868 INFO:tasks.workunit.client.1.smithi161.stdout:5/786: fdatasync d0/d2/d7/d11/f4c 0 2023-12-09T02:35:20.869 INFO:tasks.workunit.client.1.smithi161.stdout:8/692: truncate d2/f55 1918814 0 2023-12-09T02:35:20.870 INFO:tasks.workunit.client.1.smithi161.stdout:9/713: creat d2/d25/db1/d65/ff9 x:0 0 0 2023-12-09T02:35:20.870 INFO:tasks.workunit.client.1.smithi161.stdout:9/714: write d2/d25/dbf/fc0 [412251,28676] 0 2023-12-09T02:35:20.873 INFO:tasks.workunit.client.1.smithi161.stdout:5/787: write d0/d2/d7/df/f96 [3290878,36417] 0 2023-12-09T02:35:20.880 INFO:tasks.workunit.client.1.smithi161.stdout:3/672: mknod d2/d51/d75/d11/d19/d91/d46/d2d/cc5 0 2023-12-09T02:35:20.880 INFO:tasks.workunit.client.1.smithi161.stdout:3/673: chown d2/d51/d75/d11/d19/d91/c81 24550810 1 2023-12-09T02:35:20.886 INFO:tasks.workunit.client.1.smithi161.stdout:0/670: link d9/d55/f9a d9/d55/d26/d28/daa/fd1 0 2023-12-09T02:35:20.886 INFO:tasks.workunit.client.1.smithi161.stdout:0/671: chown f7 3 1 2023-12-09T02:35:20.890 INFO:tasks.workunit.client.1.smithi161.stdout:9/715: mknod d2/d25/db1/d65/d88/cfa 0 2023-12-09T02:35:20.895 INFO:tasks.workunit.client.1.smithi161.stdout:3/674: rename d2/d51/d75/d11/d19/d91/l7e to d2/d51/lc6 0 2023-12-09T02:35:20.900 INFO:tasks.workunit.client.1.smithi161.stdout:3/675: mkdir d2/d37/dc7 0 2023-12-09T02:35:20.901 INFO:tasks.workunit.client.1.smithi161.stdout:9/716: read d2/f47 [1996520,95907] 0 2023-12-09T02:35:20.904 INFO:tasks.workunit.client.1.smithi161.stdout:5/788: dwrite d0/d2/d7/d11/d50/d8a/ded/fc1 [0,4194304] 0 2023-12-09T02:35:20.905 INFO:tasks.workunit.client.1.smithi161.stdout:3/676: mknod d2/d51/d75/d50/cc8 0 2023-12-09T02:35:20.914 INFO:tasks.workunit.client.1.smithi161.stdout:0/672: dwrite d9/db/f84 [0,4194304] 0 2023-12-09T02:35:20.919 INFO:tasks.workunit.client.1.smithi161.stdout:0/673: read d9/d55/d7c/f38 [2357967,94944] 0 2023-12-09T02:35:20.921 INFO:tasks.workunit.client.1.smithi161.stdout:0/674: creat d9/dd/dca/fd2 x:0 0 0 2023-12-09T02:35:20.925 INFO:tasks.workunit.client.1.smithi161.stdout:0/675: creat d9/db/d2a/d9d/dba/d94/db6/fd3 x:0 0 0 2023-12-09T02:35:20.926 INFO:tasks.workunit.client.1.smithi161.stdout:3/677: dread d2/d37/f38 [0,4194304] 0 2023-12-09T02:35:20.930 INFO:tasks.workunit.client.1.smithi161.stdout:9/717: dwrite d2/d25/db1/d65/d5c/d55/d66/d83/dd1/ff0 [0,4194304] 0 2023-12-09T02:35:20.932 INFO:tasks.workunit.client.1.smithi161.stdout:5/789: dwrite d0/d2/de/d22/f32 [0,4194304] 0 2023-12-09T02:35:20.932 INFO:tasks.workunit.client.1.smithi161.stdout:5/790: stat d0/d2/d7/d51/fb3 0 2023-12-09T02:35:20.937 INFO:tasks.workunit.client.1.smithi161.stdout:0/676: mkdir d9/d1f/dd4 0 2023-12-09T02:35:20.939 INFO:tasks.workunit.client.1.smithi161.stdout:9/718: mkdir d2/d25/db1/d65/d4f/dfb 0 2023-12-09T02:35:20.939 INFO:tasks.workunit.client.1.smithi161.stdout:9/719: readlink d2/d25/db1/d65/d88/dcb/ddf/lce 0 2023-12-09T02:35:20.941 INFO:tasks.workunit.client.1.smithi161.stdout:4/885: sync 2023-12-09T02:35:20.942 INFO:tasks.workunit.client.1.smithi161.stdout:4/886: readlink dd/d36/d4a/d5f/lca 0 2023-12-09T02:35:20.942 INFO:tasks.workunit.client.1.smithi161.stdout:1/853: sync 2023-12-09T02:35:20.942 INFO:tasks.workunit.client.1.smithi161.stdout:1/854: dread - d6/d8/d63/d4d/d31/d73/f10f zero size 2023-12-09T02:35:20.942 INFO:tasks.workunit.client.1.smithi161.stdout:1/855: write d6/d8/d63/d93/f16 [926247,33749] 0 2023-12-09T02:35:20.942 INFO:tasks.workunit.client.1.smithi161.stdout:2/726: sync 2023-12-09T02:35:20.945 INFO:tasks.workunit.client.1.smithi161.stdout:9/720: dread d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/fdd [0,4194304] 0 2023-12-09T02:35:20.949 INFO:tasks.workunit.client.1.smithi161.stdout:6/692: sync 2023-12-09T02:35:20.949 INFO:tasks.workunit.client.1.smithi161.stdout:7/667: sync 2023-12-09T02:35:20.949 INFO:tasks.workunit.client.1.smithi161.stdout:5/791: rename d0/d2/d7/fda to d0/f116 0 2023-12-09T02:35:20.954 INFO:tasks.workunit.client.1.smithi161.stdout:2/727: rmdir d4/d1a 39 2023-12-09T02:35:20.954 INFO:tasks.workunit.client.1.smithi161.stdout:2/728: chown d4/d7/d8f/cb0 54 1 2023-12-09T02:35:20.959 INFO:tasks.workunit.client.1.smithi161.stdout:9/721: symlink d2/d25/db1/d65/d5c/d55/lfc 0 2023-12-09T02:35:20.962 INFO:tasks.workunit.client.1.smithi161.stdout:3/678: dwrite d2/fa1 [0,4194304] 0 2023-12-09T02:35:20.962 INFO:tasks.workunit.client.1.smithi161.stdout:7/668: rename d0/d3/d13/d2d/d43 to d0/d3/d13/d4e/db2/dda 0 2023-12-09T02:35:20.962 INFO:tasks.workunit.client.1.smithi161.stdout:5/792: unlink d0/d2/d5f/ff9 0 2023-12-09T02:35:20.964 INFO:tasks.workunit.client.1.smithi161.stdout:7/669: write d0/d3/d13/f18 [3094559,58314] 0 2023-12-09T02:35:20.965 INFO:tasks.workunit.client.1.smithi161.stdout:2/729: creat d4/d16/d69/d8c/ff0 x:0 0 0 2023-12-09T02:35:20.970 INFO:tasks.workunit.client.1.smithi161.stdout:3/679: getdents d2/d51/d75/d11/d19/d91/d46/d2d 0 2023-12-09T02:35:20.973 INFO:tasks.workunit.client.1.smithi161.stdout:0/677: dwrite d9/d55/d26/f8c [0,4194304] 0 2023-12-09T02:35:20.974 INFO:tasks.workunit.client.1.smithi161.stdout:9/722: rename d2/d25/db1/d65/d42/d58/f75 to d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/ffd 0 2023-12-09T02:35:20.980 INFO:tasks.workunit.client.1.smithi161.stdout:5/793: symlink d0/d2/d7/d11/d61/d107/l117 0 2023-12-09T02:35:20.980 INFO:tasks.workunit.client.1.smithi161.stdout:5/794: fsync d0/d2/d7/d11/f5d 0 2023-12-09T02:35:20.981 INFO:tasks.workunit.client.1.smithi161.stdout:5/795: chown d0/d2/de/d22/d8e/d8f/dcd/d83/lcf 139164068 1 2023-12-09T02:35:20.985 INFO:tasks.workunit.client.1.smithi161.stdout:7/670: mknod d0/d3/d13/d4e/db2/dda/dab/d94/cdb 0 2023-12-09T02:35:20.985 INFO:tasks.workunit.client.1.smithi161.stdout:7/671: write d0/d3/d13/dc7/f57 [812172,4513] 0 2023-12-09T02:35:20.985 INFO:tasks.workunit.client.1.smithi161.stdout:7/672: write d0/d49/d67/d71/fac [1028976,118651] 0 2023-12-09T02:35:20.986 INFO:tasks.workunit.client.1.smithi161.stdout:1/856: dwrite d6/d8/d63/d4d/d31/d73/d47/f6d [0,4194304] 0 2023-12-09T02:35:20.987 INFO:tasks.workunit.client.1.smithi161.stdout:6/693: dwrite f9 [4194304,4194304] 0 2023-12-09T02:35:20.987 INFO:tasks.workunit.client.1.smithi161.stdout:6/694: chown da/d19/dc2/d3c/d46/f7c 3 1 2023-12-09T02:35:20.988 INFO:tasks.workunit.client.1.smithi161.stdout:6/695: dread da/d19/dc2/d29/d2b/f7e [0,4194304] 0 2023-12-09T02:35:20.988 INFO:tasks.workunit.client.1.smithi161.stdout:2/730: truncate d4/d1a/dc2/fdb 806457 0 2023-12-09T02:35:20.993 INFO:tasks.workunit.client.1.smithi161.stdout:0/678: truncate d9/dd/f80 2486815 0 2023-12-09T02:35:20.993 INFO:tasks.workunit.client.1.smithi161.stdout:0/679: stat d9/d55/d44 0 2023-12-09T02:35:20.994 INFO:tasks.workunit.client.1.smithi161.stdout:9/723: getdents d2/dc3 0 2023-12-09T02:35:21.001 INFO:tasks.workunit.client.1.smithi161.stdout:7/673: truncate d0/d3/f73 1637548 0 2023-12-09T02:35:21.007 INFO:tasks.workunit.client.1.smithi161.stdout:3/680: dwrite d2/d51/d75/d11/d19/d91/f2b [0,4194304] 0 2023-12-09T02:35:21.007 INFO:tasks.workunit.client.1.smithi161.stdout:3/681: stat d2/d37/d99 0 2023-12-09T02:35:21.010 INFO:tasks.workunit.client.1.smithi161.stdout:3/682: read d2/d51/d75/d11/f64 [3192688,128063] 0 2023-12-09T02:35:21.011 INFO:tasks.workunit.client.1.smithi161.stdout:1/857: dread d6/d8/d63/d4d/d31/d73/d47/f6d [0,4194304] 0 2023-12-09T02:35:21.018 INFO:tasks.workunit.client.1.smithi161.stdout:5/796: dwrite d0/d2/f4d [0,4194304] 0 2023-12-09T02:35:21.018 INFO:tasks.workunit.client.1.smithi161.stdout:5/797: write d0/d2/d7/d11/d50/ff8 [619784,70322] 0 2023-12-09T02:35:21.018 INFO:tasks.workunit.client.1.smithi161.stdout:6/696: dread da/d19/dc2/d29/d2b/d31/f66 [0,4194304] 0 2023-12-09T02:35:21.018 INFO:tasks.workunit.client.1.smithi161.stdout:7/674: dwrite d0/d3/d13/d4e/db2/dda/d4b/d5a/fc6 [0,4194304] 0 2023-12-09T02:35:21.018 INFO:tasks.workunit.client.1.smithi161.stdout:2/731: creat d4/d16/d69/d8c/d87/ff1 x:0 0 0 2023-12-09T02:35:21.020 INFO:tasks.workunit.client.1.smithi161.stdout:0/680: creat d9/d9c/fd5 x:0 0 0 2023-12-09T02:35:21.025 INFO:tasks.workunit.client.1.smithi161.stdout:9/724: creat d2/d25/db1/d65/d42/d58/d91/d51/ffe x:0 0 0 2023-12-09T02:35:21.035 INFO:tasks.workunit.client.1.smithi161.stdout:3/683: dwrite d2/d51/d75/d11/d1f/d7a/fb4 [0,4194304] 0 2023-12-09T02:35:21.035 INFO:tasks.workunit.client.1.smithi161.stdout:1/858: dwrite d6/d8/d63/d1c/f69 [0,4194304] 0 2023-12-09T02:35:21.036 INFO:tasks.workunit.client.1.smithi161.stdout:6/697: unlink da/d19/dc2/d77/fc8 0 2023-12-09T02:35:21.036 INFO:tasks.workunit.client.1.smithi161.stdout:6/698: readlink da/df/l30 0 2023-12-09T02:35:21.046 INFO:tasks.workunit.client.1.smithi161.stdout:2/732: truncate d4/d16/d69/faf 5286583 0 2023-12-09T02:35:21.048 INFO:tasks.workunit.client.1.smithi161.stdout:0/681: truncate d9/db/f3e 1070101 0 2023-12-09T02:35:21.050 INFO:tasks.workunit.client.1.smithi161.stdout:3/684: dwrite d2/f82 [0,4194304] 0 2023-12-09T02:35:21.050 INFO:tasks.workunit.client.1.smithi161.stdout:3/685: chown d2/d37/f4d 77 1 2023-12-09T02:35:21.051 INFO:tasks.workunit.client.1.smithi161.stdout:9/725: symlink d2/d25/db1/d65/d42/d58/d91/lff 0 2023-12-09T02:35:21.068 INFO:tasks.workunit.client.1.smithi161.stdout:6/699: link da/df/c18 da/d19/dc2/d3c/db8/ced 0 2023-12-09T02:35:21.068 INFO:tasks.workunit.client.1.smithi161.stdout:6/700: dread - da/d19/dc2/d4d/fa8 zero size 2023-12-09T02:35:21.069 INFO:tasks.workunit.client.1.smithi161.stdout:7/675: symlink d0/d49/d67/ldc 0 2023-12-09T02:35:21.074 INFO:tasks.workunit.client.1.smithi161.stdout:2/733: rename d4/d16/d69/d8c/ddf/cb8 to d4/d7/cf2 0 2023-12-09T02:35:21.081 INFO:tasks.workunit.client.1.smithi161.stdout:9/726: mkdir d2/d25/db1/d65/d100 0 2023-12-09T02:35:21.081 INFO:tasks.workunit.client.1.smithi161.stdout:6/701: rmdir da/d19/dc2/d4d 39 2023-12-09T02:35:21.082 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:20 smithi088 ceph-mon[112028]: Standby manager daemon smithi088.jwlofb started 2023-12-09T02:35:21.082 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:20 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.88:0/4108157636' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.jwlofb/crt"}]: dispatch 2023-12-09T02:35:21.082 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:20 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.88:0/4108157636' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:35:21.082 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:20 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.88:0/4108157636' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.jwlofb/key"}]: dispatch 2023-12-09T02:35:21.082 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:20 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.88:0/4108157636' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:35:21.082 INFO:tasks.workunit.client.1.smithi161.stdout:6/702: write da/d19/f72 [3876723,23456] 0 2023-12-09T02:35:21.083 INFO:tasks.workunit.client.1.smithi161.stdout:6/703: readlink da/d55/d6d/dac/lad 0 2023-12-09T02:35:21.084 INFO:tasks.workunit.client.1.smithi161.stdout:9/727: write d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/ffd [3263330,83835] 0 2023-12-09T02:35:21.085 INFO:tasks.workunit.client.1.smithi161.stdout:7/676: truncate d0/d3/d21/f3b 424942 0 2023-12-09T02:35:21.087 INFO:tasks.workunit.client.1.smithi161.stdout:2/734: link d4/d7/c9 d4/d1a/d4a/d6d/cf3 0 2023-12-09T02:35:21.090 INFO:tasks.workunit.client.1.smithi161.stdout:7/677: truncate d0/d3/d13/f58 477201 0 2023-12-09T02:35:21.110 INFO:tasks.workunit.client.1.smithi161.stdout:9/728: dwrite d2/d25/dbf/fca [4194304,4194304] 0 2023-12-09T02:35:21.111 INFO:tasks.workunit.client.1.smithi161.stdout:9/729: dread - d2/d25/db1/d65/d42/d58/d91/d51/fc6 zero size 2023-12-09T02:35:21.113 INFO:tasks.workunit.client.1.smithi161.stdout:9/730: creat d2/d25/db1/d65/d5c/f101 x:0 0 0 2023-12-09T02:35:21.114 INFO:tasks.workunit.client.1.smithi161.stdout:9/731: symlink d2/d25/db1/d65/d42/d58/d91/d2e/d3f/l102 0 2023-12-09T02:35:21.116 INFO:tasks.workunit.client.1.smithi161.stdout:3/686: dwrite d2/d51/d75/d11/d1f/d7a/d96/f95 [0,4194304] 0 2023-12-09T02:35:21.116 INFO:tasks.workunit.client.1.smithi161.stdout:3/687: chown c0 231801164 1 2023-12-09T02:35:21.116 INFO:tasks.workunit.client.1.smithi161.stdout:6/704: dwrite da/d19/dc2/d77/d79/f7a [4194304,4194304] 0 2023-12-09T02:35:21.117 INFO:tasks.workunit.client.1.smithi161.stdout:9/732: getdents d2/d25/db1/d65/d88/dcb/ddf 0 2023-12-09T02:35:21.118 INFO:tasks.workunit.client.1.smithi161.stdout:7/678: dwrite d0/d3/d13/d2d/d6e/f8c [0,4194304] 0 2023-12-09T02:35:21.121 INFO:tasks.workunit.client.1.smithi161.stdout:7/679: dread d0/d3/f25 [0,4194304] 0 2023-12-09T02:35:21.121 INFO:tasks.workunit.client.1.smithi161.stdout:7/680: write d0/d3/d13/d4e/db5/d83/f95 [1277951,60144] 0 2023-12-09T02:35:21.122 INFO:tasks.workunit.client.1.smithi161.stdout:7/681: stat d0/d3/d13/f89 0 2023-12-09T02:35:21.122 INFO:tasks.workunit.client.1.smithi161.stdout:7/682: readlink d0/d3/d13/l14 0 2023-12-09T02:35:21.123 INFO:tasks.workunit.client.1.smithi161.stdout:6/705: mknod da/d55/d6d/d85/cee 0 2023-12-09T02:35:21.127 INFO:tasks.workunit.client.1.smithi161.stdout:9/733: rename d2/d25/db1/d65/d5c/d55/d66/d83 to d2/d25/db1/d65/d42/d58/d91/d2e/d80/d103 0 2023-12-09T02:35:21.131 INFO:tasks.workunit.client.1.smithi161.stdout:3/688: dwrite d2/d51/d75/d11/d19/d91/f7d [0,4194304] 0 2023-12-09T02:35:21.131 INFO:tasks.workunit.client.1.smithi161.stdout:6/706: rename da/d55/fda to da/d19/dc2/d4d/fef 0 2023-12-09T02:35:21.137 INFO:tasks.workunit.client.1.smithi161.stdout:3/689: creat d2/d51/d75/d11/d19/d91/fc9 x:0 0 0 2023-12-09T02:35:21.137 INFO:tasks.workunit.client.1.smithi161.stdout:3/690: chown d2/d51/d75/f18 8 1 2023-12-09T02:35:21.137 INFO:tasks.workunit.client.1.smithi161.stdout:3/691: chown d2/d51/d75/d11/d19/d91/d46/d2d/d4e/l89 377171 1 2023-12-09T02:35:21.144 INFO:tasks.workunit.client.1.smithi161.stdout:6/707: dread da/d19/dc2/d29/d2b/d31/f94 [0,4194304] 0 2023-12-09T02:35:21.144 INFO:tasks.workunit.client.1.smithi161.stdout:3/692: dread d2/d51/d75/d11/d19/f6e [0,4194304] 0 2023-12-09T02:35:21.145 INFO:tasks.workunit.client.1.smithi161.stdout:6/708: rmdir da/d19/dc2/d9e 39 2023-12-09T02:35:21.147 INFO:tasks.workunit.client.1.smithi161.stdout:6/709: mkdir da/d19/dc2/d3c/dd1/df0 0 2023-12-09T02:35:21.147 INFO:tasks.workunit.client.1.smithi161.stdout:6/710: chown da/df/d2d/f47 46782 1 2023-12-09T02:35:21.148 INFO:tasks.workunit.client.1.smithi161.stdout:6/711: link da/d19/dc2/dd2/feb da/d19/d20/ff1 0 2023-12-09T02:35:21.149 INFO:tasks.workunit.client.1.smithi161.stdout:6/712: unlink da/d55/fbd 0 2023-12-09T02:35:21.150 INFO:tasks.workunit.client.1.smithi161.stdout:6/713: dread da/d19/dc2/d4d/d5e/f89 [0,4194304] 0 2023-12-09T02:35:21.150 INFO:tasks.workunit.client.1.smithi161.stdout:6/714: read - da/d19/fdf zero size 2023-12-09T02:35:21.150 INFO:tasks.workunit.client.1.smithi161.stdout:6/715: chown da/d19/d20/fb7 1 1 2023-12-09T02:35:21.150 INFO:tasks.workunit.client.1.smithi161.stdout:6/716: stat da/d19/d20/f25 0 2023-12-09T02:35:21.151 INFO:tasks.workunit.client.1.smithi161.stdout:7/683: dwrite d0/d49/d67/f92 [4194304,4194304] 0 2023-12-09T02:35:21.151 INFO:tasks.workunit.client.1.smithi161.stdout:6/717: write f1 [3816994,5650] 0 2023-12-09T02:35:21.155 INFO:tasks.workunit.client.1.smithi161.stdout:6/718: getdents da/d19/dc2/d4d/d5e/de8 0 2023-12-09T02:35:21.158 INFO:tasks.workunit.client.1.smithi161.stdout:6/719: mkdir da/d55/d6d/df2 0 2023-12-09T02:35:21.158 INFO:tasks.workunit.client.1.smithi161.stdout:6/720: fdatasync da/f8c 0 2023-12-09T02:35:21.158 INFO:tasks.workunit.client.1.smithi161.stdout:6/721: readlink da/d19/dc2/ld8 0 2023-12-09T02:35:21.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:20 smithi161 ceph-mon[121170]: Standby manager daemon smithi088.jwlofb started 2023-12-09T02:35:21.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:20 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.88:0/4108157636' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.jwlofb/crt"}]: dispatch 2023-12-09T02:35:21.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:20 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.88:0/4108157636' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:35:21.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:20 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.88:0/4108157636' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.jwlofb/key"}]: dispatch 2023-12-09T02:35:21.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:20 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.88:0/4108157636' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:35:21.175 INFO:tasks.workunit.client.1.smithi161.stdout:6/722: getdents da/d55/d6d 0 2023-12-09T02:35:21.177 INFO:tasks.workunit.client.1.smithi161.stdout:3/693: dwrite d2/d51/d75/d50/fc1 [0,4194304] 0 2023-12-09T02:35:21.177 INFO:tasks.workunit.client.1.smithi161.stdout:7/684: dwrite d0/d3/d13/d4e/db2/f4f [0,4194304] 0 2023-12-09T02:35:21.177 INFO:tasks.workunit.client.1.smithi161.stdout:7/685: truncate d0/fc1 347623 0 2023-12-09T02:35:21.177 INFO:tasks.workunit.client.1.smithi161.stdout:7/686: chown d0/d3/d13/d4e/db2/dda/c7f 80044 1 2023-12-09T02:35:21.179 INFO:tasks.workunit.client.1.smithi161.stdout:3/694: mkdir d2/d51/d75/d11/d1f/dca 0 2023-12-09T02:35:21.179 INFO:tasks.workunit.client.1.smithi161.stdout:3/695: chown d2/d51/d75/d11/d19/f2e 26549327 1 2023-12-09T02:35:21.195 INFO:tasks.workunit.client.1.smithi161.stdout:6/723: dwrite da/f1a [0,4194304] 0 2023-12-09T02:35:21.197 INFO:tasks.workunit.client.1.smithi161.stdout:6/724: symlink da/d19/lf3 0 2023-12-09T02:35:21.198 INFO:tasks.workunit.client.1.smithi161.stdout:6/725: chown da/d55/d6d/dac/fd7 89800139 1 2023-12-09T02:35:21.199 INFO:tasks.workunit.client.1.smithi161.stdout:6/726: creat da/d19/dc2/d29/d2b/d31/ff4 x:0 0 0 2023-12-09T02:35:21.200 INFO:tasks.workunit.client.1.smithi161.stdout:6/727: rename da/df/d2d/c5d to da/d19/dc2/d4d/d5e/de8/cf5 0 2023-12-09T02:35:21.201 INFO:tasks.workunit.client.1.smithi161.stdout:6/728: fsync da/df/d2d/d49/f4a 0 2023-12-09T02:35:21.205 INFO:tasks.workunit.client.1.smithi161.stdout:6/729: dread da/f12 [0,4194304] 0 2023-12-09T02:35:21.207 INFO:tasks.workunit.client.1.smithi161.stdout:6/730: creat da/d19/dc2/d29/d2b/db4/ff6 x:0 0 0 2023-12-09T02:35:21.207 INFO:tasks.workunit.client.1.smithi161.stdout:6/731: write da/d19/dc2/fd5 [570014,65414] 0 2023-12-09T02:35:21.208 INFO:tasks.workunit.client.1.smithi161.stdout:6/732: mknod da/d19/dc2/d4d/d5e/cf7 0 2023-12-09T02:35:21.209 INFO:tasks.workunit.client.1.smithi161.stdout:6/733: unlink da/d19/d20/dbf/ccf 0 2023-12-09T02:35:21.209 INFO:tasks.workunit.client.1.smithi161.stdout:6/734: readlink da/d55/d6d/dac/le5 0 2023-12-09T02:35:21.211 INFO:tasks.workunit.client.1.smithi161.stdout:6/735: rename da/d19/dc2/d77/d79/cbe to da/d55/d6d/cf8 0 2023-12-09T02:35:21.218 INFO:tasks.workunit.client.1.smithi161.stdout:6/736: creat da/d55/dea/ff9 x:0 0 0 2023-12-09T02:35:21.218 INFO:tasks.workunit.client.1.smithi161.stdout:6/737: readlink da/d19/dc2/ld8 0 2023-12-09T02:35:21.232 INFO:tasks.workunit.client.1.smithi161.stdout:6/738: dwrite da/d19/dc2/d29/d2b/d31/f51 [0,4194304] 0 2023-12-09T02:35:21.233 INFO:tasks.workunit.client.1.smithi161.stdout:6/739: symlink da/df/d2d/d3b/dd4/lfa 0 2023-12-09T02:35:21.235 INFO:tasks.workunit.client.1.smithi161.stdout:6/740: mkdir da/d19/dc2/d3c/dfb 0 2023-12-09T02:35:21.237 INFO:tasks.workunit.client.1.smithi161.stdout:6/741: mknod da/d55/dea/cfc 0 2023-12-09T02:35:21.252 INFO:tasks.workunit.client.1.smithi161.stdout:6/742: dwrite da/fc [0,4194304] 0 2023-12-09T02:35:21.253 INFO:tasks.workunit.client.1.smithi161.stdout:6/743: link da/d55/d6d/cf8 da/d55/d6d/cfd 0 2023-12-09T02:35:21.272 INFO:tasks.workunit.client.1.smithi161.stdout:6/744: dwrite da/df/f99 [0,4194304] 0 2023-12-09T02:35:21.273 INFO:tasks.workunit.client.1.smithi161.stdout:6/745: link da/d55/d6d/dac/fb1 da/d19/dc2/d3c/d46/ffe 0 2023-12-09T02:35:21.273 INFO:tasks.workunit.client.1.smithi161.stdout:6/746: truncate da/df/f14 3217180 0 2023-12-09T02:35:21.273 INFO:tasks.workunit.client.1.smithi161.stdout:6/747: chown da/d19/dc2/fd5 127251 1 2023-12-09T02:35:21.275 INFO:tasks.workunit.client.1.smithi161.stdout:6/748: creat da/d55/d6d/d85/fff x:0 0 0 2023-12-09T02:35:21.275 INFO:tasks.workunit.client.1.smithi161.stdout:6/749: chown da/d19 155 1 2023-12-09T02:35:21.275 INFO:tasks.workunit.client.1.smithi161.stdout:6/750: write da/d19/dc2/d3c/d46/ffe [1050854,119120] 0 2023-12-09T02:35:21.277 INFO:tasks.workunit.client.1.smithi161.stdout:6/751: creat da/d19/dc2/d29/f100 x:0 0 0 2023-12-09T02:35:21.278 INFO:tasks.workunit.client.1.smithi161.stdout:6/752: symlink da/d19/dc2/d3c/d46/l101 0 2023-12-09T02:35:21.281 INFO:tasks.workunit.client.1.smithi161.stdout:6/753: link da/d19/dc2/d3c/d46/f87 da/d19/dc2/d29/d2b/d31/d33/f102 0 2023-12-09T02:35:21.282 INFO:tasks.workunit.client.1.smithi161.stdout:6/754: unlink da/d19/dc2/d9e/fe6 0 2023-12-09T02:35:21.283 INFO:tasks.workunit.client.1.smithi161.stdout:6/755: creat da/d19/dc2/dd2/f103 x:0 0 0 2023-12-09T02:35:21.284 INFO:tasks.workunit.client.1.smithi161.stdout:6/756: write da/d19/dc2/dd2/feb [137180,69699] 0 2023-12-09T02:35:21.309 INFO:tasks.workunit.client.1.smithi161.stdout:6/757: dwrite da/d19/dc2/d4d/fef [0,4194304] 0 2023-12-09T02:35:21.310 INFO:tasks.workunit.client.1.smithi161.stdout:6/758: write da/d19/dc2/d29/d2b/f97 [811091,2342] 0 2023-12-09T02:35:21.311 INFO:tasks.workunit.client.1.smithi161.stdout:6/759: mknod da/d19/dc2/d29/d2b/db4/dc0/c104 0 2023-12-09T02:35:21.313 INFO:tasks.workunit.client.1.smithi161.stdout:6/760: dread da/d55/d6d/d85/fb6 [0,4194304] 0 2023-12-09T02:35:21.314 INFO:tasks.workunit.client.1.smithi161.stdout:6/761: creat da/df/d2d/d3b/f105 x:0 0 0 2023-12-09T02:35:21.314 INFO:tasks.workunit.client.1.smithi161.stdout:6/762: chown da/d19/dc2/d3c/f91 6502561 1 2023-12-09T02:35:21.328 INFO:tasks.workunit.client.1.smithi161.stdout:6/763: dwrite da/d19/f1e [8388608,4194304] 0 2023-12-09T02:35:21.333 INFO:tasks.workunit.client.1.smithi161.stdout:6/764: write da/df/f14 [2571712,18586] 0 2023-12-09T02:35:21.340 INFO:tasks.workunit.client.1.smithi161.stdout:6/765: dread da/d19/dc2/d29/d2b/d31/f51 [0,4194304] 0 2023-12-09T02:35:21.343 INFO:tasks.workunit.client.1.smithi161.stdout:6/766: write da/df/d2d/d49/fcc [25167,115442] 0 2023-12-09T02:35:21.343 INFO:tasks.workunit.client.1.smithi161.stdout:6/767: readlink da/d55/d6d/dac/le5 0 2023-12-09T02:35:21.344 INFO:tasks.workunit.client.1.smithi161.stdout:6/768: truncate f9 403446 0 2023-12-09T02:35:21.353 INFO:tasks.workunit.client.1.smithi161.stdout:6/769: dread da/d19/dc2/d77/d79/f7a [4194304,4194304] 0 2023-12-09T02:35:21.353 INFO:tasks.workunit.client.1.smithi161.stdout:6/770: readlink da/df/d2d/d3b/dd4/lfa 0 2023-12-09T02:35:21.354 INFO:tasks.workunit.client.1.smithi161.stdout:6/771: truncate da/f76 298770 0 2023-12-09T02:35:21.364 INFO:tasks.workunit.client.1.smithi161.stdout:6/772: dread da/d19/dc2/d3c/d46/f7c [0,4194304] 0 2023-12-09T02:35:21.366 INFO:tasks.workunit.client.1.smithi161.stdout:6/773: creat da/d19/dc2/d29/d92/f106 x:0 0 0 2023-12-09T02:35:21.366 INFO:tasks.workunit.client.1.smithi161.stdout:6/774: chown da/d19/dc2/d3c/f90 72578214 1 2023-12-09T02:35:21.368 INFO:tasks.workunit.client.1.smithi161.stdout:6/775: link da/d19/dc2/d9e/lca da/d19/dc2/d29/d2b/db4/dc0/l107 0 2023-12-09T02:35:21.527 INFO:tasks.workunit.client.1.smithi161.stdout:8/693: sync 2023-12-09T02:35:21.543 INFO:tasks.workunit.client.1.smithi161.stdout:8/694: dwrite d2/d5/d22/d31/d38/f59 [0,4194304] 0 2023-12-09T02:35:21.547 INFO:tasks.workunit.client.1.smithi161.stdout:8/695: dread d2/d5/d22/d31/d38/f3b [0,4194304] 0 2023-12-09T02:35:21.729 INFO:tasks.workunit.client.1.smithi161.stdout:5/798: sync 2023-12-09T02:35:21.729 INFO:tasks.workunit.client.1.smithi161.stdout:0/682: sync 2023-12-09T02:35:21.729 INFO:tasks.workunit.client.1.smithi161.stdout:4/887: sync 2023-12-09T02:35:21.729 INFO:tasks.workunit.client.1.smithi161.stdout:1/859: sync 2023-12-09T02:35:21.733 INFO:tasks.workunit.client.1.smithi161.stdout:5/799: rename d0/d2/de/f89 to d0/d2/de/d22/d8e/d8f/f118 0 2023-12-09T02:35:21.733 INFO:tasks.workunit.client.1.smithi161.stdout:0/683: mknod d9/d55/d26/d28/d58/d8e/cd6 0 2023-12-09T02:35:21.733 INFO:tasks.workunit.client.1.smithi161.stdout:0/684: stat d9/d55/d7c 0 2023-12-09T02:35:21.733 INFO:tasks.workunit.client.1.smithi161.stdout:0/685: fdatasync d9/dd/f77 0 2023-12-09T02:35:21.733 INFO:tasks.workunit.client.1.smithi161.stdout:0/686: write d9/d55/d7c/f74 [1691844,41459] 0 2023-12-09T02:35:21.734 INFO:tasks.workunit.client.1.smithi161.stdout:5/800: creat d0/d2/d7/d51/f119 x:0 0 0 2023-12-09T02:35:21.735 INFO:tasks.workunit.client.1.smithi161.stdout:0/687: read d9/d55/d7c/f8f [1070349,20773] 0 2023-12-09T02:35:21.736 INFO:tasks.workunit.client.1.smithi161.stdout:5/801: dread d0/d2/d7/d11/f5d [0,4194304] 0 2023-12-09T02:35:21.738 INFO:tasks.workunit.client.1.smithi161.stdout:1/860: rename d6/d9/d8b/dba/c109 to d6/d8/d63/d4d/d31/d73/d47/db2/d10d/c115 0 2023-12-09T02:35:21.740 INFO:tasks.workunit.client.1.smithi161.stdout:4/888: dread dd/d36/d3f/d54/d102/d25/d4e/fb7 [0,4194304] 0 2023-12-09T02:35:21.743 INFO:tasks.workunit.client.1.smithi161.stdout:1/861: creat d6/d8/d63/d4d/d9f/d114/f116 x:0 0 0 2023-12-09T02:35:21.746 INFO:tasks.workunit.client.1.smithi161.stdout:4/889: creat dd/d36/d3f/d54/d102/d25/d3a/f125 x:0 0 0 2023-12-09T02:35:21.746 INFO:tasks.workunit.client.1.smithi161.stdout:4/890: write dd/d36/d3f/d54/d102/d25/d32/fc2 [848820,102662] 0 2023-12-09T02:35:21.749 INFO:tasks.workunit.client.1.smithi161.stdout:1/862: mknod d6/d8/d63/d4d/dd0/c117 0 2023-12-09T02:35:21.750 INFO:tasks.workunit.client.1.smithi161.stdout:4/891: mkdir dd/d1a/d23/d6a/d107/d126 0 2023-12-09T02:35:21.756 INFO:tasks.workunit.client.1.smithi161.stdout:1/863: rmdir d6/d8/d63/d61 0 2023-12-09T02:35:21.757 INFO:tasks.workunit.client.1.smithi161.stdout:4/892: dread dd/d36/d3f/d54/d102/d25/d4e/fb7 [0,4194304] 0 2023-12-09T02:35:21.757 INFO:tasks.workunit.client.1.smithi161.stdout:1/864: symlink d6/l118 0 2023-12-09T02:35:21.758 INFO:tasks.workunit.client.1.smithi161.stdout:4/893: symlink dd/d36/d3f/d54/d102/d25/d4e/dbb/l127 0 2023-12-09T02:35:21.758 INFO:tasks.workunit.client.1.smithi161.stdout:4/894: stat dd/d36/d3f/d54/d102/d25/c27 0 2023-12-09T02:35:21.759 INFO:tasks.workunit.client.1.smithi161.stdout:4/895: dread - dd/d36/d3f/d54/d102/d25/d32/dd0/f106 zero size 2023-12-09T02:35:21.760 INFO:tasks.workunit.client.1.smithi161.stdout:1/865: rmdir d6/d8/d63/d4d/d9f/ddc 39 2023-12-09T02:35:21.763 INFO:tasks.workunit.client.1.smithi161.stdout:1/866: truncate d6/d8/d63/d4d/d9f/fa0 2739478 0 2023-12-09T02:35:21.771 INFO:tasks.workunit.client.1.smithi161.stdout:1/867: dread d6/d8/d63/d1c/d8a/dcd/d9d/f10b [0,4194304] 0 2023-12-09T02:35:21.773 INFO:tasks.workunit.client.1.smithi161.stdout:1/868: creat d6/d49/f119 x:0 0 0 2023-12-09T02:35:21.773 INFO:tasks.workunit.client.1.smithi161.stdout:1/869: dread - d6/fef zero size 2023-12-09T02:35:21.773 INFO:tasks.workunit.client.1.smithi161.stdout:1/870: readlink d6/d8/d63/d93/l13 0 2023-12-09T02:35:21.773 INFO:tasks.workunit.client.1.smithi161.stdout:1/871: truncate d6/f101 93414 0 2023-12-09T02:35:21.773 INFO:tasks.workunit.client.1.smithi161.stdout:1/872: read - d6/d8/d63/d4d/d31/d73/d47/fca zero size 2023-12-09T02:35:21.773 INFO:tasks.workunit.client.1.smithi161.stdout:5/802: dwrite d0/d2/de/d22/d8e/d8f/dcd/f93 [0,4194304] 0 2023-12-09T02:35:21.775 INFO:tasks.workunit.client.1.smithi161.stdout:1/873: mknod d6/d8/d63/d93/df3/c11a 0 2023-12-09T02:35:21.781 INFO:tasks.workunit.client.1.smithi161.stdout:0/688: dwrite d9/dd/f77 [0,4194304] 0 2023-12-09T02:35:21.781 INFO:tasks.workunit.client.1.smithi161.stdout:0/689: chown d9/d55/d26/d28/d58/l90 859540 1 2023-12-09T02:35:21.782 INFO:tasks.workunit.client.1.smithi161.stdout:0/690: rmdir d9/d55/d44 39 2023-12-09T02:35:21.784 INFO:tasks.workunit.client.1.smithi161.stdout:4/896: dwrite dd/d36/d4a/f6f [0,4194304] 0 2023-12-09T02:35:21.784 INFO:tasks.workunit.client.1.smithi161.stdout:4/897: chown dd/d36/d3f/d54/d102/d25/d32/dd0/ddc/f124 3652109 1 2023-12-09T02:35:21.784 INFO:tasks.workunit.client.1.smithi161.stdout:4/898: chown dd/d36/d4a/d5f/dc7/d101/f11b 0 1 2023-12-09T02:35:21.785 INFO:tasks.workunit.client.1.smithi161.stdout:4/899: mknod dd/d36/d3f/d54/d102/d25/c128 0 2023-12-09T02:35:21.787 INFO:tasks.workunit.client.1.smithi161.stdout:0/691: getdents d9/d55/d44 0 2023-12-09T02:35:21.791 INFO:tasks.workunit.client.1.smithi161.stdout:0/692: creat d9/db/d2a/fd7 x:0 0 0 2023-12-09T02:35:21.792 INFO:tasks.workunit.client.1.smithi161.stdout:0/693: dread - d9/d55/d26/d28/d58/d8e/fab zero size 2023-12-09T02:35:21.793 INFO:tasks.workunit.client.1.smithi161.stdout:0/694: truncate d9/d55/d7c/f4e 320982 0 2023-12-09T02:35:21.793 INFO:tasks.workunit.client.1.smithi161.stdout:0/695: write d9/d55/d7c/f74 [2768435,21688] 0 2023-12-09T02:35:21.798 INFO:tasks.workunit.client.1.smithi161.stdout:0/696: mknod d9/db/d2a/d35/dc2/cd8 0 2023-12-09T02:35:21.801 INFO:tasks.workunit.client.1.smithi161.stdout:0/697: link d9/d55/d26/f57 d9/db/d2a/d9d/dba/d94/db6/fd9 0 2023-12-09T02:35:21.804 INFO:tasks.workunit.client.1.smithi161.stdout:0/698: mknod d9/d55/d44/cda 0 2023-12-09T02:35:21.804 INFO:tasks.workunit.client.1.smithi161.stdout:0/699: dread - d9/d55/d86/d98/fac zero size 2023-12-09T02:35:21.818 INFO:tasks.workunit.client.1.smithi161.stdout:5/803: dwrite d0/d2/d5f/fd1 [0,4194304] 0 2023-12-09T02:35:21.820 INFO:tasks.workunit.client.1.smithi161.stdout:5/804: symlink d0/d2/de/d22/d8e/l11a 0 2023-12-09T02:35:21.821 INFO:tasks.workunit.client.1.smithi161.stdout:0/700: dread d9/dd/f53 [0,4194304] 0 2023-12-09T02:35:21.821 INFO:tasks.workunit.client.1.smithi161.stdout:0/701: readlink d9/d55/d5a/db1/lb9 0 2023-12-09T02:35:21.822 INFO:tasks.workunit.client.1.smithi161.stdout:0/702: symlink d9/d55/d7c/d7a/ldb 0 2023-12-09T02:35:21.822 INFO:tasks.workunit.client.1.smithi161.stdout:0/703: write d9/d55/d26/d28/d58/f93 [504366,43868] 0 2023-12-09T02:35:21.828 INFO:tasks.workunit.client.1.smithi161.stdout:4/900: dwrite dd/d36/d4a/d5f/d65/f11e [0,4194304] 0 2023-12-09T02:35:21.828 INFO:tasks.workunit.client.1.smithi161.stdout:4/901: fdatasync dd/f18 0 2023-12-09T02:35:21.828 INFO:tasks.workunit.client.1.smithi161.stdout:4/902: fsync dd/d36/d3f/d54/d102/d25/d32/dd0/fdf 0 2023-12-09T02:35:21.828 INFO:tasks.workunit.client.1.smithi161.stdout:4/903: stat dd/d1a/d29/fc0 0 2023-12-09T02:35:21.828 INFO:tasks.workunit.client.1.smithi161.stdout:1/874: dwrite d6/d9/d8b/fc7 [0,4194304] 0 2023-12-09T02:35:21.833 INFO:tasks.workunit.client.1.smithi161.stdout:4/904: dread dd/d36/d3f/d54/d102/d25/d4e/fa6 [0,4194304] 0 2023-12-09T02:35:21.840 INFO:tasks.workunit.client.1.smithi161.stdout:1/875: rename d6/d8/d63/d4d/d9f/ddc/l7c to d6/d9/dd6/l11b 0 2023-12-09T02:35:21.843 INFO:tasks.workunit.client.1.smithi161.stdout:4/905: symlink dd/d1a/d23/d6a/l129 0 2023-12-09T02:35:21.843 INFO:tasks.workunit.client.1.smithi161.stdout:1/876: link d6/d8/l6c d6/d8/l11c 0 2023-12-09T02:35:21.845 INFO:tasks.workunit.client.1.smithi161.stdout:4/906: mknod dd/d36/d3f/d54/dff/c12a 0 2023-12-09T02:35:21.845 INFO:tasks.workunit.client.1.smithi161.stdout:4/907: write dd/d36/f74 [1569520,30845] 0 2023-12-09T02:35:21.845 INFO:tasks.workunit.client.1.smithi161.stdout:1/877: truncate d6/d8/d63/d4d/d9f/ddc/daa/f6b 1243706 0 2023-12-09T02:35:21.847 INFO:tasks.workunit.client.1.smithi161.stdout:4/908: creat dd/d36/d4a/d88/dcd/f12b x:0 0 0 2023-12-09T02:35:21.847 INFO:tasks.workunit.client.1.smithi161.stdout:4/909: chown dd/d1a/d1e/l24 1203007 1 2023-12-09T02:35:21.850 INFO:tasks.workunit.client.1.smithi161.stdout:1/878: mkdir d6/d8/d63/d4d/d11d 0 2023-12-09T02:35:21.850 INFO:tasks.workunit.client.1.smithi161.stdout:4/910: link dd/d1a/d23/d6a/c115 dd/d36/d4a/de8/c12c 0 2023-12-09T02:35:21.853 INFO:tasks.workunit.client.1.smithi161.stdout:1/879: truncate d6/d8/d63/d1c/f1e 692739 0 2023-12-09T02:35:21.853 INFO:tasks.workunit.client.1.smithi161.stdout:1/880: fdatasync d6/d8/d63/d4d/d31/d80/f108 0 2023-12-09T02:35:21.854 INFO:tasks.workunit.client.1.smithi161.stdout:4/911: symlink dd/d36/d4a/d5f/d65/l12d 0 2023-12-09T02:35:21.855 INFO:tasks.workunit.client.1.smithi161.stdout:4/912: write dd/d36/d3f/d54/d102/d25/f118 [592445,109462] 0 2023-12-09T02:35:21.856 INFO:tasks.workunit.client.1.smithi161.stdout:5/805: dwrite d0/d2/f57 [0,4194304] 0 2023-12-09T02:35:21.857 INFO:tasks.workunit.client.1.smithi161.stdout:1/881: symlink d6/d8/d68/df6/dff/l11e 0 2023-12-09T02:35:21.859 INFO:tasks.workunit.client.1.smithi161.stdout:4/913: mknod dd/d36/d3f/d54/d102/d25/d32/d75/deb/c12e 0 2023-12-09T02:35:21.863 INFO:tasks.workunit.client.1.smithi161.stdout:5/806: rename d0/l2f to d0/l11b 0 2023-12-09T02:35:21.864 INFO:tasks.workunit.client.1.smithi161.stdout:0/704: dwrite d9/d1f/f18 [0,4194304] 0 2023-12-09T02:35:21.864 INFO:tasks.workunit.client.1.smithi161.stdout:0/705: chown d9/db/d2a/d35/f89 517531045 1 2023-12-09T02:35:21.864 INFO:tasks.workunit.client.1.smithi161.stdout:0/706: chown d9/d55/d7c/f2d 4532976 1 2023-12-09T02:35:21.864 INFO:tasks.workunit.client.1.smithi161.stdout:0/707: chown d9/d55/d7c/f38 39702642 1 2023-12-09T02:35:21.864 INFO:tasks.workunit.client.1.smithi161.stdout:0/708: fsync d9/dd/fc5 0 2023-12-09T02:35:21.866 INFO:tasks.workunit.client.1.smithi161.stdout:1/882: truncate d6/d8/d63/d4d/d31/d73/f9b 141895 0 2023-12-09T02:35:21.867 INFO:tasks.workunit.client.1.smithi161.stdout:4/914: truncate dd/d1a/d1e/f11c 462596 0 2023-12-09T02:35:21.870 INFO:tasks.workunit.client.1.smithi161.stdout:1/883: chown d6/d8/d63/d93/l7d 1951 1 2023-12-09T02:35:21.870 INFO:tasks.workunit.client.1.smithi161.stdout:1/884: chown d6/f101 115 1 2023-12-09T02:35:21.871 INFO:tasks.workunit.client.1.smithi161.stdout:1/885: mknod d6/d8/d63/d4d/d9f/ddc/c11f 0 2023-12-09T02:35:21.874 INFO:tasks.workunit.client.1.smithi161.stdout:9/734: sync 2023-12-09T02:35:21.874 INFO:tasks.workunit.client.1.smithi161.stdout:7/687: sync 2023-12-09T02:35:21.875 INFO:tasks.workunit.client.1.smithi161.stdout:3/696: sync 2023-12-09T02:35:21.875 INFO:tasks.workunit.client.1.smithi161.stdout:6/776: sync 2023-12-09T02:35:21.875 INFO:tasks.workunit.client.1.smithi161.stdout:2/735: sync 2023-12-09T02:35:21.875 INFO:tasks.workunit.client.1.smithi161.stdout:8/696: sync 2023-12-09T02:35:21.875 INFO:tasks.workunit.client.1.smithi161.stdout:2/736: stat d4/d1a/f3c 0 2023-12-09T02:35:21.878 INFO:tasks.workunit.client.1.smithi161.stdout:7/688: mknod d0/d49/d67/d71/dc0/cdd 0 2023-12-09T02:35:21.883 INFO:tasks.workunit.client.1.smithi161.stdout:9/735: rename d2/f19 to d2/d25/db1/d65/d4f/df7/f104 0 2023-12-09T02:35:21.883 INFO:tasks.workunit.client.1.smithi161.stdout:9/736: fdatasync d2/d25/db1/d65/d7c/fd8 0 2023-12-09T02:35:21.885 INFO:tasks.workunit.client.1.smithi161.stdout:6/777: dread da/d55/d6d/dac/fb1 [0,4194304] 0 2023-12-09T02:35:21.885 INFO:tasks.workunit.client.1.smithi161.stdout:6/778: truncate da/d19/dc2/d29/d2b/d31/d33/f102 411190 0 2023-12-09T02:35:21.885 INFO:tasks.workunit.client.1.smithi161.stdout:3/697: mknod d2/d51/dc0/ccb 0 2023-12-09T02:35:21.885 INFO:tasks.workunit.client.1.smithi161.stdout:3/698: write d2/d51/d75/d11/d1f/d4c/f5b [373912,128737] 0 2023-12-09T02:35:21.886 INFO:tasks.workunit.client.1.smithi161.stdout:2/737: mknod d4/d1a/d4a/cf4 0 2023-12-09T02:35:21.887 INFO:tasks.workunit.client.1.smithi161.stdout:2/738: readlink d4/d16/la2 0 2023-12-09T02:35:21.888 INFO:tasks.workunit.client.1.smithi161.stdout:8/697: getdents d2/d5/d4f/db2/da9 0 2023-12-09T02:35:21.892 INFO:tasks.workunit.client.1.smithi161.stdout:2/739: write d4/f17 [177269,34962] 0 2023-12-09T02:35:21.893 INFO:tasks.workunit.client.1.smithi161.stdout:2/740: write d4/d16/fee [368108,97472] 0 2023-12-09T02:35:21.897 INFO:tasks.workunit.client.1.smithi161.stdout:8/698: write d2/d5/d22/d54/f91 [2425172,109622] 0 2023-12-09T02:35:21.898 INFO:tasks.workunit.client.1.smithi161.stdout:8/699: dread - d2/d5/d22/fbf zero size 2023-12-09T02:35:21.898 INFO:tasks.workunit.client.1.smithi161.stdout:9/737: creat d2/d25/db1/d65/d5c/d55/d66/f105 x:0 0 0 2023-12-09T02:35:21.903 INFO:tasks.workunit.client.1.smithi161.stdout:6/779: unlink da/d19/dc2/d77/d79/f7a 0 2023-12-09T02:35:21.905 INFO:tasks.workunit.client.1.smithi161.stdout:5/807: dwrite d0/d2/de/d22/d8e/d8f/dcd/fc7 [4194304,4194304] 0 2023-12-09T02:35:21.909 INFO:tasks.workunit.client.1.smithi161.stdout:2/741: rename d4/d7/f31 to d4/d7/d8f/ff5 0 2023-12-09T02:35:21.909 INFO:tasks.workunit.client.1.smithi161.stdout:5/808: write d0/d2/d7/d51/f71 [3711795,76319] 0 2023-12-09T02:35:21.912 INFO:tasks.workunit.client.1.smithi161.stdout:9/738: mknod d2/d25/db1/d65/d4f/c106 0 2023-12-09T02:35:21.913 INFO:tasks.workunit.client.1.smithi161.stdout:6/780: dread da/d19/dc2/d29/d92/fa2 [0,4194304] 0 2023-12-09T02:35:21.915 INFO:tasks.workunit.client.1.smithi161.stdout:2/742: mkdir d4/d16/de0/df6 0 2023-12-09T02:35:21.917 INFO:tasks.workunit.client.1.smithi161.stdout:0/709: dwrite d9/d55/d86/d98/fac [0,4194304] 0 2023-12-09T02:35:21.917 INFO:tasks.workunit.client.1.smithi161.stdout:0/710: fdatasync d9/dd/fc5 0 2023-12-09T02:35:21.917 INFO:tasks.workunit.client.1.smithi161.stdout:5/809: mkdir d0/d2/d7/df/d11c 0 2023-12-09T02:35:21.919 INFO:tasks.workunit.client.1.smithi161.stdout:9/739: getdents d2/d25/db1/d65/d42/d58/d91/d2e 0 2023-12-09T02:35:21.919 INFO:tasks.workunit.client.1.smithi161.stdout:5/810: read d0/d2/de/d44/dff/de5/ff2 [300446,41728] 0 2023-12-09T02:35:21.919 INFO:tasks.workunit.client.1.smithi161.stdout:5/811: stat d0/d2/d7/d11/d50/dfb/f113 0 2023-12-09T02:35:21.919 INFO:tasks.workunit.client.1.smithi161.stdout:9/740: write d2/d25/db1/d65/d5c/d60/fd4 [567301,77067] 0 2023-12-09T02:35:21.919 INFO:tasks.workunit.client.1.smithi161.stdout:9/741: write d2/d25/db1/d65/d42/d58/d91/d51/ffe [30082,2777] 0 2023-12-09T02:35:21.920 INFO:tasks.workunit.client.1.smithi161.stdout:6/781: creat da/d19/dc2/d3c/d46/f108 x:0 0 0 2023-12-09T02:35:21.925 INFO:tasks.workunit.client.1.smithi161.stdout:8/700: dwrite d2/d5/d4f/f2a [0,4194304] 0 2023-12-09T02:35:21.925 INFO:tasks.workunit.client.1.smithi161.stdout:1/886: dwrite d6/d9/d8b/dba/dd2/f10c [0,4194304] 0 2023-12-09T02:35:21.926 INFO:tasks.workunit.client.1.smithi161.stdout:0/711: write d9/db/d2a/d35/f91 [557504,27833] 0 2023-12-09T02:35:21.927 INFO:tasks.workunit.client.1.smithi161.stdout:4/915: dwrite dd/d1a/d23/d6a/fac [0,4194304] 0 2023-12-09T02:35:21.927 INFO:tasks.workunit.client.1.smithi161.stdout:4/916: chown dd/d36/d4a/d88/d8a/db3 14 1 2023-12-09T02:35:21.927 INFO:tasks.workunit.client.1.smithi161.stdout:4/917: fsync dd/d36/d3f/fa4 0 2023-12-09T02:35:21.928 INFO:tasks.workunit.client.1.smithi161.stdout:9/742: creat d2/d25/db1/d65/d42/d58/d91/dd0/f107 x:0 0 0 2023-12-09T02:35:21.928 INFO:tasks.workunit.client.1.smithi161.stdout:9/743: chown d2/d25/db1/d65/d5c/d55/d66/fbc 0 1 2023-12-09T02:35:21.929 INFO:tasks.workunit.client.1.smithi161.stdout:6/782: write da/d19/f23 [1177932,76899] 0 2023-12-09T02:35:21.941 INFO:tasks.workunit.client.1.smithi161.stdout:0/712: dread d9/d55/d7c/f73 [0,4194304] 0 2023-12-09T02:35:21.945 INFO:tasks.workunit.client.1.smithi161.stdout:9/744: dread d2/d25/db1/d65/d42/d58/d91/d2e/d80/d103/dd1/ff0 [0,4194304] 0 2023-12-09T02:35:21.945 INFO:tasks.workunit.client.1.smithi161.stdout:6/783: dread da/f1a [0,4194304] 0 2023-12-09T02:35:21.947 INFO:tasks.workunit.client.1.smithi161.stdout:9/745: write d2/d25/db1/d4d/f67 [5674117,119842] 0 2023-12-09T02:35:21.949 INFO:tasks.workunit.client.1.smithi161.stdout:1/887: symlink d6/d8/d63/d4d/d9f/ddc/d3d/dc3/l120 0 2023-12-09T02:35:21.949 INFO:tasks.workunit.client.1.smithi161.stdout:1/888: read - d6/d8/d63/d4d/d9f/ddc/daa/fe7 zero size 2023-12-09T02:35:21.956 INFO:tasks.workunit.client.1.smithi161.stdout:4/918: mknod dd/d36/d4a/d5f/d65/df9/ddb/c12f 0 2023-12-09T02:35:21.957 INFO:tasks.workunit.client.1.smithi161.stdout:4/919: dread dd/d36/fbd [0,4194304] 0 2023-12-09T02:35:21.957 INFO:tasks.workunit.client.1.smithi161.stdout:4/920: write dd/d36/d3f/d54/d102/d25/d32/f41 [4883899,4509] 0 2023-12-09T02:35:21.962 INFO:tasks.workunit.client.1.smithi161.stdout:6/784: creat da/d55/d6d/df2/f109 x:0 0 0 2023-12-09T02:35:21.965 INFO:tasks.workunit.client.1.smithi161.stdout:0/713: dread d9/d55/d26/d28/d58/f8a [0,4194304] 0 2023-12-09T02:35:21.966 INFO:tasks.workunit.client.1.smithi161.stdout:1/889: creat d6/d8/d63/d4d/d31/d73/f121 x:0 0 0 2023-12-09T02:35:21.967 INFO:tasks.workunit.client.1.smithi161.stdout:1/890: write d6/d8/d63/d4d/d9f/ddc/d3d/d75/fec [257269,110876] 0 2023-12-09T02:35:21.967 INFO:tasks.workunit.client.1.smithi161.stdout:5/812: dwrite d0/d2/de/d22/d8e/d8f/dcd/f6e [0,4194304] 0 2023-12-09T02:35:21.967 INFO:tasks.workunit.client.1.smithi161.stdout:2/743: dwrite d4/d16/d69/d7b/fc4 [0,4194304] 0 2023-12-09T02:35:21.967 INFO:tasks.workunit.client.1.smithi161.stdout:5/813: read d0/d2/d7/d11/f5d [912636,124937] 0 2023-12-09T02:35:21.967 INFO:tasks.workunit.client.1.smithi161.stdout:5/814: write d0/d2/de/d22/d8e/fd8 [948746,121326] 0 2023-12-09T02:35:21.967 INFO:tasks.workunit.client.1.smithi161.stdout:5/815: truncate d0/d2/de/d22/fa3 1140170 0 2023-12-09T02:35:21.968 INFO:tasks.workunit.client.1.smithi161.stdout:9/746: dwrite d2/d25/db1/fa0 [0,4194304] 0 2023-12-09T02:35:21.968 INFO:tasks.workunit.client.1.smithi161.stdout:4/921: rename dd/d1a/c7a to dd/d36/d4a/d88/d8a/c130 0 2023-12-09T02:35:21.971 INFO:tasks.workunit.client.1.smithi161.stdout:6/785: creat da/d19/dc2/d3c/db8/f10a x:0 0 0 2023-12-09T02:35:21.971 INFO:tasks.workunit.client.1.smithi161.stdout:6/786: chown da/l22 5 1 2023-12-09T02:35:21.973 INFO:tasks.workunit.client.1.smithi161.stdout:0/714: creat d9/d1f/dd4/fdc x:0 0 0 2023-12-09T02:35:21.974 INFO:tasks.workunit.client.1.smithi161.stdout:1/891: symlink d6/d8/l122 0 2023-12-09T02:35:21.974 INFO:tasks.workunit.client.1.smithi161.stdout:1/892: read - d6/d8/d63/d4d/d31/d73/d47/d102/fcf zero size 2023-12-09T02:35:21.979 INFO:tasks.workunit.client.1.smithi161.stdout:2/744: creat d4/da6/dc8/ff7 x:0 0 0 2023-12-09T02:35:21.983 INFO:tasks.workunit.client.1.smithi161.stdout:5/816: mknod d0/d2/d7/d11/d50/d8a/ded/c11d 0 2023-12-09T02:35:21.986 INFO:tasks.workunit.client.1.smithi161.stdout:9/747: truncate d2/d25/db1/d65/d42/d58/d91/d2e/d80/d103/fab 2431322 0 2023-12-09T02:35:21.986 INFO:tasks.workunit.client.1.smithi161.stdout:9/748: write d2/d25/db1/d65/d42/d58/d91/d51/ffe [59833,128277] 0 2023-12-09T02:35:21.987 INFO:tasks.workunit.client.1.smithi161.stdout:9/749: write d2/d25/db1/d65/d63/f9e [73833,56319] 0 2023-12-09T02:35:21.987 INFO:tasks.workunit.client.1.smithi161.stdout:4/922: getdents dd/d36/d3f/d54/d102/d25/d4e 0 2023-12-09T02:35:21.987 INFO:tasks.workunit.client.1.smithi161.stdout:4/923: chown dd/d36/d3f/fb1 599 1 2023-12-09T02:35:21.987 INFO:tasks.workunit.client.1.smithi161.stdout:4/924: dread - dd/d36/d3f/d54/d102/d25/d32/dd0/f123 zero size 2023-12-09T02:35:21.990 INFO:tasks.workunit.client.1.smithi161.stdout:6/787: mknod da/df/c10b 0 2023-12-09T02:35:21.993 INFO:tasks.workunit.client.1.smithi161.stdout:0/715: symlink d9/dd/d3a/ldd 0 2023-12-09T02:35:21.994 INFO:tasks.workunit.client.1.smithi161.stdout:1/893: dwrite d6/d8/d63/d1c/d8a/dcd/d9d/f10b [0,4194304] 0 2023-12-09T02:35:21.995 INFO:tasks.workunit.client.1.smithi161.stdout:2/745: creat d4/d7/ff8 x:0 0 0 2023-12-09T02:35:21.999 INFO:tasks.workunit.client.1.smithi161.stdout:5/817: rename d0/d2/de/d44/dff/lca to d0/d2/d7/d11/d50/d8a/ded/l11e 0 2023-12-09T02:35:22.006 INFO:tasks.workunit.client.1.smithi161.stdout:4/925: mkdir dd/d36/d4a/d88/d8a/db3/d131 0 2023-12-09T02:35:22.006 INFO:tasks.workunit.client.1.smithi161.stdout:4/926: stat dd/d36/d3f/fa4 0 2023-12-09T02:35:22.010 INFO:tasks.workunit.client.1.smithi161.stdout:5/818: dread d0/d2/de/d44/ddd/f10b [0,4194304] 0 2023-12-09T02:35:22.010 INFO:tasks.workunit.client.1.smithi161.stdout:5/819: chown d0/d2/de/d44/fd0 171578575 1 2023-12-09T02:35:22.010 INFO:tasks.workunit.client.1.smithi161.stdout:0/716: mknod d9/d55/d7c/cde 0 2023-12-09T02:35:22.013 INFO:tasks.workunit.client.1.smithi161.stdout:5/820: dread d0/d2/de/d22/d8e/d8f/fb1 [0,4194304] 0 2023-12-09T02:35:22.017 INFO:tasks.workunit.client.1.smithi161.stdout:0/717: write d9/db/f84 [1755145,84848] 0 2023-12-09T02:35:22.021 INFO:tasks.workunit.client.1.smithi161.stdout:2/746: link d4/d7/f15 d4/d16/d69/ff9 0 2023-12-09T02:35:22.021 INFO:tasks.workunit.client.1.smithi161.stdout:2/747: chown d4/d7/db/c32 2128717927 1 2023-12-09T02:35:22.023 INFO:tasks.workunit.client.1.smithi161.stdout:4/927: dread f9 [0,4194304] 0 2023-12-09T02:35:22.024 INFO:tasks.workunit.client.1.smithi161.stdout:0/718: mkdir d9/d55/d44/ddf 0 2023-12-09T02:35:22.025 INFO:tasks.workunit.client.1.smithi161.stdout:0/719: chown f7 63438583 1 2023-12-09T02:35:22.025 INFO:tasks.workunit.client.1.smithi161.stdout:0/720: write d9/dd/fc5 [4608168,19624] 0 2023-12-09T02:35:22.025 INFO:tasks.workunit.client.1.smithi161.stdout:0/721: chown d9/d55/d7c/d7a/ldb 1047 1 2023-12-09T02:35:22.027 INFO:tasks.workunit.client.1.smithi161.stdout:2/748: rename d4/d16/d69/d7b/l95 to d4/da6/de6/lfa 0 2023-12-09T02:35:22.030 INFO:tasks.workunit.client.1.smithi161.stdout:0/722: mkdir d9/d9c/de0 0 2023-12-09T02:35:22.031 INFO:tasks.workunit.client.1.smithi161.stdout:0/723: getdents d9/db/d2a/d9d/dba/d94/db6 0 2023-12-09T02:35:22.039 INFO:tasks.workunit.client.1.smithi161.stdout:4/928: dread dd/d36/d3f/fa4 [0,4194304] 0 2023-12-09T02:35:22.039 INFO:tasks.workunit.client.1.smithi161.stdout:4/929: chown dd/d36/d3f/d54/d102/d25/d3a/l10e 3 1 2023-12-09T02:35:22.040 INFO:tasks.workunit.client.1.smithi161.stdout:4/930: symlink dd/d36/d4a/d88/l132 0 2023-12-09T02:35:22.040 INFO:tasks.workunit.client.1.smithi161.stdout:4/931: chown dd/d36/d3f/d54/d102/d25/d3a/l50 2858323 1 2023-12-09T02:35:22.040 INFO:tasks.workunit.client.1.smithi161.stdout:4/932: stat dd/d36/d4a/d5f/d65/df9/dd2/fed 0 2023-12-09T02:35:22.040 INFO:tasks.workunit.client.1.smithi161.stdout:4/933: fsync dd/d1a/d23/d6a/fac 0 2023-12-09T02:35:22.042 INFO:tasks.workunit.client.1.smithi161.stdout:2/749: dread d4/d1a/d4a/d6d/f7a [0,4194304] 0 2023-12-09T02:35:22.042 INFO:tasks.workunit.client.1.smithi161.stdout:2/750: chown d4/d7/l39 137194 1 2023-12-09T02:35:22.042 INFO:tasks.workunit.client.1.smithi161.stdout:2/751: truncate d4/d16/d69/d8c/fbf 489728 0 2023-12-09T02:35:22.042 INFO:tasks.workunit.client.1.smithi161.stdout:4/934: rename dd/d36/d3f/d54/d102/d25/d3a/fd8 to dd/d36/d4a/d88/d8a/db3/d131/f133 0 2023-12-09T02:35:22.043 INFO:tasks.workunit.client.1.smithi161.stdout:2/752: link d4/d7/db/f67 d4/d16/d69/d8c/d87/ffb 0 2023-12-09T02:35:22.045 INFO:tasks.workunit.client.1.smithi161.stdout:4/935: symlink dd/d36/d3f/l134 0 2023-12-09T02:35:22.047 INFO:tasks.workunit.client.1.smithi161.stdout:4/936: rename dd/c11 to dd/d36/d3f/d54/d102/d25/d32/d58/c135 0 2023-12-09T02:35:22.048 INFO:tasks.workunit.client.1.smithi161.stdout:4/937: rename dd/d1a/d23/de9/l10f to dd/d36/d3f/d54/d102/l136 0 2023-12-09T02:35:22.049 INFO:tasks.workunit.client.1.smithi161.stdout:6/788: dwrite da/d55/d6d/d85/f73 [0,4194304] 0 2023-12-09T02:35:22.049 INFO:tasks.workunit.client.1.smithi161.stdout:9/750: dwrite d2/d25/db1/d65/d42/d58/d91/d2e/d80/fa2 [0,4194304] 0 2023-12-09T02:35:22.049 INFO:tasks.workunit.client.1.smithi161.stdout:9/751: read d2/d25/db1/d65/fa8 [1992859,13648] 0 2023-12-09T02:35:22.050 INFO:tasks.workunit.client.1.smithi161.stdout:5/821: dwrite d0/d2/d7/d11/f4c [0,4194304] 0 2023-12-09T02:35:22.050 INFO:tasks.workunit.client.1.smithi161.stdout:1/894: dwrite d6/d8/d63/d4d/d9f/ddc/daa/fe7 [0,4194304] 0 2023-12-09T02:35:22.050 INFO:tasks.workunit.client.1.smithi161.stdout:4/938: rename dd/d1a/d1e/c9c to dd/d36/d3f/d54/d102/c137 0 2023-12-09T02:35:22.053 INFO:tasks.workunit.client.1.smithi161.stdout:0/724: dwrite d9/f62 [0,4194304] 0 2023-12-09T02:35:22.053 INFO:tasks.workunit.client.1.smithi161.stdout:0/725: chown d9/dd/f77 15 1 2023-12-09T02:35:22.053 INFO:tasks.workunit.client.1.smithi161.stdout:0/726: stat d9/d55/d7c/lb5 0 2023-12-09T02:35:22.053 INFO:tasks.workunit.client.1.smithi161.stdout:0/727: write d9/d55/d26/d28/d58/f93 [861797,104621] 0 2023-12-09T02:35:22.055 INFO:tasks.workunit.client.1.smithi161.stdout:6/789: creat da/d19/f10c x:0 0 0 2023-12-09T02:35:22.108 INFO:tasks.workunit.client.1.smithi161.stdout:5/822: dwrite d0/d2/f3 [4194304,4194304] 0 2023-12-09T02:35:22.108 INFO:tasks.workunit.client.1.smithi161.stdout:5/823: readlink d0/d2/de/d22/d8e/d8f/dcd/d83/la4 0 2023-12-09T02:35:22.109 INFO:tasks.workunit.client.1.smithi161.stdout:9/752: mkdir d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/dc8/d108 0 2023-12-09T02:35:22.113 INFO:tasks.workunit.client.1.smithi161.stdout:1/895: unlink d6/d8/d63/d4d/d9f/ddc/d3d/dc3/f82 0 2023-12-09T02:35:22.113 INFO:tasks.workunit.client.1.smithi161.stdout:1/896: readlink d6/l118 0 2023-12-09T02:35:22.113 INFO:tasks.workunit.client.1.smithi161.stdout:2/753: dwrite d4/d16/d69/d8c/fb2 [0,4194304] 0 2023-12-09T02:35:22.113 INFO:tasks.workunit.client.1.smithi161.stdout:2/754: chown d4/d7/f15 117 1 2023-12-09T02:35:22.117 INFO:tasks.workunit.client.1.smithi161.stdout:4/939: mknod dd/d36/d3f/d54/d102/d25/d32/d58/c138 0 2023-12-09T02:35:22.117 INFO:tasks.workunit.client.1.smithi161.stdout:4/940: chown dd/d36/d3f/d54/d102/d25/f80 4144 1 2023-12-09T02:35:22.135 INFO:tasks.workunit.client.1.smithi161.stdout:0/728: getdents d9/d55/d26/d28/daa 0 2023-12-09T02:35:22.135 INFO:tasks.workunit.client.1.smithi161.stdout:1/897: dwrite d6/d8/d63/d4d/d31/fbf [0,4194304] 0 2023-12-09T02:35:22.135 INFO:tasks.workunit.client.1.smithi161.stdout:1/898: fsync d6/d8/d63/d4d/d9f/ddc/d3d/f96 0 2023-12-09T02:35:22.135 INFO:tasks.workunit.client.1.smithi161.stdout:1/899: fsync d6/d8/d63/d4d/d31/d73/d47/d102/f8c 0 2023-12-09T02:35:22.136 INFO:tasks.workunit.client.1.smithi161.stdout:6/790: rmdir da/df/d2d/d49 39 2023-12-09T02:35:22.137 INFO:tasks.workunit.client.1.smithi161.stdout:5/824: unlink d0/d2/de/d44/fd0 0 2023-12-09T02:35:22.138 INFO:tasks.workunit.client.1.smithi161.stdout:5/825: dread - d0/d2/de/d22/d8e/d8f/fa1 zero size 2023-12-09T02:35:22.139 INFO:tasks.workunit.client.1.smithi161.stdout:5/826: write d0/d2/de/d22/d8e/fd8 [132479,52069] 0 2023-12-09T02:35:22.141 INFO:tasks.workunit.client.1.smithi161.stdout:9/753: symlink d2/d25/db1/d65/d42/d58/d91/d2e/d80/d103/dd1/l109 0 2023-12-09T02:35:22.144 INFO:tasks.workunit.client.1.smithi161.stdout:2/755: rename d4/d7/c96 to d4/da6/dc8/dea/cfc 0 2023-12-09T02:35:22.145 INFO:tasks.workunit.client.1.smithi161.stdout:4/941: mknod dd/d36/d3f/d54/d102/d25/d32/d58/c139 0 2023-12-09T02:35:22.146 INFO:tasks.workunit.client.1.smithi161.stdout:0/729: symlink d9/d9c/le1 0 2023-12-09T02:35:22.149 INFO:tasks.workunit.client.1.smithi161.stdout:5/827: getdents d0/d2/de/d22/d55 0 2023-12-09T02:35:22.152 INFO:tasks.workunit.client.1.smithi161.stdout:1/900: dwrite d6/d49/f94 [0,4194304] 0 2023-12-09T02:35:22.152 INFO:tasks.workunit.client.1.smithi161.stdout:1/901: chown d6/d9/d8b/lc0 54612954 1 2023-12-09T02:35:22.153 INFO:tasks.workunit.client.1.smithi161.stdout:9/754: link d2/c3b d2/d25/db1/d65/d5c/d60/c10a 0 2023-12-09T02:35:22.154 INFO:tasks.workunit.client.1.smithi161.stdout:6/791: rename da/d19/dc2/d4d/d5e/de8 to da/df/d2d/d3b/d10d 0 2023-12-09T02:35:22.155 INFO:tasks.workunit.client.1.smithi161.stdout:4/942: mkdir dd/d36/d4a/d88/d8a/db3/d131/d13a 0 2023-12-09T02:35:22.155 INFO:tasks.workunit.client.1.smithi161.stdout:4/943: fsync dd/d36/d4a/d88/d8a/db3/fde 0 2023-12-09T02:35:22.156 INFO:tasks.workunit.client.1.smithi161.stdout:5/828: creat d0/d2/de/d44/ddd/f11f x:0 0 0 2023-12-09T02:35:22.156 INFO:tasks.workunit.client.1.smithi161.stdout:5/829: read - d0/f116 zero size 2023-12-09T02:35:22.158 INFO:tasks.workunit.client.1.smithi161.stdout:1/902: mkdir d6/d8/d63/d1c/d8a/dcd/d123 0 2023-12-09T02:35:22.161 INFO:tasks.workunit.client.1.smithi161.stdout:0/730: rename d9/db/c36 to d9/d55/d7c/d7a/da3/ce2 0 2023-12-09T02:35:22.162 INFO:tasks.workunit.client.1.smithi161.stdout:6/792: mknod da/d19/dc2/d29/d2b/db4/c10e 0 2023-12-09T02:35:22.162 INFO:tasks.workunit.client.1.smithi161.stdout:6/793: chown da/d19/dc2/d3c/d46 0 1 2023-12-09T02:35:22.163 INFO:tasks.workunit.client.1.smithi161.stdout:2/756: dwrite d4/d16/d69/d8c/d87/fa4 [0,4194304] 0 2023-12-09T02:35:22.165 INFO:tasks.workunit.client.1.smithi161.stdout:4/944: getdents dd/d36/d4a/d88 0 2023-12-09T02:35:22.166 INFO:tasks.workunit.client.1.smithi161.stdout:5/830: rmdir d0/d2/d5f 39 2023-12-09T02:35:22.168 INFO:tasks.workunit.client.1.smithi161.stdout:1/903: creat d6/d8/d63/d4d/d9f/ddc/d3d/dc3/f124 x:0 0 0 2023-12-09T02:35:22.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:21 smithi161 ceph-mon[121170]: mgrmap e25: smithi161.qmxtmg(active, since 7s), standbys: smithi088.jwlofb 2023-12-09T02:35:22.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:21 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mgr metadata", "who": "smithi088.jwlofb", "id": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:35:22.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:21 smithi161 ceph-mon[121170]: pgmap v7: 65 pgs: 65 active+clean; 2.3 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 64 MiB/s rd, 120 MiB/s wr, 261 op/s 2023-12-09T02:35:22.172 INFO:tasks.workunit.client.1.smithi161.stdout:9/755: rename d2/d25/db1/d65/d42/d58/d91/df1 to d2/d25/db1/d65/d42/d10b 0 2023-12-09T02:35:22.172 INFO:tasks.workunit.client.1.smithi161.stdout:9/756: fdatasync d2/d25/db1/d65/fe6 0 2023-12-09T02:35:22.176 INFO:tasks.workunit.client.1.smithi161.stdout:2/757: dread d4/d16/d69/d8c/ddf/f71 [0,4194304] 0 2023-12-09T02:35:22.177 INFO:tasks.workunit.client.1.smithi161.stdout:6/794: dread da/d19/dc2/d77/f9a [0,4194304] 0 2023-12-09T02:35:22.177 INFO:tasks.workunit.client.1.smithi161.stdout:6/795: dread - da/d55/dea/ff9 zero size 2023-12-09T02:35:22.178 INFO:tasks.workunit.client.1.smithi161.stdout:0/731: getdents d9/db/d2a/d9d 0 2023-12-09T02:35:22.183 INFO:tasks.workunit.client.1.smithi161.stdout:1/904: dwrite d6/d8/d63/d4d/f4c [4194304,4194304] 0 2023-12-09T02:35:22.183 INFO:tasks.workunit.client.1.smithi161.stdout:1/905: stat d6/d8/d63/d4d/d31/d80/fdd 0 2023-12-09T02:35:22.184 INFO:tasks.workunit.client.1.smithi161.stdout:4/945: mkdir dd/d36/d3f/d54/d102/d25/d4e/dbb/d13b 0 2023-12-09T02:35:22.189 INFO:tasks.workunit.client.1.smithi161.stdout:5/831: creat d0/d2/d7/d11/d61/d107/f120 x:0 0 0 2023-12-09T02:35:22.192 INFO:tasks.workunit.client.1.smithi161.stdout:9/757: symlink d2/d25/db1/d65/d42/d58/d91/d2e/d3f/l10c 0 2023-12-09T02:35:22.197 INFO:tasks.workunit.client.1.smithi161.stdout:2/758: getdents d4/d7/db 0 2023-12-09T02:35:22.197 INFO:tasks.workunit.client.1.smithi161.stdout:2/759: dread - d4/d16/d69/d8c/ff0 zero size 2023-12-09T02:35:22.199 INFO:tasks.workunit.client.1.smithi161.stdout:1/906: dwrite d6/d8/f30 [0,4194304] 0 2023-12-09T02:35:22.201 INFO:tasks.workunit.client.1.smithi161.stdout:6/796: mknod da/d19/dc2/c10f 0 2023-12-09T02:35:22.209 INFO:tasks.workunit.client.1.smithi161.stdout:5/832: stat d0/d2/d7/d11/d50/d8a/cc5 0 2023-12-09T02:35:22.211 INFO:tasks.workunit.client.1.smithi161.stdout:9/758: rmdir d2/d25/dbf 39 2023-12-09T02:35:22.215 INFO:tasks.workunit.client.1.smithi161.stdout:1/907: getdents d6/d8/d63/d1c/d8a 0 2023-12-09T02:35:22.215 INFO:tasks.workunit.client.1.smithi161.stdout:1/908: write d6/d9/ff5 [768259,89584] 0 2023-12-09T02:35:22.217 INFO:tasks.workunit.client.1.smithi161.stdout:6/797: creat da/d55/f110 x:0 0 0 2023-12-09T02:35:22.218 INFO:tasks.workunit.client.1.smithi161.stdout:6/798: dread - da/d19/dc2/d4d/fa8 zero size 2023-12-09T02:35:22.218 INFO:tasks.workunit.client.1.smithi161.stdout:0/732: mkdir d9/db/d2a/d35/de3 0 2023-12-09T02:35:22.218 INFO:tasks.workunit.client.1.smithi161.stdout:0/733: truncate d9/d55/d7c/f38 4240510 0 2023-12-09T02:35:22.220 INFO:tasks.workunit.client.1.smithi161.stdout:0/734: dread d9/d55/d7c/f2d [0,4194304] 0 2023-12-09T02:35:22.221 INFO:tasks.workunit.client.1.smithi161.stdout:5/833: mknod d0/d2/de/d22/d8e/c121 0 2023-12-09T02:35:22.222 INFO:tasks.workunit.client.1.smithi161.stdout:9/759: creat d2/d25/db1/d65/d42/d58/d91/d2e/d3f/f10d x:0 0 0 2023-12-09T02:35:22.223 INFO:tasks.workunit.client.1.smithi161.stdout:2/760: dwrite d4/d16/f49 [4194304,4194304] 0 2023-12-09T02:35:22.225 INFO:tasks.workunit.client.1.smithi161.stdout:1/909: creat d6/d8/d63/d4d/d31/d73/d47/db2/d10d/f125 x:0 0 0 2023-12-09T02:35:22.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:21 smithi088 ceph-mon[112028]: mgrmap e25: smithi161.qmxtmg(active, since 7s), standbys: smithi088.jwlofb 2023-12-09T02:35:22.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:21 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mgr metadata", "who": "smithi088.jwlofb", "id": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:35:22.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:21 smithi088 ceph-mon[112028]: pgmap v7: 65 pgs: 65 active+clean; 2.3 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 64 MiB/s rd, 120 MiB/s wr, 261 op/s 2023-12-09T02:35:22.227 INFO:tasks.workunit.client.1.smithi161.stdout:6/799: mknod da/df/d2d/d49/c111 0 2023-12-09T02:35:22.227 INFO:tasks.workunit.client.1.smithi161.stdout:6/800: truncate da/d19/dc2/dd2/f103 86386 0 2023-12-09T02:35:22.227 INFO:tasks.workunit.client.1.smithi161.stdout:6/801: stat da/df/fd6 0 2023-12-09T02:35:22.228 INFO:tasks.workunit.client.1.smithi161.stdout:4/946: link dd/d1a/d23/c91 dd/d1a/d23/c13c 0 2023-12-09T02:35:22.229 INFO:tasks.workunit.client.1.smithi161.stdout:4/947: write dd/d36/d4a/d88/d8a/fe1 [101012,58343] 0 2023-12-09T02:35:22.231 INFO:tasks.workunit.client.1.smithi161.stdout:5/834: symlink d0/d2/d7/d11/d50/dfb/l122 0 2023-12-09T02:35:22.234 INFO:tasks.workunit.client.1.smithi161.stdout:1/910: dread d6/d8/d63/d4d/d9f/ddc/f3c [4194304,4194304] 0 2023-12-09T02:35:22.234 INFO:tasks.workunit.client.1.smithi161.stdout:9/760: creat d2/d25/db1/d65/d88/dcb/ddf/de5/f10e x:0 0 0 2023-12-09T02:35:22.236 INFO:tasks.workunit.client.1.smithi161.stdout:1/911: dread d6/d8/d63/d93/f16 [0,4194304] 0 2023-12-09T02:35:22.242 INFO:tasks.workunit.client.1.smithi161.stdout:6/802: mknod da/d19/dc2/d29/d2b/d31/d33/d39/c112 0 2023-12-09T02:35:22.243 INFO:tasks.workunit.client.1.smithi161.stdout:4/948: mkdir dd/d36/d3f/d54/d102/d25/d4e/d13d 0 2023-12-09T02:35:22.244 INFO:tasks.workunit.client.1.smithi161.stdout:5/835: creat d0/f123 x:0 0 0 2023-12-09T02:35:22.244 INFO:tasks.workunit.client.1.smithi161.stdout:9/761: creat d2/d25/db1/d65/d42/d58/d91/d2e/d3f/f10f x:0 0 0 2023-12-09T02:35:22.245 INFO:tasks.workunit.client.1.smithi161.stdout:9/762: write d2/d25/db1/d65/d88/dcb/ddf/de5/f10e [392510,99986] 0 2023-12-09T02:35:22.245 INFO:tasks.workunit.client.1.smithi161.stdout:1/912: mkdir d6/d9/d8b/dba/d126 0 2023-12-09T02:35:22.246 INFO:tasks.workunit.client.1.smithi161.stdout:2/761: dwrite d4/d7/db/f76 [0,4194304] 0 2023-12-09T02:35:22.246 INFO:tasks.workunit.client.1.smithi161.stdout:2/762: chown d4/d16/d69/d8c/d87/ld8 6 1 2023-12-09T02:35:22.247 INFO:tasks.workunit.client.1.smithi161.stdout:4/949: dread dd/d1a/d1e/f4f [0,4194304] 0 2023-12-09T02:35:22.250 INFO:tasks.workunit.client.1.smithi161.stdout:5/836: rmdir d0/d2/de/d44/ddd 39 2023-12-09T02:35:22.254 INFO:tasks.workunit.client.1.smithi161.stdout:9/763: mkdir d2/d25/db1/d65/d42/d58/d91/d2e/d80/d103/d90/d95/d110 0 2023-12-09T02:35:22.255 INFO:tasks.workunit.client.1.smithi161.stdout:0/735: dwrite d9/db/d2a/d9d/dba/f79 [0,4194304] 0 2023-12-09T02:35:22.259 INFO:tasks.workunit.client.1.smithi161.stdout:2/763: symlink d4/d7/db/lfd 0 2023-12-09T02:35:22.259 INFO:tasks.workunit.client.1.smithi161.stdout:1/913: dwrite d6/d8/d63/d4d/d31/d73/f121 [0,4194304] 0 2023-12-09T02:35:22.259 INFO:tasks.workunit.client.1.smithi161.stdout:1/914: chown d6/d8/d63/d4d/d9f/cc6 0 1 2023-12-09T02:35:22.260 INFO:tasks.workunit.client.1.smithi161.stdout:4/950: rmdir dd/d36/d3f/d54/d102/d25/d4e/d13d 0 2023-12-09T02:35:22.262 INFO:tasks.workunit.client.1.smithi161.stdout:4/951: dread dd/d1a/d1e/f11c [0,4194304] 0 2023-12-09T02:35:22.263 INFO:tasks.workunit.client.1.smithi161.stdout:6/803: rename da/d19/dc2/dd2/f103 to da/f113 0 2023-12-09T02:35:22.264 INFO:tasks.workunit.client.1.smithi161.stdout:5/837: mknod d0/d2/d7/d51/c124 0 2023-12-09T02:35:22.266 INFO:tasks.workunit.client.1.smithi161.stdout:9/764: mkdir d2/d25/db1/d65/d88/dcb/ddf/de5/d111 0 2023-12-09T02:35:22.266 INFO:tasks.workunit.client.1.smithi161.stdout:9/765: fsync d2/d25/db1/d65/d42/d58/d91/d2e/d80/d103/dd1/ff0 0 2023-12-09T02:35:22.266 INFO:tasks.workunit.client.1.smithi161.stdout:9/766: stat d2/d25/db1/d65/d88/cfa 0 2023-12-09T02:35:22.266 INFO:tasks.workunit.client.1.smithi161.stdout:9/767: stat d2/d25/db1/d65/d5c/d55/c70 0 2023-12-09T02:35:22.267 INFO:tasks.workunit.client.1.smithi161.stdout:9/768: write d2/d25/db1/d65/d42/d58/d91/f86 [3925603,19772] 0 2023-12-09T02:35:22.267 INFO:tasks.workunit.client.1.smithi161.stdout:0/736: symlink d9/d1f/dd4/le4 0 2023-12-09T02:35:22.274 INFO:tasks.workunit.client.1.smithi161.stdout:2/764: truncate d4/d16/d69/d7b/f5c 139046 0 2023-12-09T02:35:22.276 INFO:tasks.workunit.client.1.smithi161.stdout:4/952: getdents dd/d36/d4a/d88/d8a/db3 0 2023-12-09T02:35:22.276 INFO:tasks.workunit.client.1.smithi161.stdout:4/953: chown dd/d36/d3f/d54/c77 0 1 2023-12-09T02:35:22.279 INFO:tasks.workunit.client.1.smithi161.stdout:6/804: rename da/d19/dc2/d4d/d5e/l9b to da/d19/dc2/d3c/dd1/l114 0 2023-12-09T02:35:22.281 INFO:tasks.workunit.client.1.smithi161.stdout:5/838: unlink d0/d2/d7/d11/d50/d8a/ded/f88 0 2023-12-09T02:35:22.282 INFO:tasks.workunit.client.1.smithi161.stdout:5/839: write d0/d2/de/d44/dff/de5/ff2 [579177,83750] 0 2023-12-09T02:35:22.282 INFO:tasks.workunit.client.1.smithi161.stdout:1/915: dwrite d6/d8/d63/d1c/d8a/dcd/d9d/fa2 [4194304,4194304] 0 2023-12-09T02:35:22.283 INFO:tasks.workunit.client.1.smithi161.stdout:9/769: getdents d2/d25/db1/d4d 0 2023-12-09T02:35:22.284 INFO:tasks.workunit.client.1.smithi161.stdout:0/737: getdents d9/d55/d44/d85 0 2023-12-09T02:35:22.287 INFO:tasks.workunit.client.1.smithi161.stdout:2/765: fdatasync d4/da6/db9/f9d 0 2023-12-09T02:35:22.289 INFO:tasks.workunit.client.1.smithi161.stdout:4/954: rename dd/d36/d4a/d88/l132 to dd/d36/d3f/d54/d102/d25/d4e/dbb/d13b/l13e 0 2023-12-09T02:35:22.292 INFO:tasks.workunit.client.1.smithi161.stdout:6/805: mknod da/d19/dc2/d3c/c115 0 2023-12-09T02:35:22.304 INFO:tasks.workunit.client.1.smithi161.stdout:0/738: truncate d9/db/d2a/d9d/fb0 122205 0 2023-12-09T02:35:22.306 INFO:tasks.workunit.client.1.smithi161.stdout:2/766: getdents d4/d16/d69/d7b 0 2023-12-09T02:35:22.306 INFO:tasks.workunit.client.1.smithi161.stdout:2/767: fsync d4/d16/d69/d8c/d87/f97 0 2023-12-09T02:35:22.306 INFO:tasks.workunit.client.1.smithi161.stdout:2/768: truncate d4/d7/d8f/dd2/fde 798337 0 2023-12-09T02:35:22.309 INFO:tasks.workunit.client.1.smithi161.stdout:5/840: rename d0/d2/d7/d11/d50/d8a/ded to d0/d2/de/d22/d8e/d8f/dcd/d83/dfa/d125 0 2023-12-09T02:35:22.311 INFO:tasks.workunit.client.1.smithi161.stdout:4/955: unlink dd/d36/d4a/d88/f105 0 2023-12-09T02:35:22.312 INFO:tasks.workunit.client.1.smithi161.stdout:6/806: creat da/d19/dc2/d29/d2b/d31/d33/d39/f116 x:0 0 0 2023-12-09T02:35:22.312 INFO:tasks.workunit.client.1.smithi161.stdout:6/807: write da/d55/d6d/d85/fff [49229,60551] 0 2023-12-09T02:35:22.312 INFO:tasks.workunit.client.1.smithi161.stdout:6/808: chown da/d19/dc2/d4d/d5e 41144 1 2023-12-09T02:35:22.315 INFO:tasks.workunit.client.1.smithi161.stdout:0/739: symlink d9/d55/d86/d98/le5 0 2023-12-09T02:35:22.316 INFO:tasks.workunit.client.1.smithi161.stdout:2/769: dread d4/d16/d69/d8c/d87/ffb [0,4194304] 0 2023-12-09T02:35:22.317 INFO:tasks.workunit.client.1.smithi161.stdout:1/916: rename d6/d49/f119 to d6/d8/d63/d4d/d9f/ddc/d3d/dc3/f127 0 2023-12-09T02:35:22.319 INFO:tasks.workunit.client.1.smithi161.stdout:5/841: symlink d0/d2/de/d22/d8e/d8f/dcd/d83/dfa/d125/l126 0 2023-12-09T02:35:22.319 INFO:tasks.workunit.client.1.smithi161.stdout:5/842: chown d0/d2/de/d22/d8e/d8f/dcd/d83/la4 877 1 2023-12-09T02:35:22.320 INFO:tasks.workunit.client.1.smithi161.stdout:4/956: mknod dd/d36/d3f/d54/d102/d25/c13f 0 2023-12-09T02:35:22.320 INFO:tasks.workunit.client.1.smithi161.stdout:4/957: write dd/d36/d3f/d54/d102/d25/d3a/f103 [828535,86951] 0 2023-12-09T02:35:22.320 INFO:tasks.workunit.client.1.smithi161.stdout:4/958: write dd/d36/d3f/d54/d102/f8e [1011040,22481] 0 2023-12-09T02:35:22.322 INFO:tasks.workunit.client.1.smithi161.stdout:6/809: link da/d19/dc2/d4d/fa8 da/df/f117 0 2023-12-09T02:35:22.323 INFO:tasks.workunit.client.1.smithi161.stdout:0/740: stat d9/dd/d3a/ca6 0 2023-12-09T02:35:22.327 INFO:tasks.workunit.client.1.smithi161.stdout:9/770: rename d2/dc3/ce8 to d2/d25/db1/d65/d7c/c112 0 2023-12-09T02:35:22.332 INFO:tasks.workunit.client.1.smithi161.stdout:4/959: mkdir dd/d36/d3f/d54/d102/d25/d32/d140 0 2023-12-09T02:35:22.332 INFO:tasks.workunit.client.1.smithi161.stdout:1/917: mkdir d6/d9/dd6/d128 0 2023-12-09T02:35:22.332 INFO:tasks.workunit.client.1.smithi161.stdout:1/918: getdents d6/d8/d63/d1c/d8a 0 2023-12-09T02:35:22.332 INFO:tasks.workunit.client.1.smithi161.stdout:1/919: fsync d6/d8/d63/d4d/d9f/ddc/f7b 0 2023-12-09T02:35:22.336 INFO:tasks.workunit.client.1.smithi161.stdout:5/843: rename d0/d2/d7/d11/d61/def/f115 to d0/d2/d7/df3/f127 0 2023-12-09T02:35:22.336 INFO:tasks.workunit.client.1.smithi161.stdout:5/844: write d0/d2/d7/d11/d50/fb9 [876216,37225] 0 2023-12-09T02:35:22.337 INFO:tasks.workunit.client.1.smithi161.stdout:1/920: write d6/d49/f94 [1126578,122688] 0 2023-12-09T02:35:22.350 INFO:tasks.workunit.client.1.smithi161.stdout:2/770: dwrite d4/da6/db9/f57 [0,4194304] 0 2023-12-09T02:35:22.350 INFO:tasks.workunit.client.1.smithi161.stdout:6/810: dwrite da/d19/fdf [0,4194304] 0 2023-12-09T02:35:22.350 INFO:tasks.workunit.client.1.smithi161.stdout:6/811: truncate da/d19/dc2/d3c/d46/ffe 1424031 0 2023-12-09T02:35:22.367 INFO:tasks.workunit.client.1.smithi161.stdout:2/771: dwrite d4/d1a/f35 [0,4194304] 0 2023-12-09T02:35:22.379 INFO:tasks.workunit.client.1.smithi161.stdout:4/960: mkdir dd/d1a/d23/de9/df1/d141 0 2023-12-09T02:35:22.379 INFO:tasks.workunit.client.1.smithi161.stdout:4/961: readlink dd/d36/d4a/d5f/d65/df9/l71 0 2023-12-09T02:35:22.380 INFO:tasks.workunit.client.1.smithi161.stdout:4/962: fsync dd/d36/d3f/d54/d102/d25/f2f 0 2023-12-09T02:35:22.380 INFO:tasks.workunit.client.1.smithi161.stdout:4/963: chown dd/d36/d4a/d5f/lca 2627 1 2023-12-09T02:35:22.388 INFO:tasks.workunit.client.1.smithi161.stdout:1/921: rename d6/d8/d68/df6 to d6/d9/d8b/dba/d129 0 2023-12-09T02:35:22.389 INFO:tasks.workunit.client.1.smithi161.stdout:1/922: write d6/d8/d63/d1c/d8a/dcd/fb5 [1471708,41464] 0 2023-12-09T02:35:22.389 INFO:tasks.workunit.client.1.smithi161.stdout:1/923: truncate d6/fef 978159 0 2023-12-09T02:35:22.392 INFO:tasks.workunit.client.1.smithi161.stdout:0/741: write d9/f97 [208147,27302] 0 2023-12-09T02:35:22.394 INFO:tasks.workunit.client.1.smithi161.stdout:7/689: sync 2023-12-09T02:35:22.394 INFO:tasks.workunit.client.1.smithi161.stdout:8/701: sync 2023-12-09T02:35:22.394 INFO:tasks.workunit.client.1.smithi161.stdout:3/699: sync 2023-12-09T02:35:22.394 INFO:tasks.workunit.client.1.smithi161.stdout:6/812: creat da/d55/dea/f118 x:0 0 0 2023-12-09T02:35:22.400 INFO:tasks.workunit.client.1.smithi161.stdout:4/964: creat dd/f142 x:0 0 0 2023-12-09T02:35:22.400 INFO:tasks.workunit.client.1.smithi161.stdout:0/742: dread d9/d55/d26/d28/d58/f67 [0,4194304] 0 2023-12-09T02:35:22.402 INFO:tasks.workunit.client.1.smithi161.stdout:2/772: write d4/da6/db9/f57 [4612575,16683] 0 2023-12-09T02:35:22.402 INFO:tasks.workunit.client.1.smithi161.stdout:4/965: dread dd/d36/d3f/d54/d102/d25/d32/fc2 [0,4194304] 0 2023-12-09T02:35:22.402 INFO:tasks.workunit.client.1.smithi161.stdout:4/966: write dd/d36/d3f/d54/d102/d25/d32/dd0/ff6 [1465248,32794] 0 2023-12-09T02:35:22.406 INFO:tasks.workunit.client.1.smithi161.stdout:1/924: getdents d6/d8/d63/d4d/d9f/ddc/d3d/dc3 0 2023-12-09T02:35:22.410 INFO:tasks.workunit.client.1.smithi161.stdout:8/702: link d2/d5/f6b d2/d5/d4f/db2/fe2 0 2023-12-09T02:35:22.413 INFO:tasks.workunit.client.1.smithi161.stdout:7/690: creat d0/d49/d67/d71/dc0/fde x:0 0 0 2023-12-09T02:35:22.414 INFO:tasks.workunit.client.1.smithi161.stdout:6/813: truncate da/fd 3047574 0 2023-12-09T02:35:22.414 INFO:tasks.workunit.client.1.smithi161.stdout:6/814: chown da/d19/dc2/d77/d79 90125 1 2023-12-09T02:35:22.415 INFO:tasks.workunit.client.1.smithi161.stdout:0/743: getdents d9/d55/d26/d28/d58 0 2023-12-09T02:35:22.418 INFO:tasks.workunit.client.1.smithi161.stdout:2/773: truncate d4/d7/f45 35508 0 2023-12-09T02:35:22.420 INFO:tasks.workunit.client.1.smithi161.stdout:1/925: symlink d6/d9/d8b/l12a 0 2023-12-09T02:35:22.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/700: rename d2/d51/d75/d11/d19/d91/c81 to d2/d51/d75/d11/d19/d91/d46/d5e/ccc 0 2023-12-09T02:35:22.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/701: fdatasync d2/d51/d75/d11/f3c 0 2023-12-09T02:35:22.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/702: truncate d2/d51/d75/d11/d7b/f85 357847 0 2023-12-09T02:35:22.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/703: truncate d2/d51/d75/d11/d19/d91/fc9 277185 0 2023-12-09T02:35:22.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/704: stat d2/d51/d75/d11/d19/d91/d46/d9c/cba 0 2023-12-09T02:35:22.427 INFO:tasks.workunit.client.1.smithi161.stdout:4/967: dwrite dd/d36/d4a/d88/d8a/db3/fd7 [0,4194304] 0 2023-12-09T02:35:22.427 INFO:tasks.workunit.client.1.smithi161.stdout:4/968: chown dd/d36/f74 8 1 2023-12-09T02:35:22.428 INFO:tasks.workunit.client.1.smithi161.stdout:7/691: creat d0/d3/d6a/fdf x:0 0 0 2023-12-09T02:35:22.432 INFO:tasks.workunit.client.1.smithi161.stdout:6/815: mknod da/d19/dc2/d29/d92/c119 0 2023-12-09T02:35:22.433 INFO:tasks.workunit.client.1.smithi161.stdout:0/744: dwrite d9/db/d2a/fa2 [0,4194304] 0 2023-12-09T02:35:22.433 INFO:tasks.workunit.client.1.smithi161.stdout:0/745: chown d9/d1f 0 1 2023-12-09T02:35:22.434 INFO:tasks.workunit.client.1.smithi161.stdout:0/746: write d9/f62 [1583938,14761] 0 2023-12-09T02:35:22.435 INFO:tasks.workunit.client.1.smithi161.stdout:2/774: creat d4/d1a/d4a/daa/ffe x:0 0 0 2023-12-09T02:35:22.437 INFO:tasks.workunit.client.1.smithi161.stdout:1/926: creat d6/d9/dd6/d128/f12b x:0 0 0 2023-12-09T02:35:22.442 INFO:tasks.workunit.client.1.smithi161.stdout:4/969: mkdir dd/d1a/d23/d6a/d107/d143 0 2023-12-09T02:35:22.445 INFO:tasks.workunit.client.1.smithi161.stdout:6/816: creat da/d19/d20/f11a x:0 0 0 2023-12-09T02:35:22.445 INFO:tasks.workunit.client.1.smithi161.stdout:6/817: write da/d55/fba [485350,98858] 0 2023-12-09T02:35:22.447 INFO:tasks.workunit.client.1.smithi161.stdout:7/692: dwrite d0/d3/d13/d4e/db2/dda/dab/f5c [0,4194304] 0 2023-12-09T02:35:22.450 INFO:tasks.workunit.client.1.smithi161.stdout:0/747: mknod d9/d55/d5a/ce6 0 2023-12-09T02:35:22.452 INFO:tasks.workunit.client.1.smithi161.stdout:2/775: creat d4/d1a/d4a/fff x:0 0 0 2023-12-09T02:35:22.456 INFO:tasks.workunit.client.1.smithi161.stdout:1/927: truncate d6/d8/d63/d1c/d8a/dcd/d9d/f10b 1366345 0 2023-12-09T02:35:22.456 INFO:tasks.workunit.client.1.smithi161.stdout:1/928: chown d6/d8/d63/d4d/d9f 4240329 1 2023-12-09T02:35:22.456 INFO:tasks.workunit.client.1.smithi161.stdout:1/929: fsync d6/d8/d63/d4d/d9f/ddc/daa/f6b 0 2023-12-09T02:35:22.458 INFO:tasks.workunit.client.1.smithi161.stdout:3/705: unlink d2/d51/d75/d11/d19/d91/d46/d5e/l6b 0 2023-12-09T02:35:22.458 INFO:tasks.workunit.client.1.smithi161.stdout:3/706: stat d2/d51/d75/d11/f3c 0 2023-12-09T02:35:22.461 INFO:tasks.workunit.client.1.smithi161.stdout:4/970: creat dd/d1a/d23/de9/f144 x:0 0 0 2023-12-09T02:35:22.461 INFO:tasks.workunit.client.1.smithi161.stdout:4/971: write dd/d36/d3f/f43 [1538334,106169] 0 2023-12-09T02:35:22.462 INFO:tasks.workunit.client.1.smithi161.stdout:4/972: fdatasync dd/d1a/d23/de9/f144 0 2023-12-09T02:35:22.464 INFO:tasks.workunit.client.1.smithi161.stdout:6/818: unlink da/fd 0 2023-12-09T02:35:22.466 INFO:tasks.workunit.client.1.smithi161.stdout:0/748: truncate d9/d55/d7c/f2b 2004068 0 2023-12-09T02:35:22.467 INFO:tasks.workunit.client.1.smithi161.stdout:2/776: truncate d4/d1a/f3e 2631709 0 2023-12-09T02:35:22.468 INFO:tasks.workunit.client.1.smithi161.stdout:0/749: write d9/db/d2a/d35/f91 [2564958,127679] 0 2023-12-09T02:35:22.468 INFO:tasks.workunit.client.1.smithi161.stdout:0/750: dread - d9/db/d2a/fd7 zero size 2023-12-09T02:35:22.471 INFO:tasks.workunit.client.1.smithi161.stdout:3/707: dread d2/d37/d99/f59 [0,4194304] 0 2023-12-09T02:35:22.473 INFO:tasks.workunit.client.1.smithi161.stdout:7/693: dwrite d0/d3/d13/d4e/db2/f4f [0,4194304] 0 2023-12-09T02:35:22.473 INFO:tasks.workunit.client.1.smithi161.stdout:4/973: dread dd/d36/d4a/f6f [0,4194304] 0 2023-12-09T02:35:22.475 INFO:tasks.workunit.client.1.smithi161.stdout:6/819: creat da/df/d2d/f11b x:0 0 0 2023-12-09T02:35:22.479 INFO:tasks.workunit.client.1.smithi161.stdout:2/777: unlink d4/d7/db/c28 0 2023-12-09T02:35:22.480 INFO:tasks.workunit.client.1.smithi161.stdout:2/778: fsync d4/d7/db/f62 0 2023-12-09T02:35:22.480 INFO:tasks.workunit.client.1.smithi161.stdout:0/751: getdents d9/db/d2a/d35 0 2023-12-09T02:35:22.482 INFO:tasks.workunit.client.1.smithi161.stdout:7/694: dread d0/d3/d13/d4e/db2/dda/dcb/d59/f6d [0,4194304] 0 2023-12-09T02:35:22.490 INFO:tasks.workunit.client.1.smithi161.stdout:4/974: creat dd/d36/d4a/d88/f145 x:0 0 0 2023-12-09T02:35:22.494 INFO:tasks.workunit.client.1.smithi161.stdout:0/752: creat d9/d55/d44/d85/fe7 x:0 0 0 2023-12-09T02:35:22.494 INFO:tasks.workunit.client.1.smithi161.stdout:0/753: write d9/d55/d44/d85/fc0 [551870,79116] 0 2023-12-09T02:35:22.494 INFO:tasks.workunit.client.1.smithi161.stdout:0/754: fdatasync d9/d55/d7c/f6c 0 2023-12-09T02:35:22.501 INFO:tasks.workunit.client.1.smithi161.stdout:3/708: link d2/d51/d75/d11/d7b/lb2 d2/d51/d75/d11/d1f/d7a/d96/lcd 0 2023-12-09T02:35:22.503 INFO:tasks.workunit.client.1.smithi161.stdout:4/975: dread f7 [4194304,4194304] 0 2023-12-09T02:35:22.503 INFO:tasks.workunit.client.1.smithi161.stdout:6/820: dwrite da/d19/dc2/d77/d79/fe7 [0,4194304] 0 2023-12-09T02:35:22.503 INFO:tasks.workunit.client.1.smithi161.stdout:6/821: truncate da/d55/dea/ff9 687772 0 2023-12-09T02:35:22.504 INFO:tasks.workunit.client.1.smithi161.stdout:6/822: chown f9 0 1 2023-12-09T02:35:22.506 INFO:tasks.workunit.client.1.smithi161.stdout:2/779: dwrite d4/d16/f49 [0,4194304] 0 2023-12-09T02:35:22.508 INFO:tasks.workunit.client.1.smithi161.stdout:1/930: link d6/d8/d63/d1c/d8a/dcd/d9d/f10b d6/d8/d63/d4d/d31/d80/f12c 0 2023-12-09T02:35:22.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/695: rename d0/d49/d67/l76 to d0/d3/d13/dc7/dc8/le0 0 2023-12-09T02:35:22.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/696: chown d0/d3/d13/dbf 203769099 1 2023-12-09T02:35:22.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/697: truncate d0/d3/d13/d4e/db2/dda/dcb/f2e 3072626 0 2023-12-09T02:35:22.524 INFO:tasks.workunit.client.1.smithi161.stdout:3/709: dread d2/d51/d75/d11/d19/d91/fc9 [0,4194304] 0 2023-12-09T02:35:22.524 INFO:tasks.workunit.client.1.smithi161.stdout:3/710: chown d2/d51/d75/d11/d19/d91/d46/d9c 16104653 1 2023-12-09T02:35:22.524 INFO:tasks.workunit.client.1.smithi161.stdout:3/711: chown d2/d51/d75/d11 1293291938 1 2023-12-09T02:35:22.525 INFO:tasks.workunit.client.1.smithi161.stdout:4/976: rmdir dd/d36/d3f/d54/d102/d25/d32/d58 39 2023-12-09T02:35:22.532 INFO:tasks.workunit.client.1.smithi161.stdout:2/780: dwrite d4/d7/db/f62 [4194304,4194304] 0 2023-12-09T02:35:22.532 INFO:tasks.workunit.client.1.smithi161.stdout:2/781: chown d4/da6/de6/ce9 16493 1 2023-12-09T02:35:22.532 INFO:tasks.workunit.client.1.smithi161.stdout:2/782: stat d4/d7/db/f62 0 2023-12-09T02:35:22.536 INFO:tasks.workunit.client.1.smithi161.stdout:7/698: dwrite d0/d3/d13/f26 [0,4194304] 0 2023-12-09T02:35:22.669 INFO:tasks.workunit.client.1.smithi161.stdout:0/755: dwrite d9/d55/d7c/f4e [0,4194304] 0 2023-12-09T02:35:22.670 INFO:tasks.workunit.client.1.smithi161.stdout:1/931: symlink d6/d8/d63/d4d/d31/d73/d47/d102/l12d 0 2023-12-09T02:35:22.670 INFO:tasks.workunit.client.1.smithi161.stdout:1/932: truncate d6/d8/d63/d4d/fc8 634079 0 2023-12-09T02:35:22.677 INFO:tasks.workunit.client.1.smithi161.stdout:3/712: chown d2/d51/d75/d11/d19/d91/d46/d5e/f9a 6594067 1 2023-12-09T02:35:22.677 INFO:tasks.workunit.client.1.smithi161.stdout:3/713: dread - d2/d37/d99/fb8 zero size 2023-12-09T02:35:22.678 INFO:tasks.workunit.client.1.smithi161.stdout:0/756: dread d9/d55/d7c/f4e [0,4194304] 0 2023-12-09T02:35:22.678 INFO:tasks.workunit.client.1.smithi161.stdout:0/757: write d9/d55/d44/fa1 [473850,101322] 0 2023-12-09T02:35:22.678 INFO:tasks.workunit.client.1.smithi161.stdout:4/977: creat dd/d36/d3f/d54/d102/d25/d32/dd0/f146 x:0 0 0 2023-12-09T02:35:22.678 INFO:tasks.workunit.client.1.smithi161.stdout:4/978: getdents dd/d36/d3f/d54/d102/d25/d32/d140 0 2023-12-09T02:35:22.682 INFO:tasks.workunit.client.1.smithi161.stdout:2/783: rmdir d4/d16 39 2023-12-09T02:35:22.686 INFO:tasks.workunit.client.1.smithi161.stdout:7/699: symlink d0/d49/d67/d71/dc0/le1 0 2023-12-09T02:35:22.694 INFO:tasks.workunit.client.1.smithi161.stdout:3/714: dwrite d2/d51/d75/d11/d19/d91/f3b [0,4194304] 0 2023-12-09T02:35:22.696 INFO:tasks.workunit.client.1.smithi161.stdout:1/933: creat d6/d8/d63/d4d/d9f/ddc/daa/f12e x:0 0 0 2023-12-09T02:35:22.696 INFO:tasks.workunit.client.1.smithi161.stdout:1/934: chown d6/d9/dd6/d128 48955 1 2023-12-09T02:35:22.698 INFO:tasks.workunit.client.1.smithi161.stdout:0/758: mknod d9/db/d2a/d35/de3/ce8 0 2023-12-09T02:35:22.698 INFO:tasks.workunit.client.1.smithi161.stdout:7/700: dread d0/f42 [0,4194304] 0 2023-12-09T02:35:22.700 INFO:tasks.workunit.client.1.smithi161.stdout:4/979: rename dd/d1a/d23/de9/f144 to dd/d36/d4a/d5f/d65/df9/f147 0 2023-12-09T02:35:22.705 INFO:tasks.workunit.client.1.smithi161.stdout:1/935: stat d6/d8/d63/d4d/d31/d73/d47/db2/d10d/c115 0 2023-12-09T02:35:22.705 INFO:tasks.workunit.client.1.smithi161.stdout:1/936: fsync d6/d8/d63/f65 0 2023-12-09T02:35:22.706 INFO:tasks.workunit.client.1.smithi161.stdout:1/937: write d6/d8/d63/d4d/d31/fbf [4665603,69077] 0 2023-12-09T02:35:22.711 INFO:tasks.workunit.client.1.smithi161.stdout:0/759: symlink d9/d55/d7c/d7a/da3/le9 0 2023-12-09T02:35:22.712 INFO:tasks.workunit.client.1.smithi161.stdout:0/760: write d9/dd/fc5 [1022048,39464] 0 2023-12-09T02:35:22.712 INFO:tasks.workunit.client.1.smithi161.stdout:0/761: dread - d9/db/d2a/d9d/fd0 zero size 2023-12-09T02:35:22.713 INFO:tasks.workunit.client.1.smithi161.stdout:0/762: fsync d9/d55/d26/f42 0 2023-12-09T02:35:22.714 INFO:tasks.workunit.client.1.smithi161.stdout:7/701: symlink d0/d49/d79/le2 0 2023-12-09T02:35:22.714 INFO:tasks.workunit.client.1.smithi161.stdout:7/702: chown d0/d3/d13/l28 7 1 2023-12-09T02:35:22.716 INFO:tasks.workunit.client.1.smithi161.stdout:3/715: write d2/d51/d75/f36 [99625,89580] 0 2023-12-09T02:35:22.716 INFO:tasks.workunit.client.1.smithi161.stdout:4/980: link dd/d36/d4a/d5f/d65/df9/l87 dd/d36/d4a/d5f/dc7/l148 0 2023-12-09T02:35:22.716 INFO:tasks.workunit.client.1.smithi161.stdout:4/981: fsync dd/d36/d3f/d54/d102/f8e 0 2023-12-09T02:35:22.716 INFO:tasks.workunit.client.1.smithi161.stdout:4/982: write dd/d1a/fe3 [555590,35978] 0 2023-12-09T02:35:22.722 INFO:tasks.workunit.client.1.smithi161.stdout:3/716: link d2/d51/d75/d11/d19/d91/d46/l26 d2/d51/d75/d11/lce 0 2023-12-09T02:35:22.722 INFO:tasks.workunit.client.1.smithi161.stdout:4/983: write dd/d36/d3f/d54/d102/d25/f3b [3987172,108254] 0 2023-12-09T02:35:22.722 INFO:tasks.workunit.client.1.smithi161.stdout:4/984: symlink dd/d36/d3f/d54/d102/d25/dfc/l149 0 2023-12-09T02:35:22.727 INFO:tasks.workunit.client.1.smithi161.stdout:4/985: write dd/d36/d3f/d54/d102/d25/f80 [2578721,12054] 0 2023-12-09T02:35:22.729 INFO:tasks.workunit.client.1.smithi161.stdout:4/986: creat dd/d36/d4a/d5f/d65/f14a x:0 0 0 2023-12-09T02:35:22.729 INFO:tasks.workunit.client.1.smithi161.stdout:4/987: dread - dd/d36/d4a/d88/dcd/f12b zero size 2023-12-09T02:35:22.729 INFO:tasks.workunit.client.1.smithi161.stdout:7/703: dread d0/d3/d13/d4e/db5/fa1 [0,4194304] 0 2023-12-09T02:35:22.730 INFO:tasks.workunit.client.1.smithi161.stdout:4/988: mkdir dd/d36/d3f/d54/d102/d25/d11f/d14b 0 2023-12-09T02:35:22.730 INFO:tasks.workunit.client.1.smithi161.stdout:4/989: chown dd/d36/d3f/d54/d102/d25/d3a/f103 26596 1 2023-12-09T02:35:22.732 INFO:tasks.workunit.client.1.smithi161.stdout:7/704: creat d0/d49/d79/dc3/fe3 x:0 0 0 2023-12-09T02:35:22.734 INFO:tasks.workunit.client.1.smithi161.stdout:4/990: symlink dd/d1a/l14c 0 2023-12-09T02:35:22.736 INFO:tasks.workunit.client.1.smithi161.stdout:4/991: symlink dd/d36/d3f/d54/d102/l14d 0 2023-12-09T02:35:22.738 INFO:tasks.workunit.client.1.smithi161.stdout:4/992: truncate dd/d36/d4a/f51 38716 0 2023-12-09T02:35:22.741 INFO:tasks.workunit.client.1.smithi161.stdout:4/993: truncate dd/d36/d3f/f9e 590699 0 2023-12-09T02:35:22.741 INFO:tasks.workunit.client.1.smithi161.stdout:4/994: fsync dd/d36/d4a/de8/f11d 0 2023-12-09T02:35:22.743 INFO:tasks.workunit.client.1.smithi161.stdout:7/705: dread d0/d3/d13/d1b/f3f [0,4194304] 0 2023-12-09T02:35:22.746 INFO:tasks.workunit.client.1.smithi161.stdout:2/784: dwrite d4/da6/db9/f73 [0,4194304] 0 2023-12-09T02:35:22.747 INFO:tasks.workunit.client.1.smithi161.stdout:0/763: dwrite d9/dd/f53 [0,4194304] 0 2023-12-09T02:35:22.748 INFO:tasks.workunit.client.1.smithi161.stdout:1/938: dwrite d6/d8/d63/d93/fe2 [0,4194304] 0 2023-12-09T02:35:22.748 INFO:tasks.workunit.client.1.smithi161.stdout:1/939: fsync d6/d8/d63/d4d/f3b 0 2023-12-09T02:35:22.748 INFO:tasks.workunit.client.1.smithi161.stdout:2/785: unlink d4/d1a/f3e 0 2023-12-09T02:35:22.748 INFO:tasks.workunit.client.1.smithi161.stdout:3/717: dwrite d2/fa1 [0,4194304] 0 2023-12-09T02:35:22.748 INFO:tasks.workunit.client.1.smithi161.stdout:3/718: dread - d2/d51/d75/d11/d19/d91/d46/d5e/fa5 zero size 2023-12-09T02:35:22.756 INFO:tasks.workunit.client.1.smithi161.stdout:1/940: rmdir d6/d9/d5c 39 2023-12-09T02:35:22.758 INFO:tasks.workunit.client.1.smithi161.stdout:1/941: write d6/d8/d63/d4d/d31/d73/d47/f6d [3460202,25114] 0 2023-12-09T02:35:22.758 INFO:tasks.workunit.client.1.smithi161.stdout:1/942: chown d6/d9/d5c 339819 1 2023-12-09T02:35:22.758 INFO:tasks.workunit.client.1.smithi161.stdout:1/943: chown d6/d8/d63/d4d/d9f/ddc/d3d/d75/fec 14 1 2023-12-09T02:35:22.760 INFO:tasks.workunit.client.1.smithi161.stdout:4/995: dread dd/d1a/d29/fef [0,4194304] 0 2023-12-09T02:35:22.761 INFO:tasks.workunit.client.1.smithi161.stdout:4/996: chown dd/d36/d4a/d88/d8a/c109 3 1 2023-12-09T02:35:22.762 INFO:tasks.workunit.client.1.smithi161.stdout:2/786: creat d4/d16/f100 x:0 0 0 2023-12-09T02:35:22.767 INFO:tasks.workunit.client.1.smithi161.stdout:1/944: mkdir d6/d8/d63/d4d/d31/d73/d12f 0 2023-12-09T02:35:22.768 INFO:tasks.workunit.client.1.smithi161.stdout:1/945: dread - d6/d8/d63/d4d/dd0/fdb zero size 2023-12-09T02:35:22.768 INFO:tasks.workunit.client.1.smithi161.stdout:1/946: chown d6/d8/d63/d93/fe 0 1 2023-12-09T02:35:22.780 INFO:tasks.workunit.client.1.smithi161.stdout:0/764: dwrite d9/db/d2a/fd7 [0,4194304] 0 2023-12-09T02:35:22.780 INFO:tasks.workunit.client.1.smithi161.stdout:3/719: dwrite d2/d51/d75/d11/d19/f6e [0,4194304] 0 2023-12-09T02:35:22.781 INFO:tasks.workunit.client.1.smithi161.stdout:7/706: dwrite d0/d49/d79/fa9 [0,4194304] 0 2023-12-09T02:35:22.789 INFO:tasks.workunit.client.1.smithi161.stdout:1/947: getdents d6/d8/d63/d4d 0 2023-12-09T02:35:22.789 INFO:tasks.workunit.client.1.smithi161.stdout:1/948: write d6/d8/d63/d4d/d9f/d114/f116 [802448,39142] 0 2023-12-09T02:35:22.794 INFO:tasks.workunit.client.1.smithi161.stdout:0/765: creat d9/d55/d26/d28/d58/d8e/fea x:0 0 0 2023-12-09T02:35:22.798 INFO:tasks.workunit.client.1.smithi161.stdout:3/720: mkdir d2/d37/dc7/dcf 0 2023-12-09T02:35:22.798 INFO:tasks.workunit.client.1.smithi161.stdout:3/721: write d2/d51/d75/d11/d19/f6e [4306772,57173] 0 2023-12-09T02:35:22.813 INFO:tasks.workunit.client.1.smithi161.stdout:3/722: dwrite d2/f72 [8388608,4194304] 0 2023-12-09T02:35:22.819 INFO:tasks.workunit.client.1.smithi161.stdout:1/949: mkdir d6/d8/d63/d4d/d31/d73/d47/db2/d130 0 2023-12-09T02:35:22.819 INFO:tasks.workunit.client.1.smithi161.stdout:1/950: chown d6/d9/d8b/dba/dd2/l111 8 1 2023-12-09T02:35:22.822 INFO:tasks.workunit.client.1.smithi161.stdout:0/766: rmdir d9/d9c 39 2023-12-09T02:35:22.825 INFO:tasks.workunit.client.1.smithi161.stdout:4/997: rmdir dd/d36/d3f/d54/d102/d25/d32/d140 0 2023-12-09T02:35:22.828 INFO:tasks.workunit.client.1.smithi161.stdout:1/951: unlink d6/d8/d63/d4d/d9f/ddc/l43 0 2023-12-09T02:35:22.828 INFO:tasks.workunit.client.1.smithi161.stdout:1/952: stat d6/d8/d63/d93/f104 0 2023-12-09T02:35:22.828 INFO:tasks.workunit.client.1.smithi161.stdout:1/953: fsync d6/d8/d63/d4d/d31/d73/d47/fb4 0 2023-12-09T02:35:22.828 INFO:tasks.workunit.client.1.smithi161.stdout:1/954: write d6/d8/d63/d4d/f4c [8530564,59672] 0 2023-12-09T02:35:22.829 INFO:tasks.workunit.client.1.smithi161.stdout:0/767: symlink d9/d55/d7c/d7a/da3/leb 0 2023-12-09T02:35:22.829 INFO:tasks.workunit.client.1.smithi161.stdout:0/768: chown d9/d55/d26 602903995 1 2023-12-09T02:35:22.831 INFO:tasks.workunit.client.1.smithi161.stdout:3/723: mknod d2/d51/d75/d11/d1f/d7a/d96/cd0 0 2023-12-09T02:35:22.834 INFO:tasks.workunit.client.1.smithi161.stdout:0/769: getdents d9/d55/d26/d82 0 2023-12-09T02:35:22.834 INFO:tasks.workunit.client.1.smithi161.stdout:0/770: fdatasync d9/db/d2a/d9d/dba/d94/fcc 0 2023-12-09T02:35:22.835 INFO:tasks.workunit.client.1.smithi161.stdout:3/724: chown d2/d51/d75/d50/fc1 6132 1 2023-12-09T02:35:22.837 INFO:tasks.workunit.client.1.smithi161.stdout:3/725: mknod d2/d51/d75/d11/d1f/d4c/cd1 0 2023-12-09T02:35:22.838 INFO:tasks.workunit.client.1.smithi161.stdout:3/726: dread - d2/d51/d75/d11/d19/f84 zero size 2023-12-09T02:35:22.840 INFO:tasks.workunit.client.1.smithi161.stdout:3/727: rmdir d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c 39 2023-12-09T02:35:22.841 INFO:tasks.workunit.client.1.smithi161.stdout:3/728: mkdir d2/d37/d99/dd2 0 2023-12-09T02:35:22.844 INFO:tasks.workunit.client.1.smithi161.stdout:1/955: write d6/d8/d63/d4d/d31/d73/f9b [330079,83933] 0 2023-12-09T02:35:22.845 INFO:tasks.workunit.client.1.smithi161.stdout:3/729: write d2/d51/d75/d11/d7b/f87 [4034396,130263] 0 2023-12-09T02:35:22.845 INFO:tasks.workunit.client.1.smithi161.stdout:3/730: stat d2/d51/d75/d11/d1f/d4c/fbf 0 2023-12-09T02:35:22.847 INFO:tasks.workunit.client.1.smithi161.stdout:1/956: mkdir d6/d8/d63/d4d/d31/d80/d131 0 2023-12-09T02:35:22.848 INFO:tasks.workunit.client.1.smithi161.stdout:1/957: chown d6/c37 26 1 2023-12-09T02:35:22.848 INFO:tasks.workunit.client.1.smithi161.stdout:3/731: truncate d2/d51/d75/d11/d28/f8a 1154085 0 2023-12-09T02:35:22.852 INFO:tasks.workunit.client.1.smithi161.stdout:1/958: link d6/d8/d63/d4d/d31/d73/d47/db2/fd3 d6/d8/d63/f132 0 2023-12-09T02:35:22.853 INFO:tasks.workunit.client.1.smithi161.stdout:4/998: dwrite dd/d36/d3f/d54/d102/d25/d3a/ffe [0,4194304] 0 2023-12-09T02:35:22.853 INFO:tasks.workunit.client.1.smithi161.stdout:1/959: rmdir d6/d9/d5c 39 2023-12-09T02:35:22.854 INFO:tasks.workunit.client.1.smithi161.stdout:0/771: dwrite d9/d55/d7c/f6c [0,4194304] 0 2023-12-09T02:35:22.858 INFO:tasks.workunit.client.1.smithi161.stdout:1/960: dread d6/d8/d63/d1c/d8a/dcd/d9d/f10b [0,4194304] 0 2023-12-09T02:35:22.859 INFO:tasks.workunit.client.1.smithi161.stdout:4/999: mkdir dd/d36/d3f/d54/d102/d25/d32/d75/deb/d14e 0 2023-12-09T02:35:22.859 INFO:tasks.workunit.client.1.smithi161.stdout:1/961: write d6/d8/d63/d4d/fc8 [276317,17817] 0 2023-12-09T02:35:22.864 INFO:tasks.workunit.client.1.smithi161.stdout:1/962: mkdir d6/d8/d63/d4d/dd0/d133 0 2023-12-09T02:35:22.868 INFO:tasks.workunit.client.1.smithi161.stdout:1/963: rename d6/d8/d63/d4d/d9f/ddc/c110 to d6/d9/d8b/c134 0 2023-12-09T02:35:22.877 INFO:tasks.workunit.client.1.smithi161.stdout:0/772: dwrite d9/d55/d7c/f74 [0,4194304] 0 2023-12-09T02:35:22.878 INFO:tasks.workunit.client.1.smithi161.stdout:3/732: dwrite d2/d51/d75/d11/d7b/f87 [0,4194304] 0 2023-12-09T02:35:22.878 INFO:tasks.workunit.client.1.smithi161.stdout:0/773: creat d9/dd/d71/fec x:0 0 0 2023-12-09T02:35:22.880 INFO:tasks.workunit.client.1.smithi161.stdout:3/733: mknod d2/d37/d99/cd3 0 2023-12-09T02:35:22.882 INFO:tasks.workunit.client.1.smithi161.stdout:0/774: unlink d9/dd/d3a/l96 0 2023-12-09T02:35:22.884 INFO:tasks.workunit.client.1.smithi161.stdout:3/734: rename d2/fac to d2/d51/d75/d11/d1f/d4c/fd4 0 2023-12-09T02:35:22.885 INFO:tasks.workunit.client.1.smithi161.stdout:3/735: creat d2/d51/dc0/fd5 x:0 0 0 2023-12-09T02:35:22.886 INFO:tasks.workunit.client.1.smithi161.stdout:1/964: dwrite d6/d8/d63/d4d/dd0/fdb [0,4194304] 0 2023-12-09T02:35:22.886 INFO:tasks.workunit.client.1.smithi161.stdout:1/965: dread - d6/d8/d63/d4d/dd5/ffb zero size 2023-12-09T02:35:22.887 INFO:tasks.workunit.client.1.smithi161.stdout:3/736: creat d2/d51/d75/d50/d69/db7/fd6 x:0 0 0 2023-12-09T02:35:22.889 INFO:tasks.workunit.client.1.smithi161.stdout:9/771: sync 2023-12-09T02:35:22.889 INFO:tasks.workunit.client.1.smithi161.stdout:5/845: sync 2023-12-09T02:35:22.895 INFO:tasks.workunit.client.1.smithi161.stdout:1/966: rename d6/d8/d63/d4d/d31/d73/d47/db2/d130 to d6/d9/d8b/dba/d126/d135 0 2023-12-09T02:35:22.895 INFO:tasks.workunit.client.1.smithi161.stdout:1/967: dread - d6/d8/d63/d4d/d9f/ddc/ff7 zero size 2023-12-09T02:35:22.897 INFO:tasks.workunit.client.1.smithi161.stdout:3/737: creat d2/d51/d75/d11/d19/fd7 x:0 0 0 2023-12-09T02:35:22.899 INFO:tasks.workunit.client.1.smithi161.stdout:5/846: mkdir d0/d2/de/d22/d128 0 2023-12-09T02:35:22.910 INFO:tasks.workunit.client.1.smithi161.stdout:9/772: dwrite d2/d25/db1/d65/d88/dcb/ddf/fbb [0,4194304] 0 2023-12-09T02:35:22.914 INFO:tasks.workunit.client.1.smithi161.stdout:5/847: creat d0/d2/d7/d11/d50/d8a/f129 x:0 0 0 2023-12-09T02:35:22.916 INFO:tasks.workunit.client.1.smithi161.stdout:9/773: mkdir d2/d25/db1/d65/d88/dcb/ddf/d113 0 2023-12-09T02:35:22.917 INFO:tasks.workunit.client.1.smithi161.stdout:5/848: creat d0/d2/de/d22/d128/f12a x:0 0 0 2023-12-09T02:35:22.918 INFO:tasks.workunit.client.1.smithi161.stdout:9/774: creat d2/d25/db1/d65/d42/d58/d91/d2e/d80/d103/d90/d95/f114 x:0 0 0 2023-12-09T02:35:22.920 INFO:tasks.workunit.client.1.smithi161.stdout:5/849: mkdir d0/d2/de/d22/d8e/d8f/d12b 0 2023-12-09T02:35:22.921 INFO:tasks.workunit.client.1.smithi161.stdout:5/850: mkdir d0/d2/de/d22/d8e/d8f/dcd/d12c 0 2023-12-09T02:35:22.924 INFO:tasks.workunit.client.1.smithi161.stdout:0/775: dwrite d9/d55/d26/d28/d58/f8a [0,4194304] 0 2023-12-09T02:35:22.924 INFO:tasks.workunit.client.1.smithi161.stdout:5/851: unlink d0/ld 0 2023-12-09T02:35:22.925 INFO:tasks.workunit.client.1.smithi161.stdout:3/738: dwrite d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/fb0 [0,4194304] 0 2023-12-09T02:35:22.926 INFO:tasks.workunit.client.1.smithi161.stdout:1/968: dwrite d6/d8/d63/d4d/d31/d73/f9b [0,4194304] 0 2023-12-09T02:35:22.927 INFO:tasks.workunit.client.1.smithi161.stdout:0/776: mknod d9/d1f/ced 0 2023-12-09T02:35:22.931 INFO:tasks.workunit.client.1.smithi161.stdout:5/852: creat d0/d2/d7/f12d x:0 0 0 2023-12-09T02:35:22.931 INFO:tasks.workunit.client.1.smithi161.stdout:5/853: readlink d0/d2/d7/d11/dc3/l7d 0 2023-12-09T02:35:22.931 INFO:tasks.workunit.client.1.smithi161.stdout:5/854: read d0/d9/fbc [335845,86378] 0 2023-12-09T02:35:22.937 INFO:tasks.workunit.client.1.smithi161.stdout:3/739: symlink d2/d51/d75/d11/d19/d91/d46/d9c/ld8 0 2023-12-09T02:35:22.937 INFO:tasks.workunit.client.1.smithi161.stdout:5/855: creat d0/d2/d7/d11/d61/def/f12e x:0 0 0 2023-12-09T02:35:22.939 INFO:tasks.workunit.client.1.smithi161.stdout:3/740: readlink d2/d51/d75/l10 0 2023-12-09T02:35:22.940 INFO:tasks.workunit.client.1.smithi161.stdout:5/856: unlink d0/d2/de/d44/dff/de5/cf7 0 2023-12-09T02:35:22.942 INFO:tasks.workunit.client.1.smithi161.stdout:3/741: symlink d2/d51/d75/d11/d19/d91/ld9 0 2023-12-09T02:35:22.942 INFO:tasks.workunit.client.1.smithi161.stdout:3/742: chown d2/d51/d75/d50/d69/db7 7160135 1 2023-12-09T02:35:22.943 INFO:tasks.workunit.client.1.smithi161.stdout:3/743: readlink d2/d51/d75/d11/d19/d91/d46/d5e/l94 0 2023-12-09T02:35:22.943 INFO:tasks.workunit.client.1.smithi161.stdout:3/744: chown d2/d51/d75/d11/d19/d91/d46/d5e 7 1 2023-12-09T02:35:22.943 INFO:tasks.workunit.client.1.smithi161.stdout:9/775: dwrite d2/d25/db1/d65/d42/d58/d91/d2e/f40 [4194304,4194304] 0 2023-12-09T02:35:22.943 INFO:tasks.workunit.client.1.smithi161.stdout:0/777: dwrite d9/d55/d7c/f33 [8388608,4194304] 0 2023-12-09T02:35:22.944 INFO:tasks.workunit.client.1.smithi161.stdout:3/745: creat d2/daf/fda x:0 0 0 2023-12-09T02:35:22.946 INFO:tasks.workunit.client.1.smithi161.stdout:5/857: mkdir d0/d2/de/d44/d12f 0 2023-12-09T02:35:22.947 INFO:tasks.workunit.client.1.smithi161.stdout:5/858: read d0/d2/d7/d51/f7e [719606,49215] 0 2023-12-09T02:35:22.953 INFO:tasks.workunit.client.1.smithi161.stdout:0/778: dread d9/d5b/fb2 [0,4194304] 0 2023-12-09T02:35:22.955 INFO:tasks.workunit.client.1.smithi161.stdout:0/779: mkdir d9/d55/d86/dee 0 2023-12-09T02:35:22.957 INFO:tasks.workunit.client.1.smithi161.stdout:0/780: creat d9/dd/dca/fef x:0 0 0 2023-12-09T02:35:22.957 INFO:tasks.workunit.client.1.smithi161.stdout:0/781: truncate d9/d55/d5a/f95 5035983 0 2023-12-09T02:35:22.959 INFO:tasks.workunit.client.1.smithi161.stdout:0/782: unlink d9/c16 0 2023-12-09T02:35:22.960 INFO:tasks.workunit.client.1.smithi161.stdout:0/783: getdents d9/d9c/de0 0 2023-12-09T02:35:22.960 INFO:tasks.workunit.client.1.smithi161.stdout:0/784: write d9/dd/dca/fd2 [59653,126603] 0 2023-12-09T02:35:22.961 INFO:tasks.workunit.client.1.smithi161.stdout:3/746: dread d2/fa8 [0,4194304] 0 2023-12-09T02:35:22.964 INFO:tasks.workunit.client.1.smithi161.stdout:3/747: link d2/d51/d75/d11/d19/d91/d46/c24 d2/d51/d75/d11/d19/d91/d46/d40/cdb 0 2023-12-09T02:35:22.964 INFO:tasks.workunit.client.1.smithi161.stdout:3/748: chown d2/d51/d75/d11/l4f 7404 1 2023-12-09T02:35:22.964 INFO:tasks.workunit.client.1.smithi161.stdout:0/785: dread d9/db/d2a/d9d/dba/f63 [0,4194304] 0 2023-12-09T02:35:22.965 INFO:tasks.workunit.client.1.smithi161.stdout:3/749: mknod d2/d51/d75/d11/d19/d91/d46/d2d/cdc 0 2023-12-09T02:35:22.965 INFO:tasks.workunit.client.1.smithi161.stdout:9/776: dwrite d2/d25/db1/d65/ff9 [0,4194304] 0 2023-12-09T02:35:22.965 INFO:tasks.workunit.client.1.smithi161.stdout:5/859: dwrite d0/d2/de/d22/faa [0,4194304] 0 2023-12-09T02:35:22.966 INFO:tasks.workunit.client.1.smithi161.stdout:9/777: write d2/f1b [1330651,54278] 0 2023-12-09T02:35:22.966 INFO:tasks.workunit.client.1.smithi161.stdout:9/778: readlink d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/le7 0 2023-12-09T02:35:22.966 INFO:tasks.workunit.client.1.smithi161.stdout:0/786: mkdir d9/db/d2a/d35/de3/df0 0 2023-12-09T02:35:22.967 INFO:tasks.workunit.client.1.smithi161.stdout:3/750: unlink c0 0 2023-12-09T02:35:22.968 INFO:tasks.workunit.client.1.smithi161.stdout:3/751: write d2/d51/d75/d11/d19/f6e [3465466,50955] 0 2023-12-09T02:35:22.976 INFO:tasks.workunit.client.1.smithi161.stdout:3/752: dread d2/d51/d75/d11/d19/d91/d46/d5e/f79 [0,4194304] 0 2023-12-09T02:35:22.979 INFO:tasks.workunit.client.1.smithi161.stdout:5/860: mkdir d0/d2/d130 0 2023-12-09T02:35:22.980 INFO:tasks.workunit.client.1.smithi161.stdout:9/779: mknod d2/d25/db1/d65/d42/d58/d22/c115 0 2023-12-09T02:35:22.982 INFO:tasks.workunit.client.1.smithi161.stdout:0/787: mkdir d9/db/df1 0 2023-12-09T02:35:22.982 INFO:tasks.workunit.client.1.smithi161.stdout:0/788: dread - d9/db/d2a/d9d/fd0 zero size 2023-12-09T02:35:22.982 INFO:tasks.workunit.client.1.smithi161.stdout:0/789: chown d9/d55/d26/c37 12519 1 2023-12-09T02:35:22.984 INFO:tasks.workunit.client.1.smithi161.stdout:3/753: write d2/d51/d75/d11/d19/d91/d46/d5e/f73 [2725501,98248] 0 2023-12-09T02:35:22.986 INFO:tasks.workunit.client.1.smithi161.stdout:5/861: rmdir d0/d2/de/d44/da6 39 2023-12-09T02:35:22.987 INFO:tasks.workunit.client.1.smithi161.stdout:9/780: mkdir d2/d25/db1/d116 0 2023-12-09T02:35:22.990 INFO:tasks.workunit.client.1.smithi161.stdout:0/790: getdents d9/dd/d3a 0 2023-12-09T02:35:22.992 INFO:tasks.workunit.client.1.smithi161.stdout:3/754: mkdir d2/d51/d75/d11/d1f/d4c/ddd 0 2023-12-09T02:35:22.996 INFO:tasks.workunit.client.1.smithi161.stdout:5/862: creat d0/d2/d7/d11/dc3/f131 x:0 0 0 2023-12-09T02:35:22.996 INFO:tasks.workunit.client.1.smithi161.stdout:6/823: sync 2023-12-09T02:35:22.996 INFO:tasks.workunit.client.1.smithi161.stdout:8/703: sync 2023-12-09T02:35:22.996 INFO:tasks.workunit.client.1.smithi161.stdout:8/704: dread - d2/d5/d22/fd3 zero size 2023-12-09T02:35:22.998 INFO:tasks.workunit.client.1.smithi161.stdout:9/781: symlink d2/d25/dbf/l117 0 2023-12-09T02:35:22.999 INFO:tasks.workunit.client.1.smithi161.stdout:0/791: truncate d9/dd/fc5 1347955 0 2023-12-09T02:35:23.001 INFO:tasks.workunit.client.1.smithi161.stdout:3/755: symlink d2/d37/d99/dd2/lde 0 2023-12-09T02:35:23.012 INFO:tasks.workunit.client.1.smithi161.stdout:3/756: dread d2/d51/d75/d11/d19/d91/d46/d5e/f73 [0,4194304] 0 2023-12-09T02:35:23.012 INFO:tasks.workunit.client.1.smithi161.stdout:3/757: read d2/d51/d75/d11/d19/d91/d46/d40/f58 [2843778,10880] 0 2023-12-09T02:35:23.105 INFO:tasks.workunit.client.1.smithi161.stdout:5/863: rename d0/d2/de/d22/d8e/d8f to d0/d2/d7/d11/d61/d107/d132 0 2023-12-09T02:35:23.107 INFO:tasks.workunit.client.1.smithi161.stdout:6/824: mknod da/d19/dc2/c11c 0 2023-12-09T02:35:23.155 INFO:tasks.workunit.client.1.smithi161.stdout:8/705: mkdir d2/d5/d22/d54/db4/dcd/de3 0 2023-12-09T02:35:23.216 INFO:tasks.workunit.client.1.smithi161.stdout:9/782: unlink d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/d8f/cb5 0 2023-12-09T02:35:23.216 INFO:tasks.workunit.client.1.smithi161.stdout:9/783: write d2/d25/db1/d65/d88/fe2 [486444,121684] 0 2023-12-09T02:35:23.223 INFO:tasks.workunit.client.1.smithi161.stdout:0/792: rename d9/d1f/c5f to d9/db/d2a/d35/de3/df0/cf2 0 2023-12-09T02:35:23.229 INFO:tasks.workunit.client.1.smithi161.stdout:5/864: mkdir d0/d2/de/d44/da6/d133 0 2023-12-09T02:35:23.229 INFO:tasks.workunit.client.1.smithi161.stdout:5/865: write d0/d2/d5f/fc0 [74048,87509] 0 2023-12-09T02:35:23.229 INFO:tasks.workunit.client.1.smithi161.stdout:5/866: stat d0/d2/d7/d11/d61/d107/d132/dcd/f93 0 2023-12-09T02:35:23.229 INFO:tasks.workunit.client.1.smithi161.stdout:5/867: stat d0/d2/d7/d11/d50/d8a/cc5 0 2023-12-09T02:35:23.233 INFO:tasks.workunit.client.1.smithi161.stdout:9/784: dwrite d2/d25/db1/d65/d42/d58/f27 [0,4194304] 0 2023-12-09T02:35:23.241 INFO:tasks.workunit.client.1.smithi161.stdout:8/706: symlink d2/d5/d22/d54/db4/le4 0 2023-12-09T02:35:23.245 INFO:tasks.workunit.client.1.smithi161.stdout:0/793: creat d9/d55/d5a/db1/ff3 x:0 0 0 2023-12-09T02:35:23.247 INFO:tasks.workunit.client.1.smithi161.stdout:5/868: creat d0/d2/de/d22/d128/f134 x:0 0 0 2023-12-09T02:35:23.251 INFO:tasks.workunit.client.1.smithi161.stdout:9/785: symlink d2/d25/db1/d65/d42/d58/d91/d2e/d80/l118 0 2023-12-09T02:35:23.253 INFO:tasks.workunit.client.1.smithi161.stdout:8/707: link d2/d5/d22/d76/l99 d2/d5/d22/d31/d38/le5 0 2023-12-09T02:35:23.254 INFO:tasks.workunit.client.1.smithi161.stdout:8/708: readlink d2/d5/d22/l87 0 2023-12-09T02:35:23.254 INFO:tasks.workunit.client.1.smithi161.stdout:8/709: dread - d2/d5/d22/d54/db4/dcd/fd4 zero size 2023-12-09T02:35:23.256 INFO:tasks.workunit.client.1.smithi161.stdout:0/794: link d9/db/d2a/d35/lb4 d9/d55/d7c/d7a/da3/lf4 0 2023-12-09T02:35:23.257 INFO:tasks.workunit.client.1.smithi161.stdout:9/786: mknod d2/d25/c119 0 2023-12-09T02:35:23.257 INFO:tasks.workunit.client.1.smithi161.stdout:9/787: truncate d2/d25/db1/d65/d5c/d60/fd4 1082771 0 2023-12-09T02:35:23.258 INFO:tasks.workunit.client.1.smithi161.stdout:5/869: dread d0/f27 [0,4194304] 0 2023-12-09T02:35:23.260 INFO:tasks.workunit.client.1.smithi161.stdout:9/788: creat d2/d25/db1/d65/d100/f11a x:0 0 0 2023-12-09T02:35:23.261 INFO:tasks.workunit.client.1.smithi161.stdout:5/870: creat d0/d2/d7/df3/f135 x:0 0 0 2023-12-09T02:35:23.264 INFO:tasks.workunit.client.1.smithi161.stdout:9/789: unlink d2/d25/db1/d65/d88/cfa 0 2023-12-09T02:35:23.267 INFO:tasks.workunit.client.1.smithi161.stdout:9/790: link d2/d25/db1/d65/d42/d58/d91/d2e/fe0 d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/f11b 0 2023-12-09T02:35:23.275 INFO:tasks.workunit.client.1.smithi161.stdout:9/791: write d2/d25/db1/d65/d88/dcb/ddf/fbb [174973,30216] 0 2023-12-09T02:35:23.276 INFO:tasks.workunit.client.1.smithi161.stdout:9/792: dread d2/d25/db1/d65/d42/d58/d91/f36 [0,4194304] 0 2023-12-09T02:35:23.279 INFO:tasks.workunit.client.1.smithi161.stdout:5/871: dwrite d0/d2/d7/d51/f7e [0,4194304] 0 2023-12-09T02:35:23.291 INFO:tasks.workunit.client.1.smithi161.stdout:3/758: rename d2/d51/d75/d11/d1f/d7a to d2/d51/d75/d50/ddf 0 2023-12-09T02:35:23.291 INFO:tasks.workunit.client.1.smithi161.stdout:3/759: write d2/d51/d75/d11/f5d [1139867,112512] 0 2023-12-09T02:35:23.292 INFO:tasks.workunit.client.1.smithi161.stdout:3/760: creat d2/d51/d75/d50/fe0 x:0 0 0 2023-12-09T02:35:23.293 INFO:tasks.workunit.client.1.smithi161.stdout:3/761: fsync d2/d51/d75/f18 0 2023-12-09T02:35:23.295 INFO:tasks.workunit.client.1.smithi161.stdout:3/762: symlink d2/d51/d75/d11/d19/d91/d46/d5e/le1 0 2023-12-09T02:35:23.297 INFO:tasks.workunit.client.1.smithi161.stdout:3/763: getdents d2/d51/d75/d50/d69 0 2023-12-09T02:35:23.300 INFO:tasks.workunit.client.1.smithi161.stdout:3/764: rmdir d2/d37/dc7/dcf 0 2023-12-09T02:35:23.301 INFO:tasks.workunit.client.1.smithi161.stdout:3/765: write d2/d51/d75/d11/d19/d91/d46/d40/f58 [628025,58395] 0 2023-12-09T02:35:23.301 INFO:tasks.workunit.client.1.smithi161.stdout:3/766: truncate d2/d51/d75/d11/d19/d91/d46/f54 1204202 0 2023-12-09T02:35:23.304 INFO:tasks.workunit.client.1.smithi161.stdout:3/767: rename d2/d51/d75/d11/d19/d91/d46/f29 to d2/d51/d75/d11/d28/fe2 0 2023-12-09T02:35:23.304 INFO:tasks.workunit.client.1.smithi161.stdout:3/768: chown d2/d51/d75/d11/d19/d91/f2f 6433839 1 2023-12-09T02:35:23.304 INFO:tasks.workunit.client.1.smithi161.stdout:3/769: truncate d2/d37/f7f 856804 0 2023-12-09T02:35:23.304 INFO:tasks.workunit.client.1.smithi161.stdout:3/770: truncate d2/d37/f7f 887839 0 2023-12-09T02:35:23.305 INFO:tasks.workunit.client.1.smithi161.stdout:3/771: creat d2/fe3 x:0 0 0 2023-12-09T02:35:23.308 INFO:tasks.workunit.client.1.smithi161.stdout:3/772: symlink d2/d51/d75/d11/d28/le4 0 2023-12-09T02:35:23.308 INFO:tasks.workunit.client.1.smithi161.stdout:3/773: dread - d2/d51/d75/d11/d19/d91/d46/d5e/fa5 zero size 2023-12-09T02:35:23.310 INFO:tasks.workunit.client.1.smithi161.stdout:3/774: symlink d2/d37/d99/le5 0 2023-12-09T02:35:23.319 INFO:tasks.workunit.client.1.smithi161.stdout:3/775: dread d2/d51/d75/d11/d19/d91/f2b [0,4194304] 0 2023-12-09T02:35:23.323 INFO:tasks.workunit.client.1.smithi161.stdout:8/710: symlink d2/le6 0 2023-12-09T02:35:23.323 INFO:tasks.workunit.client.1.smithi161.stdout:8/711: stat d2/d5/d22/d31/d38/f4d 0 2023-12-09T02:35:23.337 INFO:tasks.workunit.client.1.smithi161.stdout:3/776: dread d2/fa1 [0,4194304] 0 2023-12-09T02:35:23.341 INFO:tasks.workunit.client.1.smithi161.stdout:9/793: creat d2/d25/db1/d65/d5c/d55/f11c x:0 0 0 2023-12-09T02:35:23.344 INFO:tasks.workunit.client.1.smithi161.stdout:0/795: rmdir d9/d55/d7c/d7a 39 2023-12-09T02:35:23.346 INFO:tasks.workunit.client.1.smithi161.stdout:0/796: getdents d9/d9c 0 2023-12-09T02:35:23.348 INFO:tasks.workunit.client.1.smithi161.stdout:0/797: dread d9/d55/d26/f57 [0,4194304] 0 2023-12-09T02:35:23.352 INFO:tasks.workunit.client.1.smithi161.stdout:0/798: dread d9/d55/d7c/f6b [0,4194304] 0 2023-12-09T02:35:23.352 INFO:tasks.workunit.client.1.smithi161.stdout:0/799: dread - d9/db/d2a/d9d/dba/d94/db6/fd3 zero size 2023-12-09T02:35:23.352 INFO:tasks.workunit.client.1.smithi161.stdout:0/800: fdatasync d9/d55/d7c/f6b 0 2023-12-09T02:35:23.353 INFO:tasks.workunit.client.1.smithi161.stdout:0/801: mknod d9/db/d2a/cf5 0 2023-12-09T02:35:23.354 INFO:tasks.workunit.client.1.smithi161.stdout:0/802: readlink d9/d1f/dd4/le4 0 2023-12-09T02:35:23.354 INFO:tasks.workunit.client.1.smithi161.stdout:0/803: symlink d9/dd/dca/lf6 0 2023-12-09T02:35:23.356 INFO:tasks.workunit.client.1.smithi161.stdout:0/804: mknod d9/d1f/dd4/cf7 0 2023-12-09T02:35:23.356 INFO:tasks.workunit.client.1.smithi161.stdout:0/805: dread - d9/db/d2a/d35/d7b/f9b zero size 2023-12-09T02:35:23.357 INFO:tasks.workunit.client.1.smithi161.stdout:0/806: mknod d9/d55/db7/cf8 0 2023-12-09T02:35:23.358 INFO:tasks.workunit.client.1.smithi161.stdout:0/807: link d9/dd/c13 d9/d55/d7c/cf9 0 2023-12-09T02:35:23.359 INFO:tasks.workunit.client.1.smithi161.stdout:0/808: creat d9/dd/dca/ffa x:0 0 0 2023-12-09T02:35:23.361 INFO:tasks.workunit.client.1.smithi161.stdout:9/794: dwrite d2/d25/db1/d65/d5c/d55/d66/fbc [0,4194304] 0 2023-12-09T02:35:23.361 INFO:tasks.workunit.client.1.smithi161.stdout:9/795: write d2/d25/db1/d65/d5c/d60/fd4 [1346282,18533] 0 2023-12-09T02:35:23.362 INFO:tasks.workunit.client.1.smithi161.stdout:9/796: truncate d2/d25/db1/d65/d42/d58/d91/d2e/d3f/f10f 1023577 0 2023-12-09T02:35:23.362 INFO:tasks.workunit.client.1.smithi161.stdout:9/797: write d2/d25/db1/d65/d5c/d55/d66/f105 [653711,46242] 0 2023-12-09T02:35:23.362 INFO:tasks.workunit.client.1.smithi161.stdout:9/798: write d2/d25/db1/d65/d42/d58/d91/d51/fd2 [341432,92879] 0 2023-12-09T02:35:23.362 INFO:tasks.workunit.client.1.smithi161.stdout:0/809: rename d9/d55/d7c/cf9 to d9/dd/d71/cfb 0 2023-12-09T02:35:23.363 INFO:tasks.workunit.client.1.smithi161.stdout:0/810: stat d9/d55/d7c/f2d 0 2023-12-09T02:35:23.367 INFO:tasks.workunit.client.1.smithi161.stdout:0/811: mkdir d9/d55/d44/ddf/dfc 0 2023-12-09T02:35:23.367 INFO:tasks.workunit.client.1.smithi161.stdout:0/812: dread - d9/dd/dca/fef zero size 2023-12-09T02:35:23.369 INFO:tasks.workunit.client.1.smithi161.stdout:6/825: symlink da/d19/l11d 0 2023-12-09T02:35:23.372 INFO:tasks.workunit.client.1.smithi161.stdout:6/826: unlink da/df/f3a 0 2023-12-09T02:35:23.372 INFO:tasks.workunit.client.1.smithi161.stdout:8/712: unlink d2/d5/f30 0 2023-12-09T02:35:23.373 INFO:tasks.workunit.client.1.smithi161.stdout:8/713: write d2/d5/d3d/fd9 [302846,92883] 0 2023-12-09T02:35:23.373 INFO:tasks.workunit.client.1.smithi161.stdout:8/714: readlink d2/l7f 0 2023-12-09T02:35:23.373 INFO:tasks.workunit.client.1.smithi161.stdout:8/715: chown d2/d5/d22/d31/d38/d66/cb9 2010442 1 2023-12-09T02:35:23.376 INFO:tasks.workunit.client.1.smithi161.stdout:0/813: dread d9/db/d2a/d35/f91 [0,4194304] 0 2023-12-09T02:35:23.376 INFO:tasks.workunit.client.1.smithi161.stdout:8/716: dread d2/d5/d22/d86/f9d [0,4194304] 0 2023-12-09T02:35:23.377 INFO:tasks.workunit.client.1.smithi161.stdout:0/814: rmdir d9/d55/d86 39 2023-12-09T02:35:23.378 INFO:tasks.workunit.client.1.smithi161.stdout:0/815: dread - d9/dd/d71/fec zero size 2023-12-09T02:35:23.379 INFO:tasks.workunit.client.1.smithi161.stdout:8/717: creat d2/d5/d22/d86/dd6/fe7 x:0 0 0 2023-12-09T02:35:23.379 INFO:tasks.workunit.client.1.smithi161.stdout:6/827: write da/d19/f24 [1433815,130758] 0 2023-12-09T02:35:23.380 INFO:tasks.workunit.client.1.smithi161.stdout:5/872: mkdir d0/d136 0 2023-12-09T02:35:23.382 INFO:tasks.workunit.client.1.smithi161.stdout:0/816: rename d9/d9c/de0 to d9/db/d2a/d35/dfd 0 2023-12-09T02:35:23.382 INFO:tasks.workunit.client.1.smithi161.stdout:0/817: getdents d9/dd/d3a 0 2023-12-09T02:35:23.383 INFO:tasks.workunit.client.1.smithi161.stdout:8/718: mknod d2/d2d/ce8 0 2023-12-09T02:35:23.385 INFO:tasks.workunit.client.1.smithi161.stdout:6/828: symlink da/d19/d20/l11e 0 2023-12-09T02:35:23.388 INFO:tasks.workunit.client.1.smithi161.stdout:9/799: dwrite d2/d25/db1/d65/d42/d58/d91/d2e/d80/d103/dd1/fe3 [0,4194304] 0 2023-12-09T02:35:23.388 INFO:tasks.workunit.client.1.smithi161.stdout:5/873: mknod d0/d2/d7/d11/d61/def/c137 0 2023-12-09T02:35:23.389 INFO:tasks.workunit.client.1.smithi161.stdout:5/874: write d0/d2/d7/d11/f37 [3770628,14876] 0 2023-12-09T02:35:23.389 INFO:tasks.workunit.client.1.smithi161.stdout:0/818: mkdir d9/db/df1/dfe 0 2023-12-09T02:35:23.391 INFO:tasks.workunit.client.1.smithi161.stdout:8/719: mknod d2/d8a/dbd/ce9 0 2023-12-09T02:35:23.391 INFO:tasks.workunit.client.1.smithi161.stdout:8/720: readlink d2/d5/d22/d86/d97/lbc 0 2023-12-09T02:35:23.392 INFO:tasks.workunit.client.1.smithi161.stdout:6/829: rmdir da/d19/dc2/d4d 39 2023-12-09T02:35:23.395 INFO:tasks.workunit.client.1.smithi161.stdout:9/800: creat d2/d25/db1/d65/d5c/d55/f11d x:0 0 0 2023-12-09T02:35:23.396 INFO:tasks.workunit.client.1.smithi161.stdout:9/801: write d2/d25/db1/d65/d42/d58/f1e [1152852,18793] 0 2023-12-09T02:35:23.397 INFO:tasks.workunit.client.1.smithi161.stdout:5/875: rmdir d0 39 2023-12-09T02:35:23.401 INFO:tasks.workunit.client.1.smithi161.stdout:0/819: rename d9/d55/l27 to d9/db/df1/lff 0 2023-12-09T02:35:23.401 INFO:tasks.workunit.client.1.smithi161.stdout:0/820: write d9/db/d2a/d9d/fd0 [805268,21508] 0 2023-12-09T02:35:23.403 INFO:tasks.workunit.client.1.smithi161.stdout:3/777: dwrite d2/d37/f70 [0,4194304] 0 2023-12-09T02:35:23.403 INFO:tasks.workunit.client.1.smithi161.stdout:3/778: dread d2/d37/f7f [0,4194304] 0 2023-12-09T02:35:23.404 INFO:tasks.workunit.client.1.smithi161.stdout:6/830: mknod da/d19/dc2/d77/d79/c11f 0 2023-12-09T02:35:23.405 INFO:tasks.workunit.client.1.smithi161.stdout:8/721: getdents d2/d5/d22/d31 0 2023-12-09T02:35:23.407 INFO:tasks.workunit.client.1.smithi161.stdout:5/876: creat d0/d2/de/d44/dff/f138 x:0 0 0 2023-12-09T02:35:23.409 INFO:tasks.workunit.client.1.smithi161.stdout:5/877: dread d0/d2/de/d22/d8e/fd8 [0,4194304] 0 2023-12-09T02:35:23.409 INFO:tasks.workunit.client.1.smithi161.stdout:9/802: rename d2/d25/db1/f8e to d2/d25/db1/d65/d42/d58/d22/f11e 0 2023-12-09T02:35:23.409 INFO:tasks.workunit.client.1.smithi161.stdout:9/803: fsync d2/d25/dbf/fc0 0 2023-12-09T02:35:23.414 INFO:tasks.workunit.client.1.smithi161.stdout:0/821: creat d9/d55/d44/ddf/f100 x:0 0 0 2023-12-09T02:35:23.416 INFO:tasks.workunit.client.1.smithi161.stdout:2/787: sync 2023-12-09T02:35:23.416 INFO:tasks.workunit.client.1.smithi161.stdout:7/707: sync 2023-12-09T02:35:23.416 INFO:tasks.workunit.client.1.smithi161.stdout:1/969: sync 2023-12-09T02:35:23.416 INFO:tasks.workunit.client.1.smithi161.stdout:1/970: chown d6/d8/d63/d4d/c2c 38161 1 2023-12-09T02:35:23.418 INFO:tasks.workunit.client.1.smithi161.stdout:7/708: write d0/d3/d13/d4e/db2/dda/dab/f5c [2722595,87023] 0 2023-12-09T02:35:23.420 INFO:tasks.workunit.client.1.smithi161.stdout:3/779: mkdir d2/d51/d75/d11/d19/d91/d46/d2d/d47/de6 0 2023-12-09T02:35:23.423 INFO:tasks.workunit.client.1.smithi161.stdout:6/831: link da/d19/dc2/d3c/cc1 da/d19/dc2/d29/d2b/db4/c120 0 2023-12-09T02:35:23.426 INFO:tasks.workunit.client.1.smithi161.stdout:8/722: creat d2/fea x:0 0 0 2023-12-09T02:35:23.430 INFO:tasks.workunit.client.1.smithi161.stdout:9/804: mknod d2/d25/dbf/c11f 0 2023-12-09T02:35:23.430 INFO:tasks.workunit.client.1.smithi161.stdout:9/805: write d2/d25/db1/f85 [1369978,59181] 0 2023-12-09T02:35:23.432 INFO:tasks.workunit.client.1.smithi161.stdout:0/822: creat d9/db/d2a/d35/dfd/f101 x:0 0 0 2023-12-09T02:35:23.433 INFO:tasks.workunit.client.1.smithi161.stdout:9/806: write d2/f1b [1866709,53729] 0 2023-12-09T02:35:23.434 INFO:tasks.workunit.client.1.smithi161.stdout:2/788: creat d4/d7/d8f/dd2/f101 x:0 0 0 2023-12-09T02:35:23.435 INFO:tasks.workunit.client.1.smithi161.stdout:2/789: dread d4/d16/d69/d7b/fab [0,4194304] 0 2023-12-09T02:35:23.435 INFO:tasks.workunit.client.1.smithi161.stdout:1/971: creat d6/d8/d63/d1c/f136 x:0 0 0 2023-12-09T02:35:23.435 INFO:tasks.workunit.client.1.smithi161.stdout:1/972: write d6/d9/d5c/fe0 [1122072,28103] 0 2023-12-09T02:35:23.438 INFO:tasks.workunit.client.1.smithi161.stdout:7/709: rename d0/d49/d67/d71 to d0/d3/daa/daf/de4 0 2023-12-09T02:35:23.439 INFO:tasks.workunit.client.1.smithi161.stdout:3/780: truncate d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/fa0 2080934 0 2023-12-09T02:35:23.441 INFO:tasks.workunit.client.1.smithi161.stdout:6/832: symlink da/d19/dc2/d77/l121 0 2023-12-09T02:35:23.441 INFO:tasks.workunit.client.1.smithi161.stdout:6/833: truncate da/d19/dc2/d29/d2b/d31/ff4 653190 0 2023-12-09T02:35:23.441 INFO:tasks.workunit.client.1.smithi161.stdout:6/834: write da/d19/d20/f11a [730802,66900] 0 2023-12-09T02:35:23.445 INFO:tasks.workunit.client.1.smithi161.stdout:2/790: chown d4/d16/d69/fa3 53 1 2023-12-09T02:35:23.445 INFO:tasks.workunit.client.1.smithi161.stdout:5/878: dwrite d0/f18 [0,4194304] 0 2023-12-09T02:35:23.446 INFO:tasks.workunit.client.1.smithi161.stdout:8/723: dwrite d2/d5/d4f/f2a [4194304,4194304] 0 2023-12-09T02:35:23.446 INFO:tasks.workunit.client.1.smithi161.stdout:9/807: dread d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/f6c [4194304,4194304] 0 2023-12-09T02:35:23.447 INFO:tasks.workunit.client.1.smithi161.stdout:1/973: creat d6/d8/d63/d4d/d11d/f137 x:0 0 0 2023-12-09T02:35:23.447 INFO:tasks.workunit.client.1.smithi161.stdout:1/974: chown d6/d8/d63/d4d/d9f/ddc/d3d 55 1 2023-12-09T02:35:23.450 INFO:tasks.workunit.client.1.smithi161.stdout:7/710: rename d0/d3/daa/ld8 to d0/d3/d13/d1b/le5 0 2023-12-09T02:35:23.453 INFO:tasks.workunit.client.1.smithi161.stdout:3/781: link d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/lb1 d2/d51/d75/d11/d19/d91/d46/d2d/d47/d8c/le7 0 2023-12-09T02:35:23.454 INFO:tasks.workunit.client.1.smithi161.stdout:2/791: symlink d4/d7/db/l102 0 2023-12-09T02:35:23.455 INFO:tasks.workunit.client.1.smithi161.stdout:5/879: truncate d0/d2/de/d22/d8e/dfe/f114 812820 0 2023-12-09T02:35:23.455 INFO:tasks.workunit.client.1.smithi161.stdout:5/880: readlink d0/d2/d7/d11/d50/dfb/l122 0 2023-12-09T02:35:23.459 INFO:tasks.workunit.client.1.smithi161.stdout:8/724: getdents d2/d2d 0 2023-12-09T02:35:23.462 INFO:tasks.workunit.client.1.smithi161.stdout:1/975: creat d6/d8/d63/d4d/d31/d73/d47/db2/f138 x:0 0 0 2023-12-09T02:35:23.462 INFO:tasks.workunit.client.1.smithi161.stdout:1/976: fdatasync d6/d8/d63/d4d/d31/d80/d9c/ffd 0 2023-12-09T02:35:23.462 INFO:tasks.workunit.client.1.smithi161.stdout:1/977: chown d6/d8/d63/d4d/dd0/cf0 880090 1 2023-12-09T02:35:23.462 INFO:tasks.workunit.client.1.smithi161.stdout:7/711: rmdir d0/d3/d13/d4e/db2/dda 39 2023-12-09T02:35:23.468 INFO:tasks.workunit.client.1.smithi161.stdout:3/782: rename d2/d51/d75/d11/d19/d91/ld9 to d2/d51/d75/d11/d19/d91/d46/d40/dab/le8 0 2023-12-09T02:35:23.471 INFO:tasks.workunit.client.1.smithi161.stdout:5/881: mkdir d0/d2/d7/d11/d50/dfb/d139 0 2023-12-09T02:35:23.473 INFO:tasks.workunit.client.1.smithi161.stdout:2/792: dread d4/d1a/f35 [0,4194304] 0 2023-12-09T02:35:23.478 INFO:tasks.workunit.client.1.smithi161.stdout:8/725: write d2/d5/d22/d31/d38/d66/d88/da1/fa6 [4024608,47800] 0 2023-12-09T02:35:23.479 INFO:tasks.workunit.client.1.smithi161.stdout:1/978: mkdir d6/d9/d8b/dba/d126/d135/d139 0 2023-12-09T02:35:23.480 INFO:tasks.workunit.client.1.smithi161.stdout:7/712: dwrite d0/d3/d13/d4e/db2/da7/fb3 [0,4194304] 0 2023-12-09T02:35:23.480 INFO:tasks.workunit.client.1.smithi161.stdout:6/835: dwrite da/d55/d6d/fa1 [0,4194304] 0 2023-12-09T02:35:23.480 INFO:tasks.workunit.client.1.smithi161.stdout:0/823: dwrite d9/d55/d26/d28/d58/f93 [0,4194304] 0 2023-12-09T02:35:23.490 INFO:tasks.workunit.client.1.smithi161.stdout:8/726: rmdir d2/d5/d22/d31/da0 39 2023-12-09T02:35:23.494 INFO:tasks.workunit.client.1.smithi161.stdout:1/979: unlink d6/d8/d63/d4d/d9f/ddc/daa/fbe 0 2023-12-09T02:35:23.497 INFO:tasks.workunit.client.1.smithi161.stdout:3/783: rename d2/d51/d75/d11/d19/d91/d46/d40 to d2/daf/de9 0 2023-12-09T02:35:23.503 INFO:tasks.workunit.client.1.smithi161.stdout:7/713: mkdir d0/d3/d13/d4e/db2/dda/de6 0 2023-12-09T02:35:23.506 INFO:tasks.workunit.client.1.smithi161.stdout:6/836: mknod da/d19/dc2/d77/c122 0 2023-12-09T02:35:23.509 INFO:tasks.workunit.client.1.smithi161.stdout:0/824: symlink d9/db/d2a/d35/dc2/l102 0 2023-12-09T02:35:23.512 INFO:tasks.workunit.client.1.smithi161.stdout:5/882: link d0/d2/d7/d11/d61/d107/d132/dcd/da8/lac d0/d2/de/d44/l13a 0 2023-12-09T02:35:23.518 INFO:tasks.workunit.client.1.smithi161.stdout:8/727: creat d2/d5/d22/d31/d38/d66/d88/da5/feb x:0 0 0 2023-12-09T02:35:23.519 INFO:tasks.workunit.client.1.smithi161.stdout:2/793: rename d4/d16/d69/d7b/f5c to d4/d16/f103 0 2023-12-09T02:35:23.519 INFO:tasks.workunit.client.1.smithi161.stdout:1/980: dwrite d6/d8/d63/d1c/f1e [0,4194304] 0 2023-12-09T02:35:23.520 INFO:tasks.workunit.client.1.smithi161.stdout:1/981: truncate d6/d49/ff8 915288 0 2023-12-09T02:35:23.521 INFO:tasks.workunit.client.1.smithi161.stdout:1/982: write d6/d8/d63/d93/f48 [31142,42274] 0 2023-12-09T02:35:23.521 INFO:tasks.workunit.client.1.smithi161.stdout:3/784: mkdir d2/d51/d75/d50/dea 0 2023-12-09T02:35:23.525 INFO:tasks.workunit.client.1.smithi161.stdout:7/714: rmdir d0/d3/daa 39 2023-12-09T02:35:23.526 INFO:tasks.workunit.client.1.smithi161.stdout:0/825: creat d9/d55/d44/d85/f103 x:0 0 0 2023-12-09T02:35:23.526 INFO:tasks.workunit.client.1.smithi161.stdout:0/826: fsync d9/d1f/dd4/fdc 0 2023-12-09T02:35:23.528 INFO:tasks.workunit.client.1.smithi161.stdout:5/883: dwrite d0/d2/d5f/f64 [0,4194304] 0 2023-12-09T02:35:23.530 INFO:tasks.workunit.client.1.smithi161.stdout:8/728: mkdir d2/d2d/dec 0 2023-12-09T02:35:23.530 INFO:tasks.workunit.client.1.smithi161.stdout:8/729: fsync d2/d5/d22/d31/d38/f3b 0 2023-12-09T02:35:23.530 INFO:tasks.workunit.client.1.smithi161.stdout:8/730: read - d2/fea zero size 2023-12-09T02:35:23.530 INFO:tasks.workunit.client.1.smithi161.stdout:8/731: truncate d2/d5/d22/fbf 110793 0 2023-12-09T02:35:23.533 INFO:tasks.workunit.client.1.smithi161.stdout:2/794: rmdir d4/d16/de0/df6 0 2023-12-09T02:35:23.533 INFO:tasks.workunit.client.1.smithi161.stdout:2/795: truncate d4/d16/f100 256842 0 2023-12-09T02:35:23.533 INFO:tasks.workunit.client.1.smithi161.stdout:2/796: stat d4/d1a/f40 0 2023-12-09T02:35:23.533 INFO:tasks.workunit.client.1.smithi161.stdout:2/797: truncate d4/fa 9250258 0 2023-12-09T02:35:23.538 INFO:tasks.workunit.client.1.smithi161.stdout:1/983: rename d6/d8/d63/d4d/d9f/d114/f116 to d6/d8/d63/d4d/d31/d73/d47/db2/d10d/f13a 0 2023-12-09T02:35:23.538 INFO:tasks.workunit.client.1.smithi161.stdout:1/984: dread - d6/d8/d63/d4d/d31/d73/f10f zero size 2023-12-09T02:35:23.539 INFO:tasks.workunit.client.1.smithi161.stdout:3/785: mknod d2/d51/dc0/ceb 0 2023-12-09T02:35:23.539 INFO:tasks.workunit.client.1.smithi161.stdout:3/786: stat d2/d51/d75/d11/d19/d91/f2f 0 2023-12-09T02:35:23.539 INFO:tasks.workunit.client.1.smithi161.stdout:0/827: truncate d9/d55/d7c/f2b 1707184 0 2023-12-09T02:35:23.539 INFO:tasks.workunit.client.1.smithi161.stdout:0/828: readlink d9/dd/d71/lb3 0 2023-12-09T02:35:23.539 INFO:tasks.workunit.client.1.smithi161.stdout:5/884: getdents d0/d2/de/d22 0 2023-12-09T02:35:23.540 INFO:tasks.workunit.client.1.smithi161.stdout:5/885: write d0/d2/d7/d9a/fc8 [1376250,147] 0 2023-12-09T02:35:23.540 INFO:tasks.workunit.client.1.smithi161.stdout:5/886: truncate d0/d2/de/d44/dff/f102 384820 0 2023-12-09T02:35:23.541 INFO:tasks.workunit.client.1.smithi161.stdout:7/715: dwrite d0/d49/f4c [4194304,4194304] 0 2023-12-09T02:35:23.541 INFO:tasks.workunit.client.1.smithi161.stdout:7/716: stat d0/d3/d13/d1b 0 2023-12-09T02:35:23.542 INFO:tasks.workunit.client.1.smithi161.stdout:1/985: mkdir d6/d8/d63/d4d/d9f/d13b 0 2023-12-09T02:35:23.542 INFO:tasks.workunit.client.1.smithi161.stdout:3/787: mknod d2/d51/d75/d11/d1f/d4c/cec 0 2023-12-09T02:35:23.542 INFO:tasks.workunit.client.1.smithi161.stdout:8/732: dread d2/d5/d22/d31/d38/d48/f5a [0,4194304] 0 2023-12-09T02:35:23.543 INFO:tasks.workunit.client.1.smithi161.stdout:0/829: rmdir d9/db/d2a/d9d 39 2023-12-09T02:35:23.544 INFO:tasks.workunit.client.1.smithi161.stdout:2/798: truncate d4/d16/d69/ff9 3766997 0 2023-12-09T02:35:23.545 INFO:tasks.workunit.client.1.smithi161.stdout:5/887: symlink d0/d2/d7/d11/dc3/l13b 0 2023-12-09T02:35:23.545 INFO:tasks.workunit.client.1.smithi161.stdout:5/888: chown d0/d2/de/d44/ddd/f10b 101424013 1 2023-12-09T02:35:23.545 INFO:tasks.workunit.client.1.smithi161.stdout:5/889: write d0/d2/de/d22/faa [5178476,39183] 0 2023-12-09T02:35:23.546 INFO:tasks.workunit.client.1.smithi161.stdout:7/717: dread d0/d3/d13/d4e/db2/dda/d4b/f75 [0,4194304] 0 2023-12-09T02:35:23.546 INFO:tasks.workunit.client.1.smithi161.stdout:1/986: mkdir d6/d8/d63/d4d/d9f/ddc/d3d/dc3/d13c 0 2023-12-09T02:35:23.546 INFO:tasks.workunit.client.1.smithi161.stdout:1/987: getdents d6/d8/d63/d4d/dd0/d133 0 2023-12-09T02:35:23.547 INFO:tasks.workunit.client.1.smithi161.stdout:8/733: getdents d2/d5/d22/d31/d38 0 2023-12-09T02:35:23.548 INFO:tasks.workunit.client.1.smithi161.stdout:8/734: write d2/d5/d22/d31/d38/f79 [5138455,109013] 0 2023-12-09T02:35:23.548 INFO:tasks.workunit.client.1.smithi161.stdout:8/735: chown d2/d2d/ce8 123 1 2023-12-09T02:35:23.549 INFO:tasks.workunit.client.1.smithi161.stdout:0/830: mkdir d9/dd/d3a/d104 0 2023-12-09T02:35:23.550 INFO:tasks.workunit.client.1.smithi161.stdout:1/988: write d6/d8/d63/d4d/d31/d73/d47/d102/f8c [2220800,129318] 0 2023-12-09T02:35:23.553 INFO:tasks.workunit.client.1.smithi161.stdout:0/831: dread d9/d55/d26/fa7 [0,4194304] 0 2023-12-09T02:35:23.553 INFO:tasks.workunit.client.1.smithi161.stdout:0/832: chown d9/db/d2a/d35/d7b/f9b 267096761 1 2023-12-09T02:35:23.553 INFO:tasks.workunit.client.1.smithi161.stdout:1/989: write d6/d8/d63/d4d/d31/d73/d47/db2/fd3 [798424,33132] 0 2023-12-09T02:35:23.558 INFO:tasks.workunit.client.1.smithi161.stdout:8/736: symlink d2/d5/d22/d31/da0/led 0 2023-12-09T02:35:23.561 INFO:tasks.workunit.client.1.smithi161.stdout:0/833: rmdir d9/d55/d86/dee 0 2023-12-09T02:35:23.561 INFO:tasks.workunit.client.1.smithi161.stdout:0/834: fsync d9/d55/d44/ddf/f100 0 2023-12-09T02:35:23.562 INFO:tasks.workunit.client.1.smithi161.stdout:7/718: dwrite d0/d3/d13/d4e/db2/dda/dcb/db4/fb6 [0,4194304] 0 2023-12-09T02:35:23.562 INFO:tasks.workunit.client.1.smithi161.stdout:1/990: mknod d6/d8/d63/d4d/d31/d73/d12f/c13d 0 2023-12-09T02:35:23.565 INFO:tasks.workunit.client.1.smithi161.stdout:8/737: rename d2/d5/d4f/l27 to d2/d5/d22/d54/db4/dcd/de3/lee 0 2023-12-09T02:35:23.576 INFO:tasks.workunit.client.1.smithi161.stdout:0/835: dread d9/d55/d26/d28/daa/fc4 [0,4194304] 0 2023-12-09T02:35:23.580 INFO:tasks.workunit.client.1.smithi161.stdout:7/719: rename d0/d3/d13/d4e/db2/f41 to d0/d3/d13/d4e/db2/da7/fe7 0 2023-12-09T02:35:23.582 INFO:tasks.workunit.client.1.smithi161.stdout:2/799: dread d4/d7/f15 [0,4194304] 0 2023-12-09T02:35:23.582 INFO:tasks.workunit.client.1.smithi161.stdout:2/800: chown d4/fa0 125162804 1 2023-12-09T02:35:23.585 INFO:tasks.workunit.client.1.smithi161.stdout:1/991: rename d6/d9/dd6/d113 to d6/d8/d63/d1c/d8a/dcd/d9d/d13e 0 2023-12-09T02:35:23.586 INFO:tasks.workunit.client.1.smithi161.stdout:8/738: dwrite d2/d5/d22/f49 [0,4194304] 0 2023-12-09T02:35:23.596 INFO:tasks.workunit.client.1.smithi161.stdout:2/801: symlink d4/d1a/d4a/de3/l104 0 2023-12-09T02:35:23.596 INFO:tasks.workunit.client.1.smithi161.stdout:2/802: fdatasync d4/fda 0 2023-12-09T02:35:23.596 INFO:tasks.workunit.client.1.smithi161.stdout:5/890: truncate d0/d2/de/d22/d8e/dfe/f114 260810 0 2023-12-09T02:35:23.602 INFO:tasks.workunit.client.1.smithi161.stdout:8/739: dread d2/d5/d4f/f2a [4194304,4194304] 0 2023-12-09T02:35:23.602 INFO:tasks.workunit.client.1.smithi161.stdout:8/740: chown d2/f6 273388034 1 2023-12-09T02:35:23.603 INFO:tasks.workunit.client.1.smithi161.stdout:2/803: getdents d4 0 2023-12-09T02:35:23.607 INFO:tasks.workunit.client.1.smithi161.stdout:0/836: dwrite d9/dd/dca/fef [0,4194304] 0 2023-12-09T02:35:23.607 INFO:tasks.workunit.client.1.smithi161.stdout:0/837: fsync d9/d55/d7c/f2b 0 2023-12-09T02:35:23.607 INFO:tasks.workunit.client.1.smithi161.stdout:8/741: rename d2/d5/d22/d31/d38/d84/cbe to d2/d5/d22/d54/db4/cef 0 2023-12-09T02:35:23.607 INFO:tasks.workunit.client.1.smithi161.stdout:8/742: read - d2/d5/d4f/f82 zero size 2023-12-09T02:35:23.607 INFO:tasks.workunit.client.1.smithi161.stdout:8/743: getdents d2/d2d/dec 0 2023-12-09T02:35:23.607 INFO:tasks.workunit.client.1.smithi161.stdout:8/744: write d2/d8a/fc1 [875385,116222] 0 2023-12-09T02:35:23.607 INFO:tasks.workunit.client.1.smithi161.stdout:8/745: chown d2/d5/d22/d31/d38/d48/c56 94 1 2023-12-09T02:35:23.608 INFO:tasks.workunit.client.1.smithi161.stdout:7/720: dwrite d0/fc1 [0,4194304] 0 2023-12-09T02:35:23.608 INFO:tasks.workunit.client.1.smithi161.stdout:0/838: symlink d9/db/df1/l105 0 2023-12-09T02:35:23.609 INFO:tasks.workunit.client.1.smithi161.stdout:0/839: chown d9/d55/d7c/f38 99 1 2023-12-09T02:35:23.610 INFO:tasks.workunit.client.1.smithi161.stdout:7/721: symlink d0/d3/le8 0 2023-12-09T02:35:23.611 INFO:tasks.workunit.client.1.smithi161.stdout:0/840: link d9/d55/d7c/f6c d9/d55/d5a/db1/f106 0 2023-12-09T02:35:23.611 INFO:tasks.workunit.client.1.smithi161.stdout:2/804: dread d4/d7/db/f19 [0,4194304] 0 2023-12-09T02:35:23.612 INFO:tasks.workunit.client.1.smithi161.stdout:7/722: mknod d0/d3/d13/dc7/dc8/dd9/ce9 0 2023-12-09T02:35:23.613 INFO:tasks.workunit.client.1.smithi161.stdout:7/723: chown d0/d3/d21/c9d 5795 1 2023-12-09T02:35:23.613 INFO:tasks.workunit.client.1.smithi161.stdout:2/805: mknod d4/d16/d69/d8c/d87/c105 0 2023-12-09T02:35:23.614 INFO:tasks.workunit.client.1.smithi161.stdout:1/992: dwrite d6/d8/d63/d1c/f41 [0,4194304] 0 2023-12-09T02:35:23.615 INFO:tasks.workunit.client.1.smithi161.stdout:7/724: unlink d0/d3/d13/d1b/c69 0 2023-12-09T02:35:23.616 INFO:tasks.workunit.client.1.smithi161.stdout:7/725: dread d0/d3/d13/d4e/db2/dda/dcb/d59/d5e/fa6 [0,4194304] 0 2023-12-09T02:35:23.616 INFO:tasks.workunit.client.1.smithi161.stdout:7/726: write d0/d3/d13/d4e/db2/f4f [4761889,78919] 0 2023-12-09T02:35:23.616 INFO:tasks.workunit.client.1.smithi161.stdout:2/806: mkdir d4/d16/de0/d106 0 2023-12-09T02:35:23.618 INFO:tasks.workunit.client.1.smithi161.stdout:1/993: symlink d6/d9/l13f 0 2023-12-09T02:35:23.618 INFO:tasks.workunit.client.1.smithi161.stdout:1/994: write d6/f101 [1109572,86641] 0 2023-12-09T02:35:23.618 INFO:tasks.workunit.client.1.smithi161.stdout:1/995: stat d6/d9/d5c/le8 0 2023-12-09T02:35:23.619 INFO:tasks.workunit.client.1.smithi161.stdout:5/891: dwrite d0/d2/d7/d11/d61/d107/d132/dcd/da8/fc2 [0,4194304] 0 2023-12-09T02:35:23.619 INFO:tasks.workunit.client.1.smithi161.stdout:5/892: fdatasync d0/d2/d7/d11/d61/d107/d132/dcd/f95 0 2023-12-09T02:35:23.619 INFO:tasks.workunit.client.1.smithi161.stdout:5/893: chown d0/f116 5197 1 2023-12-09T02:35:23.622 INFO:tasks.workunit.client.1.smithi161.stdout:8/746: dread d2/d5/d22/f98 [0,4194304] 0 2023-12-09T02:35:23.622 INFO:tasks.workunit.client.1.smithi161.stdout:8/747: chown d2/c67 15 1 2023-12-09T02:35:23.623 INFO:tasks.workunit.client.1.smithi161.stdout:0/841: dread d9/db/f3e [0,4194304] 0 2023-12-09T02:35:23.627 INFO:tasks.workunit.client.1.smithi161.stdout:7/727: symlink d0/d3/d13/d4e/d70/lea 0 2023-12-09T02:35:23.627 INFO:tasks.workunit.client.1.smithi161.stdout:7/728: chown d0/d3/d6c/dbe/ld3 3470572 1 2023-12-09T02:35:23.630 INFO:tasks.workunit.client.1.smithi161.stdout:5/894: symlink d0/d2/d7/d11/d50/dfb/d139/l13c 0 2023-12-09T02:35:23.630 INFO:tasks.workunit.client.1.smithi161.stdout:5/895: fsync d0/d2/d7/d11/d61/d107/d132/dcd/f95 0 2023-12-09T02:35:23.630 INFO:tasks.workunit.client.1.smithi161.stdout:5/896: readlink d0/d2/d7/d11/d61/d107/d132/dcd/d83/dfa/d125/l98 0 2023-12-09T02:35:23.631 INFO:tasks.workunit.client.1.smithi161.stdout:5/897: fdatasync d0/d2/d7/df/f96 0 2023-12-09T02:35:23.631 INFO:tasks.workunit.client.1.smithi161.stdout:1/996: dread d6/d8/d63/d4d/d31/d73/f9b [0,4194304] 0 2023-12-09T02:35:23.631 INFO:tasks.workunit.client.1.smithi161.stdout:8/748: mkdir d2/d8a/dbd/df0 0 2023-12-09T02:35:23.632 INFO:tasks.workunit.client.1.smithi161.stdout:2/807: dwrite d4/d16/d69/d8c/fbd [0,4194304] 0 2023-12-09T02:35:23.635 INFO:tasks.workunit.client.1.smithi161.stdout:0/842: link d9/d55/d44/d85/c8d d9/db/d2a/d35/de3/c107 0 2023-12-09T02:35:23.639 INFO:tasks.workunit.client.1.smithi161.stdout:7/729: link d0/d3/d13/d4e/db2/dda/dab/c4d d0/d3/d13/d4e/db2/dda/dcb/db4/ceb 0 2023-12-09T02:35:23.639 INFO:tasks.workunit.client.1.smithi161.stdout:7/730: dread - d0/d3/d13/d4e/db5/d83/fcd zero size 2023-12-09T02:35:23.639 INFO:tasks.workunit.client.1.smithi161.stdout:7/731: read d0/d3/d13/d2d/f45 [2560729,30358] 0 2023-12-09T02:35:23.643 INFO:tasks.workunit.client.1.smithi161.stdout:5/898: creat d0/d2/de/d22/d128/f13d x:0 0 0 2023-12-09T02:35:23.643 INFO:tasks.workunit.client.1.smithi161.stdout:5/899: chown d0/d2/de/d44/da6/lb5 1334450 1 2023-12-09T02:35:23.644 INFO:tasks.workunit.client.1.smithi161.stdout:1/997: mkdir d6/d9/d8b/dba/d126/d135/d139/d140 0 2023-12-09T02:35:23.656 INFO:tasks.workunit.client.1.smithi161.stdout:7/732: dwrite d0/d3/d13/d4e/db2/dda/d4b/d5a/f6b [0,4194304] 0 2023-12-09T02:35:23.667 INFO:tasks.workunit.client.1.smithi161.stdout:8/749: symlink d2/d5/d22/d31/d38/d66/d88/lf1 0 2023-12-09T02:35:23.670 INFO:tasks.workunit.client.1.smithi161.stdout:2/808: mkdir d4/d7/d8f/dd2/d107 0 2023-12-09T02:35:23.670 INFO:tasks.workunit.client.1.smithi161.stdout:2/809: write d4/fa0 [1781529,95629] 0 2023-12-09T02:35:23.671 INFO:tasks.workunit.client.1.smithi161.stdout:2/810: chown d4/d1a/dc2/fdb 6350825 1 2023-12-09T02:35:23.672 INFO:tasks.workunit.client.1.smithi161.stdout:0/843: creat d9/f108 x:0 0 0 2023-12-09T02:35:23.672 INFO:tasks.workunit.client.1.smithi161.stdout:0/844: fsync d9/d9c/fc8 0 2023-12-09T02:35:23.673 INFO:tasks.workunit.client.1.smithi161.stdout:5/900: mkdir d0/d2/d7/df3/d13e 0 2023-12-09T02:35:23.673 INFO:tasks.workunit.client.1.smithi161.stdout:5/901: read - d0/d2/d7/d11/d61/d107/d132/fa1 zero size 2023-12-09T02:35:23.673 INFO:tasks.workunit.client.1.smithi161.stdout:5/902: stat d0/d2/d7/d11/ldc 0 2023-12-09T02:35:23.674 INFO:tasks.workunit.client.1.smithi161.stdout:2/811: dread d4/d1a/d4a/d6d/f7a [0,4194304] 0 2023-12-09T02:35:23.677 INFO:tasks.workunit.client.1.smithi161.stdout:1/998: symlink d6/d9/d8b/dba/d129/dff/l141 0 2023-12-09T02:35:23.681 INFO:tasks.workunit.client.1.smithi161.stdout:8/750: creat d2/d5/d22/d54/db4/dcd/ff2 x:0 0 0 2023-12-09T02:35:23.681 INFO:tasks.workunit.client.1.smithi161.stdout:8/751: dread - d2/d5/d22/d54/db4/dcd/ff2 zero size 2023-12-09T02:35:23.681 INFO:tasks.workunit.client.1.smithi161.stdout:5/903: mkdir d0/d2/d7/d11/d50/d13f 0 2023-12-09T02:35:23.681 INFO:tasks.workunit.client.1.smithi161.stdout:5/904: fdatasync d0/d2/d7/d11/d61/d107/d132/dcd/f93 0 2023-12-09T02:35:23.682 INFO:tasks.workunit.client.1.smithi161.stdout:2/812: rmdir d4/da6/db9 39 2023-12-09T02:35:23.683 INFO:tasks.workunit.client.1.smithi161.stdout:8/752: rmdir d2/d5/d22/d31/d38/d66 39 2023-12-09T02:35:23.683 INFO:tasks.workunit.client.1.smithi161.stdout:8/753: write d2/d5/fa [1053202,25417] 0 2023-12-09T02:35:23.684 INFO:tasks.workunit.client.1.smithi161.stdout:5/905: symlink d0/d2/d7/d11/d61/d107/d132/l140 0 2023-12-09T02:35:23.686 INFO:tasks.workunit.client.1.smithi161.stdout:8/754: truncate d2/d5/d22/d86/fa4 432545 0 2023-12-09T02:35:23.688 INFO:tasks.workunit.client.1.smithi161.stdout:5/906: rmdir d0/d2/de/d22/d128 39 2023-12-09T02:35:23.688 INFO:tasks.workunit.client.1.smithi161.stdout:7/733: dwrite d0/d3/d13/f56 [0,4194304] 0 2023-12-09T02:35:23.692 INFO:tasks.workunit.client.1.smithi161.stdout:5/907: write d0/d9/f6a [3219081,68939] 0 2023-12-09T02:35:23.692 INFO:tasks.workunit.client.1.smithi161.stdout:5/908: chown d0/d2/d7/d11/d61/d107/d132/dcd/d83/lcf 118 1 2023-12-09T02:35:23.693 INFO:tasks.workunit.client.1.smithi161.stdout:8/755: creat d2/d5/d22/d86/dd6/dd7/ff3 x:0 0 0 2023-12-09T02:35:23.693 INFO:tasks.workunit.client.1.smithi161.stdout:0/845: dwrite d9/d55/d44/d85/fce [0,4194304] 0 2023-12-09T02:35:23.700 INFO:tasks.workunit.client.1.smithi161.stdout:5/909: symlink d0/d2/d7/d11/d61/l141 0 2023-12-09T02:35:23.702 INFO:tasks.workunit.client.1.smithi161.stdout:7/734: dwrite d0/d3/d13/d4e/db2/dda/d4b/d5a/fc6 [0,4194304] 0 2023-12-09T02:35:23.703 INFO:tasks.workunit.client.1.smithi161.stdout:8/756: rmdir d2/d8a/dbd/ddb 0 2023-12-09T02:35:23.704 INFO:tasks.workunit.client.1.smithi161.stdout:0/846: mknod d9/db/d2a/d35/de3/c109 0 2023-12-09T02:35:23.706 INFO:tasks.workunit.client.1.smithi161.stdout:5/910: symlink d0/l142 0 2023-12-09T02:35:23.708 INFO:tasks.workunit.client.1.smithi161.stdout:5/911: write d0/d2/d7/d11/d61/d107/d132/dcd/d83/dfa/d125/fc1 [121074,63127] 0 2023-12-09T02:35:23.708 INFO:tasks.workunit.client.1.smithi161.stdout:7/735: creat d0/d3/d13/d4e/db2/dda/d4b/fec x:0 0 0 2023-12-09T02:35:23.709 INFO:tasks.workunit.client.1.smithi161.stdout:5/912: write d0/d2/d5f/fd1 [1529374,49063] 0 2023-12-09T02:35:23.712 INFO:tasks.workunit.client.1.smithi161.stdout:8/757: creat d2/d2d/ff4 x:0 0 0 2023-12-09T02:35:23.712 INFO:tasks.workunit.client.1.smithi161.stdout:8/758: chown d2/d5/d4f/db2/da9/fce 1 1 2023-12-09T02:35:23.712 INFO:tasks.workunit.client.1.smithi161.stdout:8/759: write d2/d5/d22/d31/d38/d66/d88/da5/feb [774270,21908] 0 2023-12-09T02:35:23.712 INFO:tasks.workunit.client.1.smithi161.stdout:8/760: readlink d2/d5/d22/d31/da0/led 0 2023-12-09T02:35:23.712 INFO:tasks.workunit.client.1.smithi161.stdout:0/847: rmdir d9/d55/d5a/db1 39 2023-12-09T02:35:23.716 INFO:tasks.workunit.client.1.smithi161.stdout:5/913: rename d0/d2/de/d22/d55/c77 to d0/d2/de/c143 0 2023-12-09T02:35:23.717 INFO:tasks.workunit.client.1.smithi161.stdout:8/761: getdents d2/d5/d22/d54/db4 0 2023-12-09T02:35:23.717 INFO:tasks.workunit.client.1.smithi161.stdout:8/762: stat d2/d5/d22/d31/f37 0 2023-12-09T02:35:23.719 INFO:tasks.workunit.client.1.smithi161.stdout:5/914: rmdir d0/d2/de/d21/dce 39 2023-12-09T02:35:23.723 INFO:tasks.workunit.client.1.smithi161.stdout:8/763: rename d2/d5/d22/d31/da0/led to d2/d5/d22/d86/dd6/lf5 0 2023-12-09T02:35:23.723 INFO:tasks.workunit.client.1.smithi161.stdout:5/915: creat d0/d2/d7/d11/d50/d8a/f144 x:0 0 0 2023-12-09T02:35:23.725 INFO:tasks.workunit.client.1.smithi161.stdout:8/764: getdents d2/d5/d22/d31/d38/d66/d88/da5 0 2023-12-09T02:35:23.726 INFO:tasks.workunit.client.1.smithi161.stdout:5/916: rmdir d0 39 2023-12-09T02:35:23.726 INFO:tasks.workunit.client.1.smithi161.stdout:5/917: fdatasync d0/d2/d7/df/f96 0 2023-12-09T02:35:23.728 INFO:tasks.workunit.client.1.smithi161.stdout:8/765: creat d2/d5/d22/dc3/ff6 x:0 0 0 2023-12-09T02:35:23.729 INFO:tasks.workunit.client.1.smithi161.stdout:5/918: mkdir d0/d2/d7/d11/d50/d8a/d145 0 2023-12-09T02:35:23.732 INFO:tasks.workunit.client.1.smithi161.stdout:8/766: rmdir d2/d5/d22/d86/d97/de0 0 2023-12-09T02:35:23.732 INFO:tasks.workunit.client.1.smithi161.stdout:7/736: dwrite d0/d3/d21/d54/f64 [0,4194304] 0 2023-12-09T02:35:23.733 INFO:tasks.workunit.client.1.smithi161.stdout:5/919: creat d0/d2/de/d44/d12f/f146 x:0 0 0 2023-12-09T02:35:23.737 INFO:tasks.workunit.client.1.smithi161.stdout:8/767: symlink d2/d5/dc0/lf7 0 2023-12-09T02:35:23.745 INFO:tasks.workunit.client.1.smithi161.stdout:8/768: dread d2/d5/d22/fa3 [0,4194304] 0 2023-12-09T02:35:23.746 INFO:tasks.workunit.client.1.smithi161.stdout:5/920: mknod d0/d2/d7/d11/d61/d107/d132/c147 0 2023-12-09T02:35:23.746 INFO:tasks.workunit.client.1.smithi161.stdout:5/921: truncate d0/d2/d7/d11/d50/dfb/ffc 189436 0 2023-12-09T02:35:23.746 INFO:tasks.workunit.client.1.smithi161.stdout:5/922: write d0/d2/d7/df3/f127 [505110,45681] 0 2023-12-09T02:35:23.746 INFO:tasks.workunit.client.1.smithi161.stdout:7/737: dwrite d0/f42 [0,4194304] 0 2023-12-09T02:35:23.746 INFO:tasks.workunit.client.1.smithi161.stdout:7/738: fdatasync d0/d3/d13/d4e/db5/d83/fcd 0 2023-12-09T02:35:23.749 INFO:tasks.workunit.client.1.smithi161.stdout:5/923: write d0/d2/d7/d11/d61/d107/d132/dcd/f95 [574559,71389] 0 2023-12-09T02:35:23.777 INFO:tasks.workunit.client.1.smithi161.stdout:8/769: dwrite d2/d5/d22/d31/d38/d48/f75 [0,4194304] 0 2023-12-09T02:35:23.777 INFO:tasks.workunit.client.1.smithi161.stdout:7/739: dwrite d0/d3/d13/d4e/db2/dda/d4b/d5a/f6b [0,4194304] 0 2023-12-09T02:35:23.777 INFO:tasks.workunit.client.1.smithi161.stdout:7/740: readlink d0/d3/d13/d4e/d70/l9b 0 2023-12-09T02:35:23.778 INFO:tasks.workunit.client.1.smithi161.stdout:7/741: chown d0/d3/d13/dc7 10 1 2023-12-09T02:35:23.780 INFO:tasks.workunit.client.1.smithi161.stdout:5/924: dwrite d0/f69 [0,4194304] 0 2023-12-09T02:35:23.782 INFO:tasks.workunit.client.1.smithi161.stdout:7/742: rename d0/d3/d13/d4e/db2/dda/dcb/db4/ceb to d0/d3/d13/d4e/db2/ced 0 2023-12-09T02:35:23.785 INFO:tasks.workunit.client.1.smithi161.stdout:5/925: mknod d0/d2/d7/d11/d61/d107/d132/c148 0 2023-12-09T02:35:23.787 INFO:tasks.workunit.client.1.smithi161.stdout:8/770: dread d2/d5/d22/d31/f37 [4194304,4194304] 0 2023-12-09T02:35:23.789 INFO:tasks.workunit.client.1.smithi161.stdout:8/771: symlink d2/d5/d22/d86/lf8 0 2023-12-09T02:35:23.789 INFO:tasks.workunit.client.1.smithi161.stdout:8/772: write d2/d5/d22/d31/fc2 [5091689,77852] 0 2023-12-09T02:35:23.793 INFO:tasks.workunit.client.1.smithi161.stdout:7/743: dread d0/d3/d13/d4e/db5/fa1 [0,4194304] 0 2023-12-09T02:35:23.793 INFO:tasks.workunit.client.1.smithi161.stdout:7/744: chown d0/d3/d13/f34 41605512 1 2023-12-09T02:35:23.800 INFO:tasks.workunit.client.1.smithi161.stdout:8/773: dread d2/d5/d4f/f35 [0,4194304] 0 2023-12-09T02:35:23.801 INFO:tasks.workunit.client.1.smithi161.stdout:5/926: dwrite d0/d2/d7/d11/d61/d107/d132/dcd/d83/dfa/d125/f42 [0,4194304] 0 2023-12-09T02:35:23.802 INFO:tasks.workunit.client.1.smithi161.stdout:8/774: mkdir d2/d5/d22/d54/db4/df9 0 2023-12-09T02:35:23.804 INFO:tasks.workunit.client.1.smithi161.stdout:5/927: mknod d0/d2/d7/d11/d61/d107/c149 0 2023-12-09T02:35:23.804 INFO:tasks.workunit.client.1.smithi161.stdout:5/928: write d0/d2/d7/d11/d50/d8a/f144 [819179,118198] 0 2023-12-09T02:35:23.806 INFO:tasks.workunit.client.1.smithi161.stdout:8/775: mkdir d2/d5/d22/d31/da0/dfa 0 2023-12-09T02:35:23.809 INFO:tasks.workunit.client.1.smithi161.stdout:8/776: link d2/d5/d22/d86/dd6/fe7 d2/d5/d22/d54/db4/dcd/ffb 0 2023-12-09T02:35:23.810 INFO:tasks.workunit.client.1.smithi161.stdout:5/929: write d0/d2/f57 [1016418,73478] 0 2023-12-09T02:35:23.812 INFO:tasks.workunit.client.1.smithi161.stdout:8/777: getdents d2/d8a 0 2023-12-09T02:35:23.813 INFO:tasks.workunit.client.1.smithi161.stdout:5/930: unlink d0/d2/de/d44/dff/de5/ff2 0 2023-12-09T02:35:23.816 INFO:tasks.workunit.client.1.smithi161.stdout:8/778: symlink d2/d5/d3d/dc7/lfc 0 2023-12-09T02:35:23.818 INFO:tasks.workunit.client.1.smithi161.stdout:5/931: rename d0/d2/d7/d11/d61/d107/d132/fab to d0/d2/d7/df3/f14a 0 2023-12-09T02:35:23.819 INFO:tasks.workunit.client.1.smithi161.stdout:8/779: symlink d2/d5/d22/lfd 0 2023-12-09T02:35:23.820 INFO:tasks.workunit.client.1.smithi161.stdout:5/932: rmdir d0/d2/d7/df 39 2023-12-09T02:35:23.821 INFO:tasks.workunit.client.1.smithi161.stdout:8/780: creat d2/d5/d3d/dc7/ffe x:0 0 0 2023-12-09T02:35:23.821 INFO:tasks.workunit.client.1.smithi161.stdout:8/781: fdatasync d2/d5/d4f/db2/da9/fce 0 2023-12-09T02:35:23.822 INFO:tasks.workunit.client.1.smithi161.stdout:8/782: write d2/d5/d22/d31/d38/f79 [4808811,43375] 0 2023-12-09T02:35:23.823 INFO:tasks.workunit.client.1.smithi161.stdout:8/783: getdents d2/d5/dc0 0 2023-12-09T02:35:23.825 INFO:tasks.workunit.client.1.smithi161.stdout:8/784: mkdir d2/d5/d22/d54/db4/df9/dff 0 2023-12-09T02:35:23.826 INFO:tasks.workunit.client.1.smithi161.stdout:8/785: unlink d2/d2d/l9c 0 2023-12-09T02:35:23.826 INFO:tasks.workunit.client.1.smithi161.stdout:8/786: chown d2/d5/d22/d31/d38/d66/d88/da5/fae 1700846 1 2023-12-09T02:35:23.827 INFO:tasks.workunit.client.1.smithi161.stdout:8/787: mkdir d2/d5/d22/d31/d38/d66/d100 0 2023-12-09T02:35:23.828 INFO:tasks.workunit.client.1.smithi161.stdout:8/788: write d2/d5/d4f/f2c [1695958,67498] 0 2023-12-09T02:35:23.829 INFO:tasks.workunit.client.1.smithi161.stdout:8/789: write d2/d5/d22/d31/d38/d48/f69 [1555536,52996] 0 2023-12-09T02:35:23.830 INFO:tasks.workunit.client.1.smithi161.stdout:8/790: symlink d2/d5/d3d/l101 0 2023-12-09T02:35:23.848 INFO:tasks.workunit.client.1.smithi161.stdout:7/745: dwrite d0/d3/d13/d4e/db2/da7/fb3 [0,4194304] 0 2023-12-09T02:35:23.851 INFO:tasks.workunit.client.1.smithi161.stdout:8/791: dwrite d2/d5/d22/dc3/ff6 [0,4194304] 0 2023-12-09T02:35:23.851 INFO:tasks.workunit.client.1.smithi161.stdout:8/792: chown d2/d5/d3d/fd9 219316 1 2023-12-09T02:35:23.855 INFO:tasks.workunit.client.1.smithi161.stdout:8/793: mkdir d2/d5/d4f/d102 0 2023-12-09T02:35:23.855 INFO:tasks.workunit.client.1.smithi161.stdout:8/794: fdatasync d2/d8a/fc1 0 2023-12-09T02:35:23.858 INFO:tasks.workunit.client.1.smithi161.stdout:8/795: creat d2/d5/d22/d54/db4/dcd/de3/f103 x:0 0 0 2023-12-09T02:35:23.861 INFO:tasks.workunit.client.1.smithi161.stdout:8/796: truncate d2/d5/d22/d31/d38/d66/d88/da5/fae 424298 0 2023-12-09T02:35:23.861 INFO:tasks.workunit.client.1.smithi161.stdout:7/746: dwrite d0/fc1 [0,4194304] 0 2023-12-09T02:35:23.865 INFO:tasks.workunit.client.1.smithi161.stdout:7/747: symlink d0/d3/d13/d4e/d70/lee 0 2023-12-09T02:35:23.865 INFO:tasks.workunit.client.1.smithi161.stdout:7/748: fdatasync d0/d3/d13/d4e/db2/dda/dcb/d59/d5e/f84 0 2023-12-09T02:35:23.872 INFO:tasks.workunit.client.1.smithi161.stdout:8/797: dread d2/d5/d22/dc3/ff6 [0,4194304] 0 2023-12-09T02:35:23.891 INFO:tasks.workunit.client.1.smithi161.stdout:7/749: dwrite d0/d3/d13/d4e/db2/dda/dab/f5c [0,4194304] 0 2023-12-09T02:35:23.892 INFO:tasks.workunit.client.1.smithi161.stdout:7/750: symlink d0/d49/d79/dc3/lef 0 2023-12-09T02:35:23.892 INFO:tasks.workunit.client.1.smithi161.stdout:7/751: dread - d0/d3/d13/d4e/db2/dda/dcb/d59/f86 zero size 2023-12-09T02:35:23.893 INFO:tasks.workunit.client.1.smithi161.stdout:7/752: rename d0/d3/d13/d4e/db2/dda/dab/cba to d0/d3/daa/cf0 0 2023-12-09T02:35:23.894 INFO:tasks.workunit.client.1.smithi161.stdout:7/753: creat d0/d49/d67/ff1 x:0 0 0 2023-12-09T02:35:23.894 INFO:tasks.workunit.client.1.smithi161.stdout:7/754: truncate d0/d3/d13/dc7/f8a 470896 0 2023-12-09T02:35:23.895 INFO:tasks.workunit.client.1.smithi161.stdout:8/798: dwrite d2/f3 [0,4194304] 0 2023-12-09T02:35:23.897 INFO:tasks.workunit.client.1.smithi161.stdout:8/799: truncate d2/d5/d22/d31/d38/d66/d88/da1/fa6 1955792 0 2023-12-09T02:35:23.898 INFO:tasks.workunit.client.1.smithi161.stdout:8/800: creat d2/d5/d3d/dc7/f104 x:0 0 0 2023-12-09T02:35:23.900 INFO:tasks.workunit.client.1.smithi161.stdout:8/801: dread d2/d5/d22/d86/fa4 [0,4194304] 0 2023-12-09T02:35:23.904 INFO:tasks.workunit.client.1.smithi161.stdout:8/802: rename d2/d5/d22/d31/caf to d2/d5/d4f/db2/c105 0 2023-12-09T02:35:23.904 INFO:tasks.workunit.client.1.smithi161.stdout:8/803: dread - d2/d5/d22/d86/dd6/fe7 zero size 2023-12-09T02:35:23.904 INFO:tasks.workunit.client.1.smithi161.stdout:8/804: chown d2/d2d/f57 98790 1 2023-12-09T02:35:23.908 INFO:tasks.workunit.client.1.smithi161.stdout:8/805: mkdir d2/d5/d22/d54/db4/df9/dff/d106 0 2023-12-09T02:35:23.911 INFO:tasks.workunit.client.1.smithi161.stdout:8/806: creat d2/d5/d4f/d102/f107 x:0 0 0 2023-12-09T02:35:23.914 INFO:tasks.workunit.client.1.smithi161.stdout:7/755: dwrite d0/d3/d21/f3b [0,4194304] 0 2023-12-09T02:35:23.917 INFO:tasks.workunit.client.1.smithi161.stdout:7/756: rename d0/d3/d13/d4e/db2/dda/dcb/db4 to d0/d3/daa/daf/de4/df2 0 2023-12-09T02:35:23.918 INFO:tasks.workunit.client.1.smithi161.stdout:7/757: write d0/d3/f8 [1204212,103929] 0 2023-12-09T02:35:23.919 INFO:tasks.workunit.client.1.smithi161.stdout:7/758: creat d0/d3/d13/d4e/db2/dda/dab/ff3 x:0 0 0 2023-12-09T02:35:23.919 INFO:tasks.workunit.client.1.smithi161.stdout:7/759: fdatasync d0/d3/d13/d4e/db5/fa1 0 2023-12-09T02:35:23.973 INFO:tasks.workunit.client.1.smithi161.stdout:8/807: dwrite d2/d5/d22/f81 [0,4194304] 0 2023-12-09T02:35:23.973 INFO:tasks.workunit.client.1.smithi161.stdout:8/808: chown d2/d5/d22/d54/db4/dcd/fd4 1 1 2023-12-09T02:35:23.978 INFO:tasks.workunit.client.1.smithi161.stdout:8/809: dread d2/d5/d22/d31/d38/f4d [0,4194304] 0 2023-12-09T02:35:23.991 INFO:tasks.workunit.client.1.smithi161.stdout:8/810: creat d2/d5/d22/d31/d38/d66/d100/f108 x:0 0 0 2023-12-09T02:35:23.991 INFO:tasks.workunit.client.1.smithi161.stdout:8/811: chown d2/d2d/l6e 1379 1 2023-12-09T02:35:23.997 INFO:tasks.workunit.client.1.smithi161.stdout:8/812: truncate d2/f17 7715916 0 2023-12-09T02:35:23.998 INFO:tasks.workunit.client.1.smithi161.stdout:8/813: dread d2/d5/f6b [0,4194304] 0 2023-12-09T02:35:24.005 INFO:tasks.workunit.client.1.smithi161.stdout:8/814: mknod d2/d5/d3d/c109 0 2023-12-09T02:35:24.005 INFO:tasks.workunit.client.1.smithi161.stdout:8/815: chown d2/l7f 1513946217 1 2023-12-09T02:35:24.005 INFO:tasks.workunit.client.1.smithi161.stdout:8/816: readlink d2/d5/d4f/db2/da9/lcb 0 2023-12-09T02:35:24.006 INFO:tasks.workunit.client.1.smithi161.stdout:8/817: dread d2/d5/d22/fbf [0,4194304] 0 2023-12-09T02:35:24.007 INFO:tasks.workunit.client.1.smithi161.stdout:8/818: mkdir d2/d5/d22/d86/dd0/d10a 0 2023-12-09T02:35:24.009 INFO:tasks.workunit.client.1.smithi161.stdout:8/819: creat d2/d5/d22/d54/db4/dcd/de3/f10b x:0 0 0 2023-12-09T02:35:24.009 INFO:tasks.workunit.client.1.smithi161.stdout:8/820: fsync d2/d5/f43 0 2023-12-09T02:35:24.011 INFO:tasks.workunit.client.1.smithi161.stdout:8/821: rename d2/d5/f16 to d2/d2d/f10c 0 2023-12-09T02:35:24.014 INFO:tasks.workunit.client.1.smithi161.stdout:8/822: mkdir d2/d5/d22/d31/d38/d66/d100/d10d 0 2023-12-09T02:35:24.017 INFO:tasks.workunit.client.1.smithi161.stdout:8/823: creat d2/d5/d4f/db2/f10e x:0 0 0 2023-12-09T02:35:24.017 INFO:tasks.workunit.client.1.smithi161.stdout:8/824: truncate d2/d5/d22/d31/da0/fb3 170456 0 2023-12-09T02:35:24.034 INFO:tasks.workunit.client.1.smithi161.stdout:8/825: rmdir d2 39 2023-12-09T02:35:24.035 INFO:tasks.workunit.client.1.smithi161.stdout:8/826: creat d2/d5/d22/d31/d38/d84/f10f x:0 0 0 2023-12-09T02:35:24.035 INFO:tasks.workunit.client.1.smithi161.stdout:8/827: chown d2/d5/d22 0 1 2023-12-09T02:35:24.037 INFO:tasks.workunit.client.1.smithi161.stdout:8/828: link d2/d5/d22/f90 d2/d5/d22/dc3/f110 0 2023-12-09T02:35:24.038 INFO:tasks.workunit.client.1.smithi161.stdout:8/829: creat d2/d5/d22/d31/d38/d66/d100/f111 x:0 0 0 2023-12-09T02:35:24.039 INFO:tasks.workunit.client.1.smithi161.stdout:8/830: rmdir d2/d5/d22/d31/da0 39 2023-12-09T02:35:24.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:24.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:24.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: pgmap v8: 65 pgs: 65 active+clean; 2.3 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 93 MiB/s wr, 203 op/s 2023-12-09T02:35:24.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:24.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:24.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:23 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:24.216 INFO:tasks.workunit.client.1.smithi161.stdout:9/808: sync 2023-12-09T02:35:24.217 INFO:tasks.workunit.client.1.smithi161.stdout:9/809: mknod d2/d25/db1/d65/d42/d58/d91/d2e/d80/d103/c120 0 2023-12-09T02:35:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: pgmap v8: 65 pgs: 65 active+clean; 2.3 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 93 MiB/s wr, 203 op/s 2023-12-09T02:35:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:24.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:24.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:23 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:24.236 INFO:tasks.workunit.client.1.smithi161.stdout:9/810: dwrite d2/d25/db1/d65/d5c/fcd [0,4194304] 0 2023-12-09T02:35:24.239 INFO:tasks.workunit.client.1.smithi161.stdout:9/811: dread d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/fdd [0,4194304] 0 2023-12-09T02:35:24.241 INFO:tasks.workunit.client.1.smithi161.stdout:9/812: creat d2/d25/db1/d65/d88/f121 x:0 0 0 2023-12-09T02:35:24.243 INFO:tasks.workunit.client.1.smithi161.stdout:9/813: unlink d2/d25/db1/d65/d100/f11a 0 2023-12-09T02:35:24.246 INFO:tasks.workunit.client.1.smithi161.stdout:9/814: mkdir d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/d122 0 2023-12-09T02:35:24.246 INFO:tasks.workunit.client.1.smithi161.stdout:9/815: chown d2/d25/db1/f85 199509 1 2023-12-09T02:35:24.247 INFO:tasks.workunit.client.1.smithi161.stdout:9/816: link d2/d25/dbf/l117 d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/l123 0 2023-12-09T02:35:24.285 INFO:tasks.workunit.client.1.smithi161.stdout:3/788: sync 2023-12-09T02:35:24.286 INFO:tasks.workunit.client.1.smithi161.stdout:6/837: sync 2023-12-09T02:35:24.286 INFO:tasks.workunit.client.1.smithi161.stdout:6/838: stat da/d19/dc2/d29/d2b 0 2023-12-09T02:35:24.286 INFO:tasks.workunit.client.1.smithi161.stdout:6/839: creat da/d19/dc2/d3c/db8/f123 x:0 0 0 2023-12-09T02:35:24.287 INFO:tasks.workunit.client.1.smithi161.stdout:6/840: chown da/d19/d20 0 1 2023-12-09T02:35:24.295 INFO:tasks.workunit.client.1.smithi161.stdout:3/789: dread d2/f82 [4194304,4194304] 0 2023-12-09T02:35:24.295 INFO:tasks.workunit.client.1.smithi161.stdout:3/790: fdatasync d2/d51/d75/d50/fe0 0 2023-12-09T02:35:24.295 INFO:tasks.workunit.client.1.smithi161.stdout:3/791: stat d2/d51/lc6 0 2023-12-09T02:35:24.296 INFO:tasks.workunit.client.1.smithi161.stdout:3/792: symlink d2/d51/d75/d11/d19/d91/d46/d2d/d47/de6/led 0 2023-12-09T02:35:24.304 INFO:tasks.workunit.client.1.smithi161.stdout:3/793: dread d2/d51/d75/d11/d19/f2e [0,4194304] 0 2023-12-09T02:35:24.306 INFO:tasks.workunit.client.1.smithi161.stdout:6/841: dwrite da/df/d2d/d49/fcc [0,4194304] 0 2023-12-09T02:35:24.308 INFO:tasks.workunit.client.1.smithi161.stdout:3/794: rename d2/d51/d75/d11/d19 to d2/d51/dee 0 2023-12-09T02:35:24.316 INFO:tasks.workunit.client.1.smithi161.stdout:6/842: mknod da/d19/dc2/d4d/c124 0 2023-12-09T02:35:24.323 INFO:tasks.workunit.client.1.smithi161.stdout:3/795: dwrite d2/d51/d75/d50/fe0 [0,4194304] 0 2023-12-09T02:35:24.326 INFO:tasks.workunit.client.1.smithi161.stdout:6/843: dread da/df/f99 [0,4194304] 0 2023-12-09T02:35:24.327 INFO:tasks.workunit.client.1.smithi161.stdout:3/796: creat d2/d51/d75/fef x:0 0 0 2023-12-09T02:35:24.329 INFO:tasks.workunit.client.1.smithi161.stdout:6/844: truncate da/df/f14 359183 0 2023-12-09T02:35:24.334 INFO:tasks.workunit.client.1.smithi161.stdout:6/845: symlink da/d19/dc2/l125 0 2023-12-09T02:35:24.334 INFO:tasks.workunit.client.1.smithi161.stdout:6/846: chown da/d55/d6d/c70 29810 1 2023-12-09T02:35:24.341 INFO:tasks.workunit.client.1.smithi161.stdout:3/797: dwrite d2/daf/de9/fb6 [0,4194304] 0 2023-12-09T02:35:24.362 INFO:tasks.workunit.client.1.smithi161.stdout:6/847: dwrite da/d19/dc2/d29/d2b/db4/ff6 [0,4194304] 0 2023-12-09T02:35:24.364 INFO:tasks.workunit.client.1.smithi161.stdout:6/848: symlink da/d19/d20/l126 0 2023-12-09T02:35:24.365 INFO:tasks.workunit.client.1.smithi161.stdout:6/849: symlink da/d19/dc2/d3c/dfb/l127 0 2023-12-09T02:35:24.365 INFO:tasks.workunit.client.1.smithi161.stdout:6/850: fdatasync da/df/d2d/d3b/f42 0 2023-12-09T02:35:24.365 INFO:tasks.workunit.client.1.smithi161.stdout:6/851: write da/df/d2d/d3b/fe0 [109122,27955] 0 2023-12-09T02:35:24.365 INFO:tasks.workunit.client.1.smithi161.stdout:6/852: creat da/d19/dc2/d3c/f128 x:0 0 0 2023-12-09T02:35:24.366 INFO:tasks.workunit.client.1.smithi161.stdout:6/853: readlink da/d19/dc2/d29/d2b/db4/ldb 0 2023-12-09T02:35:24.366 INFO:tasks.workunit.client.1.smithi161.stdout:6/854: chown da/d19/dc2/d3c/dfb 7467041 1 2023-12-09T02:35:24.366 INFO:tasks.workunit.client.1.smithi161.stdout:6/855: chown da/df/d2d/d3b/c8d 52122588 1 2023-12-09T02:35:24.366 INFO:tasks.workunit.client.1.smithi161.stdout:6/856: creat da/d19/dc2/f129 x:0 0 0 2023-12-09T02:35:24.367 INFO:tasks.workunit.client.1.smithi161.stdout:3/798: dwrite d2/d51/dee/d91/d46/d2d/d4e/f65 [0,4194304] 0 2023-12-09T02:35:24.368 INFO:tasks.workunit.client.1.smithi161.stdout:6/857: getdents da/d55/dea 0 2023-12-09T02:35:24.368 INFO:tasks.workunit.client.1.smithi161.stdout:6/858: chown da/d19/dc2/d9e/lc9 2185950 1 2023-12-09T02:35:24.370 INFO:tasks.workunit.client.1.smithi161.stdout:3/799: truncate d2/d51/dee/f2e 8787965 0 2023-12-09T02:35:24.372 INFO:tasks.workunit.client.1.smithi161.stdout:6/859: mkdir da/d19/dc2/d3c/dd1/df0/d12a 0 2023-12-09T02:35:24.372 INFO:tasks.workunit.client.1.smithi161.stdout:6/860: stat da/d19/dc2/d3c/dd1/df0 0 2023-12-09T02:35:24.374 INFO:tasks.workunit.client.1.smithi161.stdout:6/861: truncate da/d55/d6d/dac/fb1 85350 0 2023-12-09T02:35:24.376 INFO:tasks.workunit.client.1.smithi161.stdout:3/800: dread d2/d51/dee/d91/d46/f54 [0,4194304] 0 2023-12-09T02:35:24.377 INFO:tasks.workunit.client.1.smithi161.stdout:6/862: rename da/d19/dc2/d3c/c41 to da/d19/dc2/d3c/d46/c12b 0 2023-12-09T02:35:24.379 INFO:tasks.workunit.client.1.smithi161.stdout:3/801: creat d2/d51/d75/d50/d69/db7/ff0 x:0 0 0 2023-12-09T02:35:24.382 INFO:tasks.workunit.client.1.smithi161.stdout:6/863: symlink da/d55/dea/l12c 0 2023-12-09T02:35:24.396 INFO:tasks.workunit.client.1.smithi161.stdout:6/864: dread da/d19/dc2/d29/d2b/f97 [0,4194304] 0 2023-12-09T02:35:24.398 INFO:tasks.workunit.client.1.smithi161.stdout:6/865: mkdir da/d19/dc2/d9e/d12d 0 2023-12-09T02:35:24.399 INFO:tasks.workunit.client.1.smithi161.stdout:6/866: creat da/d19/dc2/f12e x:0 0 0 2023-12-09T02:35:24.402 INFO:tasks.workunit.client.1.smithi161.stdout:6/867: rename da/df/f7d to da/d55/d6d/df2/f12f 0 2023-12-09T02:35:24.404 INFO:tasks.workunit.client.1.smithi161.stdout:6/868: mknod da/d19/dc2/d29/d2b/db4/dc0/c130 0 2023-12-09T02:35:24.404 INFO:tasks.workunit.client.1.smithi161.stdout:6/869: dread - da/d19/dc2/d3c/d46/f108 zero size 2023-12-09T02:35:24.405 INFO:tasks.workunit.client.1.smithi161.stdout:6/870: mknod da/d19/dc2/c131 0 2023-12-09T02:35:24.405 INFO:tasks.workunit.client.1.smithi161.stdout:3/802: dwrite d2/d51/dee/fbd [0,4194304] 0 2023-12-09T02:35:24.420 INFO:tasks.workunit.client.1.smithi161.stdout:6/871: dwrite da/d55/dea/f118 [0,4194304] 0 2023-12-09T02:35:24.420 INFO:tasks.workunit.client.1.smithi161.stdout:6/872: readlink da/d19/dc2/d29/d2b/l69 0 2023-12-09T02:35:24.420 INFO:tasks.workunit.client.1.smithi161.stdout:6/873: read da/d19/d20/f11a [757216,12235] 0 2023-12-09T02:35:24.420 INFO:tasks.workunit.client.1.smithi161.stdout:6/874: read da/f113 [40535,4303] 0 2023-12-09T02:35:24.428 INFO:tasks.workunit.client.1.smithi161.stdout:6/875: dread da/d55/d6d/df2/f12f [0,4194304] 0 2023-12-09T02:35:24.431 INFO:tasks.workunit.client.1.smithi161.stdout:6/876: rmdir da/d19/dc2/d3c/d46 39 2023-12-09T02:35:24.432 INFO:tasks.workunit.client.1.smithi161.stdout:6/877: dread da/d55/d6d/d85/fff [0,4194304] 0 2023-12-09T02:35:24.435 INFO:tasks.workunit.client.1.smithi161.stdout:6/878: symlink da/d19/dc2/d9e/d12d/l132 0 2023-12-09T02:35:24.438 INFO:tasks.workunit.client.1.smithi161.stdout:6/879: symlink da/d19/l133 0 2023-12-09T02:35:24.442 INFO:tasks.workunit.client.1.smithi161.stdout:6/880: rmdir da/d19/dc2/d29/d2b/db4 39 2023-12-09T02:35:24.443 INFO:tasks.workunit.client.1.smithi161.stdout:6/881: write da/d55/fba [1192001,23255] 0 2023-12-09T02:35:24.444 INFO:tasks.workunit.client.1.smithi161.stdout:6/882: getdents da/d55/dea 0 2023-12-09T02:35:24.444 INFO:tasks.workunit.client.1.smithi161.stdout:6/883: fdatasync da/d19/dc2/d29/d2b/d31/f51 0 2023-12-09T02:35:24.444 INFO:tasks.workunit.client.1.smithi161.stdout:6/884: write da/f113 [47556,48055] 0 2023-12-09T02:35:24.446 INFO:tasks.workunit.client.1.smithi161.stdout:6/885: write da/d19/dc2/d77/f9a [3755290,23099] 0 2023-12-09T02:35:24.450 INFO:tasks.workunit.client.1.smithi161.stdout:6/886: rename da/d55/d6d/d85/f73 to da/d19/dc2/d3c/dd1/df0/d12a/f134 0 2023-12-09T02:35:24.452 INFO:tasks.workunit.client.1.smithi161.stdout:6/887: truncate da/d19/d20/f11a 377098 0 2023-12-09T02:35:24.455 INFO:tasks.workunit.client.1.smithi161.stdout:6/888: getdents da/d55 0 2023-12-09T02:35:24.456 INFO:tasks.workunit.client.1.smithi161.stdout:6/889: dread da/d19/dc2/d9e/fe9 [0,4194304] 0 2023-12-09T02:35:24.541 INFO:tasks.workunit.client.1.smithi161.stdout:2/813: sync 2023-12-09T02:35:24.542 INFO:tasks.workunit.client.1.smithi161.stdout:2/814: write d4/da6/db9/f57 [1846140,53624] 0 2023-12-09T02:35:24.545 INFO:tasks.workunit.client.1.smithi161.stdout:2/815: unlink d4/f17 0 2023-12-09T02:35:24.548 INFO:tasks.workunit.client.1.smithi161.stdout:2/816: symlink d4/d7/d8f/dd2/l108 0 2023-12-09T02:35:24.552 INFO:tasks.workunit.client.1.smithi161.stdout:2/817: dread d4/d7/f45 [0,4194304] 0 2023-12-09T02:35:24.555 INFO:tasks.workunit.client.1.smithi161.stdout:2/818: mknod d4/d1a/c109 0 2023-12-09T02:35:24.555 INFO:tasks.workunit.client.1.smithi161.stdout:2/819: write d4/d1a/d4a/daa/ffe [786934,11842] 0 2023-12-09T02:35:24.556 INFO:tasks.workunit.client.1.smithi161.stdout:2/820: unlink d4/fa 0 2023-12-09T02:35:24.575 INFO:tasks.workunit.client.1.smithi161.stdout:2/821: dwrite d4/d7/db/f19 [0,4194304] 0 2023-12-09T02:35:24.588 INFO:tasks.workunit.client.1.smithi161.stdout:2/822: dwrite d4/d1a/fef [0,4194304] 0 2023-12-09T02:35:24.589 INFO:tasks.workunit.client.1.smithi161.stdout:2/823: mkdir d4/d1a/d4a/d10a 0 2023-12-09T02:35:24.603 INFO:tasks.workunit.client.1.smithi161.stdout:2/824: dwrite d4/d7/fc [0,4194304] 0 2023-12-09T02:35:24.621 INFO:tasks.workunit.client.1.smithi161.stdout:2/825: dwrite d4/d16/d69/d8c/ff0 [0,4194304] 0 2023-12-09T02:35:24.621 INFO:tasks.workunit.client.1.smithi161.stdout:2/826: fsync d4/d16/d69/d8c/d87/ffb 0 2023-12-09T02:35:24.621 INFO:tasks.workunit.client.1.smithi161.stdout:2/827: readlink d4/d16/d69/d8c/lbe 0 2023-12-09T02:35:24.624 INFO:tasks.workunit.client.1.smithi161.stdout:2/828: mkdir d4/d7/d8f/dd2/d10b 0 2023-12-09T02:35:24.626 INFO:tasks.workunit.client.1.smithi161.stdout:2/829: creat d4/d1a/f10c x:0 0 0 2023-12-09T02:35:24.626 INFO:tasks.workunit.client.1.smithi161.stdout:2/830: write d4/d7/d8f/fa5 [750245,20912] 0 2023-12-09T02:35:24.628 INFO:tasks.workunit.client.1.smithi161.stdout:2/831: fsync d4/d7/d8f/fa5 0 2023-12-09T02:35:24.629 INFO:tasks.workunit.client.1.smithi161.stdout:2/832: mknod d4/d1a/c10d 0 2023-12-09T02:35:24.642 INFO:tasks.workunit.client.1.smithi161.stdout:2/833: dwrite d4/d16/f1e [4194304,4194304] 0 2023-12-09T02:35:24.643 INFO:tasks.workunit.client.1.smithi161.stdout:2/834: fsync d4/d16/d69/d8c/fa7 0 2023-12-09T02:35:24.644 INFO:tasks.workunit.client.1.smithi161.stdout:2/835: rename d4/d1a/f10c to d4/d1a/d4a/f10e 0 2023-12-09T02:35:24.691 INFO:tasks.workunit.client.1.smithi161.stdout:2/836: rmdir d4/d16/d69/d7b 39 2023-12-09T02:35:24.691 INFO:tasks.workunit.client.1.smithi161.stdout:2/837: link d4/da6/de6/ce9 d4/d7/c10f 0 2023-12-09T02:35:24.692 INFO:tasks.workunit.client.1.smithi161.stdout:2/838: dwrite d4/d1a/f35 [0,4194304] 0 2023-12-09T02:35:24.692 INFO:tasks.workunit.client.1.smithi161.stdout:2/839: chown d4/d7/c10f 36 1 2023-12-09T02:35:24.692 INFO:tasks.workunit.client.1.smithi161.stdout:2/840: link d4/d7/db/lfd d4/da6/db9/l110 0 2023-12-09T02:35:24.692 INFO:tasks.workunit.client.1.smithi161.stdout:2/841: unlink d4/d7/db/f76 0 2023-12-09T02:35:24.692 INFO:tasks.workunit.client.1.smithi161.stdout:2/842: chown d4/d16/d69/d8c/c7c 3947 1 2023-12-09T02:35:24.692 INFO:tasks.workunit.client.1.smithi161.stdout:2/843: chown d4/d16/d69/d8c/d87/f9f 6 1 2023-12-09T02:35:24.693 INFO:tasks.workunit.client.1.smithi161.stdout:2/844: mknod d4/d7/c111 0 2023-12-09T02:35:24.708 INFO:tasks.workunit.client.1.smithi161.stdout:2/845: dwrite d4/d16/d69/d8c/ddf/f71 [4194304,4194304] 0 2023-12-09T02:35:24.711 INFO:tasks.workunit.client.1.smithi161.stdout:2/846: creat d4/d1a/d4a/de3/f112 x:0 0 0 2023-12-09T02:35:24.734 INFO:tasks.workunit.client.1.smithi161.stdout:2/847: dwrite d4/f25 [0,4194304] 0 2023-12-09T02:35:24.734 INFO:tasks.workunit.client.1.smithi161.stdout:2/848: chown d4/d7/d8f/dd2/fd9 8406 1 2023-12-09T02:35:24.735 INFO:tasks.workunit.client.1.smithi161.stdout:2/849: rename d4/d16/d69/d8c/fcc to d4/d7/d8f/dd2/f113 0 2023-12-09T02:35:24.740 INFO:tasks.workunit.client.1.smithi161.stdout:2/850: dread d4/d7/db/f1d [0,4194304] 0 2023-12-09T02:35:24.740 INFO:tasks.workunit.client.1.smithi161.stdout:2/851: write d4/d1a/dc2/fe2 [514689,71728] 0 2023-12-09T02:35:24.794 INFO:tasks.workunit.client.1.smithi161.stdout:0/848: sync 2023-12-09T02:35:24.795 INFO:tasks.workunit.client.1.smithi161.stdout:0/849: truncate d9/db/d2a/d9d/dba/d94/fcc 993141 0 2023-12-09T02:35:24.795 INFO:tasks.workunit.client.1.smithi161.stdout:8/831: sync 2023-12-09T02:35:24.795 INFO:tasks.workunit.client.1.smithi161.stdout:5/933: sync 2023-12-09T02:35:24.795 INFO:tasks.workunit.client.1.smithi161.stdout:1/999: sync 2023-12-09T02:35:24.795 INFO:tasks.workunit.client.1.smithi161.stdout:5/934: chown d0/d2/d7/df3 673 1 2023-12-09T02:35:24.795 INFO:tasks.workunit.client.1.smithi161.stdout:5/935: readlink d0/d2/de/d22/d55/ld6 0 2023-12-09T02:35:24.795 INFO:tasks.workunit.client.1.smithi161.stdout:7/760: sync 2023-12-09T02:35:24.795 INFO:tasks.workunit.client.1.smithi161.stdout:7/761: write d0/d3/d13/d4e/db2/dda/dab/ff3 [956422,75555] 0 2023-12-09T02:35:24.800 INFO:tasks.workunit.client.1.smithi161.stdout:8/832: rmdir d2/d5/d22/d86/d97 39 2023-12-09T02:35:24.801 INFO:tasks.workunit.client.1.smithi161.stdout:0/850: link d9/d55/d44/d85/fc0 d9/db/df1/f10a 0 2023-12-09T02:35:24.805 INFO:tasks.workunit.client.1.smithi161.stdout:7/762: creat d0/d3/d13/d4e/db2/dda/dcb/ff4 x:0 0 0 2023-12-09T02:35:24.805 INFO:tasks.workunit.client.1.smithi161.stdout:7/763: fsync d0/d3/d13/d4e/db2/da7/fe7 0 2023-12-09T02:35:24.811 INFO:tasks.workunit.client.1.smithi161.stdout:8/833: link d2/d5/d22/d54/db4/c5d d2/d5/d22/d86/dd6/c112 0 2023-12-09T02:35:24.811 INFO:tasks.workunit.client.1.smithi161.stdout:8/834: readlink d2/d5/d22/d76/l7b 0 2023-12-09T02:35:24.811 INFO:tasks.workunit.client.1.smithi161.stdout:0/851: mknod d9/db/d2a/d35/dc2/c10b 0 2023-12-09T02:35:24.815 INFO:tasks.workunit.client.1.smithi161.stdout:5/936: rename d0/d2/d7/d11/dc3/db6/c105 to d0/d2/de/d22/d8e/dfe/c14b 0 2023-12-09T02:35:24.815 INFO:tasks.workunit.client.1.smithi161.stdout:5/937: write d0/d2/de/d22/d128/f13d [481674,87545] 0 2023-12-09T02:35:24.815 INFO:tasks.workunit.client.1.smithi161.stdout:5/938: dread - d0/d2/d7/d51/f119 zero size 2023-12-09T02:35:24.819 INFO:tasks.workunit.client.1.smithi161.stdout:7/764: mknod d0/d3/d13/d4e/d70/cf5 0 2023-12-09T02:35:24.822 INFO:tasks.workunit.client.1.smithi161.stdout:0/852: dread d9/db/d2a/fd7 [0,4194304] 0 2023-12-09T02:35:24.822 INFO:tasks.workunit.client.1.smithi161.stdout:7/765: unlink d0/ca8 0 2023-12-09T02:35:24.823 INFO:tasks.workunit.client.1.smithi161.stdout:5/939: write d0/d2/d7/d11/d61/d107/d132/dcd/f6e [3067271,10566] 0 2023-12-09T02:35:24.825 INFO:tasks.workunit.client.1.smithi161.stdout:8/835: dread d2/d5/d22/d31/d38/d66/d88/f9f [0,4194304] 0 2023-12-09T02:35:24.825 INFO:tasks.workunit.client.1.smithi161.stdout:8/836: chown d2/c67 44250187 1 2023-12-09T02:35:24.825 INFO:tasks.workunit.client.1.smithi161.stdout:8/837: getdents d2/d8a 0 2023-12-09T02:35:24.825 INFO:tasks.workunit.client.1.smithi161.stdout:0/853: write d9/d55/d7c/f4e [2301889,78644] 0 2023-12-09T02:35:24.826 INFO:tasks.workunit.client.1.smithi161.stdout:8/838: write d2/d5/d22/f98 [1361328,3513] 0 2023-12-09T02:35:24.827 INFO:tasks.workunit.client.1.smithi161.stdout:5/940: symlink d0/d136/l14c 0 2023-12-09T02:35:24.832 INFO:tasks.workunit.client.1.smithi161.stdout:7/766: dread d0/d3/d13/d4e/db2/dda/dcb/f2e [0,4194304] 0 2023-12-09T02:35:24.838 INFO:tasks.workunit.client.1.smithi161.stdout:8/839: symlink d2/d5/d22/d86/dd6/l113 0 2023-12-09T02:35:24.839 INFO:tasks.workunit.client.1.smithi161.stdout:5/941: creat d0/d2/d7/d11/f14d x:0 0 0 2023-12-09T02:35:24.839 INFO:tasks.workunit.client.1.smithi161.stdout:8/840: chown d2/d5/d22/d54/db4/f78 464 1 2023-12-09T02:35:24.839 INFO:tasks.workunit.client.1.smithi161.stdout:7/767: mkdir d0/d3/d13/d4e/db2/dda/dab/d94/df6 0 2023-12-09T02:35:24.840 INFO:tasks.workunit.client.1.smithi161.stdout:7/768: fsync d0/d3/f73 0 2023-12-09T02:35:24.840 INFO:tasks.workunit.client.1.smithi161.stdout:8/841: mknod d2/d5/d22/d31/d38/d66/c114 0 2023-12-09T02:35:24.841 INFO:tasks.workunit.client.1.smithi161.stdout:7/769: write d0/d3/d13/d4e/db2/dda/dcb/f2e [1459780,69867] 0 2023-12-09T02:35:24.842 INFO:tasks.workunit.client.1.smithi161.stdout:8/842: mkdir d2/d5/d22/d86/d97/d115 0 2023-12-09T02:35:24.843 INFO:tasks.workunit.client.1.smithi161.stdout:7/770: stat d0/d3/d13/dc7/dc8/le0 0 2023-12-09T02:35:24.844 INFO:tasks.workunit.client.1.smithi161.stdout:8/843: symlink d2/l116 0 2023-12-09T02:35:24.844 INFO:tasks.workunit.client.1.smithi161.stdout:7/771: read d0/d3/d13/d4e/db2/dda/dcb/f32 [698468,60685] 0 2023-12-09T02:35:24.844 INFO:tasks.workunit.client.1.smithi161.stdout:7/772: truncate d0/f78 5027483 0 2023-12-09T02:35:24.844 INFO:tasks.workunit.client.1.smithi161.stdout:7/773: chown d0/d3/d13/d4e/d70/cf5 2373 1 2023-12-09T02:35:24.846 INFO:tasks.workunit.client.1.smithi161.stdout:8/844: mknod d2/d5/d22/d86/d97/d115/c117 0 2023-12-09T02:35:24.846 INFO:tasks.workunit.client.1.smithi161.stdout:8/845: chown d2/d5/d22/d31/f41 0 1 2023-12-09T02:35:24.848 INFO:tasks.workunit.client.1.smithi161.stdout:0/854: dwrite d9/db/d2a/d35/d7b/f9b [0,4194304] 0 2023-12-09T02:35:24.848 INFO:tasks.workunit.client.1.smithi161.stdout:0/855: chown d9/d55/d7c/f4e 14214675 1 2023-12-09T02:35:24.850 INFO:tasks.workunit.client.1.smithi161.stdout:5/942: dread d0/d2/d7/fe8 [0,4194304] 0 2023-12-09T02:35:24.851 INFO:tasks.workunit.client.1.smithi161.stdout:8/846: dread d2/d5/d22/fbf [0,4194304] 0 2023-12-09T02:35:24.853 INFO:tasks.workunit.client.1.smithi161.stdout:0/856: link d9/d55/db7/ccf d9/d55/d44/ddf/c10c 0 2023-12-09T02:35:24.853 INFO:tasks.workunit.client.1.smithi161.stdout:0/857: chown d9/d55/d26/d28/daa/fc4 2826573 1 2023-12-09T02:35:24.856 INFO:tasks.workunit.client.1.smithi161.stdout:0/858: truncate d9/d55/d7c/f6b 847243 0 2023-12-09T02:35:24.856 INFO:tasks.workunit.client.1.smithi161.stdout:0/859: getdents d9/d55/d26/d28/d58 0 2023-12-09T02:35:24.857 INFO:tasks.workunit.client.1.smithi161.stdout:5/943: creat d0/d2/d7/d11/d61/d107/d132/dcd/de1/f14e x:0 0 0 2023-12-09T02:35:24.857 INFO:tasks.workunit.client.1.smithi161.stdout:5/944: stat d0/d2/d7/d9a/fc8 0 2023-12-09T02:35:24.859 INFO:tasks.workunit.client.1.smithi161.stdout:7/774: rmdir d0/d3/d13/d4e/db2/dda/dcb 39 2023-12-09T02:35:24.861 INFO:tasks.workunit.client.1.smithi161.stdout:5/945: mknod d0/d2/d7/d11/c14f 0 2023-12-09T02:35:24.863 INFO:tasks.workunit.client.1.smithi161.stdout:7/775: creat d0/d3/d13/d4e/db2/dda/ff7 x:0 0 0 2023-12-09T02:35:24.865 INFO:tasks.workunit.client.1.smithi161.stdout:5/946: symlink d0/d2/d7/d11/d61/d107/d132/dcd/d83/l150 0 2023-12-09T02:35:24.867 INFO:tasks.workunit.client.1.smithi161.stdout:7/776: creat d0/d3/ff8 x:0 0 0 2023-12-09T02:35:24.867 INFO:tasks.workunit.client.1.smithi161.stdout:7/777: chown d0/d3/d13/d4e/db2/dda/ff7 7776125 1 2023-12-09T02:35:24.867 INFO:tasks.workunit.client.1.smithi161.stdout:7/778: fsync d0/d3/d13/f18 0 2023-12-09T02:35:24.869 INFO:tasks.workunit.client.1.smithi161.stdout:5/947: rmdir d0/d2/d7/df/d11c 0 2023-12-09T02:35:24.869 INFO:tasks.workunit.client.1.smithi161.stdout:8/847: dwrite d2/d5/d22/f90 [0,4194304] 0 2023-12-09T02:35:24.870 INFO:tasks.workunit.client.1.smithi161.stdout:7/779: write d0/d3/d13/f26 [58341,95182] 0 2023-12-09T02:35:24.870 INFO:tasks.workunit.client.1.smithi161.stdout:7/780: dread - d0/d49/d79/dc3/fe3 zero size 2023-12-09T02:35:24.870 INFO:tasks.workunit.client.1.smithi161.stdout:7/781: readlink d0/d49/d67/ldc 0 2023-12-09T02:35:24.871 INFO:tasks.workunit.client.1.smithi161.stdout:5/948: mkdir d0/d2/d7/d11/d61/d107/d132/dcd/d83/dfa/d151 0 2023-12-09T02:35:24.871 INFO:tasks.workunit.client.1.smithi161.stdout:5/949: readlink d0/d2/d7/d11/d61/d107/d132/dcd/d83/l150 0 2023-12-09T02:35:24.875 INFO:tasks.workunit.client.1.smithi161.stdout:8/848: mknod d2/d5/d22/d31/c118 0 2023-12-09T02:35:24.875 INFO:tasks.workunit.client.1.smithi161.stdout:8/849: readlink d2/d5/d22/d76/l99 0 2023-12-09T02:35:24.875 INFO:tasks.workunit.client.1.smithi161.stdout:8/850: dread - d2/d5/d4f/d102/f107 zero size 2023-12-09T02:35:24.877 INFO:tasks.workunit.client.1.smithi161.stdout:7/782: creat d0/d49/d67/ff9 x:0 0 0 2023-12-09T02:35:24.877 INFO:tasks.workunit.client.1.smithi161.stdout:7/783: chown d0/d3/d13/d4e/db2/dda/dcb/d59/c87 4610 1 2023-12-09T02:35:24.878 INFO:tasks.workunit.client.1.smithi161.stdout:8/851: rename d2/d5/d22/d31/l5b to d2/d5/d22/d76/l119 0 2023-12-09T02:35:24.880 INFO:tasks.workunit.client.1.smithi161.stdout:7/784: link d0/d3/d13/d4e/db5/d83/fcd d0/d3/d13/d4e/db2/da7/ffa 0 2023-12-09T02:35:24.880 INFO:tasks.workunit.client.1.smithi161.stdout:7/785: readlink d0/l23 0 2023-12-09T02:35:24.882 INFO:tasks.workunit.client.1.smithi161.stdout:7/786: rmdir d0/d3/daa/daf/de4/dc0 39 2023-12-09T02:35:24.882 INFO:tasks.workunit.client.1.smithi161.stdout:7/787: readlink d0/d3/d13/l47 0 2023-12-09T02:35:24.883 INFO:tasks.workunit.client.1.smithi161.stdout:7/788: write d0/d3/f7 [182510,54476] 0 2023-12-09T02:35:24.890 INFO:tasks.workunit.client.1.smithi161.stdout:5/950: dwrite d0/d2/de/d21/f2c [0,4194304] 0 2023-12-09T02:35:24.896 INFO:tasks.workunit.client.1.smithi161.stdout:0/860: fsync d9/d55/d7c/f6b 0 2023-12-09T02:35:24.896 INFO:tasks.workunit.client.1.smithi161.stdout:0/861: chown d9/db/lbd 0 1 2023-12-09T02:35:24.896 INFO:tasks.workunit.client.1.smithi161.stdout:0/862: write d9/d55/d44/d85/fc0 [710672,4145] 0 2023-12-09T02:35:24.898 INFO:tasks.workunit.client.1.smithi161.stdout:0/863: dread d9/f97 [0,4194304] 0 2023-12-09T02:35:24.900 INFO:tasks.workunit.client.1.smithi161.stdout:5/951: truncate d0/d2/de/d22/f32 3793061 0 2023-12-09T02:35:24.901 INFO:tasks.workunit.client.1.smithi161.stdout:7/789: dwrite d0/d3/d13/d1b/f3f [0,4194304] 0 2023-12-09T02:35:24.903 INFO:tasks.workunit.client.1.smithi161.stdout:0/864: symlink d9/dd/d71/l10d 0 2023-12-09T02:35:24.906 INFO:tasks.workunit.client.1.smithi161.stdout:5/952: rename d0/d2/de/d22/d55/fe3 to d0/d2/d7/d11/d50/d8a/d145/f152 0 2023-12-09T02:35:24.906 INFO:tasks.workunit.client.1.smithi161.stdout:5/953: write d0/d2/d7/d51/f119 [909532,111312] 0 2023-12-09T02:35:24.906 INFO:tasks.workunit.client.1.smithi161.stdout:5/954: stat d0/d2/d7/d11/d50/fb9 0 2023-12-09T02:35:24.907 INFO:tasks.workunit.client.1.smithi161.stdout:0/865: mknod d9/db/d2a/c10e 0 2023-12-09T02:35:24.911 INFO:tasks.workunit.client.1.smithi161.stdout:5/955: creat d0/d2/d7/d11/d61/f153 x:0 0 0 2023-12-09T02:35:24.911 INFO:tasks.workunit.client.1.smithi161.stdout:7/790: dread d0/d3/d13/d4e/db2/da7/fb3 [0,4194304] 0 2023-12-09T02:35:24.912 INFO:tasks.workunit.client.1.smithi161.stdout:0/866: creat d9/db/d2a/d9d/dba/d94/db6/f10f x:0 0 0 2023-12-09T02:35:24.913 INFO:tasks.workunit.client.1.smithi161.stdout:0/867: write d9/f62 [4222897,66194] 0 2023-12-09T02:35:24.913 INFO:tasks.workunit.client.1.smithi161.stdout:0/868: truncate d9/db/d2a/d9d/dba/d94/fcc 1542466 0 2023-12-09T02:35:24.915 INFO:tasks.workunit.client.1.smithi161.stdout:5/956: creat d0/d2/d7/d11/d50/d8a/f154 x:0 0 0 2023-12-09T02:35:24.915 INFO:tasks.workunit.client.1.smithi161.stdout:5/957: fdatasync d0/d2/d7/d11/d61/d107/f120 0 2023-12-09T02:35:24.916 INFO:tasks.workunit.client.1.smithi161.stdout:7/791: rmdir d0/d3/d13/d4e/db2 39 2023-12-09T02:35:24.923 INFO:tasks.workunit.client.1.smithi161.stdout:0/869: creat d9/d55/d86/f110 x:0 0 0 2023-12-09T02:35:24.924 INFO:tasks.workunit.client.1.smithi161.stdout:0/870: read d9/d55/d44/fa1 [158347,85270] 0 2023-12-09T02:35:24.924 INFO:tasks.workunit.client.1.smithi161.stdout:0/871: dread - d9/dd/dca/ffa zero size 2023-12-09T02:35:24.927 INFO:tasks.workunit.client.1.smithi161.stdout:0/872: creat d9/d1f/dd4/f111 x:0 0 0 2023-12-09T02:35:24.928 INFO:tasks.workunit.client.1.smithi161.stdout:0/873: dread d9/f97 [0,4194304] 0 2023-12-09T02:35:24.937 INFO:tasks.workunit.client.1.smithi161.stdout:5/958: dwrite d0/d2/d7/f39 [0,4194304] 0 2023-12-09T02:35:24.937 INFO:tasks.workunit.client.1.smithi161.stdout:7/792: dwrite d0/d3/d13/d4e/db2/f10 [0,4194304] 0 2023-12-09T02:35:24.938 INFO:tasks.workunit.client.1.smithi161.stdout:5/959: fsync d0/d2/d7/d11/d61/d107/d132/dcd/d83/dfa/d125/f65 0 2023-12-09T02:35:24.938 INFO:tasks.workunit.client.1.smithi161.stdout:7/793: write d0/d3/d13/d4e/db5/d83/fcd [582962,48803] 0 2023-12-09T02:35:24.940 INFO:tasks.workunit.client.1.smithi161.stdout:7/794: rename d0/d3/d13/d4e/db2/dda/d4b/d5a/fc6 to d0/d3/d13/d2f/dd1/ffb 0 2023-12-09T02:35:24.944 INFO:tasks.workunit.client.1.smithi161.stdout:7/795: dread d0/d3/d13/dc7/f7e [0,4194304] 0 2023-12-09T02:35:24.952 INFO:tasks.workunit.client.1.smithi161.stdout:5/960: dread d0/d2/d7/d11/dc3/fc6 [0,4194304] 0 2023-12-09T02:35:24.954 INFO:tasks.workunit.client.1.smithi161.stdout:0/874: dwrite d9/d1f/f18 [0,4194304] 0 2023-12-09T02:35:24.956 INFO:tasks.workunit.client.1.smithi161.stdout:5/961: unlink d0/d2/d7/d11/d61/d107/d132/dcd/d83/dfa/d125/fc1 0 2023-12-09T02:35:24.956 INFO:tasks.workunit.client.1.smithi161.stdout:5/962: write d0/d2/d7/d11/d50/f8c [4201682,51306] 0 2023-12-09T02:35:24.956 INFO:tasks.workunit.client.1.smithi161.stdout:5/963: read - d0/d2/de/d44/d12f/f146 zero size 2023-12-09T02:35:24.956 INFO:tasks.workunit.client.1.smithi161.stdout:5/964: dread - d0/d2/d7/df3/f135 zero size 2023-12-09T02:35:24.963 INFO:tasks.workunit.client.1.smithi161.stdout:5/965: rename d0/d2/d7/d51/l52 to d0/d2/d7/d11/d61/d107/l155 0 2023-12-09T02:35:24.965 INFO:tasks.workunit.client.1.smithi161.stdout:5/966: rename d0/d9/caf to d0/d2/de/d22/c156 0 2023-12-09T02:35:24.967 INFO:tasks.workunit.client.1.smithi161.stdout:5/967: symlink d0/d2/d7/d11/d61/d107/d132/d12b/l157 0 2023-12-09T02:35:24.973 INFO:tasks.workunit.client.1.smithi161.stdout:0/875: dwrite d9/db/d2a/d35/d7b/f9b [0,4194304] 0 2023-12-09T02:35:24.973 INFO:tasks.workunit.client.1.smithi161.stdout:0/876: chown d9/dd/la4 3 1 2023-12-09T02:35:24.980 INFO:tasks.workunit.client.1.smithi161.stdout:9/817: sync 2023-12-09T02:35:24.985 INFO:tasks.workunit.client.1.smithi161.stdout:9/818: rename d2/d25/db1/d65/d42/d58/d91/d2e/d80/d103 to d2/d25/dbf/d124 0 2023-12-09T02:35:24.985 INFO:tasks.workunit.client.1.smithi161.stdout:5/968: dwrite d0/d2/d7/d11/d61/d107/d132/dcd/d83/dfa/d125/f3b [0,4194304] 0 2023-12-09T02:35:24.988 INFO:tasks.workunit.client.1.smithi161.stdout:9/819: write d2/d25/dbf/d124/fab [1078792,120839] 0 2023-12-09T02:35:24.988 INFO:tasks.workunit.client.1.smithi161.stdout:5/969: read d0/d2/de/d21/dce/f104 [2829271,37374] 0 2023-12-09T02:35:24.991 INFO:tasks.workunit.client.1.smithi161.stdout:0/877: dwrite d9/d55/d26/d28/d58/f93 [0,4194304] 0 2023-12-09T02:35:25.006 INFO:tasks.workunit.client.1.smithi161.stdout:9/820: symlink d2/d25/db1/d65/d4f/l125 0 2023-12-09T02:35:25.011 INFO:tasks.workunit.client.1.smithi161.stdout:0/878: unlink d9/d1f/dd4/le4 0 2023-12-09T02:35:25.014 INFO:tasks.workunit.client.1.smithi161.stdout:9/821: symlink d2/d25/db1/d116/l126 0 2023-12-09T02:35:25.017 INFO:tasks.workunit.client.1.smithi161.stdout:0/879: mkdir d9/d5b/d112 0 2023-12-09T02:35:25.018 INFO:tasks.workunit.client.1.smithi161.stdout:9/822: unlink d2/d25/db1/d65/d42/d58/c2c 0 2023-12-09T02:35:25.019 INFO:tasks.workunit.client.1.smithi161.stdout:0/880: creat d9/d55/d7c/f113 x:0 0 0 2023-12-09T02:35:25.021 INFO:tasks.workunit.client.1.smithi161.stdout:9/823: rename d2/d25/db1/d65/l4e to d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/dc8/l127 0 2023-12-09T02:35:25.022 INFO:tasks.workunit.client.1.smithi161.stdout:0/881: creat d9/dd/d3a/f114 x:0 0 0 2023-12-09T02:35:25.023 INFO:tasks.workunit.client.1.smithi161.stdout:9/824: read d2/d25/db1/d65/d5c/f56 [6372862,116236] 0 2023-12-09T02:35:25.023 INFO:tasks.workunit.client.1.smithi161.stdout:0/882: rmdir d9/d55/d26/d28/d58/d8e 39 2023-12-09T02:35:25.024 INFO:tasks.workunit.client.1.smithi161.stdout:5/970: dwrite d0/d2/d7/d11/d50/d8a/f154 [0,4194304] 0 2023-12-09T02:35:25.024 INFO:tasks.workunit.client.1.smithi161.stdout:0/883: write d9/d55/d7c/f4e [3025206,7132] 0 2023-12-09T02:35:25.024 INFO:tasks.workunit.client.1.smithi161.stdout:9/825: getdents d2 0 2023-12-09T02:35:25.025 INFO:tasks.workunit.client.1.smithi161.stdout:9/826: chown d2/d25/db1/d65/d63/f9e 40485060 1 2023-12-09T02:35:25.028 INFO:tasks.workunit.client.1.smithi161.stdout:5/971: creat d0/d2/de/d44/da6/f158 x:0 0 0 2023-12-09T02:35:25.030 INFO:tasks.workunit.client.1.smithi161.stdout:9/827: dread d2/d25/db1/d65/fa8 [0,4194304] 0 2023-12-09T02:35:25.030 INFO:tasks.workunit.client.1.smithi161.stdout:0/884: mknod d9/d55/d26/c115 0 2023-12-09T02:35:25.030 INFO:tasks.workunit.client.1.smithi161.stdout:0/885: chown d9/dd/f1e 70171 1 2023-12-09T02:35:25.030 INFO:tasks.workunit.client.1.smithi161.stdout:0/886: fsync d9/d55/d44/d85/fe7 0 2023-12-09T02:35:25.030 INFO:tasks.workunit.client.1.smithi161.stdout:0/887: write d9/d1f/fc7 [825034,113839] 0 2023-12-09T02:35:25.030 INFO:tasks.workunit.client.1.smithi161.stdout:0/888: fsync d9/dd/f53 0 2023-12-09T02:35:25.032 INFO:tasks.workunit.client.1.smithi161.stdout:9/828: creat d2/d25/db1/d65/d4f/dfb/f128 x:0 0 0 2023-12-09T02:35:25.032 INFO:tasks.workunit.client.1.smithi161.stdout:0/889: dread d9/db/df1/f10a [0,4194304] 0 2023-12-09T02:35:25.035 INFO:tasks.workunit.client.1.smithi161.stdout:0/890: unlink d9/d55/d44/d85/f103 0 2023-12-09T02:35:25.035 INFO:tasks.workunit.client.1.smithi161.stdout:0/891: dread - d9/db/d2a/d35/dfd/f101 zero size 2023-12-09T02:35:25.036 INFO:tasks.workunit.client.1.smithi161.stdout:5/972: dread d0/d2/d7/d51/f7e [0,4194304] 0 2023-12-09T02:35:25.036 INFO:tasks.workunit.client.1.smithi161.stdout:5/973: fdatasync d0/d2/de/d22/d128/f13d 0 2023-12-09T02:35:25.037 INFO:tasks.workunit.client.1.smithi161.stdout:9/829: mknod d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/dc8/d108/c129 0 2023-12-09T02:35:25.038 INFO:tasks.workunit.client.1.smithi161.stdout:5/974: truncate d0/d2/d7/d11/d61/d107/d132/dcd/fbf 4932626 0 2023-12-09T02:35:25.039 INFO:tasks.workunit.client.1.smithi161.stdout:9/830: rmdir d2/d25/dbf 39 2023-12-09T02:35:25.040 INFO:tasks.workunit.client.1.smithi161.stdout:9/831: fsync d2/d25/db1/d65/d88/fe2 0 2023-12-09T02:35:25.041 INFO:tasks.workunit.client.1.smithi161.stdout:9/832: write d2/d25/dbf/d124/dd1/ff0 [2284935,126414] 0 2023-12-09T02:35:25.052 INFO:tasks.workunit.client.1.smithi161.stdout:9/833: dread d2/d25/dbf/d124/dd1/ff0 [0,4194304] 0 2023-12-09T02:35:25.052 INFO:tasks.workunit.client.1.smithi161.stdout:9/834: truncate d2/d25/db1/d65/d42/d58/d91/d2e/fe0 71983 0 2023-12-09T02:35:25.052 INFO:tasks.workunit.client.1.smithi161.stdout:9/835: write d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/ffd [3289624,102913] 0 2023-12-09T02:35:25.054 INFO:tasks.workunit.client.1.smithi161.stdout:9/836: link d2/d25/db1/d65/d42/lae d2/d25/db1/d65/d88/dcb/l12a 0 2023-12-09T02:35:25.056 INFO:tasks.workunit.client.1.smithi161.stdout:9/837: getdents d2/d25/db1/d65/d63 0 2023-12-09T02:35:25.063 INFO:tasks.workunit.client.1.smithi161.stdout:0/892: dwrite d9/d55/d26/d28/d58/f8a [0,4194304] 0 2023-12-09T02:35:25.063 INFO:tasks.workunit.client.1.smithi161.stdout:0/893: dread - d9/d1f/dd4/fdc zero size 2023-12-09T02:35:25.065 INFO:tasks.workunit.client.1.smithi161.stdout:0/894: unlink d9/db/d2a/d35/l6e 0 2023-12-09T02:35:25.065 INFO:tasks.workunit.client.1.smithi161.stdout:0/895: chown d9/dd/f77 153984 1 2023-12-09T02:35:25.068 INFO:tasks.workunit.client.1.smithi161.stdout:0/896: symlink d9/d55/d5a/l116 0 2023-12-09T02:35:25.071 INFO:tasks.workunit.client.1.smithi161.stdout:0/897: getdents d9/d55/d44 0 2023-12-09T02:35:25.071 INFO:tasks.workunit.client.1.smithi161.stdout:5/975: dwrite d0/d2/d7/d11/f37 [0,4194304] 0 2023-12-09T02:35:25.071 INFO:tasks.workunit.client.1.smithi161.stdout:5/976: read - d0/d2/d7/d11/d61/f153 zero size 2023-12-09T02:35:25.073 INFO:tasks.workunit.client.1.smithi161.stdout:9/838: dwrite d2/d25/db1/d65/d42/d58/d22/f11e [0,4194304] 0 2023-12-09T02:35:25.073 INFO:tasks.workunit.client.1.smithi161.stdout:9/839: dread - d2/d25/db1/d65/fe6 zero size 2023-12-09T02:35:25.073 INFO:tasks.workunit.client.1.smithi161.stdout:0/898: link d9/d55/d44/d85/c8d d9/d55/d44/ddf/dfc/c117 0 2023-12-09T02:35:25.074 INFO:tasks.workunit.client.1.smithi161.stdout:5/977: symlink d0/d2/de/d44/d12f/l159 0 2023-12-09T02:35:25.079 INFO:tasks.workunit.client.1.smithi161.stdout:5/978: symlink d0/d2/d7/d11/d50/l15a 0 2023-12-09T02:35:25.080 INFO:tasks.workunit.client.1.smithi161.stdout:5/979: truncate d0/f1a 2731476 0 2023-12-09T02:35:25.081 INFO:tasks.workunit.client.1.smithi161.stdout:5/980: dread - d0/d2/de/d22/d128/f12a zero size 2023-12-09T02:35:25.081 INFO:tasks.workunit.client.1.smithi161.stdout:5/981: fsync d0/d2/d7/d9a/fc8 0 2023-12-09T02:35:25.084 INFO:tasks.workunit.client.1.smithi161.stdout:5/982: symlink d0/d2/de/d22/d55/l15b 0 2023-12-09T02:35:25.095 INFO:tasks.workunit.client.1.smithi161.stdout:9/840: dwrite d2/d25/db1/d65/d88/fe2 [0,4194304] 0 2023-12-09T02:35:25.096 INFO:tasks.workunit.client.1.smithi161.stdout:5/983: dread d0/d2/d7/d11/d50/f8c [0,4194304] 0 2023-12-09T02:35:25.097 INFO:tasks.workunit.client.1.smithi161.stdout:0/899: dwrite d9/dd/f53 [0,4194304] 0 2023-12-09T02:35:25.099 INFO:tasks.workunit.client.1.smithi161.stdout:9/841: unlink d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/lba 0 2023-12-09T02:35:25.099 INFO:tasks.workunit.client.1.smithi161.stdout:9/842: rename d2/d25/db1/d65/d42/d58/d91 to d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/d12b 22 2023-12-09T02:35:25.101 INFO:tasks.workunit.client.1.smithi161.stdout:0/900: creat d9/dd/f118 x:0 0 0 2023-12-09T02:35:25.103 INFO:tasks.workunit.client.1.smithi161.stdout:5/984: dread d0/d2/d5f/fd1 [0,4194304] 0 2023-12-09T02:35:25.105 INFO:tasks.workunit.client.1.smithi161.stdout:9/843: mkdir d2/d25/db1/d65/d4f/df7/d12c 0 2023-12-09T02:35:25.108 INFO:tasks.workunit.client.1.smithi161.stdout:0/901: rename d9/d1f/dd4/cf7 to d9/d55/d86/c119 0 2023-12-09T02:35:25.109 INFO:tasks.workunit.client.1.smithi161.stdout:0/902: write d9/db/d2a/d35/f89 [122539,9450] 0 2023-12-09T02:35:25.110 INFO:tasks.workunit.client.1.smithi161.stdout:5/985: creat d0/d2/de/d44/d12f/f15c x:0 0 0 2023-12-09T02:35:25.112 INFO:tasks.workunit.client.1.smithi161.stdout:9/844: rename d2/d25/db1/d65/d7c to d2/d25/dbf/d124/d90/d95/dea/d12d 0 2023-12-09T02:35:25.113 INFO:tasks.workunit.client.1.smithi161.stdout:0/903: getdents d9/d55/d44/d85 0 2023-12-09T02:35:25.125 INFO:tasks.workunit.client.1.smithi161.stdout:0/904: dread d9/d55/d26/d28/d58/f93 [0,4194304] 0 2023-12-09T02:35:25.132 INFO:tasks.workunit.client.1.smithi161.stdout:9/845: dwrite d2/d25/db1/d65/d88/f9b [0,4194304] 0 2023-12-09T02:35:25.132 INFO:tasks.workunit.client.1.smithi161.stdout:5/986: mknod d0/d2/d130/c15d 0 2023-12-09T02:35:25.135 INFO:tasks.workunit.client.1.smithi161.stdout:0/905: mkdir d9/db/df1/d11a 0 2023-12-09T02:35:25.139 INFO:tasks.workunit.client.1.smithi161.stdout:9/846: symlink d2/d25/dbf/d124/l12e 0 2023-12-09T02:35:25.142 INFO:tasks.workunit.client.1.smithi161.stdout:5/987: rename d0/d2/de/d22/d8e/dfe/f114 to d0/d2/d7/d11/d50/d8a/d145/f15e 0 2023-12-09T02:35:25.142 INFO:tasks.workunit.client.1.smithi161.stdout:5/988: fdatasync d0/d2/d7/d11/d61/d107/d132/dcd/fc7 0 2023-12-09T02:35:25.146 INFO:tasks.workunit.client.1.smithi161.stdout:9/847: mkdir d2/d25/db1/d65/d63/d12f 0 2023-12-09T02:35:25.147 INFO:tasks.workunit.client.1.smithi161.stdout:5/989: mkdir d0/d2/d7/d11/d50/dfb/d139/d15f 0 2023-12-09T02:35:25.151 INFO:tasks.workunit.client.1.smithi161.stdout:9/848: symlink d2/d25/db1/d65/d42/d58/d91/d2e/d80/l130 0 2023-12-09T02:35:25.153 INFO:tasks.workunit.client.1.smithi161.stdout:5/990: mkdir d0/d2/de/d22/d128/d160 0 2023-12-09T02:35:25.154 INFO:tasks.workunit.client.1.smithi161.stdout:9/849: creat d2/d25/db1/d65/d42/d10b/f131 x:0 0 0 2023-12-09T02:35:25.155 INFO:tasks.workunit.client.1.smithi161.stdout:0/906: dwrite d9/d55/f9a [0,4194304] 0 2023-12-09T02:35:25.156 INFO:tasks.workunit.client.1.smithi161.stdout:5/991: truncate d0/d2/d7/d11/f37 746272 0 2023-12-09T02:35:25.157 INFO:tasks.workunit.client.1.smithi161.stdout:9/850: mkdir d2/d25/dbf/d124/d90/d95/dea/d132 0 2023-12-09T02:35:25.160 INFO:tasks.workunit.client.1.smithi161.stdout:0/907: truncate d9/d55/d7c/f4e 1900887 0 2023-12-09T02:35:25.160 INFO:tasks.workunit.client.1.smithi161.stdout:0/908: readlink d9/d55/d7c/d7a/da3/lbc 0 2023-12-09T02:35:25.160 INFO:tasks.workunit.client.1.smithi161.stdout:0/909: read d9/d55/d26/f42 [1982554,23986] 0 2023-12-09T02:35:25.165 INFO:tasks.workunit.client.1.smithi161.stdout:9/851: truncate d2/d25/db1/d65/d42/d58/d91/d2e/d3f/f10f 286880 0 2023-12-09T02:35:25.165 INFO:tasks.workunit.client.1.smithi161.stdout:9/852: chown d2/f3e 924 1 2023-12-09T02:35:25.166 INFO:tasks.workunit.client.1.smithi161.stdout:0/910: rename d9/db/d2a/d9d/fd0 to d9/d55/db7/f11b 0 2023-12-09T02:35:25.169 INFO:tasks.workunit.client.1.smithi161.stdout:5/992: rename d0/d2/d7/d11/dc3/ce0 to d0/d2/d7/d11/d61/def/c161 0 2023-12-09T02:35:25.169 INFO:tasks.workunit.client.1.smithi161.stdout:5/993: fsync d0/d2/d7/d11/d61/d107/f120 0 2023-12-09T02:35:25.169 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:24 smithi161 ceph-mon[121170]: Adjusting osd_memory_target on smithi088 to 1568M 2023-12-09T02:35:25.171 INFO:tasks.workunit.client.1.smithi161.stdout:0/911: truncate d9/d55/d44/d85/fc0 2324 0 2023-12-09T02:35:25.173 INFO:tasks.workunit.client.1.smithi161.stdout:5/994: creat d0/d2/de/d22/d128/f162 x:0 0 0 2023-12-09T02:35:25.180 INFO:tasks.workunit.client.1.smithi161.stdout:9/853: write d2/d25/db1/d65/d42/d58/d91/d2e/d3f/f10f [1277755,12242] 0 2023-12-09T02:35:25.181 INFO:tasks.workunit.client.1.smithi161.stdout:9/854: creat d2/d25/db1/d65/d4f/df7/d12c/f133 x:0 0 0 2023-12-09T02:35:25.181 INFO:tasks.workunit.client.1.smithi161.stdout:9/855: read - d2/d25/db1/d65/d5c/d55/d66/fd9 zero size 2023-12-09T02:35:25.186 INFO:tasks.workunit.client.1.smithi161.stdout:0/912: dwrite d9/d1f/fc7 [0,4194304] 0 2023-12-09T02:35:25.186 INFO:tasks.workunit.client.1.smithi161.stdout:0/913: chown d9/db/d2a/d35/de3/ce8 119309430 1 2023-12-09T02:35:25.221 INFO:tasks.workunit.client.1.smithi161.stdout:9/856: rename d2/d25/dbf/l117 to d2/d25/db1/d65/d42/d58/d91/l134 0 2023-12-09T02:35:25.226 INFO:tasks.workunit.client.1.smithi161.stdout:9/857: link d2/d25/db1/d65/d5c/d60/fd4 d2/d25/db1/d65/d4f/dfb/f135 0 2023-12-09T02:35:25.226 INFO:tasks.workunit.client.1.smithi161.stdout:9/858: readlink d2/d25/dbf/d124/d90/d95/dea/d12d/l82 0 2023-12-09T02:35:25.226 INFO:tasks.workunit.client.1.smithi161.stdout:9/859: fdatasync d2/d25/dbf/d124/d90/d95/dea/d12d/fd8 0 2023-12-09T02:35:25.226 INFO:tasks.workunit.client.1.smithi161.stdout:9/860: write d2/d25/db1/d65/d4f/df7/d12c/f133 [195202,11841] 0 2023-12-09T02:35:25.226 INFO:tasks.workunit.client.1.smithi161.stdout:9/861: write d2/d25/db1/d65/d42/d58/d91/d2e/d80/fa2 [4618348,105296] 0 2023-12-09T02:35:25.226 INFO:tasks.workunit.client.1.smithi161.stdout:9/862: write d2/d25/dbf/d124/d90/d95/dea/d12d/fee [2338014,31204] 0 2023-12-09T02:35:25.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:24 smithi088 ceph-mon[112028]: Adjusting osd_memory_target on smithi088 to 1568M 2023-12-09T02:35:25.228 INFO:tasks.workunit.client.1.smithi161.stdout:9/863: unlink d2/d25/db1/d65/d42/d58/d91/d39/ceb 0 2023-12-09T02:35:25.231 INFO:tasks.workunit.client.1.smithi161.stdout:9/864: unlink d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/fdd 0 2023-12-09T02:35:25.231 INFO:tasks.workunit.client.1.smithi161.stdout:9/865: write d2/d25/db1/d65/d63/f9e [2028388,106209] 0 2023-12-09T02:35:25.233 INFO:tasks.workunit.client.1.smithi161.stdout:9/866: creat d2/d25/db1/d65/d4f/df7/d12c/f136 x:0 0 0 2023-12-09T02:35:25.235 INFO:tasks.workunit.client.1.smithi161.stdout:9/867: mkdir d2/d25/dbf/d124/d137 0 2023-12-09T02:35:25.253 INFO:tasks.workunit.client.1.smithi161.stdout:9/868: dwrite d2/d25/dbf/d124/ff2 [0,4194304] 0 2023-12-09T02:35:25.254 INFO:tasks.workunit.client.1.smithi161.stdout:9/869: symlink d2/d25/dbf/d124/d90/d95/l138 0 2023-12-09T02:35:25.257 INFO:tasks.workunit.client.1.smithi161.stdout:9/870: rename d2/d25/db1/d65/d42/d58/d91/l8a to d2/d25/dbf/d124/d137/l139 0 2023-12-09T02:35:25.274 INFO:tasks.workunit.client.1.smithi161.stdout:9/871: dwrite d2/d25/db1/d65/d42/d58/d91/d2e/fe0 [0,4194304] 0 2023-12-09T02:35:25.274 INFO:tasks.workunit.client.1.smithi161.stdout:9/872: chown d2/d25/dbf/fc0 21 1 2023-12-09T02:35:25.274 INFO:tasks.workunit.client.1.smithi161.stdout:3/803: sync 2023-12-09T02:35:25.274 INFO:tasks.workunit.client.1.smithi161.stdout:6/890: sync 2023-12-09T02:35:25.274 INFO:tasks.workunit.client.1.smithi161.stdout:9/873: truncate d2/d25/db1/d65/d42/d58/d22/f9f 597578 0 2023-12-09T02:35:25.275 INFO:tasks.workunit.client.1.smithi161.stdout:6/891: dread da/d19/dc2/d3c/d46/ffe [0,4194304] 0 2023-12-09T02:35:25.279 INFO:tasks.workunit.client.1.smithi161.stdout:3/804: rmdir d2/d37/d99/dd2 39 2023-12-09T02:35:25.279 INFO:tasks.workunit.client.1.smithi161.stdout:3/805: write d2/d51/dee/d91/d46/d5e/fa5 [468555,117927] 0 2023-12-09T02:35:25.282 INFO:tasks.workunit.client.1.smithi161.stdout:9/874: mkdir d2/d25/dbf/d124/d90/d95/dea/d13a 0 2023-12-09T02:35:25.286 INFO:tasks.workunit.client.1.smithi161.stdout:3/806: link d2/d51/d75/d11/c9f d2/d51/d75/d50/dea/cf1 0 2023-12-09T02:35:25.288 INFO:tasks.workunit.client.1.smithi161.stdout:9/875: write d2/d25/db1/d65/d5c/d60/d7f/f89 [776543,124881] 0 2023-12-09T02:35:25.294 INFO:tasks.workunit.client.1.smithi161.stdout:3/807: dread d2/d51/dee/d91/d46/d2d/d47/f56 [0,4194304] 0 2023-12-09T02:35:25.296 INFO:tasks.workunit.client.1.smithi161.stdout:3/808: creat d2/d51/d75/d11/d1f/d4c/ff2 x:0 0 0 2023-12-09T02:35:25.298 INFO:tasks.workunit.client.1.smithi161.stdout:6/892: dwrite da/df/f27 [0,4194304] 0 2023-12-09T02:35:25.299 INFO:tasks.workunit.client.1.smithi161.stdout:3/809: dread d2/d51/dee/d91/d46/d2d/d47/f56 [0,4194304] 0 2023-12-09T02:35:25.307 INFO:tasks.workunit.client.1.smithi161.stdout:3/810: mkdir d2/d51/dee/d91/d46/d2d/df3 0 2023-12-09T02:35:25.308 INFO:tasks.workunit.client.1.smithi161.stdout:6/893: symlink da/d19/dc2/d3c/l135 0 2023-12-09T02:35:25.311 INFO:tasks.workunit.client.1.smithi161.stdout:3/811: creat d2/d51/dee/d91/d46/d5e/ff4 x:0 0 0 2023-12-09T02:35:25.311 INFO:tasks.workunit.client.1.smithi161.stdout:3/812: fsync d2/d51/dee/d91/f2b 0 2023-12-09T02:35:25.311 INFO:tasks.workunit.client.1.smithi161.stdout:3/813: read d2/d51/dee/d91/d46/f54 [730878,85360] 0 2023-12-09T02:35:25.325 INFO:tasks.workunit.client.1.smithi161.stdout:3/814: dwrite d2/d37/d99/f59 [0,4194304] 0 2023-12-09T02:35:25.327 INFO:tasks.workunit.client.1.smithi161.stdout:3/815: mknod d2/d51/dee/d91/d46/d2d/df3/cf5 0 2023-12-09T02:35:25.328 INFO:tasks.workunit.client.1.smithi161.stdout:3/816: mkdir d2/daf/df6 0 2023-12-09T02:35:25.328 INFO:tasks.workunit.client.1.smithi161.stdout:3/817: write d2/d51/d75/d11/d1f/fb3 [631479,60815] 0 2023-12-09T02:35:25.328 INFO:tasks.workunit.client.1.smithi161.stdout:3/818: readlink d2/d51/d75/d11/d7b/lb2 0 2023-12-09T02:35:25.329 INFO:tasks.workunit.client.1.smithi161.stdout:3/819: stat d2/d51/dee/d91/d46/d5e/fa5 0 2023-12-09T02:35:25.330 INFO:tasks.workunit.client.1.smithi161.stdout:3/820: link d2/d51/dc0/ceb d2/cf7 0 2023-12-09T02:35:25.336 INFO:tasks.workunit.client.1.smithi161.stdout:3/821: dread d2/d51/dee/d91/d46/d5e/f79 [0,4194304] 0 2023-12-09T02:35:25.337 INFO:tasks.workunit.client.1.smithi161.stdout:3/822: symlink d2/daf/de9/lf8 0 2023-12-09T02:35:25.339 INFO:tasks.workunit.client.1.smithi161.stdout:3/823: mkdir d2/d51/dee/d91/df9 0 2023-12-09T02:35:25.339 INFO:tasks.workunit.client.1.smithi161.stdout:3/824: chown d2/d51/d75/d11/d1f/d74/c97 1 1 2023-12-09T02:35:25.349 INFO:tasks.workunit.client.1.smithi161.stdout:3/825: dread d2/d51/d75/f1e [0,4194304] 0 2023-12-09T02:35:25.353 INFO:tasks.workunit.client.1.smithi161.stdout:3/826: link d2/d51/lbe d2/d51/d75/d50/ddf/d96/lfa 0 2023-12-09T02:35:25.356 INFO:tasks.workunit.client.1.smithi161.stdout:3/827: getdents d2/d51/d75 0 2023-12-09T02:35:25.359 INFO:tasks.workunit.client.1.smithi161.stdout:3/828: unlink d2/d51/dee/d91/fa4 0 2023-12-09T02:35:25.373 INFO:tasks.workunit.client.1.smithi161.stdout:3/829: dwrite d2/fa8 [0,4194304] 0 2023-12-09T02:35:25.374 INFO:tasks.workunit.client.1.smithi161.stdout:3/830: symlink d2/d51/dee/d91/df9/lfb 0 2023-12-09T02:35:25.376 INFO:tasks.workunit.client.1.smithi161.stdout:3/831: creat d2/daf/df6/ffc x:0 0 0 2023-12-09T02:35:25.391 INFO:tasks.workunit.client.1.smithi161.stdout:3/832: dwrite d2/fa8 [0,4194304] 0 2023-12-09T02:35:25.391 INFO:tasks.workunit.client.1.smithi161.stdout:3/833: fsync d2/d51/d75/d11/d1f/f8f 0 2023-12-09T02:35:25.392 INFO:tasks.workunit.client.1.smithi161.stdout:3/834: rmdir d2/d51/dee/d91/d46/d2d/df3 39 2023-12-09T02:35:25.395 INFO:tasks.workunit.client.1.smithi161.stdout:3/835: creat d2/d51/d75/d11/d1f/d4c/ddd/ffd x:0 0 0 2023-12-09T02:35:25.395 INFO:tasks.workunit.client.1.smithi161.stdout:3/836: chown d2/d51/dee/d91/d46/d5e/f79 66914 1 2023-12-09T02:35:25.395 INFO:tasks.workunit.client.1.smithi161.stdout:3/837: fsync d2/d51/dee/d91/f2b 0 2023-12-09T02:35:25.395 INFO:tasks.workunit.client.1.smithi161.stdout:3/838: write d2/daf/de9/f58 [4878392,117165] 0 2023-12-09T02:35:25.396 INFO:tasks.workunit.client.1.smithi161.stdout:3/839: dread - d2/d51/dee/d91/d46/d2d/d47/d8c/fa9 zero size 2023-12-09T02:35:25.397 INFO:tasks.workunit.client.1.smithi161.stdout:3/840: rmdir d2/d37 39 2023-12-09T02:35:25.397 INFO:tasks.workunit.client.1.smithi161.stdout:3/841: fdatasync d2/d51/d75/d11/d7b/f87 0 2023-12-09T02:35:25.397 INFO:tasks.workunit.client.1.smithi161.stdout:3/842: dread - d2/d51/d75/d50/ddf/d96/fc3 zero size 2023-12-09T02:35:25.397 INFO:tasks.workunit.client.1.smithi161.stdout:3/843: truncate d2/d51/d75/d50/ddf/d96/fc3 951828 0 2023-12-09T02:35:25.415 INFO:tasks.workunit.client.1.smithi161.stdout:3/844: dwrite d2/d51/d75/f36 [0,4194304] 0 2023-12-09T02:35:25.415 INFO:tasks.workunit.client.1.smithi161.stdout:3/845: creat d2/d51/dee/d91/d46/ffe x:0 0 0 2023-12-09T02:35:25.416 INFO:tasks.workunit.client.1.smithi161.stdout:3/846: chown d2/daf/df6 885 1 2023-12-09T02:35:25.417 INFO:tasks.workunit.client.1.smithi161.stdout:3/847: link d2/daf/de9/f6d d2/d51/d75/d50/dea/fff 0 2023-12-09T02:35:25.419 INFO:tasks.workunit.client.1.smithi161.stdout:3/848: creat d2/d51/d75/d11/d1f/f100 x:0 0 0 2023-12-09T02:35:25.419 INFO:tasks.workunit.client.1.smithi161.stdout:3/849: write d2/d37/f7f [1226641,47489] 0 2023-12-09T02:35:25.419 INFO:tasks.workunit.client.1.smithi161.stdout:3/850: readlink d2/d51/d75/l5f 0 2023-12-09T02:35:25.428 INFO:tasks.workunit.client.1.smithi161.stdout:3/851: dread d2/d51/d75/d50/fc1 [0,4194304] 0 2023-12-09T02:35:25.429 INFO:tasks.workunit.client.1.smithi161.stdout:3/852: rename d2/d51/d75/d11/l33 to d2/d51/d75/l101 0 2023-12-09T02:35:25.429 INFO:tasks.workunit.client.1.smithi161.stdout:3/853: stat d2/d51/dee/d91/d46/d2d/d47/d8c/fa0 0 2023-12-09T02:35:25.433 INFO:tasks.workunit.client.1.smithi161.stdout:3/854: unlink d2/d51/d75/d50/ddf/d96/la3 0 2023-12-09T02:35:25.434 INFO:tasks.workunit.client.1.smithi161.stdout:3/855: symlink d2/d51/d75/d50/ddf/l102 0 2023-12-09T02:35:25.489 INFO:tasks.workunit.client.1.smithi161.stdout:2/852: sync 2023-12-09T02:35:25.490 INFO:tasks.workunit.client.1.smithi161.stdout:2/853: creat d4/da6/dc8/f114 x:0 0 0 2023-12-09T02:35:25.491 INFO:tasks.workunit.client.1.smithi161.stdout:2/854: link d4/d1a/d4a/d6d/cf3 d4/d7/d8f/dd2/c115 0 2023-12-09T02:35:25.492 INFO:tasks.workunit.client.1.smithi161.stdout:2/855: mknod d4/da6/dc8/c116 0 2023-12-09T02:35:25.493 INFO:tasks.workunit.client.1.smithi161.stdout:2/856: mknod d4/d16/d69/d8c/ddf/c117 0 2023-12-09T02:35:25.509 INFO:tasks.workunit.client.1.smithi161.stdout:2/857: dwrite d4/d16/f1e [0,4194304] 0 2023-12-09T02:35:25.523 INFO:tasks.workunit.client.1.smithi161.stdout:2/858: dwrite d4/d1a/f3f [0,4194304] 0 2023-12-09T02:35:25.523 INFO:tasks.workunit.client.1.smithi161.stdout:2/859: chown d4/da6/dc8 72919493 1 2023-12-09T02:35:25.523 INFO:tasks.workunit.client.1.smithi161.stdout:2/860: mknod d4/d7/db/c118 0 2023-12-09T02:35:25.525 INFO:tasks.workunit.client.1.smithi161.stdout:2/861: getdents d4/d1a/d4a 0 2023-12-09T02:35:25.525 INFO:tasks.workunit.client.1.smithi161.stdout:2/862: write d4/d16/f100 [106123,79545] 0 2023-12-09T02:35:25.534 INFO:tasks.workunit.client.1.smithi161.stdout:2/863: dread d4/d7/db/f62 [4194304,4194304] 0 2023-12-09T02:35:25.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/864: creat d4/d7/f119 x:0 0 0 2023-12-09T02:35:25.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/865: rmdir d4/d16/d69/d8c 39 2023-12-09T02:35:25.537 INFO:tasks.workunit.client.1.smithi161.stdout:2/866: unlink d4/d16/d69/d8c/fd1 0 2023-12-09T02:35:25.550 INFO:tasks.workunit.client.1.smithi161.stdout:2/867: dwrite d4/d1a/d4a/f10e [0,4194304] 0 2023-12-09T02:35:25.553 INFO:tasks.workunit.client.1.smithi161.stdout:2/868: creat d4/da6/f11a x:0 0 0 2023-12-09T02:35:25.553 INFO:tasks.workunit.client.1.smithi161.stdout:2/869: chown d4/d16/d69/d7b/c58 32558 1 2023-12-09T02:35:25.553 INFO:tasks.workunit.client.1.smithi161.stdout:2/870: creat d4/da6/f11b x:0 0 0 2023-12-09T02:35:25.554 INFO:tasks.workunit.client.1.smithi161.stdout:2/871: write d4/d7/db/f67 [1875309,42849] 0 2023-12-09T02:35:25.555 INFO:tasks.workunit.client.1.smithi161.stdout:2/872: fsync d4/d16/d69/f6a 0 2023-12-09T02:35:25.557 INFO:tasks.workunit.client.1.smithi161.stdout:2/873: link d4/da6/dc8/ff7 d4/da6/de6/f11c 0 2023-12-09T02:35:25.557 INFO:tasks.workunit.client.1.smithi161.stdout:2/874: read d4/d16/f88 [133286,92316] 0 2023-12-09T02:35:25.558 INFO:tasks.workunit.client.1.smithi161.stdout:2/875: creat d4/d16/de0/d106/f11d x:0 0 0 2023-12-09T02:35:25.558 INFO:tasks.workunit.client.1.smithi161.stdout:2/876: chown d4/da6/db9/f9d 15553 1 2023-12-09T02:35:25.561 INFO:tasks.workunit.client.1.smithi161.stdout:2/877: mkdir d4/d7/d11e 0 2023-12-09T02:35:25.572 INFO:tasks.workunit.client.1.smithi161.stdout:2/878: dread d4/d1a/f35 [0,4194304] 0 2023-12-09T02:35:25.579 INFO:tasks.workunit.client.1.smithi161.stdout:2/879: dread d4/d16/d69/d8c/fbd [0,4194304] 0 2023-12-09T02:35:25.588 INFO:tasks.workunit.client.1.smithi161.stdout:2/880: dread d4/d16/d69/d8c/d87/f9f [0,4194304] 0 2023-12-09T02:35:25.588 INFO:tasks.workunit.client.1.smithi161.stdout:2/881: fdatasync d4/d16/d69/d8c/fa7 0 2023-12-09T02:35:25.588 INFO:tasks.workunit.client.1.smithi161.stdout:2/882: symlink d4/d16/l11f 0 2023-12-09T02:35:25.593 INFO:tasks.workunit.client.1.smithi161.stdout:2/883: link d4/d7/db/l102 d4/d7/d8f/l120 0 2023-12-09T02:35:25.593 INFO:tasks.workunit.client.1.smithi161.stdout:2/884: readlink d4/d16/d69/d8c/d87/lc9 0 2023-12-09T02:35:25.595 INFO:tasks.workunit.client.1.smithi161.stdout:2/885: creat d4/d1a/d4a/d10a/f121 x:0 0 0 2023-12-09T02:35:25.595 INFO:tasks.workunit.client.1.smithi161.stdout:2/886: write d4/d1a/d4a/d10a/f121 [167822,107674] 0 2023-12-09T02:35:25.595 INFO:tasks.workunit.client.1.smithi161.stdout:2/887: creat d4/d7/f122 x:0 0 0 2023-12-09T02:35:25.595 INFO:tasks.workunit.client.1.smithi161.stdout:2/888: readlink d4/d7/d8f/dd2/l108 0 2023-12-09T02:35:25.595 INFO:tasks.workunit.client.1.smithi161.stdout:2/889: creat d4/d16/d69/d8c/ddf/f123 x:0 0 0 2023-12-09T02:35:25.595 INFO:tasks.workunit.client.1.smithi161.stdout:2/890: write d4/d1a/dc2/fdb [1905281,50950] 0 2023-12-09T02:35:25.595 INFO:tasks.workunit.client.1.smithi161.stdout:2/891: readlink d4/d16/d69/d8c/d87/lad 0 2023-12-09T02:35:25.610 INFO:tasks.workunit.client.1.smithi161.stdout:2/892: dwrite d4/d1a/f50 [0,4194304] 0 2023-12-09T02:35:25.610 INFO:tasks.workunit.client.1.smithi161.stdout:2/893: dread d4/d16/f103 [0,4194304] 0 2023-12-09T02:35:25.615 INFO:tasks.workunit.client.1.smithi161.stdout:2/894: dread d4/d1a/d4a/d10a/f121 [0,4194304] 0 2023-12-09T02:35:25.615 INFO:tasks.workunit.client.1.smithi161.stdout:2/895: truncate d4/d7/fc 4483619 0 2023-12-09T02:35:25.616 INFO:tasks.workunit.client.1.smithi161.stdout:2/896: mknod d4/d16/c124 0 2023-12-09T02:35:25.617 INFO:tasks.workunit.client.1.smithi161.stdout:2/897: link d4/d16/d69/d8c/d87/lad d4/da6/de6/l125 0 2023-12-09T02:35:25.618 INFO:tasks.workunit.client.1.smithi161.stdout:2/898: dread - d4/d1a/d4a/daa/fed zero size 2023-12-09T02:35:25.618 INFO:tasks.workunit.client.1.smithi161.stdout:2/899: chown d4/d16/fee 7782 1 2023-12-09T02:35:25.618 INFO:tasks.workunit.client.1.smithi161.stdout:2/900: getdents d4/da6/db9 0 2023-12-09T02:35:25.635 INFO:tasks.workunit.client.1.smithi161.stdout:2/901: dwrite d4/d16/d69/d8c/fb2 [0,4194304] 0 2023-12-09T02:35:25.635 INFO:tasks.workunit.client.1.smithi161.stdout:2/902: mknod d4/c126 0 2023-12-09T02:35:25.644 INFO:tasks.workunit.client.1.smithi161.stdout:2/903: dread d4/d1a/f47 [0,4194304] 0 2023-12-09T02:35:25.644 INFO:tasks.workunit.client.1.smithi161.stdout:2/904: chown d4/d7/d11e 1877 1 2023-12-09T02:35:25.644 INFO:tasks.workunit.client.1.smithi161.stdout:2/905: write d4/d16/d69/d8c/fa7 [720458,101959] 0 2023-12-09T02:35:25.667 INFO:tasks.workunit.client.1.smithi161.stdout:8/852: sync 2023-12-09T02:35:25.667 INFO:tasks.workunit.client.1.smithi161.stdout:7/796: sync 2023-12-09T02:35:25.669 INFO:tasks.workunit.client.1.smithi161.stdout:2/906: dwrite d4/f30 [0,4194304] 0 2023-12-09T02:35:25.670 INFO:tasks.workunit.client.1.smithi161.stdout:8/853: unlink d2/d5/d4f/db2/fe2 0 2023-12-09T02:35:25.672 INFO:tasks.workunit.client.1.smithi161.stdout:7/797: creat d0/d3/daa/daf/de4/df2/ffc x:0 0 0 2023-12-09T02:35:25.689 INFO:tasks.workunit.client.1.smithi161.stdout:2/907: dwrite d4/d16/d69/d8c/fb2 [0,4194304] 0 2023-12-09T02:35:25.689 INFO:tasks.workunit.client.1.smithi161.stdout:2/908: write d4/d7/d8f/fa5 [737744,69285] 0 2023-12-09T02:35:25.692 INFO:tasks.workunit.client.1.smithi161.stdout:7/798: dwrite d0/d3/d13/d1b/f3f [0,4194304] 0 2023-12-09T02:35:25.693 INFO:tasks.workunit.client.1.smithi161.stdout:8/854: creat d2/d5/d22/d76/f11a x:0 0 0 2023-12-09T02:35:25.694 INFO:tasks.workunit.client.1.smithi161.stdout:2/909: mkdir d4/d7/d11e/d127 0 2023-12-09T02:35:25.697 INFO:tasks.workunit.client.1.smithi161.stdout:7/799: unlink d0/d3/d13/d4e/db2/dda/d4b/d99/c9c 0 2023-12-09T02:35:25.700 INFO:tasks.workunit.client.1.smithi161.stdout:8/855: truncate d2/d5/d4f/f35 1936860 0 2023-12-09T02:35:25.700 INFO:tasks.workunit.client.1.smithi161.stdout:8/856: chown d2/d5/d22/d31/d38/d84/fa7 181322 1 2023-12-09T02:35:25.700 INFO:tasks.workunit.client.1.smithi161.stdout:8/857: write d2/d5/d22/f77 [1390832,54151] 0 2023-12-09T02:35:25.702 INFO:tasks.workunit.client.1.smithi161.stdout:2/910: symlink d4/d1a/l128 0 2023-12-09T02:35:25.702 INFO:tasks.workunit.client.1.smithi161.stdout:2/911: fdatasync d4/d1a/d4a/d10a/f121 0 2023-12-09T02:35:25.705 INFO:tasks.workunit.client.1.smithi161.stdout:8/858: mknod d2/c11b 0 2023-12-09T02:35:25.707 INFO:tasks.workunit.client.1.smithi161.stdout:2/912: creat d4/d1a/d4a/d10a/f129 x:0 0 0 2023-12-09T02:35:25.707 INFO:tasks.workunit.client.1.smithi161.stdout:2/913: read - d4/da6/dc8/ff7 zero size 2023-12-09T02:35:25.709 INFO:tasks.workunit.client.1.smithi161.stdout:2/914: dread d4/d16/f29 [0,4194304] 0 2023-12-09T02:35:25.710 INFO:tasks.workunit.client.1.smithi161.stdout:8/859: unlink d2/d5/d22/d31/d38/f59 0 2023-12-09T02:35:25.710 INFO:tasks.workunit.client.1.smithi161.stdout:8/860: dread - d2/d5/d22/d86/dd6/fe7 zero size 2023-12-09T02:35:25.713 INFO:tasks.workunit.client.1.smithi161.stdout:2/915: creat d4/d1a/d4a/daa/f12a x:0 0 0 2023-12-09T02:35:25.713 INFO:tasks.workunit.client.1.smithi161.stdout:7/800: dwrite d0/d3/d21/f3b [0,4194304] 0 2023-12-09T02:35:25.717 INFO:tasks.workunit.client.1.smithi161.stdout:2/916: rename d4/d1a/f47 to d4/d7/d8f/dd2/f12b 0 2023-12-09T02:35:25.717 INFO:tasks.workunit.client.1.smithi161.stdout:2/917: chown d4/d7/db/c23 740 1 2023-12-09T02:35:25.718 INFO:tasks.workunit.client.1.smithi161.stdout:7/801: symlink d0/d3/d13/d4e/db5/lfd 0 2023-12-09T02:35:25.720 INFO:tasks.workunit.client.1.smithi161.stdout:7/802: getdents d0/d3/daa/daf/de4/df2 0 2023-12-09T02:35:25.725 INFO:tasks.workunit.client.1.smithi161.stdout:7/803: dread d0/d3/d13/d4e/db2/dda/dcb/f2e [0,4194304] 0 2023-12-09T02:35:25.727 INFO:tasks.workunit.client.1.smithi161.stdout:7/804: creat d0/d3/d13/ffe x:0 0 0 2023-12-09T02:35:25.731 INFO:tasks.workunit.client.1.smithi161.stdout:7/805: rename d0/d3/daa/daf/de4/dc0/cdd to d0/d3/cff 0 2023-12-09T02:35:25.734 INFO:tasks.workunit.client.1.smithi161.stdout:7/806: link d0/d3/d13/d4e/db2/dda/dcb/f2e d0/d3/d13/d4e/db2/dda/dcb/f100 0 2023-12-09T02:35:25.737 INFO:tasks.workunit.client.1.smithi161.stdout:2/918: dwrite d4/d1a/f35 [0,4194304] 0 2023-12-09T02:35:25.737 INFO:tasks.workunit.client.1.smithi161.stdout:7/807: mkdir d0/d3/d13/d2d/d101 0 2023-12-09T02:35:25.748 INFO:tasks.workunit.client.1.smithi161.stdout:2/919: dread d4/d16/d69/d8c/fb2 [0,4194304] 0 2023-12-09T02:35:25.748 INFO:tasks.workunit.client.1.smithi161.stdout:2/920: chown d4/da6/de6/lfa 57790814 1 2023-12-09T02:35:25.751 INFO:tasks.workunit.client.1.smithi161.stdout:2/921: rename d4/d7/l39 to d4/d1a/dc2/l12c 0 2023-12-09T02:35:25.751 INFO:tasks.workunit.client.1.smithi161.stdout:2/922: write d4/d16/d69/d8c/fa7 [434322,67557] 0 2023-12-09T02:35:25.752 INFO:tasks.workunit.client.1.smithi161.stdout:2/923: creat d4/f12d x:0 0 0 2023-12-09T02:35:25.753 INFO:tasks.workunit.client.1.smithi161.stdout:2/924: getdents d4/da6/db9 0 2023-12-09T02:35:25.754 INFO:tasks.workunit.client.1.smithi161.stdout:2/925: creat d4/d7/d11e/d127/f12e x:0 0 0 2023-12-09T02:35:25.754 INFO:tasks.workunit.client.1.smithi161.stdout:2/926: fsync d4/d7/db/f67 0 2023-12-09T02:35:25.754 INFO:tasks.workunit.client.1.smithi161.stdout:7/808: dwrite d0/d3/d13/ffe [0,4194304] 0 2023-12-09T02:35:25.754 INFO:tasks.workunit.client.1.smithi161.stdout:7/809: read d0/d3/d13/f89 [4520750,13487] 0 2023-12-09T02:35:25.754 INFO:tasks.workunit.client.1.smithi161.stdout:7/810: dread - d0/d3/d6a/fc4 zero size 2023-12-09T02:35:25.755 INFO:tasks.workunit.client.1.smithi161.stdout:7/811: write d0/d3/d6a/fdf [663098,3393] 0 2023-12-09T02:35:25.756 INFO:tasks.workunit.client.1.smithi161.stdout:2/927: rename d4/da6/le5 to d4/d1a/l12f 0 2023-12-09T02:35:25.761 INFO:tasks.workunit.client.1.smithi161.stdout:7/812: rename d0/d3/d13/d2f/dd1/ffb to d0/d3/d6c/f102 0 2023-12-09T02:35:25.762 INFO:tasks.workunit.client.1.smithi161.stdout:7/813: creat d0/d3/d13/d4e/f103 x:0 0 0 2023-12-09T02:35:25.788 INFO:tasks.workunit.client.1.smithi161.stdout:7/814: dwrite d0/d3/d13/d4e/db2/dda/dcb/ff4 [0,4194304] 0 2023-12-09T02:35:25.788 INFO:tasks.workunit.client.1.smithi161.stdout:2/928: dwrite d4/da6/db9/f73 [4194304,4194304] 0 2023-12-09T02:35:25.791 INFO:tasks.workunit.client.1.smithi161.stdout:7/815: rename d0/d3/f46 to d0/d3/d6a/f104 0 2023-12-09T02:35:25.791 INFO:tasks.workunit.client.1.smithi161.stdout:7/816: fsync d0/d3/d13/d4e/db2/da7/fb3 0 2023-12-09T02:35:25.792 INFO:tasks.workunit.client.1.smithi161.stdout:7/817: read d0/d3/d13/d4e/db2/dda/dcb/d59/d5e/fa6 [558371,116791] 0 2023-12-09T02:35:25.798 INFO:tasks.workunit.client.1.smithi161.stdout:2/929: creat d4/d7/d11e/d127/f130 x:0 0 0 2023-12-09T02:35:25.801 INFO:tasks.workunit.client.1.smithi161.stdout:2/930: creat d4/d16/de0/f131 x:0 0 0 2023-12-09T02:35:25.804 INFO:tasks.workunit.client.1.smithi161.stdout:7/818: mkdir d0/d3/d6c/d105 0 2023-12-09T02:35:25.804 INFO:tasks.workunit.client.1.smithi161.stdout:7/819: write d0/d49/d79/dc3/fe3 [356645,119556] 0 2023-12-09T02:35:25.804 INFO:tasks.workunit.client.1.smithi161.stdout:7/820: readlink d0/d3/d13/d4e/db5/d83/l8b 0 2023-12-09T02:35:25.805 INFO:tasks.workunit.client.1.smithi161.stdout:7/821: readlink d0/l81 0 2023-12-09T02:35:25.808 INFO:tasks.workunit.client.1.smithi161.stdout:2/931: mknod d4/d16/c132 0 2023-12-09T02:35:25.808 INFO:tasks.workunit.client.1.smithi161.stdout:2/932: chown d4/fc1 7 1 2023-12-09T02:35:25.808 INFO:tasks.workunit.client.1.smithi161.stdout:2/933: truncate d4/da6/db9/f73 9079158 0 2023-12-09T02:35:25.809 INFO:tasks.workunit.client.1.smithi161.stdout:2/934: read - d4/d7/d11e/d127/f12e zero size 2023-12-09T02:35:25.813 INFO:tasks.workunit.client.1.smithi161.stdout:2/935: creat d4/da6/f133 x:0 0 0 2023-12-09T02:35:25.828 INFO:tasks.workunit.client.1.smithi161.stdout:5/995: sync 2023-12-09T02:35:25.830 INFO:tasks.workunit.client.1.smithi161.stdout:2/936: dwrite d4/d1a/d4a/daa/fed [0,4194304] 0 2023-12-09T02:35:25.831 INFO:tasks.workunit.client.1.smithi161.stdout:5/996: write d0/d2/d7/d9a/fc8 [2041799,5931] 0 2023-12-09T02:35:25.831 INFO:tasks.workunit.client.1.smithi161.stdout:5/997: truncate d0/d2/de/f5b 862187 0 2023-12-09T02:35:25.837 INFO:tasks.workunit.client.1.smithi161.stdout:2/937: truncate d4/d16/d69/d7b/f4e 3230235 0 2023-12-09T02:35:25.843 INFO:tasks.workunit.client.1.smithi161.stdout:5/998: getdents d0/d2/de/d21 0 2023-12-09T02:35:25.851 INFO:tasks.workunit.client.1.smithi161.stdout:2/938: unlink d4/d16/d69/d8c/d87/lad 0 2023-12-09T02:35:25.852 INFO:tasks.workunit.client.1.smithi161.stdout:5/999: link d0/d2/d7/d11/d61/d107/l155 d0/d2/d7/d11/d61/d107/d132/dcd/d83/dfa/d151/l163 0 2023-12-09T02:35:25.853 INFO:tasks.workunit.client.1.smithi161.stdout:2/939: getdents d4/da6/de6 0 2023-12-09T02:35:25.859 INFO:tasks.workunit.client.1.smithi161.stdout:2/940: creat d4/da6/dc8/dea/f134 x:0 0 0 2023-12-09T02:35:25.862 INFO:tasks.workunit.client.1.smithi161.stdout:2/941: write d4/fa0 [1161808,6337] 0 2023-12-09T02:35:25.865 INFO:tasks.workunit.client.1.smithi161.stdout:2/942: creat d4/d16/d69/f135 x:0 0 0 2023-12-09T02:35:25.865 INFO:tasks.workunit.client.1.smithi161.stdout:2/943: dread - d4/d1a/d4a/fff zero size 2023-12-09T02:35:25.867 INFO:tasks.workunit.client.1.smithi161.stdout:2/944: creat d4/d7/d8f/f136 x:0 0 0 2023-12-09T02:35:25.890 INFO:tasks.workunit.client.1.smithi161.stdout:2/945: dwrite d4/d7/d8f/ff5 [4194304,4194304] 0 2023-12-09T02:35:26.016 INFO:tasks.workunit.client.1.smithi161.stdout:0/914: sync 2023-12-09T02:35:26.017 INFO:tasks.workunit.client.1.smithi161.stdout:0/915: symlink d9/d55/db7/l11c 0 2023-12-09T02:35:26.019 INFO:tasks.workunit.client.1.smithi161.stdout:0/916: creat d9/d55/d7c/d7a/da3/f11d x:0 0 0 2023-12-09T02:35:26.023 INFO:tasks.workunit.client.1.smithi161.stdout:0/917: rename f7 to d9/d9c/f11e 0 2023-12-09T02:35:26.028 INFO:tasks.workunit.client.1.smithi161.stdout:0/918: dread d9/d55/d26/d28/d58/f93 [0,4194304] 0 2023-12-09T02:35:26.028 INFO:tasks.workunit.client.1.smithi161.stdout:0/919: dread - d9/db/d2a/d9d/dba/d94/db6/f10f zero size 2023-12-09T02:35:26.028 INFO:tasks.workunit.client.1.smithi161.stdout:0/920: chown d9/dd/d3a/f114 66699 1 2023-12-09T02:35:26.029 INFO:tasks.workunit.client.1.smithi161.stdout:0/921: truncate d9/db/f3e 1904632 0 2023-12-09T02:35:26.029 INFO:tasks.workunit.client.1.smithi161.stdout:0/922: readlink d9/dd/dca/lf6 0 2023-12-09T02:35:26.031 INFO:tasks.workunit.client.1.smithi161.stdout:0/923: mknod d9/dd/d3a/c11f 0 2023-12-09T02:35:26.031 INFO:tasks.workunit.client.1.smithi161.stdout:0/924: fsync d9/d55/d26/f57 0 2023-12-09T02:35:26.036 INFO:tasks.workunit.client.1.smithi161.stdout:0/925: dread d9/d55/d7c/f4e [0,4194304] 0 2023-12-09T02:35:26.036 INFO:tasks.workunit.client.1.smithi161.stdout:0/926: chown d9/db/d2a/d35/dc2/c10b 17 1 2023-12-09T02:35:26.043 INFO:tasks.workunit.client.1.smithi161.stdout:0/927: symlink d9/db/d2a/d9d/dba/l120 0 2023-12-09T02:35:26.047 INFO:tasks.workunit.client.1.smithi161.stdout:0/928: creat d9/d55/d44/d85/f121 x:0 0 0 2023-12-09T02:35:26.048 INFO:tasks.workunit.client.1.smithi161.stdout:0/929: getdents d9/db/df1 0 2023-12-09T02:35:26.051 INFO:tasks.workunit.client.1.smithi161.stdout:0/930: mkdir d9/db/d2a/d9d/dba/d94/d122 0 2023-12-09T02:35:26.051 INFO:tasks.workunit.client.1.smithi161.stdout:0/931: write d9/db/f3e [2065973,116303] 0 2023-12-09T02:35:26.052 INFO:tasks.workunit.client.1.smithi161.stdout:0/932: getdents d9/d55/d44/ddf 0 2023-12-09T02:35:26.053 INFO:tasks.workunit.client.1.smithi161.stdout:0/933: write d9/dd/f118 [892289,101612] 0 2023-12-09T02:35:26.053 INFO:tasks.workunit.client.1.smithi161.stdout:0/934: readlink d9/d55/d5a/db1/lb9 0 2023-12-09T02:35:26.056 INFO:tasks.workunit.client.1.smithi161.stdout:0/935: rename d9/d1f/dd4/f111 to d9/d9c/f123 0 2023-12-09T02:35:26.056 INFO:tasks.workunit.client.1.smithi161.stdout:0/936: fsync d9/db/d2a/d9d/dba/d94/fcc 0 2023-12-09T02:35:26.056 INFO:tasks.workunit.client.1.smithi161.stdout:0/937: getdents d9/d55/d26/d28/d58 0 2023-12-09T02:35:26.058 INFO:tasks.workunit.client.1.smithi161.stdout:0/938: rmdir d9/d55/d44/d85 39 2023-12-09T02:35:26.081 INFO:tasks.workunit.client.1.smithi161.stdout:0/939: dwrite d9/d55/d44/d85/fe7 [0,4194304] 0 2023-12-09T02:35:26.086 INFO:tasks.workunit.client.1.smithi161.stdout:0/940: creat d9/d55/d44/f124 x:0 0 0 2023-12-09T02:35:26.086 INFO:tasks.workunit.client.1.smithi161.stdout:0/941: fsync d9/d55/d26/fa7 0 2023-12-09T02:35:26.086 INFO:tasks.workunit.client.1.smithi161.stdout:0/942: dread - d9/d55/d86/f110 zero size 2023-12-09T02:35:26.091 INFO:tasks.workunit.client.1.smithi161.stdout:0/943: getdents d9/d1f/dd4 0 2023-12-09T02:35:26.093 INFO:tasks.workunit.client.1.smithi161.stdout:0/944: creat d9/db/d2a/d35/de3/df0/f125 x:0 0 0 2023-12-09T02:35:26.095 INFO:tasks.workunit.client.1.smithi161.stdout:0/945: creat d9/db/d2a/d9d/dba/f126 x:0 0 0 2023-12-09T02:35:26.097 INFO:tasks.workunit.client.1.smithi161.stdout:0/946: rename d9/db/d2a/d9d/dba/d94/db6/f10f to d9/db/d2a/d9d/f127 0 2023-12-09T02:35:26.097 INFO:tasks.workunit.client.1.smithi161.stdout:0/947: dread - d9/d1f/dd4/fdc zero size 2023-12-09T02:35:26.097 INFO:tasks.workunit.client.1.smithi161.stdout:0/948: chown d9/dd/d3a/c11f 46770342 1 2023-12-09T02:35:26.097 INFO:tasks.workunit.client.1.smithi161.stdout:0/949: chown d9/d1f/f18 1150932590 1 2023-12-09T02:35:26.097 INFO:tasks.workunit.client.1.smithi161.stdout:0/950: read - d9/db/d2a/d9d/f127 zero size 2023-12-09T02:35:26.098 INFO:tasks.workunit.client.1.smithi161.stdout:0/951: dread d9/dd/dca/fd2 [0,4194304] 0 2023-12-09T02:35:26.100 INFO:tasks.workunit.client.1.smithi161.stdout:0/952: rmdir d9/d55/d26 39 2023-12-09T02:35:26.103 INFO:tasks.workunit.client.1.smithi161.stdout:0/953: creat d9/d55/d44/d85/f128 x:0 0 0 2023-12-09T02:35:26.121 INFO:tasks.workunit.client.1.smithi161.stdout:0/954: dwrite d9/d9c/f123 [0,4194304] 0 2023-12-09T02:35:26.123 INFO:tasks.workunit.client.1.smithi161.stdout:0/955: write d9/d55/d7c/f33 [2155108,37716] 0 2023-12-09T02:35:26.138 INFO:tasks.workunit.client.1.smithi161.stdout:0/956: dwrite d9/f97 [0,4194304] 0 2023-12-09T02:35:26.144 INFO:tasks.workunit.client.1.smithi161.stdout:0/957: rmdir d9/dd/d71 39 2023-12-09T02:35:26.145 INFO:tasks.workunit.client.1.smithi161.stdout:0/958: creat d9/db/d2a/d9d/dba/d94/d122/f129 x:0 0 0 2023-12-09T02:35:26.156 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-09T02:35:26.156 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-09T02:35:26.161 INFO:tasks.workunit.client.1.smithi161.stdout:0/959: dwrite d9/d55/d7c/f38 [0,4194304] 0 2023-12-09T02:35:26.161 INFO:tasks.workunit.client.1.smithi161.stdout:0/960: chown d9/d5b/fb2 608207 1 2023-12-09T02:35:26.163 INFO:tasks.workunit.client.1.smithi161.stdout:0/961: unlink d9/dd/d3a/f54 0 2023-12-09T02:35:26.163 INFO:tasks.workunit.client.1.smithi161.stdout:0/962: chown d9/d55/d7c/c3c 61752 1 2023-12-09T02:35:26.163 INFO:tasks.workunit.client.1.smithi161.stdout:0/963: creat d9/d9c/f12a x:0 0 0 2023-12-09T02:35:26.165 INFO:tasks.workunit.client.1.smithi161.stdout:0/964: mknod d9/db/d2a/d9d/dba/d94/db6/c12b 0 2023-12-09T02:35:26.167 INFO:tasks.workunit.client.1.smithi161.stdout:0/965: rename d9/db/d2a/fd7 to d9/d55/d7c/f12c 0 2023-12-09T02:35:26.168 INFO:tasks.workunit.client.1.smithi161.stdout:0/966: rmdir d9/db/d2a/d35/dfd 39 2023-12-09T02:35:26.169 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:25 smithi161 ceph-mon[121170]: pgmap v9: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 78 MiB/s rd, 153 MiB/s wr, 306 op/s 2023-12-09T02:35:26.170 INFO:tasks.workunit.client.1.smithi161.stdout:0/967: dread d9/d55/d7c/f6b [0,4194304] 0 2023-12-09T02:35:26.173 INFO:tasks.workunit.client.1.smithi161.stdout:0/968: unlink d9/d9c/f123 0 2023-12-09T02:35:26.175 INFO:tasks.workunit.client.1.smithi161.stdout:0/969: creat d9/d55/d26/d28/d58/f12d x:0 0 0 2023-12-09T02:35:26.176 INFO:tasks.workunit.client.1.smithi161.stdout:0/970: rmdir d9/d55/d44/ddf 39 2023-12-09T02:35:26.177 INFO:tasks.workunit.client.1.smithi161.stdout:0/971: getdents d9/d55/d26 0 2023-12-09T02:35:26.183 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:25 smithi088 ceph-mon[112028]: pgmap v9: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 78 MiB/s rd, 153 MiB/s wr, 306 op/s 2023-12-09T02:35:26.191 INFO:tasks.workunit.client.1.smithi161.stdout:0/972: dwrite d9/dd/f80 [0,4194304] 0 2023-12-09T02:35:26.193 INFO:tasks.workunit.client.1.smithi161.stdout:0/973: write d9/f62 [1385170,29765] 0 2023-12-09T02:35:26.196 INFO:tasks.workunit.client.1.smithi161.stdout:0/974: symlink d9/d55/d44/d85/l12e 0 2023-12-09T02:35:26.198 INFO:tasks.workunit.client.1.smithi161.stdout:0/975: creat d9/db/d2a/d9d/f12f x:0 0 0 2023-12-09T02:35:26.201 INFO:tasks.workunit.client.1.smithi161.stdout:0/976: rmdir d9/d5b/d112 0 2023-12-09T02:35:26.202 INFO:tasks.workunit.client.1.smithi161.stdout:0/977: mkdir d9/d55/d5a/d130 0 2023-12-09T02:35:26.204 INFO:tasks.workunit.client.1.smithi161.stdout:0/978: creat d9/d55/d26/d28/daa/f131 x:0 0 0 2023-12-09T02:35:26.209 INFO:tasks.workunit.client.1.smithi161.stdout:6/894: sync 2023-12-09T02:35:26.210 INFO:tasks.workunit.client.1.smithi161.stdout:6/895: dread - da/d19/dc2/d4d/fa8 zero size 2023-12-09T02:35:26.210 INFO:tasks.workunit.client.1.smithi161.stdout:9/876: sync 2023-12-09T02:35:26.211 INFO:tasks.workunit.client.1.smithi161.stdout:6/896: rmdir da/d19/dc2 39 2023-12-09T02:35:26.211 INFO:tasks.workunit.client.1.smithi161.stdout:6/897: fsync da/d19/dc2/d4d/fef 0 2023-12-09T02:35:26.214 INFO:tasks.workunit.client.1.smithi161.stdout:9/877: creat d2/d25/dbf/d124/dd1/f13b x:0 0 0 2023-12-09T02:35:26.215 INFO:tasks.workunit.client.1.smithi161.stdout:6/898: mknod da/d55/d6d/d85/c136 0 2023-12-09T02:35:26.219 INFO:tasks.workunit.client.1.smithi161.stdout:6/899: link da/d19/dc2/f67 da/d19/d20/dbf/f137 0 2023-12-09T02:35:26.221 INFO:tasks.workunit.client.1.smithi161.stdout:0/979: dwrite d9/d55/f6a [0,4194304] 0 2023-12-09T02:35:26.225 INFO:tasks.workunit.client.1.smithi161.stdout:0/980: symlink d9/d55/d5a/db1/l132 0 2023-12-09T02:35:26.225 INFO:tasks.workunit.client.1.smithi161.stdout:0/981: dread - d9/d9c/fc8 zero size 2023-12-09T02:35:26.225 INFO:tasks.workunit.client.1.smithi161.stdout:0/982: dread - d9/d1f/dd4/fdc zero size 2023-12-09T02:35:26.226 INFO:tasks.workunit.client.1.smithi161.stdout:0/983: chown d9/db/d2a/d35/d7b 793 1 2023-12-09T02:35:26.227 INFO:tasks.workunit.client.1.smithi161.stdout:0/984: stat d9/d55/d7c/d7a/da3/ce2 0 2023-12-09T02:35:26.227 INFO:tasks.workunit.client.1.smithi161.stdout:0/985: chown d9/d55/d5a/c76 25919 1 2023-12-09T02:35:26.229 INFO:tasks.workunit.client.1.smithi161.stdout:0/986: creat d9/db/f133 x:0 0 0 2023-12-09T02:35:26.235 INFO:tasks.workunit.client.1.smithi161.stdout:9/878: dwrite d2/f3e [0,4194304] 0 2023-12-09T02:35:26.235 INFO:tasks.workunit.client.1.smithi161.stdout:9/879: symlink d2/d25/dbf/d124/d90/d95/dea/d13a/l13c 0 2023-12-09T02:35:26.239 INFO:tasks.workunit.client.1.smithi161.stdout:6/900: dwrite da/d19/dc2/d3c/f128 [0,4194304] 0 2023-12-09T02:35:26.239 INFO:tasks.workunit.client.1.smithi161.stdout:6/901: truncate da/d19/dc2/d29/f100 141907 0 2023-12-09T02:35:26.240 INFO:tasks.workunit.client.1.smithi161.stdout:9/880: creat d2/d25/db1/d65/d4f/dfb/f13d x:0 0 0 2023-12-09T02:35:26.240 INFO:tasks.workunit.client.1.smithi161.stdout:9/881: getdents d2/d25/dbf/d124/d90/d95/de1 0 2023-12-09T02:35:26.240 INFO:tasks.workunit.client.1.smithi161.stdout:9/882: fdatasync d2/d25/db1/d65/d5c/f56 0 2023-12-09T02:35:26.248 INFO:tasks.workunit.client.1.smithi161.stdout:6/902: mkdir da/d19/dc2/d29/d2b/db4/dc0/d138 0 2023-12-09T02:35:26.248 INFO:tasks.workunit.client.1.smithi161.stdout:6/903: fdatasync da/d19/dc2/d29/f100 0 2023-12-09T02:35:26.248 INFO:tasks.workunit.client.1.smithi161.stdout:0/987: dwrite d9/d55/d26/d28/d58/d8e/fea [0,4194304] 0 2023-12-09T02:35:26.249 INFO:tasks.workunit.client.1.smithi161.stdout:9/883: mkdir d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/d13e 0 2023-12-09T02:35:26.253 INFO:tasks.workunit.client.1.smithi161.stdout:6/904: rename da/d55/dea to da/d19/dc2/d29/d2b/d31/d33/d39/d139 0 2023-12-09T02:35:26.253 INFO:tasks.workunit.client.1.smithi161.stdout:6/905: write da/df/f117 [613238,129162] 0 2023-12-09T02:35:26.254 INFO:tasks.workunit.client.1.smithi161.stdout:6/906: chown da/d19/dc2/d4d/fef 53 1 2023-12-09T02:35:26.254 INFO:tasks.workunit.client.1.smithi161.stdout:6/907: write da/d19/dc2/d29/d2b/d31/ff4 [1191248,46274] 0 2023-12-09T02:35:26.254 INFO:tasks.workunit.client.1.smithi161.stdout:6/908: dread - da/d19/fc7 zero size 2023-12-09T02:35:26.262 INFO:tasks.workunit.client.1.smithi161.stdout:6/909: dread da/d19/dc2/d29/f45 [0,4194304] 0 2023-12-09T02:35:26.332 INFO:tasks.workunit.client.1.smithi161.stdout:9/884: rename d2/d25/db1/d65/d5c/d60/d7f/la1 to d2/d25/db1/d65/d88/dcb/ddf/l13f 0 2023-12-09T02:35:26.332 INFO:tasks.workunit.client.1.smithi161.stdout:9/885: truncate d2/d25/db1/d65/d5c/d55/f11d 917271 0 2023-12-09T02:35:26.332 INFO:tasks.workunit.client.1.smithi161.stdout:9/886: stat d2/c37 0 2023-12-09T02:35:26.332 INFO:tasks.workunit.client.1.smithi161.stdout:9/887: write d2/d25/db1/d65/d5c/d55/d66/fbc [3306028,50269] 0 2023-12-09T02:35:26.336 INFO:tasks.workunit.client.1.smithi161.stdout:6/910: rename da/d19/dc2/l125 to da/d19/dc2/d29/d2b/l13a 0 2023-12-09T02:35:26.337 INFO:tasks.workunit.client.1.smithi161.stdout:6/911: write da/d19/dc2/d29/f6e [1194999,123458] 0 2023-12-09T02:35:26.340 INFO:tasks.workunit.client.1.smithi161.stdout:6/912: link da/d19/dc2/d3c/l135 da/d19/dc2/d29/d2b/d31/d33/d39/d139/l13b 0 2023-12-09T02:35:26.340 INFO:tasks.workunit.client.1.smithi161.stdout:6/913: chown da/d19/dc2/d29/d2b/db4/dc0/c104 59763230 1 2023-12-09T02:35:26.340 INFO:tasks.workunit.client.1.smithi161.stdout:6/914: stat da/d19/dc2/d3c/d46/l4b 0 2023-12-09T02:35:26.341 INFO:tasks.workunit.client.1.smithi161.stdout:9/888: dread d2/d25/db1/d65/d88/fe2 [0,4194304] 0 2023-12-09T02:35:26.341 INFO:tasks.workunit.client.1.smithi161.stdout:9/889: fdatasync d2/d25/dbf/d124/dd1/ff0 0 2023-12-09T02:35:26.344 INFO:tasks.workunit.client.1.smithi161.stdout:6/915: mknod da/d19/dc2/d9e/d12d/c13c 0 2023-12-09T02:35:26.344 INFO:tasks.workunit.client.1.smithi161.stdout:6/916: readlink da/d19/dc2/d3c/l135 0 2023-12-09T02:35:26.344 INFO:tasks.workunit.client.1.smithi161.stdout:6/917: fdatasync da/d19/dc2/d4d/fa8 0 2023-12-09T02:35:26.345 INFO:tasks.workunit.client.1.smithi161.stdout:9/890: creat d2/d25/db1/d65/d42/d58/d22/f140 x:0 0 0 2023-12-09T02:35:26.346 INFO:tasks.workunit.client.1.smithi161.stdout:6/918: creat da/d19/dc2/d29/d92/f13d x:0 0 0 2023-12-09T02:35:26.346 INFO:tasks.workunit.client.1.smithi161.stdout:6/919: truncate da/d19/dc2/d3c/fdc 396185 0 2023-12-09T02:35:26.347 INFO:tasks.workunit.client.1.smithi161.stdout:9/891: unlink d2/d25/db1/d65/d42/d58/d91/dd0/f107 0 2023-12-09T02:35:26.350 INFO:tasks.workunit.client.1.smithi161.stdout:6/920: rename da/d19/dc2/d3c/laa to da/d19/dc2/d29/l13e 0 2023-12-09T02:35:26.350 INFO:tasks.workunit.client.1.smithi161.stdout:6/921: fdatasync da/df/fd6 0 2023-12-09T02:35:26.350 INFO:tasks.workunit.client.1.smithi161.stdout:6/922: chown da/d19/dc2/dd2 9322 1 2023-12-09T02:35:26.350 INFO:tasks.workunit.client.1.smithi161.stdout:6/923: chown da/df/d2d/ldd 4368520 1 2023-12-09T02:35:26.351 INFO:tasks.workunit.client.1.smithi161.stdout:9/892: symlink d2/d25/db1/d65/d42/d58/d91/l141 0 2023-12-09T02:35:26.351 INFO:tasks.workunit.client.1.smithi161.stdout:9/893: readlink d2/d25/dbf/dcc/lde 0 2023-12-09T02:35:26.351 INFO:tasks.workunit.client.1.smithi161.stdout:9/894: chown d2/d25/db1/fa0 508 1 2023-12-09T02:35:26.352 INFO:tasks.workunit.client.1.smithi161.stdout:6/924: creat da/d19/f13f x:0 0 0 2023-12-09T02:35:26.353 INFO:tasks.workunit.client.1.smithi161.stdout:9/895: creat d2/d25/db1/d65/d5c/d55/d66/f142 x:0 0 0 2023-12-09T02:35:26.353 INFO:tasks.workunit.client.1.smithi161.stdout:9/896: write d2/d25/db1/d65/d4f/dfb/f128 [426970,7913] 0 2023-12-09T02:35:26.354 INFO:tasks.workunit.client.1.smithi161.stdout:6/925: symlink da/d19/dc2/d4d/d5e/l140 0 2023-12-09T02:35:26.355 INFO:tasks.workunit.client.1.smithi161.stdout:6/926: dread da/d19/dc2/d3c/d46/ffe [0,4194304] 0 2023-12-09T02:35:26.355 INFO:tasks.workunit.client.1.smithi161.stdout:6/927: chown da/d19/dc2/d29/d2b/d31/d33/d39/c112 30078495 1 2023-12-09T02:35:26.356 INFO:tasks.workunit.client.1.smithi161.stdout:9/897: link d2/d25/dbf/d124/d90/d95/fc5 d2/d25/db1/d65/d42/d58/d91/d2e/db8/f143 0 2023-12-09T02:35:26.361 INFO:tasks.workunit.client.1.smithi161.stdout:6/928: creat da/df/d2d/d49/f141 x:0 0 0 2023-12-09T02:35:26.361 INFO:tasks.workunit.client.1.smithi161.stdout:6/929: write da/d19/dc2/d3c/d46/ffe [326379,90195] 0 2023-12-09T02:35:26.363 INFO:tasks.workunit.client.1.smithi161.stdout:9/898: creat d2/d25/db1/d65/d5c/d55/f144 x:0 0 0 2023-12-09T02:35:26.365 INFO:tasks.workunit.client.1.smithi161.stdout:6/930: symlink da/df/d2d/d3b/d10d/l142 0 2023-12-09T02:35:26.366 INFO:tasks.workunit.client.1.smithi161.stdout:6/931: chown da/d19/dc2/d29/f6e 287608 1 2023-12-09T02:35:26.367 INFO:tasks.workunit.client.1.smithi161.stdout:9/899: creat d2/d25/db1/d65/d5c/d55/d66/f145 x:0 0 0 2023-12-09T02:35:26.367 INFO:tasks.workunit.client.1.smithi161.stdout:9/900: dread - d2/d25/db1/d65/d42/d58/d91/d2e/d3f/f10d zero size 2023-12-09T02:35:26.385 INFO:tasks.workunit.client.1.smithi161.stdout:9/901: dwrite d2/d25/db1/d65/d88/f121 [0,4194304] 0 2023-12-09T02:35:26.386 INFO:tasks.workunit.client.1.smithi161.stdout:6/932: dwrite da/d19/dc2/d3c/f91 [0,4194304] 0 2023-12-09T02:35:26.391 INFO:tasks.workunit.client.1.smithi161.stdout:6/933: getdents da/df/d2d 0 2023-12-09T02:35:26.391 INFO:tasks.workunit.client.1.smithi161.stdout:6/934: write da/d19/f1e [12707065,38544] 0 2023-12-09T02:35:26.393 INFO:tasks.workunit.client.1.smithi161.stdout:6/935: dread da/d19/dc2/fd5 [0,4194304] 0 2023-12-09T02:35:26.401 INFO:tasks.workunit.client.1.smithi161.stdout:9/902: dwrite d2/d25/db1/d65/d42/d58/f27 [0,4194304] 0 2023-12-09T02:35:26.406 INFO:tasks.workunit.client.1.smithi161.stdout:8/861: sync 2023-12-09T02:35:26.406 INFO:tasks.workunit.client.1.smithi161.stdout:7/822: sync 2023-12-09T02:35:26.406 INFO:tasks.workunit.client.1.smithi161.stdout:3/856: sync 2023-12-09T02:35:26.406 INFO:tasks.workunit.client.1.smithi161.stdout:2/946: sync 2023-12-09T02:35:26.406 INFO:tasks.workunit.client.1.smithi161.stdout:2/947: fdatasync d4/d7/d11e/d127/f130 0 2023-12-09T02:35:26.406 INFO:tasks.workunit.client.1.smithi161.stdout:7/823: truncate d0/d49/d79/dc3/fe3 1411190 0 2023-12-09T02:35:26.407 INFO:tasks.workunit.client.1.smithi161.stdout:8/862: mknod d2/d2d/c11c 0 2023-12-09T02:35:26.410 INFO:tasks.workunit.client.1.smithi161.stdout:2/948: getdents d4/d1a/d4a/de3 0 2023-12-09T02:35:26.411 INFO:tasks.workunit.client.1.smithi161.stdout:3/857: write d2/d51/d75/d11/d28/fe2 [1432529,51578] 0 2023-12-09T02:35:26.411 INFO:tasks.workunit.client.1.smithi161.stdout:3/858: chown d2/d51/d75/d50/ddf/d96/lb5 605183010 1 2023-12-09T02:35:26.412 INFO:tasks.workunit.client.1.smithi161.stdout:7/824: creat d0/d3/d13/d4e/db2/dda/d4b/d5a/f106 x:0 0 0 2023-12-09T02:35:26.413 INFO:tasks.workunit.client.1.smithi161.stdout:7/825: fsync d0/d3/d13/d4e/db2/dda/dab/ff3 0 2023-12-09T02:35:26.416 INFO:tasks.workunit.client.1.smithi161.stdout:2/949: link d4/d1a/d4a/daa/l9b d4/d1a/d4a/d10a/l137 0 2023-12-09T02:35:26.417 INFO:tasks.workunit.client.1.smithi161.stdout:2/950: chown d4/d16/c6f 21890 1 2023-12-09T02:35:26.417 INFO:tasks.workunit.client.1.smithi161.stdout:2/951: fdatasync d4/d16/d69/d8c/ddf/f81 0 2023-12-09T02:35:26.418 INFO:tasks.workunit.client.1.smithi161.stdout:3/859: creat d2/d37/d99/dd2/f103 x:0 0 0 2023-12-09T02:35:26.421 INFO:tasks.workunit.client.1.smithi161.stdout:2/952: symlink d4/d7/d8f/dd2/d107/l138 0 2023-12-09T02:35:26.423 INFO:tasks.workunit.client.1.smithi161.stdout:3/860: creat d2/daf/de9/f104 x:0 0 0 2023-12-09T02:35:26.423 INFO:tasks.workunit.client.1.smithi161.stdout:3/861: chown d2/d51/d75/d11/d1f/d74 1486145854 1 2023-12-09T02:35:26.425 INFO:tasks.workunit.client.1.smithi161.stdout:2/953: rename d4/d7/db/c23 to d4/da6/db9/c139 0 2023-12-09T02:35:26.425 INFO:tasks.workunit.client.1.smithi161.stdout:6/936: dwrite da/d19/f72 [4194304,4194304] 0 2023-12-09T02:35:26.427 INFO:tasks.workunit.client.1.smithi161.stdout:9/903: dwrite d2/d25/db1/d65/d5c/d55/d66/f105 [0,4194304] 0 2023-12-09T02:35:26.427 INFO:tasks.workunit.client.1.smithi161.stdout:6/937: mkdir da/d19/dc2/d29/d92/d143 0 2023-12-09T02:35:26.427 INFO:tasks.workunit.client.1.smithi161.stdout:6/938: stat da/d19/dc2/d9e/d12d/l132 0 2023-12-09T02:35:26.430 INFO:tasks.workunit.client.1.smithi161.stdout:3/862: dread d2/d51/d75/d11/d28/f8a [0,4194304] 0 2023-12-09T02:35:26.435 INFO:tasks.workunit.client.1.smithi161.stdout:7/826: dwrite d0/d3/d13/d4e/db5/fa1 [4194304,4194304] 0 2023-12-09T02:35:26.438 INFO:tasks.workunit.client.1.smithi161.stdout:8/863: dwrite d2/d5/d22/d31/d38/d66/d88/da1/fa6 [0,4194304] 0 2023-12-09T02:35:26.441 INFO:tasks.workunit.client.1.smithi161.stdout:2/954: dread d4/d16/d69/d7b/f54 [0,4194304] 0 2023-12-09T02:35:26.441 INFO:tasks.workunit.client.1.smithi161.stdout:2/955: chown d4/d16/d69/d8c/d87/fe1 0 1 2023-12-09T02:35:26.443 INFO:tasks.workunit.client.1.smithi161.stdout:2/956: write d4/fa0 [486080,13222] 0 2023-12-09T02:35:26.443 INFO:tasks.workunit.client.1.smithi161.stdout:9/904: dread d2/f47 [0,4194304] 0 2023-12-09T02:35:26.447 INFO:tasks.workunit.client.1.smithi161.stdout:7/827: unlink d0/d3/f17 0 2023-12-09T02:35:26.449 INFO:tasks.workunit.client.1.smithi161.stdout:6/939: dwrite da/df/f27 [0,4194304] 0 2023-12-09T02:35:26.453 INFO:tasks.workunit.client.1.smithi161.stdout:8/864: dread d2/f3 [0,4194304] 0 2023-12-09T02:35:26.454 INFO:tasks.workunit.client.1.smithi161.stdout:3/863: dwrite d2/d51/d75/d11/d1f/f8f [0,4194304] 0 2023-12-09T02:35:26.454 INFO:tasks.workunit.client.1.smithi161.stdout:3/864: readlink d2/d51/d75/d11/d1f/l4a 0 2023-12-09T02:35:26.465 INFO:tasks.workunit.client.1.smithi161.stdout:2/957: rename d4/d1a/d4a/daa/fc5 to d4/d1a/f13a 0 2023-12-09T02:35:26.467 INFO:tasks.workunit.client.1.smithi161.stdout:9/905: mkdir d2/d25/db1/d65/d42/d58/d91/d2e/db8/d146 0 2023-12-09T02:35:26.467 INFO:tasks.workunit.client.1.smithi161.stdout:7/828: truncate d0/fc1 575231 0 2023-12-09T02:35:26.468 INFO:tasks.workunit.client.1.smithi161.stdout:6/940: creat da/d55/f144 x:0 0 0 2023-12-09T02:35:26.470 INFO:tasks.workunit.client.1.smithi161.stdout:2/958: rename d4/da6/db9/f57 to d4/d1a/d4a/d10a/f13b 0 2023-12-09T02:35:26.471 INFO:tasks.workunit.client.1.smithi161.stdout:9/906: mkdir d2/d25/dbf/d124/dd1/d147 0 2023-12-09T02:35:26.475 INFO:tasks.workunit.client.1.smithi161.stdout:2/959: rmdir d4/d16/de0 39 2023-12-09T02:35:26.475 INFO:tasks.workunit.client.1.smithi161.stdout:2/960: fsync d4/d16/de0/d106/f11d 0 2023-12-09T02:35:26.475 INFO:tasks.workunit.client.1.smithi161.stdout:6/941: creat da/d19/dc2/d29/d92/d143/f145 x:0 0 0 2023-12-09T02:35:26.476 INFO:tasks.workunit.client.1.smithi161.stdout:6/942: creat da/d19/dc2/d29/d2b/f146 x:0 0 0 2023-12-09T02:35:26.478 INFO:tasks.workunit.client.1.smithi161.stdout:2/961: rename d4/d1a/d4a/daa/fed to d4/d16/d69/f13c 0 2023-12-09T02:35:26.478 INFO:tasks.workunit.client.1.smithi161.stdout:2/962: write d4/fda [581009,115920] 0 2023-12-09T02:35:26.480 INFO:tasks.workunit.client.1.smithi161.stdout:6/943: rename da/d19/dc2/d3c/f91 to da/d19/dc2/d29/d2b/d31/d33/d39/d139/f147 0 2023-12-09T02:35:26.482 INFO:tasks.workunit.client.1.smithi161.stdout:2/963: unlink d4/d16/f100 0 2023-12-09T02:35:26.484 INFO:tasks.workunit.client.1.smithi161.stdout:6/944: creat da/d19/d20/dbf/f148 x:0 0 0 2023-12-09T02:35:26.486 INFO:tasks.workunit.client.1.smithi161.stdout:8/865: dwrite d2/d5/d4f/f35 [0,4194304] 0 2023-12-09T02:35:26.490 INFO:tasks.workunit.client.1.smithi161.stdout:3/865: dwrite d2/d51/d75/d11/f64 [4194304,4194304] 0 2023-12-09T02:35:26.490 INFO:tasks.workunit.client.1.smithi161.stdout:7/829: dwrite d0/d3/d13/dc7/f57 [0,4194304] 0 2023-12-09T02:35:26.491 INFO:tasks.workunit.client.1.smithi161.stdout:6/945: dread da/d19/dc2/d29/d2b/d31/f66 [0,4194304] 0 2023-12-09T02:35:26.491 INFO:tasks.workunit.client.1.smithi161.stdout:6/946: chown da/c8f 1385630 1 2023-12-09T02:35:26.495 INFO:tasks.workunit.client.1.smithi161.stdout:8/866: creat d2/d8a/dbd/df0/f11d x:0 0 0 2023-12-09T02:35:26.495 INFO:tasks.workunit.client.1.smithi161.stdout:7/830: dread d0/d3/f8 [0,4194304] 0 2023-12-09T02:35:26.495 INFO:tasks.workunit.client.1.smithi161.stdout:7/831: write d0/d3/d13/d4e/db2/dda/dab/f5c [4381573,23419] 0 2023-12-09T02:35:26.497 INFO:tasks.workunit.client.1.smithi161.stdout:2/964: dwrite d4/d1a/f40 [0,4194304] 0 2023-12-09T02:35:26.499 INFO:tasks.workunit.client.1.smithi161.stdout:2/965: read d4/d7/f15 [8021662,81375] 0 2023-12-09T02:35:26.499 INFO:tasks.workunit.client.1.smithi161.stdout:2/966: dread - d4/d7/f119 zero size 2023-12-09T02:35:26.499 INFO:tasks.workunit.client.1.smithi161.stdout:2/967: readlink d4/d1a/d4a/d6d/ld3 0 2023-12-09T02:35:26.499 INFO:tasks.workunit.client.1.smithi161.stdout:2/968: truncate d4/d16/d69/d8c/fbd 5075348 0 2023-12-09T02:35:26.499 INFO:tasks.workunit.client.1.smithi161.stdout:2/969: dread - d4/d1a/f13a zero size 2023-12-09T02:35:26.499 INFO:tasks.workunit.client.1.smithi161.stdout:3/866: creat d2/d51/dee/d91/d46/f105 x:0 0 0 2023-12-09T02:35:26.499 INFO:tasks.workunit.client.1.smithi161.stdout:3/867: write d2/d51/d75/d50/d69/db7/ff0 [836568,85888] 0 2023-12-09T02:35:26.499 INFO:tasks.workunit.client.1.smithi161.stdout:7/832: write d0/f42 [1194518,96150] 0 2023-12-09T02:35:26.501 INFO:tasks.workunit.client.1.smithi161.stdout:6/947: symlink da/d19/l149 0 2023-12-09T02:35:26.501 INFO:tasks.workunit.client.1.smithi161.stdout:6/948: fsync da/d19/f72 0 2023-12-09T02:35:26.502 INFO:tasks.workunit.client.1.smithi161.stdout:6/949: chown da/d19/dc2/d29/d2b/d31/ff4 16272 1 2023-12-09T02:35:26.505 INFO:tasks.workunit.client.1.smithi161.stdout:8/867: creat d2/d5/d4f/db2/da9/f11e x:0 0 0 2023-12-09T02:35:26.510 INFO:tasks.workunit.client.1.smithi161.stdout:2/970: creat d4/da6/db9/f13d x:0 0 0 2023-12-09T02:35:26.515 INFO:tasks.workunit.client.1.smithi161.stdout:6/950: symlink da/df/d2d/d3b/l14a 0 2023-12-09T02:35:26.515 INFO:tasks.workunit.client.1.smithi161.stdout:6/951: chown da/c8f 7846 1 2023-12-09T02:35:26.520 INFO:tasks.workunit.client.1.smithi161.stdout:7/833: dread d0/fc1 [0,4194304] 0 2023-12-09T02:35:26.522 INFO:tasks.workunit.client.1.smithi161.stdout:8/868: creat d2/d5/d22/d86/f11f x:0 0 0 2023-12-09T02:35:26.523 INFO:tasks.workunit.client.1.smithi161.stdout:8/869: write d2/d5/d22/d76/f85 [636786,52869] 0 2023-12-09T02:35:26.523 INFO:tasks.workunit.client.1.smithi161.stdout:8/870: fdatasync d2/d5/d22/d31/f39 0 2023-12-09T02:35:26.524 INFO:tasks.workunit.client.1.smithi161.stdout:6/952: link da/d19/dc2/d29/d2b/f97 da/d55/d6d/dac/f14b 0 2023-12-09T02:35:26.526 INFO:tasks.workunit.client.1.smithi161.stdout:8/871: truncate d2/d2d/f70 2075009 0 2023-12-09T02:35:26.526 INFO:tasks.workunit.client.1.smithi161.stdout:8/872: chown d2/d2d/c11c 762596 1 2023-12-09T02:35:26.527 INFO:tasks.workunit.client.1.smithi161.stdout:8/873: fdatasync d2/d5/d22/fbf 0 2023-12-09T02:35:26.527 INFO:tasks.workunit.client.1.smithi161.stdout:2/971: dwrite d4/d7/f48 [0,4194304] 0 2023-12-09T02:35:26.529 INFO:tasks.workunit.client.1.smithi161.stdout:6/953: getdents da/d19/dc2/d3c/dfb 0 2023-12-09T02:35:26.530 INFO:tasks.workunit.client.1.smithi161.stdout:7/834: write d0/d3/d13/dc7/f57 [4300794,72553] 0 2023-12-09T02:35:26.530 INFO:tasks.workunit.client.1.smithi161.stdout:7/835: readlink d0/d3/d13/d4e/db5/d83/l8b 0 2023-12-09T02:35:26.531 INFO:tasks.workunit.client.1.smithi161.stdout:2/972: dread d4/d16/f88 [0,4194304] 0 2023-12-09T02:35:26.532 INFO:tasks.workunit.client.1.smithi161.stdout:6/954: write da/d19/dc2/d29/d2b/d31/d33/d39/d139/f118 [2964581,105175] 0 2023-12-09T02:35:26.532 INFO:tasks.workunit.client.1.smithi161.stdout:6/955: fsync da/d19/dc2/d3c/dd1/df0/d12a/f134 0 2023-12-09T02:35:26.536 INFO:tasks.workunit.client.1.smithi161.stdout:6/956: rename da/d19/dc2/d3c/db8/f123 to da/d19/dc2/d3c/d46/f14c 0 2023-12-09T02:35:26.537 INFO:tasks.workunit.client.1.smithi161.stdout:2/973: symlink d4/da6/de6/l13e 0 2023-12-09T02:35:26.543 INFO:tasks.workunit.client.1.smithi161.stdout:2/974: creat d4/f13f x:0 0 0 2023-12-09T02:35:26.544 INFO:tasks.workunit.client.1.smithi161.stdout:0/988: sync 2023-12-09T02:35:26.544 INFO:tasks.workunit.client.1.smithi161.stdout:0/989: chown d9/d55/d5a/db1/f106 51363954 1 2023-12-09T02:35:26.546 INFO:tasks.workunit.client.1.smithi161.stdout:6/957: dread da/d19/dc2/d77/d79/fe7 [0,4194304] 0 2023-12-09T02:35:26.546 INFO:tasks.workunit.client.1.smithi161.stdout:6/958: write da/d19/dc2/d3c/d46/f108 [865007,73246] 0 2023-12-09T02:35:26.546 INFO:tasks.workunit.client.1.smithi161.stdout:6/959: fdatasync da/d19/f23 0 2023-12-09T02:35:26.550 INFO:tasks.workunit.client.1.smithi161.stdout:6/960: mkdir da/d55/d6d/d14d 0 2023-12-09T02:35:26.550 INFO:tasks.workunit.client.1.smithi161.stdout:0/990: mkdir d9/db/d134 0 2023-12-09T02:35:26.550 INFO:tasks.workunit.client.1.smithi161.stdout:0/991: write d9/d55/d44/d85/f128 [448440,101807] 0 2023-12-09T02:35:26.552 INFO:tasks.workunit.client.1.smithi161.stdout:6/961: getdents da/df/d2d/d49 0 2023-12-09T02:35:26.555 INFO:tasks.workunit.client.1.smithi161.stdout:0/992: creat d9/db/df1/d11a/f135 x:0 0 0 2023-12-09T02:35:26.556 INFO:tasks.workunit.client.1.smithi161.stdout:6/962: rmdir da/df/d2d/d3b/dd4 39 2023-12-09T02:35:26.557 INFO:tasks.workunit.client.1.smithi161.stdout:7/836: dwrite d0/d3/d13/f1f [0,4194304] 0 2023-12-09T02:35:26.558 INFO:tasks.workunit.client.1.smithi161.stdout:8/874: dwrite d2/fea [0,4194304] 0 2023-12-09T02:35:26.558 INFO:tasks.workunit.client.1.smithi161.stdout:2/975: dread d4/d16/d69/d8c/ff0 [0,4194304] 0 2023-12-09T02:35:26.558 INFO:tasks.workunit.client.1.smithi161.stdout:7/837: write d0/d3/d6a/fdf [384950,36654] 0 2023-12-09T02:35:26.563 INFO:tasks.workunit.client.1.smithi161.stdout:6/963: rename da/d19/dc2/d29/d2b/db4/ff6 to da/df/d2d/d3b/dd4/f14e 0 2023-12-09T02:35:26.564 INFO:tasks.workunit.client.1.smithi161.stdout:8/875: dread d2/f3 [0,4194304] 0 2023-12-09T02:35:26.565 INFO:tasks.workunit.client.1.smithi161.stdout:6/964: read da/d19/dc2/d29/d2b/d31/f94 [629157,4969] 0 2023-12-09T02:35:26.572 INFO:tasks.workunit.client.1.smithi161.stdout:2/976: link d4/d1a/c42 d4/d7/d11e/d127/c140 0 2023-12-09T02:35:26.573 INFO:tasks.workunit.client.1.smithi161.stdout:2/977: chown d4/d1a/d4a/de3/f112 1567391 1 2023-12-09T02:35:26.582 INFO:tasks.workunit.client.1.smithi161.stdout:7/838: dwrite d0/d49/d79/f93 [0,4194304] 0 2023-12-09T02:35:26.586 INFO:tasks.workunit.client.1.smithi161.stdout:0/993: link d9/c70 d9/d55/d26/d28/c136 0 2023-12-09T02:35:26.587 INFO:tasks.workunit.client.1.smithi161.stdout:0/994: write d9/d55/f6a [1989891,17707] 0 2023-12-09T02:35:26.588 INFO:tasks.workunit.client.1.smithi161.stdout:8/876: rename d2/d5/d22/d31/d38/f4d to d2/d5/d4f/f120 0 2023-12-09T02:35:26.588 INFO:tasks.workunit.client.1.smithi161.stdout:0/995: read d9/d55/d44/d85/fce [3719970,44590] 0 2023-12-09T02:35:26.592 INFO:tasks.workunit.client.1.smithi161.stdout:7/839: getdents d0/d3/d6a/dc9 0 2023-12-09T02:35:26.594 INFO:tasks.workunit.client.1.smithi161.stdout:6/965: rename da/f76 to da/df/d2d/d3b/f14f 0 2023-12-09T02:35:26.601 INFO:tasks.workunit.client.1.smithi161.stdout:2/978: dwrite d4/d7/d11e/d127/f12e [0,4194304] 0 2023-12-09T02:35:26.601 INFO:tasks.workunit.client.1.smithi161.stdout:8/877: dread d2/d5/d22/f81 [0,4194304] 0 2023-12-09T02:35:26.653 INFO:tasks.workunit.client.1.smithi161.stdout:7/840: symlink d0/d3/d13/d4e/d70/l107 0 2023-12-09T02:35:26.654 INFO:tasks.workunit.client.1.smithi161.stdout:6/966: link da/d19/dc2/d29/d92/fa2 da/d19/dc2/d4d/f150 0 2023-12-09T02:35:26.661 INFO:tasks.workunit.client.1.smithi161.stdout:7/841: dread d0/d3/d6c/f102 [0,4194304] 0 2023-12-09T02:35:26.662 INFO:tasks.workunit.client.1.smithi161.stdout:7/842: write d0/d3/d13/d4e/db5/d83/f95 [970317,116864] 0 2023-12-09T02:35:26.662 INFO:tasks.workunit.client.1.smithi161.stdout:7/843: write d0/d3/d13/d4e/db2/f4f [5110040,123934] 0 2023-12-09T02:35:26.663 INFO:tasks.workunit.client.1.smithi161.stdout:8/878: creat d2/f121 x:0 0 0 2023-12-09T02:35:26.666 INFO:tasks.workunit.client.1.smithi161.stdout:8/879: dread d2/d5/d22/d31/d38/f3b [0,4194304] 0 2023-12-09T02:35:26.666 INFO:tasks.workunit.client.1.smithi161.stdout:8/880: dread - d2/d5/d22/d31/f8b zero size 2023-12-09T02:35:26.671 INFO:tasks.workunit.client.1.smithi161.stdout:8/881: symlink d2/d5/l122 0 2023-12-09T02:35:26.671 INFO:tasks.workunit.client.1.smithi161.stdout:7/844: dread d0/d3/d21/f3b [0,4194304] 0 2023-12-09T02:35:26.674 INFO:tasks.workunit.client.1.smithi161.stdout:6/967: dwrite da/d19/d20/fb9 [0,4194304] 0 2023-12-09T02:35:26.675 INFO:tasks.workunit.client.1.smithi161.stdout:6/968: stat da/d55/fc6 0 2023-12-09T02:35:26.675 INFO:tasks.workunit.client.1.smithi161.stdout:7/845: mkdir d0/d3/d13/dc7/dc8/dd9/d108 0 2023-12-09T02:35:26.676 INFO:tasks.workunit.client.1.smithi161.stdout:7/846: write d0/d3/d13/d4e/db5/d83/f95 [669843,79206] 0 2023-12-09T02:35:26.678 INFO:tasks.workunit.client.1.smithi161.stdout:6/969: symlink da/df/d2d/d3b/l151 0 2023-12-09T02:35:26.679 INFO:tasks.workunit.client.1.smithi161.stdout:7/847: mknod d0/d3/d13/dc7/dc8/dd9/d108/c109 0 2023-12-09T02:35:26.679 INFO:tasks.workunit.client.1.smithi161.stdout:7/848: fdatasync d0/d3/d13/d4e/db2/dda/d4b/f75 0 2023-12-09T02:35:26.680 INFO:tasks.workunit.client.1.smithi161.stdout:6/970: creat da/d55/d6d/dac/f152 x:0 0 0 2023-12-09T02:35:26.684 INFO:tasks.workunit.client.1.smithi161.stdout:6/971: dread da/df/f14 [0,4194304] 0 2023-12-09T02:35:26.686 INFO:tasks.workunit.client.1.smithi161.stdout:6/972: mkdir da/df/d2d/d49/d153 0 2023-12-09T02:35:26.688 INFO:tasks.workunit.client.1.smithi161.stdout:6/973: creat da/df/f154 x:0 0 0 2023-12-09T02:35:26.688 INFO:tasks.workunit.client.1.smithi161.stdout:8/882: dwrite d2/f121 [0,4194304] 0 2023-12-09T02:35:26.699 INFO:tasks.workunit.client.1.smithi161.stdout:6/974: mkdir da/d19/dc2/d3c/d46/d155 0 2023-12-09T02:35:26.703 INFO:tasks.workunit.client.1.smithi161.stdout:8/883: symlink d2/d5/d3d/dc7/l123 0 2023-12-09T02:35:26.703 INFO:tasks.workunit.client.1.smithi161.stdout:8/884: chown d2/d5/d22/d31 3716 1 2023-12-09T02:35:26.703 INFO:tasks.workunit.client.1.smithi161.stdout:8/885: write d2/f3 [627627,30282] 0 2023-12-09T02:35:26.704 INFO:tasks.workunit.client.1.smithi161.stdout:7/849: dwrite d0/d3/d13/d4e/db2/dda/dcb/f82 [4194304,4194304] 0 2023-12-09T02:35:26.707 INFO:tasks.workunit.client.1.smithi161.stdout:8/886: truncate d2/f17 906646 0 2023-12-09T02:35:26.707 INFO:tasks.workunit.client.1.smithi161.stdout:8/887: write d2/d5/d22/d31/d38/d66/d88/da5/feb [1255765,32671] 0 2023-12-09T02:35:26.707 INFO:tasks.workunit.client.1.smithi161.stdout:8/888: chown d2/d5/d22/d31/f65 489 1 2023-12-09T02:35:26.707 INFO:tasks.workunit.client.1.smithi161.stdout:8/889: readlink d2/d5/d22/d31/d38/ld2 0 2023-12-09T02:35:26.712 INFO:tasks.workunit.client.1.smithi161.stdout:6/975: dread da/d19/f1e [8388608,4194304] 0 2023-12-09T02:35:26.715 INFO:tasks.workunit.client.1.smithi161.stdout:8/890: symlink d2/d5/d22/d86/d97/d115/l124 0 2023-12-09T02:35:26.729 INFO:tasks.workunit.client.1.smithi161.stdout:6/976: mkdir da/d55/d6d/d156 0 2023-12-09T02:35:26.730 INFO:tasks.workunit.client.1.smithi161.stdout:7/850: symlink d0/d3/d6c/l10a 0 2023-12-09T02:35:26.731 INFO:tasks.workunit.client.1.smithi161.stdout:7/851: write d0/d3/d13/f34 [633530,91166] 0 2023-12-09T02:35:26.732 INFO:tasks.workunit.client.1.smithi161.stdout:8/891: mkdir d2/d5/d22/d86/d97/d125 0 2023-12-09T02:35:26.736 INFO:tasks.workunit.client.1.smithi161.stdout:6/977: rename da/d55/d6d/d85/l83 to da/d19/dc2/d29/d2b/d31/d33/d39/d139/l157 0 2023-12-09T02:35:26.738 INFO:tasks.workunit.client.1.smithi161.stdout:7/852: dread - d0/d3/d13/d4e/db2/dda/dcb/fb9 zero size 2023-12-09T02:35:26.740 INFO:tasks.workunit.client.1.smithi161.stdout:7/853: write d0/d3/d13/d4e/db2/dda/dab/ff3 [538506,78800] 0 2023-12-09T02:35:26.743 INFO:tasks.workunit.client.1.smithi161.stdout:7/854: mknod d0/d3/d13/d1b/db8/c10b 0 2023-12-09T02:35:26.746 INFO:tasks.workunit.client.1.smithi161.stdout:8/892: rename d2/d5/d22/d31/d38/d48/cde to d2/d5/d22/d54/db4/c126 0 2023-12-09T02:35:26.746 INFO:tasks.workunit.client.1.smithi161.stdout:8/893: chown d2/d5/d22/d31/da0 1749046731 1 2023-12-09T02:35:26.746 INFO:tasks.workunit.client.1.smithi161.stdout:8/894: dread - d2/d5/d22/d31/f8b zero size 2023-12-09T02:35:26.746 INFO:tasks.workunit.client.1.smithi161.stdout:8/895: chown d2/d5/d22/dc3/fda 128675 1 2023-12-09T02:35:26.746 INFO:tasks.workunit.client.1.smithi161.stdout:7/855: creat d0/d3/daa/daf/de4/df2/f10c x:0 0 0 2023-12-09T02:35:26.749 INFO:tasks.workunit.client.1.smithi161.stdout:8/896: write d2/d5/f34 [1898235,63099] 0 2023-12-09T02:35:26.751 INFO:tasks.workunit.client.1.smithi161.stdout:8/897: rename d2/d5/d22/d31/c118 to d2/d5/d22/d31/da0/dfa/c127 0 2023-12-09T02:35:26.752 INFO:tasks.workunit.client.1.smithi161.stdout:7/856: dread d0/d49/d79/dc3/fe3 [0,4194304] 0 2023-12-09T02:35:26.752 INFO:tasks.workunit.client.1.smithi161.stdout:7/857: fsync d0/d3/d6a/fdf 0 2023-12-09T02:35:26.754 INFO:tasks.workunit.client.1.smithi161.stdout:7/858: unlink d0/d3/d13/d1b/db8/c10b 0 2023-12-09T02:35:26.754 INFO:tasks.workunit.client.1.smithi161.stdout:7/859: chown d0/d3/daa/daf/de4/df2 28659113 1 2023-12-09T02:35:26.757 INFO:tasks.workunit.client.1.smithi161.stdout:8/898: write d2/d5/d4f/f35 [3724443,111997] 0 2023-12-09T02:35:26.757 INFO:tasks.workunit.client.1.smithi161.stdout:6/978: dwrite da/df/f27 [0,4194304] 0 2023-12-09T02:35:26.763 INFO:tasks.workunit.client.1.smithi161.stdout:8/899: mknod d2/d5/d22/d54/d9e/c128 0 2023-12-09T02:35:26.763 INFO:tasks.workunit.client.1.smithi161.stdout:8/900: write d2/d5/d22/d86/dd6/dd7/ff3 [1044449,55713] 0 2023-12-09T02:35:26.764 INFO:tasks.workunit.client.1.smithi161.stdout:6/979: creat da/d19/dc2/d3c/d46/f158 x:0 0 0 2023-12-09T02:35:26.766 INFO:tasks.workunit.client.1.smithi161.stdout:8/901: rename d2/d5/d22/d76/f11a to d2/d5/d22/d31/d38/d84/f129 0 2023-12-09T02:35:26.767 INFO:tasks.workunit.client.1.smithi161.stdout:8/902: link d2/d5/d22/d54/c64 d2/d5/dac/c12a 0 2023-12-09T02:35:26.769 INFO:tasks.workunit.client.1.smithi161.stdout:8/903: rename d2/d5/d22/d86/dd6/l113 to d2/d2d/l12b 0 2023-12-09T02:35:26.771 INFO:tasks.workunit.client.1.smithi161.stdout:8/904: link d2/d5/d22/l87 d2/d5/d22/d54/db4/df9/l12c 0 2023-12-09T02:35:26.773 INFO:tasks.workunit.client.1.smithi161.stdout:6/980: dread da/d19/dc2/d3c/d46/f7c [0,4194304] 0 2023-12-09T02:35:26.785 INFO:tasks.workunit.client.1.smithi161.stdout:6/981: dread da/d55/d6d/dac/f14b [0,4194304] 0 2023-12-09T02:35:26.786 INFO:tasks.workunit.client.1.smithi161.stdout:6/982: write da/d19/f24 [1167900,32503] 0 2023-12-09T02:35:26.787 INFO:tasks.workunit.client.1.smithi161.stdout:6/983: read - da/d19/dc2/d3c/d46/f14c zero size 2023-12-09T02:35:26.794 INFO:tasks.workunit.client.1.smithi161.stdout:8/905: dwrite d2/d5/d22/d31/d38/d66/d88/da1/fa6 [0,4194304] 0 2023-12-09T02:35:26.795 INFO:tasks.workunit.client.1.smithi161.stdout:8/906: write d2/d5/d22/d31/f41 [2015126,79192] 0 2023-12-09T02:35:26.795 INFO:tasks.workunit.client.1.smithi161.stdout:8/907: fsync d2/d5/d22/d31/d38/d66/d88/da1/fb0 0 2023-12-09T02:35:26.797 INFO:tasks.workunit.client.1.smithi161.stdout:9/907: sync 2023-12-09T02:35:26.797 INFO:tasks.workunit.client.1.smithi161.stdout:3/868: sync 2023-12-09T02:35:26.797 INFO:tasks.workunit.client.1.smithi161.stdout:3/869: chown d2/d51/dee/d91/d46/f54 627639 1 2023-12-09T02:35:26.797 INFO:tasks.workunit.client.1.smithi161.stdout:3/870: chown d2/d51/dee/d91/d46/d5e/f9a 10753677 1 2023-12-09T02:35:26.800 INFO:tasks.workunit.client.1.smithi161.stdout:9/908: symlink d2/dc3/l148 0 2023-12-09T02:35:26.800 INFO:tasks.workunit.client.1.smithi161.stdout:9/909: chown d2/d25/dbf/d124/dd1 116 1 2023-12-09T02:35:26.800 INFO:tasks.workunit.client.1.smithi161.stdout:9/910: truncate d2/d25/db1/d65/d4f/df7/d12c/f136 667447 0 2023-12-09T02:35:26.801 INFO:tasks.workunit.client.1.smithi161.stdout:3/871: creat d2/d51/dee/d91/d46/d2d/d4e/f106 x:0 0 0 2023-12-09T02:35:26.802 INFO:tasks.workunit.client.1.smithi161.stdout:3/872: write d2/d51/d75/d11/d1f/fb3 [251358,115089] 0 2023-12-09T02:35:26.806 INFO:tasks.workunit.client.1.smithi161.stdout:9/911: creat d2/d25/dbf/d124/f149 x:0 0 0 2023-12-09T02:35:26.806 INFO:tasks.workunit.client.1.smithi161.stdout:9/912: truncate d2/d25/db1/d65/d42/d58/d91/d2e/d3f/f10d 232865 0 2023-12-09T02:35:26.806 INFO:tasks.workunit.client.1.smithi161.stdout:9/913: readlink d2/d25/db1/d65/d5c/d55/d66/la3 0 2023-12-09T02:35:26.807 INFO:tasks.workunit.client.1.smithi161.stdout:3/873: mknod d2/daf/de9/c107 0 2023-12-09T02:35:26.809 INFO:tasks.workunit.client.1.smithi161.stdout:9/914: getdents d2/d25/db1/d65/d5c/dac 0 2023-12-09T02:35:26.809 INFO:tasks.workunit.client.1.smithi161.stdout:9/915: chown d2/d25/db1/d65/d42/d58/f1e 398 1 2023-12-09T02:35:26.811 INFO:tasks.workunit.client.1.smithi161.stdout:3/874: symlink d2/d51/d75/l108 0 2023-12-09T02:35:26.815 INFO:tasks.workunit.client.1.smithi161.stdout:3/875: rename d2/d51/dee/d91/f2b to d2/d51/f109 0 2023-12-09T02:35:26.815 INFO:tasks.workunit.client.1.smithi161.stdout:3/876: readlink d2/d51/lc6 0 2023-12-09T02:35:26.818 INFO:tasks.workunit.client.1.smithi161.stdout:9/916: dread d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/ffd [0,4194304] 0 2023-12-09T02:35:26.820 INFO:tasks.workunit.client.1.smithi161.stdout:8/908: dwrite d2/f1d [0,4194304] 0 2023-12-09T02:35:26.820 INFO:tasks.workunit.client.1.smithi161.stdout:8/909: dread - d2/d5/dac/fdf zero size 2023-12-09T02:35:26.820 INFO:tasks.workunit.client.1.smithi161.stdout:9/917: write d2/d25/db1/d65/d4f/df7/f104 [3764749,94491] 0 2023-12-09T02:35:26.820 INFO:tasks.workunit.client.1.smithi161.stdout:9/918: chown d2/d25/db1/d65/c8c 80230787 1 2023-12-09T02:35:26.822 INFO:tasks.workunit.client.1.smithi161.stdout:3/877: link d2/d51/d75/d50/ddf/d96/f76 d2/d51/dee/d91/d46/d5e/f10a 0 2023-12-09T02:35:26.827 INFO:tasks.workunit.client.1.smithi161.stdout:9/919: truncate d2/d25/db1/d65/d88/f121 3360490 0 2023-12-09T02:35:26.827 INFO:tasks.workunit.client.1.smithi161.stdout:8/910: dread d2/d5/f34 [0,4194304] 0 2023-12-09T02:35:26.830 INFO:tasks.workunit.client.1.smithi161.stdout:3/878: rmdir d2/d37/d99 39 2023-12-09T02:35:26.831 INFO:tasks.workunit.client.1.smithi161.stdout:9/920: mkdir d2/d25/dbf/d124/d90/d95/d14a 0 2023-12-09T02:35:26.834 INFO:tasks.workunit.client.1.smithi161.stdout:8/911: creat d2/d5/d22/d31/d38/d66/d88/f12d x:0 0 0 2023-12-09T02:35:26.835 INFO:tasks.workunit.client.1.smithi161.stdout:8/912: chown d2/d5/d22/d31/f39 0 1 2023-12-09T02:35:26.836 INFO:tasks.workunit.client.1.smithi161.stdout:9/921: dread d2/d25/db1/f85 [0,4194304] 0 2023-12-09T02:35:26.836 INFO:tasks.workunit.client.1.smithi161.stdout:9/922: chown d2/d25/db1/d65/d5c/d55/d66/f105 62943 1 2023-12-09T02:35:26.836 INFO:tasks.workunit.client.1.smithi161.stdout:9/923: read d2/d25/db1/d65/d42/d58/d91/d2e/f40 [2985297,51523] 0 2023-12-09T02:35:26.837 INFO:tasks.workunit.client.1.smithi161.stdout:8/913: dread d2/d5/d22/d31/d38/f3b [0,4194304] 0 2023-12-09T02:35:26.837 INFO:tasks.workunit.client.1.smithi161.stdout:8/914: truncate d2/d5/d22/d31/d38/d84/fa7 696618 0 2023-12-09T02:35:26.837 INFO:tasks.workunit.client.1.smithi161.stdout:9/924: write d2/f1b [2753403,4615] 0 2023-12-09T02:35:26.837 INFO:tasks.workunit.client.1.smithi161.stdout:9/925: stat d2/d25/db1/d65/d42/d58/d91/d2e/d3f/f10d 0 2023-12-09T02:35:26.838 INFO:tasks.workunit.client.1.smithi161.stdout:3/879: rename d2/d51/dee/d91/d46/d2d/d47/d8c/fa9 to d2/d51/d75/d11/d1f/d74/f10b 0 2023-12-09T02:35:26.838 INFO:tasks.workunit.client.1.smithi161.stdout:3/880: dread - d2/d51/dee/fd7 zero size 2023-12-09T02:35:26.838 INFO:tasks.workunit.client.1.smithi161.stdout:3/881: chown d2/d37/f71 147271819 1 2023-12-09T02:35:26.840 INFO:tasks.workunit.client.1.smithi161.stdout:8/915: dread d2/d5/f34 [0,4194304] 0 2023-12-09T02:35:26.840 INFO:tasks.workunit.client.1.smithi161.stdout:8/916: write d2/d5/d4f/d102/f107 [920090,87050] 0 2023-12-09T02:35:26.841 INFO:tasks.workunit.client.1.smithi161.stdout:9/926: truncate d2/d25/db1/f85 86353 0 2023-12-09T02:35:26.841 INFO:tasks.workunit.client.1.smithi161.stdout:9/927: stat d2/d25/db1/d65/d5c/dac/cd3 0 2023-12-09T02:35:26.842 INFO:tasks.workunit.client.1.smithi161.stdout:9/928: write d2/d25/db1/d65/d63/f9e [1270485,104357] 0 2023-12-09T02:35:26.842 INFO:tasks.workunit.client.1.smithi161.stdout:9/929: write d2/d25/db1/d65/d42/d58/d22/f140 [741061,48348] 0 2023-12-09T02:35:26.842 INFO:tasks.workunit.client.1.smithi161.stdout:9/930: truncate d2/d25/db1/d65/d42/d58/d91/d2e/db8/f143 908175 0 2023-12-09T02:35:26.842 INFO:tasks.workunit.client.1.smithi161.stdout:9/931: chown d2/d25/db1/d65/d42/d58/d22/c84 223456 1 2023-12-09T02:35:26.843 INFO:tasks.workunit.client.1.smithi161.stdout:3/882: symlink d2/d51/d75/d11/d1f/d4c/ddd/l10c 0 2023-12-09T02:35:26.844 INFO:tasks.workunit.client.1.smithi161.stdout:8/917: getdents d2/d5/d22/d86/dd0 0 2023-12-09T02:35:26.844 INFO:tasks.workunit.client.1.smithi161.stdout:3/883: write d2/d51/dee/d91/d46/d2d/d47/d8c/fa0 [1870904,66412] 0 2023-12-09T02:35:26.847 INFO:tasks.workunit.client.1.smithi161.stdout:9/932: link d2/f47 d2/d25/dbf/f14b 0 2023-12-09T02:35:26.849 INFO:tasks.workunit.client.1.smithi161.stdout:8/918: creat d2/d5/d22/d31/d38/d48/f12e x:0 0 0 2023-12-09T02:35:26.849 INFO:tasks.workunit.client.1.smithi161.stdout:8/919: write d2/d5/d22/d31/d38/d48/f12e [477938,127780] 0 2023-12-09T02:35:26.849 INFO:tasks.workunit.client.1.smithi161.stdout:8/920: dread - d2/d5/d4f/f82 zero size 2023-12-09T02:35:26.850 INFO:tasks.workunit.client.1.smithi161.stdout:3/884: creat d2/d51/d75/f10d x:0 0 0 2023-12-09T02:35:26.851 INFO:tasks.workunit.client.1.smithi161.stdout:8/921: rename d2/d5/d22/d54/db4/c5d to d2/d5/d22/d31/d38/d66/d88/da5/c12f 0 2023-12-09T02:35:26.856 INFO:tasks.workunit.client.1.smithi161.stdout:8/922: write d2/d5/d22/f90 [11914,94286] 0 2023-12-09T02:35:26.860 INFO:tasks.workunit.client.1.smithi161.stdout:8/923: mknod d2/d5/d22/d86/d97/d125/c130 0 2023-12-09T02:35:26.863 INFO:tasks.workunit.client.1.smithi161.stdout:8/924: mknod d2/d5/d22/d54/db4/c131 0 2023-12-09T02:35:26.880 INFO:tasks.workunit.client.1.smithi161.stdout:3/885: dwrite d2/d51/d75/d11/d7b/f85 [0,4194304] 0 2023-12-09T02:35:26.883 INFO:tasks.workunit.client.1.smithi161.stdout:3/886: creat d2/d51/d75/d50/ddf/f10e x:0 0 0 2023-12-09T02:35:26.884 INFO:tasks.workunit.client.1.smithi161.stdout:3/887: symlink d2/d51/d75/d50/ddf/l10f 0 2023-12-09T02:35:26.885 INFO:tasks.workunit.client.1.smithi161.stdout:3/888: getdents d2/d51 0 2023-12-09T02:35:26.891 INFO:tasks.workunit.client.1.smithi161.stdout:3/889: read d2/d51/dee/d91/d46/d2d/d47/d8c/fa0 [1319656,25124] 0 2023-12-09T02:35:26.895 INFO:tasks.workunit.client.1.smithi161.stdout:8/925: dwrite d2/fb1 [0,4194304] 0 2023-12-09T02:35:26.897 INFO:tasks.workunit.client.1.smithi161.stdout:6/984: dwrite da/f68 [0,4194304] 0 2023-12-09T02:35:26.899 INFO:tasks.workunit.client.1.smithi161.stdout:9/933: dwrite d2/d25/dbf/fc0 [0,4194304] 0 2023-12-09T02:35:26.905 INFO:tasks.workunit.client.1.smithi161.stdout:8/926: creat d2/d5/d22/f132 x:0 0 0 2023-12-09T02:35:26.905 INFO:tasks.workunit.client.1.smithi161.stdout:8/927: write d2/d5/d22/d54/db4/dcd/de3/f103 [607380,121723] 0 2023-12-09T02:35:26.906 INFO:tasks.workunit.client.1.smithi161.stdout:8/928: chown d2/f3 6698 1 2023-12-09T02:35:26.910 INFO:tasks.workunit.client.1.smithi161.stdout:6/985: creat da/d19/dc2/d3c/dfb/f159 x:0 0 0 2023-12-09T02:35:26.911 INFO:tasks.workunit.client.1.smithi161.stdout:9/934: dread d2/f3e [0,4194304] 0 2023-12-09T02:35:26.937 INFO:tasks.workunit.client.1.smithi161.stdout:3/890: mkdir d2/d51/dee/d91/d46/d5e/d110 0 2023-12-09T02:35:26.937 INFO:tasks.workunit.client.1.smithi161.stdout:8/929: creat d2/d5/d3d/dc7/f133 x:0 0 0 2023-12-09T02:35:26.940 INFO:tasks.workunit.client.1.smithi161.stdout:6/986: mknod da/d19/dc2/d9e/d12d/c15a 0 2023-12-09T02:35:26.940 INFO:tasks.workunit.client.1.smithi161.stdout:6/987: chown da/d19/dc2/d29/d2b/d31/d33/f102 161 1 2023-12-09T02:35:26.940 INFO:tasks.workunit.client.1.smithi161.stdout:6/988: stat da/d19/dc2/d9e/fe9 0 2023-12-09T02:35:26.940 INFO:tasks.workunit.client.1.smithi161.stdout:6/989: chown da/d19/dc2/d3c/cc1 158566963 1 2023-12-09T02:35:26.940 INFO:tasks.workunit.client.1.smithi161.stdout:6/990: stat da/d19/dc2/d3c/d46 0 2023-12-09T02:35:26.940 INFO:tasks.workunit.client.1.smithi161.stdout:6/991: write da/d19/dc2/d3c/d46/fbc [986274,67141] 0 2023-12-09T02:35:26.945 INFO:tasks.workunit.client.1.smithi161.stdout:3/891: link d2/d51/d75/d11/d7b/f87 d2/d37/d99/dd2/f111 0 2023-12-09T02:35:26.945 INFO:tasks.workunit.client.1.smithi161.stdout:9/935: creat d2/d25/db1/f14c x:0 0 0 2023-12-09T02:35:26.948 INFO:tasks.workunit.client.1.smithi161.stdout:8/930: getdents d2/d8a/dbd/df0 0 2023-12-09T02:35:26.954 INFO:tasks.workunit.client.1.smithi161.stdout:9/936: mkdir d2/d25/db1/d65/d5c/d60/d14d 0 2023-12-09T02:35:26.957 INFO:tasks.workunit.client.1.smithi161.stdout:8/931: link d2/d5/d22/d31/d38/d66/d88/da1/fa6 d2/d5/d22/d31/d38/d66/d88/f134 0 2023-12-09T02:35:26.959 INFO:tasks.workunit.client.1.smithi161.stdout:9/937: rmdir d2/d25/dbf/d124/d90/d95/d14a 0 2023-12-09T02:35:26.966 INFO:tasks.workunit.client.1.smithi161.stdout:9/938: mkdir d2/d25/db1/d65/d42/d58/d91/d2e/db8/d14e 0 2023-12-09T02:35:26.968 INFO:tasks.workunit.client.1.smithi161.stdout:3/892: dwrite d2/d51/dee/d91/d46/d2d/d47/f60 [0,4194304] 0 2023-12-09T02:35:26.968 INFO:tasks.workunit.client.1.smithi161.stdout:3/893: write d2/d51/dee/d91/d46/d5e/ff4 [395597,82043] 0 2023-12-09T02:35:26.970 INFO:tasks.workunit.client.1.smithi161.stdout:9/939: truncate d2/d25/db1/d65/d42/f4b 1637648 0 2023-12-09T02:35:26.974 INFO:tasks.workunit.client.1.smithi161.stdout:9/940: unlink d2/d25/db1/d65/d88/dcb/ddf/de5/f10e 0 2023-12-09T02:35:26.974 INFO:tasks.workunit.client.1.smithi161.stdout:3/894: write d2/d37/d99/dd2/f111 [1132071,34360] 0 2023-12-09T02:35:26.976 INFO:tasks.workunit.client.1.smithi161.stdout:3/895: symlink d2/d51/d75/d50/d69/db7/l112 0 2023-12-09T02:35:26.976 INFO:tasks.workunit.client.1.smithi161.stdout:3/896: write d2/d51/dee/d91/d46/d5e/fa5 [1546230,79774] 0 2023-12-09T02:35:26.978 INFO:tasks.workunit.client.1.smithi161.stdout:3/897: mknod d2/d51/d75/d11/d1f/dca/c113 0 2023-12-09T02:35:26.978 INFO:tasks.workunit.client.1.smithi161.stdout:3/898: fsync d2/daf/de9/f6d 0 2023-12-09T02:35:26.981 INFO:tasks.workunit.client.1.smithi161.stdout:3/899: truncate d2/d51/d75/d50/fc1 653996 0 2023-12-09T02:35:26.984 INFO:tasks.workunit.client.1.smithi161.stdout:8/932: dwrite d2/d5/d4f/fd5 [0,4194304] 0 2023-12-09T02:35:26.992 INFO:tasks.workunit.client.1.smithi161.stdout:3/900: dread d2/d51/d75/d50/fe0 [0,4194304] 0 2023-12-09T02:35:26.992 INFO:tasks.workunit.client.1.smithi161.stdout:3/901: dread - d2/d51/d75/f10d zero size 2023-12-09T02:35:26.992 INFO:tasks.workunit.client.1.smithi161.stdout:8/933: creat d2/d5/d22/d86/dd6/dd7/f135 x:0 0 0 2023-12-09T02:35:26.996 INFO:tasks.workunit.client.1.smithi161.stdout:8/934: mknod d2/d5/d22/d54/db4/dcd/c136 0 2023-12-09T02:35:26.997 INFO:tasks.workunit.client.1.smithi161.stdout:8/935: creat d2/d5/d4f/d102/f137 x:0 0 0 2023-12-09T02:35:26.997 INFO:tasks.workunit.client.1.smithi161.stdout:8/936: fsync d2/d5/d22/d54/f91 0 2023-12-09T02:35:27.003 INFO:tasks.workunit.client.1.smithi161.stdout:8/937: link d2/d5/d22/d31/f39 d2/d5/d4f/d102/f138 0 2023-12-09T02:35:27.003 INFO:tasks.workunit.client.1.smithi161.stdout:8/938: stat d2/d2d/dec 0 2023-12-09T02:35:27.005 INFO:tasks.workunit.client.1.smithi161.stdout:0/996: sync 2023-12-09T02:35:27.005 INFO:tasks.workunit.client.1.smithi161.stdout:2/979: sync 2023-12-09T02:35:27.005 INFO:tasks.workunit.client.1.smithi161.stdout:9/941: dwrite d2/d25/db1/d65/d5c/d55/d66/fbc [0,4194304] 0 2023-12-09T02:35:27.007 INFO:tasks.workunit.client.1.smithi161.stdout:8/939: rename d2/d5/d22/dc3/f110 to d2/d5/d22/d86/dd0/d10a/f139 0 2023-12-09T02:35:27.010 INFO:tasks.workunit.client.1.smithi161.stdout:6/992: rmdir da/d19 39 2023-12-09T02:35:27.011 INFO:tasks.workunit.client.1.smithi161.stdout:2/980: dread d4/d16/f88 [0,4194304] 0 2023-12-09T02:35:27.011 INFO:tasks.workunit.client.1.smithi161.stdout:0/997: creat d9/d55/d44/f137 x:0 0 0 2023-12-09T02:35:27.013 INFO:tasks.workunit.client.1.smithi161.stdout:6/993: read da/d19/dc2/d3c/db8/fe1 [3193598,72987] 0 2023-12-09T02:35:27.013 INFO:tasks.workunit.client.1.smithi161.stdout:6/994: stat da/d19/dc2/d29/d2b/d31/cc4 0 2023-12-09T02:35:27.016 INFO:tasks.workunit.client.1.smithi161.stdout:3/902: dwrite d2/d51/dee/d91/d46/d2d/d47/f60 [4194304,4194304] 0 2023-12-09T02:35:27.017 INFO:tasks.workunit.client.1.smithi161.stdout:9/942: creat d2/d25/db1/d65/d42/d10b/f14f x:0 0 0 2023-12-09T02:35:27.023 INFO:tasks.workunit.client.1.smithi161.stdout:9/943: write d2/d25/db1/d65/d88/dcb/ddf/f87 [3151690,76363] 0 2023-12-09T02:35:27.023 INFO:tasks.workunit.client.1.smithi161.stdout:9/944: write d2/d25/dbf/d124/d90/d95/f114 [428679,40711] 0 2023-12-09T02:35:27.023 INFO:tasks.workunit.client.1.smithi161.stdout:9/945: chown d2/d25/db1/d65/fe6 1526 1 2023-12-09T02:35:27.023 INFO:tasks.workunit.client.1.smithi161.stdout:8/940: creat d2/d5/d22/d86/d97/f13a x:0 0 0 2023-12-09T02:35:27.029 INFO:tasks.workunit.client.1.smithi161.stdout:2/981: creat d4/da6/de6/f141 x:0 0 0 2023-12-09T02:35:27.031 INFO:tasks.workunit.client.1.smithi161.stdout:0/998: symlink d9/d1f/l138 0 2023-12-09T02:35:27.034 INFO:tasks.workunit.client.1.smithi161.stdout:6/995: creat da/df/d2d/d3b/d10d/f15b x:0 0 0 2023-12-09T02:35:27.040 INFO:tasks.workunit.client.1.smithi161.stdout:3/903: creat d2/d51/dee/d91/d46/d2d/f114 x:0 0 0 2023-12-09T02:35:27.051 INFO:tasks.workunit.client.1.smithi161.stdout:7/860: sync 2023-12-09T02:35:27.051 INFO:tasks.workunit.client.1.smithi161.stdout:8/941: creat d2/d5/d22/d31/d38/d66/d100/f13b x:0 0 0 2023-12-09T02:35:27.060 INFO:tasks.workunit.client.1.smithi161.stdout:7/861: link d0/cb7 d0/d3/d13/d2d/c10d 0 2023-12-09T02:35:27.060 INFO:tasks.workunit.client.1.smithi161.stdout:7/862: stat d0/d3/d13/d4e/d70/l9b 0 2023-12-09T02:35:27.060 INFO:tasks.workunit.client.1.smithi161.stdout:8/942: mknod d2/d5/d22/d54/db4/df9/c13c 0 2023-12-09T02:35:27.064 INFO:tasks.workunit.client.1.smithi161.stdout:9/946: dwrite d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/ffd [0,4194304] 0 2023-12-09T02:35:27.064 INFO:tasks.workunit.client.1.smithi161.stdout:9/947: dread - d2/d25/db1/d65/d42/d58/ff6 zero size 2023-12-09T02:35:27.068 INFO:tasks.workunit.client.1.smithi161.stdout:7/863: getdents d0/d3/d13/d1b 0 2023-12-09T02:35:27.068 INFO:tasks.workunit.client.1.smithi161.stdout:8/943: mkdir d2/d8a/d13d 0 2023-12-09T02:35:27.069 INFO:tasks.workunit.client.1.smithi161.stdout:2/982: dwrite d4/d7/f122 [0,4194304] 0 2023-12-09T02:35:27.072 INFO:tasks.workunit.client.1.smithi161.stdout:2/983: creat d4/d1a/d4a/d10a/f142 x:0 0 0 2023-12-09T02:35:27.074 INFO:tasks.workunit.client.1.smithi161.stdout:2/984: mkdir d4/d1a/d4a/daa/d143 0 2023-12-09T02:35:27.076 INFO:tasks.workunit.client.1.smithi161.stdout:8/944: write d2/d5/d22/d31/f37 [3483466,49793] 0 2023-12-09T02:35:27.076 INFO:tasks.workunit.client.1.smithi161.stdout:8/945: fsync d2/d5/d22/d86/dd0/d10a/f139 0 2023-12-09T02:35:27.082 INFO:tasks.workunit.client.1.smithi161.stdout:8/946: creat d2/d5/d22/d31/d38/d66/f13e x:0 0 0 2023-12-09T02:35:27.082 INFO:tasks.workunit.client.1.smithi161.stdout:3/904: dwrite d2/d51/d75/d50/fe0 [0,4194304] 0 2023-12-09T02:35:27.082 INFO:tasks.workunit.client.1.smithi161.stdout:0/999: dwrite d9/dd/f53 [0,4194304] 0 2023-12-09T02:35:27.084 INFO:tasks.workunit.client.1.smithi161.stdout:6/996: dwrite da/d19/dc2/d4d/fef [0,4194304] 0 2023-12-09T02:35:27.084 INFO:tasks.workunit.client.1.smithi161.stdout:6/997: chown da/d19/dc2/d9e/lc9 3057093 1 2023-12-09T02:35:27.085 INFO:tasks.workunit.client.1.smithi161.stdout:7/864: dread d0/d3/d13/d1b/f2b [4194304,4194304] 0 2023-12-09T02:35:27.086 INFO:tasks.workunit.client.1.smithi161.stdout:9/948: dwrite d2/d25/db1/d65/d42/d58/d91/d51/fd2 [0,4194304] 0 2023-12-09T02:35:27.087 INFO:tasks.workunit.client.1.smithi161.stdout:9/949: write d2/d25/db1/d65/d42/d58/d91/d51/ffe [705625,35006] 0 2023-12-09T02:35:27.093 INFO:tasks.workunit.client.1.smithi161.stdout:9/950: dread d2/d25/db1/f85 [0,4194304] 0 2023-12-09T02:35:27.093 INFO:tasks.workunit.client.1.smithi161.stdout:3/905: mkdir d2/d51/dee/d91/d115 0 2023-12-09T02:35:27.093 INFO:tasks.workunit.client.1.smithi161.stdout:7/865: dread d0/d3/d13/d4e/db5/d83/f95 [0,4194304] 0 2023-12-09T02:35:27.101 INFO:tasks.workunit.client.1.smithi161.stdout:3/906: truncate d2/d51/dee/f2e 4658509 0 2023-12-09T02:35:27.104 INFO:tasks.workunit.client.1.smithi161.stdout:6/998: write da/d19/f24 [973830,7039] 0 2023-12-09T02:35:27.104 INFO:tasks.workunit.client.1.smithi161.stdout:6/999: fsync da/d55/fc6 0 2023-12-09T02:35:27.108 INFO:tasks.workunit.client.1.smithi161.stdout:3/907: rename d2/d51/d75/d50/ddf/d96/f76 to d2/d51/d75/d11/d1f/d74/f116 0 2023-12-09T02:35:27.117 INFO:tasks.workunit.client.1.smithi161.stdout:2/985: dwrite d4/d1a/d4a/de3/f112 [0,4194304] 0 2023-12-09T02:35:27.119 INFO:tasks.workunit.client.1.smithi161.stdout:3/908: dread d2/d51/d75/fad [0,4194304] 0 2023-12-09T02:35:27.119 INFO:tasks.workunit.client.1.smithi161.stdout:9/951: dwrite d2/d25/db1/d65/d88/f121 [0,4194304] 0 2023-12-09T02:35:27.123 INFO:tasks.workunit.client.1.smithi161.stdout:2/986: mknod d4/d16/c144 0 2023-12-09T02:35:27.126 INFO:tasks.workunit.client.1.smithi161.stdout:3/909: rename d2/daf/df6 to d2/d51/d75/d11/d117 0 2023-12-09T02:35:27.126 INFO:tasks.workunit.client.1.smithi161.stdout:3/910: write d2/d51/d75/d11/d1f/d4c/fbf [940287,89573] 0 2023-12-09T02:35:27.129 INFO:tasks.workunit.client.1.smithi161.stdout:9/952: link d2/d25/db1/d65/d88/dcb/ddf/c8b d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/dc8/c150 0 2023-12-09T02:35:27.130 INFO:tasks.workunit.client.1.smithi161.stdout:2/987: symlink d4/d16/de0/l145 0 2023-12-09T02:35:27.132 INFO:tasks.workunit.client.1.smithi161.stdout:3/911: mknod d2/d51/d75/c118 0 2023-12-09T02:35:27.134 INFO:tasks.workunit.client.1.smithi161.stdout:2/988: truncate d4/d1a/dc2/fe2 11465 0 2023-12-09T02:35:27.134 INFO:tasks.workunit.client.1.smithi161.stdout:2/989: write d4/fc1 [1035433,120791] 0 2023-12-09T02:35:27.136 INFO:tasks.workunit.client.1.smithi161.stdout:3/912: getdents d2/d51/dee/d91/d46/d5e 0 2023-12-09T02:35:27.137 INFO:tasks.workunit.client.1.smithi161.stdout:3/913: dread d2/d51/dee/d91/fc9 [0,4194304] 0 2023-12-09T02:35:27.137 INFO:tasks.workunit.client.1.smithi161.stdout:3/914: write d2/d51/d75/d11/d1f/d4c/ddd/ffd [362557,35527] 0 2023-12-09T02:35:27.141 INFO:tasks.workunit.client.1.smithi161.stdout:3/915: symlink d2/d51/d75/d50/ddf/d96/l119 0 2023-12-09T02:35:27.145 INFO:tasks.workunit.client.1.smithi161.stdout:3/916: rename d2/d51/lc6 to d2/d51/d75/d50/ddf/d96/l11a 0 2023-12-09T02:35:27.145 INFO:tasks.workunit.client.1.smithi161.stdout:3/917: write d2/d51/dee/d91/d46/f105 [776459,17138] 0 2023-12-09T02:35:27.146 INFO:tasks.workunit.client.1.smithi161.stdout:9/953: getdents d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/dc8 0 2023-12-09T02:35:27.148 INFO:tasks.workunit.client.1.smithi161.stdout:3/918: dread d2/d51/d75/d11/d1f/d4c/f5b [0,4194304] 0 2023-12-09T02:35:27.149 INFO:tasks.workunit.client.1.smithi161.stdout:9/954: mkdir d2/d25/db1/d65/d5c/dac/d151 0 2023-12-09T02:35:27.151 INFO:tasks.workunit.client.1.smithi161.stdout:3/919: symlink d2/d51/d75/d50/d69/db7/l11b 0 2023-12-09T02:35:27.152 INFO:tasks.workunit.client.1.smithi161.stdout:3/920: dread d2/d51/d75/d50/d69/db7/ff0 [0,4194304] 0 2023-12-09T02:35:27.155 INFO:tasks.workunit.client.1.smithi161.stdout:9/955: dread d2/d25/db1/d65/d42/d58/d22/f9f [0,4194304] 0 2023-12-09T02:35:27.158 INFO:tasks.workunit.client.1.smithi161.stdout:9/956: rename d2/d25/dbf/d124/d90/d95/dea/d12d/fd8 to d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/dc8/f152 0 2023-12-09T02:35:27.161 INFO:tasks.workunit.client.1.smithi161.stdout:3/921: dread d2/d51/dee/d91/d46/d2d/d47/f5c [4194304,4194304] 0 2023-12-09T02:35:27.161 INFO:tasks.workunit.client.1.smithi161.stdout:3/922: write d2/d51/dee/d91/d46/d2d/d47/f8b [955554,73083] 0 2023-12-09T02:35:27.161 INFO:tasks.workunit.client.1.smithi161.stdout:3/923: dread - d2/d51/d75/f10d zero size 2023-12-09T02:35:27.161 INFO:tasks.workunit.client.1.smithi161.stdout:3/924: chown d2/d51/d75/d11/d1f/d4c/f5b 525585 1 2023-12-09T02:35:27.161 INFO:tasks.workunit.client.1.smithi161.stdout:3/925: read d2/d51/dee/d91/d46/d2d/d47/d8c/fa0 [1901753,29895] 0 2023-12-09T02:35:27.161 INFO:tasks.workunit.client.1.smithi161.stdout:3/926: write d2/d51/d75/d11/d1f/fb3 [1121487,19047] 0 2023-12-09T02:35:27.162 INFO:tasks.workunit.client.1.smithi161.stdout:2/990: dwrite d4/d16/f29 [0,4194304] 0 2023-12-09T02:35:27.162 INFO:tasks.workunit.client.1.smithi161.stdout:3/927: creat d2/d51/dee/d91/d46/d5e/d110/f11c x:0 0 0 2023-12-09T02:35:27.164 INFO:tasks.workunit.client.1.smithi161.stdout:2/991: unlink d4/d7/db/fb7 0 2023-12-09T02:35:27.166 INFO:tasks.workunit.client.1.smithi161.stdout:3/928: rename d2/d51/d75/d11/d117 to d2/d51/dee/d91/d46/d2d/d4e/d11d 0 2023-12-09T02:35:27.167 INFO:tasks.workunit.client.1.smithi161.stdout:2/992: mknod d4/d1a/dc2/c146 0 2023-12-09T02:35:27.168 INFO:tasks.workunit.client.1.smithi161.stdout:3/929: truncate d2/f82 1351998 0 2023-12-09T02:35:27.168 INFO:tasks.workunit.client.1.smithi161.stdout:3/930: truncate d2/d51/d75/d11/d1f/d4c/fbf 1925228 0 2023-12-09T02:35:27.169 INFO:tasks.workunit.client.1.smithi161.stdout:2/993: symlink d4/l147 0 2023-12-09T02:35:27.172 INFO:tasks.workunit.client.1.smithi161.stdout:3/931: rename d2/d51/dee/fd7 to d2/d51/dee/d91/d46/d2d/df3/f11e 0 2023-12-09T02:35:27.174 INFO:tasks.workunit.client.1.smithi161.stdout:2/994: truncate d4/d16/d69/d8c/ddf/f71 1718021 0 2023-12-09T02:35:27.187 INFO:tasks.workunit.client.1.smithi161.stdout:2/995: dread d4/d1a/f3f [0,4194304] 0 2023-12-09T02:35:27.192 INFO:tasks.workunit.client.1.smithi161.stdout:2/996: creat d4/d1a/dc2/f148 x:0 0 0 2023-12-09T02:35:27.195 INFO:tasks.workunit.client.1.smithi161.stdout:2/997: mknod d4/d7/d8f/c149 0 2023-12-09T02:35:27.195 INFO:tasks.workunit.client.1.smithi161.stdout:2/998: write d4/d7/d11e/d127/f130 [634421,117473] 0 2023-12-09T02:35:27.199 INFO:tasks.workunit.client.1.smithi161.stdout:2/999: creat d4/d7/d8f/dd2/f14a x:0 0 0 2023-12-09T02:35:27.201 INFO:tasks.workunit.client.1.smithi161.stdout:3/932: dwrite d2/d51/d75/d50/f92 [0,4194304] 0 2023-12-09T02:35:27.201 INFO:tasks.workunit.client.1.smithi161.stdout:9/957: dwrite d2/d25/db1/d65/d42/d58/d22/f9f [0,4194304] 0 2023-12-09T02:35:27.201 INFO:tasks.workunit.client.1.smithi161.stdout:3/933: write d2/d51/d75/d11/d1f/f100 [613523,52014] 0 2023-12-09T02:35:27.201 INFO:tasks.workunit.client.1.smithi161.stdout:9/958: fdatasync d2/d25/db1/d65/d4f/dfb/f128 0 2023-12-09T02:35:27.204 INFO:tasks.workunit.client.1.smithi161.stdout:3/934: mkdir d2/d51/dee/d11f 0 2023-12-09T02:35:27.205 INFO:tasks.workunit.client.1.smithi161.stdout:9/959: symlink d2/d25/db1/d4d/l153 0 2023-12-09T02:35:27.206 INFO:tasks.workunit.client.1.smithi161.stdout:3/935: creat d2/d51/f120 x:0 0 0 2023-12-09T02:35:27.214 INFO:tasks.workunit.client.1.smithi161.stdout:9/960: dread d2/d25/dbf/d124/ff2 [0,4194304] 0 2023-12-09T02:35:27.215 INFO:tasks.workunit.client.1.smithi161.stdout:9/961: mknod d2/d25/dbf/d124/dd1/d147/c154 0 2023-12-09T02:35:27.218 INFO:tasks.workunit.client.1.smithi161.stdout:9/962: dread d2/d25/dbf/d124/d90/d95/fc5 [0,4194304] 0 2023-12-09T02:35:27.218 INFO:tasks.workunit.client.1.smithi161.stdout:9/963: write d2/d25/db1/d65/d42/d58/d91/d51/ffe [1248751,43540] 0 2023-12-09T02:35:27.221 INFO:tasks.workunit.client.1.smithi161.stdout:9/964: rename d2/d25/db1/d65/d42/d58/d22/f11e to d2/d25/dbf/d124/d90/d95/dea/d13a/f155 0 2023-12-09T02:35:27.232 INFO:tasks.workunit.client.1.smithi161.stdout:3/936: dwrite d2/d51/dee/d91/f2f [0,4194304] 0 2023-12-09T02:35:27.238 INFO:tasks.workunit.client.1.smithi161.stdout:9/965: dread d2/d25/db1/d65/d5c/d55/d66/fbc [0,4194304] 0 2023-12-09T02:35:27.238 INFO:tasks.workunit.client.1.smithi161.stdout:9/966: chown d2/d25/lb3 6290075 1 2023-12-09T02:35:27.238 INFO:tasks.workunit.client.1.smithi161.stdout:3/937: rename d2/d51/d75/d11/d28/le4 to d2/d51/dc0/l121 0 2023-12-09T02:35:27.240 INFO:tasks.workunit.client.1.smithi161.stdout:3/938: dread d2/d51/dee/d91/d46/d2d/d47/d8c/fa0 [0,4194304] 0 2023-12-09T02:35:27.251 INFO:tasks.workunit.client.1.smithi161.stdout:9/967: unlink d2/d25/db1/d65/d42/d58/d91/d2e/fe0 0 2023-12-09T02:35:27.252 INFO:tasks.workunit.client.1.smithi161.stdout:9/968: mkdir d2/d25/db1/d65/d88/dcb/d156 0 2023-12-09T02:35:27.254 INFO:tasks.workunit.client.1.smithi161.stdout:3/939: dwrite d2/d51/d75/d11/d1f/fb3 [0,4194304] 0 2023-12-09T02:35:27.254 INFO:tasks.workunit.client.1.smithi161.stdout:9/969: creat d2/d25/db1/d65/d5c/d55/d66/f157 x:0 0 0 2023-12-09T02:35:27.254 INFO:tasks.workunit.client.1.smithi161.stdout:9/970: write d2/d25/dbf/d124/d90/d95/f114 [1096538,78437] 0 2023-12-09T02:35:27.258 INFO:tasks.workunit.client.1.smithi161.stdout:3/940: symlink d2/daf/de9/l122 0 2023-12-09T02:35:27.260 INFO:tasks.workunit.client.1.smithi161.stdout:3/941: mkdir d2/d37/d123 0 2023-12-09T02:35:27.262 INFO:tasks.workunit.client.1.smithi161.stdout:3/942: truncate d2/d51/dee/f2e 4068807 0 2023-12-09T02:35:27.262 INFO:tasks.workunit.client.1.smithi161.stdout:3/943: readlink d2/d37/d99/le5 0 2023-12-09T02:35:27.274 INFO:tasks.workunit.client.1.smithi161.stdout:3/944: dread d2/d51/d75/d11/f64 [0,4194304] 0 2023-12-09T02:35:27.274 INFO:tasks.workunit.client.1.smithi161.stdout:3/945: chown d2/d51/d75/d11/d7b/lb2 31038 1 2023-12-09T02:35:27.278 INFO:tasks.workunit.client.1.smithi161.stdout:9/971: dwrite d2/d25/db1/d65/d5c/fcd [0,4194304] 0 2023-12-09T02:35:27.289 INFO:tasks.workunit.client.1.smithi161.stdout:9/972: dread d2/d25/db1/d4d/f67 [4194304,4194304] 0 2023-12-09T02:35:27.291 INFO:tasks.workunit.client.1.smithi161.stdout:3/946: dwrite d2/d51/dee/d91/d46/ffe [0,4194304] 0 2023-12-09T02:35:27.291 INFO:tasks.workunit.client.1.smithi161.stdout:9/973: mkdir d2/d25/dbf/d124/d137/d158 0 2023-12-09T02:35:27.299 INFO:tasks.workunit.client.1.smithi161.stdout:3/947: rmdir d2/d51/dee/d91/d46/d2d/d47 39 2023-12-09T02:35:27.299 INFO:tasks.workunit.client.1.smithi161.stdout:3/948: fsync d2/d51/d75/d11/d1f/d74/f116 0 2023-12-09T02:35:27.302 INFO:tasks.workunit.client.1.smithi161.stdout:9/974: link d2/d25/dbf/d124/f96 d2/d25/db1/d65/d42/d58/d91/d2e/db8/f159 0 2023-12-09T02:35:27.307 INFO:tasks.workunit.client.1.smithi161.stdout:3/949: link d2/d51/d75/d50/d69/db7/l112 d2/d51/dee/d91/d46/d9c/l124 0 2023-12-09T02:35:27.308 INFO:tasks.workunit.client.1.smithi161.stdout:3/950: symlink d2/d51/dee/d91/d46/d2d/d47/de6/l125 0 2023-12-09T02:35:27.308 INFO:tasks.workunit.client.1.smithi161.stdout:3/951: write d2/d37/d99/fb8 [374000,62139] 0 2023-12-09T02:35:27.310 INFO:tasks.workunit.client.1.smithi161.stdout:3/952: creat d2/f126 x:0 0 0 2023-12-09T02:35:27.311 INFO:tasks.workunit.client.1.smithi161.stdout:3/953: creat d2/d51/dee/d11f/f127 x:0 0 0 2023-12-09T02:35:27.311 INFO:tasks.workunit.client.1.smithi161.stdout:3/954: readlink d2/d37/d99/le5 0 2023-12-09T02:35:27.311 INFO:tasks.workunit.client.1.smithi161.stdout:3/955: truncate d2/d51/d75/f1e 5379158 0 2023-12-09T02:35:27.313 INFO:tasks.workunit.client.1.smithi161.stdout:3/956: mknod d2/d51/d75/d50/c128 0 2023-12-09T02:35:27.313 INFO:tasks.workunit.client.1.smithi161.stdout:3/957: dread - d2/fe3 zero size 2023-12-09T02:35:27.316 INFO:tasks.workunit.client.1.smithi161.stdout:3/958: rename d2/d51/d75/l8 to d2/d37/d99/l129 0 2023-12-09T02:35:27.317 INFO:tasks.workunit.client.1.smithi161.stdout:3/959: creat d2/d51/dee/f12a x:0 0 0 2023-12-09T02:35:27.325 INFO:tasks.workunit.client.1.smithi161.stdout:9/975: dwrite d2/d25/db1/d65/d4f/dfb/f13d [0,4194304] 0 2023-12-09T02:35:27.325 INFO:tasks.workunit.client.1.smithi161.stdout:9/976: chown d2/d25/lcf 25001 1 2023-12-09T02:35:27.328 INFO:tasks.workunit.client.1.smithi161.stdout:9/977: mkdir d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/da4/dc8/d108/d15a 0 2023-12-09T02:35:27.330 INFO:tasks.workunit.client.1.smithi161.stdout:9/978: mknod d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d61/d122/c15b 0 2023-12-09T02:35:27.330 INFO:tasks.workunit.client.1.smithi161.stdout:9/979: write d2/d25/db1/d65/d4f/ff4 [135656,23886] 0 2023-12-09T02:35:27.332 INFO:tasks.workunit.client.1.smithi161.stdout:9/980: chown d2/d25/db1/d65/d42/d58/d91/d2e/d3f/d71/f11b 4054 1 2023-12-09T02:35:27.335 INFO:tasks.workunit.client.1.smithi161.stdout:9/981: rename d2/d25/db1/d65/d4f/c106 to d2/dc3/c15c 0 2023-12-09T02:35:27.335 INFO:tasks.workunit.client.1.smithi161.stdout:9/982: readlink d2/d25/db1/l3d 0 2023-12-09T02:35:27.335 INFO:tasks.workunit.client.1.smithi161.stdout:3/960: dwrite d2/d51/d75/d11/d1f/fb3 [0,4194304] 0 2023-12-09T02:35:27.338 INFO:tasks.workunit.client.1.smithi161.stdout:9/983: mknod d2/d25/db1/d65/d42/d58/c15d 0 2023-12-09T02:35:27.338 INFO:tasks.workunit.client.1.smithi161.stdout:9/984: chown d2/d25/db1/f85 9832 1 2023-12-09T02:35:27.338 INFO:tasks.workunit.client.1.smithi161.stdout:9/985: write d2/d25/dbf/d124/d90/d95/f114 [1595912,93618] 0 2023-12-09T02:35:27.341 INFO:tasks.workunit.client.1.smithi161.stdout:3/961: getdents d2/d51/d75/d11/d7b 0 2023-12-09T02:35:27.343 INFO:tasks.workunit.client.1.smithi161.stdout:9/986: getdents d2/d25/dbf/d124/dd1 0 2023-12-09T02:35:27.348 INFO:tasks.workunit.client.1.smithi161.stdout:3/962: symlink d2/d37/d99/dd2/l12b 0 2023-12-09T02:35:27.351 INFO:tasks.workunit.client.1.smithi161.stdout:3/963: mkdir d2/daf/de9/d12c 0 2023-12-09T02:35:27.351 INFO:tasks.workunit.client.1.smithi161.stdout:9/987: dread d2/d25/db1/d65/d4f/df7/f104 [0,4194304] 0 2023-12-09T02:35:27.351 INFO:tasks.workunit.client.1.smithi161.stdout:3/964: read d2/d51/dee/d91/d46/d5e/fa5 [1533089,112821] 0 2023-12-09T02:35:27.354 INFO:tasks.workunit.client.1.smithi161.stdout:9/988: mknod d2/d25/db1/d65/d42/d58/c15e 0 2023-12-09T02:35:27.354 INFO:tasks.workunit.client.1.smithi161.stdout:9/989: fsync d2/d25/db1/d65/d42/d58/f10 0 2023-12-09T02:35:27.356 INFO:tasks.workunit.client.1.smithi161.stdout:9/990: creat d2/d25/db1/d65/d88/dcb/f15f x:0 0 0 2023-12-09T02:35:27.357 INFO:tasks.workunit.client.1.smithi161.stdout:3/965: symlink d2/d51/d75/d50/ddf/d96/l12d 0 2023-12-09T02:35:27.357 INFO:tasks.workunit.client.1.smithi161.stdout:3/966: write d2/daf/de9/f104 [836349,102993] 0 2023-12-09T02:35:27.358 INFO:tasks.workunit.client.1.smithi161.stdout:9/991: mknod d2/d25/db1/d65/d42/d58/c160 0 2023-12-09T02:35:27.359 INFO:tasks.workunit.client.1.smithi161.stdout:3/967: symlink d2/d51/d75/d50/d69/db7/l12e 0 2023-12-09T02:35:27.360 INFO:tasks.workunit.client.1.smithi161.stdout:9/992: stat d2/d25/l28 0 2023-12-09T02:35:27.360 INFO:tasks.workunit.client.1.smithi161.stdout:9/993: truncate d2/d25/dbf/d124/dd1/f13b 341102 0 2023-12-09T02:35:27.361 INFO:tasks.workunit.client.1.smithi161.stdout:3/968: rename d2/daf/fda to d2/d51/d75/d11/f12f 0 2023-12-09T02:35:27.363 INFO:tasks.workunit.client.1.smithi161.stdout:9/994: creat d2/d25/db1/d65/d42/f161 x:0 0 0 2023-12-09T02:35:27.364 INFO:tasks.workunit.client.1.smithi161.stdout:9/995: write d2/d25/db1/d65/d42/d58/d91/d51/ffe [1649637,76459] 0 2023-12-09T02:35:27.364 INFO:tasks.workunit.client.1.smithi161.stdout:9/996: write d2/d25/db1/d65/d42/d58/d91/d51/fc6 [229439,25577] 0 2023-12-09T02:35:27.364 INFO:tasks.workunit.client.1.smithi161.stdout:3/969: symlink d2/d51/dee/d91/d46/d9c/l130 0 2023-12-09T02:35:27.366 INFO:tasks.workunit.client.1.smithi161.stdout:9/997: rmdir d2 39 2023-12-09T02:35:27.366 INFO:tasks.workunit.client.1.smithi161.stdout:9/998: readlink d2/d25/dbf/d124/lf5 0 2023-12-09T02:35:27.367 INFO:tasks.workunit.client.1.smithi161.stdout:9/999: unlink d2/d25/db1/d65/d42/d58/c15e 0 2023-12-09T02:35:27.378 INFO:tasks.workunit.client.1.smithi161.stdout:3/970: dwrite d2/d51/d75/d50/d69/db7/ff0 [0,4194304] 0 2023-12-09T02:35:27.385 INFO:tasks.workunit.client.1.smithi161.stdout:3/971: mknod d2/d51/dee/d91/d46/d9c/c131 0 2023-12-09T02:35:27.386 INFO:tasks.workunit.client.1.smithi161.stdout:3/972: write d2/d37/f71 [299392,83913] 0 2023-12-09T02:35:27.386 INFO:tasks.workunit.client.1.smithi161.stdout:3/973: fdatasync d2/d51/d75/d11/d1f/f8f 0 2023-12-09T02:35:27.388 INFO:tasks.workunit.client.1.smithi161.stdout:3/974: getdents d2/d51/d75/d50 0 2023-12-09T02:35:27.401 INFO:tasks.workunit.client.1.smithi161.stdout:3/975: dwrite d2/d51/dee/d91/d46/d2d/d47/f8b [0,4194304] 0 2023-12-09T02:35:27.405 INFO:tasks.workunit.client.1.smithi161.stdout:3/976: rename d2/d51/d75/d11/d1f/f100 to d2/daf/de9/dab/f132 0 2023-12-09T02:35:27.430 INFO:tasks.workunit.client.1.smithi161.stdout:3/977: dwrite d2/daf/de9/f6d [0,4194304] 0 2023-12-09T02:35:27.442 INFO:tasks.workunit.client.1.smithi161.stdout:3/978: dread d2/fa1 [0,4194304] 0 2023-12-09T02:35:27.442 INFO:tasks.workunit.client.1.smithi161.stdout:3/979: stat d2/d51/dee/d91/d46/f105 0 2023-12-09T02:35:27.442 INFO:tasks.workunit.client.1.smithi161.stdout:3/980: fdatasync d2/d51/d75/d50/f92 0 2023-12-09T02:35:27.442 INFO:tasks.workunit.client.1.smithi161.stdout:3/981: symlink d2/daf/de9/d12c/l133 0 2023-12-09T02:35:27.442 INFO:tasks.workunit.client.1.smithi161.stdout:3/982: chown d2/d51/dee/d91/d46/d2d/d47/d8c 15 1 2023-12-09T02:35:27.442 INFO:tasks.workunit.client.1.smithi161.stdout:3/983: chown d2/d37/d99/le5 5442114 1 2023-12-09T02:35:27.442 INFO:tasks.workunit.client.1.smithi161.stdout:3/984: stat d2/f126 0 2023-12-09T02:35:27.442 INFO:tasks.workunit.client.1.smithi161.stdout:3/985: mkdir d2/d51/dee/d91/d46/d134 0 2023-12-09T02:35:27.443 INFO:tasks.workunit.client.1.smithi161.stdout:3/986: symlink d2/d37/dc7/l135 0 2023-12-09T02:35:27.443 INFO:tasks.workunit.client.1.smithi161.stdout:3/987: mkdir d2/d51/dee/d91/d136 0 2023-12-09T02:35:27.443 INFO:tasks.workunit.client.1.smithi161.stdout:3/988: chown d2/d37/d99/dd2/f111 360269102 1 2023-12-09T02:35:27.444 INFO:tasks.workunit.client.1.smithi161.stdout:3/989: symlink d2/d51/d75/d11/d1f/dca/l137 0 2023-12-09T02:35:27.447 INFO:tasks.workunit.client.1.smithi161.stdout:3/990: dread d2/d51/d75/d11/f5d [0,4194304] 0 2023-12-09T02:35:27.449 INFO:tasks.workunit.client.1.smithi161.stdout:8/947: sync 2023-12-09T02:35:27.449 INFO:tasks.workunit.client.1.smithi161.stdout:7/866: sync 2023-12-09T02:35:27.449 INFO:tasks.workunit.client.1.smithi161.stdout:3/991: creat d2/d51/dee/d91/d46/d2d/d47/de6/f138 x:0 0 0 2023-12-09T02:35:27.453 INFO:tasks.workunit.client.1.smithi161.stdout:7/867: unlink d0/d3/d21/d54/f64 0 2023-12-09T02:35:27.454 INFO:tasks.workunit.client.1.smithi161.stdout:8/948: getdents d2/d5/d22/d54/d9e 0 2023-12-09T02:35:27.457 INFO:tasks.workunit.client.1.smithi161.stdout:3/992: mknod d2/d51/d75/c139 0 2023-12-09T02:35:27.457 INFO:tasks.workunit.client.1.smithi161.stdout:3/993: readlink d2/d51/d75/d11/d1f/d4c/ddd/l10c 0 2023-12-09T02:35:27.462 INFO:tasks.workunit.client.1.smithi161.stdout:8/949: link d2/d5/d22/d86/f9d d2/d5/d22/d86/dd6/f13f 0 2023-12-09T02:35:27.462 INFO:tasks.workunit.client.1.smithi161.stdout:8/950: chown d2/d5/d22/d76/l99 285 1 2023-12-09T02:35:27.464 INFO:tasks.workunit.client.1.smithi161.stdout:3/994: creat d2/d37/d99/dd2/f13a x:0 0 0 2023-12-09T02:35:27.464 INFO:tasks.workunit.client.1.smithi161.stdout:3/995: readlink d2/d51/d75/d11/d1f/l43 0 2023-12-09T02:35:27.469 INFO:tasks.workunit.client.1.smithi161.stdout:7/868: write d0/f78 [5568919,35673] 0 2023-12-09T02:35:27.471 INFO:tasks.workunit.client.1.smithi161.stdout:8/951: unlink d2/d5/d22/d31/d38/d84/f10f 0 2023-12-09T02:35:27.473 INFO:tasks.workunit.client.1.smithi161.stdout:8/952: write d2/d5/d22/fa3 [2437932,18565] 0 2023-12-09T02:35:27.473 INFO:tasks.workunit.client.1.smithi161.stdout:8/953: write d2/d2d/ff4 [256196,48842] 0 2023-12-09T02:35:27.473 INFO:tasks.workunit.client.1.smithi161.stdout:8/954: read - d2/d5/d22/f132 zero size 2023-12-09T02:35:27.473 INFO:tasks.workunit.client.1.smithi161.stdout:8/955: write d2/d5/d22/d31/f8b [756550,107031] 0 2023-12-09T02:35:27.474 INFO:tasks.workunit.client.1.smithi161.stdout:8/956: dread - d2/d5/d4f/db2/da9/fce zero size 2023-12-09T02:35:27.475 INFO:tasks.workunit.client.1.smithi161.stdout:8/957: creat d2/d5/d22/d31/d38/d84/f140 x:0 0 0 2023-12-09T02:35:27.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:27 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:27.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:27 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:27.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:27 smithi088 ceph-mon[112028]: pgmap v10: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 72 MiB/s rd, 140 MiB/s wr, 280 op/s 2023-12-09T02:35:27.476 INFO:tasks.workunit.client.1.smithi161.stdout:8/958: creat d2/d5/d22/f141 x:0 0 0 2023-12-09T02:35:27.477 INFO:tasks.workunit.client.1.smithi161.stdout:8/959: write d2/d5/d22/f98 [1418166,34914] 0 2023-12-09T02:35:27.479 INFO:tasks.workunit.client.1.smithi161.stdout:8/960: write d2/d5/d22/d31/d38/d48/f75 [2649248,126359] 0 2023-12-09T02:35:27.487 INFO:tasks.workunit.client.1.smithi161.stdout:7/869: dwrite d0/d3/d13/d4e/db2/dda/dab/ff3 [0,4194304] 0 2023-12-09T02:35:27.488 INFO:tasks.workunit.client.1.smithi161.stdout:3/996: dwrite d2/d51/dee/d91/d46/d2d/d4e/d11d/ffc [0,4194304] 0 2023-12-09T02:35:27.492 INFO:tasks.workunit.client.1.smithi161.stdout:8/961: rmdir d2/d5/d22/d31/d38 39 2023-12-09T02:35:27.499 INFO:tasks.workunit.client.1.smithi161.stdout:7/870: creat d0/d3/d13/dc7/dc8/dd9/f10e x:0 0 0 2023-12-09T02:35:27.508 INFO:tasks.workunit.client.1.smithi161.stdout:7/871: rename d0/d3/d13/d4e/db2/dda/dcb to d0/d3/daa/daf/de4/d10f 0 2023-12-09T02:35:27.509 INFO:tasks.workunit.client.1.smithi161.stdout:3/997: dwrite d2/d51/d75/d11/d7b/f85 [0,4194304] 0 2023-12-09T02:35:27.512 INFO:tasks.workunit.client.1.smithi161.stdout:7/872: creat d0/f110 x:0 0 0 2023-12-09T02:35:27.515 INFO:tasks.workunit.client.1.smithi161.stdout:7/873: unlink d0/d3/d13/d1b/f2b 0 2023-12-09T02:35:27.518 INFO:tasks.workunit.client.1.smithi161.stdout:3/998: rename d2/d51/dee/d91/d46/d2d/d47/d8c/fb0 to d2/d51/d75/d50/ddf/d96/f13b 0 2023-12-09T02:35:27.523 INFO:tasks.workunit.client.1.smithi161.stdout:3/999: dread d2/d51/dee/d91/d46/d2d/d47/f5c [4194304,4194304] 0 2023-12-09T02:35:27.534 INFO:tasks.workunit.client.1.smithi161.stdout:7/874: dwrite d0/d3/d21/f3b [0,4194304] 0 2023-12-09T02:35:27.550 INFO:tasks.workunit.client.1.smithi161.stdout:7/875: rmdir d0 39 2023-12-09T02:35:27.551 INFO:tasks.workunit.client.1.smithi161.stdout:7/876: dread d0/fc1 [0,4194304] 0 2023-12-09T02:35:27.553 INFO:tasks.workunit.client.1.smithi161.stdout:7/877: mkdir d0/d3/d13/d111 0 2023-12-09T02:35:27.555 INFO:tasks.workunit.client.1.smithi161.stdout:7/878: truncate d0/d3/d13/d2d/f5b 388638 0 2023-12-09T02:35:27.559 INFO:tasks.workunit.client.1.smithi161.stdout:7/879: creat d0/d3/d13/d4e/d70/f112 x:0 0 0 2023-12-09T02:35:27.560 INFO:tasks.workunit.client.1.smithi161.stdout:7/880: write d0/d3/daa/daf/de4/d10f/d59/f86 [625005,810] 0 2023-12-09T02:35:27.562 INFO:tasks.workunit.client.1.smithi161.stdout:7/881: symlink d0/d49/d67/l113 0 2023-12-09T02:35:27.564 INFO:tasks.workunit.client.1.smithi161.stdout:7/882: creat d0/d3/d13/d4e/db2/dda/dab/d94/df6/f114 x:0 0 0 2023-12-09T02:35:27.564 INFO:tasks.workunit.client.1.smithi161.stdout:7/883: fsync d0/d3/f66 0 2023-12-09T02:35:27.579 INFO:tasks.workunit.client.1.smithi161.stdout:7/884: dwrite d0/d3/d13/f58 [0,4194304] 0 2023-12-09T02:35:27.582 INFO:tasks.workunit.client.1.smithi161.stdout:7/885: link d0/d3/d6c/dbe/cd4 d0/d49/d79/c115 0 2023-12-09T02:35:27.582 INFO:tasks.workunit.client.1.smithi161.stdout:7/886: chown d0/d3/d21 31 1 2023-12-09T02:35:27.582 INFO:tasks.workunit.client.1.smithi161.stdout:7/887: creat d0/d3/d13/d4e/db5/d83/f116 x:0 0 0 2023-12-09T02:35:27.584 INFO:tasks.workunit.client.1.smithi161.stdout:7/888: mknod d0/d3/c117 0 2023-12-09T02:35:27.585 INFO:tasks.workunit.client.1.smithi161.stdout:7/889: dread d0/d3/d13/dc7/f8a [0,4194304] 0 2023-12-09T02:35:27.585 INFO:tasks.workunit.client.1.smithi161.stdout:7/890: truncate d0/d3/daa/daf/de4/df2/f10c 18484 0 2023-12-09T02:35:27.587 INFO:tasks.workunit.client.1.smithi161.stdout:7/891: unlink d0/d3/d13/d4e/db2/dda/d4b/fec 0 2023-12-09T02:35:27.590 INFO:tasks.workunit.client.1.smithi161.stdout:7/892: link d0/d3/d13/d4e/db2/dda/c7f d0/d49/d67/c118 0 2023-12-09T02:35:27.604 INFO:tasks.workunit.client.1.smithi161.stdout:7/893: rename d0/d3/d13/d4e/db2 to d0/d3/daa/daf/de4/d10f/d59/d5e/d119 0 2023-12-09T02:35:27.607 INFO:tasks.workunit.client.1.smithi161.stdout:7/894: truncate d0/d3/d13/f56 1023956 0 2023-12-09T02:35:27.609 INFO:tasks.workunit.client.1.smithi161.stdout:7/895: creat d0/d3/d13/d1b/f11a x:0 0 0 2023-12-09T02:35:27.609 INFO:tasks.workunit.client.1.smithi161.stdout:7/896: chown d0/d49/d79/dc3 17851548 1 2023-12-09T02:35:27.629 INFO:tasks.workunit.client.1.smithi161.stdout:7/897: dwrite d0/d3/d13/d4e/db5/fa1 [0,4194304] 0 2023-12-09T02:35:27.632 INFO:tasks.workunit.client.1.smithi161.stdout:7/898: mknod d0/d49/d79/c11b 0 2023-12-09T02:35:27.632 INFO:tasks.workunit.client.1.smithi161.stdout:7/899: truncate d0/d3/d13/f89 5267217 0 2023-12-09T02:35:27.633 INFO:tasks.workunit.client.1.smithi161.stdout:7/900: mknod d0/d3/d13/dc7/dc8/c11c 0 2023-12-09T02:35:27.649 INFO:tasks.workunit.client.1.smithi161.stdout:7/901: dwrite d0/d3/daa/daf/de4/df2/fb6 [0,4194304] 0 2023-12-09T02:35:27.651 INFO:tasks.workunit.client.1.smithi161.stdout:7/902: creat d0/d3/d13/d111/f11d x:0 0 0 2023-12-09T02:35:27.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:27 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:27.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:27 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:27.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:27 smithi161 ceph-mon[121170]: pgmap v10: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 72 MiB/s rd, 140 MiB/s wr, 280 op/s 2023-12-09T02:35:27.677 INFO:tasks.workunit.client.1.smithi161.stdout:7/903: dwrite d0/d3/d13/dc7/f8a [0,4194304] 0 2023-12-09T02:35:27.680 INFO:tasks.workunit.client.1.smithi161.stdout:7/904: symlink d0/d3/d13/d2d/d6e/l11e 0 2023-12-09T02:35:27.680 INFO:tasks.workunit.client.1.smithi161.stdout:7/905: write d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/d4b/d99/fca [235804,127290] 0 2023-12-09T02:35:27.681 INFO:tasks.workunit.client.1.smithi161.stdout:7/906: write d0/d3/d13/d4e/db5/d83/f95 [1927773,12800] 0 2023-12-09T02:35:27.681 INFO:tasks.workunit.client.1.smithi161.stdout:7/907: fdatasync d0/d3/d13/f58 0 2023-12-09T02:35:27.681 INFO:tasks.workunit.client.1.smithi161.stdout:7/908: chown d0/d3/d13/d4e/d70/lee 102670610 1 2023-12-09T02:35:27.682 INFO:tasks.workunit.client.1.smithi161.stdout:7/909: creat d0/d3/d13/dbf/f11f x:0 0 0 2023-12-09T02:35:27.939 INFO:tasks.workunit.client.1.smithi161.stdout:8/962: sync 2023-12-09T02:35:27.939 INFO:tasks.workunit.client.1.smithi161.stdout:8/963: write d2/d5/d22/fbf [485639,112388] 0 2023-12-09T02:35:27.940 INFO:tasks.workunit.client.1.smithi161.stdout:8/964: truncate d2/d5/d22/f81 2431415 0 2023-12-09T02:35:27.941 INFO:tasks.workunit.client.1.smithi161.stdout:8/965: creat d2/d5/d4f/d102/f142 x:0 0 0 2023-12-09T02:35:27.944 INFO:tasks.workunit.client.1.smithi161.stdout:8/966: dread d2/d5/d22/d31/d38/d48/f69 [0,4194304] 0 2023-12-09T02:35:27.946 INFO:tasks.workunit.client.1.smithi161.stdout:8/967: mkdir d2/d5/dac/d143 0 2023-12-09T02:35:27.947 INFO:tasks.workunit.client.1.smithi161.stdout:8/968: mknod d2/d5/d4f/db2/c144 0 2023-12-09T02:35:27.950 INFO:tasks.workunit.client.1.smithi161.stdout:8/969: creat d2/d8a/dbd/df0/f145 x:0 0 0 2023-12-09T02:35:27.952 INFO:tasks.workunit.client.1.smithi161.stdout:8/970: link d2/d5/d22/d86/dd6/lf5 d2/d5/d22/d31/da0/dfa/l146 0 2023-12-09T02:35:27.952 INFO:tasks.workunit.client.1.smithi161.stdout:8/971: chown d2/d5/d22/d31/c8c 738151916 1 2023-12-09T02:35:27.955 INFO:tasks.workunit.client.1.smithi161.stdout:8/972: link d2/d5/d22/d76/f85 d2/d5/d22/d86/d97/d115/f147 0 2023-12-09T02:35:27.955 INFO:tasks.workunit.client.1.smithi161.stdout:8/973: write d2/d5/d22/d31/d38/d66/d100/f13b [303233,21903] 0 2023-12-09T02:35:27.955 INFO:tasks.workunit.client.1.smithi161.stdout:8/974: stat d2/d5/d22/d54/db4/cef 0 2023-12-09T02:35:27.957 INFO:tasks.workunit.client.1.smithi161.stdout:8/975: mknod d2/d2d/dec/c148 0 2023-12-09T02:35:27.958 INFO:tasks.workunit.client.1.smithi161.stdout:8/976: creat d2/d5/d22/d54/db4/df9/dff/f149 x:0 0 0 2023-12-09T02:35:27.959 INFO:tasks.workunit.client.1.smithi161.stdout:8/977: symlink d2/d5/d22/d86/dd6/l14a 0 2023-12-09T02:35:27.960 INFO:tasks.workunit.client.1.smithi161.stdout:8/978: mknod d2/d5/d22/d54/d9e/c14b 0 2023-12-09T02:35:27.960 INFO:tasks.workunit.client.1.smithi161.stdout:8/979: write d2/d5/d22/d31/d38/f3b [385416,48718] 0 2023-12-09T02:35:27.969 INFO:tasks.workunit.client.1.smithi161.stdout:8/980: dread d2/fea [0,4194304] 0 2023-12-09T02:35:27.976 INFO:tasks.workunit.client.1.smithi161.stdout:8/981: dread d2/d5/d22/d31/d38/d48/f75 [0,4194304] 0 2023-12-09T02:35:27.979 INFO:tasks.workunit.client.1.smithi161.stdout:8/982: getdents d2/d5/d22/d86 0 2023-12-09T02:35:27.979 INFO:tasks.workunit.client.1.smithi161.stdout:8/983: read - d2/d5/d22/d54/db4/dcd/ffb zero size 2023-12-09T02:35:27.982 INFO:tasks.workunit.client.1.smithi161.stdout:8/984: rename d2/d5/d22/d31/d38/d66 to d2/d5/d14c 0 2023-12-09T02:35:27.982 INFO:tasks.workunit.client.1.smithi161.stdout:8/985: dread - d2/d8a/dbd/df0/f11d zero size 2023-12-09T02:35:27.984 INFO:tasks.workunit.client.1.smithi161.stdout:8/986: dread d2/d8a/fc1 [0,4194304] 0 2023-12-09T02:35:27.993 INFO:tasks.workunit.client.1.smithi161.stdout:8/987: dread d2/f1d [0,4194304] 0 2023-12-09T02:35:27.993 INFO:tasks.workunit.client.1.smithi161.stdout:8/988: dread - d2/d5/d22/f141 zero size 2023-12-09T02:35:28.008 INFO:tasks.workunit.client.1.smithi161.stdout:8/989: dwrite d2/d5/d22/d31/d38/d48/f69 [0,4194304] 0 2023-12-09T02:35:28.011 INFO:tasks.workunit.client.1.smithi161.stdout:8/990: mkdir d2/d8a/dbd/d14d 0 2023-12-09T02:35:28.012 INFO:tasks.workunit.client.1.smithi161.stdout:8/991: rmdir d2/d5/d22/d86/dd6/dd7 39 2023-12-09T02:35:28.013 INFO:tasks.workunit.client.1.smithi161.stdout:8/992: chown d2/d5/d22/d31/d38/d48/c56 915 1 2023-12-09T02:35:28.038 INFO:tasks.workunit.client.1.smithi161.stdout:7/910: sync 2023-12-09T02:35:28.038 INFO:tasks.workunit.client.1.smithi161.stdout:7/911: chown d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/lbd 80013107 1 2023-12-09T02:35:28.039 INFO:tasks.workunit.client.1.smithi161.stdout:7/912: rename d0/d3/daa/daf/de4/la2 to d0/d3/d6c/d105/l120 0 2023-12-09T02:35:28.039 INFO:tasks.workunit.client.1.smithi161.stdout:7/913: stat d0/d3/d13/d1b/db8 0 2023-12-09T02:35:28.040 INFO:tasks.workunit.client.1.smithi161.stdout:8/993: dwrite d2/d5/d22/f49 [0,4194304] 0 2023-12-09T02:35:28.054 INFO:tasks.workunit.client.1.smithi161.stdout:7/914: dread d0/d3/f7 [0,4194304] 0 2023-12-09T02:35:28.054 INFO:tasks.workunit.client.1.smithi161.stdout:7/915: rmdir d0/d3/d13/d2f 39 2023-12-09T02:35:28.059 INFO:tasks.workunit.client.1.smithi161.stdout:7/916: rename d0/d3/f8 to d0/d3/d13/d1b/db8/f121 0 2023-12-09T02:35:28.061 INFO:tasks.workunit.client.1.smithi161.stdout:7/917: unlink d0/d3/d21/c9d 0 2023-12-09T02:35:28.062 INFO:tasks.workunit.client.1.smithi161.stdout:8/994: dwrite d2/d5/d22/fbf [0,4194304] 0 2023-12-09T02:35:28.064 INFO:tasks.workunit.client.1.smithi161.stdout:7/918: symlink d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/d4b/d99/l122 0 2023-12-09T02:35:28.084 INFO:tasks.workunit.client.1.smithi161.stdout:8/995: dwrite d2/d5/d4f/fd5 [0,4194304] 0 2023-12-09T02:35:28.085 INFO:tasks.workunit.client.1.smithi161.stdout:8/996: symlink d2/d5/d22/d54/db4/df9/dff/l14e 0 2023-12-09T02:35:28.085 INFO:tasks.workunit.client.1.smithi161.stdout:7/919: dwrite d0/d3/d13/f26 [0,4194304] 0 2023-12-09T02:35:28.086 INFO:tasks.workunit.client.1.smithi161.stdout:8/997: symlink d2/d2d/l14f 0 2023-12-09T02:35:28.087 INFO:tasks.workunit.client.1.smithi161.stdout:8/998: truncate d2/d5/d4f/f82 441597 0 2023-12-09T02:35:28.087 INFO:tasks.workunit.client.1.smithi161.stdout:8/999: fdatasync d2/d5/d22/d31/d38/d84/f129 0 2023-12-09T02:35:28.373 INFO:tasks.workunit.client.1.smithi161.stdout:7/920: sync 2023-12-09T02:35:28.388 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:28 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:28.388 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:28 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:28.388 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:28 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:35:28.390 INFO:tasks.workunit.client.1.smithi161.stdout:7/921: dwrite d0/d3/daa/daf/de4/dc0/fde [0,4194304] 0 2023-12-09T02:35:28.393 INFO:tasks.workunit.client.1.smithi161.stdout:7/922: creat d0/d3/d13/dbf/f123 x:0 0 0 2023-12-09T02:35:28.395 INFO:tasks.workunit.client.1.smithi161.stdout:7/923: mknod d0/d3/d21/d54/d91/c124 0 2023-12-09T02:35:28.397 INFO:tasks.workunit.client.1.smithi161.stdout:7/924: rmdir d0/d49/d79 39 2023-12-09T02:35:28.397 INFO:tasks.workunit.client.1.smithi161.stdout:7/925: truncate d0/d3/d13/dc7/dc8/dd9/f10e 320959 0 2023-12-09T02:35:28.404 INFO:tasks.workunit.client.1.smithi161.stdout:7/926: dread d0/d3/d13/f96 [0,4194304] 0 2023-12-09T02:35:28.404 INFO:tasks.workunit.client.1.smithi161.stdout:7/927: stat d0/d3/d13/f56 0 2023-12-09T02:35:28.404 INFO:tasks.workunit.client.1.smithi161.stdout:7/928: readlink d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/lbd 0 2023-12-09T02:35:28.404 INFO:tasks.workunit.client.1.smithi161.stdout:7/929: fsync d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/dab/f5c 0 2023-12-09T02:35:28.405 INFO:tasks.workunit.client.1.smithi161.stdout:7/930: write d0/d3/daa/daf/de4/d10f/d59/f6d [3893201,93170] 0 2023-12-09T02:35:28.429 INFO:tasks.workunit.client.1.smithi161.stdout:7/931: dwrite d0/d3/d13/f89 [0,4194304] 0 2023-12-09T02:35:28.429 INFO:tasks.workunit.client.1.smithi161.stdout:7/932: stat d0/d3/d13/f1f 0 2023-12-09T02:35:28.430 INFO:tasks.workunit.client.1.smithi161.stdout:7/933: unlink d0/d3/d13/la4 0 2023-12-09T02:35:28.435 INFO:tasks.workunit.client.1.smithi161.stdout:7/934: rename d0/d3/d13/d4e/db5 to d0/d3/daa/daf/de4/d10f/d125 0 2023-12-09T02:35:28.435 INFO:tasks.workunit.client.1.smithi161.stdout:7/935: chown d0/d3/d13/d1b/f11a 201 1 2023-12-09T02:35:28.437 INFO:tasks.workunit.client.1.smithi161.stdout:7/936: dread d0/d3/daa/daf/de4/d10f/d125/d83/f95 [0,4194304] 0 2023-12-09T02:35:28.437 INFO:tasks.workunit.client.1.smithi161.stdout:7/937: readlink d0/d3/d13/d2d/d6e/l11e 0 2023-12-09T02:35:28.438 INFO:tasks.workunit.client.1.smithi161.stdout:7/938: symlink d0/d3/daa/daf/de4/dc0/l126 0 2023-12-09T02:35:28.438 INFO:tasks.workunit.client.1.smithi161.stdout:7/939: fdatasync d0/d3/daa/daf/de4/d10f/d59/d5e/fae 0 2023-12-09T02:35:28.441 INFO:tasks.workunit.client.1.smithi161.stdout:7/940: fsync d0/d3/daa/daf/de4/d10f/d59/f6d 0 2023-12-09T02:35:28.441 INFO:tasks.workunit.client.1.smithi161.stdout:7/941: fdatasync d0/d3/d13/d4e/f103 0 2023-12-09T02:35:28.457 INFO:tasks.workunit.client.1.smithi161.stdout:7/942: dwrite d0/d3/daa/daf/de4/d10f/d59/d5e/fae [0,4194304] 0 2023-12-09T02:35:28.462 INFO:tasks.workunit.client.1.smithi161.stdout:7/943: symlink d0/d3/daa/daf/de4/d10f/d59/l127 0 2023-12-09T02:35:28.462 INFO:tasks.workunit.client.1.smithi161.stdout:7/944: creat d0/d3/daa/daf/de4/d10f/d125/d83/f128 x:0 0 0 2023-12-09T02:35:28.462 INFO:tasks.workunit.client.1.smithi161.stdout:7/945: truncate d0/d3/d13/f56 722874 0 2023-12-09T02:35:28.684 INFO:tasks.workunit.client.1.smithi161.stdout:7/946: sync 2023-12-09T02:35:28.684 INFO:tasks.workunit.client.1.smithi161.stdout:7/947: write d0/d3/daa/daf/de4/d10f/f32 [2206400,14731] 0 2023-12-09T02:35:28.685 INFO:tasks.workunit.client.1.smithi161.stdout:7/948: read d0/d3/daa/daf/de4/d10f/d125/d83/f95 [732361,37154] 0 2023-12-09T02:35:28.686 INFO:tasks.workunit.client.1.smithi161.stdout:7/949: mknod d0/d3/d13/d4e/c129 0 2023-12-09T02:35:28.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:28 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:28.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:28 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:28.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:28 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:35:29.024 INFO:tasks.workunit.client.1.smithi161.stdout:7/950: sync 2023-12-09T02:35:29.024 INFO:tasks.workunit.client.1.smithi161.stdout:7/951: read - d0/d3/d13/dbf/f123 zero size 2023-12-09T02:35:29.026 INFO:tasks.workunit.client.1.smithi161.stdout:7/952: rename d0/d3/daa/daf/de4/d10f/d59/c65 to d0/d49/d79/dc3/c12a 0 2023-12-09T02:35:29.028 INFO:tasks.workunit.client.1.smithi161.stdout:7/953: creat d0/d3/daa/daf/de4/d10f/d125/d83/f12b x:0 0 0 2023-12-09T02:35:29.029 INFO:tasks.workunit.client.1.smithi161.stdout:7/954: symlink d0/d3/d13/dc7/dc8/dd9/d108/l12c 0 2023-12-09T02:35:29.048 INFO:tasks.workunit.client.1.smithi161.stdout:7/955: dwrite d0/d3/daa/daf/de4/dc0/fde [0,4194304] 0 2023-12-09T02:35:29.050 INFO:tasks.workunit.client.1.smithi161.stdout:7/956: creat d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/dab/d94/df6/f12d x:0 0 0 2023-12-09T02:35:29.070 INFO:tasks.workunit.client.1.smithi161.stdout:7/957: dwrite d0/d3/d13/dc7/fb1 [0,4194304] 0 2023-12-09T02:35:29.097 INFO:tasks.workunit.client.1.smithi161.stdout:7/958: dwrite d0/d3/daa/daf/de4/d10f/f2e [0,4194304] 0 2023-12-09T02:35:29.098 INFO:tasks.workunit.client.1.smithi161.stdout:7/959: chown d0/d3/daa/daf/de4/d10f 269133548 1 2023-12-09T02:35:29.098 INFO:tasks.workunit.client.1.smithi161.stdout:7/960: read - d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/ff7 zero size 2023-12-09T02:35:29.098 INFO:tasks.workunit.client.1.smithi161.stdout:7/961: fdatasync d0/d3/f73 0 2023-12-09T02:35:29.100 INFO:tasks.workunit.client.1.smithi161.stdout:7/962: mkdir d0/d49/d79/dc3/d12e 0 2023-12-09T02:35:29.114 INFO:tasks.workunit.client.1.smithi161.stdout:7/963: dwrite d0/fc [0,4194304] 0 2023-12-09T02:35:29.124 INFO:tasks.workunit.client.1.smithi161.stdout:7/964: dread d0/d3/d13/f26 [0,4194304] 0 2023-12-09T02:35:29.127 INFO:tasks.workunit.client.1.smithi161.stdout:7/965: symlink d0/d3/daa/daf/de4/d10f/d59/d5e/d119/da7/l12f 0 2023-12-09T02:35:29.130 INFO:tasks.workunit.client.1.smithi161.stdout:7/966: stat d0/d49/d79/dc3/c12a 0 2023-12-09T02:35:29.130 INFO:tasks.workunit.client.1.smithi161.stdout:7/967: stat d0/l38 0 2023-12-09T02:35:29.144 INFO:tasks.workunit.client.1.smithi161.stdout:7/968: dwrite d0/d3/d13/f58 [0,4194304] 0 2023-12-09T02:35:29.147 INFO:tasks.workunit.client.1.smithi161.stdout:7/969: creat d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/d4b/f130 x:0 0 0 2023-12-09T02:35:29.150 INFO:tasks.workunit.client.1.smithi161.stdout:7/970: rmdir d0/d49 39 2023-12-09T02:35:29.169 INFO:tasks.workunit.client.1.smithi161.stdout:7/971: dwrite d0/d3/daa/daf/de4/d10f/d125/d83/f128 [0,4194304] 0 2023-12-09T02:35:29.171 INFO:tasks.workunit.client.1.smithi161.stdout:7/972: mknod d0/d3/daa/daf/de4/d10f/d59/d5e/c131 0 2023-12-09T02:35:29.172 INFO:tasks.workunit.client.1.smithi161.stdout:7/973: mkdir d0/d49/d79/d132 0 2023-12-09T02:35:29.172 INFO:tasks.workunit.client.1.smithi161.stdout:7/974: write d0/d3/daa/daf/de4/d10f/d125/d83/f97 [4329046,70631] 0 2023-12-09T02:35:29.173 INFO:tasks.workunit.client.1.smithi161.stdout:7/975: rmdir d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/d4b/d5a 39 2023-12-09T02:35:29.174 INFO:tasks.workunit.client.1.smithi161.stdout:7/976: creat d0/f133 x:0 0 0 2023-12-09T02:35:29.194 INFO:tasks.workunit.client.1.smithi161.stdout:7/977: dwrite d0/d3/d13/f18 [0,4194304] 0 2023-12-09T02:35:29.194 INFO:tasks.workunit.client.1.smithi161.stdout:7/978: dread - d0/d3/d13/d111/f11d zero size 2023-12-09T02:35:29.194 INFO:tasks.workunit.client.1.smithi161.stdout:7/979: read d0/d3/daa/daf/de4/d10f/d59/f86 [287673,2671] 0 2023-12-09T02:35:29.196 INFO:tasks.workunit.client.1.smithi161.stdout:7/980: mkdir d0/d3/daa/daf/de4/d10f/d134 0 2023-12-09T02:35:29.212 INFO:tasks.workunit.client.1.smithi161.stdout:7/981: dwrite d0/d3/daa/daf/de4/d10f/d125/fa1 [4194304,4194304] 0 2023-12-09T02:35:29.212 INFO:tasks.workunit.client.1.smithi161.stdout:7/982: chown d0/d3/daa/daf 3233 1 2023-12-09T02:35:29.215 INFO:tasks.workunit.client.1.smithi161.stdout:7/983: symlink d0/d3/daa/daf/de4/d10f/d59/d5e/l135 0 2023-12-09T02:35:29.228 INFO:tasks.workunit.client.1.smithi161.stdout:7/984: dwrite d0/d49/f90 [0,4194304] 0 2023-12-09T02:35:29.231 INFO:tasks.workunit.client.1.smithi161.stdout:7/985: creat d0/d3/d13/dc7/dc8/dd9/d108/f136 x:0 0 0 2023-12-09T02:35:29.258 INFO:tasks.workunit.client.1.smithi161.stdout:7/986: dwrite d0/d49/d67/f92 [4194304,4194304] 0 2023-12-09T02:35:29.259 INFO:tasks.workunit.client.1.smithi161.stdout:7/987: rmdir d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/d4b/d5a 39 2023-12-09T02:35:29.261 INFO:tasks.workunit.client.1.smithi161.stdout:7/988: rename d0/d49/d79/c115 to d0/d49/d79/c137 0 2023-12-09T02:35:29.263 INFO:tasks.workunit.client.1.smithi161.stdout:7/989: unlink d0/d3/d21/d54/d91/la3 0 2023-12-09T02:35:29.278 INFO:tasks.workunit.client.1.smithi161.stdout:7/990: dwrite d0/d3/d13/d1b/f3f [0,4194304] 0 2023-12-09T02:35:29.279 INFO:tasks.workunit.client.1.smithi161.stdout:7/991: write d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/d4b/d5a/f106 [8549,67078] 0 2023-12-09T02:35:29.280 INFO:tasks.workunit.client.1.smithi161.stdout:7/992: symlink d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/l138 0 2023-12-09T02:35:29.298 INFO:tasks.workunit.client.1.smithi161.stdout:7/993: dwrite d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/d4b/d5a/f106 [0,4194304] 0 2023-12-09T02:35:29.299 INFO:tasks.workunit.client.1.smithi161.stdout:7/994: truncate d0/d3/daa/daf/de4/d10f/d125/d83/f116 216900 0 2023-12-09T02:35:29.303 INFO:tasks.workunit.client.1.smithi161.stdout:7/995: dread d0/d3/daa/daf/de4/d10f/f32 [0,4194304] 0 2023-12-09T02:35:29.318 INFO:tasks.workunit.client.1.smithi161.stdout:7/996: dwrite d0/d3/d13/d2d/f45 [0,4194304] 0 2023-12-09T02:35:29.318 INFO:tasks.workunit.client.1.smithi161.stdout:7/997: chown d0/d3/d13/d4e/c5f 16372033 1 2023-12-09T02:35:29.318 INFO:tasks.workunit.client.1.smithi161.stdout:7/998: dread - d0/f133 zero size 2023-12-09T02:35:29.321 INFO:tasks.workunit.client.1.smithi161.stdout:7/999: dread d0/d3/daa/daf/de4/d10f/d59/d5e/d119/dda/d4b/d99/fca [0,4194304] 0 2023-12-09T02:35:29.325 INFO:tasks.workunit.client.1.smithi161.stderr:+ rm -rf -- ./tmp.LXP8cY6KUP 2023-12-09T02:35:29.746 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:29 smithi161 ceph-mon[121170]: pgmap v11: 65 pgs: 65 active+clean; 2.3 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 74 MiB/s rd, 147 MiB/s wr, 292 op/s 2023-12-09T02:35:30.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:29 smithi088 ceph-mon[112028]: pgmap v11: 65 pgs: 65 active+clean; 2.3 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 74 MiB/s rd, 147 MiB/s wr, 292 op/s 2023-12-09T02:35:32.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: Adjusting osd_memory_target on smithi161 to 2592M 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: Updating smithi088:/etc/ceph/ceph.conf 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: Updating smithi161:/etc/ceph/ceph.conf 2023-12-09T02:35:32.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:31 smithi161 ceph-mon[121170]: pgmap v12: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 94 MiB/s rd, 178 MiB/s wr, 373 op/s 2023-12-09T02:35:32.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:32.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:32.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-09T02:35:32.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: Adjusting osd_memory_target on smithi161 to 2592M 2023-12-09T02:35:32.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:32.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:35:32.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:35:32.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: Updating smithi088:/etc/ceph/ceph.conf 2023-12-09T02:35:32.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: Updating smithi161:/etc/ceph/ceph.conf 2023-12-09T02:35:32.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:31 smithi088 ceph-mon[112028]: pgmap v12: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 94 MiB/s rd, 178 MiB/s wr, 373 op/s 2023-12-09T02:35:33.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:35:33.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:35:33.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:35:33.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:35:33.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:35:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:35:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:33 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:35:33.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:35:33.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:35:33.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:35:33.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:35:33.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:35:33.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:33.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:33 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:34.356 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:34 smithi088 ceph-mon[112028]: Reconfiguring node-exporter.smithi088 (dependencies changed)... 2023-12-09T02:35:34.356 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:34 smithi088 ceph-mon[112028]: Reconfiguring daemon node-exporter.smithi088 on smithi088 2023-12-09T02:35:34.356 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:34 smithi088 ceph-mon[112028]: pgmap v13: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 59 MiB/s rd, 117 MiB/s wr, 266 op/s 2023-12-09T02:35:34.356 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:34 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:34.356 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:34 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:34.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:34 smithi161 ceph-mon[121170]: Reconfiguring node-exporter.smithi088 (dependencies changed)... 2023-12-09T02:35:34.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:34 smithi161 ceph-mon[121170]: Reconfiguring daemon node-exporter.smithi088 on smithi088 2023-12-09T02:35:34.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:34 smithi161 ceph-mon[121170]: pgmap v13: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 59 MiB/s rd, 117 MiB/s wr, 266 op/s 2023-12-09T02:35:34.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:34 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:34.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:34 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:35.324 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:35 smithi088 ceph-mon[112028]: Reconfiguring alertmanager.smithi088 (dependencies changed)... 2023-12-09T02:35:35.324 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:35 smithi088 ceph-mon[112028]: Reconfiguring daemon alertmanager.smithi088 on smithi088 2023-12-09T02:35:35.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:35 smithi161 ceph-mon[121170]: Reconfiguring alertmanager.smithi088 (dependencies changed)... 2023-12-09T02:35:35.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:35 smithi161 ceph-mon[121170]: Reconfiguring daemon alertmanager.smithi088 on smithi088 2023-12-09T02:35:36.188 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:36 smithi088 ceph-mon[112028]: pgmap v14: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 60 MiB/s rd, 122 MiB/s wr, 371 op/s 2023-12-09T02:35:36.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:36 smithi161 ceph-mon[121170]: pgmap v14: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 60 MiB/s rd, 122 MiB/s wr, 371 op/s 2023-12-09T02:35:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:37 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:37 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:37 smithi088 ceph-mon[112028]: Reconfiguring grafana.smithi088 (dependencies changed)... 2023-12-09T02:35:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:37 smithi088 ceph-mon[112028]: Reconfiguring daemon grafana.smithi088 on smithi088 2023-12-09T02:35:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:37 smithi088 ceph-mon[112028]: pgmap v15: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 25 MiB/s rd, 52 MiB/s wr, 243 op/s 2023-12-09T02:35:37.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:37 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:37.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:37 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:37.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:37 smithi161 ceph-mon[121170]: Reconfiguring grafana.smithi088 (dependencies changed)... 2023-12-09T02:35:37.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:37 smithi161 ceph-mon[121170]: Reconfiguring daemon grafana.smithi088 on smithi088 2023-12-09T02:35:37.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:37 smithi161 ceph-mon[121170]: pgmap v15: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 25 MiB/s rd, 52 MiB/s wr, 243 op/s 2023-12-09T02:35:40.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:39 smithi161 ceph-mon[121170]: pgmap v16: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 25 MiB/s rd, 52 MiB/s wr, 261 op/s 2023-12-09T02:35:40.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:39 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:40.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:39 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:40.196 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:39 smithi088 ceph-mon[112028]: pgmap v16: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 25 MiB/s rd, 52 MiB/s wr, 261 op/s 2023-12-09T02:35:40.196 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:39 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:40.196 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:39 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:40.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.306+0000 7f085bc14700 1 -- 172.21.15.88:0/241874970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08540fb290 msgr2=0x7f08540fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:40.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.306+0000 7f085bc14700 1 --2- 172.21.15.88:0/241874970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08540fb290 0x7f08540fb6a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0850004940 tx=0x7f0850009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:40.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.307+0000 7f085bc14700 1 -- 172.21.15.88:0/241874970 shutdown_connections 2023-12-09T02:35:40.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.307+0000 7f085bc14700 1 --2- 172.21.15.88:0/241874970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540fc4a0 0x7f08540fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:40.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.307+0000 7f085bc14700 1 --2- 172.21.15.88:0/241874970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08540fb290 0x7f08540fb6a0 secure :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0850004940 tx=0x7f0850009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:40.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.307+0000 7f085bc14700 1 -- 172.21.15.88:0/241874970 >> 172.21.15.88:0/241874970 conn(0x7f08540f6950 msgr2=0x7f08540f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:40.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.307+0000 7f085bc14700 1 -- 172.21.15.88:0/241874970 shutdown_connections 2023-12-09T02:35:40.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.307+0000 7f085bc14700 1 -- 172.21.15.88:0/241874970 wait complete. 2023-12-09T02:35:40.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.307+0000 7f085bc14700 1 Processor -- start 2023-12-09T02:35:40.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.307+0000 7f085bc14700 1 -- start start 2023-12-09T02:35:40.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.308+0000 7f085bc14700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540fc4a0 0x7f085410d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:40.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.308+0000 7f085bc14700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f085410dd60 0x7f085410ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:40.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.308+0000 7f085bc14700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085410e2b0 con 0x7f085410dd60 2023-12-09T02:35:40.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.308+0000 7f085bc14700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085410e3f0 con 0x7f08540fc4a0 2023-12-09T02:35:40.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.308+0000 7f08591af700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f085410dd60 0x7f085410ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:40.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.308+0000 7f08591af700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f085410dd60 0x7f085410ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46726/0 (socket says 172.21.15.88:46726) 2023-12-09T02:35:40.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.308+0000 7f08591af700 1 -- 172.21.15.88:0/1749973282 learned_addr learned my addr 172.21.15.88:0/1749973282 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:40.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.308+0000 7f08591af700 1 -- 172.21.15.88:0/1749973282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540fc4a0 msgr2=0x7f085410d820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-09T02:35:40.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.308+0000 7f08591af700 1 --2- 172.21.15.88:0/1749973282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540fc4a0 0x7f085410d820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:40.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.308+0000 7f08591af700 1 -- 172.21.15.88:0/1749973282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0850005040 con 0x7f085410dd60 2023-12-09T02:35:40.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.309+0000 7f08591af700 1 --2- 172.21.15.88:0/1749973282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f085410dd60 0x7f085410ec00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f084400b790 tx=0x7f0844009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:40.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.309+0000 7f084a7fc700 1 -- 172.21.15.88:0/1749973282 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f084400f770 con 0x7f085410dd60 2023-12-09T02:35:40.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.309+0000 7f084a7fc700 1 -- 172.21.15.88:0/1749973282 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f084400fd80 con 0x7f085410dd60 2023-12-09T02:35:40.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.309+0000 7f084a7fc700 1 -- 172.21.15.88:0/1749973282 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f084400d310 con 0x7f085410dd60 2023-12-09T02:35:40.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.309+0000 7f085bc14700 1 -- 172.21.15.88:0/1749973282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085410f2e0 con 0x7f085410dd60 2023-12-09T02:35:40.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.309+0000 7f085bc14700 1 -- 172.21.15.88:0/1749973282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085410f820 con 0x7f085410dd60 2023-12-09T02:35:40.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.310+0000 7f085bc14700 1 -- 172.21.15.88:0/1749973282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0854105470 con 0x7f085410dd60 2023-12-09T02:35:40.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.311+0000 7f084a7fc700 1 -- 172.21.15.88:0/1749973282 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f0844010420 con 0x7f085410dd60 2023-12-09T02:35:40.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.312+0000 7f084a7fc700 1 --2- 172.21.15.88:0/1749973282 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f084006ae90 0x7f084006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:40.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.312+0000 7f084a7fc700 1 -- 172.21.15.88:0/1749973282 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0844089610 con 0x7f085410dd60 2023-12-09T02:35:40.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.313+0000 7f08599b0700 1 --2- 172.21.15.88:0/1749973282 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f084006ae90 0x7f084006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:40.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.313+0000 7f08599b0700 1 --2- 172.21.15.88:0/1749973282 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f084006ae90 0x7f084006d340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0850000c00 tx=0x7f0850009e30 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.321+0000 7f084a7fc700 1 -- 172.21.15.88:0/1749973282 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f08440574d0 con 0x7f085410dd60 2023-12-09T02:35:40.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.557+0000 7f085bc14700 1 -- 172.21.15.88:0/1749973282 --> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f085405e080 con 0x7f084006ae90 2023-12-09T02:35:40.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.559+0000 7f084a7fc700 1 -- 172.21.15.88:0/1749973282 <== mgr.24377 v2:172.21.15.161:6828/1447919242 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f085405e080 con 0x7f084006ae90 2023-12-09T02:35:40.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.561+0000 7f085bc14700 1 -- 172.21.15.88:0/1749973282 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f084006ae90 msgr2=0x7f084006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.561+0000 7f085bc14700 1 --2- 172.21.15.88:0/1749973282 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f084006ae90 0x7f084006d340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0850000c00 tx=0x7f0850009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.561+0000 7f085bc14700 1 -- 172.21.15.88:0/1749973282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f085410dd60 msgr2=0x7f085410ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.561+0000 7f085bc14700 1 --2- 172.21.15.88:0/1749973282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f085410dd60 0x7f085410ec00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f084400b790 tx=0x7f0844009250 comp rx=0 tx=0).stop 2023-12-09T02:35:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.561+0000 7f085bc14700 1 -- 172.21.15.88:0/1749973282 shutdown_connections 2023-12-09T02:35:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.561+0000 7f085bc14700 1 --2- 172.21.15.88:0/1749973282 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f084006ae90 0x7f084006d340 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.561+0000 7f085bc14700 1 --2- 172.21.15.88:0/1749973282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540fc4a0 0x7f085410d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.561+0000 7f085bc14700 1 --2- 172.21.15.88:0/1749973282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f085410dd60 0x7f085410ec00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.561+0000 7f085bc14700 1 -- 172.21.15.88:0/1749973282 >> 172.21.15.88:0/1749973282 conn(0x7f08540f6950 msgr2=0x7f08540fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.561+0000 7f085bc14700 1 -- 172.21.15.88:0/1749973282 shutdown_connections 2023-12-09T02:35:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.561+0000 7f085bc14700 1 -- 172.21.15.88:0/1749973282 wait complete. 2023-12-09T02:35:40.573 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:35:40.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.672+0000 7f7fbc009700 1 -- 172.21.15.88:0/1512686985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fb40fd730 msgr2=0x7f7fb40ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:40.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.672+0000 7f7fbc009700 1 --2- 172.21.15.88:0/1512686985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fb40fd730 0x7f7fb40ffb10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0004940 tx=0x7f7fb0009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:40.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.672+0000 7f7fbc009700 1 -- 172.21.15.88:0/1512686985 shutdown_connections 2023-12-09T02:35:40.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.672+0000 7f7fbc009700 1 --2- 172.21.15.88:0/1512686985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fb4100050 0x7f7fb4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:40.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.672+0000 7f7fbc009700 1 --2- 172.21.15.88:0/1512686985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fb40fd730 0x7f7fb40ffb10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:40.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.672+0000 7f7fbc009700 1 -- 172.21.15.88:0/1512686985 >> 172.21.15.88:0/1512686985 conn(0x7f7fb40f71b0 msgr2=0x7f7fb40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:40.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.673+0000 7f7fbc009700 1 -- 172.21.15.88:0/1512686985 shutdown_connections 2023-12-09T02:35:40.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.673+0000 7f7fbc009700 1 -- 172.21.15.88:0/1512686985 wait complete. 2023-12-09T02:35:40.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.673+0000 7f7fbc009700 1 Processor -- start 2023-12-09T02:35:40.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.673+0000 7f7fbc009700 1 -- start start 2023-12-09T02:35:40.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.673+0000 7f7fbc009700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fb40fd730 0x7f7fb410b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:40.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.673+0000 7f7fbc009700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fb4100050 0x7f7fb410b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:40.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.673+0000 7f7fbc009700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb410bdb0 con 0x7f7fb4100050 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.673+0000 7f7fbc009700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb410c650 con 0x7f7fb40fd730 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7fb95a4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fb4100050 0x7f7fb410b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7fb95a4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fb4100050 0x7f7fb410b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46746/0 (socket says 172.21.15.88:46746) 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7fb95a4700 1 -- 172.21.15.88:0/4038795039 learned_addr learned my addr 172.21.15.88:0/4038795039 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7fb9da5700 1 --2- 172.21.15.88:0/4038795039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fb40fd730 0x7f7fb410b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7fb95a4700 1 -- 172.21.15.88:0/4038795039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fb40fd730 msgr2=0x7f7fb410b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7fb95a4700 1 --2- 172.21.15.88:0/4038795039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fb40fd730 0x7f7fb410b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7fb95a4700 1 -- 172.21.15.88:0/4038795039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb0005040 con 0x7f7fb4100050 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7fb95a4700 1 --2- 172.21.15.88:0/4038795039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fb4100050 0x7f7fb410b7b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400eb40 tx=0x7f7fa400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7faa7fc700 1 -- 172.21.15.88:0/4038795039 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fa4007cc0 con 0x7f7fb4100050 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7faa7fc700 1 -- 172.21.15.88:0/4038795039 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fa400f040 con 0x7f7fb4100050 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7faa7fc700 1 -- 172.21.15.88:0/4038795039 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fa400c990 con 0x7f7fb4100050 2023-12-09T02:35:40.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7fbc009700 1 -- 172.21.15.88:0/4038795039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb410c8d0 con 0x7f7fb4100050 2023-12-09T02:35:40.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.674+0000 7f7fbc009700 1 -- 172.21.15.88:0/4038795039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb410ce10 con 0x7f7fb4100050 2023-12-09T02:35:40.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.675+0000 7f7fbc009700 1 -- 172.21.15.88:0/4038795039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb41053e0 con 0x7f7fb4100050 2023-12-09T02:35:40.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.676+0000 7f7faa7fc700 1 -- 172.21.15.88:0/4038795039 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f7fa400caf0 con 0x7f7fb4100050 2023-12-09T02:35:40.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.676+0000 7f7faa7fc700 1 --2- 172.21.15.88:0/4038795039 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f7fa006f240 0x7f7fa00716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:40.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.677+0000 7f7faa7fc700 1 -- 172.21.15.88:0/4038795039 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7fa40895f0 con 0x7f7fb4100050 2023-12-09T02:35:40.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.677+0000 7f7fb9da5700 1 --2- 172.21.15.88:0/4038795039 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f7fa006f240 0x7f7fa00716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:40.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.677+0000 7f7fb9da5700 1 --2- 172.21.15.88:0/4038795039 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f7fa006f240 0x7f7fa00716f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0000c00 tx=0x7f7fb0009e30 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:40.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.680+0000 7f7faa7fc700 1 -- 172.21.15.88:0/4038795039 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7fa4057450 con 0x7f7fb4100050 2023-12-09T02:35:40.857 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:40 smithi088 ceph-mon[112028]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2023-12-09T02:35:40.857 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:40 smithi088 ceph-mon[112028]: Reconfiguring daemon prometheus.smithi088 on smithi088 2023-12-09T02:35:40.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.910+0000 7f7fbc009700 1 -- 172.21.15.88:0/4038795039 --> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fb402b1f0 con 0x7f7fa006f240 2023-12-09T02:35:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.912+0000 7f7faa7fc700 1 -- 172.21.15.88:0/4038795039 <== mgr.24377 v2:172.21.15.161:6828/1447919242 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f7fb402b1f0 con 0x7f7fa006f240 2023-12-09T02:35:40.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.914+0000 7f7fbc009700 1 -- 172.21.15.88:0/4038795039 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f7fa006f240 msgr2=0x7f7fa00716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:40.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.914+0000 7f7fbc009700 1 --2- 172.21.15.88:0/4038795039 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f7fa006f240 0x7f7fa00716f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0000c00 tx=0x7f7fb0009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:40.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.914+0000 7f7fbc009700 1 -- 172.21.15.88:0/4038795039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fb4100050 msgr2=0x7f7fb410b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:40.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.914+0000 7f7fbc009700 1 --2- 172.21.15.88:0/4038795039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fb4100050 0x7f7fb410b7b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400eb40 tx=0x7f7fa400b040 comp rx=0 tx=0).stop 2023-12-09T02:35:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.914+0000 7f7fbc009700 1 -- 172.21.15.88:0/4038795039 shutdown_connections 2023-12-09T02:35:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.914+0000 7f7fbc009700 1 --2- 172.21.15.88:0/4038795039 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f7fa006f240 0x7f7fa00716f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.914+0000 7f7fbc009700 1 --2- 172.21.15.88:0/4038795039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fb40fd730 0x7f7fb410b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.914+0000 7f7fbc009700 1 --2- 172.21.15.88:0/4038795039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fb4100050 0x7f7fb410b7b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.914+0000 7f7fbc009700 1 -- 172.21.15.88:0/4038795039 >> 172.21.15.88:0/4038795039 conn(0x7f7fb40f71b0 msgr2=0x7f7fb40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.914+0000 7f7fbc009700 1 -- 172.21.15.88:0/4038795039 shutdown_connections 2023-12-09T02:35:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:40.914+0000 7f7fbc009700 1 -- 172.21.15.88:0/4038795039 wait complete. 2023-12-09T02:35:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.019+0000 7f93e87fc700 1 -- 172.21.15.88:0/4261431044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e00fcd00 msgr2=0x7f93e00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.019+0000 7f93e87fc700 1 --2- 172.21.15.88:0/4261431044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e00fcd00 0x7f93e00fd150 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f93d0004940 tx=0x7f93d0009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.019+0000 7f93e87fc700 1 -- 172.21.15.88:0/4261431044 shutdown_connections 2023-12-09T02:35:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.019+0000 7f93e87fc700 1 --2- 172.21.15.88:0/4261431044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e00fcd00 0x7f93e00fd150 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.019+0000 7f93e87fc700 1 --2- 172.21.15.88:0/4261431044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93e00fbaf0 0x7f93e00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.019+0000 7f93e87fc700 1 -- 172.21.15.88:0/4261431044 >> 172.21.15.88:0/4261431044 conn(0x7f93e00f71b0 msgr2=0x7f93e00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.019+0000 7f93e87fc700 1 -- 172.21.15.88:0/4261431044 shutdown_connections 2023-12-09T02:35:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.019+0000 7f93e87fc700 1 -- 172.21.15.88:0/4261431044 wait complete. 2023-12-09T02:35:41.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.020+0000 7f93e87fc700 1 Processor -- start 2023-12-09T02:35:41.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.020+0000 7f93e87fc700 1 -- start start 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.020+0000 7f93e87fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93e00fbaf0 0x7f93e010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.020+0000 7f93e87fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e00fcd00 0x7f93e010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.020+0000 7f93e87fc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e010e030 con 0x7f93e00fcd00 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.020+0000 7f93e87fc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e010e8d0 con 0x7f93e00fbaf0 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.020+0000 7f93e5d97700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e00fcd00 0x7f93e010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.020+0000 7f93e5d97700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e00fcd00 0x7f93e010da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46770/0 (socket says 172.21.15.88:46770) 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.020+0000 7f93e6598700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93e00fbaf0 0x7f93e010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.020+0000 7f93e5d97700 1 -- 172.21.15.88:0/3442990080 learned_addr learned my addr 172.21.15.88:0/3442990080 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.021+0000 7f93e5d97700 1 -- 172.21.15.88:0/3442990080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93e00fbaf0 msgr2=0x7f93e010d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.021+0000 7f93e5d97700 1 --2- 172.21.15.88:0/3442990080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93e00fbaf0 0x7f93e010d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.021+0000 7f93e5d97700 1 -- 172.21.15.88:0/3442990080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d0005040 con 0x7f93e00fcd00 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.021+0000 7f93e6598700 1 --2- 172.21.15.88:0/3442990080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93e00fbaf0 0x7f93e010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-09T02:35:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.021+0000 7f93e5d97700 1 --2- 172.21.15.88:0/3442990080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e00fcd00 0x7f93e010da30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009380 tx=0x7f93d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:41.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.021+0000 7f93d6ffd700 1 -- 172.21.15.88:0/3442990080 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93d000e040 con 0x7f93e00fcd00 2023-12-09T02:35:41.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.021+0000 7f93e87fc700 1 -- 172.21.15.88:0/3442990080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e010eb50 con 0x7f93e00fcd00 2023-12-09T02:35:41.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.021+0000 7f93e87fc700 1 -- 172.21.15.88:0/3442990080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e010f090 con 0x7f93e00fcd00 2023-12-09T02:35:41.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.021+0000 7f93d6ffd700 1 -- 172.21.15.88:0/3442990080 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f93d000bd20 con 0x7f93e00fcd00 2023-12-09T02:35:41.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.021+0000 7f93d6ffd700 1 -- 172.21.15.88:0/3442990080 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93d001c630 con 0x7f93e00fcd00 2023-12-09T02:35:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.022+0000 7f93e87fc700 1 -- 172.21.15.88:0/3442990080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e004bb80 con 0x7f93e00fcd00 2023-12-09T02:35:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.023+0000 7f93d6ffd700 1 -- 172.21.15.88:0/3442990080 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f93d0013420 con 0x7f93e00fcd00 2023-12-09T02:35:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.023+0000 7f93d6ffd700 1 --2- 172.21.15.88:0/3442990080 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f93cc06ae40 0x7f93cc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.024+0000 7f93d6ffd700 1 -- 172.21.15.88:0/3442990080 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f93d008abb0 con 0x7f93e00fcd00 2023-12-09T02:35:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.024+0000 7f93e6598700 1 --2- 172.21.15.88:0/3442990080 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f93cc06ae40 0x7f93cc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.024+0000 7f93e6598700 1 --2- 172.21.15.88:0/3442990080 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f93cc06ae40 0x7f93cc06d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f93e00fcb60 tx=0x7f93dc011040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.028+0000 7f93d6ffd700 1 -- 172.21.15.88:0/3442990080 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f93d0058960 con 0x7f93e00fcd00 2023-12-09T02:35:41.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:40 smithi161 ceph-mon[121170]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2023-12-09T02:35:41.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:40 smithi161 ceph-mon[121170]: Reconfiguring daemon prometheus.smithi088 on smithi088 2023-12-09T02:35:41.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.297+0000 7f93e87fc700 1 -- 172.21.15.88:0/3442990080 --> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f93e010f520 con 0x7f93cc06ae40 2023-12-09T02:35:41.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.315+0000 7f93d6ffd700 1 -- 172.21.15.88:0/3442990080 <== mgr.24377 v2:172.21.15.161:6828/1447919242 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f93e010f520 con 0x7f93cc06ae40 2023-12-09T02:35:41.319 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:35:41.319 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 starting - - - - 2023-12-09T02:35:41.319 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (6m) 18s ago 6m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 9098f424ee11 2023-12-09T02:35:41.319 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (6m) 15s ago 6m 7482k - 17.2.7-119-ge2143d99 f761b6e42225 15c5154f5f2e 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 starting - - - - 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (2m) 18s ago 2m 13.3M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (2m) 18s ago 2m 14.6M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (2m) 15s ago 2m 4486M - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (2m) 15s ago 2m 14.4M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:9283 running (7m) 18s ago 7m 419M - 17.2.7-119-ge2143d99 f761b6e42225 0fffc89bc055 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283 running (66s) 15s ago 5m 492M - 19.0.0-44-g9dcc13bb f28f2b94f153 86d2f55bb861 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (7m) 18s ago 7m 83.2M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d21a10406297 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (5m) 15s ago 5m 59.9M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d6b9d9265450 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 starting - - - - 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (5m) 15s ago 5m 17.1M - 1.5.0 0da6a335fe13 43bf179905a8 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (5m) 18s ago 5m 508M 1568M 17.2.7-119-ge2143d99 f761b6e42225 fdd606881a64 2023-12-09T02:35:41.320 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (5m) 18s ago 5m 537M 1568M 17.2.7-119-ge2143d99 f761b6e42225 354d4a4d3430 2023-12-09T02:35:41.321 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (4m) 18s ago 4m 439M 1568M 17.2.7-119-ge2143d99 f761b6e42225 0b0abbb070ec 2023-12-09T02:35:41.321 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (4m) 15s ago 4m 623M 2592M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:35:41.321 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (4m) 15s ago 4m 495M 2592M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:35:41.321 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (3m) 15s ago 3m 589M 2592M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:35:41.321 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (5m) 18s ago 6m 59.5M - 2.43.0 a07b618ecd1d 5e8226460d4a 2023-12-09T02:35:41.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.320+0000 7f93e87fc700 1 -- 172.21.15.88:0/3442990080 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f93cc06ae40 msgr2=0x7f93cc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:41.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.320+0000 7f93e87fc700 1 --2- 172.21.15.88:0/3442990080 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f93cc06ae40 0x7f93cc06d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f93e00fcb60 tx=0x7f93dc011040 comp rx=0 tx=0).stop 2023-12-09T02:35:41.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.320+0000 7f93e87fc700 1 -- 172.21.15.88:0/3442990080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e00fcd00 msgr2=0x7f93e010da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:41.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.320+0000 7f93e87fc700 1 --2- 172.21.15.88:0/3442990080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e00fcd00 0x7f93e010da30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009380 tx=0x7f93d0009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:41.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.320+0000 7f93e87fc700 1 -- 172.21.15.88:0/3442990080 shutdown_connections 2023-12-09T02:35:41.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.320+0000 7f93e87fc700 1 --2- 172.21.15.88:0/3442990080 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f93cc06ae40 0x7f93cc06d2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.320+0000 7f93e87fc700 1 --2- 172.21.15.88:0/3442990080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93e00fbaf0 0x7f93e010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.320+0000 7f93e87fc700 1 --2- 172.21.15.88:0/3442990080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e00fcd00 0x7f93e010da30 secure :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009380 tx=0x7f93d0009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:41.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.320+0000 7f93e87fc700 1 -- 172.21.15.88:0/3442990080 >> 172.21.15.88:0/3442990080 conn(0x7f93e00f71b0 msgr2=0x7f93e0065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:41.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.320+0000 7f93e87fc700 1 -- 172.21.15.88:0/3442990080 shutdown_connections 2023-12-09T02:35:41.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.320+0000 7f93e87fc700 1 -- 172.21.15.88:0/3442990080 wait complete. 2023-12-09T02:35:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.463+0000 7f9b31f47700 1 -- 172.21.15.88:0/4231064419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b2c0fb520 msgr2=0x7f9b2c0fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.463+0000 7f9b31f47700 1 --2- 172.21.15.88:0/4231064419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b2c0fb520 0x7f9b2c0fb930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c004940 tx=0x7f9b1c009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.463+0000 7f9b31f47700 1 -- 172.21.15.88:0/4231064419 shutdown_connections 2023-12-09T02:35:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.463+0000 7f9b31f47700 1 --2- 172.21.15.88:0/4231064419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b2c0fbe70 0x7f9b2c0fc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.463+0000 7f9b31f47700 1 --2- 172.21.15.88:0/4231064419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b2c0fb520 0x7f9b2c0fb930 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.463+0000 7f9b31f47700 1 -- 172.21.15.88:0/4231064419 >> 172.21.15.88:0/4231064419 conn(0x7f9b2c0f7190 msgr2=0x7f9b2c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.463+0000 7f9b31f47700 1 -- 172.21.15.88:0/4231064419 shutdown_connections 2023-12-09T02:35:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.463+0000 7f9b31f47700 1 -- 172.21.15.88:0/4231064419 wait complete. 2023-12-09T02:35:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.463+0000 7f9b31f47700 1 Processor -- start 2023-12-09T02:35:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b31f47700 1 -- start start 2023-12-09T02:35:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b31f47700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b2c0fb520 0x7f9b2c0fdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b31f47700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b2c0fbe70 0x7f9b2c0fe020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b31f47700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0fe670 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b31f47700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0fef10 con 0x7f9b2c0fb520 2023-12-09T02:35:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b2affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b2c0fbe70 0x7f9b2c0fe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b2affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b2c0fbe70 0x7f9b2c0fe020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46784/0 (socket says 172.21.15.88:46784) 2023-12-09T02:35:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b2affd700 1 -- 172.21.15.88:0/3128348774 learned_addr learned my addr 172.21.15.88:0/3128348774 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b2b7fe700 1 --2- 172.21.15.88:0/3128348774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b2c0fb520 0x7f9b2c0fdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b2affd700 1 -- 172.21.15.88:0/3128348774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b2c0fb520 msgr2=0x7f9b2c0fdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b2affd700 1 --2- 172.21.15.88:0/3128348774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b2c0fb520 0x7f9b2c0fdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b2affd700 1 -- 172.21.15.88:0/3128348774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c005040 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b2affd700 1 --2- 172.21.15.88:0/3128348774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b2c0fbe70 0x7f9b2c0fe020 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000eb40 tx=0x7f9b2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b13fff700 1 -- 172.21.15.88:0/3128348774 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b20007cc0 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b13fff700 1 -- 172.21.15.88:0/3128348774 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b2000f040 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b31f47700 1 -- 172.21.15.88:0/3128348774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2c0ff110 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b13fff700 1 -- 172.21.15.88:0/3128348774 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b2000c990 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.464+0000 7f9b31f47700 1 -- 172.21.15.88:0/3128348774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2c0ff620 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.465+0000 7f9b31f47700 1 -- 172.21.15.88:0/3128348774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2c1096e0 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.466+0000 7f9b13fff700 1 -- 172.21.15.88:0/3128348774 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f9b2000cc00 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.466+0000 7f9b13fff700 1 --2- 172.21.15.88:0/3128348774 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f9b1406ae40 0x7f9b1406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.466+0000 7f9b13fff700 1 -- 172.21.15.88:0/3128348774 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9b20089430 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.467+0000 7f9b2b7fe700 1 --2- 172.21.15.88:0/3128348774 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f9b1406ae40 0x7f9b1406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:41.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.467+0000 7f9b2b7fe700 1 --2- 172.21.15.88:0/3128348774 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f9b1406ae40 0x7f9b1406d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c013680 tx=0x7f9b1c009e30 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:41.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.471+0000 7f9b13fff700 1 -- 172.21.15.88:0/3128348774 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f9b2004ece0 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.775+0000 7f9b31f47700 1 -- 172.21.15.88:0/3128348774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9b2c107770 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.777 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:35:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 1, 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 1 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:35:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 13, 2023-12-09T02:35:41.779 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 1 2023-12-09T02:35:41.779 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:35:41.779 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:35:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.776+0000 7f9b13fff700 1 -- 172.21.15.88:0/3128348774 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f9b20053780 con 0x7f9b2c0fbe70 2023-12-09T02:35:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.778+0000 7f9b31f47700 1 -- 172.21.15.88:0/3128348774 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f9b1406ae40 msgr2=0x7f9b1406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.778+0000 7f9b31f47700 1 --2- 172.21.15.88:0/3128348774 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f9b1406ae40 0x7f9b1406d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c013680 tx=0x7f9b1c009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.778+0000 7f9b31f47700 1 -- 172.21.15.88:0/3128348774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b2c0fbe70 msgr2=0x7f9b2c0fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.778+0000 7f9b31f47700 1 --2- 172.21.15.88:0/3128348774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b2c0fbe70 0x7f9b2c0fe020 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000eb40 tx=0x7f9b2000b040 comp rx=0 tx=0).stop 2023-12-09T02:35:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.778+0000 7f9b31f47700 1 -- 172.21.15.88:0/3128348774 shutdown_connections 2023-12-09T02:35:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.778+0000 7f9b31f47700 1 --2- 172.21.15.88:0/3128348774 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f9b1406ae40 0x7f9b1406d2f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.778+0000 7f9b31f47700 1 --2- 172.21.15.88:0/3128348774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b2c0fb520 0x7f9b2c0fdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.778+0000 7f9b31f47700 1 --2- 172.21.15.88:0/3128348774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b2c0fbe70 0x7f9b2c0fe020 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.778+0000 7f9b31f47700 1 -- 172.21.15.88:0/3128348774 >> 172.21.15.88:0/3128348774 conn(0x7f9b2c0f7190 msgr2=0x7f9b2c1043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.778+0000 7f9b31f47700 1 -- 172.21.15.88:0/3128348774 shutdown_connections 2023-12-09T02:35:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.778+0000 7f9b31f47700 1 -- 172.21.15.88:0/3128348774 wait complete. 2023-12-09T02:35:41.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:41 smithi088 ceph-mon[112028]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:41.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:41 smithi088 ceph-mon[112028]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:41.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:41 smithi088 ceph-mon[112028]: pgmap v17: 65 pgs: 65 active+clean; 1.2 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 23 MiB/s rd, 45 MiB/s wr, 368 op/s 2023-12-09T02:35:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.889+0000 7fe4dd50b700 1 -- 172.21.15.88:0/3140755811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d80fdac0 msgr2=0x7fe4d80faca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.889+0000 7fe4dd50b700 1 --2- 172.21.15.88:0/3140755811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d80fdac0 0x7fe4d80faca0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc004940 tx=0x7fe4cc009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.889+0000 7fe4dd50b700 1 -- 172.21.15.88:0/3140755811 shutdown_connections 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.889+0000 7fe4dd50b700 1 --2- 172.21.15.88:0/3140755811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d80fdac0 0x7fe4d80faca0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.889+0000 7fe4dd50b700 1 --2- 172.21.15.88:0/3140755811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4d80fd0e0 0x7fe4d80fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.889+0000 7fe4dd50b700 1 -- 172.21.15.88:0/3140755811 >> 172.21.15.88:0/3140755811 conn(0x7fe4d80f6950 msgr2=0x7fe4d80f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.889+0000 7fe4dd50b700 1 -- 172.21.15.88:0/3140755811 shutdown_connections 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.889+0000 7fe4dd50b700 1 -- 172.21.15.88:0/3140755811 wait complete. 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.889+0000 7fe4dd50b700 1 Processor -- start 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.889+0000 7fe4dd50b700 1 -- start start 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.889+0000 7fe4dd50b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4d80fd0e0 0x7fe4d810f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4dd50b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d810fc80 0x7fe4d8110b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4dd50b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d8110140 con 0x7fe4d810fc80 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4dd50b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d8110280 con 0x7fe4d80fd0e0 2023-12-09T02:35:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4d67fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d810fc80 0x7fe4d8110b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4d6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4d80fd0e0 0x7fe4d810f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4d6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4d80fd0e0 0x7fe4d810f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.88:35744/0 (socket says 172.21.15.88:35744) 2023-12-09T02:35:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4d6ffd700 1 -- 172.21.15.88:0/2662368445 learned_addr learned my addr 172.21.15.88:0/2662368445 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4d67fc700 1 -- 172.21.15.88:0/2662368445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4d80fd0e0 msgr2=0x7fe4d810f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4d67fc700 1 --2- 172.21.15.88:0/2662368445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4d80fd0e0 0x7fe4d810f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4d67fc700 1 -- 172.21.15.88:0/2662368445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc005040 con 0x7fe4d810fc80 2023-12-09T02:35:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4d67fc700 1 --2- 172.21.15.88:0/2662368445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d810fc80 0x7fe4d8110b20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00b0d0 tx=0x7fe4cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4bf7fe700 1 -- 172.21.15.88:0/2662368445 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4cc00e070 con 0x7fe4d810fc80 2023-12-09T02:35:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4dd50b700 1 -- 172.21.15.88:0/2662368445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d8111120 con 0x7fe4d810fc80 2023-12-09T02:35:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4bf7fe700 1 -- 172.21.15.88:0/2662368445 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe4cc01c400 con 0x7fe4d810fc80 2023-12-09T02:35:41.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4bf7fe700 1 -- 172.21.15.88:0/2662368445 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4cc00b650 con 0x7fe4d810fc80 2023-12-09T02:35:41.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.890+0000 7fe4dd50b700 1 -- 172.21.15.88:0/2662368445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d81115d0 con 0x7fe4d810fc80 2023-12-09T02:35:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.891+0000 7fe4dd50b700 1 -- 172.21.15.88:0/2662368445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d804bb80 con 0x7fe4d810fc80 2023-12-09T02:35:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.892+0000 7fe4bf7fe700 1 -- 172.21.15.88:0/2662368445 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fe4cc01ca00 con 0x7fe4d810fc80 2023-12-09T02:35:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.892+0000 7fe4bf7fe700 1 --2- 172.21.15.88:0/2662368445 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fe4c006ae40 0x7fe4c006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.892+0000 7fe4bf7fe700 1 -- 172.21.15.88:0/2662368445 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe4cc08a980 con 0x7fe4d810fc80 2023-12-09T02:35:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.892+0000 7fe4d6ffd700 1 --2- 172.21.15.88:0/2662368445 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fe4c006ae40 0x7fe4c006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.893+0000 7fe4d6ffd700 1 --2- 172.21.15.88:0/2662368445 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fe4c006ae40 0x7fe4c006d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8008fd0 tx=0x7fe4c800b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:41.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:41.897+0000 7fe4bf7fe700 1 -- 172.21.15.88:0/2662368445 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe4cc0587f0 con 0x7fe4d810fc80 2023-12-09T02:35:42.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:41 smithi161 ceph-mon[121170]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:42.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:41 smithi161 ceph-mon[121170]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:42.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:41 smithi161 ceph-mon[121170]: pgmap v17: 65 pgs: 65 active+clean; 1.2 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 23 MiB/s rd, 45 MiB/s wr, 368 op/s 2023-12-09T02:35:42.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.184+0000 7fe4dd50b700 1 -- 172.21.15.88:0/2662368445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe4d8111840 con 0x7fe4d810fc80 2023-12-09T02:35:42.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.185+0000 7fe4bf7fe700 1 -- 172.21.15.88:0/2662368445 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1810 (secure 0 0 0) 0x7fe4cc004490 con 0x7fe4d810fc80 2023-12-09T02:35:42.186 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:35:42.187 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:35:42.188 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:35:42.189 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:35:42.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:35:42.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:35:42.189 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:35:42.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:35:42.189 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:35:42.189 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:35:42.189 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:35:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.187+0000 7fe4dd50b700 1 -- 172.21.15.88:0/2662368445 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fe4c006ae40 msgr2=0x7fe4c006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.187+0000 7fe4dd50b700 1 --2- 172.21.15.88:0/2662368445 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fe4c006ae40 0x7fe4c006d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8008fd0 tx=0x7fe4c800b040 comp rx=0 tx=0).stop 2023-12-09T02:35:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.187+0000 7fe4dd50b700 1 -- 172.21.15.88:0/2662368445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d810fc80 msgr2=0x7fe4d8110b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.187+0000 7fe4dd50b700 1 --2- 172.21.15.88:0/2662368445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d810fc80 0x7fe4d8110b20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00b0d0 tx=0x7fe4cc009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.187+0000 7fe4dd50b700 1 -- 172.21.15.88:0/2662368445 shutdown_connections 2023-12-09T02:35:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.187+0000 7fe4dd50b700 1 --2- 172.21.15.88:0/2662368445 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fe4c006ae40 0x7fe4c006d2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.187+0000 7fe4dd50b700 1 --2- 172.21.15.88:0/2662368445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4d80fd0e0 0x7fe4d810f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.187+0000 7fe4dd50b700 1 --2- 172.21.15.88:0/2662368445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d810fc80 0x7fe4d8110b20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.187+0000 7fe4dd50b700 1 -- 172.21.15.88:0/2662368445 >> 172.21.15.88:0/2662368445 conn(0x7fe4d80f6950 msgr2=0x7fe4d8104380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.187+0000 7fe4dd50b700 1 -- 172.21.15.88:0/2662368445 shutdown_connections 2023-12-09T02:35:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.187+0000 7fe4dd50b700 1 -- 172.21.15.88:0/2662368445 wait complete. 2023-12-09T02:35:42.191 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:35:42.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.305+0000 7fa32ee3f700 1 -- 172.21.15.88:0/756474097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3280ffdd0 msgr2=0x7fa3281021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:42.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.305+0000 7fa32ee3f700 1 --2- 172.21.15.88:0/756474097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3280ffdd0 0x7fa3281021d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa314004940 tx=0x7fa314009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:42.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.305+0000 7fa32ee3f700 1 -- 172.21.15.88:0/756474097 shutdown_connections 2023-12-09T02:35:42.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.305+0000 7fa32ee3f700 1 --2- 172.21.15.88:0/756474097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3280ffdd0 0x7fa3281021d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.305+0000 7fa32ee3f700 1 --2- 172.21.15.88:0/756474097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa328066030 0x7fa3280ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.305+0000 7fa32ee3f700 1 -- 172.21.15.88:0/756474097 >> 172.21.15.88:0/756474097 conn(0x7fa3280f7190 msgr2=0x7fa3280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:42.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.305+0000 7fa32ee3f700 1 -- 172.21.15.88:0/756474097 shutdown_connections 2023-12-09T02:35:42.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.305+0000 7fa32ee3f700 1 -- 172.21.15.88:0/756474097 wait complete. 2023-12-09T02:35:42.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.306+0000 7fa32ee3f700 1 Processor -- start 2023-12-09T02:35:42.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.306+0000 7fa32ee3f700 1 -- start start 2023-12-09T02:35:42.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.306+0000 7fa32ee3f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa328066030 0x7fa3280fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:42.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.306+0000 7fa32ee3f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3280ffdd0 0x7fa3280fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:42.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.306+0000 7fa32ee3f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280fbd00 con 0x7fa3280ffdd0 2023-12-09T02:35:42.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.306+0000 7fa32ee3f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280fbe70 con 0x7fa328066030 2023-12-09T02:35:42.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.307+0000 7fa32cbdb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa328066030 0x7fa3280fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:42.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.307+0000 7fa327fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3280ffdd0 0x7fa3280fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:42.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.307+0000 7fa32cbdb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa328066030 0x7fa3280fd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.88:35760/0 (socket says 172.21.15.88:35760) 2023-12-09T02:35:42.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.307+0000 7fa32cbdb700 1 -- 172.21.15.88:0/4237012373 learned_addr learned my addr 172.21.15.88:0/4237012373 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:42.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.307+0000 7fa327fff700 1 -- 172.21.15.88:0/4237012373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa328066030 msgr2=0x7fa3280fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:42.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.307+0000 7fa327fff700 1 --2- 172.21.15.88:0/4237012373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa328066030 0x7fa3280fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.307+0000 7fa327fff700 1 -- 172.21.15.88:0/4237012373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa314005040 con 0x7fa3280ffdd0 2023-12-09T02:35:42.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.307+0000 7fa32cbdb700 1 --2- 172.21.15.88:0/4237012373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa328066030 0x7fa3280fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-09T02:35:42.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.307+0000 7fa327fff700 1 --2- 172.21.15.88:0/4237012373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3280ffdd0 0x7fa3280fb700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa31400b0d0 tx=0x7fa314009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:42.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.307+0000 7fa3257fa700 1 -- 172.21.15.88:0/4237012373 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa31400e070 con 0x7fa3280ffdd0 2023-12-09T02:35:42.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.307+0000 7fa32ee3f700 1 -- 172.21.15.88:0/4237012373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3280fc0f0 con 0x7fa3280ffdd0 2023-12-09T02:35:42.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.308+0000 7fa3257fa700 1 -- 172.21.15.88:0/4237012373 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa31400b410 con 0x7fa3280ffdd0 2023-12-09T02:35:42.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.308+0000 7fa3257fa700 1 -- 172.21.15.88:0/4237012373 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa314012600 con 0x7fa3280ffdd0 2023-12-09T02:35:42.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.308+0000 7fa32ee3f700 1 -- 172.21.15.88:0/4237012373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa328115510 con 0x7fa3280ffdd0 2023-12-09T02:35:42.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.309+0000 7fa32ee3f700 1 -- 172.21.15.88:0/4237012373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30c0052e0 con 0x7fa3280ffdd0 2023-12-09T02:35:42.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.309+0000 7fa3257fa700 1 -- 172.21.15.88:0/4237012373 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fa314012870 con 0x7fa3280ffdd0 2023-12-09T02:35:42.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.309+0000 7fa3257fa700 1 --2- 172.21.15.88:0/4237012373 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fa31806ae40 0x7fa31806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:42.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.310+0000 7fa3257fa700 1 -- 172.21.15.88:0/4237012373 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa31408a0e0 con 0x7fa3280ffdd0 2023-12-09T02:35:42.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.310+0000 7fa32cbdb700 1 --2- 172.21.15.88:0/4237012373 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fa31806ae40 0x7fa31806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:42.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.310+0000 7fa32cbdb700 1 --2- 172.21.15.88:0/4237012373 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fa31806ae40 0x7fa31806d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa31c004fd0 tx=0x7fa31c00b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:42.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.318+0000 7fa3257fa700 1 -- 172.21.15.88:0/4237012373 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa314057fc0 con 0x7fa3280ffdd0 2023-12-09T02:35:42.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.561+0000 7fa32ee3f700 1 -- 172.21.15.88:0/4237012373 --> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa30c000bf0 con 0x7fa31806ae40 2023-12-09T02:35:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.563+0000 7fa3257fa700 1 -- 172.21.15.88:0/4237012373 <== mgr.24377 v2:172.21.15.161:6828/1447919242 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa30c000bf0 con 0x7fa31806ae40 2023-12-09T02:35:42.565 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:35:42.565 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:35:42.565 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:35:42.565 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:35:42.565 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2023-12-09T02:35:42.565 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "1/21 daemons upgraded", 2023-12-09T02:35:42.565 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2023-12-09T02:35:42.566 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:35:42.566 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:35:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.565+0000 7fa32ee3f700 1 -- 172.21.15.88:0/4237012373 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fa31806ae40 msgr2=0x7fa31806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.565+0000 7fa32ee3f700 1 --2- 172.21.15.88:0/4237012373 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fa31806ae40 0x7fa31806d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa31c004fd0 tx=0x7fa31c00b040 comp rx=0 tx=0).stop 2023-12-09T02:35:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.565+0000 7fa32ee3f700 1 -- 172.21.15.88:0/4237012373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3280ffdd0 msgr2=0x7fa3280fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.565+0000 7fa32ee3f700 1 --2- 172.21.15.88:0/4237012373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3280ffdd0 0x7fa3280fb700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa31400b0d0 tx=0x7fa314009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.565+0000 7fa32ee3f700 1 -- 172.21.15.88:0/4237012373 shutdown_connections 2023-12-09T02:35:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.565+0000 7fa32ee3f700 1 --2- 172.21.15.88:0/4237012373 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7fa31806ae40 0x7fa31806d2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.565+0000 7fa32ee3f700 1 --2- 172.21.15.88:0/4237012373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa328066030 0x7fa3280fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.565+0000 7fa32ee3f700 1 --2- 172.21.15.88:0/4237012373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3280ffdd0 0x7fa3280fb700 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.565+0000 7fa32ee3f700 1 -- 172.21.15.88:0/4237012373 >> 172.21.15.88:0/4237012373 conn(0x7fa3280f7190 msgr2=0x7fa3280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.565+0000 7fa32ee3f700 1 -- 172.21.15.88:0/4237012373 shutdown_connections 2023-12-09T02:35:42.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.565+0000 7fa32ee3f700 1 -- 172.21.15.88:0/4237012373 wait complete. 2023-12-09T02:35:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.672+0000 7f1017672700 1 -- 172.21.15.88:0/2560025233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100fbaf0 msgr2=0x7f10100fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.672+0000 7f1017672700 1 --2- 172.21.15.88:0/2560025233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100fbaf0 0x7f10100fbf00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f100c004940 tx=0x7f100c009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.672+0000 7f1017672700 1 -- 172.21.15.88:0/2560025233 shutdown_connections 2023-12-09T02:35:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.672+0000 7f1017672700 1 --2- 172.21.15.88:0/2560025233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100fcd00 0x7f10100fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.672+0000 7f1017672700 1 --2- 172.21.15.88:0/2560025233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100fbaf0 0x7f10100fbf00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.672+0000 7f1017672700 1 -- 172.21.15.88:0/2560025233 >> 172.21.15.88:0/2560025233 conn(0x7f10100f7190 msgr2=0x7f10100f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.673+0000 7f1017672700 1 -- 172.21.15.88:0/2560025233 shutdown_connections 2023-12-09T02:35:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.673+0000 7f1017672700 1 -- 172.21.15.88:0/2560025233 wait complete. 2023-12-09T02:35:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.673+0000 7f1017672700 1 Processor -- start 2023-12-09T02:35:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.673+0000 7f1017672700 1 -- start start 2023-12-09T02:35:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f1017672700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100fbaf0 0x7f101010c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f1017672700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100fcd00 0x7f101010c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f1017672700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101010cf30 con 0x7f10100fcd00 2023-12-09T02:35:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f1017672700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101010d7d0 con 0x7f10100fbaf0 2023-12-09T02:35:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f101540e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100fbaf0 0x7f101010c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f1014c0d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100fcd00 0x7f101010c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f101540e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100fbaf0 0x7f101010c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.88:35778/0 (socket says 172.21.15.88:35778) 2023-12-09T02:35:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f101540e700 1 -- 172.21.15.88:0/971364393 learned_addr learned my addr 172.21.15.88:0/971364393 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:35:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f1014c0d700 1 -- 172.21.15.88:0/971364393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100fbaf0 msgr2=0x7f101010c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f1014c0d700 1 --2- 172.21.15.88:0/971364393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100fbaf0 0x7f101010c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f1014c0d700 1 -- 172.21.15.88:0/971364393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c005040 con 0x7f10100fcd00 2023-12-09T02:35:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.674+0000 7f1014c0d700 1 --2- 172.21.15.88:0/971364393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100fcd00 0x7f101010c930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1000009fd0 tx=0x7f100000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.675+0000 7f1005ffb700 1 -- 172.21.15.88:0/971364393 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1000004e90 con 0x7f10100fcd00 2023-12-09T02:35:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.675+0000 7f1005ffb700 1 -- 172.21.15.88:0/971364393 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f100000f040 con 0x7f10100fcd00 2023-12-09T02:35:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.675+0000 7f1017672700 1 -- 172.21.15.88:0/971364393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101010da50 con 0x7f10100fcd00 2023-12-09T02:35:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.675+0000 7f1005ffb700 1 -- 172.21.15.88:0/971364393 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f100000c9b0 con 0x7f10100fcd00 2023-12-09T02:35:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.675+0000 7f1017672700 1 -- 172.21.15.88:0/971364393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101010df90 con 0x7f10100fcd00 2023-12-09T02:35:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.676+0000 7f1017672700 1 -- 172.21.15.88:0/971364393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101004bb80 con 0x7f10100fcd00 2023-12-09T02:35:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.677+0000 7f1005ffb700 1 -- 172.21.15.88:0/971364393 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f1000007cc0 con 0x7f10100fcd00 2023-12-09T02:35:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.678+0000 7f1005ffb700 1 --2- 172.21.15.88:0/971364393 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f0ffc06af10 0x7f0ffc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:35:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.678+0000 7f1005ffb700 1 -- 172.21.15.88:0/971364393 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1000089480 con 0x7f10100fcd00 2023-12-09T02:35:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.678+0000 7f101540e700 1 --2- 172.21.15.88:0/971364393 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f0ffc06af10 0x7f0ffc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:35:42.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.678+0000 7f101540e700 1 --2- 172.21.15.88:0/971364393 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f0ffc06af10 0x7f0ffc06d3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f100c013680 tx=0x7f100c009e30 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:35:42.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.681+0000 7f1005ffb700 1 -- 172.21.15.88:0/971364393 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f10000572e0 con 0x7f10100fcd00 2023-12-09T02:35:42.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:42 smithi088 ceph-mon[112028]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:42.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:42 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3128348774' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:35:42.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:42 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/2662368445' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:35:42.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:42 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:42.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:42 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.987+0000 7f1017672700 1 -- 172.21.15.88:0/971364393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1010104490 con 0x7f10100fcd00 2023-12-09T02:35:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.988+0000 7f1005ffb700 1 -- 172.21.15.88:0/971364393 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1000056e70 con 0x7f10100fcd00 2023-12-09T02:35:42.989 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:35:42.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.990+0000 7f1017672700 1 -- 172.21.15.88:0/971364393 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f0ffc06af10 msgr2=0x7f0ffc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:42.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.990+0000 7f1017672700 1 --2- 172.21.15.88:0/971364393 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f0ffc06af10 0x7f0ffc06d3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f100c013680 tx=0x7f100c009e30 comp rx=0 tx=0).stop 2023-12-09T02:35:42.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.990+0000 7f1017672700 1 -- 172.21.15.88:0/971364393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100fcd00 msgr2=0x7f101010c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:35:42.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.990+0000 7f1017672700 1 --2- 172.21.15.88:0/971364393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100fcd00 0x7f101010c930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1000009fd0 tx=0x7f100000b040 comp rx=0 tx=0).stop 2023-12-09T02:35:42.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.990+0000 7f1017672700 1 -- 172.21.15.88:0/971364393 shutdown_connections 2023-12-09T02:35:42.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.990+0000 7f1017672700 1 --2- 172.21.15.88:0/971364393 >> [v2:172.21.15.161:6828/1447919242,v1:172.21.15.161:6829/1447919242] conn(0x7f0ffc06af10 0x7f0ffc06d3c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.990+0000 7f1017672700 1 --2- 172.21.15.88:0/971364393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100fbaf0 0x7f101010c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.990+0000 7f1017672700 1 --2- 172.21.15.88:0/971364393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100fcd00 0x7f101010c930 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:35:42.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.990+0000 7f1017672700 1 -- 172.21.15.88:0/971364393 >> 172.21.15.88:0/971364393 conn(0x7f10100f7190 msgr2=0x7f10100fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:35:42.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.990+0000 7f1017672700 1 -- 172.21.15.88:0/971364393 shutdown_connections 2023-12-09T02:35:42.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:35:42.990+0000 7f1017672700 1 -- 172.21.15.88:0/971364393 wait complete. 2023-12-09T02:35:43.127 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:42 smithi161 ceph-mon[121170]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:43.127 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:42 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3128348774' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:35:43.127 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:42 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/2662368445' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:35:43.127 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:42 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:43.127 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:42 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:43.877 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:43 smithi161 ceph-mon[121170]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:43.877 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:43 smithi161 ceph-mon[121170]: Reconfiguring node-exporter.smithi161 (dependencies changed)... 2023-12-09T02:35:43.877 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:43 smithi161 ceph-mon[121170]: Reconfiguring daemon node-exporter.smithi161 on smithi161 2023-12-09T02:35:43.877 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:43 smithi161 ceph-mon[121170]: pgmap v18: 65 pgs: 65 active+clean; 1.2 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 579 KiB/s rd, 5.6 MiB/s wr, 242 op/s 2023-12-09T02:35:43.877 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:43 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/971364393' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:35:43.877 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:43 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:35:44.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:43 smithi088 ceph-mon[112028]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:35:44.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:43 smithi088 ceph-mon[112028]: Reconfiguring node-exporter.smithi161 (dependencies changed)... 2023-12-09T02:35:44.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:43 smithi088 ceph-mon[112028]: Reconfiguring daemon node-exporter.smithi161 on smithi161 2023-12-09T02:35:44.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:43 smithi088 ceph-mon[112028]: pgmap v18: 65 pgs: 65 active+clean; 1.2 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 579 KiB/s rd, 5.6 MiB/s wr, 242 op/s 2023-12-09T02:35:44.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:43 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/971364393' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:35:44.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:43 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:35:45.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:45.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-09T02:35:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-09T02:35:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-09T02:35:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-09T02:35:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:35:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:35:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: Upgrade: Need to upgrade myself (mgr.smithi161.qmxtmg) 2023-12-09T02:35:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: Upgrade: Need to upgrade myself (mgr.smithi161.qmxtmg) 2023-12-09T02:35:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:45 smithi088 ceph-mon[112028]: pgmap v19: 65 pgs: 65 active+clean; 845 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 592 KiB/s rd, 6.4 MiB/s wr, 375 op/s 2023-12-09T02:35:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-09T02:35:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-09T02:35:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-09T02:35:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-09T02:35:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:35:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:35:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: Upgrade: Need to upgrade myself (mgr.smithi161.qmxtmg) 2023-12-09T02:35:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: Upgrade: Need to upgrade myself (mgr.smithi161.qmxtmg) 2023-12-09T02:35:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:45 smithi161 ceph-mon[121170]: pgmap v19: 65 pgs: 65 active+clean; 845 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 592 KiB/s rd, 6.4 MiB/s wr, 375 op/s 2023-12-09T02:35:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:46 smithi161 ceph-mon[121170]: Upgrade: Updating mgr.smithi088.jwlofb 2023-12-09T02:35:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:46 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:46 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.jwlofb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:35:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:46 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.jwlofb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:35:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:46 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:35:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:46 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:35:46.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:46 smithi161 ceph-mon[121170]: Deploying daemon mgr.smithi088.jwlofb on smithi088 2023-12-09T02:35:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:46 smithi088 ceph-mon[112028]: Upgrade: Updating mgr.smithi088.jwlofb 2023-12-09T02:35:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:46 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:46 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.jwlofb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:35:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:46 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.jwlofb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:35:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:46 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:35:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:46 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:35:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:46 smithi088 ceph-mon[112028]: Deploying daemon mgr.smithi088.jwlofb on smithi088 2023-12-09T02:35:47.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:47 smithi088 ceph-mon[112028]: pgmap v20: 65 pgs: 65 active+clean; 845 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 270 op/s 2023-12-09T02:35:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:47 smithi161 ceph-mon[121170]: pgmap v20: 65 pgs: 65 active+clean; 845 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 270 op/s 2023-12-09T02:35:49.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:48 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:49.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:48 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:49.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:48 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:49.195 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:48 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:49.196 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:48 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:49.196 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:48 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:50.021 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-09T02:35:50.022 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-09T02:35:50.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:49 smithi088 ceph-mon[112028]: pgmap v21: 65 pgs: 65 active+clean; 788 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 288 op/s 2023-12-09T02:35:50.249 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:49 smithi161 ceph-mon[121170]: pgmap v21: 65 pgs: 65 active+clean; 788 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 288 op/s 2023-12-09T02:35:52.182 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:51 smithi088 ceph-mon[112028]: pgmap v22: 65 pgs: 65 active+clean; 503 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 21 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-12-09T02:35:52.182 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:51 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:52.183 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:51 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:52.183 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:51 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:52.183 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:51 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:52.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:51 smithi161 ceph-mon[121170]: pgmap v22: 65 pgs: 65 active+clean; 503 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 21 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-12-09T02:35:52.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:51 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:52.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:51 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:52.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:51 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:52.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:51 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:53 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:53 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:53 smithi161 ceph-mon[121170]: pgmap v23: 65 pgs: 65 active+clean; 503 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 21 KiB/s rd, 1.7 MiB/s wr, 191 op/s 2023-12-09T02:35:53.451 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:53 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:53.451 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:53 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:53.451 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:53 smithi088 ceph-mon[112028]: pgmap v23: 65 pgs: 65 active+clean; 503 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 21 KiB/s rd, 1.7 MiB/s wr, 191 op/s 2023-12-09T02:35:56.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: pgmap v24: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 2.6 MiB/s wr, 333 op/s 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mgr fail", "who": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mgr fail", "who": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: osdmap e48: 6 total, 6 up, 6 in 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd='[{"prefix": "mgr fail", "who": "smithi161.qmxtmg"}]': finished 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: mgrmap e26: smithi088.jwlofb(active, starting, since 0.0054693s) 2023-12-09T02:35:56.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: Active manager daemon smithi088.jwlofb restarted 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: Activating manager daemon smithi088.jwlofb 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: osdmap e49: 6 total, 6 up, 6 in 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: mgrmap e27: smithi088.jwlofb(active, starting, since 0.00540808s) 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.jwlofb/crt"}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.jwlofb/crt"}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.zfojux"}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.utskxh"}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.dhvdif"}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.posrbq"}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi088.jwlofb", "id": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:35:56.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.jwlofb/key"}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: Manager daemon smithi088.jwlofb is now available 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:35:56.173 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:55 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/trash_purge_schedule"}]: dispatch 2023-12-09T02:35:56.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: pgmap v24: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 2.6 MiB/s wr, 333 op/s 2023-12-09T02:35:56.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:56.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:56.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:35:56.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:35:56.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' 2023-12-09T02:35:56.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:56.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.24377 172.21.15.161:0/3373707642' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mgr fail", "who": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:35:56.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "mgr fail", "who": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: osdmap e48: 6 total, 6 up, 6 in 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.24377 ' entity='mgr.smithi161.qmxtmg' cmd='[{"prefix": "mgr fail", "who": "smithi161.qmxtmg"}]': finished 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: mgrmap e26: smithi088.jwlofb(active, starting, since 0.0054693s) 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: Active manager daemon smithi088.jwlofb restarted 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: Activating manager daemon smithi088.jwlofb 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: osdmap e49: 6 total, 6 up, 6 in 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: mgrmap e27: smithi088.jwlofb(active, starting, since 0.00540808s) 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.jwlofb/crt"}]: dispatch 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.jwlofb/crt"}]: dispatch 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.zfojux"}]: dispatch 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.utskxh"}]: dispatch 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.dhvdif"}]: dispatch 2023-12-09T02:35:56.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.posrbq"}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi088.jwlofb", "id": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.jwlofb/key"}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:35:56.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: Manager daemon smithi088.jwlofb is now available 2023-12-09T02:35:56.230 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:56.230 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:35:56.230 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:35:56.230 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:35:56.230 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:55 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/trash_purge_schedule"}]: dispatch 2023-12-09T02:35:57.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:57 smithi161 ceph-mon[121170]: [09/Dec/2023:02:35:56] ENGINE Bus STARTING 2023-12-09T02:35:57.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:57 smithi161 ceph-mon[121170]: mgrmap e28: smithi088.jwlofb(active, since 1.00847s) 2023-12-09T02:35:57.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:57 smithi161 ceph-mon[121170]: pgmap v3: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:35:57.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:57 smithi161 ceph-mon[121170]: [09/Dec/2023:02:35:56] ENGINE Serving on https://172.21.15.88:7150 2023-12-09T02:35:57.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:57 smithi161 ceph-mon[121170]: [09/Dec/2023:02:35:56] ENGINE Serving on http://172.21.15.88:8765 2023-12-09T02:35:57.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:57 smithi161 ceph-mon[121170]: [09/Dec/2023:02:35:56] ENGINE Bus STARTED 2023-12-09T02:35:57.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:57 smithi088 ceph-mon[112028]: [09/Dec/2023:02:35:56] ENGINE Bus STARTING 2023-12-09T02:35:57.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:57 smithi088 ceph-mon[112028]: mgrmap e28: smithi088.jwlofb(active, since 1.00847s) 2023-12-09T02:35:57.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:57 smithi088 ceph-mon[112028]: pgmap v3: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:35:57.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:57 smithi088 ceph-mon[112028]: [09/Dec/2023:02:35:56] ENGINE Serving on https://172.21.15.88:7150 2023-12-09T02:35:57.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:57 smithi088 ceph-mon[112028]: [09/Dec/2023:02:35:56] ENGINE Serving on http://172.21.15.88:8765 2023-12-09T02:35:57.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:57 smithi088 ceph-mon[112028]: [09/Dec/2023:02:35:56] ENGINE Bus STARTED 2023-12-09T02:35:58.572 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:58 smithi161 ceph-mon[121170]: pgmap v4: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:35:58.572 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:58 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:58.572 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:58 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:58.662 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:58 smithi088 ceph-mon[112028]: pgmap v4: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:35:58.662 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:58 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:58.662 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:58 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:59.911 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:59 smithi161 ceph-mon[121170]: mgrmap e29: smithi088.jwlofb(active, since 3s) 2023-12-09T02:35:59.912 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:59 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:59.912 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:59 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:59.912 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:59 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:59.912 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:35:59 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:59 smithi088 ceph-mon[112028]: mgrmap e29: smithi088.jwlofb(active, since 3s) 2023-12-09T02:35:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:59 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:59 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:59 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:35:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:35:59 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:00.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:00 smithi088 ceph-mon[112028]: pgmap v5: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:36:00.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:00 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:00.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:00 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:00.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:00 smithi088 ceph-mon[112028]: mgrmap e30: smithi088.jwlofb(active, since 4s) 2023-12-09T02:36:00.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:00 smithi161 ceph-mon[121170]: pgmap v5: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:36:00.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:00 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:00.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:00 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:00.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:00 smithi161 ceph-mon[121170]: mgrmap e30: smithi088.jwlofb(active, since 4s) 2023-12-09T02:36:02.579 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:02 smithi161 ceph-mon[121170]: pgmap v6: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:36:02.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:02 smithi088 ceph-mon[112028]: pgmap v6: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:36:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:04 smithi088 ceph-mon[112028]: pgmap v7: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.3 MiB/s wr, 267 op/s 2023-12-09T02:36:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:04 smithi088 ceph-mon[112028]: Standby manager daemon smithi161.qmxtmg started 2023-12-09T02:36:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:04 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/1008556940' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/crt"}]: dispatch 2023-12-09T02:36:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:04 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/1008556940' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:36:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:04 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/1008556940' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/key"}]: dispatch 2023-12-09T02:36:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:04 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/1008556940' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:36:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:04 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:04 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:04 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:04.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:04 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:36:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:04 smithi161 ceph-mon[121170]: pgmap v7: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.3 MiB/s wr, 267 op/s 2023-12-09T02:36:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:04 smithi161 ceph-mon[121170]: Standby manager daemon smithi161.qmxtmg started 2023-12-09T02:36:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:04 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/1008556940' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/crt"}]: dispatch 2023-12-09T02:36:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:04 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/1008556940' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:36:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:04 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/1008556940' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/key"}]: dispatch 2023-12-09T02:36:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:04 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/1008556940' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:36:05.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:04 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:05.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:04 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:05.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:04 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:05.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:04 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:36:06.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:05 smithi161 ceph-mon[121170]: Updating smithi088:/etc/ceph/ceph.conf 2023-12-09T02:36:06.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:05 smithi161 ceph-mon[121170]: Updating smithi161:/etc/ceph/ceph.conf 2023-12-09T02:36:06.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:05 smithi161 ceph-mon[121170]: mgrmap e31: smithi088.jwlofb(active, since 9s), standbys: smithi161.qmxtmg 2023-12-09T02:36:06.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:05 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi161.qmxtmg", "id": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:36:06.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:05 smithi088 ceph-mon[112028]: Updating smithi088:/etc/ceph/ceph.conf 2023-12-09T02:36:06.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:05 smithi088 ceph-mon[112028]: Updating smithi161:/etc/ceph/ceph.conf 2023-12-09T02:36:06.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:05 smithi088 ceph-mon[112028]: mgrmap e31: smithi088.jwlofb(active, since 9s), standbys: smithi161.qmxtmg 2023-12-09T02:36:06.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:05 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi161.qmxtmg", "id": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:36:07.072 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:36:07.072 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:36:07.072 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:36:07.073 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:36:07.073 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:36:07.073 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: pgmap v8: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.0 MiB/s wr, 208 op/s 2023-12-09T02:36:07.073 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:36:07.073 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:07.073 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:07.073 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:07.073 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:07.073 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:06 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:07.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:36:07.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:36:07.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:36:07.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:36:07.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:36:07.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: pgmap v8: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.0 MiB/s wr, 208 op/s 2023-12-09T02:36:07.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:36:07.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:07.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:07.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:07.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:07.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:06 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:07.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:07 smithi088 ceph-mon[112028]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2023-12-09T02:36:07.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:07 smithi088 ceph-mon[112028]: Reconfiguring daemon prometheus.smithi088 on smithi088 2023-12-09T02:36:08.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:07 smithi161 ceph-mon[121170]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2023-12-09T02:36:08.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:07 smithi161 ceph-mon[121170]: Reconfiguring daemon prometheus.smithi088 on smithi088 2023-12-09T02:36:08.827 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:08 smithi088 ceph-mon[112028]: pgmap v9: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.7 MiB/s wr, 367 op/s 2023-12-09T02:36:09.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:08 smithi161 ceph-mon[121170]: pgmap v9: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.7 MiB/s wr, 367 op/s 2023-12-09T02:36:10.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:10 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:10.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:10 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:10.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:10 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:36:10.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:10 smithi161 ceph-mon[121170]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:36:10.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:10 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:10.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:10 smithi161 ceph-mon[121170]: pgmap v10: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 336 op/s 2023-12-09T02:36:10.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:10 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:10.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:10 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:10.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:10 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:36:10.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:10 smithi088 ceph-mon[112028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-09T02:36:10.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:10 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:10.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:10 smithi088 ceph-mon[112028]: pgmap v10: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 336 op/s 2023-12-09T02:36:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:11 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:36:11.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:11 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:36:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:12 smithi161 ceph-mon[121170]: pgmap v11: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 336 op/s 2023-12-09T02:36:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:12 smithi161 ceph-mon[121170]: Upgrade: Updating mgr.smithi161.qmxtmg 2023-12-09T02:36:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:12 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:36:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:12 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:36:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:12 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:12.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:12 smithi161 ceph-mon[121170]: Deploying daemon mgr.smithi161.qmxtmg on smithi161 2023-12-09T02:36:12.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:12 smithi088 ceph-mon[112028]: pgmap v11: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 336 op/s 2023-12-09T02:36:12.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:12 smithi088 ceph-mon[112028]: Upgrade: Updating mgr.smithi161.qmxtmg 2023-12-09T02:36:12.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:12 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:36:12.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:12 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:36:12.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:12 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:12.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:12 smithi088 ceph-mon[112028]: Deploying daemon mgr.smithi161.qmxtmg on smithi161 2023-12-09T02:36:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.095+0000 7fa0df147700 1 -- 172.21.15.88:0/4153823483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d8066070 msgr2=0x7fa0d8101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.095+0000 7fa0df147700 1 --2- 172.21.15.88:0/4153823483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d8066070 0x7fa0d8101bc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc004940 tx=0x7fa0cc009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.095+0000 7fa0df147700 1 -- 172.21.15.88:0/4153823483 shutdown_connections 2023-12-09T02:36:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.095+0000 7fa0df147700 1 --2- 172.21.15.88:0/4153823483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0d8102100 0x7fa0d81044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.095+0000 7fa0df147700 1 --2- 172.21.15.88:0/4153823483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d8066070 0x7fa0d8101bc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.095+0000 7fa0df147700 1 -- 172.21.15.88:0/4153823483 >> 172.21.15.88:0/4153823483 conn(0x7fa0d80f7190 msgr2=0x7fa0d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.095+0000 7fa0df147700 1 -- 172.21.15.88:0/4153823483 shutdown_connections 2023-12-09T02:36:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.095+0000 7fa0df147700 1 -- 172.21.15.88:0/4153823483 wait complete. 2023-12-09T02:36:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.095+0000 7fa0df147700 1 Processor -- start 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.095+0000 7fa0df147700 1 -- start start 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0df147700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0d8066070 0x7fa0d810f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0df147700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d8102100 0x7fa0d810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0df147700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8110230 con 0x7fa0d8102100 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0df147700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8110ad0 con 0x7fa0d8066070 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0d7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d8102100 0x7fa0d810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0d7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d8102100 0x7fa0d810fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57252/0 (socket says 172.21.15.88:57252) 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0d7fff700 1 -- 172.21.15.88:0/2461545110 learned_addr learned my addr 172.21.15.88:0/2461545110 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0dcee3700 1 --2- 172.21.15.88:0/2461545110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0d8066070 0x7fa0d810f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0d7fff700 1 -- 172.21.15.88:0/2461545110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0d8066070 msgr2=0x7fa0d810f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0d7fff700 1 --2- 172.21.15.88:0/2461545110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0d8066070 0x7fa0d810f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0d7fff700 1 -- 172.21.15.88:0/2461545110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc005040 con 0x7fa0d8102100 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0d7fff700 1 --2- 172.21.15.88:0/2461545110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d8102100 0x7fa0d810fc30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4002350 tx=0x7fa0c40139a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0d57fa700 1 -- 172.21.15.88:0/2461545110 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c4018070 con 0x7fa0d8102100 2023-12-09T02:36:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0d57fa700 1 -- 172.21.15.88:0/2461545110 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa0c4007c90 con 0x7fa0d8102100 2023-12-09T02:36:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0df147700 1 -- 172.21.15.88:0/2461545110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d8110d50 con 0x7fa0d8102100 2023-12-09T02:36:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.096+0000 7fa0d57fa700 1 -- 172.21.15.88:0/2461545110 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c401c770 con 0x7fa0d8102100 2023-12-09T02:36:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.097+0000 7fa0df147700 1 -- 172.21.15.88:0/2461545110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d8111290 con 0x7fa0d8102100 2023-12-09T02:36:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.097+0000 7fa0df147700 1 -- 172.21.15.88:0/2461545110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d804bb80 con 0x7fa0d8102100 2023-12-09T02:36:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.098+0000 7fa0d57fa700 1 -- 172.21.15.88:0/2461545110 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fa0c4026440 con 0x7fa0d8102100 2023-12-09T02:36:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.098+0000 7fa0d57fa700 1 --2- 172.21.15.88:0/2461545110 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7fa0c806cc00 0x7fa0c806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.098+0000 7fa0d57fa700 1 -- 172.21.15.88:0/2461545110 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa0c4094310 con 0x7fa0d8102100 2023-12-09T02:36:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.098+0000 7fa0dcee3700 1 --2- 172.21.15.88:0/2461545110 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7fa0c806cc00 0x7fa0c806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.099+0000 7fa0dcee3700 1 --2- 172.21.15.88:0/2461545110 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7fa0c806cc00 0x7fa0c806f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc004f90 tx=0x7fa0cc009e30 comp rx=0 tx=0).ready entity=mgr.14710 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:13.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.103+0000 7fa0d57fa700 1 -- 172.21.15.88:0/2461545110 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa0c4061ee0 con 0x7fa0d8102100 2023-12-09T02:36:13.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.392+0000 7fa0df147700 1 -- 172.21.15.88:0/2461545110 --> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0d81116e0 con 0x7fa0c806cc00 2023-12-09T02:36:13.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.403+0000 7fa0d57fa700 1 -- 172.21.15.88:0/2461545110 <== mgr.14710 v2:172.21.15.88:6800/3655200437 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa0d81116e0 con 0x7fa0c806cc00 2023-12-09T02:36:13.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.418+0000 7fa0df147700 1 -- 172.21.15.88:0/2461545110 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7fa0c806cc00 msgr2=0x7fa0c806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:13.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.418+0000 7fa0df147700 1 --2- 172.21.15.88:0/2461545110 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7fa0c806cc00 0x7fa0c806f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc004f90 tx=0x7fa0cc009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:13.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.418+0000 7fa0df147700 1 -- 172.21.15.88:0/2461545110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d8102100 msgr2=0x7fa0d810fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:13.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.418+0000 7fa0df147700 1 --2- 172.21.15.88:0/2461545110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d8102100 0x7fa0d810fc30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4002350 tx=0x7fa0c40139a0 comp rx=0 tx=0).stop 2023-12-09T02:36:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.420+0000 7fa0df147700 1 -- 172.21.15.88:0/2461545110 shutdown_connections 2023-12-09T02:36:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.420+0000 7fa0df147700 1 --2- 172.21.15.88:0/2461545110 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7fa0c806cc00 0x7fa0c806f0b0 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc004f90 tx=0x7fa0cc009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.420+0000 7fa0df147700 1 --2- 172.21.15.88:0/2461545110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0d8066070 0x7fa0d810f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.421+0000 7fa0df147700 1 --2- 172.21.15.88:0/2461545110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d8102100 0x7fa0d810fc30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.421+0000 7fa0df147700 1 -- 172.21.15.88:0/2461545110 >> 172.21.15.88:0/2461545110 conn(0x7fa0d80f7190 msgr2=0x7fa0d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:13.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.434+0000 7fa0df147700 1 -- 172.21.15.88:0/2461545110 shutdown_connections 2023-12-09T02:36:13.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.434+0000 7fa0df147700 1 -- 172.21.15.88:0/2461545110 wait complete. 2023-12-09T02:36:13.473 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:36:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.643+0000 7f0ffe1da700 1 -- 172.21.15.88:0/1391097428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ff806ee20 msgr2=0x7f0ff806f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.643+0000 7f0ffe1da700 1 --2- 172.21.15.88:0/1391097428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ff806ee20 0x7f0ff806f230 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0004940 tx=0x7f0ff0009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.643+0000 7f0ffe1da700 1 -- 172.21.15.88:0/1391097428 shutdown_connections 2023-12-09T02:36:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.643+0000 7f0ffe1da700 1 --2- 172.21.15.88:0/1391097428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ff8104ce0 0x7f0ff8105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.643+0000 7f0ffe1da700 1 --2- 172.21.15.88:0/1391097428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ff806ee20 0x7f0ff806f230 secure :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0004940 tx=0x7f0ff0009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:13.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.643+0000 7f0ffe1da700 1 -- 172.21.15.88:0/1391097428 >> 172.21.15.88:0/1391097428 conn(0x7f0ff8069b20 msgr2=0x7f0ff806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:13.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.647+0000 7f0ffe1da700 1 -- 172.21.15.88:0/1391097428 shutdown_connections 2023-12-09T02:36:13.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.647+0000 7f0ffe1da700 1 -- 172.21.15.88:0/1391097428 wait complete. 2023-12-09T02:36:13.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.647+0000 7f0ffe1da700 1 Processor -- start 2023-12-09T02:36:13.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.648+0000 7f0ffe1da700 1 -- start start 2023-12-09T02:36:13.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.648+0000 7f0ffe1da700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ff8104ce0 0x7f0ff8113d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:13.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.648+0000 7f0ffe1da700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ff8114270 0x7f0ff8115160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:13.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.648+0000 7f0ffe1da700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff81147c0 con 0x7f0ff8104ce0 2023-12-09T02:36:13.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.648+0000 7f0ffe1da700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8114930 con 0x7f0ff8114270 2023-12-09T02:36:13.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.649+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ff8114270 0x7f0ff8115160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:13.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.650+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ff8104ce0 0x7f0ff8113d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:13.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.650+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ff8104ce0 0x7f0ff8113d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57274/0 (socket says 172.21.15.88:57274) 2023-12-09T02:36:13.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.650+0000 7f0ff77fe700 1 -- 172.21.15.88:0/3243978977 learned_addr learned my addr 172.21.15.88:0/3243978977 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:13.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.653+0000 7f0ff77fe700 1 -- 172.21.15.88:0/3243978977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ff8114270 msgr2=0x7f0ff8115160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:13.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.653+0000 7f0ff77fe700 1 --2- 172.21.15.88:0/3243978977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ff8114270 0x7f0ff8115160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:13.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.653+0000 7f0ff77fe700 1 -- 172.21.15.88:0/3243978977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0005040 con 0x7f0ff8104ce0 2023-12-09T02:36:13.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.654+0000 7f0ff77fe700 1 --2- 172.21.15.88:0/3243978977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ff8104ce0 0x7f0ff8113d30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806e100 tx=0x7f0ff0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:13.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.663+0000 7f0fdffff700 1 -- 172.21.15.88:0/3243978977 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff000e030 con 0x7f0ff8104ce0 2023-12-09T02:36:13.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.663+0000 7f0fdffff700 1 -- 172.21.15.88:0/3243978977 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ff000be50 con 0x7f0ff8104ce0 2023-12-09T02:36:13.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.663+0000 7f0ffe1da700 1 -- 172.21.15.88:0/3243978977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff81157e0 con 0x7f0ff8104ce0 2023-12-09T02:36:13.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.663+0000 7f0fdffff700 1 -- 172.21.15.88:0/3243978977 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff0013e00 con 0x7f0ff8104ce0 2023-12-09T02:36:13.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.663+0000 7f0ffe1da700 1 -- 172.21.15.88:0/3243978977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff8115d20 con 0x7f0ff8104ce0 2023-12-09T02:36:13.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.667+0000 7f0ffe1da700 1 -- 172.21.15.88:0/3243978977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe40052e0 con 0x7f0ff8104ce0 2023-12-09T02:36:13.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.667+0000 7f0fdffff700 1 -- 172.21.15.88:0/3243978977 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f0ff0025400 con 0x7f0ff8104ce0 2023-12-09T02:36:13.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.668+0000 7f0fdffff700 1 --2- 172.21.15.88:0/3243978977 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f0fe006cde0 0x7f0fe006f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:13.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.668+0000 7f0fdffff700 1 -- 172.21.15.88:0/3243978977 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f0ff008e960 con 0x7f0ff8104ce0 2023-12-09T02:36:13.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.668+0000 7f0ff6ffd700 1 --2- 172.21.15.88:0/3243978977 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f0fe006cde0 0x7f0fe006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:13.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.671+0000 7f0ff6ffd700 1 --2- 172.21.15.88:0/3243978977 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f0fe006cde0 0x7f0fe006f290 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8114da0 tx=0x7f0fe8009620 comp rx=0 tx=0).ready entity=mgr.14710 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:13.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.676+0000 7f0fdffff700 1 -- 172.21.15.88:0/3243978977 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0ff0058b00 con 0x7f0ff8104ce0 2023-12-09T02:36:13.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.979+0000 7f0ffe1da700 1 -- 172.21.15.88:0/3243978977 --> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fe4000bf0 con 0x7f0fe006cde0 2023-12-09T02:36:13.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.980+0000 7f0fdffff700 1 -- 172.21.15.88:0/3243978977 <== mgr.14710 v2:172.21.15.88:6800/3655200437 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f0fe4000bf0 con 0x7f0fe006cde0 2023-12-09T02:36:13.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.983+0000 7f0ffe1da700 1 -- 172.21.15.88:0/3243978977 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f0fe006cde0 msgr2=0x7f0fe006f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:13.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.983+0000 7f0ffe1da700 1 --2- 172.21.15.88:0/3243978977 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f0fe006cde0 0x7f0fe006f290 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8114da0 tx=0x7f0fe8009620 comp rx=0 tx=0).stop 2023-12-09T02:36:13.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.983+0000 7f0ffe1da700 1 -- 172.21.15.88:0/3243978977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ff8104ce0 msgr2=0x7f0ff8113d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:13.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.983+0000 7f0ffe1da700 1 --2- 172.21.15.88:0/3243978977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ff8104ce0 0x7f0ff8113d30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806e100 tx=0x7f0ff0009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:13.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.983+0000 7f0ffe1da700 1 -- 172.21.15.88:0/3243978977 shutdown_connections 2023-12-09T02:36:13.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.983+0000 7f0ffe1da700 1 --2- 172.21.15.88:0/3243978977 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f0fe006cde0 0x7f0fe006f290 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:13.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.983+0000 7f0ffe1da700 1 --2- 172.21.15.88:0/3243978977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ff8104ce0 0x7f0ff8113d30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:13.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.983+0000 7f0ffe1da700 1 --2- 172.21.15.88:0/3243978977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ff8114270 0x7f0ff8115160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:13.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.983+0000 7f0ffe1da700 1 -- 172.21.15.88:0/3243978977 >> 172.21.15.88:0/3243978977 conn(0x7f0ff8069b20 msgr2=0x7f0ff806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:13.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.983+0000 7f0ffe1da700 1 -- 172.21.15.88:0/3243978977 shutdown_connections 2023-12-09T02:36:13.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:13.983+0000 7f0ffe1da700 1 -- 172.21.15.88:0/3243978977 wait complete. 2023-12-09T02:36:14.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.088+0000 7f496ac1e700 1 -- 172.21.15.88:0/3875777730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49640fbb00 msgr2=0x7f49640fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:14.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.088+0000 7f496ac1e700 1 --2- 172.21.15.88:0/3875777730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49640fbb00 0x7f49640fbf10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4958004940 tx=0x7f4958009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:14.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.088+0000 7f496ac1e700 1 -- 172.21.15.88:0/3875777730 shutdown_connections 2023-12-09T02:36:14.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.088+0000 7f496ac1e700 1 --2- 172.21.15.88:0/3875777730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49640fcd10 0x7f49640fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.088+0000 7f496ac1e700 1 --2- 172.21.15.88:0/3875777730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49640fbb00 0x7f49640fbf10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.088+0000 7f496ac1e700 1 -- 172.21.15.88:0/3875777730 >> 172.21.15.88:0/3875777730 conn(0x7f49640f71c0 msgr2=0x7f49640f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:14.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.088+0000 7f496ac1e700 1 -- 172.21.15.88:0/3875777730 shutdown_connections 2023-12-09T02:36:14.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.088+0000 7f496ac1e700 1 -- 172.21.15.88:0/3875777730 wait complete. 2023-12-09T02:36:14.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.089+0000 7f496ac1e700 1 Processor -- start 2023-12-09T02:36:14.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.089+0000 7f496ac1e700 1 -- start start 2023-12-09T02:36:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.089+0000 7f496ac1e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49640fbb00 0x7f496410c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.089+0000 7f496ac1e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49640fcd10 0x7f496410c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.089+0000 7f496ac1e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496410cf20 con 0x7f49640fbb00 2023-12-09T02:36:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.089+0000 7f496ac1e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496410d7c0 con 0x7f49640fcd10 2023-12-09T02:36:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.089+0000 7f49689ba700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49640fbb00 0x7f496410c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.089+0000 7f49689ba700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49640fbb00 0x7f496410c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57288/0 (socket says 172.21.15.88:57288) 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.089+0000 7f49689ba700 1 -- 172.21.15.88:0/737229739 learned_addr learned my addr 172.21.15.88:0/737229739 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.089+0000 7f4963fff700 1 --2- 172.21.15.88:0/737229739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49640fcd10 0x7f496410c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.090+0000 7f49689ba700 1 -- 172.21.15.88:0/737229739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49640fcd10 msgr2=0x7f496410c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.090+0000 7f49689ba700 1 --2- 172.21.15.88:0/737229739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49640fcd10 0x7f496410c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.090+0000 7f49689ba700 1 -- 172.21.15.88:0/737229739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4958005040 con 0x7f49640fbb00 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.090+0000 7f49689ba700 1 --2- 172.21.15.88:0/737229739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49640fbb00 0x7f496410c3e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4958000c00 tx=0x7f4958009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.090+0000 7f49617fa700 1 -- 172.21.15.88:0/737229739 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4958021070 con 0x7f49640fbb00 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.090+0000 7f496ac1e700 1 -- 172.21.15.88:0/737229739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496410da40 con 0x7f49640fbb00 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.090+0000 7f49617fa700 1 -- 172.21.15.88:0/737229739 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f495801c400 con 0x7f49640fbb00 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.090+0000 7f49617fa700 1 -- 172.21.15.88:0/737229739 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f495800e070 con 0x7f49640fbb00 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.090+0000 7f496ac1e700 1 -- 172.21.15.88:0/737229739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496410df20 con 0x7f49640fbb00 2023-12-09T02:36:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.091+0000 7f496ac1e700 1 -- 172.21.15.88:0/737229739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496404bb80 con 0x7f49640fbb00 2023-12-09T02:36:14.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.091+0000 7f49617fa700 1 -- 172.21.15.88:0/737229739 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f495801ca00 con 0x7f49640fbb00 2023-12-09T02:36:14.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.092+0000 7f49617fa700 1 --2- 172.21.15.88:0/737229739 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f495406cc00 0x7f495406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:14.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.092+0000 7f49617fa700 1 -- 172.21.15.88:0/737229739 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f495808d2e0 con 0x7f49640fbb00 2023-12-09T02:36:14.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.092+0000 7f4963fff700 1 --2- 172.21.15.88:0/737229739 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f495406cc00 0x7f495406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:14.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.092+0000 7f4963fff700 1 --2- 172.21.15.88:0/737229739 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f495406cc00 0x7f495406f0b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4950004600 tx=0x7f495000b040 comp rx=0 tx=0).ready entity=mgr.14710 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:14.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.096+0000 7f49617fa700 1 -- 172.21.15.88:0/737229739 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f495805af30 con 0x7f49640fbb00 2023-12-09T02:36:14.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.304+0000 7f496ac1e700 1 -- 172.21.15.88:0/737229739 --> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f496410e310 con 0x7f495406cc00 2023-12-09T02:36:14.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.314+0000 7f49617fa700 1 -- 172.21.15.88:0/737229739 <== mgr.14710 v2:172.21.15.88:6800/3655200437 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f496410e310 con 0x7f495406cc00 2023-12-09T02:36:14.317 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:36:14.317 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (38s) 15s ago 7m 16.7M - 0.25.0 c8568f914cd2 9dc2b8db0963 2023-12-09T02:36:14.317 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (7m) 15s ago 7m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 9098f424ee11 2023-12-09T02:36:14.317 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (6m) 15s ago 6m 7482k - 17.2.7-119-ge2143d99 f761b6e42225 15c5154f5f2e 2023-12-09T02:36:14.317 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (35s) 15s ago 6m 78.9M - 9.4.7 954c08fa6188 ab4c3f64ce4d 2023-12-09T02:36:14.317 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (3m) 15s ago 3m 13.6M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:36:14.317 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (3m) 15s ago 3m 14.8M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:36:14.317 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (3m) 15s ago 3m 6971M - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (3m) 15s ago 3m 14.7M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:8443,9283,8765 running (26s) 15s ago 8m 473M - 19.0.0-44-g9dcc13bb f28f2b94f153 a939ff288750 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283 running (99s) 15s ago 6m 118M - 19.0.0-44-g9dcc13bb f28f2b94f153 86d2f55bb861 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (8m) 15s ago 8m 84.7M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d21a10406297 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (6m) 15s ago 6m 59.6M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d6b9d9265450 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (40s) 15s ago 7m 16.4M - 1.5.0 0da6a335fe13 e2b7cc0b7527 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (30s) 15s ago 6m 6043k - 1.5.0 0da6a335fe13 0de833ab198e 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (5m) 15s ago 5m 588M 1568M 17.2.7-119-ge2143d99 f761b6e42225 fdd606881a64 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (5m) 15s ago 5m 610M 1568M 17.2.7-119-ge2143d99 f761b6e42225 354d4a4d3430 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (5m) 15s ago 5m 506M 1568M 17.2.7-119-ge2143d99 f761b6e42225 0b0abbb070ec 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (4m) 15s ago 4m 739M 2592M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (4m) 15s ago 4m 567M 2592M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (4m) 15s ago 4m 636M 2592M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:36:14.318 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 starting - - - - 2023-12-09T02:36:14.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.317+0000 7f496ac1e700 1 -- 172.21.15.88:0/737229739 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f495406cc00 msgr2=0x7f495406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:14.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.317+0000 7f496ac1e700 1 --2- 172.21.15.88:0/737229739 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f495406cc00 0x7f495406f0b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4950004600 tx=0x7f495000b040 comp rx=0 tx=0).stop 2023-12-09T02:36:14.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.317+0000 7f496ac1e700 1 -- 172.21.15.88:0/737229739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49640fbb00 msgr2=0x7f496410c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:14.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.317+0000 7f496ac1e700 1 --2- 172.21.15.88:0/737229739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49640fbb00 0x7f496410c3e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4958000c00 tx=0x7f4958009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:14.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.317+0000 7f496ac1e700 1 -- 172.21.15.88:0/737229739 shutdown_connections 2023-12-09T02:36:14.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.317+0000 7f496ac1e700 1 --2- 172.21.15.88:0/737229739 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f495406cc00 0x7f495406f0b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.317+0000 7f496ac1e700 1 --2- 172.21.15.88:0/737229739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49640fbb00 0x7f496410c3e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.317+0000 7f496ac1e700 1 --2- 172.21.15.88:0/737229739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49640fcd10 0x7f496410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.317+0000 7f496ac1e700 1 -- 172.21.15.88:0/737229739 >> 172.21.15.88:0/737229739 conn(0x7f49640f71c0 msgr2=0x7f49640fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:14.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.317+0000 7f496ac1e700 1 -- 172.21.15.88:0/737229739 shutdown_connections 2023-12-09T02:36:14.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.317+0000 7f496ac1e700 1 -- 172.21.15.88:0/737229739 wait complete. 2023-12-09T02:36:14.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.419+0000 7f75a3384700 1 -- 172.21.15.88:0/692804403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f759c0fcd00 msgr2=0x7f759c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.419+0000 7f75a3384700 1 --2- 172.21.15.88:0/692804403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f759c0fcd00 0x7f759c0fd150 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7598004940 tx=0x7f7598009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.419+0000 7f75a3384700 1 -- 172.21.15.88:0/692804403 shutdown_connections 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.419+0000 7f75a3384700 1 --2- 172.21.15.88:0/692804403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f759c0fcd00 0x7f759c0fd150 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.419+0000 7f75a3384700 1 --2- 172.21.15.88:0/692804403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f759c0fbaf0 0x7f759c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.419+0000 7f75a3384700 1 -- 172.21.15.88:0/692804403 >> 172.21.15.88:0/692804403 conn(0x7f759c0f7190 msgr2=0x7f759c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.419+0000 7f75a3384700 1 -- 172.21.15.88:0/692804403 shutdown_connections 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.419+0000 7f75a3384700 1 -- 172.21.15.88:0/692804403 wait complete. 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.419+0000 7f75a3384700 1 Processor -- start 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.419+0000 7f75a3384700 1 -- start start 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a3384700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f759c0fbaf0 0x7f759c10c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a3384700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f759c0fcd00 0x7f759c10c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a3384700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c10cf10 con 0x7f759c0fcd00 2023-12-09T02:36:14.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a3384700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c10d7b0 con 0x7f759c0fbaf0 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a091f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f759c0fcd00 0x7f759c10c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a091f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f759c0fcd00 0x7f759c10c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57302/0 (socket says 172.21.15.88:57302) 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a091f700 1 -- 172.21.15.88:0/3416430505 learned_addr learned my addr 172.21.15.88:0/3416430505 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a1120700 1 --2- 172.21.15.88:0/3416430505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f759c0fbaf0 0x7f759c10c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a091f700 1 -- 172.21.15.88:0/3416430505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f759c0fbaf0 msgr2=0x7f759c10c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a091f700 1 --2- 172.21.15.88:0/3416430505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f759c0fbaf0 0x7f759c10c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a091f700 1 -- 172.21.15.88:0/3416430505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7598005040 con 0x7f759c0fcd00 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a091f700 1 --2- 172.21.15.88:0/3416430505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f759c0fcd00 0x7f759c10c910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7598000c00 tx=0x7f7598009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f758dffb700 1 -- 172.21.15.88:0/3416430505 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7598021070 con 0x7f759c0fcd00 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f75a3384700 1 -- 172.21.15.88:0/3416430505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c10da30 con 0x7f759c0fcd00 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f758dffb700 1 -- 172.21.15.88:0/3416430505 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f759801c400 con 0x7f759c0fcd00 2023-12-09T02:36:14.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.420+0000 7f758dffb700 1 -- 172.21.15.88:0/3416430505 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f759800e070 con 0x7f759c0fcd00 2023-12-09T02:36:14.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.421+0000 7f75a3384700 1 -- 172.21.15.88:0/3416430505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c10df10 con 0x7f759c0fcd00 2023-12-09T02:36:14.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.421+0000 7f75a3384700 1 -- 172.21.15.88:0/3416430505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c04bb80 con 0x7f759c0fcd00 2023-12-09T02:36:14.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.422+0000 7f758dffb700 1 -- 172.21.15.88:0/3416430505 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f759801c9c0 con 0x7f759c0fcd00 2023-12-09T02:36:14.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.422+0000 7f758dffb700 1 --2- 172.21.15.88:0/3416430505 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f758806cc00 0x7f758806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:14.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.422+0000 7f758dffb700 1 -- 172.21.15.88:0/3416430505 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f759808d2a0 con 0x7f759c0fcd00 2023-12-09T02:36:14.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.422+0000 7f75a1120700 1 --2- 172.21.15.88:0/3416430505 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f758806cc00 0x7f758806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:14.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.423+0000 7f75a1120700 1 --2- 172.21.15.88:0/3416430505 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f758806cc00 0x7f758806f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7590009b80 tx=0x7f759000b040 comp rx=0 tx=0).ready entity=mgr.14710 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:14.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.427+0000 7f758dffb700 1 -- 172.21.15.88:0/3416430505 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f759805aef0 con 0x7f759c0fcd00 2023-12-09T02:36:14.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.719+0000 7f75a3384700 1 -- 172.21.15.88:0/3416430505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f759c104490 con 0x7f759c0fcd00 2023-12-09T02:36:14.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.719+0000 7f758dffb700 1 -- 172.21.15.88:0/3416430505 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f759805aa80 con 0x7f759c0fcd00 2023-12-09T02:36:14.722 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:36:14.722 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:36:14.722 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-09T02:36:14.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:36:14.722 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:36:14.722 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:36:14.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:36:14.723 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:36:14.723 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-09T02:36:14.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:36:14.723 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:36:14.723 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:36:14.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:36:14.723 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:36:14.723 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 12, 2023-12-09T02:36:14.723 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:36:14.723 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:36:14.723 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:36:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.722+0000 7f75a3384700 1 -- 172.21.15.88:0/3416430505 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f758806cc00 msgr2=0x7f758806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.722+0000 7f75a3384700 1 --2- 172.21.15.88:0/3416430505 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f758806cc00 0x7f758806f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7590009b80 tx=0x7f759000b040 comp rx=0 tx=0).stop 2023-12-09T02:36:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.722+0000 7f75a3384700 1 -- 172.21.15.88:0/3416430505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f759c0fcd00 msgr2=0x7f759c10c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.722+0000 7f75a3384700 1 --2- 172.21.15.88:0/3416430505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f759c0fcd00 0x7f759c10c910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7598000c00 tx=0x7f7598009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.722+0000 7f75a3384700 1 -- 172.21.15.88:0/3416430505 shutdown_connections 2023-12-09T02:36:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.722+0000 7f75a3384700 1 --2- 172.21.15.88:0/3416430505 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f758806cc00 0x7f758806f0b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.722+0000 7f75a3384700 1 --2- 172.21.15.88:0/3416430505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f759c0fbaf0 0x7f759c10c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.722+0000 7f75a3384700 1 --2- 172.21.15.88:0/3416430505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f759c0fcd00 0x7f759c10c910 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.722+0000 7f75a3384700 1 -- 172.21.15.88:0/3416430505 >> 172.21.15.88:0/3416430505 conn(0x7f759c0f7190 msgr2=0x7f759c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.722+0000 7f75a3384700 1 -- 172.21.15.88:0/3416430505 shutdown_connections 2023-12-09T02:36:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.722+0000 7f75a3384700 1 -- 172.21.15.88:0/3416430505 wait complete. 2023-12-09T02:36:14.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.832+0000 7f61235b4700 1 -- 172.21.15.88:0/2174541946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c0faed0 msgr2=0x7f611c0fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:14.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.832+0000 7f61235b4700 1 --2- 172.21.15.88:0/2174541946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c0faed0 0x7f611c0fb2e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6118004940 tx=0x7f6118009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:14.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.832+0000 7f61235b4700 1 -- 172.21.15.88:0/2174541946 shutdown_connections 2023-12-09T02:36:14.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.832+0000 7f61235b4700 1 --2- 172.21.15.88:0/2174541946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c0fdf60 0x7f611c0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.832+0000 7f61235b4700 1 --2- 172.21.15.88:0/2174541946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c0faed0 0x7f611c0fb2e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.832+0000 7f61235b4700 1 -- 172.21.15.88:0/2174541946 >> 172.21.15.88:0/2174541946 conn(0x7f611c0f6950 msgr2=0x7f611c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.833+0000 7f61235b4700 1 -- 172.21.15.88:0/2174541946 shutdown_connections 2023-12-09T02:36:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.833+0000 7f61235b4700 1 -- 172.21.15.88:0/2174541946 wait complete. 2023-12-09T02:36:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.833+0000 7f61235b4700 1 Processor -- start 2023-12-09T02:36:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.833+0000 7f61235b4700 1 -- start start 2023-12-09T02:36:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.833+0000 7f61235b4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c0faed0 0x7f611c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.833+0000 7f61235b4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c0fdf60 0x7f611c10db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.833+0000 7f61235b4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c10e120 con 0x7f611c0faed0 2023-12-09T02:36:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.833+0000 7f61235b4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c10e9c0 con 0x7f611c0fdf60 2023-12-09T02:36:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6121350700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c0faed0 0x7f611c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6121350700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c0faed0 0x7f611c10d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57328/0 (socket says 172.21.15.88:57328) 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6121350700 1 -- 172.21.15.88:0/478317423 learned_addr learned my addr 172.21.15.88:0/478317423 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6120b4f700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c0fdf60 0x7f611c10db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6121350700 1 -- 172.21.15.88:0/478317423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c0fdf60 msgr2=0x7f611c10db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6121350700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c0fdf60 0x7f611c10db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6121350700 1 -- 172.21.15.88:0/478317423 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118005040 con 0x7f611c0faed0 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6120b4f700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c0fdf60 0x7f611c10db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6121350700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c0faed0 0x7f611c10d5e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6118009180 tx=0x7f6118009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6111ffb700 1 -- 172.21.15.88:0/478317423 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611800e040 con 0x7f611c0faed0 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6111ffb700 1 -- 172.21.15.88:0/478317423 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6118004290 con 0x7f611c0faed0 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f61235b4700 1 -- 172.21.15.88:0/478317423 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611c10ec40 con 0x7f611c0faed0 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f6111ffb700 1 -- 172.21.15.88:0/478317423 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611801c630 con 0x7f611c0faed0 2023-12-09T02:36:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.834+0000 7f61235b4700 1 -- 172.21.15.88:0/478317423 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c10f180 con 0x7f611c0faed0 2023-12-09T02:36:14.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.835+0000 7f61235b4700 1 -- 172.21.15.88:0/478317423 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611c1075f0 con 0x7f611c0faed0 2023-12-09T02:36:14.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.836+0000 7f6111ffb700 1 -- 172.21.15.88:0/478317423 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f6118013420 con 0x7f611c0faed0 2023-12-09T02:36:14.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.836+0000 7f6111ffb700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f610806cc00 0x7f610806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:14.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.836+0000 7f6111ffb700 1 -- 172.21.15.88:0/478317423 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f611808d440 con 0x7f611c0faed0 2023-12-09T02:36:14.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.836+0000 7f6120b4f700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f610806cc00 0x7f610806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:14.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.837+0000 7f6120b4f700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f610806cc00 0x7f610806f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f610c009fd0 tx=0x7f610c009ee0 comp rx=0 tx=0).ready entity=mgr.14710 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:14.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:14.841+0000 7f6111ffb700 1 -- 172.21.15.88:0/478317423 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f611805b090 con 0x7f611c0faed0 2023-12-09T02:36:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:14 smithi088 ceph-mon[112028]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:14 smithi088 ceph-mon[112028]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 63 KiB/s rd, 2.3 MiB/s wr, 482 op/s 2023-12-09T02:36:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:14 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:14 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:14 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:14.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:14 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/3416430505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:36:15.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.115+0000 7f61235b4700 1 -- 172.21.15.88:0/478317423 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f611c02b0e0 con 0x7f611c0faed0 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.115+0000 7f6111ffb700 1 -- 172.21.15.88:0/478317423 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1810 (secure 0 0 0) 0x7f611805ac20 con 0x7f611c0faed0 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:36:15.118 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:36:15.119 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:15.120 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.118+0000 7f61235b4700 1 -- 172.21.15.88:0/478317423 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f610806cc00 msgr2=0x7f610806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.118+0000 7f61235b4700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f610806cc00 0x7f610806f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f610c009fd0 tx=0x7f610c009ee0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.118+0000 7f61235b4700 1 -- 172.21.15.88:0/478317423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c0faed0 msgr2=0x7f611c10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.118+0000 7f61235b4700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c0faed0 0x7f611c10d5e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6118009180 tx=0x7f6118009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.118+0000 7f61235b4700 1 -- 172.21.15.88:0/478317423 shutdown_connections 2023-12-09T02:36:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.118+0000 7f61235b4700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7f610806cc00 0x7f610806f0b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.118+0000 7f61235b4700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c0faed0 0x7f611c10d5e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.118+0000 7f61235b4700 1 --2- 172.21.15.88:0/478317423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c0fdf60 0x7f611c10db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.118+0000 7f61235b4700 1 -- 172.21.15.88:0/478317423 >> 172.21.15.88:0/478317423 conn(0x7f611c0f6950 msgr2=0x7f611c0f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.118+0000 7f61235b4700 1 -- 172.21.15.88:0/478317423 shutdown_connections 2023-12-09T02:36:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.118+0000 7f61235b4700 1 -- 172.21.15.88:0/478317423 wait complete. 2023-12-09T02:36:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:36:15.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:14 smithi161 ceph-mon[121170]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:15.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:14 smithi161 ceph-mon[121170]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 63 KiB/s rd, 2.3 MiB/s wr, 482 op/s 2023-12-09T02:36:15.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:14 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:15.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:14 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:15.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:14 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:15.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:14 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/3416430505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:36:15.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.232+0000 7eff02cd7700 1 -- 172.21.15.88:0/195504229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efefc0ffd90 msgr2=0x7efefc1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:15.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.232+0000 7eff02cd7700 1 --2- 172.21.15.88:0/195504229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efefc0ffd90 0x7efefc1021d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efee8004940 tx=0x7efee8009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:15.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.233+0000 7eff02cd7700 1 -- 172.21.15.88:0/195504229 shutdown_connections 2023-12-09T02:36:15.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.233+0000 7eff02cd7700 1 --2- 172.21.15.88:0/195504229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efefc0ffd90 0x7efefc1021d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.233+0000 7eff02cd7700 1 --2- 172.21.15.88:0/195504229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efefc066070 0x7efefc0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.233+0000 7eff02cd7700 1 -- 172.21.15.88:0/195504229 >> 172.21.15.88:0/195504229 conn(0x7efefc0f7190 msgr2=0x7efefc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:15.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.233+0000 7eff02cd7700 1 -- 172.21.15.88:0/195504229 shutdown_connections 2023-12-09T02:36:15.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.233+0000 7eff02cd7700 1 -- 172.21.15.88:0/195504229 wait complete. 2023-12-09T02:36:15.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.233+0000 7eff02cd7700 1 Processor -- start 2023-12-09T02:36:15.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.233+0000 7eff02cd7700 1 -- start start 2023-12-09T02:36:15.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff02cd7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efefc066070 0x7efefc10f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:15.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff02cd7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efefc0ffd90 0x7efefc10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:15.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff02cd7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc110240 con 0x7efefc066070 2023-12-09T02:36:15.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff02cd7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc110ae0 con 0x7efefc0ffd90 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff00a73700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efefc066070 0x7efefc10f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff00a73700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efefc066070 0x7efefc10f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57350/0 (socket says 172.21.15.88:57350) 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff00a73700 1 -- 172.21.15.88:0/356503655 learned_addr learned my addr 172.21.15.88:0/356503655 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7efefbfff700 1 --2- 172.21.15.88:0/356503655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efefc0ffd90 0x7efefc10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff00a73700 1 -- 172.21.15.88:0/356503655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efefc0ffd90 msgr2=0x7efefc10fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff00a73700 1 --2- 172.21.15.88:0/356503655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efefc0ffd90 0x7efefc10fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff00a73700 1 -- 172.21.15.88:0/356503655 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee8005040 con 0x7efefc066070 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff00a73700 1 --2- 172.21.15.88:0/356503655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efefc066070 0x7efefc10f700 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efef000eb40 tx=0x7efef000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7efef97fa700 1 -- 172.21.15.88:0/356503655 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efef0007cc0 con 0x7efefc066070 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7eff02cd7700 1 -- 172.21.15.88:0/356503655 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efefc110d60 con 0x7efefc066070 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.234+0000 7efef97fa700 1 -- 172.21.15.88:0/356503655 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efef000f040 con 0x7efefc066070 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.235+0000 7efef97fa700 1 -- 172.21.15.88:0/356503655 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efef000c990 con 0x7efefc066070 2023-12-09T02:36:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.235+0000 7eff02cd7700 1 -- 172.21.15.88:0/356503655 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efefc1112a0 con 0x7efefc066070 2023-12-09T02:36:15.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.236+0000 7eff02cd7700 1 -- 172.21.15.88:0/356503655 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efefc04bb80 con 0x7efefc066070 2023-12-09T02:36:15.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.236+0000 7efef97fa700 1 -- 172.21.15.88:0/356503655 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7efef000cc00 con 0x7efefc066070 2023-12-09T02:36:15.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.236+0000 7efef97fa700 1 --2- 172.21.15.88:0/356503655 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efeec06cc00 0x7efeec06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:15.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.237+0000 7efef97fa700 1 -- 172.21.15.88:0/356503655 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7efef008bc70 con 0x7efefc066070 2023-12-09T02:36:15.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.237+0000 7efefbfff700 1 --2- 172.21.15.88:0/356503655 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efeec06cc00 0x7efeec06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:15.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.237+0000 7efefbfff700 1 --2- 172.21.15.88:0/356503655 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efeec06cc00 0x7efeec06f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efee8013680 tx=0x7efee8009e30 comp rx=0 tx=0).ready entity=mgr.14710 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:15.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.241+0000 7efef97fa700 1 -- 172.21.15.88:0/356503655 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7efef00598f0 con 0x7efefc066070 2023-12-09T02:36:15.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.512+0000 7eff02cd7700 1 -- 172.21.15.88:0/356503655 --> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efefc0fbcb0 con 0x7efeec06cc00 2023-12-09T02:36:15.517 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:36:15.517 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:36:15.517 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:36:15.517 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:36:15.518 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2023-12-09T02:36:15.518 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "", 2023-12-09T02:36:15.518 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mgr daemons", 2023-12-09T02:36:15.518 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:36:15.518 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:36:15.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.514+0000 7efef97fa700 1 -- 172.21.15.88:0/356503655 <== mgr.14710 v2:172.21.15.88:6800/3655200437 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7efefc0fbcb0 con 0x7efeec06cc00 2023-12-09T02:36:15.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.516+0000 7eff02cd7700 1 -- 172.21.15.88:0/356503655 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efeec06cc00 msgr2=0x7efeec06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:15.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.516+0000 7eff02cd7700 1 --2- 172.21.15.88:0/356503655 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efeec06cc00 0x7efeec06f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efee8013680 tx=0x7efee8009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:15.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.516+0000 7eff02cd7700 1 -- 172.21.15.88:0/356503655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efefc066070 msgr2=0x7efefc10f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:15.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.516+0000 7eff02cd7700 1 --2- 172.21.15.88:0/356503655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efefc066070 0x7efefc10f700 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efef000eb40 tx=0x7efef000b040 comp rx=0 tx=0).stop 2023-12-09T02:36:15.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.517+0000 7eff02cd7700 1 -- 172.21.15.88:0/356503655 shutdown_connections 2023-12-09T02:36:15.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.517+0000 7eff02cd7700 1 --2- 172.21.15.88:0/356503655 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efeec06cc00 0x7efeec06f0b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.517+0000 7eff02cd7700 1 --2- 172.21.15.88:0/356503655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efefc066070 0x7efefc10f700 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.517+0000 7eff02cd7700 1 --2- 172.21.15.88:0/356503655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efefc0ffd90 0x7efefc10fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.517+0000 7eff02cd7700 1 -- 172.21.15.88:0/356503655 >> 172.21.15.88:0/356503655 conn(0x7efefc0f7190 msgr2=0x7efefc0fb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:15.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.517+0000 7eff02cd7700 1 -- 172.21.15.88:0/356503655 shutdown_connections 2023-12-09T02:36:15.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.517+0000 7eff02cd7700 1 -- 172.21.15.88:0/356503655 wait complete. 2023-12-09T02:36:15.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.679+0000 7efd085bc700 1 -- 172.21.15.88:0/996725107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0006eb60 msgr2=0x7efd0010ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:15.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.679+0000 7efd085bc700 1 --2- 172.21.15.88:0/996725107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0006eb60 0x7efd0010ae70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efcf0004940 tx=0x7efcf0009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:15.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.680+0000 7efd085bc700 1 -- 172.21.15.88:0/996725107 shutdown_connections 2023-12-09T02:36:15.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.680+0000 7efd085bc700 1 --2- 172.21.15.88:0/996725107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0006eb60 0x7efd0010ae70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.680+0000 7efd085bc700 1 --2- 172.21.15.88:0/996725107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0006e210 0x7efd0006e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.680+0000 7efd085bc700 1 -- 172.21.15.88:0/996725107 >> 172.21.15.88:0/996725107 conn(0x7efd00069b20 msgr2=0x7efd0006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:15.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.681+0000 7efd085bc700 1 -- 172.21.15.88:0/996725107 shutdown_connections 2023-12-09T02:36:15.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.681+0000 7efd085bc700 1 -- 172.21.15.88:0/996725107 wait complete. 2023-12-09T02:36:15.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.681+0000 7efd085bc700 1 Processor -- start 2023-12-09T02:36:15.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.681+0000 7efd085bc700 1 -- start start 2023-12-09T02:36:15.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd085bc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0006e210 0x7efd00115ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:15.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd085bc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0006eb60 0x7efd001163e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:15.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd085bc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd00117140 con 0x7efd0006e210 2023-12-09T02:36:15.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd085bc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd001172b0 con 0x7efd0006eb60 2023-12-09T02:36:15.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd06358700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0006e210 0x7efd00115ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:15.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd06358700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0006e210 0x7efd00115ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57382/0 (socket says 172.21.15.88:57382) 2023-12-09T02:36:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd06358700 1 -- 172.21.15.88:0/173907598 learned_addr learned my addr 172.21.15.88:0/173907598 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd06358700 1 -- 172.21.15.88:0/173907598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0006eb60 msgr2=0x7efd001163e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd05b57700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0006eb60 0x7efd001163e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd06358700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0006eb60 0x7efd001163e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd06358700 1 -- 172.21.15.88:0/173907598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0005040 con 0x7efd0006e210 2023-12-09T02:36:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd05b57700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0006eb60 0x7efd001163e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:36:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd06358700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0006e210 0x7efd00115ea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efcf800bb00 tx=0x7efcf8009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efcf6ffd700 1 -- 172.21.15.88:0/173907598 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf800cae0 con 0x7efd0006e210 2023-12-09T02:36:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efcf6ffd700 1 -- 172.21.15.88:0/173907598 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efcf800cc40 con 0x7efd0006e210 2023-12-09T02:36:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efcf6ffd700 1 -- 172.21.15.88:0/173907598 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf80076e0 con 0x7efd0006e210 2023-12-09T02:36:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.682+0000 7efd085bc700 1 -- 172.21.15.88:0/173907598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd00117590 con 0x7efd0006e210 2023-12-09T02:36:15.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.683+0000 7efd085bc700 1 -- 172.21.15.88:0/173907598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd00117a80 con 0x7efd0006e210 2023-12-09T02:36:15.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.684+0000 7efd085bc700 1 -- 172.21.15.88:0/173907598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0010fea0 con 0x7efd0006e210 2023-12-09T02:36:15.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.685+0000 7efcf6ffd700 1 -- 172.21.15.88:0/173907598 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7efcf8014410 con 0x7efd0006e210 2023-12-09T02:36:15.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.686+0000 7efcf6ffd700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efcec06cc00 0x7efcec06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:15.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.686+0000 7efcf6ffd700 1 -- 172.21.15.88:0/173907598 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7efcf808c260 con 0x7efd0006e210 2023-12-09T02:36:15.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.686+0000 7efd05b57700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efcec06cc00 0x7efcec06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:15.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.686+0000 7efd05b57700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efcec06cc00 0x7efcec06f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efcf0004f90 tx=0x7efcf0009e30 comp rx=0 tx=0).ready entity=mgr.14710 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:15.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:15.690+0000 7efcf6ffd700 1 -- 172.21.15.88:0/173907598 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7efcf8091060 con 0x7efd0006e210 2023-12-09T02:36:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:15 smithi088 ceph-mon[112028]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:15 smithi088 ceph-mon[112028]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:15 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/478317423' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:36:16.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.001+0000 7efd085bc700 1 -- 172.21.15.88:0/173907598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efd0004bb80 con 0x7efd0006e210 2023-12-09T02:36:16.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.001+0000 7efcf6ffd700 1 -- 172.21.15.88:0/173907598 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7efcf8059eb0 con 0x7efd0006e210 2023-12-09T02:36:16.004 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:36:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.003+0000 7efd085bc700 1 -- 172.21.15.88:0/173907598 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efcec06cc00 msgr2=0x7efcec06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.003+0000 7efd085bc700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efcec06cc00 0x7efcec06f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efcf0004f90 tx=0x7efcf0009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.003+0000 7efd085bc700 1 -- 172.21.15.88:0/173907598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0006e210 msgr2=0x7efd00115ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.003+0000 7efd085bc700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0006e210 0x7efd00115ea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efcf800bb00 tx=0x7efcf8009810 comp rx=0 tx=0).stop 2023-12-09T02:36:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.003+0000 7efd085bc700 1 -- 172.21.15.88:0/173907598 shutdown_connections 2023-12-09T02:36:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.003+0000 7efd085bc700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.88:6800/3655200437,v1:172.21.15.88:6801/3655200437] conn(0x7efcec06cc00 0x7efcec06f0b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.003+0000 7efd085bc700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0006e210 0x7efd00115ea0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.003+0000 7efd085bc700 1 --2- 172.21.15.88:0/173907598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0006eb60 0x7efd001163e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.004+0000 7efd085bc700 1 -- 172.21.15.88:0/173907598 >> 172.21.15.88:0/173907598 conn(0x7efd00069b20 msgr2=0x7efd001096f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.004+0000 7efd085bc700 1 -- 172.21.15.88:0/173907598 shutdown_connections 2023-12-09T02:36:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:16.004+0000 7efd085bc700 1 -- 172.21.15.88:0/173907598 wait complete. 2023-12-09T02:36:16.093 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:15 smithi161 ceph-mon[121170]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:16.094 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:15 smithi161 ceph-mon[121170]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:16.094 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:15 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/478317423' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:36:16.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:16 smithi088 ceph-mon[112028]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:16.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:16 smithi088 ceph-mon[112028]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 326 op/s 2023-12-09T02:36:16.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:16 smithi088 ceph-mon[112028]: from='client.? 172.21.15.88:0/173907598' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:36:17.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:16 smithi161 ceph-mon[121170]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:17.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:16 smithi161 ceph-mon[121170]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 326 op/s 2023-12-09T02:36:17.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:16 smithi161 ceph-mon[121170]: from='client.? 172.21.15.88:0/173907598' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:36:18.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:18 smithi161 ceph-mon[121170]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 867 op/s 2023-12-09T02:36:18.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:18 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:18.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:18 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:18.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:18 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:18.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:18 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:18.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:18 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:18.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:18 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:18.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:18 smithi088 ceph-mon[112028]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 867 op/s 2023-12-09T02:36:18.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:18 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:18.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:18 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:18.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:18 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:18.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:18 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:18.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:18 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:18.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:18 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:21.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:20 smithi161 ceph-mon[121170]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 686 op/s 2023-12-09T02:36:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:20 smithi088 ceph-mon[112028]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 686 op/s 2023-12-09T02:36:23.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:22 smithi161 ceph-mon[121170]: pgmap v16: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 772 op/s 2023-12-09T02:36:23.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:22 smithi088 ceph-mon[112028]: pgmap v16: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 772 op/s 2023-12-09T02:36:24.785 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: pgmap v17: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.2 MiB/s wr, 1.16k op/s 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: Standby manager daemon smithi161.qmxtmg restarted 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: Standby manager daemon smithi161.qmxtmg started 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/1722745930' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/crt"}]: dispatch 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/1722745930' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/1722745930' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/key"}]: dispatch 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/1722745930' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:36:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.jwlofb"}]: dispatch 2023-12-09T02:36:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.jwlofb"}]': finished 2023-12-09T02:36:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.qmxtmg"}]: dispatch 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: pgmap v17: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.2 MiB/s wr, 1.16k op/s 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: Standby manager daemon smithi161.qmxtmg restarted 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: Standby manager daemon smithi161.qmxtmg started 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/1722745930' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/crt"}]: dispatch 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/1722745930' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/1722745930' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/key"}]: dispatch 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.? 172.21.15.161:0/1722745930' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:36:24.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:24.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:24.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:36:24.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:24.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.jwlofb"}]: dispatch 2023-12-09T02:36:24.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.jwlofb"}]': finished 2023-12-09T02:36:24.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.qmxtmg"}]: dispatch 2023-12-09T02:36:24.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.qmxtmg"}]': finished 2023-12-09T02:36:24.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:24 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-09T02:36:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.qmxtmg"}]': finished 2023-12-09T02:36:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:24 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-09T02:36:26.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:25 smithi161 ceph-mon[121170]: Upgrade: Setting container_image for all mgr 2023-12-09T02:36:26.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:25 smithi161 ceph-mon[121170]: mgrmap e32: smithi088.jwlofb(active, since 29s), standbys: smithi161.qmxtmg 2023-12-09T02:36:26.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:25 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:36:26.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:25 smithi088 ceph-mon[112028]: Upgrade: Setting container_image for all mgr 2023-12-09T02:36:26.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:25 smithi088 ceph-mon[112028]: mgrmap e32: smithi088.jwlofb(active, since 29s), standbys: smithi161.qmxtmg 2023-12-09T02:36:26.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:25 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:36:26.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:26 smithi088 ceph-mon[112028]: pgmap v18: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 1.02k op/s 2023-12-09T02:36:26.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:26 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:26.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:26 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:36:26.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:26 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:36:26.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:26 smithi088 ceph-mon[112028]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:26 smithi161 ceph-mon[121170]: pgmap v18: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 1.02k op/s 2023-12-09T02:36:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:26 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:26 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:36:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:26 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:36:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:26 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:27.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:27 smithi088 systemd[1]: Stopping Ceph mon.smithi088 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:36:27.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:27 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi088[112004]: 2023-12-09T02:36:27.228+0000 7efda4888700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi088 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:36:27.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:27 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi088[112004]: 2023-12-09T02:36:27.228+0000 7efda4888700 -1 mon.smithi088@0(leader) e2 *** Got Signal Terminated *** 2023-12-09T02:36:27.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:27 smithi088 bash[193211]: ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi088 2023-12-09T02:36:28.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:27 smithi088 systemd[1]: ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi088.service: Succeeded. 2023-12-09T02:36:28.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:27 smithi088 systemd[1]: Stopped Ceph mon.smithi088 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:36:28.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 systemd[1]: Starting Ceph mon.smithi088 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:36:28.662 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: set uid:gid to 167:167 (ceph:ceph) 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev), process ceph-mon, pid 7 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: pidfile_write: ignore empty --pid-file 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: load: jerasure load: lrc 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: RocksDB version: 7.9.2 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Git sha 0 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Compile date 2023-12-08 17:42:16 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: DB SUMMARY 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: DB Session ID: EKQF1XI4Q2NFBL346PFB 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: CURRENT file: CURRENT 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: IDENTITY file: IDENTITY 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: MANIFEST file: MANIFEST-000015 size: 779 Bytes 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi088/store.db dir, Total Num: 1, files: 000027.sst 2023-12-09T02:36:28.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi088/store.db: 000025.log size: 1335251 ; 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.error_if_exists: 0 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.create_if_missing: 0 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.paranoid_checks: 1 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.env: 0x56197e013a60 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.fs: PosixFileSystem 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.info_log: 0x56198052d600 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_file_opening_threads: 16 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.statistics: (nil) 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.use_fsync: 0 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_log_file_size: 0 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-09T02:36:28.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.keep_log_file_num: 1000 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.recycle_log_file_num: 0 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.allow_fallocate: 1 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.allow_mmap_reads: 0 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.allow_mmap_writes: 0 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.use_direct_reads: 0 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.create_missing_column_families: 0 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.db_log_dir: 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.wal_dir: 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-09T02:36:28.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.advise_random_on_open: 1 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.db_write_buffer_size: 0 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.write_buffer_manager: 0x5619804e3360 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.rate_limiter: (nil) 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.wal_recovery_mode: 2 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.enable_thread_tracking: 0 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.enable_pipelined_write: 0 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.unordered_write: 0 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-09T02:36:28.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.row_cache: None 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.wal_filter: None 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.allow_ingest_behind: 0 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.two_write_queues: 0 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.manual_wal_flush: 0 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.wal_compression: 0 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.atomic_flush: 0 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.log_readahead_size: 0 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-09T02:36:28.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.best_efforts_recovery: 0 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.allow_data_in_errors: 0 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.db_host_id: __hostname__ 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_background_jobs: 2 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_background_compactions: -1 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_subcompactions: 1 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_total_wal_size: 0 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-09T02:36:28.668 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_open_files: -1 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bytes_per_sync: 0 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_readahead_size: 0 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_background_flushes: -1 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Compression algorithms supported: 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: kZSTD supported: 0 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: kXpressCompression supported: 0 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: kLZ4HCCompression supported: 1 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: kZlibCompression supported: 1 2023-12-09T02:36:28.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: kSnappyCompression supported: 1 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: kLZ4Compression supported: 1 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: kBZip2Compression supported: 0 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000015 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.merge_operator: 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_filter: None 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_filter_factory: None 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.sst_partitioner_factory: None 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56198052d700) 2023-12-09T02:36:28.670 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks: 1 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_top_level_index_and_filter: 1 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_type: 0 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_index_type: 0 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_shortening: 1 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: checksum: 4 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: no_block_cache: 0 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache: 0x5619805831f0 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_name: BinnedLRUCache 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_options: 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: capacity : 536870912 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: num_shard_bits : 4 2023-12-09T02:36:28.671 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: strict_capacity_limit : 0 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: high_pri_pool_ratio: 0.000 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_compressed: (nil) 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: persistent_cache: (nil) 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size: 4096 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size_deviation: 10 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_restart_interval: 16 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_block_restart_interval: 1 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: metadata_block_size: 4096 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: partition_filters: 0 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: use_delta_encoding: 1 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: filter_policy: bloomfilter 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: whole_key_filtering: 1 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: verify_compression: 0 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: read_amp_bytes_per_bit: 0 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: format_version: 5 2023-12-09T02:36:28.672 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: enable_index_compression: 1 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_align: 0 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: max_auto_readahead_size: 262144 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: prepopulate_block_cache: 0 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: initial_auto_readahead_size: 8192 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: num_file_reads_for_auto_readahead: 2 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.write_buffer_size: 33554432 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_write_buffer_number: 2 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compression: NoCompression 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bottommost_compression: Disabled 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.prefix_extractor: nullptr 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.num_levels: 7 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-09T02:36:28.673 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-09T02:36:28.674 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-09T02:36:28.674 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-09T02:36:28.674 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-09T02:36:28.674 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compression_opts.level: 32767 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compression_opts.strategy: 0 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-09T02:36:28.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-09T02:36:28.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compression_opts.enabled: false 2023-12-09T02:36:28.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-09T02:36:28.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-09T02:36:28.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-09T02:36:28.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-09T02:36:28.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.target_file_size_base: 67108864 2023-12-09T02:36:28.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-09T02:36:28.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-09T02:36:28.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.arena_block_size: 1048576 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-09T02:36:28.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.disable_auto_compactions: 0 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.table_properties_collectors: 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.inplace_update_support: 0 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-09T02:36:28.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.bloom_locality: 0 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.max_successive_merges: 0 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.paranoid_file_checks: 0 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.force_consistency_checks: 1 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.report_bg_io_stats: 0 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.ttl: 2592000 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.enable_blob_files: false 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.min_blob_size: 0 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.blob_file_size: 268435456 2023-12-09T02:36:28.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.blob_file_starting_level: 0 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 29, last_sequence is 9868, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 175ff5bc-9f4b-4db6-ad57-367e391a4860 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702089388365352, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702089388375714, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 1198758, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 9869, "largest_seqno": 10485, "table_properties": {"data_size": 1195197, "index_size": 1843, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 6610, "raw_average_key_size": 23, "raw_value_size": 1189065, "raw_average_value_size": 4292, "num_data_blocks": 84, "num_entries": 277, "num_filter_entries": 277, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702089388, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "175ff5bc-9f4b-4db6-ad57-367e391a4860", "db_session_id": "EKQF1XI4Q2NFBL346PFB", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-09T02:36:28.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702089388375897, "job": 1, "event": "recovery_finished"} 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 bash[193370]: 8e4b2ba7b37cd36833b92141dbfe5b137c9964729f181afd18787f6d580059f1 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 systemd[1]: Started Ceph mon.smithi088 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi088/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56198061e000 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: DB pointer 0x56198060a000 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** DB Stats ** 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.1 total, 0.1 interval 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-09T02:36:28.681 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: L0 1/0 1.14 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.7 0.01 0.00 1 0.007 0 0 0.0 0.0 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: L6 1/0 6.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Sum 2/0 7.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.7 0.01 0.00 1 0.007 0 0 0.0 0.0 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.7 0.01 0.00 1 0.007 0 0 0.0 0.0 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2023-12-09T02:36:28.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 153.7 0.01 0.00 1 0.007 0 0 0.0 0.0 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.1 total, 0.1 interval 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Flush(GB): cumulative 0.001, interval 0.001 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative compaction: 0.00 GB write, 19.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval compaction: 0.00 GB write, 19.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:36:28.683 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-09T02:36:28.684 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Block cache BinnedLRUCache@0x5619805831f0#7 capacity: 512.00 MB usage: 2.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.6e-05 secs_since: 0 2023-12-09T02:36:28.684 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.78 KB,0.000149012%) IndexBlock(1,2.08 KB,0.000396371%) Misc(1,0.00 KB,0%) 2023-12-09T02:36:28.684 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2023-12-09T02:36:28.684 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-09T02:36:28.684 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: starting mon.smithi088 rank 0 at public addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] at bind addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi088 fsid 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:36:28.684 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: mon.smithi088@-1(???) e2 preinit fsid 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:36:28.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:36:28.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:36:28.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: pgmap v19: 65 pgs: 65 active+clean; 292 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 1.20k op/s 2023-12-09T02:36:28.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: mon.smithi088 calling monitor election 2023-12-09T02:36:28.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: mon.smithi088 is new leader, mons smithi088,smithi161 in quorum (ranks 0,1) 2023-12-09T02:36:28.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: monmap e2: 2 mons at {smithi088=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-09T02:36:28.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: fsmap cephfs:1 {0=cephfs.smithi161.dhvdif=up:active} 3 up:standby 2023-12-09T02:36:28.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: osdmap e49: 6 total, 6 up, 6 in 2023-12-09T02:36:28.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: mgrmap e32: smithi088.jwlofb(active, since 33s), standbys: smithi161.qmxtmg 2023-12-09T02:36:28.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: from='mgr.14710 ' entity='' 2023-12-09T02:36:28.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: mgrmap e33: smithi088.jwlofb(active, since 33s), standbys: smithi161.qmxtmg 2023-12-09T02:36:28.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:28 smithi088 ceph-mon[193406]: overall HEALTH_OK 2023-12-09T02:36:29.134 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:36:29.134 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: from='mgr.14710 172.21.15.88:0/2017304216' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:36:29.134 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: pgmap v19: 65 pgs: 65 active+clean; 292 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 1.20k op/s 2023-12-09T02:36:29.134 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: mon.smithi088 calling monitor election 2023-12-09T02:36:29.134 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: mon.smithi088 is new leader, mons smithi088,smithi161 in quorum (ranks 0,1) 2023-12-09T02:36:29.134 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: monmap e2: 2 mons at {smithi088=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-09T02:36:29.135 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: fsmap cephfs:1 {0=cephfs.smithi161.dhvdif=up:active} 3 up:standby 2023-12-09T02:36:29.135 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: osdmap e49: 6 total, 6 up, 6 in 2023-12-09T02:36:29.135 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: mgrmap e32: smithi088.jwlofb(active, since 33s), standbys: smithi161.qmxtmg 2023-12-09T02:36:29.135 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: from='mgr.14710 ' entity='' 2023-12-09T02:36:29.135 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: mgrmap e33: smithi088.jwlofb(active, since 33s), standbys: smithi161.qmxtmg 2023-12-09T02:36:29.135 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:28 smithi161 ceph-mon[121170]: overall HEALTH_OK 2023-12-09T02:36:36.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi161[121146]: 2023-12-09T02:36:36.293+0000 7f8bddb17700 -1 mon.smithi161@1(peon).osd e50 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-09T02:36:36.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: Active manager daemon smithi088.jwlofb restarted 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: Activating manager daemon smithi088.jwlofb 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: osdmap e50: 6 total, 6 up, 6 in 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: mgrmap e34: smithi088.jwlofb(active, starting, since 0.00787503s), standbys: smithi161.qmxtmg 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.zfojux"}]: dispatch 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.utskxh"}]: dispatch 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.dhvdif"}]: dispatch 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.posrbq"}]: dispatch 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi088.jwlofb", "id": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi161.qmxtmg", "id": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:36:36.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:36:36.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:36:36.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:36:36.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:36:36.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-09T02:36:36.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-09T02:36:36.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-09T02:36:36.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:36 smithi161 ceph-mon[121170]: Manager daemon smithi088.jwlofb is now available 2023-12-09T02:36:36.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: Active manager daemon smithi088.jwlofb restarted 2023-12-09T02:36:36.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: Activating manager daemon smithi088.jwlofb 2023-12-09T02:36:36.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: osdmap e50: 6 total, 6 up, 6 in 2023-12-09T02:36:36.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: mgrmap e34: smithi088.jwlofb(active, starting, since 0.00787503s), standbys: smithi161.qmxtmg 2023-12-09T02:36:36.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:36:36.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:36:36.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.zfojux"}]: dispatch 2023-12-09T02:36:36.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.utskxh"}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.dhvdif"}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.posrbq"}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi088.jwlofb", "id": "smithi088.jwlofb"}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr metadata", "who": "smithi161.qmxtmg", "id": "smithi161.qmxtmg"}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-09T02:36:36.428 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:36 smithi088 ceph-mon[193406]: Manager daemon smithi088.jwlofb is now available 2023-12-09T02:36:37.516 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:37 smithi161 ceph-mon[121170]: failed to encode map e50 with expected crc 2023-12-09T02:36:37.516 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:37 smithi161 ceph-mon[121170]: failed to encode map e50 with expected crc 2023-12-09T02:36:37.516 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:37 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:37.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:37 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:37.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:37 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:36:37.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:37 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:36:37.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:37 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/trash_purge_schedule"}]: dispatch 2023-12-09T02:36:37.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:37 smithi161 ceph-mon[121170]: mgrmap e35: smithi088.jwlofb(active, since 1.00848s), standbys: smithi161.qmxtmg 2023-12-09T02:36:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:37 smithi088 ceph-mon[193406]: failed to encode map e50 with expected crc 2023-12-09T02:36:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:37 smithi088 ceph-mon[193406]: failed to encode map e50 with expected crc 2023-12-09T02:36:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:36:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/mirror_snapshot_schedule"}]: dispatch 2023-12-09T02:36:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.jwlofb/trash_purge_schedule"}]: dispatch 2023-12-09T02:36:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:37 smithi088 ceph-mon[193406]: mgrmap e35: smithi088.jwlofb(active, since 1.00848s), standbys: smithi161.qmxtmg 2023-12-09T02:36:38.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:38 smithi161 ceph-mon[121170]: [09/Dec/2023:02:36:37] ENGINE Bus STARTING 2023-12-09T02:36:38.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:38 smithi161 ceph-mon[121170]: pgmap v3: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:36:38.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:38 smithi161 ceph-mon[121170]: [09/Dec/2023:02:36:37] ENGINE Serving on http://172.21.15.88:8765 2023-12-09T02:36:38.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:38 smithi161 ceph-mon[121170]: [09/Dec/2023:02:36:37] ENGINE Serving on https://172.21.15.88:7150 2023-12-09T02:36:38.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:38 smithi161 ceph-mon[121170]: [09/Dec/2023:02:36:37] ENGINE Bus STARTED 2023-12-09T02:36:38.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:38 smithi161 ceph-mon[121170]: Standby manager daemon smithi161.qmxtmg restarted 2023-12-09T02:36:38.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:38 smithi161 ceph-mon[121170]: Standby manager daemon smithi161.qmxtmg started 2023-12-09T02:36:38.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:38 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/713931523' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/crt"}]: dispatch 2023-12-09T02:36:38.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:38 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/713931523' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:36:38.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:38 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/713931523' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/key"}]: dispatch 2023-12-09T02:36:38.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:38 smithi161 ceph-mon[121170]: from='mgr.? 172.21.15.161:0/713931523' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:36:38.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:38 smithi088 ceph-mon[193406]: [09/Dec/2023:02:36:37] ENGINE Bus STARTING 2023-12-09T02:36:38.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:38 smithi088 ceph-mon[193406]: pgmap v3: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:36:38.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:38 smithi088 ceph-mon[193406]: [09/Dec/2023:02:36:37] ENGINE Serving on http://172.21.15.88:8765 2023-12-09T02:36:38.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:38 smithi088 ceph-mon[193406]: [09/Dec/2023:02:36:37] ENGINE Serving on https://172.21.15.88:7150 2023-12-09T02:36:38.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:38 smithi088 ceph-mon[193406]: [09/Dec/2023:02:36:37] ENGINE Bus STARTED 2023-12-09T02:36:38.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:38 smithi088 ceph-mon[193406]: Standby manager daemon smithi161.qmxtmg restarted 2023-12-09T02:36:38.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:38 smithi088 ceph-mon[193406]: Standby manager daemon smithi161.qmxtmg started 2023-12-09T02:36:38.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:38 smithi088 ceph-mon[193406]: from='mgr.? 172.21.15.161:0/713931523' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/crt"}]: dispatch 2023-12-09T02:36:38.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:38 smithi088 ceph-mon[193406]: from='mgr.? 172.21.15.161:0/713931523' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-09T02:36:38.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:38 smithi088 ceph-mon[193406]: from='mgr.? 172.21.15.161:0/713931523' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.qmxtmg/key"}]: dispatch 2023-12-09T02:36:38.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:38 smithi088 ceph-mon[193406]: from='mgr.? 172.21.15.161:0/713931523' entity='mgr.smithi161.qmxtmg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-09T02:36:39.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:39 smithi161 ceph-mon[121170]: pgmap v4: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:36:39.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:39 smithi161 ceph-mon[121170]: mgrmap e36: smithi088.jwlofb(active, since 2s), standbys: smithi161.qmxtmg 2023-12-09T02:36:39.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:39 smithi088 ceph-mon[193406]: pgmap v4: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:36:39.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:39 smithi088 ceph-mon[193406]: mgrmap e36: smithi088.jwlofb(active, since 2s), standbys: smithi161.qmxtmg 2023-12-09T02:36:41.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:40 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:41.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:40 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:41.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:40 smithi088 ceph-mon[193406]: pgmap v5: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:36:41.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:40 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:41.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:40 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:41.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:40 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:41.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:40 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:41.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:40 smithi161 ceph-mon[121170]: pgmap v5: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:36:41.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:40 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:41.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:40 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:42.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:41 smithi161 ceph-mon[121170]: mgrmap e37: smithi088.jwlofb(active, since 4s), standbys: smithi161.qmxtmg 2023-12-09T02:36:42.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:41 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:42.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:41 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:42.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:41 smithi088 ceph-mon[193406]: mgrmap e37: smithi088.jwlofb(active, since 4s), standbys: smithi161.qmxtmg 2023-12-09T02:36:42.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:41 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:42.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:41 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:43.336 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:43 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:43.337 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:43 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:43.337 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:43 smithi161 ceph-mon[121170]: pgmap v6: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6.4 KiB/s wr, 195 op/s 2023-12-09T02:36:43.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:43 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:43.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:43 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:43.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:43 smithi088 ceph-mon[193406]: pgmap v6: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6.4 KiB/s wr, 195 op/s 2023-12-09T02:36:43.515 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-09T02:36:43.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-09T02:36:43.859 DEBUG:teuthology.parallel:result is None 2023-12-09T02:36:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:36:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: Updating smithi088:/etc/ceph/ceph.conf 2023-12-09T02:36:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: Updating smithi161:/etc/ceph/ceph.conf 2023-12-09T02:36:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:36:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:36:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: pgmap v7: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 1.2 MiB/s wr, 415 op/s 2023-12-09T02:36:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:36:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:36:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:36:44.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:44 smithi088 ceph-mon[193406]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:36:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:36:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: Updating smithi088:/etc/ceph/ceph.conf 2023-12-09T02:36:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: Updating smithi161:/etc/ceph/ceph.conf 2023-12-09T02:36:45.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:36:45.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-09T02:36:45.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: pgmap v7: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 1.2 MiB/s wr, 415 op/s 2023-12-09T02:36:45.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:36:45.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-12-09T02:36:45.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: Updating smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:36:45.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:44 smithi161 ceph-mon[121170]: Updating smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-09T02:36:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.110+0000 7ff0b9d62700 1 -- 172.21.15.88:0/412360488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0b4066920 msgr2=0x7ff0b40ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.110+0000 7ff0b9d62700 1 --2- 172.21.15.88:0/412360488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0b4066920 0x7ff0b40ff7a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8004940 tx=0x7ff0a8009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.110+0000 7ff0b9d62700 1 -- 172.21.15.88:0/412360488 shutdown_connections 2023-12-09T02:36:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.110+0000 7ff0b9d62700 1 --2- 172.21.15.88:0/412360488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b40ffd70 0x7ff0b41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.110+0000 7ff0b9d62700 1 --2- 172.21.15.88:0/412360488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0b4066920 0x7ff0b40ff7a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.110+0000 7ff0b9d62700 1 -- 172.21.15.88:0/412360488 >> 172.21.15.88:0/412360488 conn(0x7ff0b40f71d0 msgr2=0x7ff0b40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.110+0000 7ff0b9d62700 1 -- 172.21.15.88:0/412360488 shutdown_connections 2023-12-09T02:36:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.110+0000 7ff0b9d62700 1 -- 172.21.15.88:0/412360488 wait complete. 2023-12-09T02:36:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b9d62700 1 Processor -- start 2023-12-09T02:36:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b9d62700 1 -- start start 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b9d62700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b4066920 0x7ff0b410d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b9d62700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0b40ffd70 0x7ff0b410d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b9d62700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b410dff0 con 0x7ff0b40ffd70 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b9d62700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b410e890 con 0x7ff0b4066920 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0b40ffd70 0x7ff0b410d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0b40ffd70 0x7ff0b410d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45410/0 (socket says 172.21.15.88:45410) 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b2ffd700 1 -- 172.21.15.88:0/3425866145 learned_addr learned my addr 172.21.15.88:0/3425866145 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b37fe700 1 --2- 172.21.15.88:0/3425866145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b4066920 0x7ff0b410d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b2ffd700 1 -- 172.21.15.88:0/3425866145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b4066920 msgr2=0x7ff0b410d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b2ffd700 1 --2- 172.21.15.88:0/3425866145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b4066920 0x7ff0b410d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.111+0000 7ff0b2ffd700 1 -- 172.21.15.88:0/3425866145 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8005040 con 0x7ff0b40ffd70 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.112+0000 7ff0b2ffd700 1 --2- 172.21.15.88:0/3425866145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0b40ffd70 0x7ff0b410d9f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400eb40 tx=0x7ff0a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.112+0000 7ff09bfff700 1 -- 172.21.15.88:0/3425866145 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a4007cc0 con 0x7ff0b40ffd70 2023-12-09T02:36:46.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.112+0000 7ff09bfff700 1 -- 172.21.15.88:0/3425866145 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff0a400f040 con 0x7ff0b40ffd70 2023-12-09T02:36:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.112+0000 7ff0b9d62700 1 -- 172.21.15.88:0/3425866145 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b410eb10 con 0x7ff0b40ffd70 2023-12-09T02:36:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.112+0000 7ff09bfff700 1 -- 172.21.15.88:0/3425866145 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a400c8f0 con 0x7ff0b40ffd70 2023-12-09T02:36:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.112+0000 7ff0b9d62700 1 -- 172.21.15.88:0/3425866145 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b410f050 con 0x7ff0b40ffd70 2023-12-09T02:36:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.113+0000 7ff0b9d62700 1 -- 172.21.15.88:0/3425866145 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b404bb80 con 0x7ff0b40ffd70 2023-12-09T02:36:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.113+0000 7ff09bfff700 1 -- 172.21.15.88:0/3425866145 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7ff0a400cb60 con 0x7ff0b40ffd70 2023-12-09T02:36:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.113+0000 7ff09bfff700 1 --2- 172.21.15.88:0/3425866145 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff09c06cf80 0x7ff09c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.114+0000 7ff09bfff700 1 -- 172.21.15.88:0/3425866145 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff0a408bf90 con 0x7ff0b40ffd70 2023-12-09T02:36:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.114+0000 7ff0b37fe700 1 --2- 172.21.15.88:0/3425866145 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff09c06cf80 0x7ff09c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.114+0000 7ff0b37fe700 1 --2- 172.21.15.88:0/3425866145 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff09c06cf80 0x7ff09c06f430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8000c00 tx=0x7ff0a8009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.118+0000 7ff09bfff700 1 -- 172.21.15.88:0/3425866145 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff0a4059730 con 0x7ff0b40ffd70 2023-12-09T02:36:46.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:45 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:46.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:45 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:46.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:45 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:46.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:45 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:46.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:45 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:46.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:45 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:46.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:45 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:36:46.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:45 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-09T02:36:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:46.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:36:46.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-09T02:36:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.353+0000 7ff0b9d62700 1 -- 172.21.15.88:0/3425866145 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0b410f4a0 con 0x7ff09c06cf80 2023-12-09T02:36:46.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.354+0000 7ff09bfff700 1 -- 172.21.15.88:0/3425866145 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7ff0b410f4a0 con 0x7ff09c06cf80 2023-12-09T02:36:46.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.356+0000 7ff0b9d62700 1 -- 172.21.15.88:0/3425866145 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff09c06cf80 msgr2=0x7ff09c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.356+0000 7ff0b9d62700 1 --2- 172.21.15.88:0/3425866145 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff09c06cf80 0x7ff09c06f430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8000c00 tx=0x7ff0a8009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.356+0000 7ff0b9d62700 1 -- 172.21.15.88:0/3425866145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0b40ffd70 msgr2=0x7ff0b410d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.356+0000 7ff0b9d62700 1 --2- 172.21.15.88:0/3425866145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0b40ffd70 0x7ff0b410d9f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400eb40 tx=0x7ff0a400b040 comp rx=0 tx=0).stop 2023-12-09T02:36:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.356+0000 7ff0b9d62700 1 -- 172.21.15.88:0/3425866145 shutdown_connections 2023-12-09T02:36:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.356+0000 7ff0b9d62700 1 --2- 172.21.15.88:0/3425866145 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff09c06cf80 0x7ff09c06f430 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.356+0000 7ff0b9d62700 1 --2- 172.21.15.88:0/3425866145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b4066920 0x7ff0b410d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.356+0000 7ff0b9d62700 1 --2- 172.21.15.88:0/3425866145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0b40ffd70 0x7ff0b410d9f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.356+0000 7ff0b9d62700 1 -- 172.21.15.88:0/3425866145 >> 172.21.15.88:0/3425866145 conn(0x7ff0b40f71d0 msgr2=0x7ff0b40f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.356+0000 7ff0b9d62700 1 -- 172.21.15.88:0/3425866145 shutdown_connections 2023-12-09T02:36:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.356+0000 7ff0b9d62700 1 -- 172.21.15.88:0/3425866145 wait complete. 2023-12-09T02:36:46.369 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:36:46.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.463+0000 7fd0e4329700 1 -- 172.21.15.88:0/490199860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc066920 msgr2=0x7fd0dc101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.463+0000 7fd0e4329700 1 --2- 172.21.15.88:0/490199860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc066920 0x7fd0dc101ba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8004940 tx=0x7fd0d8009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 -- 172.21.15.88:0/490199860 shutdown_connections 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 --2- 172.21.15.88:0/490199860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0dc1020e0 0x7fd0dc1044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 --2- 172.21.15.88:0/490199860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc066920 0x7fd0dc101ba0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 -- 172.21.15.88:0/490199860 >> 172.21.15.88:0/490199860 conn(0x7fd0dc0f71b0 msgr2=0x7fd0dc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 -- 172.21.15.88:0/490199860 shutdown_connections 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 -- 172.21.15.88:0/490199860 wait complete. 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 Processor -- start 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 -- start start 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0dc066920 0x7fd0dc10f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc1020e0 0x7fd0dc10fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc110220 con 0x7fd0dc1020e0 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e4329700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc110ac0 con 0x7fd0dc066920 2023-12-09T02:36:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e18c4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc1020e0 0x7fd0dc10fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e18c4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc1020e0 0x7fd0dc10fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39232/0 (socket says 172.21.15.88:39232) 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e18c4700 1 -- 172.21.15.88:0/3422509986 learned_addr learned my addr 172.21.15.88:0/3422509986 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.464+0000 7fd0e20c5700 1 --2- 172.21.15.88:0/3422509986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0dc066920 0x7fd0dc10f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.465+0000 7fd0e18c4700 1 -- 172.21.15.88:0/3422509986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0dc066920 msgr2=0x7fd0dc10f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.465+0000 7fd0e18c4700 1 --2- 172.21.15.88:0/3422509986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0dc066920 0x7fd0dc10f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.465+0000 7fd0e18c4700 1 -- 172.21.15.88:0/3422509986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d8005040 con 0x7fd0dc1020e0 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.465+0000 7fd0e18c4700 1 --2- 172.21.15.88:0/3422509986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc1020e0 0x7fd0dc10fc20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00eb40 tx=0x7fd0cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.465+0000 7fd0d2ffd700 1 -- 172.21.15.88:0/3422509986 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0cc007cc0 con 0x7fd0dc1020e0 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.465+0000 7fd0e4329700 1 -- 172.21.15.88:0/3422509986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc110d40 con 0x7fd0dc1020e0 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.465+0000 7fd0d2ffd700 1 -- 172.21.15.88:0/3422509986 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0cc00f040 con 0x7fd0dc1020e0 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.465+0000 7fd0d2ffd700 1 -- 172.21.15.88:0/3422509986 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0cc00c8f0 con 0x7fd0dc1020e0 2023-12-09T02:36:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.465+0000 7fd0e4329700 1 -- 172.21.15.88:0/3422509986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc111280 con 0x7fd0dc1020e0 2023-12-09T02:36:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.466+0000 7fd0e4329700 1 -- 172.21.15.88:0/3422509986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc04bb80 con 0x7fd0dc1020e0 2023-12-09T02:36:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.466+0000 7fd0d2ffd700 1 -- 172.21.15.88:0/3422509986 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fd0cc00cb60 con 0x7fd0dc1020e0 2023-12-09T02:36:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.467+0000 7fd0d2ffd700 1 --2- 172.21.15.88:0/3422509986 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd0c806cf80 0x7fd0c806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.467+0000 7fd0d2ffd700 1 -- 172.21.15.88:0/3422509986 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd0cc08bf90 con 0x7fd0dc1020e0 2023-12-09T02:36:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.467+0000 7fd0e20c5700 1 --2- 172.21.15.88:0/3422509986 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd0c806cf80 0x7fd0c806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.467+0000 7fd0e20c5700 1 --2- 172.21.15.88:0/3422509986 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd0c806cf80 0x7fd0c806f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8000c00 tx=0x7fd0d8009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.472+0000 7fd0d2ffd700 1 -- 172.21.15.88:0/3422509986 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd0cc059730 con 0x7fd0dc1020e0 2023-12-09T02:36:46.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.703+0000 7fd0e4329700 1 -- 172.21.15.88:0/3422509986 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0dc1116d0 con 0x7fd0c806cf80 2023-12-09T02:36:46.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.705+0000 7fd0d2ffd700 1 -- 172.21.15.88:0/3422509986 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd0dc1116d0 con 0x7fd0c806cf80 2023-12-09T02:36:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.708+0000 7fd0e4329700 1 -- 172.21.15.88:0/3422509986 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd0c806cf80 msgr2=0x7fd0c806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.708+0000 7fd0e4329700 1 --2- 172.21.15.88:0/3422509986 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd0c806cf80 0x7fd0c806f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8000c00 tx=0x7fd0d8009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.708+0000 7fd0e4329700 1 -- 172.21.15.88:0/3422509986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc1020e0 msgr2=0x7fd0dc10fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.708+0000 7fd0e4329700 1 --2- 172.21.15.88:0/3422509986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc1020e0 0x7fd0dc10fc20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00eb40 tx=0x7fd0cc00b040 comp rx=0 tx=0).stop 2023-12-09T02:36:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.709+0000 7fd0e4329700 1 -- 172.21.15.88:0/3422509986 shutdown_connections 2023-12-09T02:36:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.709+0000 7fd0e4329700 1 --2- 172.21.15.88:0/3422509986 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd0c806cf80 0x7fd0c806f430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.709+0000 7fd0e4329700 1 --2- 172.21.15.88:0/3422509986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0dc066920 0x7fd0dc10f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.709+0000 7fd0e4329700 1 --2- 172.21.15.88:0/3422509986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc1020e0 0x7fd0dc10fc20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.709+0000 7fd0e4329700 1 -- 172.21.15.88:0/3422509986 >> 172.21.15.88:0/3422509986 conn(0x7fd0dc0f71b0 msgr2=0x7fd0dc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:46.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.712+0000 7fd0e4329700 1 -- 172.21.15.88:0/3422509986 shutdown_connections 2023-12-09T02:36:46.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.713+0000 7fd0e4329700 1 -- 172.21.15.88:0/3422509986 wait complete. 2023-12-09T02:36:46.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.864+0000 7f8c65ced700 1 -- 172.21.15.88:0/3681103864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c600fd120 msgr2=0x7f8c600fd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:46.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.864+0000 7f8c65ced700 1 --2- 172.21.15.88:0/3681103864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c600fd120 0x7f8c600fd530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8c50004940 tx=0x7f8c50009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.864+0000 7f8c65ced700 1 -- 172.21.15.88:0/3681103864 shutdown_connections 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.864+0000 7f8c65ced700 1 --2- 172.21.15.88:0/3681103864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c600fbe30 0x7f8c600fc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.864+0000 7f8c65ced700 1 --2- 172.21.15.88:0/3681103864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c600fd120 0x7f8c600fd530 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.864+0000 7f8c65ced700 1 -- 172.21.15.88:0/3681103864 >> 172.21.15.88:0/3681103864 conn(0x7f8c600f6950 msgr2=0x7f8c600f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.864+0000 7f8c65ced700 1 -- 172.21.15.88:0/3681103864 shutdown_connections 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.864+0000 7f8c65ced700 1 -- 172.21.15.88:0/3681103864 wait complete. 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.864+0000 7f8c65ced700 1 Processor -- start 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c65ced700 1 -- start start 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c65ced700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c600fbe30 0x7f8c6010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c65ced700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c600fd120 0x7f8c6010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c65ced700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6010e0c0 con 0x7f8c600fd120 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c65ced700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6010e960 con 0x7f8c600fbe30 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c5effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c600fd120 0x7f8c6010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:46.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c5effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c600fd120 0x7f8c6010dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39256/0 (socket says 172.21.15.88:39256) 2023-12-09T02:36:46.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c5effd700 1 -- 172.21.15.88:0/3987924267 learned_addr learned my addr 172.21.15.88:0/3987924267 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:46.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c5f7fe700 1 --2- 172.21.15.88:0/3987924267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c600fbe30 0x7f8c6010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:46.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c5effd700 1 -- 172.21.15.88:0/3987924267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c600fbe30 msgr2=0x7f8c6010d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:46.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c5effd700 1 --2- 172.21.15.88:0/3987924267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c600fbe30 0x7f8c6010d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:46.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c5effd700 1 -- 172.21.15.88:0/3987924267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c50005040 con 0x7f8c600fd120 2023-12-09T02:36:46.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c5effd700 1 --2- 172.21.15.88:0/3987924267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c600fd120 0x7f8c6010dac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400eb40 tx=0x7f8c5400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:46.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.865+0000 7f8c47fff700 1 -- 172.21.15.88:0/3987924267 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c54007cc0 con 0x7f8c600fd120 2023-12-09T02:36:46.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.866+0000 7f8c65ced700 1 -- 172.21.15.88:0/3987924267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6010ebe0 con 0x7f8c600fd120 2023-12-09T02:36:46.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.866+0000 7f8c47fff700 1 -- 172.21.15.88:0/3987924267 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c5400f040 con 0x7f8c600fd120 2023-12-09T02:36:46.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.866+0000 7f8c47fff700 1 -- 172.21.15.88:0/3987924267 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c5400c990 con 0x7f8c600fd120 2023-12-09T02:36:46.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.866+0000 7f8c65ced700 1 -- 172.21.15.88:0/3987924267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6010f120 con 0x7f8c600fd120 2023-12-09T02:36:46.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.866+0000 7f8c65ced700 1 -- 172.21.15.88:0/3987924267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6004bb80 con 0x7f8c600fd120 2023-12-09T02:36:46.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.867+0000 7f8c47fff700 1 -- 172.21.15.88:0/3987924267 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f8c5400cc00 con 0x7f8c600fd120 2023-12-09T02:36:46.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.867+0000 7f8c47fff700 1 --2- 172.21.15.88:0/3987924267 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8c4806cf80 0x7f8c4806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:46.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.868+0000 7f8c5f7fe700 1 --2- 172.21.15.88:0/3987924267 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8c4806cf80 0x7f8c4806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:46.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.868+0000 7f8c47fff700 1 -- 172.21.15.88:0/3987924267 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f8c5408c1b0 con 0x7f8c600fd120 2023-12-09T02:36:46.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.868+0000 7f8c5f7fe700 1 --2- 172.21.15.88:0/3987924267 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8c4806cf80 0x7f8c4806f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000c00 tx=0x7f8c50009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:46.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:46.872+0000 7f8c47fff700 1 -- 172.21.15.88:0/3987924267 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8c54059950 con 0x7f8c600fd120 2023-12-09T02:36:47.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.088+0000 7f8c65ced700 1 -- 172.21.15.88:0/3987924267 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c6010f570 con 0x7f8c4806cf80 2023-12-09T02:36:47.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.099+0000 7f8c47fff700 1 -- 172.21.15.88:0/3987924267 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f8c6010f570 con 0x7f8c4806cf80 2023-12-09T02:36:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:36:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (70s) 5s ago 7m 28.5M - 0.25.0 c8568f914cd2 9dc2b8db0963 2023-12-09T02:36:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (7m) 5s ago 7m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 9098f424ee11 2023-12-09T02:36:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (7m) 7s ago 7m 7486k - 17.2.7-119-ge2143d99 f761b6e42225 15c5154f5f2e 2023-12-09T02:36:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (68s) 5s ago 7m 83.3M - 9.4.7 954c08fa6188 ab4c3f64ce4d 2023-12-09T02:36:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (3m) 5s ago 3m 14.1M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:36:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (3m) 5s ago 3m 15.5M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:36:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (3m) 7s ago 3m 9481M - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:36:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (3m) 7s ago 3m 15.2M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:36:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:8443,9283,8765 running (59s) 5s ago 8m 476M - 19.0.0-44-g9dcc13bb f28f2b94f153 a939ff288750 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283,8765 running (32s) 7s ago 7m 406M - 19.0.0-44-g9dcc13bb f28f2b94f153 e2ee2a6eb30b 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (18s) 5s ago 8m 29.9M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 8e4b2ba7b37c 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (6m) 7s ago 6m 69.9M 2048M 17.2.7-119-ge2143d99 f761b6e42225 d6b9d9265450 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (73s) 5s ago 7m 17.1M - 1.5.0 0da6a335fe13 e2b7cc0b7527 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (63s) 7s ago 7m 17.0M - 1.5.0 0da6a335fe13 0de833ab198e 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (6m) 5s ago 6m 802M 1568M 17.2.7-119-ge2143d99 f761b6e42225 fdd606881a64 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (6m) 5s ago 6m 848M 1568M 17.2.7-119-ge2143d99 f761b6e42225 354d4a4d3430 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (5m) 5s ago 5m 702M 1568M 17.2.7-119-ge2143d99 f761b6e42225 0b0abbb070ec 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (5m) 7s ago 5m 1049M 2592M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (5m) 7s ago 5m 773M 2592M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (4m) 7s ago 4m 878M 2592M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:36:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (38s) 5s ago 7m 47.5M - 2.43.0 a07b618ecd1d ddb1fb2e1888 2023-12-09T02:36:47.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.101+0000 7f8c65ced700 1 -- 172.21.15.88:0/3987924267 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8c4806cf80 msgr2=0x7f8c4806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:47.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.101+0000 7f8c65ced700 1 --2- 172.21.15.88:0/3987924267 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8c4806cf80 0x7f8c4806f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000c00 tx=0x7f8c50009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:47.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.101+0000 7f8c65ced700 1 -- 172.21.15.88:0/3987924267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c600fd120 msgr2=0x7f8c6010dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:47.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.101+0000 7f8c65ced700 1 --2- 172.21.15.88:0/3987924267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c600fd120 0x7f8c6010dac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400eb40 tx=0x7f8c5400b040 comp rx=0 tx=0).stop 2023-12-09T02:36:47.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.102+0000 7f8c65ced700 1 -- 172.21.15.88:0/3987924267 shutdown_connections 2023-12-09T02:36:47.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.102+0000 7f8c65ced700 1 --2- 172.21.15.88:0/3987924267 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8c4806cf80 0x7f8c4806f430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.102+0000 7f8c65ced700 1 --2- 172.21.15.88:0/3987924267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c600fbe30 0x7f8c6010d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.102+0000 7f8c65ced700 1 --2- 172.21.15.88:0/3987924267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c600fd120 0x7f8c6010dac0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.102+0000 7f8c65ced700 1 -- 172.21.15.88:0/3987924267 >> 172.21.15.88:0/3987924267 conn(0x7f8c600f6950 msgr2=0x7f8c600fad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:47.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.102+0000 7f8c65ced700 1 -- 172.21.15.88:0/3987924267 shutdown_connections 2023-12-09T02:36:47.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.102+0000 7f8c65ced700 1 -- 172.21.15.88:0/3987924267 wait complete. 2023-12-09T02:36:47.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.207+0000 7f2839455700 1 -- 172.21.15.88:0/2228495013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28340ffd70 msgr2=0x7f28341021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:47.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.207+0000 7f2839455700 1 --2- 172.21.15.88:0/2228495013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28340ffd70 0x7f28341021d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2828004940 tx=0x7f2828009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:47.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.207+0000 7f2839455700 1 -- 172.21.15.88:0/2228495013 shutdown_connections 2023-12-09T02:36:47.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.207+0000 7f2839455700 1 --2- 172.21.15.88:0/2228495013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28340ffd70 0x7f28341021d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.207+0000 7f2839455700 1 --2- 172.21.15.88:0/2228495013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2834066090 0x7f28340ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.207+0000 7f2839455700 1 -- 172.21.15.88:0/2228495013 >> 172.21.15.88:0/2228495013 conn(0x7f28340f7190 msgr2=0x7f28340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:47.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.207+0000 7f2839455700 1 -- 172.21.15.88:0/2228495013 shutdown_connections 2023-12-09T02:36:47.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.207+0000 7f2839455700 1 -- 172.21.15.88:0/2228495013 wait complete. 2023-12-09T02:36:47.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.207+0000 7f2839455700 1 Processor -- start 2023-12-09T02:36:47.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.207+0000 7f2839455700 1 -- start start 2023-12-09T02:36:47.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2839455700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2834066090 0x7f283410d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:47.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2839455700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28340ffd70 0x7f283410d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2839455700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283410dfc0 con 0x7f2834066090 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2839455700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283410e860 con 0x7f28340ffd70 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2832ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2834066090 0x7f283410d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2832ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2834066090 0x7f283410d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39268/0 (socket says 172.21.15.88:39268) 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2832ffd700 1 -- 172.21.15.88:0/719694282 learned_addr learned my addr 172.21.15.88:0/719694282 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f28327fc700 1 --2- 172.21.15.88:0/719694282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28340ffd70 0x7f283410d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2832ffd700 1 -- 172.21.15.88:0/719694282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28340ffd70 msgr2=0x7f283410d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2832ffd700 1 --2- 172.21.15.88:0/719694282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28340ffd70 0x7f283410d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2832ffd700 1 -- 172.21.15.88:0/719694282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2828005040 con 0x7f2834066090 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2832ffd700 1 --2- 172.21.15.88:0/719694282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2834066090 0x7f283410d480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f282400eb40 tx=0x7f282400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f281b7fe700 1 -- 172.21.15.88:0/719694282 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2824007cc0 con 0x7f2834066090 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2839455700 1 -- 172.21.15.88:0/719694282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283410eae0 con 0x7f2834066090 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f281b7fe700 1 -- 172.21.15.88:0/719694282 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f282400f040 con 0x7f2834066090 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f281b7fe700 1 -- 172.21.15.88:0/719694282 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f282400c990 con 0x7f2834066090 2023-12-09T02:36:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.208+0000 7f2839455700 1 -- 172.21.15.88:0/719694282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283410f020 con 0x7f2834066090 2023-12-09T02:36:47.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.209+0000 7f2839455700 1 -- 172.21.15.88:0/719694282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283404bb80 con 0x7f2834066090 2023-12-09T02:36:47.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.210+0000 7f281b7fe700 1 -- 172.21.15.88:0/719694282 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f282400cc00 con 0x7f2834066090 2023-12-09T02:36:47.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.210+0000 7f281b7fe700 1 --2- 172.21.15.88:0/719694282 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f281c06cf80 0x7f281c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:47.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.210+0000 7f281b7fe700 1 -- 172.21.15.88:0/719694282 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f282408c1b0 con 0x7f2834066090 2023-12-09T02:36:47.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.210+0000 7f28327fc700 1 --2- 172.21.15.88:0/719694282 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f281c06cf80 0x7f281c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:47.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.211+0000 7f28327fc700 1 --2- 172.21.15.88:0/719694282 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f281c06cf80 0x7f281c06f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2828013680 tx=0x7f2828009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:47.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.215+0000 7f281b7fe700 1 -- 172.21.15.88:0/719694282 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2824059950 con 0x7f2834066090 2023-12-09T02:36:47.475 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 ceph-mon[121170]: Upgrade: Updating mon.smithi161 2023-12-09T02:36:47.475 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:47.475 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:36:47.475 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:36:47.475 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 ceph-mon[121170]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:47.475 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 ceph-mon[121170]: Deploying daemon mon.smithi161 on smithi161 2023-12-09T02:36:47.475 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 ceph-mon[121170]: pgmap v8: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 962 KiB/s wr, 323 op/s 2023-12-09T02:36:47.475 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 ceph-mon[121170]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:47.475 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 ceph-mon[121170]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:47.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.507+0000 7f2839455700 1 -- 172.21.15.88:0/719694282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f283410f3d0 con 0x7f2834066090 2023-12-09T02:36:47.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.508+0000 7f281b7fe700 1 -- 172.21.15.88:0/719694282 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+834 (secure 0 0 0) 0x7f28240594e0 con 0x7f2834066090 2023-12-09T02:36:47.510 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:36:47.510 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:36:47.510 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 1, 2023-12-09T02:36:47.510 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 1 2023-12-09T02:36:47.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:36:47.510 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 11, 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 3 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:36:47.511 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:36:47.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.510+0000 7f2839455700 1 -- 172.21.15.88:0/719694282 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f281c06cf80 msgr2=0x7f281c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:47.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.510+0000 7f2839455700 1 --2- 172.21.15.88:0/719694282 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f281c06cf80 0x7f281c06f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2828013680 tx=0x7f2828009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:47.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.510+0000 7f2839455700 1 -- 172.21.15.88:0/719694282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2834066090 msgr2=0x7f283410d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:47.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.510+0000 7f2839455700 1 --2- 172.21.15.88:0/719694282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2834066090 0x7f283410d480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f282400eb40 tx=0x7f282400b040 comp rx=0 tx=0).stop 2023-12-09T02:36:47.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.510+0000 7f2839455700 1 -- 172.21.15.88:0/719694282 shutdown_connections 2023-12-09T02:36:47.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.510+0000 7f2839455700 1 --2- 172.21.15.88:0/719694282 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f281c06cf80 0x7f281c06f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.510+0000 7f2839455700 1 --2- 172.21.15.88:0/719694282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2834066090 0x7f283410d480 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.510+0000 7f2839455700 1 --2- 172.21.15.88:0/719694282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28340ffd70 0x7f283410d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.510+0000 7f2839455700 1 -- 172.21.15.88:0/719694282 >> 172.21.15.88:0/719694282 conn(0x7f28340f7190 msgr2=0x7f28340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:47.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.510+0000 7f2839455700 1 -- 172.21.15.88:0/719694282 shutdown_connections 2023-12-09T02:36:47.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.510+0000 7f2839455700 1 -- 172.21.15.88:0/719694282 wait complete. 2023-12-09T02:36:47.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 -- 172.21.15.88:0/3218687501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfec0fdf60 msgr2=0x7fdfec0fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 --2- 172.21.15.88:0/3218687501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfec0fdf60 0x7fdfec0fe3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc004940 tx=0x7fdfdc009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 -- 172.21.15.88:0/3218687501 shutdown_connections 2023-12-09T02:36:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 --2- 172.21.15.88:0/3218687501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfec0fdf60 0x7fdfec0fe3b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 --2- 172.21.15.88:0/3218687501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec0faed0 0x7fdfec0fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 -- 172.21.15.88:0/3218687501 >> 172.21.15.88:0/3218687501 conn(0x7fdfec0f6950 msgr2=0x7fdfec0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 -- 172.21.15.88:0/3218687501 shutdown_connections 2023-12-09T02:36:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 -- 172.21.15.88:0/3218687501 wait complete. 2023-12-09T02:36:47.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 Processor -- start 2023-12-09T02:36:47.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 -- start start 2023-12-09T02:36:47.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfec0faed0 0x7fdfec10d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:47.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec0fdf60 0x7fdfec10db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:47.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec10e140 con 0x7fdfec0faed0 2023-12-09T02:36:47.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff3b56700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec10e9e0 con 0x7fdfec0fdf60 2023-12-09T02:36:47.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.619+0000 7fdff18f2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfec0faed0 0x7fdfec10d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:47.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdff18f2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfec0faed0 0x7fdfec10d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39286/0 (socket says 172.21.15.88:39286) 2023-12-09T02:36:47.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdff18f2700 1 -- 172.21.15.88:0/1513115689 learned_addr learned my addr 172.21.15.88:0/1513115689 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:47.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdff10f1700 1 --2- 172.21.15.88:0/1513115689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec0fdf60 0x7fdfec10db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:47.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdff18f2700 1 -- 172.21.15.88:0/1513115689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec0fdf60 msgr2=0x7fdfec10db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:47.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdff18f2700 1 --2- 172.21.15.88:0/1513115689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec0fdf60 0x7fdfec10db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdff18f2700 1 -- 172.21.15.88:0/1513115689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc005040 con 0x7fdfec0faed0 2023-12-09T02:36:47.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdff18f2700 1 --2- 172.21.15.88:0/1513115689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfec0faed0 0x7fdfec10d600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8002a50 tx=0x7fdfe8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:47.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdfe27fc700 1 -- 172.21.15.88:0/1513115689 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe8007cc0 con 0x7fdfec0faed0 2023-12-09T02:36:47.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdfe27fc700 1 -- 172.21.15.88:0/1513115689 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdfe800f040 con 0x7fdfec0faed0 2023-12-09T02:36:47.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdfe27fc700 1 -- 172.21.15.88:0/1513115689 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe800d8d0 con 0x7fdfec0faed0 2023-12-09T02:36:47.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdff3b56700 1 -- 172.21.15.88:0/1513115689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfec10ecc0 con 0x7fdfec0faed0 2023-12-09T02:36:47.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.620+0000 7fdff3b56700 1 -- 172.21.15.88:0/1513115689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfec10f200 con 0x7fdfec0faed0 2023-12-09T02:36:47.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.621+0000 7fdff3b56700 1 -- 172.21.15.88:0/1513115689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfec107610 con 0x7fdfec0faed0 2023-12-09T02:36:47.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.622+0000 7fdfe27fc700 1 -- 172.21.15.88:0/1513115689 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fdfe800dab0 con 0x7fdfec0faed0 2023-12-09T02:36:47.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.622+0000 7fdfe27fc700 1 --2- 172.21.15.88:0/1513115689 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fdfd806cf80 0x7fdfd806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:47.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.623+0000 7fdff10f1700 1 --2- 172.21.15.88:0/1513115689 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fdfd806cf80 0x7fdfd806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:47.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.623+0000 7fdfe27fc700 1 -- 172.21.15.88:0/1513115689 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdfe808c280 con 0x7fdfec0faed0 2023-12-09T02:36:47.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.623+0000 7fdff10f1700 1 --2- 172.21.15.88:0/1513115689 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fdfd806cf80 0x7fdfd806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc004f90 tx=0x7fdfdc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:47.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.627+0000 7fdfe27fc700 1 -- 172.21.15.88:0/1513115689 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdfe80599f0 con 0x7fdfec0faed0 2023-12-09T02:36:47.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:47 smithi088 ceph-mon[193406]: Upgrade: Updating mon.smithi161 2023-12-09T02:36:47.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:47 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:47.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:47 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:36:47.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:47 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:36:47.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:47 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:47.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:47 smithi088 ceph-mon[193406]: Deploying daemon mon.smithi161 on smithi161 2023-12-09T02:36:47.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:47 smithi088 ceph-mon[193406]: pgmap v8: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 962 KiB/s wr, 323 op/s 2023-12-09T02:36:47.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:47 smithi088 ceph-mon[193406]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:47.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:47 smithi088 ceph-mon[193406]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:47.887 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 systemd[1]: Stopping Ceph mon.smithi161 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:36:47.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.922+0000 7fdff3b56700 1 -- 172.21.15.88:0/1513115689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdfec1055d0 con 0x7fdfec0faed0 2023-12-09T02:36:47.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.922+0000 7fdfe27fc700 1 -- 172.21.15.88:0/1513115689 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1848 (secure 0 0 0) 0x7fdfe8059580 con 0x7fdfec0faed0 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:36:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:36:47.926 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:47.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.924+0000 7fdff3b56700 1 -- 172.21.15.88:0/1513115689 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fdfd806cf80 msgr2=0x7fdfd806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:47.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.924+0000 7fdff3b56700 1 --2- 172.21.15.88:0/1513115689 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fdfd806cf80 0x7fdfd806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc004f90 tx=0x7fdfdc009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:47.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.924+0000 7fdff3b56700 1 -- 172.21.15.88:0/1513115689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfec0faed0 msgr2=0x7fdfec10d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:47.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.924+0000 7fdff3b56700 1 --2- 172.21.15.88:0/1513115689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfec0faed0 0x7fdfec10d600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8002a50 tx=0x7fdfe8004600 comp rx=0 tx=0).stop 2023-12-09T02:36:47.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.924+0000 7fdff3b56700 1 -- 172.21.15.88:0/1513115689 shutdown_connections 2023-12-09T02:36:47.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.924+0000 7fdff3b56700 1 --2- 172.21.15.88:0/1513115689 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fdfd806cf80 0x7fdfd806f430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.924+0000 7fdff3b56700 1 --2- 172.21.15.88:0/1513115689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfec0faed0 0x7fdfec10d600 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.924+0000 7fdff3b56700 1 --2- 172.21.15.88:0/1513115689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec0fdf60 0x7fdfec10db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:47.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.924+0000 7fdff3b56700 1 -- 172.21.15.88:0/1513115689 >> 172.21.15.88:0/1513115689 conn(0x7fdfec0f6950 msgr2=0x7fdfec0f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:47.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.924+0000 7fdff3b56700 1 -- 172.21.15.88:0/1513115689 shutdown_connections 2023-12-09T02:36:47.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:47.924+0000 7fdff3b56700 1 -- 172.21.15.88:0/1513115689 wait complete. 2023-12-09T02:36:47.929 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:36:48.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.033+0000 7f2d6e508700 1 -- 172.21.15.88:0/237108332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d680fff90 msgr2=0x7f2d68100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:48.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.033+0000 7f2d6e508700 1 --2- 172.21.15.88:0/237108332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d680fff90 0x7f2d68100400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c004940 tx=0x7f2d5c009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:48.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.033+0000 7f2d6e508700 1 -- 172.21.15.88:0/237108332 shutdown_connections 2023-12-09T02:36:48.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.033+0000 7f2d6e508700 1 --2- 172.21.15.88:0/237108332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d680fff90 0x7f2d68100400 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.033+0000 7f2d6e508700 1 --2- 172.21.15.88:0/237108332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d680fee20 0x7f2d680ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.033+0000 7f2d6e508700 1 -- 172.21.15.88:0/237108332 >> 172.21.15.88:0/237108332 conn(0x7f2d680fa5d0 msgr2=0x7f2d680fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:48.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.033+0000 7f2d6e508700 1 -- 172.21.15.88:0/237108332 shutdown_connections 2023-12-09T02:36:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.033+0000 7f2d6e508700 1 -- 172.21.15.88:0/237108332 wait complete. 2023-12-09T02:36:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d6e508700 1 Processor -- start 2023-12-09T02:36:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d6e508700 1 -- start start 2023-12-09T02:36:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d6e508700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d680fee20 0x7f2d6810f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d6e508700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d680fff90 0x7f2d6810fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d6e508700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68110380 con 0x7f2d680fff90 2023-12-09T02:36:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d6e508700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68110bc0 con 0x7f2d680fee20 2023-12-09T02:36:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d67fff700 1 -- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d680fee20 msgr2=0x7f2d6810f7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:3300/0 2023-12-09T02:36:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d67fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d680fee20 0x7f2d6810f7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-09T02:36:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d677fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d680fff90 0x7f2d6810fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d677fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d680fff90 0x7f2d6810fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39352/0 (socket says 172.21.15.88:39352) 2023-12-09T02:36:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d677fe700 1 -- 172.21.15.88:0/737040564 learned_addr learned my addr 172.21.15.88:0/737040564 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d677fe700 1 -- 172.21.15.88:0/737040564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d680fee20 msgr2=0x7f2d6810f7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-09T02:36:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d677fe700 1 --2- 172.21.15.88:0/737040564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d680fee20 0x7f2d6810f7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.034+0000 7f2d677fe700 1 -- 172.21.15.88:0/737040564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c005040 con 0x7f2d680fff90 2023-12-09T02:36:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.035+0000 7f2d677fe700 1 --2- 172.21.15.88:0/737040564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d680fff90 0x7f2d6810fcf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c000c00 tx=0x7f2d5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.035+0000 7f2d64ff9700 1 -- 172.21.15.88:0/737040564 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d5c00e030 con 0x7f2d680fff90 2023-12-09T02:36:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.035+0000 7f2d6e508700 1 -- 172.21.15.88:0/737040564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d68110e40 con 0x7f2d680fff90 2023-12-09T02:36:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.035+0000 7f2d64ff9700 1 -- 172.21.15.88:0/737040564 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d5c004290 con 0x7f2d680fff90 2023-12-09T02:36:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.035+0000 7f2d64ff9700 1 -- 172.21.15.88:0/737040564 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d5c01c400 con 0x7f2d680fff90 2023-12-09T02:36:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.035+0000 7f2d6e508700 1 -- 172.21.15.88:0/737040564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d68111380 con 0x7f2d680fff90 2023-12-09T02:36:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.036+0000 7f2d6e508700 1 -- 172.21.15.88:0/737040564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6804bb80 con 0x7f2d680fff90 2023-12-09T02:36:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.037+0000 7f2d64ff9700 1 -- 172.21.15.88:0/737040564 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f2d5c013420 con 0x7f2d680fff90 2023-12-09T02:36:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.037+0000 7f2d64ff9700 1 --2- 172.21.15.88:0/737040564 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2d5006ced0 0x7f2d5006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.037+0000 7f2d64ff9700 1 -- 172.21.15.88:0/737040564 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2d5c08e430 con 0x7f2d680fff90 2023-12-09T02:36:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.037+0000 7f2d67fff700 1 --2- 172.21.15.88:0/737040564 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2d5006ced0 0x7f2d5006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.038+0000 7f2d67fff700 1 --2- 172.21.15.88:0/737040564 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2d5006ced0 0x7f2d5006f380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2d58006fd0 tx=0x7f2d58006df0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.041+0000 7f2d64ff9700 1 -- 172.21.15.88:0/737040564 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2d5c05bbc0 con 0x7f2d680fff90 2023-12-09T02:36:48.157 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi161[121146]: 2023-12-09T02:36:47.880+0000 7f8be3322700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi161 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:36:48.158 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:47 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi161[121146]: 2023-12-09T02:36:47.881+0000 7f8be3322700 -1 mon.smithi161@1(peon) e2 *** Got Signal Terminated *** 2023-12-09T02:36:48.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.272+0000 7f2d6e508700 1 -- 172.21.15.88:0/737040564 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d68104970 con 0x7f2d5006ced0 2023-12-09T02:36:48.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.274+0000 7f2d64ff9700 1 -- 172.21.15.88:0/737040564 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f2d68104970 con 0x7f2d5006ced0 2023-12-09T02:36:48.276 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:36:48.276 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:36:48.276 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:36:48.276 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:36:48.276 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2023-12-09T02:36:48.276 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2023-12-09T02:36:48.276 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-12-09T02:36:48.277 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "3/21 daemons upgraded", 2023-12-09T02:36:48.277 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mon daemons", 2023-12-09T02:36:48.277 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:36:48.277 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:36:48.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.276+0000 7f2d6e508700 1 -- 172.21.15.88:0/737040564 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2d5006ced0 msgr2=0x7f2d5006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:48.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.276+0000 7f2d6e508700 1 --2- 172.21.15.88:0/737040564 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2d5006ced0 0x7f2d5006f380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2d58006fd0 tx=0x7f2d58006df0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.276+0000 7f2d6e508700 1 -- 172.21.15.88:0/737040564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d680fff90 msgr2=0x7f2d6810fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:48.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.276+0000 7f2d6e508700 1 --2- 172.21.15.88:0/737040564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d680fff90 0x7f2d6810fcf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c000c00 tx=0x7f2d5c009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:48.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.276+0000 7f2d6e508700 1 -- 172.21.15.88:0/737040564 shutdown_connections 2023-12-09T02:36:48.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.276+0000 7f2d6e508700 1 --2- 172.21.15.88:0/737040564 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2d5006ced0 0x7f2d5006f380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.276+0000 7f2d6e508700 1 --2- 172.21.15.88:0/737040564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d680fee20 0x7f2d6810f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.276+0000 7f2d6e508700 1 --2- 172.21.15.88:0/737040564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d680fff90 0x7f2d6810fcf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.276+0000 7f2d6e508700 1 -- 172.21.15.88:0/737040564 >> 172.21.15.88:0/737040564 conn(0x7f2d680fa5d0 msgr2=0x7f2d68103250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:48.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.276+0000 7f2d6e508700 1 -- 172.21.15.88:0/737040564 shutdown_connections 2023-12-09T02:36:48.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.276+0000 7f2d6e508700 1 -- 172.21.15.88:0/737040564 wait complete. 2023-12-09T02:36:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.383+0000 7f97d6dda700 1 -- 172.21.15.88:0/1616896903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97d0100050 msgr2=0x7f97d0102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.383+0000 7f97d6dda700 1 --2- 172.21.15.88:0/1616896903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97d0100050 0x7f97d0102430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f97bc004940 tx=0x7f97bc009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.383+0000 7f97d6dda700 1 -- 172.21.15.88:0/1616896903 shutdown_connections 2023-12-09T02:36:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.383+0000 7f97d6dda700 1 --2- 172.21.15.88:0/1616896903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97d0100050 0x7f97d0102430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.384+0000 7f97d6dda700 1 --2- 172.21.15.88:0/1616896903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d00fd730 0x7f97d00ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.384+0000 7f97d6dda700 1 -- 172.21.15.88:0/1616896903 >> 172.21.15.88:0/1616896903 conn(0x7f97d00f7190 msgr2=0x7f97d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.384+0000 7f97d6dda700 1 -- 172.21.15.88:0/1616896903 shutdown_connections 2023-12-09T02:36:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.384+0000 7f97d6dda700 1 -- 172.21.15.88:0/1616896903 wait complete. 2023-12-09T02:36:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.384+0000 7f97d6dda700 1 Processor -- start 2023-12-09T02:36:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.384+0000 7f97d6dda700 1 -- start start 2023-12-09T02:36:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.384+0000 7f97d6dda700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97d00fd730 0x7f97d010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.384+0000 7f97d6dda700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d0100050 0x7f97d010dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.384+0000 7f97d6dda700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d010e170 con 0x7f97d00fd730 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.384+0000 7f97d6dda700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d010e9b0 con 0x7f97d0100050 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.385+0000 7f97cffff700 1 -- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d0100050 msgr2=0x7f97d010dae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:3300/0 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.385+0000 7f97cffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d0100050 0x7f97d010dae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.385+0000 7f97d4b76700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97d00fd730 0x7f97d010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.385+0000 7f97d4b76700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97d00fd730 0x7f97d010d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39376/0 (socket says 172.21.15.88:39376) 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.385+0000 7f97d4b76700 1 -- 172.21.15.88:0/3798881129 learned_addr learned my addr 172.21.15.88:0/3798881129 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.385+0000 7f97d4b76700 1 -- 172.21.15.88:0/3798881129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d0100050 msgr2=0x7f97d010dae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.385+0000 7f97d4b76700 1 --2- 172.21.15.88:0/3798881129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d0100050 0x7f97d010dae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.385+0000 7f97d4b76700 1 -- 172.21.15.88:0/3798881129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc005040 con 0x7f97d00fd730 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.385+0000 7f97d4b76700 1 --2- 172.21.15.88:0/3798881129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97d00fd730 0x7f97d010d5a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f97c400b760 tx=0x7f97c4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.386+0000 7f97cd7fa700 1 -- 172.21.15.88:0/3798881129 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97c4010790 con 0x7f97d00fd730 2023-12-09T02:36:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.386+0000 7f97cd7fa700 1 -- 172.21.15.88:0/3798881129 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97c4010da0 con 0x7f97d00fd730 2023-12-09T02:36:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.386+0000 7f97cd7fa700 1 -- 172.21.15.88:0/3798881129 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97c400f300 con 0x7f97d00fd730 2023-12-09T02:36:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.386+0000 7f97d6dda700 1 -- 172.21.15.88:0/3798881129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d010ec90 con 0x7f97d00fd730 2023-12-09T02:36:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.386+0000 7f97d6dda700 1 -- 172.21.15.88:0/3798881129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d010f1d0 con 0x7f97d00fd730 2023-12-09T02:36:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.387+0000 7f97d6dda700 1 -- 172.21.15.88:0/3798881129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d0107660 con 0x7f97d00fd730 2023-12-09T02:36:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.387+0000 7f97cd7fa700 1 -- 172.21.15.88:0/3798881129 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f97c40116d0 con 0x7f97d00fd730 2023-12-09T02:36:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.387+0000 7f97cd7fa700 1 --2- 172.21.15.88:0/3798881129 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f97c006ced0 0x7f97c006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:36:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.388+0000 7f97cd7fa700 1 -- 172.21.15.88:0/3798881129 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f97c408c530 con 0x7f97d00fd730 2023-12-09T02:36:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.388+0000 7f97cffff700 1 --2- 172.21.15.88:0/3798881129 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f97c006ced0 0x7f97c006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:36:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.388+0000 7f97cffff700 1 --2- 172.21.15.88:0/3798881129 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f97c006ced0 0x7f97c006f380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f97bc000c00 tx=0x7f97bc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:36:48.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.392+0000 7f97cd7fa700 1 -- 172.21.15.88:0/3798881129 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f97c4059b20 con 0x7f97d00fd730 2023-12-09T02:36:48.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:48 smithi161 bash[178658]: ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi161 2023-12-09T02:36:48.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:48 smithi161 systemd[1]: ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi161.service: Succeeded. 2023-12-09T02:36:48.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:48 smithi161 systemd[1]: Stopped Ceph mon.smithi161 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:36:48.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:48 smithi161 systemd[1]: Starting Ceph mon.smithi161 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:36:48.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.690+0000 7f97d6dda700 1 -- 172.21.15.88:0/3798881129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f97d0105620 con 0x7f97d00fd730 2023-12-09T02:36:48.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.690+0000 7f97cd7fa700 1 -- 172.21.15.88:0/3798881129 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f97c4059940 con 0x7f97d00fd730 2023-12-09T02:36:48.693 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:36:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.692+0000 7f97d6dda700 1 -- 172.21.15.88:0/3798881129 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f97c006ced0 msgr2=0x7f97c006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.692+0000 7f97d6dda700 1 --2- 172.21.15.88:0/3798881129 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f97c006ced0 0x7f97c006f380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f97bc000c00 tx=0x7f97bc009e30 comp rx=0 tx=0).stop 2023-12-09T02:36:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.692+0000 7f97d6dda700 1 -- 172.21.15.88:0/3798881129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97d00fd730 msgr2=0x7f97d010d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:36:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.692+0000 7f97d6dda700 1 --2- 172.21.15.88:0/3798881129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97d00fd730 0x7f97d010d5a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f97c400b760 tx=0x7f97c4009220 comp rx=0 tx=0).stop 2023-12-09T02:36:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.693+0000 7f97d6dda700 1 -- 172.21.15.88:0/3798881129 shutdown_connections 2023-12-09T02:36:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.693+0000 7f97d6dda700 1 --2- 172.21.15.88:0/3798881129 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f97c006ced0 0x7f97c006f380 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.693+0000 7f97d6dda700 1 --2- 172.21.15.88:0/3798881129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97d00fd730 0x7f97d010d5a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.693+0000 7f97d6dda700 1 --2- 172.21.15.88:0/3798881129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d0100050 0x7f97d010dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:36:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.693+0000 7f97d6dda700 1 -- 172.21.15.88:0/3798881129 >> 172.21.15.88:0/3798881129 conn(0x7f97d00f7190 msgr2=0x7f97d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:36:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.693+0000 7f97d6dda700 1 -- 172.21.15.88:0/3798881129 shutdown_connections 2023-12-09T02:36:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:36:48.693+0000 7f97d6dda700 1 -- 172.21.15.88:0/3798881129 wait complete. 2023-12-09T02:36:49.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: set uid:gid to 167:167 (ceph:ceph) 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev), process ceph-mon, pid 7 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: pidfile_write: ignore empty --pid-file 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: load: jerasure load: lrc 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: RocksDB version: 7.9.2 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Git sha 0 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Compile date 2023-12-08 17:42:16 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: DB SUMMARY 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: DB Session ID: 8XOWMBLZ2F1S9ZLZXCY5 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: CURRENT file: CURRENT 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: IDENTITY file: IDENTITY 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: MANIFEST file: MANIFEST-000009 size: 704 Bytes 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi161/store.db dir, Total Num: 1, files: 000021.sst 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi161/store.db: 000019.log size: 4491416 ; 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.error_if_exists: 0 2023-12-09T02:36:49.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.create_if_missing: 0 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.paranoid_checks: 1 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.env: 0x55c2f170da60 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.fs: PosixFileSystem 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.info_log: 0x55c2f2233600 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_file_opening_threads: 16 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.statistics: (nil) 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.use_fsync: 0 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_log_file_size: 0 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-09T02:36:49.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.keep_log_file_num: 1000 2023-12-09T02:36:49.423 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.recycle_log_file_num: 0 2023-12-09T02:36:49.423 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.allow_fallocate: 1 2023-12-09T02:36:49.423 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.allow_mmap_reads: 0 2023-12-09T02:36:49.423 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.allow_mmap_writes: 0 2023-12-09T02:36:49.423 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.use_direct_reads: 0 2023-12-09T02:36:49.423 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-09T02:36:49.423 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.create_missing_column_families: 0 2023-12-09T02:36:49.423 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.db_log_dir: 2023-12-09T02:36:49.423 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.wal_dir: 2023-12-09T02:36:49.424 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-09T02:36:49.424 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.advise_random_on_open: 1 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.db_write_buffer_size: 0 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.write_buffer_manager: 0x55c2f21e9360 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.rate_limiter: (nil) 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.wal_recovery_mode: 2 2023-12-09T02:36:49.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.enable_thread_tracking: 0 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.enable_pipelined_write: 0 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.unordered_write: 0 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.row_cache: None 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.wal_filter: None 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.allow_ingest_behind: 0 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.two_write_queues: 0 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.manual_wal_flush: 0 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.wal_compression: 0 2023-12-09T02:36:49.426 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.atomic_flush: 0 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.log_readahead_size: 0 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.best_efforts_recovery: 0 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.allow_data_in_errors: 0 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.db_host_id: __hostname__ 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_background_jobs: 2 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_background_compactions: -1 2023-12-09T02:36:49.427 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_subcompactions: 1 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_total_wal_size: 0 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_open_files: -1 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bytes_per_sync: 0 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_readahead_size: 0 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_background_flushes: -1 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Compression algorithms supported: 2023-12-09T02:36:49.428 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: kZSTD supported: 0 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: kXpressCompression supported: 0 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: kLZ4HCCompression supported: 1 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: kZlibCompression supported: 1 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: kSnappyCompression supported: 1 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: kLZ4Compression supported: 1 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: kBZip2Compression supported: 0 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi161/store.db/MANIFEST-000009 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.merge_operator: 2023-12-09T02:36:49.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_filter: None 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_filter_factory: None 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.sst_partitioner_factory: None 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c2f2233700) 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: cache_index_and_filter_blocks: 1 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: pin_top_level_index_and_filter: 1 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_type: 0 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: data_block_index_type: 0 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_shortening: 1 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-09T02:36:49.430 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: checksum: 4 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: no_block_cache: 0 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache: 0x55c2f2289090 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_name: BinnedLRUCache 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_options: 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: capacity : 536870912 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: num_shard_bits : 4 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: strict_capacity_limit : 0 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: high_pri_pool_ratio: 0.000 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_compressed: (nil) 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: persistent_cache: (nil) 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_size: 4096 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_size_deviation: 10 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_restart_interval: 16 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_block_restart_interval: 1 2023-12-09T02:36:49.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: metadata_block_size: 4096 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: partition_filters: 0 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: use_delta_encoding: 1 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: filter_policy: bloomfilter 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: whole_key_filtering: 1 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: verify_compression: 0 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: read_amp_bytes_per_bit: 0 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: format_version: 5 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: enable_index_compression: 1 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_align: 0 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_auto_readahead_size: 262144 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: prepopulate_block_cache: 0 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: initial_auto_readahead_size: 8192 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: num_file_reads_for_auto_readahead: 2 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.write_buffer_size: 33554432 2023-12-09T02:36:49.432 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_write_buffer_number: 2 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compression: NoCompression 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bottommost_compression: Disabled 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.prefix_extractor: nullptr 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.num_levels: 7 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-09T02:36:49.433 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compression_opts.level: 32767 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compression_opts.strategy: 0 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compression_opts.enabled: false 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.target_file_size_base: 67108864 2023-12-09T02:36:49.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.arena_block_size: 1048576 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-09T02:36:49.435 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.disable_auto_compactions: 0 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.table_properties_collectors: 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.inplace_update_support: 0 2023-12-09T02:36:49.436 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.bloom_locality: 0 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.max_successive_merges: 0 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.paranoid_file_checks: 0 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.force_consistency_checks: 1 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.report_bg_io_stats: 0 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.ttl: 2592000 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.enable_blob_files: false 2023-12-09T02:36:49.437 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.min_blob_size: 0 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.blob_file_size: 268435456 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.blob_file_starting_level: 0 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 21.sst 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi161/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 23, last_sequence is 9926, log_number is 19,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 19 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 07e67916-ee8c-4724-882b-a6ae6d2ef1af 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702089409023095, "job": 1, "event": "recovery_started", "wal_files": [19]} 2023-12-09T02:36:49.438 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #19 mode 2 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 bash[178804]: 4769966a784f5eccb32829ece9ae9821506b444905dc06ee2f0318bf46c41453 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702089409032735, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 24, "file_size": 2760359, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 9931, "largest_seqno": 11083, "table_properties": {"data_size": 2754969, "index_size": 3155, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1221, "raw_key_size": 11234, "raw_average_key_size": 23, "raw_value_size": 2744634, "raw_average_value_size": 5790, "num_data_blocks": 145, "num_entries": 474, "num_filter_entries": 474, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702089409, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "07e67916-ee8c-4724-882b-a6ae6d2ef1af", "db_session_id": "8XOWMBLZ2F1S9ZLZXCY5", "orig_file_number": 24, "seqno_to_time_mapping": "N/A"}} 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702089409032855, "job": 1, "event": "recovery_finished"} 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/version_set.cc:5047] Creating manifest 26 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 systemd[1]: Started Ceph mon.smithi161 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi161/store.db/000019.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c2f2324000 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: DB pointer 0x55c2f2310000 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** DB Stats ** 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-09T02:36:49.439 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: L0 1/0 2.63 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 724.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: L6 1/0 6.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Sum 2/0 8.63 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 724.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 724.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-09T02:36:49.440 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 724.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Flush(GB): cumulative 0.003, interval 0.003 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-09T02:36:49.441 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative compaction: 0.00 GB write, 187.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval compaction: 0.00 GB write, 187.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Block cache BinnedLRUCache@0x55c2f2289090#7 capacity: 512.00 MB usage: 4.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.28 KB,0.000244379%) IndexBlock(1,3.33 KB,0.000634789%) Misc(1,0.00 KB,0%) 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: starting mon.smithi161 rank 1 at public addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] at bind addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi161 fsid 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: mon.smithi161@-1(???) e2 preinit fsid 70b26980-963a-11ee-95a3-87774f69a715 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: mon.smithi161@-1(???).mds e14 new map 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: mon.smithi161@-1(???).mds e14 print_map 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: e14 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:36:49.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: legacy client fscid: 1 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Filesystem 'cephfs' (1) 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: fs_name cephfs 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: epoch 14 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: tableserver 0 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: root 0 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: session_timeout 60 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: session_autoclose 300 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_file_size 1099511627776 2023-12-09T02:36:49.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_xattr_size 65536 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: required_client_features {} 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: last_failure 0 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: last_failure_osd_epoch 46 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_mds 1 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: in 0 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: up {0=24251} 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: failed 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: damaged 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: stopped 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: data_pools [3] 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: metadata_pool 2 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: inline_data disabled 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: balancer 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: bal_rank_mask -1 2023-12-09T02:36:49.444 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: standby_count_wanted 1 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Standby daemons: 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: mon.smithi161@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: mon.smithi161@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: mon.smithi161@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: mon.smithi161@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-09T02:36:49.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: mon.smithi161@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-09T02:36:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:49 smithi088 ceph-mon[193406]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:49 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/719694282' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:36:49.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:49 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1513115689' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:36:50.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:36:50.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/719694282' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:36:50.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:49 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1513115689' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:36:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: overall HEALTH_OK 2023-12-09T02:36:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:36:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:36:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: mon.smithi088 calling monitor election 2023-12-09T02:36:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: mon.smithi161 calling monitor election 2023-12-09T02:36:50.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: mon.smithi088 is new leader, mons smithi088,smithi161 in quorum (ranks 0,1) 2023-12-09T02:36:50.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: monmap e3: 2 mons at {smithi088=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-09T02:36:50.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: fsmap cephfs:1 {0=cephfs.smithi161.dhvdif=up:active} 3 up:standby 2023-12-09T02:36:50.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: osdmap e50: 6 total, 6 up, 6 in 2023-12-09T02:36:50.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: mgrmap e37: smithi088.jwlofb(active, since 13s), standbys: smithi161.qmxtmg 2023-12-09T02:36:50.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: overall HEALTH_OK 2023-12-09T02:36:50.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:50.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:50.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:50 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:51.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: overall HEALTH_OK 2023-12-09T02:36:51.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2023-12-09T02:36:51.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2023-12-09T02:36:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: mon.smithi088 calling monitor election 2023-12-09T02:36:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: mon.smithi161 calling monitor election 2023-12-09T02:36:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: mon.smithi088 is new leader, mons smithi088,smithi161 in quorum (ranks 0,1) 2023-12-09T02:36:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: monmap e3: 2 mons at {smithi088=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-09T02:36:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: fsmap cephfs:1 {0=cephfs.smithi161.dhvdif=up:active} 3 up:standby 2023-12-09T02:36:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: osdmap e50: 6 total, 6 up, 6 in 2023-12-09T02:36:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: mgrmap e37: smithi088.jwlofb(active, since 13s), standbys: smithi161.qmxtmg 2023-12-09T02:36:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: overall HEALTH_OK 2023-12-09T02:36:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:51.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:50 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:36:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:51 smithi161 ceph-mon[178840]: pgmap v10: 65 pgs: 65 active+clean; 239 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.4 MiB/s wr, 424 op/s 2023-12-09T02:36:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:51 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:36:52.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:51 smithi088 ceph-mon[193406]: pgmap v10: 65 pgs: 65 active+clean; 239 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.4 MiB/s wr, 424 op/s 2023-12-09T02:36:52.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:51 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:36:53.215 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-09T02:36:53.215 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-09T02:36:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:53 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:53 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:53 smithi161 ceph-mon[178840]: pgmap v11: 65 pgs: 65 active+clean; 230 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.6 MiB/s wr, 498 op/s 2023-12-09T02:36:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:53 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:53.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:53 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:53.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:53 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:53.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:53 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:53.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:53 smithi088 ceph-mon[193406]: pgmap v11: 65 pgs: 65 active+clean; 230 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.6 MiB/s wr, 498 op/s 2023-12-09T02:36:53.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:53 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:53.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:53 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:53.492 DEBUG:teuthology.parallel:result is None 2023-12-09T02:36:53.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-09T02:36:53.524 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-09T02:36:53.525 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-09T02:36:53.561 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-09T02:36:53.561 DEBUG:teuthology.parallel:result is None 2023-12-09T02:36:55.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:55 smithi161 ceph-mon[178840]: pgmap v12: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 2.0 MiB/s wr, 506 op/s 2023-12-09T02:36:55.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:55 smithi088 ceph-mon[193406]: pgmap v12: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 2.0 MiB/s wr, 506 op/s 2023-12-09T02:36:57.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:57 smithi161 ceph-mon[178840]: pgmap v13: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 346 op/s 2023-12-09T02:36:57.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:57 smithi088 ceph-mon[193406]: pgmap v13: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 346 op/s 2023-12-09T02:36:59.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:59 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:59 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:59 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:59 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:36:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:59 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:59 smithi088 ceph-mon[193406]: Reconfiguring mon.smithi088 (monmap changed)... 2023-12-09T02:36:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:59 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:36:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:59 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:36:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:59 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:59.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:59 smithi088 ceph-mon[193406]: Reconfiguring daemon mon.smithi088 on smithi088 2023-12-09T02:36:59.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:36:59 smithi088 ceph-mon[193406]: pgmap v14: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.5 MiB/s wr, 405 op/s 2023-12-09T02:36:59.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:59 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:59.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:59 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:59.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:59 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:59.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:59 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:36:59.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:59 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:36:59.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:59 smithi161 ceph-mon[178840]: Reconfiguring mon.smithi088 (monmap changed)... 2023-12-09T02:36:59.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:59 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:36:59.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:59 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:36:59.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:59 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:36:59.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:59 smithi161 ceph-mon[178840]: Reconfiguring daemon mon.smithi088 on smithi088 2023-12-09T02:36:59.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:36:59 smithi161 ceph-mon[178840]: pgmap v14: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.5 MiB/s wr, 405 op/s 2023-12-09T02:37:00.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:00 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:00.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:00 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:00.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:00 smithi088 ceph-mon[193406]: Reconfiguring mgr.smithi088.jwlofb (monmap changed)... 2023-12-09T02:37:00.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:00 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.jwlofb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:37:00.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:00 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:37:00.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:00 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:00.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:00 smithi088 ceph-mon[193406]: Reconfiguring daemon mgr.smithi088.jwlofb on smithi088 2023-12-09T02:37:00.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:00 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:00.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:00 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:00.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:00 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:00.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:00 smithi161 ceph-mon[178840]: Reconfiguring mgr.smithi088.jwlofb (monmap changed)... 2023-12-09T02:37:00.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:00 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.jwlofb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:37:00.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:00 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:37:00.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:00 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:00.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:00 smithi161 ceph-mon[178840]: Reconfiguring daemon mgr.smithi088.jwlofb on smithi088 2023-12-09T02:37:00.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:00 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:01.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:01.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:01 smithi161 ceph-mon[178840]: Reconfiguring crash.smithi088 (monmap changed)... 2023-12-09T02:37:01.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:37:01.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:01.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:01 smithi161 ceph-mon[178840]: Reconfiguring daemon crash.smithi088 on smithi088 2023-12-09T02:37:01.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:01 smithi161 ceph-mon[178840]: pgmap v15: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 789 KiB/s wr, 223 op/s 2023-12-09T02:37:01.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:01.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:01.473 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:01.473 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:01 smithi088 ceph-mon[193406]: Reconfiguring crash.smithi088 (monmap changed)... 2023-12-09T02:37:01.473 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:37:01.474 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:01.474 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:01 smithi088 ceph-mon[193406]: Reconfiguring daemon crash.smithi088 on smithi088 2023-12-09T02:37:01.474 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:01 smithi088 ceph-mon[193406]: pgmap v15: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 789 KiB/s wr, 223 op/s 2023-12-09T02:37:01.474 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:01.474 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:02.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:02 smithi088 ceph-mon[193406]: Reconfiguring osd.0 (monmap changed)... 2023-12-09T02:37:02.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:02 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-09T02:37:02.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:02 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:02.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:02 smithi088 ceph-mon[193406]: Reconfiguring daemon osd.0 on smithi088 2023-12-09T02:37:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:02 smithi161 ceph-mon[178840]: Reconfiguring osd.0 (monmap changed)... 2023-12-09T02:37:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:02 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-09T02:37:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:02 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:02.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:02 smithi161 ceph-mon[178840]: Reconfiguring daemon osd.0 on smithi088 2023-12-09T02:37:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:03 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:03 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:03.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:03 smithi161 ceph-mon[178840]: Reconfiguring osd.1 (monmap changed)... 2023-12-09T02:37:03.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:03 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-09T02:37:03.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:03 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:03.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:03 smithi161 ceph-mon[178840]: Reconfiguring daemon osd.1 on smithi088 2023-12-09T02:37:03.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:03 smithi161 ceph-mon[178840]: pgmap v16: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 789 KiB/s wr, 223 op/s 2023-12-09T02:37:03.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:03 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:03.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:03 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:03.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:03 smithi088 ceph-mon[193406]: Reconfiguring osd.1 (monmap changed)... 2023-12-09T02:37:03.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:03 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-09T02:37:03.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:03 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:03.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:03 smithi088 ceph-mon[193406]: Reconfiguring daemon osd.1 on smithi088 2023-12-09T02:37:03.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:03 smithi088 ceph-mon[193406]: pgmap v16: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 789 KiB/s wr, 223 op/s 2023-12-09T02:37:04.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:04 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:04.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:04 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:04.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:04 smithi088 ceph-mon[193406]: Reconfiguring osd.2 (monmap changed)... 2023-12-09T02:37:04.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:04 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-09T02:37:04.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:04 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:04.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:04 smithi088 ceph-mon[193406]: Reconfiguring daemon osd.2 on smithi088 2023-12-09T02:37:04.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:04 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:04.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:04 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:04.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:04 smithi161 ceph-mon[178840]: Reconfiguring osd.2 (monmap changed)... 2023-12-09T02:37:04.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:04 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-09T02:37:04.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:04 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:04.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:04 smithi161 ceph-mon[178840]: Reconfiguring daemon osd.2 on smithi088 2023-12-09T02:37:05.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:05 smithi088 ceph-mon[193406]: pgmap v17: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 576 KiB/s wr, 150 op/s 2023-12-09T02:37:05.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:05 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:05.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:05 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:05.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:05 smithi088 ceph-mon[193406]: Reconfiguring mds.cephfs.smithi088.utskxh (monmap changed)... 2023-12-09T02:37:05.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:05 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.utskxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:37:05.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:05 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:05.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:05 smithi088 ceph-mon[193406]: Reconfiguring daemon mds.cephfs.smithi088.utskxh on smithi088 2023-12-09T02:37:06.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:05 smithi161 ceph-mon[178840]: pgmap v17: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 576 KiB/s wr, 150 op/s 2023-12-09T02:37:06.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:05 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:06.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:05 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:06.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:05 smithi161 ceph-mon[178840]: Reconfiguring mds.cephfs.smithi088.utskxh (monmap changed)... 2023-12-09T02:37:06.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:05 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.utskxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:37:06.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:05 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:06.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:05 smithi161 ceph-mon[178840]: Reconfiguring daemon mds.cephfs.smithi088.utskxh on smithi088 2023-12-09T02:37:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:06 smithi088 ceph-mon[193406]: Reconfiguring mds.cephfs.smithi088.zfojux (monmap changed)... 2023-12-09T02:37:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.zfojux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:37:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:06 smithi088 ceph-mon[193406]: Reconfiguring daemon mds.cephfs.smithi088.zfojux on smithi088 2023-12-09T02:37:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:37:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:06.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:06.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:37:06.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:07.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:07.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:07.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:06 smithi161 ceph-mon[178840]: Reconfiguring mds.cephfs.smithi088.zfojux (monmap changed)... 2023-12-09T02:37:07.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.zfojux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:37:07.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:07.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:06 smithi161 ceph-mon[178840]: Reconfiguring daemon mds.cephfs.smithi088.zfojux on smithi088 2023-12-09T02:37:07.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:37:07.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:07.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:07.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:37:07.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:07.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:07 smithi088 ceph-mon[193406]: pgmap v18: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.7 KiB/s rd, 146 KiB/s wr, 61 op/s 2023-12-09T02:37:07.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:07 smithi088 ceph-mon[193406]: Reconfiguring crash.smithi161 (monmap changed)... 2023-12-09T02:37:07.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:07 smithi088 ceph-mon[193406]: Reconfiguring daemon crash.smithi161 on smithi161 2023-12-09T02:37:07.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:07 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:07.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:07 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:07.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:07 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:37:07.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:07 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:37:07.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:07 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:07 smithi161 ceph-mon[178840]: pgmap v18: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.7 KiB/s rd, 146 KiB/s wr, 61 op/s 2023-12-09T02:37:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:07 smithi161 ceph-mon[178840]: Reconfiguring crash.smithi161 (monmap changed)... 2023-12-09T02:37:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:07 smithi161 ceph-mon[178840]: Reconfiguring daemon crash.smithi161 on smithi161 2023-12-09T02:37:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:07 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:07 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:07 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.qmxtmg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-09T02:37:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:07 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-09T02:37:08.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:07 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:08.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:08 smithi088 ceph-mon[193406]: Reconfiguring mgr.smithi161.qmxtmg (monmap changed)... 2023-12-09T02:37:08.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:08 smithi088 ceph-mon[193406]: Reconfiguring daemon mgr.smithi161.qmxtmg on smithi161 2023-12-09T02:37:08.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:08 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:08.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:08 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:08.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:08 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:37:08.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:08 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:37:08.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:08 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:09.002 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:08 smithi161 ceph-mon[178840]: Reconfiguring mgr.smithi161.qmxtmg (monmap changed)... 2023-12-09T02:37:09.002 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:08 smithi161 ceph-mon[178840]: Reconfiguring daemon mgr.smithi161.qmxtmg on smithi161 2023-12-09T02:37:09.003 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:08 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:09.003 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:08 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:09.003 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:08 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-09T02:37:09.003 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:08 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-09T02:37:09.003 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:08 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:09.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:09 smithi088 ceph-mon[193406]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.7 KiB/s rd, 147 KiB/s wr, 61 op/s 2023-12-09T02:37:09.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:09 smithi088 ceph-mon[193406]: Reconfiguring mon.smithi161 (monmap changed)... 2023-12-09T02:37:09.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:09 smithi088 ceph-mon[193406]: Reconfiguring daemon mon.smithi161 on smithi161 2023-12-09T02:37:09.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:09 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:09.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:09 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:09.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:09 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-09T02:37:09.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:09 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:09.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:09 smithi161 ceph-mon[178840]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.7 KiB/s rd, 147 KiB/s wr, 61 op/s 2023-12-09T02:37:09.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:09 smithi161 ceph-mon[178840]: Reconfiguring mon.smithi161 (monmap changed)... 2023-12-09T02:37:09.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:09 smithi161 ceph-mon[178840]: Reconfiguring daemon mon.smithi161 on smithi161 2023-12-09T02:37:09.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:09 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:09.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:09 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:09.977 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:09 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-09T02:37:09.978 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:09 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:10.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:10 smithi088 ceph-mon[193406]: Reconfiguring osd.3 (monmap changed)... 2023-12-09T02:37:10.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:10 smithi088 ceph-mon[193406]: Reconfiguring daemon osd.3 on smithi161 2023-12-09T02:37:10.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:10 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:10.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:10 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:10.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:10 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-09T02:37:10.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:10 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:11.001 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:10 smithi161 ceph-mon[178840]: Reconfiguring osd.3 (monmap changed)... 2023-12-09T02:37:11.002 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:10 smithi161 ceph-mon[178840]: Reconfiguring daemon osd.3 on smithi161 2023-12-09T02:37:11.002 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:10 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:11.002 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:10 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:11.002 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:10 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-09T02:37:11.002 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:10 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:11 smithi088 ceph-mon[193406]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 8.4 KiB/s wr, 1 op/s 2023-12-09T02:37:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:11 smithi088 ceph-mon[193406]: Reconfiguring osd.4 (monmap changed)... 2023-12-09T02:37:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:11 smithi088 ceph-mon[193406]: Reconfiguring daemon osd.4 on smithi161 2023-12-09T02:37:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:11.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:11.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-09T02:37:11.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:12.077 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:11 smithi161 ceph-mon[178840]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 8.4 KiB/s wr, 1 op/s 2023-12-09T02:37:12.077 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:11 smithi161 ceph-mon[178840]: Reconfiguring osd.4 (monmap changed)... 2023-12-09T02:37:12.077 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:11 smithi161 ceph-mon[178840]: Reconfiguring daemon osd.4 on smithi161 2023-12-09T02:37:12.077 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:12.077 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:12.077 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-09T02:37:12.078 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:12.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:12 smithi088 ceph-mon[193406]: Reconfiguring osd.5 (monmap changed)... 2023-12-09T02:37:12.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:12 smithi088 ceph-mon[193406]: Reconfiguring daemon osd.5 on smithi161 2023-12-09T02:37:13.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:12 smithi161 ceph-mon[178840]: Reconfiguring osd.5 (monmap changed)... 2023-12-09T02:37:13.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:12 smithi161 ceph-mon[178840]: Reconfiguring daemon osd.5 on smithi161 2023-12-09T02:37:13.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:13 smithi088 ceph-mon[193406]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 8.4 KiB/s wr, 1 op/s 2023-12-09T02:37:14.086 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:13 smithi161 ceph-mon[178840]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 8.4 KiB/s wr, 1 op/s 2023-12-09T02:37:15.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:15 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:15.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:15 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:15.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:15 smithi088 ceph-mon[193406]: Reconfiguring mds.cephfs.smithi161.dhvdif (monmap changed)... 2023-12-09T02:37:15.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:15 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.dhvdif", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:37:15.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:15 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:15.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:15 smithi088 ceph-mon[193406]: Reconfiguring daemon mds.cephfs.smithi161.dhvdif on smithi161 2023-12-09T02:37:15.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:15 smithi088 ceph-mon[193406]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 8.4 KiB/s wr, 1 op/s 2023-12-09T02:37:15.596 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:15 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:15.596 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:15 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:15.596 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:15 smithi161 ceph-mon[178840]: Reconfiguring mds.cephfs.smithi161.dhvdif (monmap changed)... 2023-12-09T02:37:15.596 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:15 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.dhvdif", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:37:15.596 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:15 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:15.596 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:15 smithi161 ceph-mon[178840]: Reconfiguring daemon mds.cephfs.smithi161.dhvdif on smithi161 2023-12-09T02:37:15.596 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:15 smithi161 ceph-mon[178840]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 8.4 KiB/s wr, 1 op/s 2023-12-09T02:37:17.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:17.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:17.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: Reconfiguring mds.cephfs.smithi161.posrbq (monmap changed)... 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.posrbq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: Reconfiguring daemon mds.cephfs.smithi161.posrbq on smithi161 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"}]: dispatch 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"}]': finished 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"}]: dispatch 2023-12-09T02:37:17.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"}]': finished 2023-12-09T02:37:17.204 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:17.204 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:17.204 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: Reconfiguring mds.cephfs.smithi161.posrbq (monmap changed)... 2023-12-09T02:37:17.204 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.posrbq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: Reconfiguring daemon mds.cephfs.smithi161.posrbq on smithi161 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"}]: dispatch 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"}]': finished 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"}]: dispatch 2023-12-09T02:37:17.205 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"}]': finished 2023-12-09T02:37:18.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:17 smithi161 ceph-mon[178840]: Upgrade: Setting container_image for all mon 2023-12-09T02:37:18.194 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:17 smithi088 ceph-mon[193406]: Upgrade: Setting container_image for all mon 2023-12-09T02:37:18.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.806+0000 7f1333308700 1 -- 172.21.15.88:0/644312581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f132c0fbe30 msgr2=0x7f132c0fc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:18.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.806+0000 7f1333308700 1 --2- 172.21.15.88:0/644312581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f132c0fbe30 0x7f132c0fc2a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1320004940 tx=0x7f1320009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:18.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.806+0000 7f1333308700 1 -- 172.21.15.88:0/644312581 shutdown_connections 2023-12-09T02:37:18.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.806+0000 7f1333308700 1 --2- 172.21.15.88:0/644312581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f132c0fbe30 0x7f132c0fc2a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:18.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.806+0000 7f1333308700 1 --2- 172.21.15.88:0/644312581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132c0fd120 0x7f132c0fd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:18.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.806+0000 7f1333308700 1 -- 172.21.15.88:0/644312581 >> 172.21.15.88:0/644312581 conn(0x7f132c0f6950 msgr2=0x7f132c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:18.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.806+0000 7f1333308700 1 -- 172.21.15.88:0/644312581 shutdown_connections 2023-12-09T02:37:18.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.806+0000 7f1333308700 1 -- 172.21.15.88:0/644312581 wait complete. 2023-12-09T02:37:18.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.807+0000 7f1333308700 1 Processor -- start 2023-12-09T02:37:18.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.807+0000 7f1333308700 1 -- start start 2023-12-09T02:37:18.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.807+0000 7f1333308700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132c0fbe30 0x7f132c112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:18.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.807+0000 7f1333308700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f132c0fd120 0x7f132c114c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:18.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.807+0000 7f1333308700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c0fb9b0 con 0x7f132c0fd120 2023-12-09T02:37:18.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.807+0000 7f1333308700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c0fbaf0 con 0x7f132c0fbe30 2023-12-09T02:37:18.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f13308a3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f132c0fd120 0x7f132c114c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:18.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f13308a3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f132c0fd120 0x7f132c114c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35034/0 (socket says 172.21.15.88:35034) 2023-12-09T02:37:18.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f13308a3700 1 -- 172.21.15.88:0/3923853164 learned_addr learned my addr 172.21.15.88:0/3923853164 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:18.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f13310a4700 1 --2- 172.21.15.88:0/3923853164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132c0fbe30 0x7f132c112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:18.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f13308a3700 1 -- 172.21.15.88:0/3923853164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132c0fbe30 msgr2=0x7f132c112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:18.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f13308a3700 1 --2- 172.21.15.88:0/3923853164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132c0fbe30 0x7f132c112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:18.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f13308a3700 1 -- 172.21.15.88:0/3923853164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320005040 con 0x7f132c0fd120 2023-12-09T02:37:18.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f13308a3700 1 --2- 172.21.15.88:0/3923853164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f132c0fd120 0x7f132c114c70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1320009360 tx=0x7f1320009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:18.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f1329ffb700 1 -- 172.21.15.88:0/3923853164 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f132000e040 con 0x7f132c0fd120 2023-12-09T02:37:18.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f1333308700 1 -- 172.21.15.88:0/3923853164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132c1151b0 con 0x7f132c0fd120 2023-12-09T02:37:18.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f1329ffb700 1 -- 172.21.15.88:0/3923853164 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f132000bcd0 con 0x7f132c0fd120 2023-12-09T02:37:18.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f1329ffb700 1 -- 172.21.15.88:0/3923853164 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f132001c630 con 0x7f132c0fd120 2023-12-09T02:37:18.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.808+0000 7f1333308700 1 -- 172.21.15.88:0/3923853164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132c115550 con 0x7f132c0fd120 2023-12-09T02:37:18.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.809+0000 7f1333308700 1 -- 172.21.15.88:0/3923853164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132c04bb80 con 0x7f132c0fd120 2023-12-09T02:37:18.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.810+0000 7f1329ffb700 1 -- 172.21.15.88:0/3923853164 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f132001c8a0 con 0x7f132c0fd120 2023-12-09T02:37:18.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.810+0000 7f1329ffb700 1 --2- 172.21.15.88:0/3923853164 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f131406cf80 0x7f131406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:18.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.810+0000 7f1329ffb700 1 -- 172.21.15.88:0/3923853164 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f132008d980 con 0x7f132c0fd120 2023-12-09T02:37:18.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.810+0000 7f13310a4700 1 --2- 172.21.15.88:0/3923853164 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f131406cf80 0x7f131406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:18.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.811+0000 7f13310a4700 1 --2- 172.21.15.88:0/3923853164 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f131406cf80 0x7f131406f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f131c009fd0 tx=0x7f131c00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:18.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:18.815+0000 7f1329ffb700 1 -- 172.21.15.88:0/3923853164 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1320057660 con 0x7f132c0fd120 2023-12-09T02:37:19.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.057+0000 7f1333308700 1 -- 172.21.15.88:0/3923853164 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f132c1156e0 con 0x7f131406cf80 2023-12-09T02:37:19.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.059+0000 7f1329ffb700 1 -- 172.21.15.88:0/3923853164 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f132c1156e0 con 0x7f131406cf80 2023-12-09T02:37:19.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.062+0000 7f1333308700 1 -- 172.21.15.88:0/3923853164 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f131406cf80 msgr2=0x7f131406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.062+0000 7f1333308700 1 --2- 172.21.15.88:0/3923853164 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f131406cf80 0x7f131406f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f131c009fd0 tx=0x7f131c00b040 comp rx=0 tx=0).stop 2023-12-09T02:37:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.062+0000 7f1333308700 1 -- 172.21.15.88:0/3923853164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f132c0fd120 msgr2=0x7f132c114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.062+0000 7f1333308700 1 --2- 172.21.15.88:0/3923853164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f132c0fd120 0x7f132c114c70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1320009360 tx=0x7f1320009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.062+0000 7f1333308700 1 -- 172.21.15.88:0/3923853164 shutdown_connections 2023-12-09T02:37:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.062+0000 7f1333308700 1 --2- 172.21.15.88:0/3923853164 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f131406cf80 0x7f131406f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.062+0000 7f1333308700 1 --2- 172.21.15.88:0/3923853164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132c0fbe30 0x7f132c112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.062+0000 7f1333308700 1 --2- 172.21.15.88:0/3923853164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f132c0fd120 0x7f132c114c70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.062+0000 7f1333308700 1 -- 172.21.15.88:0/3923853164 >> 172.21.15.88:0/3923853164 conn(0x7f132c0f6950 msgr2=0x7f132c100070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.062+0000 7f1333308700 1 -- 172.21.15.88:0/3923853164 shutdown_connections 2023-12-09T02:37:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.062+0000 7f1333308700 1 -- 172.21.15.88:0/3923853164 wait complete. 2023-12-09T02:37:19.074 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:37:19.122 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:18 smithi088 ceph-mon[193406]: Upgrade: Updating crash.smithi088 (1/2) 2023-12-09T02:37:19.122 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:18 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:19.123 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:18 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:37:19.123 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:18 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:19.123 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:18 smithi088 ceph-mon[193406]: Deploying daemon crash.smithi088 on smithi088 2023-12-09T02:37:19.123 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:18 smithi088 ceph-mon[193406]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-09T02:37:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:18 smithi161 ceph-mon[178840]: Upgrade: Updating crash.smithi088 (1/2) 2023-12-09T02:37:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:18 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:18 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:37:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:18 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:18 smithi161 ceph-mon[178840]: Deploying daemon crash.smithi088 on smithi088 2023-12-09T02:37:19.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:18 smithi161 ceph-mon[178840]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-09T02:37:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.172+0000 7fc08f302700 1 -- 172.21.15.88:0/1994455858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc088066090 msgr2=0x7fc0880ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.172+0000 7fc08f302700 1 --2- 172.21.15.88:0/1994455858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc088066090 0x7fc0880ff7a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc078004940 tx=0x7fc078009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.172+0000 7fc08f302700 1 -- 172.21.15.88:0/1994455858 shutdown_connections 2023-12-09T02:37:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.172+0000 7fc08f302700 1 --2- 172.21.15.88:0/1994455858 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0880ffd70 0x7fc0881021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.172+0000 7fc08f302700 1 --2- 172.21.15.88:0/1994455858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc088066090 0x7fc0880ff7a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.172+0000 7fc08f302700 1 -- 172.21.15.88:0/1994455858 >> 172.21.15.88:0/1994455858 conn(0x7fc0880f7190 msgr2=0x7fc0880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.172+0000 7fc08f302700 1 -- 172.21.15.88:0/1994455858 shutdown_connections 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.172+0000 7fc08f302700 1 -- 172.21.15.88:0/1994455858 wait complete. 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08f302700 1 Processor -- start 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08f302700 1 -- start start 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08f302700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc088066090 0x7fc08810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08f302700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0880ffd70 0x7fc08810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08f302700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08810e010 con 0x7fc0880ffd70 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08f302700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08810e8b0 con 0x7fc088066090 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08c89d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0880ffd70 0x7fc08810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08c89d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0880ffd70 0x7fc08810da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35056/0 (socket says 172.21.15.88:35056) 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08c89d700 1 -- 172.21.15.88:0/881701465 learned_addr learned my addr 172.21.15.88:0/881701465 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08d09e700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc088066090 0x7fc08810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08c89d700 1 -- 172.21.15.88:0/881701465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc088066090 msgr2=0x7fc08810d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08c89d700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc088066090 0x7fc08810d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08c89d700 1 -- 172.21.15.88:0/881701465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc078005040 con 0x7fc0880ffd70 2023-12-09T02:37:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08d09e700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc088066090 0x7fc08810d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:37:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08c89d700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0880ffd70 0x7fc08810da10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc08400eb40 tx=0x7fc08400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc07dffb700 1 -- 172.21.15.88:0/881701465 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc084007cc0 con 0x7fc0880ffd70 2023-12-09T02:37:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc07dffb700 1 -- 172.21.15.88:0/881701465 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc08400f040 con 0x7fc0880ffd70 2023-12-09T02:37:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc08f302700 1 -- 172.21.15.88:0/881701465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08810eb30 con 0x7fc0880ffd70 2023-12-09T02:37:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.173+0000 7fc07dffb700 1 -- 172.21.15.88:0/881701465 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc084009570 con 0x7fc0880ffd70 2023-12-09T02:37:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.174+0000 7fc08f302700 1 -- 172.21.15.88:0/881701465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08810f070 con 0x7fc0880ffd70 2023-12-09T02:37:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.175+0000 7fc08f302700 1 -- 172.21.15.88:0/881701465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08804bb80 con 0x7fc0880ffd70 2023-12-09T02:37:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.175+0000 7fc07dffb700 1 -- 172.21.15.88:0/881701465 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fc0840096d0 con 0x7fc0880ffd70 2023-12-09T02:37:19.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.175+0000 7fc07dffb700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc07406cf80 0x7fc07406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:19.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.175+0000 7fc08d09e700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc07406cf80 0x7fc07406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:19.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.175+0000 7fc07dffb700 1 -- 172.21.15.88:0/881701465 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc08408c070 con 0x7fc0880ffd70 2023-12-09T02:37:19.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.176+0000 7fc08d09e700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc07406cf80 0x7fc07406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc078004560 tx=0x7fc078009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:19.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.180+0000 7fc07dffb700 1 -- 172.21.15.88:0/881701465 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc084059810 con 0x7fc0880ffd70 2023-12-09T02:37:19.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.399+0000 7fc08f302700 1 -- 172.21.15.88:0/881701465 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc08810f4c0 con 0x7fc07406cf80 2023-12-09T02:37:19.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.400+0000 7fc07dffb700 1 -- 172.21.15.88:0/881701465 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fc08810f4c0 con 0x7fc07406cf80 2023-12-09T02:37:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.402+0000 7fc08f302700 1 -- 172.21.15.88:0/881701465 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc07406cf80 msgr2=0x7fc07406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.402+0000 7fc08f302700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc07406cf80 0x7fc07406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc078004560 tx=0x7fc078009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.402+0000 7fc08f302700 1 -- 172.21.15.88:0/881701465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0880ffd70 msgr2=0x7fc08810da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.402+0000 7fc08f302700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0880ffd70 0x7fc08810da10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc08400eb40 tx=0x7fc08400b040 comp rx=0 tx=0).stop 2023-12-09T02:37:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.402+0000 7fc08f302700 1 -- 172.21.15.88:0/881701465 shutdown_connections 2023-12-09T02:37:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.402+0000 7fc08f302700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc07406cf80 0x7fc07406f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.402+0000 7fc08f302700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc088066090 0x7fc08810d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.402+0000 7fc08f302700 1 --2- 172.21.15.88:0/881701465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0880ffd70 0x7fc08810da10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.402+0000 7fc08f302700 1 -- 172.21.15.88:0/881701465 >> 172.21.15.88:0/881701465 conn(0x7fc0880f7190 msgr2=0x7fc0880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.402+0000 7fc08f302700 1 -- 172.21.15.88:0/881701465 shutdown_connections 2023-12-09T02:37:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.402+0000 7fc08f302700 1 -- 172.21.15.88:0/881701465 wait complete. 2023-12-09T02:37:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.507+0000 7feebf2b8700 1 -- 172.21.15.88:0/1782689834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feeb8066070 msgr2=0x7feeb80ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.507+0000 7feebf2b8700 1 --2- 172.21.15.88:0/1782689834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feeb8066070 0x7feeb80ff7c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feeb4004940 tx=0x7feeb4009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.507+0000 7feebf2b8700 1 -- 172.21.15.88:0/1782689834 shutdown_connections 2023-12-09T02:37:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.507+0000 7feebf2b8700 1 --2- 172.21.15.88:0/1782689834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeb80ffd90 0x7feeb81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.507+0000 7feebf2b8700 1 --2- 172.21.15.88:0/1782689834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feeb8066070 0x7feeb80ff7c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.507+0000 7feebf2b8700 1 -- 172.21.15.88:0/1782689834 >> 172.21.15.88:0/1782689834 conn(0x7feeb80f7190 msgr2=0x7feeb80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.508+0000 7feebf2b8700 1 -- 172.21.15.88:0/1782689834 shutdown_connections 2023-12-09T02:37:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.508+0000 7feebf2b8700 1 -- 172.21.15.88:0/1782689834 wait complete. 2023-12-09T02:37:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.508+0000 7feebf2b8700 1 Processor -- start 2023-12-09T02:37:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.508+0000 7feebf2b8700 1 -- start start 2023-12-09T02:37:19.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.508+0000 7feebf2b8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feeb8066070 0x7feeb810d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:19.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.508+0000 7feebf2b8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeb80ffd90 0x7feeb810da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:19.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.508+0000 7feebf2b8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb810e000 con 0x7feeb8066070 2023-12-09T02:37:19.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.508+0000 7feebf2b8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb810e8a0 con 0x7feeb80ffd90 2023-12-09T02:37:19.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.508+0000 7feebd054700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feeb8066070 0x7feeb810d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:19.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.508+0000 7feebd054700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feeb8066070 0x7feeb810d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35088/0 (socket says 172.21.15.88:35088) 2023-12-09T02:37:19.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.508+0000 7feebd054700 1 -- 172.21.15.88:0/3640556366 learned_addr learned my addr 172.21.15.88:0/3640556366 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:19.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.509+0000 7feebc853700 1 --2- 172.21.15.88:0/3640556366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeb80ffd90 0x7feeb810da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:19.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.509+0000 7feebd054700 1 -- 172.21.15.88:0/3640556366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeb80ffd90 msgr2=0x7feeb810da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.509+0000 7feebd054700 1 --2- 172.21.15.88:0/3640556366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeb80ffd90 0x7feeb810da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.509+0000 7feebd054700 1 -- 172.21.15.88:0/3640556366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4005040 con 0x7feeb8066070 2023-12-09T02:37:19.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.509+0000 7feebd054700 1 --2- 172.21.15.88:0/3640556366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feeb8066070 0x7feeb810d4c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feeb4000c00 tx=0x7feeb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:19.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.509+0000 7feeadffb700 1 -- 172.21.15.88:0/3640556366 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeb4021070 con 0x7feeb8066070 2023-12-09T02:37:19.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.509+0000 7feebf2b8700 1 -- 172.21.15.88:0/3640556366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb810eb20 con 0x7feeb8066070 2023-12-09T02:37:19.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.509+0000 7feeadffb700 1 -- 172.21.15.88:0/3640556366 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feeb401c400 con 0x7feeb8066070 2023-12-09T02:37:19.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.509+0000 7feeadffb700 1 -- 172.21.15.88:0/3640556366 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeb400e070 con 0x7feeb8066070 2023-12-09T02:37:19.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.509+0000 7feebf2b8700 1 -- 172.21.15.88:0/3640556366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb810f000 con 0x7feeb8066070 2023-12-09T02:37:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.511+0000 7feebf2b8700 1 -- 172.21.15.88:0/3640556366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb804bb80 con 0x7feeb8066070 2023-12-09T02:37:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.511+0000 7feeadffb700 1 -- 172.21.15.88:0/3640556366 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7feeb401c570 con 0x7feeb8066070 2023-12-09T02:37:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.511+0000 7feeadffb700 1 --2- 172.21.15.88:0/3640556366 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7feea406cf80 0x7feea406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.511+0000 7feeadffb700 1 -- 172.21.15.88:0/3640556366 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7feeb408d870 con 0x7feeb8066070 2023-12-09T02:37:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.511+0000 7feebc853700 1 --2- 172.21.15.88:0/3640556366 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7feea406cf80 0x7feea406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.512+0000 7feebc853700 1 --2- 172.21.15.88:0/3640556366 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7feea406cf80 0x7feea406f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feea8004600 tx=0x7feea800b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:19.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.516+0000 7feeadffb700 1 -- 172.21.15.88:0/3640556366 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7feeb405afe0 con 0x7feeb8066070 2023-12-09T02:37:19.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.739+0000 7feebf2b8700 1 -- 172.21.15.88:0/3640556366 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feeb810f3f0 con 0x7feea406cf80 2023-12-09T02:37:19.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.749+0000 7feeadffb700 1 -- 172.21.15.88:0/3640556366 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7feeb810f3f0 con 0x7feea406cf80 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (103s) 38s ago 8m 28.5M - 0.25.0 c8568f914cd2 9dc2b8db0963 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (8m) 38s ago 8m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 9098f424ee11 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (7m) 27s ago 7m 7482k - 17.2.7-119-ge2143d99 f761b6e42225 15c5154f5f2e 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (100s) 38s ago 8m 83.3M - 9.4.7 954c08fa6188 ab4c3f64ce4d 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (4m) 38s ago 4m 14.1M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (4m) 38s ago 4m 15.5M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (4m) 27s ago 4m 10.0G - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (4m) 27s ago 4m 15.5M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:8443,9283,8765 running (92s) 38s ago 9m 476M - 19.0.0-44-g9dcc13bb f28f2b94f153 a939ff288750 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283,8765 running (65s) 27s ago 7m 447M - 19.0.0-44-g9dcc13bb f28f2b94f153 e2ee2a6eb30b 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (51s) 38s ago 9m 29.9M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 8e4b2ba7b37c 2023-12-09T02:37:19.751 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (31s) 27s ago 7m 29.2M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 4769966a784f 2023-12-09T02:37:19.752 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (106s) 38s ago 8m 17.1M - 1.5.0 0da6a335fe13 e2b7cc0b7527 2023-12-09T02:37:19.752 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (95s) 27s ago 7m 17.1M - 1.5.0 0da6a335fe13 0de833ab198e 2023-12-09T02:37:19.752 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (7m) 38s ago 6m 802M 1568M 17.2.7-119-ge2143d99 f761b6e42225 fdd606881a64 2023-12-09T02:37:19.752 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (6m) 38s ago 6m 848M 1568M 17.2.7-119-ge2143d99 f761b6e42225 354d4a4d3430 2023-12-09T02:37:19.752 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (6m) 38s ago 6m 702M 1568M 17.2.7-119-ge2143d99 f761b6e42225 0b0abbb070ec 2023-12-09T02:37:19.752 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (6m) 27s ago 6m 1114M 2592M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:37:19.752 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (5m) 27s ago 5m 822M 2592M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:37:19.752 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (5m) 27s ago 5m 926M 2592M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:37:19.752 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (70s) 38s ago 7m 47.5M - 2.43.0 a07b618ecd1d ddb1fb2e1888 2023-12-09T02:37:19.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.751+0000 7feebf2b8700 1 -- 172.21.15.88:0/3640556366 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7feea406cf80 msgr2=0x7feea406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.751+0000 7feebf2b8700 1 --2- 172.21.15.88:0/3640556366 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7feea406cf80 0x7feea406f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feea8004600 tx=0x7feea800b040 comp rx=0 tx=0).stop 2023-12-09T02:37:19.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.751+0000 7feebf2b8700 1 -- 172.21.15.88:0/3640556366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feeb8066070 msgr2=0x7feeb810d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.751+0000 7feebf2b8700 1 --2- 172.21.15.88:0/3640556366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feeb8066070 0x7feeb810d4c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feeb4000c00 tx=0x7feeb4009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:19.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.751+0000 7feebf2b8700 1 -- 172.21.15.88:0/3640556366 shutdown_connections 2023-12-09T02:37:19.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.751+0000 7feebf2b8700 1 --2- 172.21.15.88:0/3640556366 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7feea406cf80 0x7feea406f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.751+0000 7feebf2b8700 1 --2- 172.21.15.88:0/3640556366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feeb8066070 0x7feeb810d4c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.751+0000 7feebf2b8700 1 --2- 172.21.15.88:0/3640556366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeb80ffd90 0x7feeb810da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.751+0000 7feebf2b8700 1 -- 172.21.15.88:0/3640556366 >> 172.21.15.88:0/3640556366 conn(0x7feeb80f7190 msgr2=0x7feeb80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:19.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.751+0000 7feebf2b8700 1 -- 172.21.15.88:0/3640556366 shutdown_connections 2023-12-09T02:37:19.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.751+0000 7feebf2b8700 1 -- 172.21.15.88:0/3640556366 wait complete. 2023-12-09T02:37:19.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.862+0000 7fddd4972700 1 -- 172.21.15.88:0/2108884196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00fcbf0 msgr2=0x7fddd00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.862+0000 7fddd4972700 1 --2- 172.21.15.88:0/2108884196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00fcbf0 0x7fddd00fd000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fddc0004940 tx=0x7fddc0009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:19.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.862+0000 7fddd4972700 1 -- 172.21.15.88:0/2108884196 shutdown_connections 2023-12-09T02:37:19.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.862+0000 7fddd4972700 1 --2- 172.21.15.88:0/2108884196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd00fde00 0x7fddd00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.862+0000 7fddd4972700 1 --2- 172.21.15.88:0/2108884196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00fcbf0 0x7fddd00fd000 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.862+0000 7fddd4972700 1 -- 172.21.15.88:0/2108884196 >> 172.21.15.88:0/2108884196 conn(0x7fddd00f82d0 msgr2=0x7fddd00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:19.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.862+0000 7fddd4972700 1 -- 172.21.15.88:0/2108884196 shutdown_connections 2023-12-09T02:37:19.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.862+0000 7fddd4972700 1 -- 172.21.15.88:0/2108884196 wait complete. 2023-12-09T02:37:19.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddd4972700 1 Processor -- start 2023-12-09T02:37:19.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddd4972700 1 -- start start 2023-12-09T02:37:19.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddd4972700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00fcbf0 0x7fddd010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:19.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddd4972700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd00fde00 0x7fddd010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:19.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddd4972700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd010e0a0 con 0x7fddd00fcbf0 2023-12-09T02:37:19.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddd4972700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd010e940 con 0x7fddd00fde00 2023-12-09T02:37:19.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddce59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00fcbf0 0x7fddd010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:19.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddce59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00fcbf0 0x7fddd010d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35114/0 (socket says 172.21.15.88:35114) 2023-12-09T02:37:19.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddce59c700 1 -- 172.21.15.88:0/2919176409 learned_addr learned my addr 172.21.15.88:0/2919176409 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:19.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddcdd9b700 1 --2- 172.21.15.88:0/2919176409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd00fde00 0x7fddd010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:19.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddce59c700 1 -- 172.21.15.88:0/2919176409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd00fde00 msgr2=0x7fddd010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:19.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddce59c700 1 --2- 172.21.15.88:0/2919176409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd00fde00 0x7fddd010daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:19.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddce59c700 1 -- 172.21.15.88:0/2919176409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc0005040 con 0x7fddd00fcbf0 2023-12-09T02:37:19.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.863+0000 7fddce59c700 1 --2- 172.21.15.88:0/2919176409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00fcbf0 0x7fddd010d560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fddc0004f90 tx=0x7fddc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:19.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.864+0000 7fddbeffd700 1 -- 172.21.15.88:0/2919176409 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddc000e040 con 0x7fddd00fcbf0 2023-12-09T02:37:19.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.864+0000 7fddbeffd700 1 -- 172.21.15.88:0/2919176409 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fddc000bcd0 con 0x7fddd00fcbf0 2023-12-09T02:37:19.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.864+0000 7fddd4972700 1 -- 172.21.15.88:0/2919176409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd010ebc0 con 0x7fddd00fcbf0 2023-12-09T02:37:19.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.864+0000 7fddbeffd700 1 -- 172.21.15.88:0/2919176409 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddc001c630 con 0x7fddd00fcbf0 2023-12-09T02:37:19.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.864+0000 7fddd4972700 1 -- 172.21.15.88:0/2919176409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd010f100 con 0x7fddd00fcbf0 2023-12-09T02:37:19.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.865+0000 7fddd4972700 1 -- 172.21.15.88:0/2919176409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd01075d0 con 0x7fddd00fcbf0 2023-12-09T02:37:19.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.865+0000 7fddbeffd700 1 -- 172.21.15.88:0/2919176409 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fddc0013960 con 0x7fddd00fcbf0 2023-12-09T02:37:19.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.866+0000 7fddbeffd700 1 --2- 172.21.15.88:0/2919176409 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fddb806cf80 0x7fddb806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:19.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.866+0000 7fddbeffd700 1 -- 172.21.15.88:0/2919176409 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fddc008d9b0 con 0x7fddd00fcbf0 2023-12-09T02:37:19.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.866+0000 7fddcdd9b700 1 --2- 172.21.15.88:0/2919176409 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fddb806cf80 0x7fddb806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:19.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.867+0000 7fddcdd9b700 1 --2- 172.21.15.88:0/2919176409 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fddb806cf80 0x7fddb806f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fddc4004990 tx=0x7fddc4009ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:19.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:19.871+0000 7fddbeffd700 1 -- 172.21.15.88:0/2919176409 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fddc005b1c0 con 0x7fddd00fcbf0 2023-12-09T02:37:19.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:19 smithi088 ceph-mon[193406]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:19.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:19 smithi088 ceph-mon[193406]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:19.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:19 smithi088 ceph-mon[193406]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:20.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:19 smithi161 ceph-mon[178840]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:20.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:19 smithi161 ceph-mon[178840]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:20.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:19 smithi161 ceph-mon[178840]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:20.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.171+0000 7fddd4972700 1 -- 172.21.15.88:0/2919176409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fddd0105590 con 0x7fddd00fcbf0 2023-12-09T02:37:20.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.172+0000 7fddbeffd700 1 -- 172.21.15.88:0/2919176409 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7fddc005ad50 con 0x7fddd00fcbf0 2023-12-09T02:37:20.173 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:37:20.173 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:37:20.173 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 10, 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 4 2023-12-09T02:37:20.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:37:20.175 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:37:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.174+0000 7fddd4972700 1 -- 172.21.15.88:0/2919176409 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fddb806cf80 msgr2=0x7fddb806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.174+0000 7fddd4972700 1 --2- 172.21.15.88:0/2919176409 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fddb806cf80 0x7fddb806f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fddc4004990 tx=0x7fddc4009ee0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.174+0000 7fddd4972700 1 -- 172.21.15.88:0/2919176409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00fcbf0 msgr2=0x7fddd010d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.174+0000 7fddd4972700 1 --2- 172.21.15.88:0/2919176409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00fcbf0 0x7fddd010d560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fddc0004f90 tx=0x7fddc0009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.174+0000 7fddd4972700 1 -- 172.21.15.88:0/2919176409 shutdown_connections 2023-12-09T02:37:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.174+0000 7fddd4972700 1 --2- 172.21.15.88:0/2919176409 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fddb806cf80 0x7fddb806f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.174+0000 7fddd4972700 1 --2- 172.21.15.88:0/2919176409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00fcbf0 0x7fddd010d560 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.174+0000 7fddd4972700 1 --2- 172.21.15.88:0/2919176409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd00fde00 0x7fddd010daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.174+0000 7fddd4972700 1 -- 172.21.15.88:0/2919176409 >> 172.21.15.88:0/2919176409 conn(0x7fddd00f82d0 msgr2=0x7fddd00fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.174+0000 7fddd4972700 1 -- 172.21.15.88:0/2919176409 shutdown_connections 2023-12-09T02:37:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.174+0000 7fddd4972700 1 -- 172.21.15.88:0/2919176409 wait complete. 2023-12-09T02:37:20.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.283+0000 7fcfb36cc700 1 -- 172.21.15.88:0/42403370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfac0fcbf0 msgr2=0x7fcfac0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.283+0000 7fcfb36cc700 1 --2- 172.21.15.88:0/42403370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfac0fcbf0 0x7fcfac0fd000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8004940 tx=0x7fcfa8009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:20.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.283+0000 7fcfb36cc700 1 -- 172.21.15.88:0/42403370 shutdown_connections 2023-12-09T02:37:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.283+0000 7fcfb36cc700 1 --2- 172.21.15.88:0/42403370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfac0fde00 0x7fcfac0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.283+0000 7fcfb36cc700 1 --2- 172.21.15.88:0/42403370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfac0fcbf0 0x7fcfac0fd000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.283+0000 7fcfb36cc700 1 -- 172.21.15.88:0/42403370 >> 172.21.15.88:0/42403370 conn(0x7fcfac0f82d0 msgr2=0x7fcfac0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.283+0000 7fcfb36cc700 1 -- 172.21.15.88:0/42403370 shutdown_connections 2023-12-09T02:37:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.283+0000 7fcfb36cc700 1 -- 172.21.15.88:0/42403370 wait complete. 2023-12-09T02:37:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb36cc700 1 Processor -- start 2023-12-09T02:37:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb36cc700 1 -- start start 2023-12-09T02:37:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb36cc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfac0fcbf0 0x7fcfac10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb36cc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfac0fde00 0x7fcfac10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb36cc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac10e0a0 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb36cc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac10e940 con 0x7fcfac0fde00 2023-12-09T02:37:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb1468700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfac0fcbf0 0x7fcfac10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb1468700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfac0fcbf0 0x7fcfac10d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35120/0 (socket says 172.21.15.88:35120) 2023-12-09T02:37:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb1468700 1 -- 172.21.15.88:0/3306683651 learned_addr learned my addr 172.21.15.88:0/3306683651 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb0c67700 1 --2- 172.21.15.88:0/3306683651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfac0fde00 0x7fcfac10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb1468700 1 -- 172.21.15.88:0/3306683651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfac0fde00 msgr2=0x7fcfac10daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb1468700 1 --2- 172.21.15.88:0/3306683651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfac0fde00 0x7fcfac10daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.284+0000 7fcfb1468700 1 -- 172.21.15.88:0/3306683651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8005040 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.285+0000 7fcfb1468700 1 --2- 172.21.15.88:0/3306683651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfac0fcbf0 0x7fcfac10d560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8004f90 tx=0x7fcfa8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.285+0000 7fcfa1ffb700 1 -- 172.21.15.88:0/3306683651 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa800e040 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.285+0000 7fcfa1ffb700 1 -- 172.21.15.88:0/3306683651 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcfa800bc50 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.285+0000 7fcfb36cc700 1 -- 172.21.15.88:0/3306683651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfac10ebc0 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.285+0000 7fcfa1ffb700 1 -- 172.21.15.88:0/3306683651 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa801c630 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.285+0000 7fcfb36cc700 1 -- 172.21.15.88:0/3306683651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfac10f100 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.286+0000 7fcfb36cc700 1 -- 172.21.15.88:0/3306683651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfac1075d0 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.287+0000 7fcfa1ffb700 1 -- 172.21.15.88:0/3306683651 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fcfa801c8a0 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.287+0000 7fcfa1ffb700 1 --2- 172.21.15.88:0/3306683651 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcf9806cf80 0x7fcf9806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.287+0000 7fcfa1ffb700 1 -- 172.21.15.88:0/3306683651 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fcfa808e410 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.287+0000 7fcfb0c67700 1 --2- 172.21.15.88:0/3306683651 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcf9806cf80 0x7fcf9806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.288+0000 7fcfb0c67700 1 --2- 172.21.15.88:0/3306683651 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcf9806cf80 0x7fcf9806f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c004f40 tx=0x7fcf9c00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:20.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.291+0000 7fcfa1ffb700 1 -- 172.21.15.88:0/3306683651 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcfa805bc20 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.527+0000 7fcfb36cc700 1 -- 172.21.15.88:0/3306683651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcfac105590 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.528+0000 7fcfa1ffb700 1 -- 172.21.15.88:0/3306683651 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1848 (secure 0 0 0) 0x7fcfa802de60 con 0x7fcfac0fcbf0 2023-12-09T02:37:20.530 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:37:20.530 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:37:20.530 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:37:20.530 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:37:20.531 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:37:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:37:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:37:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:37:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:37:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:37:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:37:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:37:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:37:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:37:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:37:20.532 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:37:20.533 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:37:20.533 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:37:20.533 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2023-12-09T02:37:20.533 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:37:20.533 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:37:20.533 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:37:20.533 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:37:20.533 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:37:20.534 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:37:20.534 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:37:20.534 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:37:20.534 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:37:20.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.530+0000 7fcfb36cc700 1 -- 172.21.15.88:0/3306683651 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcf9806cf80 msgr2=0x7fcf9806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.530+0000 7fcfb36cc700 1 --2- 172.21.15.88:0/3306683651 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcf9806cf80 0x7fcf9806f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c004f40 tx=0x7fcf9c00b040 comp rx=0 tx=0).stop 2023-12-09T02:37:20.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.530+0000 7fcfb36cc700 1 -- 172.21.15.88:0/3306683651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfac0fcbf0 msgr2=0x7fcfac10d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.530+0000 7fcfb36cc700 1 --2- 172.21.15.88:0/3306683651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfac0fcbf0 0x7fcfac10d560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8004f90 tx=0x7fcfa8009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:20.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.530+0000 7fcfb36cc700 1 -- 172.21.15.88:0/3306683651 shutdown_connections 2023-12-09T02:37:20.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.530+0000 7fcfb36cc700 1 --2- 172.21.15.88:0/3306683651 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcf9806cf80 0x7fcf9806f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.530+0000 7fcfb36cc700 1 --2- 172.21.15.88:0/3306683651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfac0fcbf0 0x7fcfac10d560 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.530+0000 7fcfb36cc700 1 --2- 172.21.15.88:0/3306683651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfac0fde00 0x7fcfac10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.530+0000 7fcfb36cc700 1 -- 172.21.15.88:0/3306683651 >> 172.21.15.88:0/3306683651 conn(0x7fcfac0f82d0 msgr2=0x7fcfac0fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:20.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.530+0000 7fcfb36cc700 1 -- 172.21.15.88:0/3306683651 shutdown_connections 2023-12-09T02:37:20.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.530+0000 7fcfb36cc700 1 -- 172.21.15.88:0/3306683651 wait complete. 2023-12-09T02:37:20.537 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:37:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.630+0000 7ff1c9741700 1 -- 172.21.15.88:0/1753513708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1c40fbaf0 msgr2=0x7ff1c40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.630+0000 7ff1c9741700 1 --2- 172.21.15.88:0/1753513708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1c40fbaf0 0x7ff1c40fbf00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8004940 tx=0x7ff1b8009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.630+0000 7ff1c9741700 1 -- 172.21.15.88:0/1753513708 shutdown_connections 2023-12-09T02:37:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.630+0000 7ff1c9741700 1 --2- 172.21.15.88:0/1753513708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1c40fcd00 0x7ff1c40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.630+0000 7ff1c9741700 1 --2- 172.21.15.88:0/1753513708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1c40fbaf0 0x7ff1c40fbf00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.630+0000 7ff1c9741700 1 -- 172.21.15.88:0/1753513708 >> 172.21.15.88:0/1753513708 conn(0x7ff1c40f71d0 msgr2=0x7ff1c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:20.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.631+0000 7ff1c9741700 1 -- 172.21.15.88:0/1753513708 shutdown_connections 2023-12-09T02:37:20.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.631+0000 7ff1c9741700 1 -- 172.21.15.88:0/1753513708 wait complete. 2023-12-09T02:37:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.631+0000 7ff1c9741700 1 Processor -- start 2023-12-09T02:37:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.631+0000 7ff1c9741700 1 -- start start 2023-12-09T02:37:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.631+0000 7ff1c9741700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1c40fbaf0 0x7ff1c410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.631+0000 7ff1c9741700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1c40fcd00 0x7ff1c410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.631+0000 7ff1c9741700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c410e010 con 0x7ff1c40fcd00 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.631+0000 7ff1c9741700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c410e8b0 con 0x7ff1c40fbaf0 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1c27fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1c40fcd00 0x7ff1c410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1c27fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1c40fcd00 0x7ff1c410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35146/0 (socket says 172.21.15.88:35146) 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1c27fc700 1 -- 172.21.15.88:0/3855885857 learned_addr learned my addr 172.21.15.88:0/3855885857 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1c2ffd700 1 --2- 172.21.15.88:0/3855885857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1c40fbaf0 0x7ff1c410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1c27fc700 1 -- 172.21.15.88:0/3855885857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1c40fbaf0 msgr2=0x7ff1c410d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1c27fc700 1 --2- 172.21.15.88:0/3855885857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1c40fbaf0 0x7ff1c410d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1c27fc700 1 -- 172.21.15.88:0/3855885857 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b8005040 con 0x7ff1c40fcd00 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1c27fc700 1 --2- 172.21.15.88:0/3855885857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1c40fcd00 0x7ff1c410da10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400eb40 tx=0x7ff1b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1ab7fe700 1 -- 172.21.15.88:0/3855885857 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1b4007cc0 con 0x7ff1c40fcd00 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1c9741700 1 -- 172.21.15.88:0/3855885857 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c410eb30 con 0x7ff1c40fcd00 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1ab7fe700 1 -- 172.21.15.88:0/3855885857 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff1b400f040 con 0x7ff1c40fcd00 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1ab7fe700 1 -- 172.21.15.88:0/3855885857 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1b400c990 con 0x7ff1c40fcd00 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.632+0000 7ff1c9741700 1 -- 172.21.15.88:0/3855885857 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c410f070 con 0x7ff1c40fcd00 2023-12-09T02:37:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.633+0000 7ff1c9741700 1 -- 172.21.15.88:0/3855885857 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c404bb80 con 0x7ff1c40fcd00 2023-12-09T02:37:20.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.633+0000 7ff1ab7fe700 1 -- 172.21.15.88:0/3855885857 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7ff1b400cc00 con 0x7ff1c40fcd00 2023-12-09T02:37:20.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.634+0000 7ff1ab7fe700 1 --2- 172.21.15.88:0/3855885857 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff1ac06cf80 0x7ff1ac06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:20.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.634+0000 7ff1ab7fe700 1 -- 172.21.15.88:0/3855885857 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff1b408c1a0 con 0x7ff1c40fcd00 2023-12-09T02:37:20.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.634+0000 7ff1c2ffd700 1 --2- 172.21.15.88:0/3855885857 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff1ac06cf80 0x7ff1ac06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:20.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.634+0000 7ff1c2ffd700 1 --2- 172.21.15.88:0/3855885857 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff1ac06cf80 0x7ff1ac06f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8013680 tx=0x7ff1b8009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:20.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.638+0000 7ff1ab7fe700 1 -- 172.21.15.88:0/3855885857 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff1b4059940 con 0x7ff1c40fcd00 2023-12-09T02:37:20.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.845+0000 7ff1c9741700 1 -- 172.21.15.88:0/3855885857 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1c410f4c0 con 0x7ff1ac06cf80 2023-12-09T02:37:20.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.846+0000 7ff1ab7fe700 1 -- 172.21.15.88:0/3855885857 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7ff1c410f4c0 con 0x7ff1ac06cf80 2023-12-09T02:37:20.847 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:37:20.848 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:37:20.848 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:37:20.848 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:37:20.848 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2023-12-09T02:37:20.848 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2023-12-09T02:37:20.848 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2023-12-09T02:37:20.848 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-12-09T02:37:20.848 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "4/21 daemons upgraded", 2023-12-09T02:37:20.848 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading crash daemons", 2023-12-09T02:37:20.848 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:37:20.848 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:37:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.848+0000 7ff1c9741700 1 -- 172.21.15.88:0/3855885857 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff1ac06cf80 msgr2=0x7ff1ac06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.848+0000 7ff1c9741700 1 --2- 172.21.15.88:0/3855885857 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff1ac06cf80 0x7ff1ac06f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8013680 tx=0x7ff1b8009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.848+0000 7ff1c9741700 1 -- 172.21.15.88:0/3855885857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1c40fcd00 msgr2=0x7ff1c410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.848+0000 7ff1c9741700 1 --2- 172.21.15.88:0/3855885857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1c40fcd00 0x7ff1c410da10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400eb40 tx=0x7ff1b400b040 comp rx=0 tx=0).stop 2023-12-09T02:37:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.848+0000 7ff1c9741700 1 -- 172.21.15.88:0/3855885857 shutdown_connections 2023-12-09T02:37:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.848+0000 7ff1c9741700 1 --2- 172.21.15.88:0/3855885857 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff1ac06cf80 0x7ff1ac06f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.848+0000 7ff1c9741700 1 --2- 172.21.15.88:0/3855885857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1c40fbaf0 0x7ff1c410d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.848+0000 7ff1c9741700 1 --2- 172.21.15.88:0/3855885857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1c40fcd00 0x7ff1c410da10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.848+0000 7ff1c9741700 1 -- 172.21.15.88:0/3855885857 >> 172.21.15.88:0/3855885857 conn(0x7ff1c40f71d0 msgr2=0x7ff1c4065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.848+0000 7ff1c9741700 1 -- 172.21.15.88:0/3855885857 shutdown_connections 2023-12-09T02:37:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.848+0000 7ff1c9741700 1 -- 172.21.15.88:0/3855885857 wait complete. 2023-12-09T02:37:20.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.948+0000 7f328c15e700 1 -- 172.21.15.88:0/2178330910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840fcbf0 msgr2=0x7f32840fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.948+0000 7f328c15e700 1 --2- 172.21.15.88:0/2178330910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840fcbf0 0x7f32840fd000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3274004940 tx=0x7f3274009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:20.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.948+0000 7f328c15e700 1 -- 172.21.15.88:0/2178330910 shutdown_connections 2023-12-09T02:37:20.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.948+0000 7f328c15e700 1 --2- 172.21.15.88:0/2178330910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32840fde00 0x7f32840fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.948+0000 7f328c15e700 1 --2- 172.21.15.88:0/2178330910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840fcbf0 0x7f32840fd000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.948+0000 7f328c15e700 1 -- 172.21.15.88:0/2178330910 >> 172.21.15.88:0/2178330910 conn(0x7f32840f82d0 msgr2=0x7f32840fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:20.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.948+0000 7f328c15e700 1 -- 172.21.15.88:0/2178330910 shutdown_connections 2023-12-09T02:37:20.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.948+0000 7f328c15e700 1 -- 172.21.15.88:0/2178330910 wait complete. 2023-12-09T02:37:20.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.948+0000 7f328c15e700 1 Processor -- start 2023-12-09T02:37:20.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f328c15e700 1 -- start start 2023-12-09T02:37:20.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f328c15e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32840fcbf0 0x7f328410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:20.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f328c15e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840fde00 0x7f328410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f328c15e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328410e010 con 0x7f32840fde00 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f328c15e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328410e8b0 con 0x7f32840fcbf0 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f32896f9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840fde00 0x7f328410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f32896f9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840fde00 0x7f328410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35168/0 (socket says 172.21.15.88:35168) 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f32896f9700 1 -- 172.21.15.88:0/3836031550 learned_addr learned my addr 172.21.15.88:0/3836031550 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f3289efa700 1 --2- 172.21.15.88:0/3836031550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32840fcbf0 0x7f328410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f32896f9700 1 -- 172.21.15.88:0/3836031550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32840fcbf0 msgr2=0x7f328410d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f32896f9700 1 --2- 172.21.15.88:0/3836031550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32840fcbf0 0x7f328410d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f32896f9700 1 -- 172.21.15.88:0/3836031550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3274005040 con 0x7f32840fde00 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f32896f9700 1 --2- 172.21.15.88:0/3836031550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840fde00 0x7f328410da10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3280002a80 tx=0x7f32800046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.949+0000 7f327a7fc700 1 -- 172.21.15.88:0/3836031550 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3280007cc0 con 0x7f32840fde00 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.950+0000 7f328c15e700 1 -- 172.21.15.88:0/3836031550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328410eb90 con 0x7f32840fde00 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.950+0000 7f327a7fc700 1 -- 172.21.15.88:0/3836031550 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f328000f040 con 0x7f32840fde00 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.950+0000 7f327a7fc700 1 -- 172.21.15.88:0/3836031550 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f328000da60 con 0x7f32840fde00 2023-12-09T02:37:20.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.950+0000 7f328c15e700 1 -- 172.21.15.88:0/3836031550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328410f0d0 con 0x7f32840fde00 2023-12-09T02:37:20.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.950+0000 7f328c15e700 1 -- 172.21.15.88:0/3836031550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328404bb80 con 0x7f32840fde00 2023-12-09T02:37:20.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.951+0000 7f327a7fc700 1 -- 172.21.15.88:0/3836031550 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f328000dbc0 con 0x7f32840fde00 2023-12-09T02:37:20.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.951+0000 7f327a7fc700 1 --2- 172.21.15.88:0/3836031550 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f327006cf80 0x7f327006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:20.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.951+0000 7f327a7fc700 1 -- 172.21.15.88:0/3836031550 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f328008c210 con 0x7f32840fde00 2023-12-09T02:37:20.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.951+0000 7f3289efa700 1 --2- 172.21.15.88:0/3836031550 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f327006cf80 0x7f327006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:20.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.952+0000 7f3289efa700 1 --2- 172.21.15.88:0/3836031550 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f327006cf80 0x7f327006f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3274004890 tx=0x7f3274009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:20.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:20.956+0000 7f327a7fc700 1 -- 172.21.15.88:0/3836031550 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3280059900 con 0x7f32840fde00 2023-12-09T02:37:21.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:20 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/2919176409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:21.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:20 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:21.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:20 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:21.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:20 smithi161 ceph-mon[178840]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:21.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:20 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/3306683651' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:37:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:20 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/2919176409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:20 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:20 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:21.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:20 smithi088 ceph-mon[193406]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:21.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:20 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/3306683651' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:37:21.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.229+0000 7f328c15e700 1 -- 172.21.15.88:0/3836031550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3284105590 con 0x7f32840fde00 2023-12-09T02:37:21.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.229+0000 7f327a7fc700 1 -- 172.21.15.88:0/3836031550 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3280059490 con 0x7f32840fde00 2023-12-09T02:37:21.231 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:37:21.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.231+0000 7f328c15e700 1 -- 172.21.15.88:0/3836031550 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f327006cf80 msgr2=0x7f327006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:21.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.231+0000 7f328c15e700 1 --2- 172.21.15.88:0/3836031550 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f327006cf80 0x7f327006f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3274004890 tx=0x7f3274009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:21.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.231+0000 7f328c15e700 1 -- 172.21.15.88:0/3836031550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840fde00 msgr2=0x7f328410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:21.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.231+0000 7f328c15e700 1 --2- 172.21.15.88:0/3836031550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840fde00 0x7f328410da10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3280002a80 tx=0x7f32800046b0 comp rx=0 tx=0).stop 2023-12-09T02:37:21.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.231+0000 7f328c15e700 1 -- 172.21.15.88:0/3836031550 shutdown_connections 2023-12-09T02:37:21.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.231+0000 7f328c15e700 1 --2- 172.21.15.88:0/3836031550 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f327006cf80 0x7f327006f430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:21.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.231+0000 7f328c15e700 1 --2- 172.21.15.88:0/3836031550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32840fcbf0 0x7f328410d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:21.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.231+0000 7f328c15e700 1 --2- 172.21.15.88:0/3836031550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840fde00 0x7f328410da10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:21.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.231+0000 7f328c15e700 1 -- 172.21.15.88:0/3836031550 >> 172.21.15.88:0/3836031550 conn(0x7f32840f82d0 msgr2=0x7f3284101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:21.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.232+0000 7f328c15e700 1 -- 172.21.15.88:0/3836031550 shutdown_connections 2023-12-09T02:37:21.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:21.232+0000 7f328c15e700 1 -- 172.21.15.88:0/3836031550 wait complete. 2023-12-09T02:37:22.105 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:21 smithi161 ceph-mon[178840]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:22.105 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:21 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/3836031550' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:37:22.105 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:21 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:37:22.105 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:21 smithi161 ceph-mon[178840]: Upgrade: Updating crash.smithi161 (2/2) 2023-12-09T02:37:22.105 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:21 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:22.105 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:21 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:37:22.105 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:21 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:22.105 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:21 smithi161 ceph-mon[178840]: Deploying daemon crash.smithi161 on smithi161 2023-12-09T02:37:22.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:21 smithi088 ceph-mon[193406]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:22.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:21 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/3836031550' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:37:22.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:21 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:37:22.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:21 smithi088 ceph-mon[193406]: Upgrade: Updating crash.smithi161 (2/2) 2023-12-09T02:37:22.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:21 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:22.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:21 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-09T02:37:22.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:21 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:22.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:21 smithi088 ceph-mon[193406]: Deploying daemon crash.smithi161 on smithi161 2023-12-09T02:37:23.033 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:22 smithi161 ceph-mon[178840]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:23.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:22 smithi088 ceph-mon[193406]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:25.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:25 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:25.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:25 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:25.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:25 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:37:25.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:25 smithi161 ceph-mon[178840]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:25.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:25 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:25.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:25 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:25.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:25 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:37:25.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:25 smithi088 ceph-mon[193406]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:27.412 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:27 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:27.413 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:27 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:27.413 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:27 smithi161 ceph-mon[178840]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:27.413 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:27 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:27.413 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:27 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:27.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:27 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:27.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:27 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:27.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:27 smithi088 ceph-mon[193406]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:27.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:27 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:27.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:27 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:28.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:28 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:28.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:28 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:28.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:28 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:28.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:28 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:28.769 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:28 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:28.770 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:28 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:28.770 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:28 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:28.770 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:28 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:29.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:29 smithi088 ceph-mon[193406]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:29.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:29 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:29.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:29 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:29.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:29 smithi161 ceph-mon[178840]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:29.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:29 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:29.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:29 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:31.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:31.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:31.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:31.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:31.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:37:31.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:31.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:37:31.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:31.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:31.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:31.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: Upgrade: Setting container_image for all crash 2023-12-09T02:37:31.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:31.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"}]: dispatch 2023-12-09T02:37:31.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"}]': finished 2023-12-09T02:37:31.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"}]: dispatch 2023-12-09T02:37:31.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"}]': finished 2023-12-09T02:37:31.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-09T02:37:31.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-09T02:37:31.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:31 smithi088 ceph-mon[193406]: Upgrade: osd.0 is safe to restart 2023-12-09T02:37:31.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:31.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:31.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: Upgrade: Setting container_image for all crash 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"}]: dispatch 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"}]': finished 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"}]: dispatch 2023-12-09T02:37:31.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"}]': finished 2023-12-09T02:37:31.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-09T02:37:31.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-09T02:37:31.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:31 smithi161 ceph-mon[178840]: Upgrade: osd.0 is safe to restart 2023-12-09T02:37:33.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:32 smithi161 ceph-mon[178840]: Upgrade: Updating osd.0 2023-12-09T02:37:33.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:32 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:33.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:32 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-09T02:37:33.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:32 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:33.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:32 smithi161 ceph-mon[178840]: Deploying daemon osd.0 on smithi088 2023-12-09T02:37:33.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:32 smithi161 ceph-mon[178840]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:33.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:32 smithi088 ceph-mon[193406]: Upgrade: Updating osd.0 2023-12-09T02:37:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:32 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:32 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-09T02:37:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:32 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:32 smithi088 ceph-mon[193406]: Deploying daemon osd.0 on smithi088 2023-12-09T02:37:33.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:32 smithi088 ceph-mon[193406]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:34.448 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:34 smithi088 systemd[1]: Stopping Ceph osd.0 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:37:34.449 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:34 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[135678]: 2023-12-09T02:37:34.204+0000 7fa9e9034700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:37:34.449 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:34 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[135678]: 2023-12-09T02:37:34.204+0000 7fa9e9034700 -1 osd.0 50 *** Got signal Terminated *** 2023-12-09T02:37:34.449 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:34 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[135678]: 2023-12-09T02:37:34.204+0000 7fa9e9034700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:37:34.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:34 smithi088 ceph-mon[193406]: osd.0 marked itself down and dead 2023-12-09T02:37:34.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:34 smithi161 ceph-mon[178840]: osd.0 marked itself down and dead 2023-12-09T02:37:35.449 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:35 smithi088 bash[202915]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0 2023-12-09T02:37:35.707 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:35 smithi088 ceph-mon[193406]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:35.708 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:35 smithi088 ceph-mon[193406]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:37:35.708 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:35 smithi088 ceph-mon[193406]: failed to encode map e51 with expected crc 2023-12-09T02:37:35.708 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:35 smithi088 ceph-mon[193406]: osdmap e51: 6 total, 5 up, 6 in 2023-12-09T02:37:35.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:35 smithi161 ceph-mon[178840]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:35.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:35 smithi161 ceph-mon[178840]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:37:35.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:35 smithi161 ceph-mon[178840]: failed to encode map e51 with expected crc 2023-12-09T02:37:35.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:35 smithi161 ceph-mon[178840]: osdmap e51: 6 total, 5 up, 6 in 2023-12-09T02:37:36.726 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:36 smithi088 systemd[1]: ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.0.service: Succeeded. 2023-12-09T02:37:36.726 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:36 smithi088 systemd[1]: Stopped Ceph osd.0 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: osdmap e52: 6 total, 5 up, 6 in 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 0]}]: dispatch 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]: dispatch 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [3, 2]}]: dispatch 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]: dispatch 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]: dispatch 2023-12-09T02:37:36.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 0]}]: dispatch 2023-12-09T02:37:36.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [4, 2]}]: dispatch 2023-12-09T02:37:36.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]: dispatch 2023-12-09T02:37:36.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1f", "id": [3, 5]}]: dispatch 2023-12-09T02:37:36.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:36.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:37:36.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: osdmap e52: 6 total, 5 up, 6 in 2023-12-09T02:37:36.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: failed to encode map e52 with expected crc 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 0]}]: dispatch 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]: dispatch 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [3, 2]}]: dispatch 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]: dispatch 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]: dispatch 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 0]}]: dispatch 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [4, 2]}]: dispatch 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]: dispatch 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1f", "id": [3, 5]}]: dispatch 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:36.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:37:37.039 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:36 smithi088 systemd[1]: Starting Ceph osd.0 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:37:37.726 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:37 smithi088 bash[203181]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-09T02:37:37.726 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:37 smithi088 bash[203181]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-09T02:37:37.726 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:37 smithi088 bash[203181]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-09T02:37:37.726 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:37 smithi088 bash[203181]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-09T02:37:37.727 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:37 smithi088 bash[203181]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-09T02:37:37.727 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:37 smithi088 bash[203181]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-09T02:37:37.727 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:37 smithi088 bash[203181]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-09T02:37:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: pgmap v35: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 0]}]': finished 2023-12-09T02:37:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]': finished 2023-12-09T02:37:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [3, 2]}]': finished 2023-12-09T02:37:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]': finished 2023-12-09T02:37:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]': finished 2023-12-09T02:37:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 0]}]': finished 2023-12-09T02:37:37.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [4, 2]}]': finished 2023-12-09T02:37:37.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]': finished 2023-12-09T02:37:37.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1f", "id": [3, 5]}]': finished 2023-12-09T02:37:37.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: failed to encode map e53 with expected crc 2023-12-09T02:37:37.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:37 smithi088 ceph-mon[193406]: osdmap e53: 6 total, 5 up, 6 in 2023-12-09T02:37:37.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: pgmap v35: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:37:37.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 0]}]': finished 2023-12-09T02:37:37.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]': finished 2023-12-09T02:37:37.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [3, 2]}]': finished 2023-12-09T02:37:37.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]': finished 2023-12-09T02:37:37.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]': finished 2023-12-09T02:37:37.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 0]}]': finished 2023-12-09T02:37:37.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [4, 2]}]': finished 2023-12-09T02:37:37.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]': finished 2023-12-09T02:37:37.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1f", "id": [3, 5]}]': finished 2023-12-09T02:37:37.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: failed to encode map e53 with expected crc 2023-12-09T02:37:37.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:37 smithi161 ceph-mon[178840]: osdmap e53: 6 total, 5 up, 6 in 2023-12-09T02:37:38.464 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:38 smithi088 ceph-osd[203500]: -- 172.21.15.88:0/3200316116 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557ea71411e0 con 0x557ea7110c00 2023-12-09T02:37:38.464 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:38 smithi088 bash[203462]: 88f0691c638aa1474a46efdee3ed87fc30ac8bce7b2fe10820975538191e66a5 2023-12-09T02:37:38.464 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:38 smithi088 systemd[1]: Started Ceph osd.0 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:37:38.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:38 smithi088 ceph-mon[193406]: failed to encode map e54 with expected crc 2023-12-09T02:37:38.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:38 smithi088 ceph-mon[193406]: osdmap e54: 6 total, 5 up, 6 in 2023-12-09T02:37:38.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:38 smithi088 ceph-mon[193406]: failed to encode map e54 with expected crc 2023-12-09T02:37:38.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:38 smithi088 ceph-mon[193406]: failed to encode map e54 with expected crc 2023-12-09T02:37:38.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:38 smithi088 ceph-mon[193406]: failed to encode map e54 with expected crc 2023-12-09T02:37:38.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:38 smithi088 ceph-mon[193406]: failed to encode map e54 with expected crc 2023-12-09T02:37:38.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:38 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:38.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:38 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:38.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:38 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:37:38.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:38 smithi161 ceph-mon[178840]: failed to encode map e54 with expected crc 2023-12-09T02:37:38.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:38 smithi161 ceph-mon[178840]: osdmap e54: 6 total, 5 up, 6 in 2023-12-09T02:37:38.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:38 smithi161 ceph-mon[178840]: failed to encode map e54 with expected crc 2023-12-09T02:37:38.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:38 smithi161 ceph-mon[178840]: failed to encode map e54 with expected crc 2023-12-09T02:37:38.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:38 smithi161 ceph-mon[178840]: failed to encode map e54 with expected crc 2023-12-09T02:37:38.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:38 smithi161 ceph-mon[178840]: failed to encode map e54 with expected crc 2023-12-09T02:37:38.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:38 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:38.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:38 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:38.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:38 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:37:39.226 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:38 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[203477]: 2023-12-09T02:37:38.727+0000 7f5dbbd73640 -1 Falling back to public interface 2023-12-09T02:37:39.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:39 smithi088 ceph-mon[193406]: pgmap v38: 65 pgs: 5 peering, 16 active+undersized+degraded, 13 active+undersized, 29 active+clean, 2 stale+active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:37:39.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:39 smithi088 ceph-mon[193406]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:39 smithi088 ceph-mon[193406]: osdmap e55: 6 total, 5 up, 6 in 2023-12-09T02:37:39.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:39 smithi088 ceph-mon[193406]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:39 smithi088 ceph-mon[193406]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:39 smithi088 ceph-mon[193406]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:39 smithi088 ceph-mon[193406]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:39 smithi088 ceph-mon[193406]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:39 smithi088 ceph-mon[193406]: Health check failed: Degraded data redundancy: 38/222 objects degraded (17.117%), 16 pgs degraded (PG_DEGRADED) 2023-12-09T02:37:39.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:39 smithi161 ceph-mon[178840]: pgmap v38: 65 pgs: 5 peering, 16 active+undersized+degraded, 13 active+undersized, 29 active+clean, 2 stale+active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:37:39.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:39 smithi161 ceph-mon[178840]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:39 smithi161 ceph-mon[178840]: osdmap e55: 6 total, 5 up, 6 in 2023-12-09T02:37:39.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:39 smithi161 ceph-mon[178840]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:39 smithi161 ceph-mon[178840]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:39 smithi161 ceph-mon[178840]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:39 smithi161 ceph-mon[178840]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:39 smithi161 ceph-mon[178840]: failed to encode map e55 with expected crc 2023-12-09T02:37:39.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:39 smithi161 ceph-mon[178840]: Health check failed: Degraded data redundancy: 38/222 objects degraded (17.117%), 16 pgs degraded (PG_DEGRADED) 2023-12-09T02:37:40.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:40 smithi088 ceph-mon[193406]: failed to encode map e56 with expected crc 2023-12-09T02:37:40.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:40 smithi088 ceph-mon[193406]: osdmap e56: 6 total, 5 up, 6 in 2023-12-09T02:37:40.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:40 smithi088 ceph-mon[193406]: failed to encode map e56 with expected crc 2023-12-09T02:37:40.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:40 smithi161 ceph-mon[178840]: failed to encode map e56 with expected crc 2023-12-09T02:37:40.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:40 smithi161 ceph-mon[178840]: osdmap e56: 6 total, 5 up, 6 in 2023-12-09T02:37:40.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:40 smithi161 ceph-mon[178840]: failed to encode map e56 with expected crc 2023-12-09T02:37:41.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:41 smithi088 ceph-mon[193406]: pgmap v41: 65 pgs: 5 peering, 16 active+undersized+degraded, 13 active+undersized, 29 active+clean, 2 stale+active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:37:41.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:41 smithi088 ceph-mon[193406]: failed to encode map e57 with expected crc 2023-12-09T02:37:41.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:41 smithi088 ceph-mon[193406]: osdmap e57: 6 total, 5 up, 6 in 2023-12-09T02:37:41.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:41 smithi088 ceph-mon[193406]: failed to encode map e57 with expected crc 2023-12-09T02:37:41.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:41 smithi088 ceph-mon[193406]: failed to encode map e57 with expected crc 2023-12-09T02:37:41.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:41 smithi161 ceph-mon[178840]: pgmap v41: 65 pgs: 5 peering, 16 active+undersized+degraded, 13 active+undersized, 29 active+clean, 2 stale+active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:37:41.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:41 smithi161 ceph-mon[178840]: failed to encode map e57 with expected crc 2023-12-09T02:37:41.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:41 smithi161 ceph-mon[178840]: osdmap e57: 6 total, 5 up, 6 in 2023-12-09T02:37:41.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:41 smithi161 ceph-mon[178840]: failed to encode map e57 with expected crc 2023-12-09T02:37:41.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:41 smithi161 ceph-mon[178840]: failed to encode map e57 with expected crc 2023-12-09T02:37:42.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:42 smithi088 ceph-mon[193406]: failed to encode map e58 with expected crc 2023-12-09T02:37:42.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:42 smithi088 ceph-mon[193406]: osdmap e58: 6 total, 5 up, 6 in 2023-12-09T02:37:42.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:42 smithi088 ceph-mon[193406]: failed to encode map e58 with expected crc 2023-12-09T02:37:42.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:42 smithi088 ceph-mon[193406]: failed to encode map e58 with expected crc 2023-12-09T02:37:42.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:42 smithi088 ceph-mon[193406]: failed to encode map e58 with expected crc 2023-12-09T02:37:42.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:42.824 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:42.824 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:42.824 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:42.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:42 smithi161 ceph-mon[178840]: failed to encode map e58 with expected crc 2023-12-09T02:37:42.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:42 smithi161 ceph-mon[178840]: osdmap e58: 6 total, 5 up, 6 in 2023-12-09T02:37:42.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:42 smithi161 ceph-mon[178840]: failed to encode map e58 with expected crc 2023-12-09T02:37:42.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:42 smithi161 ceph-mon[178840]: failed to encode map e58 with expected crc 2023-12-09T02:37:42.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:42 smithi161 ceph-mon[178840]: failed to encode map e58 with expected crc 2023-12-09T02:37:42.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:42.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:42.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:42.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:43.476 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:43 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[203477]: 2023-12-09T02:37:43.206+0000 7f5dbbd73640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-09T02:37:43.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:43 smithi161 ceph-mon[178840]: pgmap v44: 65 pgs: 1 remapped+peering, 27 active+clean, 13 active+undersized, 16 active+undersized+degraded, 8 active+clean+remapped; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 38/222 objects degraded (17.117%); 7/222 objects misplaced (3.153%); 2.0 MiB/s, 0 keys/s, 357 objects/s recovering 2023-12-09T02:37:43.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:43 smithi161 ceph-mon[178840]: failed to encode map e59 with expected crc 2023-12-09T02:37:43.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:43 smithi161 ceph-mon[178840]: osdmap e59: 6 total, 5 up, 6 in 2023-12-09T02:37:43.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:43 smithi161 ceph-mon[178840]: failed to encode map e59 with expected crc 2023-12-09T02:37:43.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:43 smithi088 ceph-mon[193406]: pgmap v44: 65 pgs: 1 remapped+peering, 27 active+clean, 13 active+undersized, 16 active+undersized+degraded, 8 active+clean+remapped; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 38/222 objects degraded (17.117%); 7/222 objects misplaced (3.153%); 2.0 MiB/s, 0 keys/s, 357 objects/s recovering 2023-12-09T02:37:43.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:43 smithi088 ceph-mon[193406]: failed to encode map e59 with expected crc 2023-12-09T02:37:43.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:43 smithi088 ceph-mon[193406]: osdmap e59: 6 total, 5 up, 6 in 2023-12-09T02:37:43.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:43 smithi088 ceph-mon[193406]: failed to encode map e59 with expected crc 2023-12-09T02:37:43.977 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:43 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[203477]: 2023-12-09T02:37:43.687+0000 7f5dbbd73640 -1 osd.0 50 log_to_monitors true 2023-12-09T02:37:44.695 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:44 smithi088 ceph-mon[193406]: from='osd.0 [v2:172.21.15.88:6802/1860691891,v1:172.21.15.88:6803/1860691891]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-09T02:37:44.696 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:37:44 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[203477]: 2023-12-09T02:37:44.508+0000 7f5daa9df700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:37:44.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:44 smithi161 ceph-mon[178840]: from='osd.0 [v2:172.21.15.88:6802/1860691891,v1:172.21.15.88:6803/1860691891]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-09T02:37:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: pgmap v46: 65 pgs: 1 remapped+peering, 27 active+clean, 13 active+undersized, 16 active+undersized+degraded, 8 active+clean+remapped; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 38/222 objects degraded (17.117%); 7/222 objects misplaced (3.153%); 1.7 MiB/s, 0 keys/s, 295 objects/s recovering 2023-12-09T02:37:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='osd.0 [v2:172.21.15.88:6802/1860691891,v1:172.21.15.88:6803/1860691891]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-09T02:37:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: failed to encode map e60 with expected crc 2023-12-09T02:37:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: osdmap e60: 6 total, 5 up, 6 in 2023-12-09T02:37:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='osd.0 [v2:172.21.15.88:6802/1860691891,v1:172.21.15.88:6803/1860691891]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:37:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:37:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:37:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-09T02:37:45.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: pgmap v46: 65 pgs: 1 remapped+peering, 27 active+clean, 13 active+undersized, 16 active+undersized+degraded, 8 active+clean+remapped; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 38/222 objects degraded (17.117%); 7/222 objects misplaced (3.153%); 1.7 MiB/s, 0 keys/s, 295 objects/s recovering 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='osd.0 [v2:172.21.15.88:6802/1860691891,v1:172.21.15.88:6803/1860691891]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: failed to encode map e60 with expected crc 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: osdmap e60: 6 total, 5 up, 6 in 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='osd.0 [v2:172.21.15.88:6802/1860691891,v1:172.21.15.88:6803/1860691891]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:45.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-09T02:37:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:46 smithi161 ceph-mon[178840]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-09T02:37:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:46 smithi161 ceph-mon[178840]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2023-12-09T02:37:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:46 smithi161 ceph-mon[178840]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:37:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:46 smithi161 ceph-mon[178840]: failed to encode map e60 with expected crc 2023-12-09T02:37:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:46 smithi161 ceph-mon[178840]: osd.0 [v2:172.21.15.88:6802/1860691891,v1:172.21.15.88:6803/1860691891] boot 2023-12-09T02:37:46.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:46 smithi161 ceph-mon[178840]: osdmap e61: 6 total, 6 up, 6 in 2023-12-09T02:37:46.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:46 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:37:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:46 smithi088 ceph-mon[193406]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-09T02:37:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:46 smithi088 ceph-mon[193406]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2023-12-09T02:37:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:46 smithi088 ceph-mon[193406]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:37:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:46 smithi088 ceph-mon[193406]: failed to encode map e60 with expected crc 2023-12-09T02:37:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:46 smithi088 ceph-mon[193406]: osd.0 [v2:172.21.15.88:6802/1860691891,v1:172.21.15.88:6803/1860691891] boot 2023-12-09T02:37:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:46 smithi088 ceph-mon[193406]: osdmap e61: 6 total, 6 up, 6 in 2023-12-09T02:37:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:46 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-09T02:37:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:47 smithi161 ceph-mon[178840]: pgmap v49: 65 pgs: 1 remapped+peering, 27 active+clean, 13 active+undersized, 16 active+undersized+degraded, 8 active+clean+remapped; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 38/222 objects degraded (17.117%); 7/222 objects misplaced (3.153%); 1.7 MiB/s, 0 keys/s, 296 objects/s recovering 2023-12-09T02:37:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:47 smithi161 ceph-mon[178840]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:47 smithi161 ceph-mon[178840]: osdmap e62: 6 total, 6 up, 6 in 2023-12-09T02:37:47.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:47 smithi161 ceph-mon[178840]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:47 smithi161 ceph-mon[178840]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:47 smithi161 ceph-mon[178840]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:47 smithi161 ceph-mon[178840]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:47 smithi161 ceph-mon[178840]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:47 smithi161 ceph-mon[178840]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:47 smithi161 ceph-mon[178840]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:47 smithi161 ceph-mon[178840]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:47 smithi088 ceph-mon[193406]: pgmap v49: 65 pgs: 1 remapped+peering, 27 active+clean, 13 active+undersized, 16 active+undersized+degraded, 8 active+clean+remapped; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 38/222 objects degraded (17.117%); 7/222 objects misplaced (3.153%); 1.7 MiB/s, 0 keys/s, 296 objects/s recovering 2023-12-09T02:37:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:47 smithi088 ceph-mon[193406]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:47 smithi088 ceph-mon[193406]: osdmap e62: 6 total, 6 up, 6 in 2023-12-09T02:37:47.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:47 smithi088 ceph-mon[193406]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:47 smithi088 ceph-mon[193406]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:47 smithi088 ceph-mon[193406]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:47 smithi088 ceph-mon[193406]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:47 smithi088 ceph-mon[193406]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:47 smithi088 ceph-mon[193406]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:47 smithi088 ceph-mon[193406]: failed to encode map e62 with expected crc 2023-12-09T02:37:47.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:47 smithi088 ceph-mon[193406]: failed to encode map e62 with expected crc 2023-12-09T02:37:48.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: osdmap e63: 6 total, 6 up, 6 in 2023-12-09T02:37:48.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: failed to encode map e64 with expected crc 2023-12-09T02:37:48.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: osdmap e64: 6 total, 6 up, 6 in 2023-12-09T02:37:48.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:48 smithi161 ceph-mon[178840]: failed to encode map e64 with expected crc 2023-12-09T02:37:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: osdmap e63: 6 total, 6 up, 6 in 2023-12-09T02:37:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: failed to encode map e63 with expected crc 2023-12-09T02:37:48.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: failed to encode map e64 with expected crc 2023-12-09T02:37:48.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: osdmap e64: 6 total, 6 up, 6 in 2023-12-09T02:37:48.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:48 smithi088 ceph-mon[193406]: failed to encode map e64 with expected crc 2023-12-09T02:37:49.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:49 smithi161 ceph-mon[178840]: pgmap v52: 65 pgs: 3 peering, 4 remapped+peering, 49 active+clean, 5 active+undersized, 2 active+undersized+degraded, 2 active+clean+remapped; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3/222 objects degraded (1.351%); 3/222 objects misplaced (1.351%); 0 B/s, 180 objects/s recovering 2023-12-09T02:37:49.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:49 smithi161 ceph-mon[178840]: Health check update: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded (PG_DEGRADED) 2023-12-09T02:37:49.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:49 smithi161 ceph-mon[178840]: osdmap e65: 6 total, 6 up, 6 in 2023-12-09T02:37:49.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:49 smithi161 ceph-mon[178840]: failed to encode map e65 with expected crc 2023-12-09T02:37:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:49 smithi088 ceph-mon[193406]: pgmap v52: 65 pgs: 3 peering, 4 remapped+peering, 49 active+clean, 5 active+undersized, 2 active+undersized+degraded, 2 active+clean+remapped; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3/222 objects degraded (1.351%); 3/222 objects misplaced (1.351%); 0 B/s, 180 objects/s recovering 2023-12-09T02:37:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:49 smithi088 ceph-mon[193406]: Health check update: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded (PG_DEGRADED) 2023-12-09T02:37:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:49 smithi088 ceph-mon[193406]: osdmap e65: 6 total, 6 up, 6 in 2023-12-09T02:37:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:49 smithi088 ceph-mon[193406]: failed to encode map e65 with expected crc 2023-12-09T02:37:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:50 smithi161 ceph-mon[178840]: failed to encode map e65 with expected crc 2023-12-09T02:37:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:50 smithi161 ceph-mon[178840]: failed to encode map e65 with expected crc 2023-12-09T02:37:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:50 smithi161 ceph-mon[178840]: failed to encode map e65 with expected crc 2023-12-09T02:37:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:50 smithi161 ceph-mon[178840]: osdmap e66: 6 total, 6 up, 6 in 2023-12-09T02:37:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:50 smithi088 ceph-mon[193406]: failed to encode map e65 with expected crc 2023-12-09T02:37:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:50 smithi088 ceph-mon[193406]: failed to encode map e65 with expected crc 2023-12-09T02:37:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:50 smithi088 ceph-mon[193406]: failed to encode map e65 with expected crc 2023-12-09T02:37:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:50 smithi088 ceph-mon[193406]: osdmap e66: 6 total, 6 up, 6 in 2023-12-09T02:37:51.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.341+0000 7f526177e700 1 -- 172.21.15.88:0/1649119550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0faed0 msgr2=0x7f525c0fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:51.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.341+0000 7f526177e700 1 --2- 172.21.15.88:0/1649119550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0faed0 0x7f525c0fb2e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f524c004940 tx=0x7f524c009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:51.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.341+0000 7f526177e700 1 -- 172.21.15.88:0/1649119550 shutdown_connections 2023-12-09T02:37:51.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.341+0000 7f526177e700 1 --2- 172.21.15.88:0/1649119550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f525c0fdf60 0x7f525c0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.341+0000 7f526177e700 1 --2- 172.21.15.88:0/1649119550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0faed0 0x7f525c0fb2e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.341+0000 7f526177e700 1 -- 172.21.15.88:0/1649119550 >> 172.21.15.88:0/1649119550 conn(0x7f525c0f6950 msgr2=0x7f525c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:51.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.341+0000 7f526177e700 1 -- 172.21.15.88:0/1649119550 shutdown_connections 2023-12-09T02:37:51.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.341+0000 7f526177e700 1 -- 172.21.15.88:0/1649119550 wait complete. 2023-12-09T02:37:51.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.341+0000 7f526177e700 1 Processor -- start 2023-12-09T02:37:51.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.341+0000 7f526177e700 1 -- start start 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f526177e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0faed0 0x7f525c10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f526177e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f525c0fdf60 0x7f525c10db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f526177e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c10e110 con 0x7f525c0faed0 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f526177e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c10e9b0 con 0x7f525c0fdf60 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f525affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0faed0 0x7f525c10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f525affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0faed0 0x7f525c10d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38728/0 (socket says 172.21.15.88:38728) 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f525affd700 1 -- 172.21.15.88:0/1611396987 learned_addr learned my addr 172.21.15.88:0/1611396987 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f525affd700 1 -- 172.21.15.88:0/1611396987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f525c0fdf60 msgr2=0x7f525c10db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f525affd700 1 --2- 172.21.15.88:0/1611396987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f525c0fdf60 0x7f525c10db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f525affd700 1 -- 172.21.15.88:0/1611396987 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c005040 con 0x7f525c0faed0 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f525affd700 1 --2- 172.21.15.88:0/1611396987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0faed0 0x7f525c10d5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f524c00b7d0 tx=0x7f524c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f52437fe700 1 -- 172.21.15.88:0/1611396987 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f524c00e040 con 0x7f525c0faed0 2023-12-09T02:37:51.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f52437fe700 1 -- 172.21.15.88:0/1611396987 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f524c00bc50 con 0x7f525c0faed0 2023-12-09T02:37:51.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f526177e700 1 -- 172.21.15.88:0/1611396987 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c10ec30 con 0x7f525c0faed0 2023-12-09T02:37:51.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f52437fe700 1 -- 172.21.15.88:0/1611396987 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f524c01c630 con 0x7f525c0faed0 2023-12-09T02:37:51.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.342+0000 7f526177e700 1 -- 172.21.15.88:0/1611396987 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c10f170 con 0x7f525c0faed0 2023-12-09T02:37:51.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.343+0000 7f526177e700 1 -- 172.21.15.88:0/1611396987 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c1075f0 con 0x7f525c0faed0 2023-12-09T02:37:51.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.344+0000 7f52437fe700 1 -- 172.21.15.88:0/1611396987 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f524c013420 con 0x7f525c0faed0 2023-12-09T02:37:51.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.344+0000 7f52437fe700 1 --2- 172.21.15.88:0/1611396987 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524406cf80 0x7f524406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:51.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.344+0000 7f52437fe700 1 -- 172.21.15.88:0/1611396987 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f524c08db00 con 0x7f525c0faed0 2023-12-09T02:37:51.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.344+0000 7f525a7fc700 1 --2- 172.21.15.88:0/1611396987 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524406cf80 0x7f524406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:51.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.345+0000 7f525a7fc700 1 --2- 172.21.15.88:0/1611396987 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524406cf80 0x7f524406f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5250004d00 tx=0x7f5250009ce0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:51.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.349+0000 7f52437fe700 1 -- 172.21.15.88:0/1611396987 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f524c05b150 con 0x7f525c0faed0 2023-12-09T02:37:51.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.564+0000 7f526177e700 1 -- 172.21.15.88:0/1611396987 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f525c02b1f0 con 0x7f524406cf80 2023-12-09T02:37:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.565+0000 7f52437fe700 1 -- 172.21.15.88:0/1611396987 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f525c02b1f0 con 0x7f524406cf80 2023-12-09T02:37:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.567+0000 7f526177e700 1 -- 172.21.15.88:0/1611396987 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524406cf80 msgr2=0x7f524406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.567+0000 7f526177e700 1 --2- 172.21.15.88:0/1611396987 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524406cf80 0x7f524406f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5250004d00 tx=0x7f5250009ce0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.567+0000 7f526177e700 1 -- 172.21.15.88:0/1611396987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0faed0 msgr2=0x7f525c10d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.567+0000 7f526177e700 1 --2- 172.21.15.88:0/1611396987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0faed0 0x7f525c10d5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f524c00b7d0 tx=0x7f524c009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.567+0000 7f526177e700 1 -- 172.21.15.88:0/1611396987 shutdown_connections 2023-12-09T02:37:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.567+0000 7f526177e700 1 --2- 172.21.15.88:0/1611396987 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524406cf80 0x7f524406f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.567+0000 7f526177e700 1 --2- 172.21.15.88:0/1611396987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0faed0 0x7f525c10d5d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.567+0000 7f526177e700 1 --2- 172.21.15.88:0/1611396987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f525c0fdf60 0x7f525c10db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.567+0000 7f526177e700 1 -- 172.21.15.88:0/1611396987 >> 172.21.15.88:0/1611396987 conn(0x7f525c0f6950 msgr2=0x7f525c0f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.567+0000 7f526177e700 1 -- 172.21.15.88:0/1611396987 shutdown_connections 2023-12-09T02:37:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.567+0000 7f526177e700 1 -- 172.21.15.88:0/1611396987 wait complete. 2023-12-09T02:37:51.580 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:37:51.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.668+0000 7fbad748f700 1 -- 172.21.15.88:0/1286937777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad00fbae0 msgr2=0x7fbad00fbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:51.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.668+0000 7fbad748f700 1 --2- 172.21.15.88:0/1286937777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad00fbae0 0x7fbad00fbef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbacc004940 tx=0x7fbacc009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:51.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.668+0000 7fbad748f700 1 -- 172.21.15.88:0/1286937777 shutdown_connections 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.668+0000 7fbad748f700 1 --2- 172.21.15.88:0/1286937777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbad00fcd90 0x7fbad00fd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.668+0000 7fbad748f700 1 --2- 172.21.15.88:0/1286937777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad00fbae0 0x7fbad00fbef0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.668+0000 7fbad748f700 1 -- 172.21.15.88:0/1286937777 >> 172.21.15.88:0/1286937777 conn(0x7fbad00f7240 msgr2=0x7fbad00f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.668+0000 7fbad748f700 1 -- 172.21.15.88:0/1286937777 shutdown_connections 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.668+0000 7fbad748f700 1 -- 172.21.15.88:0/1286937777 wait complete. 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad748f700 1 Processor -- start 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad748f700 1 -- start start 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad748f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbad00fbae0 0x7fbad010c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad748f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad00fcd90 0x7fbad010c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad748f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad010cf30 con 0x7fbad00fcd90 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad748f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad010d7d0 con 0x7fbad00fbae0 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad4a2a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad00fcd90 0x7fbad010c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad4a2a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad00fcd90 0x7fbad010c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38740/0 (socket says 172.21.15.88:38740) 2023-12-09T02:37:51.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad4a2a700 1 -- 172.21.15.88:0/4036065602 learned_addr learned my addr 172.21.15.88:0/4036065602 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:51.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad4a2a700 1 -- 172.21.15.88:0/4036065602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbad00fbae0 msgr2=0x7fbad010c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:51.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad4a2a700 1 --2- 172.21.15.88:0/4036065602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbad00fbae0 0x7fbad010c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.669+0000 7fbad4a2a700 1 -- 172.21.15.88:0/4036065602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc005040 con 0x7fbad00fcd90 2023-12-09T02:37:51.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.670+0000 7fbad4a2a700 1 --2- 172.21.15.88:0/4036065602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad00fcd90 0x7fbad010c930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c8c0 tx=0x7fbac40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:51.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.670+0000 7fbac1ffb700 1 -- 172.21.15.88:0/4036065602 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbac400a980 con 0x7fbad00fcd90 2023-12-09T02:37:51.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.670+0000 7fbad748f700 1 -- 172.21.15.88:0/4036065602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad010dab0 con 0x7fbad00fcd90 2023-12-09T02:37:51.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.670+0000 7fbac1ffb700 1 -- 172.21.15.88:0/4036065602 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbac400ce60 con 0x7fbad00fcd90 2023-12-09T02:37:51.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.670+0000 7fbac1ffb700 1 -- 172.21.15.88:0/4036065602 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbac40113a0 con 0x7fbad00fcd90 2023-12-09T02:37:51.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.670+0000 7fbad748f700 1 -- 172.21.15.88:0/4036065602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad010dff0 con 0x7fbad00fcd90 2023-12-09T02:37:51.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.671+0000 7fbad748f700 1 -- 172.21.15.88:0/4036065602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad004bb80 con 0x7fbad00fcd90 2023-12-09T02:37:51.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.671+0000 7fbac1ffb700 1 -- 172.21.15.88:0/4036065602 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fbac4012400 con 0x7fbad00fcd90 2023-12-09T02:37:51.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.672+0000 7fbac1ffb700 1 --2- 172.21.15.88:0/4036065602 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fbabc06cf80 0x7fbabc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:51.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.672+0000 7fbac1ffb700 1 -- 172.21.15.88:0/4036065602 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fbac408c6b0 con 0x7fbad00fcd90 2023-12-09T02:37:51.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.672+0000 7fbad522b700 1 --2- 172.21.15.88:0/4036065602 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fbabc06cf80 0x7fbabc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:51.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.672+0000 7fbad522b700 1 --2- 172.21.15.88:0/4036065602 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fbabc06cf80 0x7fbabc06f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00b3b0 tx=0x7fbacc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:51.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.676+0000 7fbac1ffb700 1 -- 172.21.15.88:0/4036065602 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbac4059e30 con 0x7fbad00fcd90 2023-12-09T02:37:51.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.881+0000 7fbad748f700 1 -- 172.21.15.88:0/4036065602 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbad010e460 con 0x7fbabc06cf80 2023-12-09T02:37:51.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.882+0000 7fbac1ffb700 1 -- 172.21.15.88:0/4036065602 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fbad010e460 con 0x7fbabc06cf80 2023-12-09T02:37:51.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.884+0000 7fbad748f700 1 -- 172.21.15.88:0/4036065602 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fbabc06cf80 msgr2=0x7fbabc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.884+0000 7fbad748f700 1 --2- 172.21.15.88:0/4036065602 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fbabc06cf80 0x7fbabc06f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00b3b0 tx=0x7fbacc009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.884+0000 7fbad748f700 1 -- 172.21.15.88:0/4036065602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad00fcd90 msgr2=0x7fbad010c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.884+0000 7fbad748f700 1 --2- 172.21.15.88:0/4036065602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad00fcd90 0x7fbad010c930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c8c0 tx=0x7fbac40044c0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.884+0000 7fbad748f700 1 -- 172.21.15.88:0/4036065602 shutdown_connections 2023-12-09T02:37:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.884+0000 7fbad748f700 1 --2- 172.21.15.88:0/4036065602 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fbabc06cf80 0x7fbabc06f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.884+0000 7fbad748f700 1 --2- 172.21.15.88:0/4036065602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbad00fbae0 0x7fbad010c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.884+0000 7fbad748f700 1 --2- 172.21.15.88:0/4036065602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad00fcd90 0x7fbad010c930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.884+0000 7fbad748f700 1 -- 172.21.15.88:0/4036065602 >> 172.21.15.88:0/4036065602 conn(0x7fbad00f7240 msgr2=0x7fbad00fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.884+0000 7fbad748f700 1 -- 172.21.15.88:0/4036065602 shutdown_connections 2023-12-09T02:37:51.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.884+0000 7fbad748f700 1 -- 172.21.15.88:0/4036065602 wait complete. 2023-12-09T02:37:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:51 smithi161 ceph-mon[178840]: pgmap v55: 65 pgs: 3 peering, 4 remapped+peering, 58 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 180 objects/s recovering 2023-12-09T02:37:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:51 smithi161 ceph-mon[178840]: failed to encode map e66 with expected crc 2023-12-09T02:37:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:51 smithi161 ceph-mon[178840]: failed to encode map e66 with expected crc 2023-12-09T02:37:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:51 smithi161 ceph-mon[178840]: failed to encode map e66 with expected crc 2023-12-09T02:37:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:51 smithi161 ceph-mon[178840]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded) 2023-12-09T02:37:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:51 smithi161 ceph-mon[178840]: Cluster is now healthy 2023-12-09T02:37:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:51 smithi161 ceph-mon[178840]: failed to encode map e66 with expected crc 2023-12-09T02:37:51.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:51 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:51.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:51 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:37:51.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:51 smithi161 ceph-mon[178840]: osdmap e67: 6 total, 6 up, 6 in 2023-12-09T02:37:51.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:51 smithi161 ceph-mon[178840]: failed to encode map e67 with expected crc 2023-12-09T02:37:51.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:51 smithi088 ceph-mon[193406]: pgmap v55: 65 pgs: 3 peering, 4 remapped+peering, 58 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 180 objects/s recovering 2023-12-09T02:37:51.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:51 smithi088 ceph-mon[193406]: failed to encode map e66 with expected crc 2023-12-09T02:37:51.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:51 smithi088 ceph-mon[193406]: failed to encode map e66 with expected crc 2023-12-09T02:37:51.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:51 smithi088 ceph-mon[193406]: failed to encode map e66 with expected crc 2023-12-09T02:37:51.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:51 smithi088 ceph-mon[193406]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded) 2023-12-09T02:37:51.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:51 smithi088 ceph-mon[193406]: Cluster is now healthy 2023-12-09T02:37:51.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:51 smithi088 ceph-mon[193406]: failed to encode map e66 with expected crc 2023-12-09T02:37:51.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:51 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:37:51.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:51 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:37:51.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:51 smithi088 ceph-mon[193406]: osdmap e67: 6 total, 6 up, 6 in 2023-12-09T02:37:51.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:51 smithi088 ceph-mon[193406]: failed to encode map e67 with expected crc 2023-12-09T02:37:51.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.983+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3440466424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e40fcbf0 msgr2=0x7fe2e40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:51.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.983+0000 7fe2e9eac700 1 --2- 172.21.15.88:0/3440466424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e40fcbf0 0x7fe2e40fd000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4004940 tx=0x7fe2d4009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:51.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.983+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3440466424 shutdown_connections 2023-12-09T02:37:51.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.983+0000 7fe2e9eac700 1 --2- 172.21.15.88:0/3440466424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e40fde00 0x7fe2e40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.983+0000 7fe2e9eac700 1 --2- 172.21.15.88:0/3440466424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e40fcbf0 0x7fe2e40fd000 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.983+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3440466424 >> 172.21.15.88:0/3440466424 conn(0x7fe2e40f82d0 msgr2=0x7fe2e40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:51.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.983+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3440466424 shutdown_connections 2023-12-09T02:37:51.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.983+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3440466424 wait complete. 2023-12-09T02:37:51.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.984+0000 7fe2e9eac700 1 Processor -- start 2023-12-09T02:37:51.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.984+0000 7fe2e9eac700 1 -- start start 2023-12-09T02:37:51.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.984+0000 7fe2e9eac700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e40fcbf0 0x7fe2e410d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:51.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.984+0000 7fe2e9eac700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e40fde00 0x7fe2e410db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:51.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.984+0000 7fe2e9eac700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e410e1e0 con 0x7fe2e40fcbf0 2023-12-09T02:37:51.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.984+0000 7fe2e9eac700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e410ea20 con 0x7fe2e40fde00 2023-12-09T02:37:51.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.984+0000 7fe2e37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e40fcbf0 0x7fe2e410d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.984+0000 7fe2e37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e40fcbf0 0x7fe2e410d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38756/0 (socket says 172.21.15.88:38756) 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.984+0000 7fe2e37fe700 1 -- 172.21.15.88:0/3309052909 learned_addr learned my addr 172.21.15.88:0/3309052909 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.984+0000 7fe2e2ffd700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e40fde00 0x7fe2e410db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.985+0000 7fe2e37fe700 1 -- 172.21.15.88:0/3309052909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e40fde00 msgr2=0x7fe2e410db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.985+0000 7fe2e37fe700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e40fde00 0x7fe2e410db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.985+0000 7fe2e37fe700 1 -- 172.21.15.88:0/3309052909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d4005040 con 0x7fe2e40fcbf0 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.985+0000 7fe2e2ffd700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e40fde00 0x7fe2e410db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.985+0000 7fe2e37fe700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e40fcbf0 0x7fe2e410d610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4000c00 tx=0x7fe2d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.985+0000 7fe2cbfff700 1 -- 172.21.15.88:0/3309052909 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2d400e030 con 0x7fe2e40fcbf0 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.985+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3309052909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e410eca0 con 0x7fe2e40fcbf0 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.985+0000 7fe2cbfff700 1 -- 172.21.15.88:0/3309052909 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe2d4004290 con 0x7fe2e40fcbf0 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.985+0000 7fe2cbfff700 1 -- 172.21.15.88:0/3309052909 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2d401c400 con 0x7fe2e40fcbf0 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.985+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3309052909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e410f1e0 con 0x7fe2e40fcbf0 2023-12-09T02:37:51.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.986+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3309052909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e404bb80 con 0x7fe2e40fcbf0 2023-12-09T02:37:51.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.987+0000 7fe2cbfff700 1 -- 172.21.15.88:0/3309052909 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fe2d4013420 con 0x7fe2e40fcbf0 2023-12-09T02:37:51.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.987+0000 7fe2cbfff700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe2cc06cf80 0x7fe2cc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:51.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.987+0000 7fe2cbfff700 1 -- 172.21.15.88:0/3309052909 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fe2d408e3f0 con 0x7fe2e40fcbf0 2023-12-09T02:37:51.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.987+0000 7fe2e2ffd700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe2cc06cf80 0x7fe2cc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:51.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.988+0000 7fe2e2ffd700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe2cc06cf80 0x7fe2cc06f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009a80 tx=0x7fe2d8008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:51.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:51.991+0000 7fe2cbfff700 1 -- 172.21.15.88:0/3309052909 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe2d405ba40 con 0x7fe2e40fcbf0 2023-12-09T02:37:52.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.190+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3309052909 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2e410f680 con 0x7fe2cc06cf80 2023-12-09T02:37:52.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.200+0000 7fe2cbfff700 1 -- 172.21.15.88:0/3309052909 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe2e410f680 con 0x7fe2cc06cf80 2023-12-09T02:37:52.202 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:37:52.202 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (2m) 10s ago 8m 28.5M - 0.25.0 c8568f914cd2 9dc2b8db0963 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (32s) 10s ago 8m 7470k - 19.0.0-44-g9dcc13bb f28f2b94f153 bf03eec19a86 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (28s) 26s ago 8m 7444k - 19.0.0-44-g9dcc13bb f28f2b94f153 890646e8cd90 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (2m) 10s ago 8m 86.2M - 9.4.7 954c08fa6188 ab4c3f64ce4d 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (5m) 10s ago 5m 14.5M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (4m) 10s ago 4m 15.8M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (4m) 26s ago 4m 10.1G - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (4m) 26s ago 4m 15.6M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:8443,9283,8765 running (2m) 10s ago 9m 507M - 19.0.0-44-g9dcc13bb f28f2b94f153 a939ff288750 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283,8765 running (98s) 26s ago 8m 448M - 19.0.0-44-g9dcc13bb f28f2b94f153 e2ee2a6eb30b 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (84s) 10s ago 10m 58.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 8e4b2ba7b37c 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (63s) 26s ago 8m 42.0M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 4769966a784f 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (2m) 10s ago 8m 17.7M - 1.5.0 0da6a335fe13 e2b7cc0b7527 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (2m) 26s ago 8m 17.4M - 1.5.0 0da6a335fe13 0de833ab198e 2023-12-09T02:37:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (14s) 10s ago 7m 12.6M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 88f0691c638a 2023-12-09T02:37:52.204 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (7m) 10s ago 7m 929M 1568M 17.2.7-119-ge2143d99 f761b6e42225 354d4a4d3430 2023-12-09T02:37:52.204 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (6m) 10s ago 6m 829M 1568M 17.2.7-119-ge2143d99 f761b6e42225 0b0abbb070ec 2023-12-09T02:37:52.204 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (6m) 26s ago 6m 1124M 2592M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:37:52.204 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (6m) 26s ago 6m 831M 2592M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:37:52.204 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (5m) 26s ago 5m 945M 2592M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:37:52.204 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (103s) 10s ago 8m 50.8M - 2.43.0 a07b618ecd1d ddb1fb2e1888 2023-12-09T02:37:52.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.202+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3309052909 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe2cc06cf80 msgr2=0x7fe2cc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.202+0000 7fe2e9eac700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe2cc06cf80 0x7fe2cc06f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009a80 tx=0x7fe2d8008040 comp rx=0 tx=0).stop 2023-12-09T02:37:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.202+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3309052909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e40fcbf0 msgr2=0x7fe2e410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.202+0000 7fe2e9eac700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e40fcbf0 0x7fe2e410d610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4000c00 tx=0x7fe2d4009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.202+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3309052909 shutdown_connections 2023-12-09T02:37:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.202+0000 7fe2e9eac700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe2cc06cf80 0x7fe2cc06f430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.202+0000 7fe2e9eac700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e40fcbf0 0x7fe2e410d610 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.202+0000 7fe2e9eac700 1 --2- 172.21.15.88:0/3309052909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e40fde00 0x7fe2e410db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.202+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3309052909 >> 172.21.15.88:0/3309052909 conn(0x7fe2e40f82d0 msgr2=0x7fe2e4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.202+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3309052909 shutdown_connections 2023-12-09T02:37:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.202+0000 7fe2e9eac700 1 -- 172.21.15.88:0/3309052909 wait complete. 2023-12-09T02:37:52.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.300+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/2590729607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fc0066090 msgr2=0x7f1fc00ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:52.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.300+0000 7f1fc7ad4700 1 --2- 172.21.15.88:0/2590729607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fc0066090 0x7f1fc00ff7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc004940 tx=0x7f1fbc009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:52.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/2590729607 shutdown_connections 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 --2- 172.21.15.88:0/2590729607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc00ffd70 0x7f1fc01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 --2- 172.21.15.88:0/2590729607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fc0066090 0x7f1fc00ff7a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/2590729607 >> 172.21.15.88:0/2590729607 conn(0x7f1fc00f7190 msgr2=0x7f1fc00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/2590729607 shutdown_connections 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/2590729607 wait complete. 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 Processor -- start 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 -- start start 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc0066090 0x7f1fc00fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fc00ffd70 0x7f1fc00fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00fbca0 con 0x7f1fc00ffd70 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc7ad4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00fbe10 con 0x7f1fc0066090 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc506f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fc00ffd70 0x7f1fc00fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:52.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc506f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fc00ffd70 0x7f1fc00fb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38782/0 (socket says 172.21.15.88:38782) 2023-12-09T02:37:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.301+0000 7f1fc506f700 1 -- 172.21.15.88:0/179029229 learned_addr learned my addr 172.21.15.88:0/179029229 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.302+0000 7f1fc5870700 1 --2- 172.21.15.88:0/179029229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc0066090 0x7f1fc00fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.302+0000 7f1fc506f700 1 -- 172.21.15.88:0/179029229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc0066090 msgr2=0x7f1fc00fd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.302+0000 7f1fc506f700 1 --2- 172.21.15.88:0/179029229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc0066090 0x7f1fc00fd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.302+0000 7f1fc506f700 1 -- 172.21.15.88:0/179029229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc005040 con 0x7f1fc00ffd70 2023-12-09T02:37:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.302+0000 7f1fc506f700 1 --2- 172.21.15.88:0/179029229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fc00ffd70 0x7f1fc00fb6a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c890 tx=0x7f1fb00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.302+0000 7f1fb67fc700 1 -- 172.21.15.88:0/179029229 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb000a7d0 con 0x7f1fc00ffd70 2023-12-09T02:37:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.302+0000 7f1fb67fc700 1 -- 172.21.15.88:0/179029229 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1fb000ade0 con 0x7f1fc00ffd70 2023-12-09T02:37:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.302+0000 7f1fb67fc700 1 -- 172.21.15.88:0/179029229 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb00113a0 con 0x7f1fc00ffd70 2023-12-09T02:37:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.302+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/179029229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc00fc0f0 con 0x7f1fc00ffd70 2023-12-09T02:37:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.302+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/179029229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc01155b0 con 0x7f1fc00ffd70 2023-12-09T02:37:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.303+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/179029229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc01075e0 con 0x7f1fc00ffd70 2023-12-09T02:37:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.303+0000 7f1fb67fc700 1 -- 172.21.15.88:0/179029229 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f1fb0012400 con 0x7f1fc00ffd70 2023-12-09T02:37:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.304+0000 7f1fb67fc700 1 --2- 172.21.15.88:0/179029229 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1fac06cf80 0x7f1fac06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.304+0000 7f1fc5870700 1 --2- 172.21.15.88:0/179029229 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1fac06cf80 0x7f1fac06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.304+0000 7f1fb67fc700 1 -- 172.21.15.88:0/179029229 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f1fb008c580 con 0x7f1fc00ffd70 2023-12-09T02:37:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.304+0000 7f1fc5870700 1 --2- 172.21.15.88:0/179029229 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1fac06cf80 0x7f1fac06f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00b3b0 tx=0x7f1fbc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:52.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.309+0000 7f1fb67fc700 1 -- 172.21.15.88:0/179029229 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1fb0059da0 con 0x7f1fc00ffd70 2023-12-09T02:37:52.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.588+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/179029229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1fc004bb80 con 0x7f1fc00ffd70 2023-12-09T02:37:52.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.588+0000 7f1fb67fc700 1 -- 172.21.15.88:0/179029229 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f1fb005ee60 con 0x7f1fc00ffd70 2023-12-09T02:37:52.595 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:37:52.595 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:37:52.595 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:37:52.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 5, 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 1 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 9, 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 5 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:37:52.596 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:37:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.590+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/179029229 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1fac06cf80 msgr2=0x7f1fac06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.590+0000 7f1fc7ad4700 1 --2- 172.21.15.88:0/179029229 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1fac06cf80 0x7f1fac06f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00b3b0 tx=0x7f1fbc009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.590+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/179029229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fc00ffd70 msgr2=0x7f1fc00fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.590+0000 7f1fc7ad4700 1 --2- 172.21.15.88:0/179029229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fc00ffd70 0x7f1fc00fb6a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c890 tx=0x7f1fb00044c0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.590+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/179029229 shutdown_connections 2023-12-09T02:37:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.590+0000 7f1fc7ad4700 1 --2- 172.21.15.88:0/179029229 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1fac06cf80 0x7f1fac06f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.590+0000 7f1fc7ad4700 1 --2- 172.21.15.88:0/179029229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fc0066090 0x7f1fc00fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.590+0000 7f1fc7ad4700 1 --2- 172.21.15.88:0/179029229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fc00ffd70 0x7f1fc00fb6a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.590+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/179029229 >> 172.21.15.88:0/179029229 conn(0x7f1fc00f7190 msgr2=0x7f1fc00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:52.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.590+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/179029229 shutdown_connections 2023-12-09T02:37:52.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.590+0000 7f1fc7ad4700 1 -- 172.21.15.88:0/179029229 wait complete. 2023-12-09T02:37:52.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.690+0000 7f04c0963700 1 -- 172.21.15.88:0/2685485691 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04ac00bc00 con 0x7f04bc0fcbf0 2023-12-09T02:37:52.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.690+0000 7f04c3bc9700 1 -- 172.21.15.88:0/2685485691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04bc0fcbf0 msgr2=0x7f04bc0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:52.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.690+0000 7f04c3bc9700 1 --2- 172.21.15.88:0/2685485691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc0fd000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04ac004940 tx=0x7f04ac009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:52.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.690+0000 7f04c3bc9700 1 -- 172.21.15.88:0/2685485691 shutdown_connections 2023-12-09T02:37:52.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.690+0000 7f04c3bc9700 1 --2- 172.21.15.88:0/2685485691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc0fde00 0x7f04bc0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.690+0000 7f04c3bc9700 1 --2- 172.21.15.88:0/2685485691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc0fd000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.690+0000 7f04c3bc9700 1 -- 172.21.15.88:0/2685485691 >> 172.21.15.88:0/2685485691 conn(0x7f04bc0f82d0 msgr2=0x7f04bc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:52.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.690+0000 7f04c3bc9700 1 -- 172.21.15.88:0/2685485691 shutdown_connections 2023-12-09T02:37:52.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.690+0000 7f04c3bc9700 1 -- 172.21.15.88:0/2685485691 wait complete. 2023-12-09T02:37:52.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c3bc9700 1 Processor -- start 2023-12-09T02:37:52.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c3bc9700 1 -- start start 2023-12-09T02:37:52.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c3bc9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:52.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c3bc9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04bc0fde00 0x7f04bc10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:52.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c3bc9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc10e0c0 con 0x7f04bc0fde00 2023-12-09T02:37:52.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c3bc9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc10e960 con 0x7f04bc0fcbf0 2023-12-09T02:37:52.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c1164700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04bc0fde00 0x7f04bc10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:52.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c1164700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04bc0fde00 0x7f04bc10dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38806/0 (socket says 172.21.15.88:38806) 2023-12-09T02:37:52.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c1164700 1 -- 172.21.15.88:0/1044853661 learned_addr learned my addr 172.21.15.88:0/1044853661 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:52.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c1965700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:52.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c1164700 1 -- 172.21.15.88:0/1044853661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc0fcbf0 msgr2=0x7f04bc10d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:52.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.691+0000 7f04c1164700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc10d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.692+0000 7f04c1164700 1 -- 172.21.15.88:0/1044853661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac005040 con 0x7f04bc0fde00 2023-12-09T02:37:52.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.692+0000 7f04c1965700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc10d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:37:52.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.692+0000 7f04c1164700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04bc0fde00 0x7f04bc10dac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f04b8002a50 tx=0x7f04b80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:52.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.692+0000 7f04b27fc700 1 -- 172.21.15.88:0/1044853661 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b8007cc0 con 0x7f04bc0fde00 2023-12-09T02:37:52.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.692+0000 7f04c3bc9700 1 -- 172.21.15.88:0/1044853661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc10ec40 con 0x7f04bc0fde00 2023-12-09T02:37:52.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.692+0000 7f04b27fc700 1 -- 172.21.15.88:0/1044853661 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f04b800f040 con 0x7f04bc0fde00 2023-12-09T02:37:52.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.692+0000 7f04b27fc700 1 -- 172.21.15.88:0/1044853661 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b8009540 con 0x7f04bc0fde00 2023-12-09T02:37:52.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.692+0000 7f04c3bc9700 1 -- 172.21.15.88:0/1044853661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc10f180 con 0x7f04bc0fde00 2023-12-09T02:37:52.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.693+0000 7f04c3bc9700 1 -- 172.21.15.88:0/1044853661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc04bb80 con 0x7f04bc0fde00 2023-12-09T02:37:52.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.693+0000 7f04b27fc700 1 -- 172.21.15.88:0/1044853661 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f04b80096a0 con 0x7f04bc0fde00 2023-12-09T02:37:52.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.694+0000 7f04b27fc700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f04a806cf80 0x7f04a806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:52.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.694+0000 7f04b27fc700 1 -- 172.21.15.88:0/1044853661 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f04b808c570 con 0x7f04bc0fde00 2023-12-09T02:37:52.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.694+0000 7f04c1965700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f04a806cf80 0x7f04a806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:52.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.694+0000 7f04c1965700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f04a806cf80 0x7f04a806f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00b3b0 tx=0x7f04ac009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:52.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.698+0000 7f04b27fc700 1 -- 172.21.15.88:0/1044853661 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f04b8059ac0 con 0x7f04bc0fde00 2023-12-09T02:37:52.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:52 smithi161 ceph-mon[178840]: failed to encode map e67 with expected crc 2023-12-09T02:37:52.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:52 smithi161 ceph-mon[178840]: failed to encode map e67 with expected crc 2023-12-09T02:37:52.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:52 smithi161 ceph-mon[178840]: failed to encode map e67 with expected crc 2023-12-09T02:37:52.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:52 smithi161 ceph-mon[178840]: failed to encode map e67 with expected crc 2023-12-09T02:37:52.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:52 smithi161 ceph-mon[178840]: failed to encode map e67 with expected crc 2023-12-09T02:37:52.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:52 smithi161 ceph-mon[178840]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:52.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:52 smithi161 ceph-mon[178840]: osdmap e68: 6 total, 6 up, 6 in 2023-12-09T02:37:52.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:52 smithi161 ceph-mon[178840]: failed to encode map e68 with expected crc 2023-12-09T02:37:52.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.928+0000 7f04c3bc9700 1 -- 172.21.15.88:0/1044853661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f04bc105590 con 0x7f04bc0fde00 2023-12-09T02:37:52.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.928+0000 7f04b27fc700 1 -- 172.21.15.88:0/1044853661 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f04b8059650 con 0x7f04bc0fde00 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:37:52.931 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:37:52.932 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:37:52.933 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:37:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.930+0000 7f04c3bc9700 1 -- 172.21.15.88:0/1044853661 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f04a806cf80 msgr2=0x7f04a806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.930+0000 7f04c3bc9700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f04a806cf80 0x7f04a806f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00b3b0 tx=0x7f04ac009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.930+0000 7f04c3bc9700 1 -- 172.21.15.88:0/1044853661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04bc0fde00 msgr2=0x7f04bc10dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.930+0000 7f04c3bc9700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04bc0fde00 0x7f04bc10dac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f04b8002a50 tx=0x7f04b80046b0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.930+0000 7f04c3bc9700 1 -- 172.21.15.88:0/1044853661 shutdown_connections 2023-12-09T02:37:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.930+0000 7f04c3bc9700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f04a806cf80 0x7f04a806f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.930+0000 7f04c3bc9700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc10d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.930+0000 7f04c3bc9700 1 --2- 172.21.15.88:0/1044853661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04bc0fde00 0x7f04bc10dac0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.930+0000 7f04c3bc9700 1 -- 172.21.15.88:0/1044853661 >> 172.21.15.88:0/1044853661 conn(0x7f04bc0f82d0 msgr2=0x7f04bc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.930+0000 7f04c3bc9700 1 -- 172.21.15.88:0/1044853661 shutdown_connections 2023-12-09T02:37:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:52.930+0000 7f04c3bc9700 1 -- 172.21.15.88:0/1044853661 wait complete. 2023-12-09T02:37:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:37:52.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:52 smithi088 ceph-mon[193406]: failed to encode map e67 with expected crc 2023-12-09T02:37:52.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:52 smithi088 ceph-mon[193406]: failed to encode map e67 with expected crc 2023-12-09T02:37:52.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:52 smithi088 ceph-mon[193406]: failed to encode map e67 with expected crc 2023-12-09T02:37:52.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:52 smithi088 ceph-mon[193406]: failed to encode map e67 with expected crc 2023-12-09T02:37:52.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:52 smithi088 ceph-mon[193406]: failed to encode map e67 with expected crc 2023-12-09T02:37:52.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:52 smithi088 ceph-mon[193406]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:52.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:52 smithi088 ceph-mon[193406]: osdmap e68: 6 total, 6 up, 6 in 2023-12-09T02:37:52.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:52 smithi088 ceph-mon[193406]: failed to encode map e68 with expected crc 2023-12-09T02:37:53.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.031+0000 7f69d5d20700 1 -- 172.21.15.88:0/1842342760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d00fcd00 msgr2=0x7f69d00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:53.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.031+0000 7f69d5d20700 1 --2- 172.21.15.88:0/1842342760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d00fcd00 0x7f69d00fd150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f69c0004940 tx=0x7f69c0009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:53.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.031+0000 7f69d5d20700 1 -- 172.21.15.88:0/1842342760 shutdown_connections 2023-12-09T02:37:53.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.031+0000 7f69d5d20700 1 --2- 172.21.15.88:0/1842342760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d00fcd00 0x7f69d00fd150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.031+0000 7f69d5d20700 1 --2- 172.21.15.88:0/1842342760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d00fbaf0 0x7f69d00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.031+0000 7f69d5d20700 1 -- 172.21.15.88:0/1842342760 >> 172.21.15.88:0/1842342760 conn(0x7f69d00f7190 msgr2=0x7f69d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:53.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.031+0000 7f69d5d20700 1 -- 172.21.15.88:0/1842342760 shutdown_connections 2023-12-09T02:37:53.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.031+0000 7f69d5d20700 1 -- 172.21.15.88:0/1842342760 wait complete. 2023-12-09T02:37:53.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69d5d20700 1 Processor -- start 2023-12-09T02:37:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69d5d20700 1 -- start start 2023-12-09T02:37:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69d5d20700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d00fbaf0 0x7f69d0110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69d5d20700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d00fcd00 0x7f69d01127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69d5d20700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0066110 con 0x7f69d00fbaf0 2023-12-09T02:37:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69d5d20700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0066250 con 0x7f69d00fcd00 2023-12-09T02:37:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69cf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d00fbaf0 0x7f69d0110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69cf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d00fbaf0 0x7f69d0110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38828/0 (socket says 172.21.15.88:38828) 2023-12-09T02:37:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69cf7fe700 1 -- 172.21.15.88:0/3165926735 learned_addr learned my addr 172.21.15.88:0/3165926735 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69ceffd700 1 --2- 172.21.15.88:0/3165926735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d00fcd00 0x7f69d01127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69cf7fe700 1 -- 172.21.15.88:0/3165926735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d00fcd00 msgr2=0x7f69d01127e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69cf7fe700 1 --2- 172.21.15.88:0/3165926735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d00fcd00 0x7f69d01127e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.032+0000 7f69cf7fe700 1 -- 172.21.15.88:0/3165926735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c0005040 con 0x7f69d00fbaf0 2023-12-09T02:37:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.033+0000 7f69cf7fe700 1 --2- 172.21.15.88:0/3165926735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d00fbaf0 0x7f69d0110290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69b800c8e0 tx=0x7f69b80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.033+0000 7f69c7fff700 1 -- 172.21.15.88:0/3165926735 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69b800a940 con 0x7f69d00fbaf0 2023-12-09T02:37:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.033+0000 7f69d5d20700 1 -- 172.21.15.88:0/3165926735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d0112de0 con 0x7f69d00fbaf0 2023-12-09T02:37:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.033+0000 7f69c7fff700 1 -- 172.21.15.88:0/3165926735 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69b800ce80 con 0x7f69d00fbaf0 2023-12-09T02:37:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.033+0000 7f69c7fff700 1 -- 172.21.15.88:0/3165926735 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69b80113a0 con 0x7f69d00fbaf0 2023-12-09T02:37:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.033+0000 7f69d5d20700 1 -- 172.21.15.88:0/3165926735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d0113240 con 0x7f69d00fbaf0 2023-12-09T02:37:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.034+0000 7f69d5d20700 1 -- 172.21.15.88:0/3165926735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d004bb80 con 0x7f69d00fbaf0 2023-12-09T02:37:53.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.034+0000 7f69c7fff700 1 -- 172.21.15.88:0/3165926735 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f69b8012400 con 0x7f69d00fbaf0 2023-12-09T02:37:53.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.034+0000 7f69c7fff700 1 --2- 172.21.15.88:0/3165926735 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f69bc06cf80 0x7f69bc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:53.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.035+0000 7f69c7fff700 1 -- 172.21.15.88:0/3165926735 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f69b808c700 con 0x7f69d00fbaf0 2023-12-09T02:37:53.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.035+0000 7f69ceffd700 1 --2- 172.21.15.88:0/3165926735 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f69bc06cf80 0x7f69bc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:53.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.035+0000 7f69ceffd700 1 --2- 172.21.15.88:0/3165926735 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f69bc06cf80 0x7f69bc06f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f69c0004f90 tx=0x7f69c0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:53.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.039+0000 7f69c7fff700 1 -- 172.21.15.88:0/3165926735 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f69b80563f0 con 0x7f69d00fbaf0 2023-12-09T02:37:53.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.245+0000 7f69d5d20700 1 -- 172.21.15.88:0/3165926735 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69d0113520 con 0x7f69bc06cf80 2023-12-09T02:37:53.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.247+0000 7f69c7fff700 1 -- 172.21.15.88:0/3165926735 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f69d0113520 con 0x7f69bc06cf80 2023-12-09T02:37:53.249 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:37:53.249 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:37:53.249 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:37:53.249 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:37:53.249 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2023-12-09T02:37:53.249 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2023-12-09T02:37:53.249 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2023-12-09T02:37:53.250 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2023-12-09T02:37:53.250 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-12-09T02:37:53.250 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "7/21 daemons upgraded", 2023-12-09T02:37:53.250 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2023-12-09T02:37:53.250 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:37:53.250 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:37:53.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.249+0000 7f69d5d20700 1 -- 172.21.15.88:0/3165926735 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f69bc06cf80 msgr2=0x7f69bc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:53.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.249+0000 7f69d5d20700 1 --2- 172.21.15.88:0/3165926735 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f69bc06cf80 0x7f69bc06f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f69c0004f90 tx=0x7f69c0009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:53.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.249+0000 7f69d5d20700 1 -- 172.21.15.88:0/3165926735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d00fbaf0 msgr2=0x7f69d0110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:53.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.249+0000 7f69d5d20700 1 --2- 172.21.15.88:0/3165926735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d00fbaf0 0x7f69d0110290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69b800c8e0 tx=0x7f69b80044c0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.249+0000 7f69d5d20700 1 -- 172.21.15.88:0/3165926735 shutdown_connections 2023-12-09T02:37:53.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.249+0000 7f69d5d20700 1 --2- 172.21.15.88:0/3165926735 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f69bc06cf80 0x7f69bc06f430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.249+0000 7f69d5d20700 1 --2- 172.21.15.88:0/3165926735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d00fbaf0 0x7f69d0110290 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.249+0000 7f69d5d20700 1 --2- 172.21.15.88:0/3165926735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d00fcd00 0x7f69d01127e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.249+0000 7f69d5d20700 1 -- 172.21.15.88:0/3165926735 >> 172.21.15.88:0/3165926735 conn(0x7f69d00f7190 msgr2=0x7f69d00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:53.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.249+0000 7f69d5d20700 1 -- 172.21.15.88:0/3165926735 shutdown_connections 2023-12-09T02:37:53.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.249+0000 7f69d5d20700 1 -- 172.21.15.88:0/3165926735 wait complete. 2023-12-09T02:37:53.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.349+0000 7f8e3b190700 1 -- 172.21.15.88:0/885746687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e340fcb80 msgr2=0x7f8e340fcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:53.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.349+0000 7f8e3b190700 1 --2- 172.21.15.88:0/885746687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e340fcb80 0x7f8e340fcf90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8e28004940 tx=0x7f8e28009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:53.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.349+0000 7f8e3b190700 1 -- 172.21.15.88:0/885746687 shutdown_connections 2023-12-09T02:37:53.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.349+0000 7f8e3b190700 1 --2- 172.21.15.88:0/885746687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e340fdd90 0x7f8e340fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.349+0000 7f8e3b190700 1 --2- 172.21.15.88:0/885746687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e340fcb80 0x7f8e340fcf90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.349+0000 7f8e3b190700 1 -- 172.21.15.88:0/885746687 >> 172.21.15.88:0/885746687 conn(0x7f8e340f8240 msgr2=0x7f8e340fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:53.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.349+0000 7f8e3b190700 1 -- 172.21.15.88:0/885746687 shutdown_connections 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.349+0000 7f8e3b190700 1 -- 172.21.15.88:0/885746687 wait complete. 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.349+0000 7f8e3b190700 1 Processor -- start 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e3b190700 1 -- start start 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e3b190700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e340fcb80 0x7f8e3410d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e3b190700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e340fdd90 0x7f8e3410d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e3b190700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3410dfa0 con 0x7f8e340fdd90 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e3b190700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3410e840 con 0x7f8e340fcb80 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e33fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e340fdd90 0x7f8e3410d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e33fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e340fdd90 0x7f8e3410d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38842/0 (socket says 172.21.15.88:38842) 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e33fff700 1 -- 172.21.15.88:0/2797328540 learned_addr learned my addr 172.21.15.88:0/2797328540 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e38f2c700 1 --2- 172.21.15.88:0/2797328540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e340fcb80 0x7f8e3410d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e33fff700 1 -- 172.21.15.88:0/2797328540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e340fcb80 msgr2=0x7f8e3410d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e33fff700 1 --2- 172.21.15.88:0/2797328540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e340fcb80 0x7f8e3410d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e33fff700 1 -- 172.21.15.88:0/2797328540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e28005040 con 0x7f8e340fdd90 2023-12-09T02:37:53.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.350+0000 7f8e33fff700 1 --2- 172.21.15.88:0/2797328540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e340fdd90 0x7f8e3410d9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e20002a50 tx=0x7f8e200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:53.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.351+0000 7f8e317fa700 1 -- 172.21.15.88:0/2797328540 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e20007cc0 con 0x7f8e340fdd90 2023-12-09T02:37:53.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.351+0000 7f8e3b190700 1 -- 172.21.15.88:0/2797328540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3410eb20 con 0x7f8e340fdd90 2023-12-09T02:37:53.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.351+0000 7f8e317fa700 1 -- 172.21.15.88:0/2797328540 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e2000f040 con 0x7f8e340fdd90 2023-12-09T02:37:53.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.351+0000 7f8e317fa700 1 -- 172.21.15.88:0/2797328540 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e20009540 con 0x7f8e340fdd90 2023-12-09T02:37:53.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.351+0000 7f8e3b190700 1 -- 172.21.15.88:0/2797328540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3410f060 con 0x7f8e340fdd90 2023-12-09T02:37:53.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.352+0000 7f8e3b190700 1 -- 172.21.15.88:0/2797328540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3404bb80 con 0x7f8e340fdd90 2023-12-09T02:37:53.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.352+0000 7f8e317fa700 1 -- 172.21.15.88:0/2797328540 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f8e200096a0 con 0x7f8e340fdd90 2023-12-09T02:37:53.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.353+0000 7f8e317fa700 1 --2- 172.21.15.88:0/2797328540 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8e2406cf80 0x7f8e2406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:37:53.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.353+0000 7f8e317fa700 1 -- 172.21.15.88:0/2797328540 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f8e2008c4d0 con 0x7f8e340fdd90 2023-12-09T02:37:53.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.353+0000 7f8e38f2c700 1 --2- 172.21.15.88:0/2797328540 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8e2406cf80 0x7f8e2406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:37:53.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.353+0000 7f8e38f2c700 1 --2- 172.21.15.88:0/2797328540 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8e2406cf80 0x7f8e2406f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800b3b0 tx=0x7f8e28009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:37:53.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.357+0000 7f8e317fa700 1 -- 172.21.15.88:0/2797328540 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8e20059ac0 con 0x7f8e340fdd90 2023-12-09T02:37:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.624+0000 7f8e3b190700 1 -- 172.21.15.88:0/2797328540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8e34105520 con 0x7f8e340fdd90 2023-12-09T02:37:53.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.624+0000 7f8e317fa700 1 -- 172.21.15.88:0/2797328540 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8e20059650 con 0x7f8e340fdd90 2023-12-09T02:37:53.627 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:37:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.626+0000 7f8e3b190700 1 -- 172.21.15.88:0/2797328540 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8e2406cf80 msgr2=0x7f8e2406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.626+0000 7f8e3b190700 1 --2- 172.21.15.88:0/2797328540 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8e2406cf80 0x7f8e2406f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800b3b0 tx=0x7f8e28009e30 comp rx=0 tx=0).stop 2023-12-09T02:37:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.626+0000 7f8e3b190700 1 -- 172.21.15.88:0/2797328540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e340fdd90 msgr2=0x7f8e3410d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:37:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.626+0000 7f8e3b190700 1 --2- 172.21.15.88:0/2797328540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e340fdd90 0x7f8e3410d9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e20002a50 tx=0x7f8e200046b0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.626+0000 7f8e3b190700 1 -- 172.21.15.88:0/2797328540 shutdown_connections 2023-12-09T02:37:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.626+0000 7f8e3b190700 1 --2- 172.21.15.88:0/2797328540 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8e2406cf80 0x7f8e2406f430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.626+0000 7f8e3b190700 1 --2- 172.21.15.88:0/2797328540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e340fcb80 0x7f8e3410d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.626+0000 7f8e3b190700 1 --2- 172.21.15.88:0/2797328540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e340fdd90 0x7f8e3410d9a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:37:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.626+0000 7f8e3b190700 1 -- 172.21.15.88:0/2797328540 >> 172.21.15.88:0/2797328540 conn(0x7f8e340f8240 msgr2=0x7f8e34100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:37:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.626+0000 7f8e3b190700 1 -- 172.21.15.88:0/2797328540 shutdown_connections 2023-12-09T02:37:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:37:53.626+0000 7f8e3b190700 1 -- 172.21.15.88:0/2797328540 wait complete. 2023-12-09T02:37:53.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:53 smithi161 ceph-mon[178840]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:53.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:53 smithi161 ceph-mon[178840]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:53.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:53 smithi161 ceph-mon[178840]: pgmap v58: 65 pgs: 1 remapped+peering, 64 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s, 360 objects/s recovering 2023-12-09T02:37:53.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:53 smithi161 ceph-mon[178840]: failed to encode map e68 with expected crc 2023-12-09T02:37:53.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:53 smithi161 ceph-mon[178840]: failed to encode map e68 with expected crc 2023-12-09T02:37:53.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:53 smithi161 ceph-mon[178840]: failed to encode map e68 with expected crc 2023-12-09T02:37:53.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:53 smithi161 ceph-mon[178840]: failed to encode map e68 with expected crc 2023-12-09T02:37:53.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:53 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/179029229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:53.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:53 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1044853661' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:37:53.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:53 smithi088 ceph-mon[193406]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:53.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:53 smithi088 ceph-mon[193406]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:53.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:53 smithi088 ceph-mon[193406]: pgmap v58: 65 pgs: 1 remapped+peering, 64 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s, 360 objects/s recovering 2023-12-09T02:37:53.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:53 smithi088 ceph-mon[193406]: failed to encode map e68 with expected crc 2023-12-09T02:37:53.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:53 smithi088 ceph-mon[193406]: failed to encode map e68 with expected crc 2023-12-09T02:37:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:53 smithi088 ceph-mon[193406]: failed to encode map e68 with expected crc 2023-12-09T02:37:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:53 smithi088 ceph-mon[193406]: failed to encode map e68 with expected crc 2023-12-09T02:37:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:53 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/179029229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:37:53.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:53 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1044853661' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:37:54.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:54 smithi161 ceph-mon[178840]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:54.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:54 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/2797328540' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:37:54.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:54 smithi088 ceph-mon[193406]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:37:54.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:54 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/2797328540' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:37:55.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:55 smithi161 ceph-mon[178840]: pgmap v60: 65 pgs: 1 remapped+peering, 64 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s, 296 objects/s recovering 2023-12-09T02:37:55.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:55 smithi088 ceph-mon[193406]: pgmap v60: 65 pgs: 1 remapped+peering, 64 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s, 296 objects/s recovering 2023-12-09T02:37:57.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:57 smithi161 ceph-mon[178840]: pgmap v61: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s, 240 objects/s recovering 2023-12-09T02:37:57.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:57 smithi088 ceph-mon[193406]: pgmap v61: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s, 240 objects/s recovering 2023-12-09T02:37:59.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:37:59 smithi161 ceph-mon[178840]: pgmap v62: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s, 183 objects/s recovering 2023-12-09T02:37:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:37:59 smithi088 ceph-mon[193406]: pgmap v62: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s, 183 objects/s recovering 2023-12-09T02:38:00.682 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:00 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-09T02:38:00.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:00 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-09T02:38:01.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:01 smithi088 ceph-mon[193406]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-09T02:38:01.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:01 smithi088 ceph-mon[193406]: Upgrade: osd.1 is safe to restart 2023-12-09T02:38:01.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:01 smithi088 ceph-mon[193406]: pgmap v63: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 925 KiB/s, 162 objects/s recovering 2023-12-09T02:38:01.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:01.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-09T02:38:01.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:38:01.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:01.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:01 smithi161 ceph-mon[178840]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-09T02:38:01.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:01 smithi161 ceph-mon[178840]: Upgrade: osd.1 is safe to restart 2023-12-09T02:38:01.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:01 smithi161 ceph-mon[178840]: pgmap v63: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 925 KiB/s, 162 objects/s recovering 2023-12-09T02:38:01.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:01.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-09T02:38:01.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:38:01.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:02.838 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:02 smithi088 ceph-mon[193406]: Upgrade: Updating osd.1 2023-12-09T02:38:02.838 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:02 smithi088 ceph-mon[193406]: Deploying daemon osd.1 on smithi088 2023-12-09T02:38:02.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:02 smithi161 ceph-mon[178840]: Upgrade: Updating osd.1 2023-12-09T02:38:02.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:02 smithi161 ceph-mon[178840]: Deploying daemon osd.1 on smithi088 2023-12-09T02:38:03.477 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:03 smithi088 systemd[1]: Stopping Ceph osd.1 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:38:03.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:03 smithi161 ceph-mon[178840]: pgmap v64: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:38:03.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:03 smithi161 ceph-mon[178840]: osd.1 marked itself down and dead 2023-12-09T02:38:03.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:03 smithi088 ceph-mon[193406]: pgmap v64: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:38:03.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:03 smithi088 ceph-mon[193406]: osd.1 marked itself down and dead 2023-12-09T02:38:03.977 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:03 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[145573]: 2023-12-09T02:38:03.500+0000 7f9b6c66f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:38:03.977 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:03 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[145573]: 2023-12-09T02:38:03.500+0000 7f9b6c66f700 -1 osd.1 68 *** Got signal Terminated *** 2023-12-09T02:38:03.977 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:03 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[145573]: 2023-12-09T02:38:03.500+0000 7f9b6c66f700 -1 osd.1 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:38:04.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:04 smithi161 ceph-mon[178840]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:38:04.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:04 smithi161 ceph-mon[178840]: osdmap e69: 6 total, 5 up, 6 in 2023-12-09T02:38:04.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:04 smithi088 ceph-mon[193406]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:38:04.947 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:04 smithi088 ceph-mon[193406]: osdmap e69: 6 total, 5 up, 6 in 2023-12-09T02:38:05.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:05 smithi088 bash[209539]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1 2023-12-09T02:38:05.886 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:05 smithi088 ceph-mon[193406]: pgmap v65: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:38:05.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:05 smithi088 ceph-mon[193406]: failed to encode map e69 with expected crc 2023-12-09T02:38:05.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:05 smithi088 ceph-mon[193406]: osdmap e70: 6 total, 5 up, 6 in 2023-12-09T02:38:05.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:05 smithi161 ceph-mon[178840]: pgmap v65: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:38:05.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:05 smithi161 ceph-mon[178840]: failed to encode map e69 with expected crc 2023-12-09T02:38:05.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:05 smithi161 ceph-mon[178840]: osdmap e70: 6 total, 5 up, 6 in 2023-12-09T02:38:06.575 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:06 smithi088 systemd[1]: ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.1.service: Succeeded. 2023-12-09T02:38:06.576 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:06 smithi088 systemd[1]: Stopped Ceph osd.1 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:38:06.576 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:06 smithi088 systemd[1]: Starting Ceph osd.1 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:38:06.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:06 smithi161 ceph-mon[178840]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:06 smithi161 ceph-mon[178840]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:06 smithi161 ceph-mon[178840]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:06 smithi161 ceph-mon[178840]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:06 smithi161 ceph-mon[178840]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:06 smithi161 ceph-mon[178840]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:06.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:38:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:06 smithi088 ceph-mon[193406]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:06 smithi088 ceph-mon[193406]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:06 smithi088 ceph-mon[193406]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:06 smithi088 ceph-mon[193406]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:06 smithi088 ceph-mon[193406]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:06 smithi088 ceph-mon[193406]: failed to encode map e70 with expected crc 2023-12-09T02:38:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:06.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:38:07.476 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:07 smithi088 bash[209804]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-09T02:38:07.476 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:07 smithi088 bash[209804]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-09T02:38:07.476 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:07 smithi088 bash[209804]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-09T02:38:07.476 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:07 smithi088 bash[209804]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-09T02:38:07.476 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:07 smithi088 bash[209804]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-09T02:38:07.477 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:07 smithi088 bash[209804]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-09T02:38:07.477 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:07 smithi088 bash[209804]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-09T02:38:07.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:07 smithi088 ceph-mon[193406]: pgmap v68: 65 pgs: 5 peering, 8 stale+active+clean, 52 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:38:07.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:07 smithi088 ceph-mon[193406]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-09T02:38:07.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:07 smithi161 ceph-mon[178840]: pgmap v68: 65 pgs: 5 peering, 8 stale+active+clean, 52 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-09T02:38:07.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:07 smithi161 ceph-mon[178840]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-09T02:38:08.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:07 smithi088 ceph-osd[210098]: -- 172.21.15.88:0/288011050 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55659029d1e0 con 0x55659026cc00 2023-12-09T02:38:08.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:07 smithi088 bash[210060]: 8bb8d12931bbd8436b0c8cde41dba6c34219fdd58e8b4d0711d07b378bb4d486 2023-12-09T02:38:08.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:07 smithi088 systemd[1]: Started Ceph osd.1 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:38:08.661 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:08 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[210075]: 2023-12-09T02:38:08.383+0000 7f25ca0a5640 -1 Falling back to public interface 2023-12-09T02:38:08.661 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:08 smithi088 ceph-mon[193406]: mgrmap e38: smithi088.jwlofb(active, since 91s), standbys: smithi161.qmxtmg 2023-12-09T02:38:08.661 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:08 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:08.662 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:08 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:08.662 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:08 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:38:08.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:08 smithi161 ceph-mon[178840]: mgrmap e38: smithi088.jwlofb(active, since 91s), standbys: smithi161.qmxtmg 2023-12-09T02:38:08.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:08 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:08.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:08 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:08.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:08 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:38:09.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:09 smithi088 ceph-mon[193406]: pgmap v69: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 5 peering, 33 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 127 B/s wr, 0 op/s; 28/222 objects degraded (12.613%) 2023-12-09T02:38:09.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:09 smithi088 ceph-mon[193406]: Health check failed: Degraded data redundancy: 28/222 objects degraded (12.613%), 11 pgs degraded (PG_DEGRADED) 2023-12-09T02:38:09.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:09 smithi161 ceph-mon[178840]: pgmap v69: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 5 peering, 33 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 127 B/s wr, 0 op/s; 28/222 objects degraded (12.613%) 2023-12-09T02:38:09.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:09 smithi161 ceph-mon[178840]: Health check failed: Degraded data redundancy: 28/222 objects degraded (12.613%), 11 pgs degraded (PG_DEGRADED) 2023-12-09T02:38:10.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:10 smithi161 ceph-mon[178840]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-09T02:38:10.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:10 smithi088 ceph-mon[193406]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-09T02:38:11.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:11 smithi161 ceph-mon[178840]: pgmap v70: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 30/222 objects degraded (13.514%) 2023-12-09T02:38:11.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:11.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:11 smithi088 ceph-mon[193406]: pgmap v70: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 30/222 objects degraded (13.514%) 2023-12-09T02:38:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:13.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:12 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[210075]: 2023-12-09T02:38:12.928+0000 7f25ca0a5640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-09T02:38:13.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:13.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:13.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:13 smithi088 ceph-mon[193406]: pgmap v71: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 30/222 objects degraded (13.514%) 2023-12-09T02:38:13.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:13.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:13.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:13 smithi161 ceph-mon[178840]: pgmap v71: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 30/222 objects degraded (13.514%) 2023-12-09T02:38:13.726 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:13 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[210075]: 2023-12-09T02:38:13.403+0000 7f25ca0a5640 -1 osd.1 68 log_to_monitors true 2023-12-09T02:38:14.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:14 smithi088 ceph-mon[193406]: from='osd.1 [v2:172.21.15.88:6810/3596877492,v1:172.21.15.88:6811/3596877492]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-09T02:38:14.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:38:14 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[210075]: 2023-12-09T02:38:14.142+0000 7f25b9d13700 -1 osd.1 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:38:14.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:14 smithi161 ceph-mon[178840]: from='osd.1 [v2:172.21.15.88:6810/3596877492,v1:172.21.15.88:6811/3596877492]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-09T02:38:15.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:15 smithi161 ceph-mon[178840]: from='osd.1 [v2:172.21.15.88:6810/3596877492,v1:172.21.15.88:6811/3596877492]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-09T02:38:15.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:15 smithi161 ceph-mon[178840]: failed to encode map e71 with expected crc 2023-12-09T02:38:15.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:15 smithi161 ceph-mon[178840]: osdmap e71: 6 total, 5 up, 6 in 2023-12-09T02:38:15.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:15 smithi161 ceph-mon[178840]: from='osd.1 [v2:172.21.15.88:6810/3596877492,v1:172.21.15.88:6811/3596877492]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:38:15.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:15 smithi161 ceph-mon[178840]: pgmap v73: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 346 B/s wr, 0 op/s; 30/222 objects degraded (13.514%) 2023-12-09T02:38:15.421 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:15 smithi088 ceph-mon[193406]: from='osd.1 [v2:172.21.15.88:6810/3596877492,v1:172.21.15.88:6811/3596877492]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-09T02:38:15.421 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:15 smithi088 ceph-mon[193406]: failed to encode map e71 with expected crc 2023-12-09T02:38:15.421 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:15 smithi088 ceph-mon[193406]: osdmap e71: 6 total, 5 up, 6 in 2023-12-09T02:38:15.421 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:15 smithi088 ceph-mon[193406]: from='osd.1 [v2:172.21.15.88:6810/3596877492,v1:172.21.15.88:6811/3596877492]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:38:15.421 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:15 smithi088 ceph-mon[193406]: pgmap v73: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 346 B/s wr, 0 op/s; 30/222 objects degraded (13.514%) 2023-12-09T02:38:16.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:38:16.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: failed to encode map e72 with expected crc 2023-12-09T02:38:16.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: osd.1 [v2:172.21.15.88:6810/3596877492,v1:172.21.15.88:6811/3596877492] boot 2023-12-09T02:38:16.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: osdmap e72: 6 total, 6 up, 6 in 2023-12-09T02:38:16.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-09T02:38:16.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:16 smithi161 ceph-mon[178840]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-09T02:38:16.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:38:16.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: failed to encode map e72 with expected crc 2023-12-09T02:38:16.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: osd.1 [v2:172.21.15.88:6810/3596877492,v1:172.21.15.88:6811/3596877492] boot 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: osdmap e72: 6 total, 6 up, 6 in 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-09T02:38:16.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:16 smithi088 ceph-mon[193406]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-09T02:38:17.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: osdmap e73: 6 total, 6 up, 6 in 2023-12-09T02:38:17.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: pgmap v76: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2023-12-09T02:38:17.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:17 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:17.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: osdmap e73: 6 total, 6 up, 6 in 2023-12-09T02:38:17.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: failed to encode map e73 with expected crc 2023-12-09T02:38:17.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: pgmap v76: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2023-12-09T02:38:17.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:17 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:18.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:18 smithi088 ceph-mon[193406]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2023-12-09T02:38:18.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:18 smithi161 ceph-mon[178840]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2023-12-09T02:38:19.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:19 smithi088 ceph-mon[193406]: pgmap v77: 65 pgs: 6 active+undersized, 7 active+undersized+degraded, 52 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/222 objects degraded (7.207%) 2023-12-09T02:38:19.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:19 smithi161 ceph-mon[178840]: pgmap v77: 65 pgs: 6 active+undersized, 7 active+undersized+degraded, 52 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/222 objects degraded (7.207%) 2023-12-09T02:38:20.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:20 smithi161 ceph-mon[178840]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2023-12-09T02:38:20.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:20 smithi161 ceph-mon[178840]: Cluster is now healthy 2023-12-09T02:38:20.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:20 smithi088 ceph-mon[193406]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2023-12-09T02:38:20.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:20 smithi088 ceph-mon[193406]: Cluster is now healthy 2023-12-09T02:38:21.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:21 smithi161 ceph-mon[178840]: pgmap v78: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 45 B/s, 0 objects/s recovering 2023-12-09T02:38:21.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:21 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:21.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:21 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:38:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:21 smithi088 ceph-mon[193406]: pgmap v78: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 45 B/s, 0 objects/s recovering 2023-12-09T02:38:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:21 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:21 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:38:23.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.741+0000 7f82d6886700 1 -- 172.21.15.88:0/3492629034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82d00fcd00 msgr2=0x7f82d00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.741+0000 7f82d6886700 1 --2- 172.21.15.88:0/3492629034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82d00fcd00 0x7f82d00fd150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82c4004940 tx=0x7f82c4009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.741+0000 7f82d6886700 1 -- 172.21.15.88:0/3492629034 shutdown_connections 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.741+0000 7f82d6886700 1 --2- 172.21.15.88:0/3492629034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82d00fcd00 0x7f82d00fd150 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.741+0000 7f82d6886700 1 --2- 172.21.15.88:0/3492629034 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d00fbaf0 0x7f82d00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.741+0000 7f82d6886700 1 -- 172.21.15.88:0/3492629034 >> 172.21.15.88:0/3492629034 conn(0x7f82d00f7190 msgr2=0x7f82d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.741+0000 7f82d6886700 1 -- 172.21.15.88:0/3492629034 shutdown_connections 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.741+0000 7f82d6886700 1 -- 172.21.15.88:0/3492629034 wait complete. 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.742+0000 7f82d6886700 1 Processor -- start 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.742+0000 7f82d6886700 1 -- start start 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.742+0000 7f82d6886700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d00fbaf0 0x7f82d010c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.742+0000 7f82d6886700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82d00fcd00 0x7f82d010c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.742+0000 7f82d6886700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d010cfb0 con 0x7f82d00fcd00 2023-12-09T02:38:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.742+0000 7f82d6886700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d010d850 con 0x7f82d00fbaf0 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.742+0000 7f82cf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82d00fcd00 0x7f82d010c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.742+0000 7f82cf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82d00fcd00 0x7f82d010c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58878/0 (socket says 172.21.15.88:58878) 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.742+0000 7f82cf7fe700 1 -- 172.21.15.88:0/3194543734 learned_addr learned my addr 172.21.15.88:0/3194543734 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.743+0000 7f82cffff700 1 --2- 172.21.15.88:0/3194543734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d00fbaf0 0x7f82d010c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.743+0000 7f82cf7fe700 1 -- 172.21.15.88:0/3194543734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d00fbaf0 msgr2=0x7f82d010c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.743+0000 7f82cf7fe700 1 --2- 172.21.15.88:0/3194543734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d00fbaf0 0x7f82d010c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.743+0000 7f82cf7fe700 1 -- 172.21.15.88:0/3194543734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c4005040 con 0x7f82d00fcd00 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.743+0000 7f82cf7fe700 1 --2- 172.21.15.88:0/3194543734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82d00fcd00 0x7f82d010c9b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f82c400b3b0 tx=0x7f82c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.743+0000 7f82ccff9700 1 -- 172.21.15.88:0/3194543734 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82c400e040 con 0x7f82d00fcd00 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.743+0000 7f82ccff9700 1 -- 172.21.15.88:0/3194543734 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f82c400be60 con 0x7f82d00fcd00 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.743+0000 7f82d6886700 1 -- 172.21.15.88:0/3194543734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d010dad0 con 0x7f82d00fcd00 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.743+0000 7f82ccff9700 1 -- 172.21.15.88:0/3194543734 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82c4013780 con 0x7f82d00fcd00 2023-12-09T02:38:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.743+0000 7f82d6886700 1 -- 172.21.15.88:0/3194543734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d010dfb0 con 0x7f82d00fcd00 2023-12-09T02:38:23.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.744+0000 7f82d6886700 1 -- 172.21.15.88:0/3194543734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d004bb80 con 0x7f82d00fcd00 2023-12-09T02:38:23.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.745+0000 7f82ccff9700 1 -- 172.21.15.88:0/3194543734 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f82c401eb60 con 0x7f82d00fcd00 2023-12-09T02:38:23.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.745+0000 7f82ccff9700 1 --2- 172.21.15.88:0/3194543734 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f82b806ce60 0x7f82b806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:23.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.745+0000 7f82ccff9700 1 -- 172.21.15.88:0/3194543734 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f82c4090400 con 0x7f82d00fcd00 2023-12-09T02:38:23.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.745+0000 7f82cffff700 1 --2- 172.21.15.88:0/3194543734 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f82b806ce60 0x7f82b806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:23.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.746+0000 7f82cffff700 1 --2- 172.21.15.88:0/3194543734 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f82b806ce60 0x7f82b806f310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f82d00fcb60 tx=0x7f82c000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:23.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.750+0000 7f82ccff9700 1 -- 172.21.15.88:0/3194543734 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f82c405dc10 con 0x7f82d00fcd00 2023-12-09T02:38:23.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:23 smithi161 ceph-mon[178840]: pgmap v79: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 35 B/s, 0 objects/s recovering 2023-12-09T02:38:23.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.955+0000 7f82d6886700 1 -- 172.21.15.88:0/3194543734 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82d010e4b0 con 0x7f82b806ce60 2023-12-09T02:38:23.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.956+0000 7f82ccff9700 1 -- 172.21.15.88:0/3194543734 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f82d010e4b0 con 0x7f82b806ce60 2023-12-09T02:38:23.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.958+0000 7f82d6886700 1 -- 172.21.15.88:0/3194543734 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f82b806ce60 msgr2=0x7f82b806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:23.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.958+0000 7f82d6886700 1 --2- 172.21.15.88:0/3194543734 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f82b806ce60 0x7f82b806f310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f82d00fcb60 tx=0x7f82c000b040 comp rx=0 tx=0).stop 2023-12-09T02:38:23.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.958+0000 7f82d6886700 1 -- 172.21.15.88:0/3194543734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82d00fcd00 msgr2=0x7f82d010c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:23.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.958+0000 7f82d6886700 1 --2- 172.21.15.88:0/3194543734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82d00fcd00 0x7f82d010c9b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f82c400b3b0 tx=0x7f82c4009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:23.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.958+0000 7f82d6886700 1 -- 172.21.15.88:0/3194543734 shutdown_connections 2023-12-09T02:38:23.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.958+0000 7f82d6886700 1 --2- 172.21.15.88:0/3194543734 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f82b806ce60 0x7f82b806f310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:23.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.958+0000 7f82d6886700 1 --2- 172.21.15.88:0/3194543734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d00fbaf0 0x7f82d010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:23.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.958+0000 7f82d6886700 1 --2- 172.21.15.88:0/3194543734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82d00fcd00 0x7f82d010c9b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:23.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.958+0000 7f82d6886700 1 -- 172.21.15.88:0/3194543734 >> 172.21.15.88:0/3194543734 conn(0x7f82d00f7190 msgr2=0x7f82d00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:23.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.959+0000 7f82d6886700 1 -- 172.21.15.88:0/3194543734 shutdown_connections 2023-12-09T02:38:23.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:23.959+0000 7f82d6886700 1 -- 172.21.15.88:0/3194543734 wait complete. 2023-12-09T02:38:23.971 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:38:23.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:23 smithi088 ceph-mon[193406]: pgmap v79: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 35 B/s, 0 objects/s recovering 2023-12-09T02:38:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.059+0000 7fd73eb3f700 1 -- 172.21.15.88:0/3059975256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7380fbaf0 msgr2=0x7fd7380fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.059+0000 7fd73eb3f700 1 --2- 172.21.15.88:0/3059975256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7380fbaf0 0x7fd7380fbf00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd72c004940 tx=0x7fd72c009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.059+0000 7fd73eb3f700 1 -- 172.21.15.88:0/3059975256 shutdown_connections 2023-12-09T02:38:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.059+0000 7fd73eb3f700 1 --2- 172.21.15.88:0/3059975256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7380fcd00 0x7fd7380fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.059+0000 7fd73eb3f700 1 --2- 172.21.15.88:0/3059975256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7380fbaf0 0x7fd7380fbf00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.059+0000 7fd73eb3f700 1 -- 172.21.15.88:0/3059975256 >> 172.21.15.88:0/3059975256 conn(0x7fd7380f7190 msgr2=0x7fd7380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.059+0000 7fd73eb3f700 1 -- 172.21.15.88:0/3059975256 shutdown_connections 2023-12-09T02:38:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.059+0000 7fd73eb3f700 1 -- 172.21.15.88:0/3059975256 wait complete. 2023-12-09T02:38:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.060+0000 7fd73eb3f700 1 Processor -- start 2023-12-09T02:38:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.060+0000 7fd73eb3f700 1 -- start start 2023-12-09T02:38:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.060+0000 7fd73eb3f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7380fbaf0 0x7fd7381101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.060+0000 7fd73eb3f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7380fcd00 0x7fd738112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.060+0000 7fd73eb3f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd738066130 con 0x7fd7380fbaf0 2023-12-09T02:38:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.060+0000 7fd73eb3f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd738066270 con 0x7fd7380fcd00 2023-12-09T02:38:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.060+0000 7fd73c8db700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7380fbaf0 0x7fd7381101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.060+0000 7fd73c8db700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7380fbaf0 0x7fd7381101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58896/0 (socket says 172.21.15.88:58896) 2023-12-09T02:38:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.060+0000 7fd73c8db700 1 -- 172.21.15.88:0/1899727276 learned_addr learned my addr 172.21.15.88:0/1899727276 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.061+0000 7fd737fff700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7380fcd00 0x7fd738112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.061+0000 7fd73c8db700 1 -- 172.21.15.88:0/1899727276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7380fcd00 msgr2=0x7fd738112740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.061+0000 7fd73c8db700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7380fcd00 0x7fd738112740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.061+0000 7fd73c8db700 1 -- 172.21.15.88:0/1899727276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c005040 con 0x7fd7380fbaf0 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.061+0000 7fd737fff700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7380fcd00 0x7fd738112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.061+0000 7fd73c8db700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7380fbaf0 0x7fd7381101f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd72c000c00 tx=0x7fd72c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.061+0000 7fd7357fa700 1 -- 172.21.15.88:0/1899727276 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd72c021070 con 0x7fd7380fbaf0 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.061+0000 7fd73eb3f700 1 -- 172.21.15.88:0/1899727276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd738112d40 con 0x7fd7380fbaf0 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.061+0000 7fd7357fa700 1 -- 172.21.15.88:0/1899727276 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd72c01c400 con 0x7fd7380fbaf0 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.061+0000 7fd7357fa700 1 -- 172.21.15.88:0/1899727276 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd72c00e070 con 0x7fd7380fbaf0 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.061+0000 7fd73eb3f700 1 -- 172.21.15.88:0/1899727276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd738113180 con 0x7fd7380fbaf0 2023-12-09T02:38:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.062+0000 7fd73eb3f700 1 -- 172.21.15.88:0/1899727276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73804bb80 con 0x7fd7380fbaf0 2023-12-09T02:38:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.062+0000 7fd7357fa700 1 -- 172.21.15.88:0/1899727276 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fd72c01ca00 con 0x7fd7380fbaf0 2023-12-09T02:38:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.063+0000 7fd7357fa700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd72806ce60 0x7fd72806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.063+0000 7fd737fff700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd72806ce60 0x7fd72806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.063+0000 7fd7357fa700 1 -- 172.21.15.88:0/1899727276 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fd72c08d6d0 con 0x7fd7380fbaf0 2023-12-09T02:38:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.063+0000 7fd737fff700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd72806ce60 0x7fd72806f310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd724004600 tx=0x7fd72400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:24.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.068+0000 7fd7357fa700 1 -- 172.21.15.88:0/1899727276 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd72c0574d0 con 0x7fd7380fbaf0 2023-12-09T02:38:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.276+0000 7fd73eb3f700 1 -- 172.21.15.88:0/1899727276 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd738101650 con 0x7fd72806ce60 2023-12-09T02:38:24.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.277+0000 7fd7357fa700 1 -- 172.21.15.88:0/1899727276 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd738101650 con 0x7fd72806ce60 2023-12-09T02:38:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.279+0000 7fd73eb3f700 1 -- 172.21.15.88:0/1899727276 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd72806ce60 msgr2=0x7fd72806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.279+0000 7fd73eb3f700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd72806ce60 0x7fd72806f310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd724004600 tx=0x7fd72400b040 comp rx=0 tx=0).stop 2023-12-09T02:38:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.279+0000 7fd73eb3f700 1 -- 172.21.15.88:0/1899727276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7380fbaf0 msgr2=0x7fd7381101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.279+0000 7fd73eb3f700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7380fbaf0 0x7fd7381101f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd72c000c00 tx=0x7fd72c009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.279+0000 7fd73eb3f700 1 -- 172.21.15.88:0/1899727276 shutdown_connections 2023-12-09T02:38:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.279+0000 7fd73eb3f700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fd72806ce60 0x7fd72806f310 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.279+0000 7fd73eb3f700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7380fbaf0 0x7fd7381101f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.279+0000 7fd73eb3f700 1 --2- 172.21.15.88:0/1899727276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7380fcd00 0x7fd738112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.279+0000 7fd73eb3f700 1 -- 172.21.15.88:0/1899727276 >> 172.21.15.88:0/1899727276 conn(0x7fd7380f7190 msgr2=0x7fd7380fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.279+0000 7fd73eb3f700 1 -- 172.21.15.88:0/1899727276 shutdown_connections 2023-12-09T02:38:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.279+0000 7fd73eb3f700 1 -- 172.21.15.88:0/1899727276 wait complete. 2023-12-09T02:38:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.380+0000 7f6cf1e02700 1 -- 172.21.15.88:0/4126075631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cec0fbaf0 msgr2=0x7f6cec0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.380+0000 7f6cf1e02700 1 --2- 172.21.15.88:0/4126075631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cec0fbaf0 0x7f6cec0fbf00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc004940 tx=0x7f6cdc009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.380+0000 7f6cf1e02700 1 -- 172.21.15.88:0/4126075631 shutdown_connections 2023-12-09T02:38:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.380+0000 7f6cf1e02700 1 --2- 172.21.15.88:0/4126075631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cec0fcd00 0x7f6cec0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.380+0000 7f6cf1e02700 1 --2- 172.21.15.88:0/4126075631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cec0fbaf0 0x7f6cec0fbf00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.380+0000 7f6cf1e02700 1 -- 172.21.15.88:0/4126075631 >> 172.21.15.88:0/4126075631 conn(0x7f6cec0f71d0 msgr2=0x7f6cec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.380+0000 7f6cf1e02700 1 -- 172.21.15.88:0/4126075631 shutdown_connections 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.380+0000 7f6cf1e02700 1 -- 172.21.15.88:0/4126075631 wait complete. 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6cf1e02700 1 Processor -- start 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6cf1e02700 1 -- start start 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6cf1e02700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cec0fbaf0 0x7f6cec10c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6cf1e02700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cec0fcd00 0x7f6cec10c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6cf1e02700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec10cf10 con 0x7f6cec0fcd00 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6cf1e02700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec10d7b0 con 0x7f6cec0fbaf0 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6ceaffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cec0fcd00 0x7f6cec10c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6ceaffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cec0fcd00 0x7f6cec10c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58908/0 (socket says 172.21.15.88:58908) 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6ceaffd700 1 -- 172.21.15.88:0/1112369588 learned_addr learned my addr 172.21.15.88:0/1112369588 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6ceb7fe700 1 --2- 172.21.15.88:0/1112369588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cec0fbaf0 0x7f6cec10c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6ceaffd700 1 -- 172.21.15.88:0/1112369588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cec0fbaf0 msgr2=0x7f6cec10c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6ceaffd700 1 --2- 172.21.15.88:0/1112369588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cec0fbaf0 0x7f6cec10c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.381+0000 7f6ceaffd700 1 -- 172.21.15.88:0/1112369588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc005040 con 0x7f6cec0fcd00 2023-12-09T02:38:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.382+0000 7f6ceaffd700 1 --2- 172.21.15.88:0/1112369588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cec0fcd00 0x7f6cec10c910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000fd10 tx=0x7f6ce00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.382+0000 7f6cd3fff700 1 -- 172.21.15.88:0/1112369588 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce000dcf0 con 0x7f6cec0fcd00 2023-12-09T02:38:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.382+0000 7f6cd3fff700 1 -- 172.21.15.88:0/1112369588 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ce000de50 con 0x7f6cec0fcd00 2023-12-09T02:38:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.382+0000 7f6cf1e02700 1 -- 172.21.15.88:0/1112369588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec10da30 con 0x7f6cec0fcd00 2023-12-09T02:38:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.382+0000 7f6cd3fff700 1 -- 172.21.15.88:0/1112369588 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce00126a0 con 0x7f6cec0fcd00 2023-12-09T02:38:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.382+0000 7f6cf1e02700 1 -- 172.21.15.88:0/1112369588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cec10df70 con 0x7f6cec0fcd00 2023-12-09T02:38:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.383+0000 7f6cf1e02700 1 -- 172.21.15.88:0/1112369588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cec04bb80 con 0x7f6cec0fcd00 2023-12-09T02:38:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.383+0000 7f6cd3fff700 1 -- 172.21.15.88:0/1112369588 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f6ce0007ab0 con 0x7f6cec0fcd00 2023-12-09T02:38:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.383+0000 7f6cd3fff700 1 --2- 172.21.15.88:0/1112369588 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f6cd406ce70 0x7f6cd406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.384+0000 7f6cd3fff700 1 -- 172.21.15.88:0/1112369588 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f6ce008e940 con 0x7f6cec0fcd00 2023-12-09T02:38:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.384+0000 7f6ceb7fe700 1 --2- 172.21.15.88:0/1112369588 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f6cd406ce70 0x7f6cd406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.384+0000 7f6ceb7fe700 1 --2- 172.21.15.88:0/1112369588 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f6cd406ce70 0x7f6cd406f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00b7d0 tx=0x7f6cdc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.388+0000 7f6cd3fff700 1 -- 172.21.15.88:0/1112369588 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6ce005c150 con 0x7f6cec0fcd00 2023-12-09T02:38:24.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.591+0000 7f6cf1e02700 1 -- 172.21.15.88:0/1112369588 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cec10e400 con 0x7f6cd406ce70 2023-12-09T02:38:24.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.601+0000 7f6cd3fff700 1 -- 172.21.15.88:0/1112369588 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6cec10e400 con 0x7f6cd406ce70 2023-12-09T02:38:24.603 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:38:24.603 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (2m) 13s ago 9m 28.5M - 0.25.0 c8568f914cd2 9dc2b8db0963 2023-12-09T02:38:24.603 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (64s) 13s ago 9m 7470k - 19.0.0-44-g9dcc13bb f28f2b94f153 bf03eec19a86 2023-12-09T02:38:24.603 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (60s) 58s ago 8m 7444k - 19.0.0-44-g9dcc13bb f28f2b94f153 890646e8cd90 2023-12-09T02:38:24.603 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (2m) 13s ago 9m 86.4M - 9.4.7 954c08fa6188 ab4c3f64ce4d 2023-12-09T02:38:24.603 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (5m) 13s ago 5m 14.7M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (5m) 13s ago 5m 16.0M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (5m) 58s ago 5m 10.1G - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (5m) 58s ago 5m 15.6M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:8443,9283,8765 running (2m) 13s ago 10m 509M - 19.0.0-44-g9dcc13bb f28f2b94f153 a939ff288750 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283,8765 running (2m) 58s ago 8m 448M - 19.0.0-44-g9dcc13bb f28f2b94f153 e2ee2a6eb30b 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (116s) 13s ago 10m 64.5M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 8e4b2ba7b37c 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (95s) 58s ago 8m 42.0M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 4769966a784f 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (2m) 13s ago 9m 17.9M - 1.5.0 0da6a335fe13 e2b7cc0b7527 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (2m) 58s ago 8m 17.4M - 1.5.0 0da6a335fe13 0de833ab198e 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (46s) 13s ago 8m 181M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 88f0691c638a 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (16s) 13s ago 7m 12.1M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 8bb8d12931bb 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (7m) 13s ago 7m 938M 1568M 17.2.7-119-ge2143d99 f761b6e42225 0b0abbb070ec 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (7m) 58s ago 7m 1124M 2592M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (6m) 58s ago 6m 831M 2592M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:38:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (6m) 58s ago 6m 945M 2592M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:38:24.605 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (2m) 13s ago 9m 51.1M - 2.43.0 a07b618ecd1d ddb1fb2e1888 2023-12-09T02:38:24.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.603+0000 7f6cf1e02700 1 -- 172.21.15.88:0/1112369588 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f6cd406ce70 msgr2=0x7f6cd406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.603+0000 7f6cf1e02700 1 --2- 172.21.15.88:0/1112369588 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f6cd406ce70 0x7f6cd406f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00b7d0 tx=0x7f6cdc009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:24.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.603+0000 7f6cf1e02700 1 -- 172.21.15.88:0/1112369588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cec0fcd00 msgr2=0x7f6cec10c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.603+0000 7f6cf1e02700 1 --2- 172.21.15.88:0/1112369588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cec0fcd00 0x7f6cec10c910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000fd10 tx=0x7f6ce00046b0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.603+0000 7f6cf1e02700 1 -- 172.21.15.88:0/1112369588 shutdown_connections 2023-12-09T02:38:24.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.603+0000 7f6cf1e02700 1 --2- 172.21.15.88:0/1112369588 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f6cd406ce70 0x7f6cd406f320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.603+0000 7f6cf1e02700 1 --2- 172.21.15.88:0/1112369588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cec0fbaf0 0x7f6cec10c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.603+0000 7f6cf1e02700 1 --2- 172.21.15.88:0/1112369588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cec0fcd00 0x7f6cec10c910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.603+0000 7f6cf1e02700 1 -- 172.21.15.88:0/1112369588 >> 172.21.15.88:0/1112369588 conn(0x7f6cec0f71d0 msgr2=0x7f6cec0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.603+0000 7f6cf1e02700 1 -- 172.21.15.88:0/1112369588 shutdown_connections 2023-12-09T02:38:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.603+0000 7f6cf1e02700 1 -- 172.21.15.88:0/1112369588 wait complete. 2023-12-09T02:38:24.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.701+0000 7f05968ee700 1 -- 172.21.15.88:0/2131116899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05900fbaf0 msgr2=0x7f05900fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.701+0000 7f05968ee700 1 --2- 172.21.15.88:0/2131116899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05900fbaf0 0x7f05900fbf00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0580004940 tx=0x7f0580009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:24.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.701+0000 7f05968ee700 1 -- 172.21.15.88:0/2131116899 shutdown_connections 2023-12-09T02:38:24.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.701+0000 7f05968ee700 1 --2- 172.21.15.88:0/2131116899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05900fcd00 0x7f05900fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.701+0000 7f05968ee700 1 --2- 172.21.15.88:0/2131116899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05900fbaf0 0x7f05900fbf00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.701+0000 7f05968ee700 1 -- 172.21.15.88:0/2131116899 >> 172.21.15.88:0/2131116899 conn(0x7f05900f7190 msgr2=0x7f05900f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:24.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.701+0000 7f05968ee700 1 -- 172.21.15.88:0/2131116899 shutdown_connections 2023-12-09T02:38:24.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.701+0000 7f05968ee700 1 -- 172.21.15.88:0/2131116899 wait complete. 2023-12-09T02:38:24.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f05968ee700 1 Processor -- start 2023-12-09T02:38:24.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f05968ee700 1 -- start start 2023-12-09T02:38:24.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f05968ee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05900fbaf0 0x7f05900ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:24.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f05968ee700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05900fcd00 0x7f05900fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:24.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f05968ee700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05900fe640 con 0x7f05900fbaf0 2023-12-09T02:38:24.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f05968ee700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05900fe7b0 con 0x7f05900fcd00 2023-12-09T02:38:24.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f058ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05900fbaf0 0x7f05900ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:24.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f058ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05900fbaf0 0x7f05900ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58926/0 (socket says 172.21.15.88:58926) 2023-12-09T02:38:24.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f058ffff700 1 -- 172.21.15.88:0/3897549319 learned_addr learned my addr 172.21.15.88:0/3897549319 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:24.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f058f7fe700 1 --2- 172.21.15.88:0/3897549319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05900fcd00 0x7f05900fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:24.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f058ffff700 1 -- 172.21.15.88:0/3897549319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05900fcd00 msgr2=0x7f05900fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f058ffff700 1 --2- 172.21.15.88:0/3897549319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05900fcd00 0x7f05900fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f058ffff700 1 -- 172.21.15.88:0/3897549319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580005040 con 0x7f05900fbaf0 2023-12-09T02:38:24.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.702+0000 7f058ffff700 1 --2- 172.21.15.88:0/3897549319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05900fbaf0 0x7f05900ffbc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0580004f90 tx=0x7f0580009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:24.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.703+0000 7f058cff9700 1 -- 172.21.15.88:0/3897549319 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f058000e040 con 0x7f05900fbaf0 2023-12-09T02:38:24.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.703+0000 7f058cff9700 1 -- 172.21.15.88:0/3897549319 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f058000bcd0 con 0x7f05900fbaf0 2023-12-09T02:38:24.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.703+0000 7f05968ee700 1 -- 172.21.15.88:0/3897549319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05900fea30 con 0x7f05900fbaf0 2023-12-09T02:38:24.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.703+0000 7f058cff9700 1 -- 172.21.15.88:0/3897549319 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f058001c630 con 0x7f05900fbaf0 2023-12-09T02:38:24.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.703+0000 7f05968ee700 1 -- 172.21.15.88:0/3897549319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05901155b0 con 0x7f05900fbaf0 2023-12-09T02:38:24.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.704+0000 7f05968ee700 1 -- 172.21.15.88:0/3897549319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059004bb80 con 0x7f05900fbaf0 2023-12-09T02:38:24.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.704+0000 7f058cff9700 1 -- 172.21.15.88:0/3897549319 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0580013960 con 0x7f05900fbaf0 2023-12-09T02:38:24.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.704+0000 7f058cff9700 1 --2- 172.21.15.88:0/3897549319 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f057806ce60 0x7f057806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:24.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.705+0000 7f058cff9700 1 -- 172.21.15.88:0/3897549319 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f058008d910 con 0x7f05900fbaf0 2023-12-09T02:38:24.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.705+0000 7f058f7fe700 1 --2- 172.21.15.88:0/3897549319 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f057806ce60 0x7f057806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:24.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.705+0000 7f058f7fe700 1 --2- 172.21.15.88:0/3897549319 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f057806ce60 0x7f057806f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0584004990 tx=0x7f0584009ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:24.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.709+0000 7f058cff9700 1 -- 172.21.15.88:0/3897549319 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f058005b1a0 con 0x7f05900fbaf0 2023-12-09T02:38:24.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.979+0000 7f05968ee700 1 -- 172.21.15.88:0/3897549319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0590115920 con 0x7f05900fbaf0 2023-12-09T02:38:24.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.980+0000 7f058cff9700 1 -- 172.21.15.88:0/3897549319 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f058005ad30 con 0x7f05900fbaf0 2023-12-09T02:38:24.982 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:38:24.982 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:38:24.982 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:38:24.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:38:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:38:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:38:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:38:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:38:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4, 2023-12-09T02:38:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:38:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:38:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:38:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:38:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:38:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:38:24.984 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 8, 2023-12-09T02:38:24.984 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 6 2023-12-09T02:38:24.984 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:38:24.984 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:38:24.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.982+0000 7f05968ee700 1 -- 172.21.15.88:0/3897549319 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f057806ce60 msgr2=0x7f057806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.982+0000 7f05968ee700 1 --2- 172.21.15.88:0/3897549319 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f057806ce60 0x7f057806f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0584004990 tx=0x7f0584009ee0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.982+0000 7f05968ee700 1 -- 172.21.15.88:0/3897549319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05900fbaf0 msgr2=0x7f05900ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:24.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.982+0000 7f05968ee700 1 --2- 172.21.15.88:0/3897549319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05900fbaf0 0x7f05900ffbc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0580004f90 tx=0x7f0580009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:24.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.982+0000 7f05968ee700 1 -- 172.21.15.88:0/3897549319 shutdown_connections 2023-12-09T02:38:24.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.982+0000 7f05968ee700 1 --2- 172.21.15.88:0/3897549319 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f057806ce60 0x7f057806f310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.982+0000 7f05968ee700 1 --2- 172.21.15.88:0/3897549319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05900fbaf0 0x7f05900ffbc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.982+0000 7f05968ee700 1 --2- 172.21.15.88:0/3897549319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05900fcd00 0x7f05900fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:24.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.982+0000 7f05968ee700 1 -- 172.21.15.88:0/3897549319 >> 172.21.15.88:0/3897549319 conn(0x7f05900f7190 msgr2=0x7f0590065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:24.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.982+0000 7f05968ee700 1 -- 172.21.15.88:0/3897549319 shutdown_connections 2023-12-09T02:38:24.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:24.982+0000 7f05968ee700 1 -- 172.21.15.88:0/3897549319 wait complete. 2023-12-09T02:38:25.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.083+0000 7f03e934d700 1 -- 172.21.15.88:0/964650935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03e40faed0 msgr2=0x7f03e40fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:25.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.083+0000 7f03e934d700 1 --2- 172.21.15.88:0/964650935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03e40faed0 0x7f03e40fb2e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f03d4004940 tx=0x7f03d4009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:25.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.083+0000 7f03e934d700 1 -- 172.21.15.88:0/964650935 shutdown_connections 2023-12-09T02:38:25.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.083+0000 7f03e934d700 1 --2- 172.21.15.88:0/964650935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03e40fdf60 0x7f03e40fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.083+0000 7f03e934d700 1 --2- 172.21.15.88:0/964650935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03e40faed0 0x7f03e40fb2e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.083+0000 7f03e934d700 1 -- 172.21.15.88:0/964650935 >> 172.21.15.88:0/964650935 conn(0x7f03e40f6950 msgr2=0x7f03e40f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:25.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.083+0000 7f03e934d700 1 -- 172.21.15.88:0/964650935 shutdown_connections 2023-12-09T02:38:25.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.083+0000 7f03e934d700 1 -- 172.21.15.88:0/964650935 wait complete. 2023-12-09T02:38:25.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.084+0000 7f03e934d700 1 Processor -- start 2023-12-09T02:38:25.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.084+0000 7f03e934d700 1 -- start start 2023-12-09T02:38:25.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.084+0000 7f03e934d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03e40faed0 0x7f03e410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:25.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.084+0000 7f03e934d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03e40fdf60 0x7f03e410db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:25.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.084+0000 7f03e934d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e410e110 con 0x7f03e40faed0 2023-12-09T02:38:25.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.084+0000 7f03e934d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e410e9b0 con 0x7f03e40fdf60 2023-12-09T02:38:25.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03e2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03e40faed0 0x7f03e410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:25.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03e2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03e40faed0 0x7f03e410d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58936/0 (socket says 172.21.15.88:58936) 2023-12-09T02:38:25.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03e2ffd700 1 -- 172.21.15.88:0/4201871646 learned_addr learned my addr 172.21.15.88:0/4201871646 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:25.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03e27fc700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03e40fdf60 0x7f03e410db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:25.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03e2ffd700 1 -- 172.21.15.88:0/4201871646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03e40fdf60 msgr2=0x7f03e410db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:25.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03e2ffd700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03e40fdf60 0x7f03e410db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03e2ffd700 1 -- 172.21.15.88:0/4201871646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d4005040 con 0x7f03e40faed0 2023-12-09T02:38:25.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03e27fc700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03e40fdf60 0x7f03e410db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:38:25.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03e2ffd700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03e40faed0 0x7f03e410d5d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009180 tx=0x7f03d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:25.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03cb7fe700 1 -- 172.21.15.88:0/4201871646 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d400e040 con 0x7f03e40faed0 2023-12-09T02:38:25.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03e934d700 1 -- 172.21.15.88:0/4201871646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e410ec30 con 0x7f03e40faed0 2023-12-09T02:38:25.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03cb7fe700 1 -- 172.21.15.88:0/4201871646 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f03d4004290 con 0x7f03e40faed0 2023-12-09T02:38:25.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03cb7fe700 1 -- 172.21.15.88:0/4201871646 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d401c630 con 0x7f03e40faed0 2023-12-09T02:38:25.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.085+0000 7f03e934d700 1 -- 172.21.15.88:0/4201871646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e410f170 con 0x7f03e40faed0 2023-12-09T02:38:25.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.086+0000 7f03e934d700 1 -- 172.21.15.88:0/4201871646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e41075f0 con 0x7f03e40faed0 2023-12-09T02:38:25.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.087+0000 7f03cb7fe700 1 -- 172.21.15.88:0/4201871646 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f03d4013420 con 0x7f03e40faed0 2023-12-09T02:38:25.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.087+0000 7f03cb7fe700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f03cc06ce70 0x7f03cc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:25.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.087+0000 7f03cb7fe700 1 -- 172.21.15.88:0/4201871646 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f03d408d820 con 0x7f03e40faed0 2023-12-09T02:38:25.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.087+0000 7f03e27fc700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f03cc06ce70 0x7f03cc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:25.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.087+0000 7f03e27fc700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f03cc06ce70 0x7f03cc06f320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f03d80041d0 tx=0x7f03d8009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:25.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.091+0000 7f03cb7fe700 1 -- 172.21.15.88:0/4201871646 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f03d405b0b0 con 0x7f03e40faed0 2023-12-09T02:38:25.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.322+0000 7f03e934d700 1 -- 172.21.15.88:0/4201871646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f03e4107010 con 0x7f03e40faed0 2023-12-09T02:38:25.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.322+0000 7f03cb7fe700 1 -- 172.21.15.88:0/4201871646 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f03d4061070 con 0x7f03e40faed0 2023-12-09T02:38:25.324 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:38:25.324 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:38:25.324 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:38:25.325 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:38:25.326 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2023-12-09T02:38:25.327 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:38:25.327 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:38:25.327 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:38:25.327 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:38:25.327 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:38:25.327 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:38:25.327 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:38:25.327 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:38:25.327 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:38:25.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.324+0000 7f03e934d700 1 -- 172.21.15.88:0/4201871646 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f03cc06ce70 msgr2=0x7f03cc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:25.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.324+0000 7f03e934d700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f03cc06ce70 0x7f03cc06f320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f03d80041d0 tx=0x7f03d8009040 comp rx=0 tx=0).stop 2023-12-09T02:38:25.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.324+0000 7f03e934d700 1 -- 172.21.15.88:0/4201871646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03e40faed0 msgr2=0x7f03e410d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:25.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.324+0000 7f03e934d700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03e40faed0 0x7f03e410d5d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009180 tx=0x7f03d4009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:25.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.324+0000 7f03e934d700 1 -- 172.21.15.88:0/4201871646 shutdown_connections 2023-12-09T02:38:25.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.324+0000 7f03e934d700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f03cc06ce70 0x7f03cc06f320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.324+0000 7f03e934d700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03e40faed0 0x7f03e410d5d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.324+0000 7f03e934d700 1 --2- 172.21.15.88:0/4201871646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03e40fdf60 0x7f03e410db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.324+0000 7f03e934d700 1 -- 172.21.15.88:0/4201871646 >> 172.21.15.88:0/4201871646 conn(0x7f03e40f6950 msgr2=0x7f03e40f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:25.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.324+0000 7f03e934d700 1 -- 172.21.15.88:0/4201871646 shutdown_connections 2023-12-09T02:38:25.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.324+0000 7f03e934d700 1 -- 172.21.15.88:0/4201871646 wait complete. 2023-12-09T02:38:25.329 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:38:25.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.426+0000 7f742a839700 1 -- 172.21.15.88:0/1307242577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74240fcd00 msgr2=0x7f74240fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:25.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.426+0000 7f742a839700 1 --2- 172.21.15.88:0/1307242577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74240fcd00 0x7f74240fd150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7418004940 tx=0x7f7418009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:25.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.426+0000 7f742a839700 1 -- 172.21.15.88:0/1307242577 shutdown_connections 2023-12-09T02:38:25.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.426+0000 7f742a839700 1 --2- 172.21.15.88:0/1307242577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74240fcd00 0x7f74240fd150 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.426+0000 7f742a839700 1 --2- 172.21.15.88:0/1307242577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74240fbaf0 0x7f74240fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.426+0000 7f742a839700 1 -- 172.21.15.88:0/1307242577 >> 172.21.15.88:0/1307242577 conn(0x7f74240f71b0 msgr2=0x7f74240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:25.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.426+0000 7f742a839700 1 -- 172.21.15.88:0/1307242577 shutdown_connections 2023-12-09T02:38:25.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.426+0000 7f742a839700 1 -- 172.21.15.88:0/1307242577 wait complete. 2023-12-09T02:38:25.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.426+0000 7f742a839700 1 Processor -- start 2023-12-09T02:38:25.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.426+0000 7f742a839700 1 -- start start 2023-12-09T02:38:25.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f742a839700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74240fbaf0 0x7f742410c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:25.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f742a839700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74240fcd00 0x7f742410c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:25.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f742a839700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742410cf30 con 0x7f74240fcd00 2023-12-09T02:38:25.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f742a839700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742410d7d0 con 0x7f74240fbaf0 2023-12-09T02:38:25.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f74237fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74240fcd00 0x7f742410c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:25.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f74237fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74240fcd00 0x7f742410c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58960/0 (socket says 172.21.15.88:58960) 2023-12-09T02:38:25.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f74237fe700 1 -- 172.21.15.88:0/2822511991 learned_addr learned my addr 172.21.15.88:0/2822511991 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:25.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f7423fff700 1 --2- 172.21.15.88:0/2822511991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74240fbaf0 0x7f742410c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:25.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f74237fe700 1 -- 172.21.15.88:0/2822511991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74240fbaf0 msgr2=0x7f742410c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f74237fe700 1 --2- 172.21.15.88:0/2822511991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74240fbaf0 0x7f742410c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f74237fe700 1 -- 172.21.15.88:0/2822511991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7418005040 con 0x7f74240fcd00 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f74237fe700 1 --2- 172.21.15.88:0/2822511991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74240fcd00 0x7f742410c930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7418009360 tx=0x7f7418009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f7420ff9700 1 -- 172.21.15.88:0/2822511991 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741800e040 con 0x7f74240fcd00 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f742a839700 1 -- 172.21.15.88:0/2822511991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742410da50 con 0x7f74240fcd00 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f7420ff9700 1 -- 172.21.15.88:0/2822511991 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f741800bcd0 con 0x7f74240fcd00 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f7420ff9700 1 -- 172.21.15.88:0/2822511991 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741801c630 con 0x7f74240fcd00 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.427+0000 7f742a839700 1 -- 172.21.15.88:0/2822511991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742410df90 con 0x7f74240fcd00 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.428+0000 7f742a839700 1 -- 172.21.15.88:0/2822511991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742404bb80 con 0x7f74240fcd00 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.429+0000 7f7420ff9700 1 -- 172.21.15.88:0/2822511991 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7418013960 con 0x7f74240fcd00 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.429+0000 7f7420ff9700 1 --2- 172.21.15.88:0/2822511991 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f740c06ce60 0x7f740c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.429+0000 7f7420ff9700 1 -- 172.21.15.88:0/2822511991 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f741808d900 con 0x7f74240fcd00 2023-12-09T02:38:25.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.429+0000 7f7423fff700 1 --2- 172.21.15.88:0/2822511991 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f740c06ce60 0x7f740c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:25.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.430+0000 7f7423fff700 1 --2- 172.21.15.88:0/2822511991 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f740c06ce60 0x7f740c06f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f74240fcb60 tx=0x7f741400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:25.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.434+0000 7f7420ff9700 1 -- 172.21.15.88:0/2822511991 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f741805b190 con 0x7f74240fcd00 2023-12-09T02:38:25.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.639+0000 7f742a839700 1 -- 172.21.15.88:0/2822511991 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f742410e3e0 con 0x7f740c06ce60 2023-12-09T02:38:25.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.640+0000 7f7420ff9700 1 -- 172.21.15.88:0/2822511991 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f742410e3e0 con 0x7f740c06ce60 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "8/21 daemons upgraded", 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:38:25.643 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:38:25.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.642+0000 7f742a839700 1 -- 172.21.15.88:0/2822511991 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f740c06ce60 msgr2=0x7f740c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:25.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.642+0000 7f742a839700 1 --2- 172.21.15.88:0/2822511991 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f740c06ce60 0x7f740c06f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f74240fcb60 tx=0x7f741400b040 comp rx=0 tx=0).stop 2023-12-09T02:38:25.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.642+0000 7f742a839700 1 -- 172.21.15.88:0/2822511991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74240fcd00 msgr2=0x7f742410c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:25.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.642+0000 7f742a839700 1 --2- 172.21.15.88:0/2822511991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74240fcd00 0x7f742410c930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7418009360 tx=0x7f7418009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:25.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.642+0000 7f742a839700 1 -- 172.21.15.88:0/2822511991 shutdown_connections 2023-12-09T02:38:25.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.642+0000 7f742a839700 1 --2- 172.21.15.88:0/2822511991 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f740c06ce60 0x7f740c06f310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.642+0000 7f742a839700 1 --2- 172.21.15.88:0/2822511991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74240fbaf0 0x7f742410c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.642+0000 7f742a839700 1 --2- 172.21.15.88:0/2822511991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74240fcd00 0x7f742410c930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.642+0000 7f742a839700 1 -- 172.21.15.88:0/2822511991 >> 172.21.15.88:0/2822511991 conn(0x7f74240f71b0 msgr2=0x7f74240fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:25.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.642+0000 7f742a839700 1 -- 172.21.15.88:0/2822511991 shutdown_connections 2023-12-09T02:38:25.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.642+0000 7f742a839700 1 -- 172.21.15.88:0/2822511991 wait complete. 2023-12-09T02:38:25.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.742+0000 7f3d82e80700 1 -- 172.21.15.88:0/989021857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d7c0fbaf0 msgr2=0x7f3d7c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:25.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.742+0000 7f3d82e80700 1 --2- 172.21.15.88:0/989021857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d7c0fbaf0 0x7f3d7c0fbf00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d70004940 tx=0x7f3d70009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:25.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.742+0000 7f3d82e80700 1 -- 172.21.15.88:0/989021857 shutdown_connections 2023-12-09T02:38:25.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.742+0000 7f3d82e80700 1 --2- 172.21.15.88:0/989021857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d7c0fcd00 0x7f3d7c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.742+0000 7f3d82e80700 1 --2- 172.21.15.88:0/989021857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d7c0fbaf0 0x7f3d7c0fbf00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.742+0000 7f3d82e80700 1 -- 172.21.15.88:0/989021857 >> 172.21.15.88:0/989021857 conn(0x7f3d7c0f7190 msgr2=0x7f3d7c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.742+0000 7f3d82e80700 1 -- 172.21.15.88:0/989021857 shutdown_connections 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.742+0000 7f3d82e80700 1 -- 172.21.15.88:0/989021857 wait complete. 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.743+0000 7f3d82e80700 1 Processor -- start 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.743+0000 7f3d82e80700 1 -- start start 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.743+0000 7f3d82e80700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d7c0fbaf0 0x7f3d7c1126a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.743+0000 7f3d82e80700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d7c0fcd00 0x7f3d7c114bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.743+0000 7f3d82e80700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c066060 con 0x7f3d7c0fcd00 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.743+0000 7f3d82e80700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0661a0 con 0x7f3d7c0fbaf0 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.743+0000 7f3d7bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d7c0fcd00 0x7f3d7c114bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.743+0000 7f3d7bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d7c0fcd00 0x7f3d7c114bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58980/0 (socket says 172.21.15.88:58980) 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.743+0000 7f3d7bfff700 1 -- 172.21.15.88:0/870169898 learned_addr learned my addr 172.21.15.88:0/870169898 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.743+0000 7f3d80c1c700 1 --2- 172.21.15.88:0/870169898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d7c0fbaf0 0x7f3d7c1126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.744+0000 7f3d7bfff700 1 -- 172.21.15.88:0/870169898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d7c0fbaf0 msgr2=0x7f3d7c1126a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:25.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.744+0000 7f3d7bfff700 1 --2- 172.21.15.88:0/870169898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d7c0fbaf0 0x7f3d7c1126a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:25.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.744+0000 7f3d7bfff700 1 -- 172.21.15.88:0/870169898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70005040 con 0x7f3d7c0fcd00 2023-12-09T02:38:25.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.744+0000 7f3d7bfff700 1 --2- 172.21.15.88:0/870169898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d7c0fcd00 0x7f3d7c114bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800b790 tx=0x7f3d68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:25.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.744+0000 7f3d797fa700 1 -- 172.21.15.88:0/870169898 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d6800f6f0 con 0x7f3d7c0fcd00 2023-12-09T02:38:25.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.744+0000 7f3d797fa700 1 -- 172.21.15.88:0/870169898 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d6800fd00 con 0x7f3d7c0fcd00 2023-12-09T02:38:25.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.744+0000 7f3d797fa700 1 -- 172.21.15.88:0/870169898 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d680103a0 con 0x7f3d7c0fcd00 2023-12-09T02:38:25.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.744+0000 7f3d82e80700 1 -- 172.21.15.88:0/870169898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7c115130 con 0x7f3d7c0fcd00 2023-12-09T02:38:25.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.744+0000 7f3d82e80700 1 -- 172.21.15.88:0/870169898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7c115610 con 0x7f3d7c0fcd00 2023-12-09T02:38:25.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.745+0000 7f3d82e80700 1 -- 172.21.15.88:0/870169898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7c04bb80 con 0x7f3d7c0fcd00 2023-12-09T02:38:25.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.745+0000 7f3d797fa700 1 -- 172.21.15.88:0/870169898 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f3d6800f850 con 0x7f3d7c0fcd00 2023-12-09T02:38:25.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.746+0000 7f3d797fa700 1 --2- 172.21.15.88:0/870169898 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3d6c06ce60 0x7f3d6c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:25.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.746+0000 7f3d797fa700 1 -- 172.21.15.88:0/870169898 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f3d6808c1a0 con 0x7f3d7c0fcd00 2023-12-09T02:38:25.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.746+0000 7f3d80c1c700 1 --2- 172.21.15.88:0/870169898 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3d6c06ce60 0x7f3d6c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:25.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.746+0000 7f3d80c1c700 1 --2- 172.21.15.88:0/870169898 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3d6c06ce60 0x7f3d6c06f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000b7d0 tx=0x7f3d70009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:25.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:25.750+0000 7f3d797fa700 1 -- 172.21.15.88:0/870169898 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3d68056040 con 0x7f3d7c0fcd00 2023-12-09T02:38:25.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:25 smithi161 ceph-mon[178840]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:25.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:25 smithi161 ceph-mon[178840]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:25.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:25 smithi161 ceph-mon[178840]: pgmap v80: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 30 B/s, 0 objects/s recovering 2023-12-09T02:38:25.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:25 smithi161 ceph-mon[178840]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:25.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:25 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/3897549319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:25.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:25 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/4201871646' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:38:25.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:25 smithi088 ceph-mon[193406]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:25.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:25 smithi088 ceph-mon[193406]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:25.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:25 smithi088 ceph-mon[193406]: pgmap v80: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 30 B/s, 0 objects/s recovering 2023-12-09T02:38:25.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:25 smithi088 ceph-mon[193406]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:25.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:25 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/3897549319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:25.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:25 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/4201871646' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:38:26.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.019+0000 7f3d82e80700 1 -- 172.21.15.88:0/870169898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3d7c115a70 con 0x7f3d7c0fcd00 2023-12-09T02:38:26.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.019+0000 7f3d797fa700 1 -- 172.21.15.88:0/870169898 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3d68059660 con 0x7f3d7c0fcd00 2023-12-09T02:38:26.022 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:38:26.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.021+0000 7f3d82e80700 1 -- 172.21.15.88:0/870169898 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3d6c06ce60 msgr2=0x7f3d6c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:26.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.021+0000 7f3d82e80700 1 --2- 172.21.15.88:0/870169898 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3d6c06ce60 0x7f3d6c06f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000b7d0 tx=0x7f3d70009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.021+0000 7f3d82e80700 1 -- 172.21.15.88:0/870169898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d7c0fcd00 msgr2=0x7f3d7c114bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.021+0000 7f3d82e80700 1 --2- 172.21.15.88:0/870169898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d7c0fcd00 0x7f3d7c114bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800b790 tx=0x7f3d68009250 comp rx=0 tx=0).stop 2023-12-09T02:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.021+0000 7f3d82e80700 1 -- 172.21.15.88:0/870169898 shutdown_connections 2023-12-09T02:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.021+0000 7f3d82e80700 1 --2- 172.21.15.88:0/870169898 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3d6c06ce60 0x7f3d6c06f310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.021+0000 7f3d82e80700 1 --2- 172.21.15.88:0/870169898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d7c0fbaf0 0x7f3d7c1126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.021+0000 7f3d82e80700 1 --2- 172.21.15.88:0/870169898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d7c0fcd00 0x7f3d7c114bf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.021+0000 7f3d82e80700 1 -- 172.21.15.88:0/870169898 >> 172.21.15.88:0/870169898 conn(0x7f3d7c0f7190 msgr2=0x7f3d7c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.021+0000 7f3d82e80700 1 -- 172.21.15.88:0/870169898 shutdown_connections 2023-12-09T02:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:26.021+0000 7f3d82e80700 1 -- 172.21.15.88:0/870169898 wait complete. 2023-12-09T02:38:26.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:26 smithi161 ceph-mon[178840]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:26.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:26 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/870169898' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:38:26.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:26 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:26.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:26 smithi088 ceph-mon[193406]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:26.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:26 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/870169898' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:38:26.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:26 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:27.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:27 smithi161 ceph-mon[178840]: pgmap v81: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27 B/s, 0 objects/s recovering 2023-12-09T02:38:27.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:27 smithi088 ceph-mon[193406]: pgmap v81: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27 B/s, 0 objects/s recovering 2023-12-09T02:38:29.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:29 smithi161 ceph-mon[178840]: pgmap v82: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2023-12-09T02:38:29.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:29 smithi088 ceph-mon[193406]: pgmap v82: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2023-12-09T02:38:31.660 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:31 smithi088 ceph-mon[193406]: pgmap v83: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2023-12-09T02:38:31.660 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:31 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-09T02:38:31.660 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:31 smithi088 ceph-mon[193406]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-09T02:38:31.660 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:31 smithi088 ceph-mon[193406]: Upgrade: osd.2 is safe to restart 2023-12-09T02:38:31.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:31 smithi161 ceph-mon[178840]: pgmap v83: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2023-12-09T02:38:31.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:31 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-09T02:38:31.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:31 smithi161 ceph-mon[178840]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-09T02:38:31.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:31 smithi161 ceph-mon[178840]: Upgrade: osd.2 is safe to restart 2023-12-09T02:38:32.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:32 smithi088 ceph-mon[193406]: Upgrade: Updating osd.2 2023-12-09T02:38:32.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:32 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:32.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:32 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-09T02:38:32.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:32 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:38:32.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:32 smithi088 ceph-mon[193406]: Deploying daemon osd.2 on smithi088 2023-12-09T02:38:33.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:32 smithi161 ceph-mon[178840]: Upgrade: Updating osd.2 2023-12-09T02:38:33.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:32 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:33.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:32 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-09T02:38:33.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:32 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:38:33.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:32 smithi161 ceph-mon[178840]: Deploying daemon osd.2 on smithi088 2023-12-09T02:38:34.047 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:33 smithi088 ceph-mon[193406]: pgmap v84: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:38:34.047 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:33 smithi088 systemd[1]: Stopping Ceph osd.2 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:38:34.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:33 smithi161 ceph-mon[178840]: pgmap v84: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:38:34.476 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:34 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[155282]: 2023-12-09T02:38:34.043+0000 7fe27772c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:38:34.476 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:34 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[155282]: 2023-12-09T02:38:34.043+0000 7fe27772c700 -1 osd.2 73 *** Got signal Terminated *** 2023-12-09T02:38:34.476 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:34 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[155282]: 2023-12-09T02:38:34.043+0000 7fe27772c700 -1 osd.2 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:38:34.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:34 smithi088 ceph-mon[193406]: osd.2 marked itself down and dead 2023-12-09T02:38:35.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:34 smithi161 ceph-mon[178840]: osd.2 marked itself down and dead 2023-12-09T02:38:35.726 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:35 smithi088 bash[216300]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2 2023-12-09T02:38:36.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:35 smithi161 ceph-mon[178840]: pgmap v85: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:38:36.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:35 smithi161 ceph-mon[178840]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:38:36.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:35 smithi161 ceph-mon[178840]: failed to encode map e74 with expected crc 2023-12-09T02:38:36.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:35 smithi161 ceph-mon[178840]: osdmap e74: 6 total, 5 up, 6 in 2023-12-09T02:38:36.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:35 smithi088 ceph-mon[193406]: pgmap v85: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:38:36.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:35 smithi088 ceph-mon[193406]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:38:36.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:35 smithi088 ceph-mon[193406]: failed to encode map e74 with expected crc 2023-12-09T02:38:36.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:35 smithi088 ceph-mon[193406]: osdmap e74: 6 total, 5 up, 6 in 2023-12-09T02:38:36.945 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:36 smithi088 systemd[1]: ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.2.service: Succeeded. 2023-12-09T02:38:36.945 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:36 smithi088 systemd[1]: Stopped Ceph osd.2 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:38:36.945 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:36 smithi088 systemd[1]: Starting Ceph osd.2 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:38:36.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: failed to encode map e75 with expected crc 2023-12-09T02:38:36.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: osdmap e75: 6 total, 5 up, 6 in 2023-12-09T02:38:36.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: failed to encode map e75 with expected crc 2023-12-09T02:38:36.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: failed to encode map e75 with expected crc 2023-12-09T02:38:36.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: failed to encode map e75 with expected crc 2023-12-09T02:38:36.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: failed to encode map e75 with expected crc 2023-12-09T02:38:36.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: failed to encode map e75 with expected crc 2023-12-09T02:38:36.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: failed to encode map e75 with expected crc 2023-12-09T02:38:36.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:36.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:38:36.946 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 5]}]: dispatch 2023-12-09T02:38:36.947 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]: dispatch 2023-12-09T02:38:36.947 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 2]}]: dispatch 2023-12-09T02:38:36.947 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [0, 5]}]: dispatch 2023-12-09T02:38:36.947 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [0, 2]}]: dispatch 2023-12-09T02:38:36.947 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.a"}]: dispatch 2023-12-09T02:38:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: failed to encode map e75 with expected crc 2023-12-09T02:38:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: osdmap e75: 6 total, 5 up, 6 in 2023-12-09T02:38:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: failed to encode map e75 with expected crc 2023-12-09T02:38:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: failed to encode map e75 with expected crc 2023-12-09T02:38:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: failed to encode map e75 with expected crc 2023-12-09T02:38:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: failed to encode map e75 with expected crc 2023-12-09T02:38:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: failed to encode map e75 with expected crc 2023-12-09T02:38:37.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: failed to encode map e75 with expected crc 2023-12-09T02:38:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:38:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 5]}]: dispatch 2023-12-09T02:38:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]: dispatch 2023-12-09T02:38:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 2]}]: dispatch 2023-12-09T02:38:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [0, 5]}]: dispatch 2023-12-09T02:38:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [0, 2]}]: dispatch 2023-12-09T02:38:37.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.a"}]: dispatch 2023-12-09T02:38:37.741 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:37 smithi088 bash[216565]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-09T02:38:37.741 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:37 smithi088 bash[216565]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-09T02:38:37.741 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:37 smithi088 bash[216565]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-09T02:38:37.741 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:37 smithi088 bash[216565]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-09T02:38:37.741 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:37 smithi088 bash[216565]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-09T02:38:37.741 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:37 smithi088 bash[216565]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-09T02:38:37.741 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:37 smithi088 bash[216565]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-09T02:38:38.132 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:37 smithi088 ceph-mon[193406]: pgmap v88: 65 pgs: 11 stale+active+clean, 54 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:38:38.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 5]}]': finished 2023-12-09T02:38:38.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]': finished 2023-12-09T02:38:38.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 2]}]': finished 2023-12-09T02:38:38.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [0, 5]}]': finished 2023-12-09T02:38:38.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [0, 2]}]': finished 2023-12-09T02:38:38.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:37 smithi088 ceph-mon[193406]: osdmap e76: 6 total, 5 up, 6 in 2023-12-09T02:38:38.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:37 smithi161 ceph-mon[178840]: pgmap v88: 65 pgs: 11 stale+active+clean, 54 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:38:38.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 5]}]': finished 2023-12-09T02:38:38.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]': finished 2023-12-09T02:38:38.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 2]}]': finished 2023-12-09T02:38:38.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [0, 5]}]': finished 2023-12-09T02:38:38.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [0, 2]}]': finished 2023-12-09T02:38:38.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:37 smithi161 ceph-mon[178840]: osdmap e76: 6 total, 5 up, 6 in 2023-12-09T02:38:38.476 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:38 smithi088 ceph-osd[216878]: -- 172.21.15.88:0/2780882287 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564d437091e0 con 0x564d436d9000 2023-12-09T02:38:38.476 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:38 smithi088 bash[216840]: e623b21addf02f80709de568f40535de7c9fa8d0df9df8a94bdbd9c9a059fc0f 2023-12-09T02:38:38.476 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:38 smithi088 systemd[1]: Started Ceph osd.2 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:38:38.976 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:38 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[216855]: 2023-12-09T02:38:38.727+0000 7f32bb838640 -1 Falling back to public interface 2023-12-09T02:38:39.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: failed to encode map e76 with expected crc 2023-12-09T02:38:39.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:39.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:39.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:38:39.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: pgmap v90: 65 pgs: 7 active+undersized, 6 active+undersized+degraded, 8 stale+active+clean, 44 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 11/222 objects degraded (4.955%) 2023-12-09T02:38:39.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.a"}]': finished 2023-12-09T02:38:39.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: osdmap e77: 6 total, 5 up, 6 in 2023-12-09T02:38:39.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: failed to encode map e77 with expected crc 2023-12-09T02:38:39.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: failed to encode map e77 with expected crc 2023-12-09T02:38:39.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: osdmap e78: 6 total, 5 up, 6 in 2023-12-09T02:38:39.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: failed to encode map e78 with expected crc 2023-12-09T02:38:39.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: failed to encode map e78 with expected crc 2023-12-09T02:38:39.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:39.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:39 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:39.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: failed to encode map e76 with expected crc 2023-12-09T02:38:39.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:39.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:39.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:38:39.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: pgmap v90: 65 pgs: 7 active+undersized, 6 active+undersized+degraded, 8 stale+active+clean, 44 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 11/222 objects degraded (4.955%) 2023-12-09T02:38:39.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.a"}]': finished 2023-12-09T02:38:39.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: osdmap e77: 6 total, 5 up, 6 in 2023-12-09T02:38:39.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: failed to encode map e77 with expected crc 2023-12-09T02:38:39.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: failed to encode map e77 with expected crc 2023-12-09T02:38:39.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: osdmap e78: 6 total, 5 up, 6 in 2023-12-09T02:38:39.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: failed to encode map e78 with expected crc 2023-12-09T02:38:39.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: failed to encode map e78 with expected crc 2023-12-09T02:38:39.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:39.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:39 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:40.257 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:40 smithi088 ceph-mon[193406]: failed to encode map e77 with expected crc 2023-12-09T02:38:40.258 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:40 smithi088 ceph-mon[193406]: failed to encode map e77 with expected crc 2023-12-09T02:38:40.258 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:40 smithi088 ceph-mon[193406]: failed to encode map e78 with expected crc 2023-12-09T02:38:40.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:40 smithi161 ceph-mon[178840]: failed to encode map e77 with expected crc 2023-12-09T02:38:40.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:40 smithi161 ceph-mon[178840]: failed to encode map e77 with expected crc 2023-12-09T02:38:40.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:40 smithi161 ceph-mon[178840]: failed to encode map e78 with expected crc 2023-12-09T02:38:40.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:40 smithi161 ceph-mon[178840]: failed to encode map e78 with expected crc 2023-12-09T02:38:40.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:40 smithi161 ceph-mon[178840]: Health check failed: Degraded data redundancy: 11/222 objects degraded (4.955%), 6 pgs degraded (PG_DEGRADED) 2023-12-09T02:38:40.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:40 smithi161 ceph-mon[178840]: failed to encode map e79 with expected crc 2023-12-09T02:38:40.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:40 smithi161 ceph-mon[178840]: osdmap e79: 6 total, 5 up, 6 in 2023-12-09T02:38:40.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:40 smithi161 ceph-mon[178840]: failed to encode map e79 with expected crc 2023-12-09T02:38:40.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:40 smithi088 ceph-mon[193406]: failed to encode map e78 with expected crc 2023-12-09T02:38:40.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:40 smithi088 ceph-mon[193406]: Health check failed: Degraded data redundancy: 11/222 objects degraded (4.955%), 6 pgs degraded (PG_DEGRADED) 2023-12-09T02:38:40.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:40 smithi088 ceph-mon[193406]: failed to encode map e79 with expected crc 2023-12-09T02:38:40.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:40 smithi088 ceph-mon[193406]: osdmap e79: 6 total, 5 up, 6 in 2023-12-09T02:38:40.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:40 smithi088 ceph-mon[193406]: failed to encode map e79 with expected crc 2023-12-09T02:38:41.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:41 smithi088 ceph-mon[193406]: failed to encode map e79 with expected crc 2023-12-09T02:38:41.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:41 smithi088 ceph-mon[193406]: failed to encode map e79 with expected crc 2023-12-09T02:38:41.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:41 smithi088 ceph-mon[193406]: pgmap v94: 65 pgs: 1 remapped+peering, 17 active+undersized, 1 active+undersized+remapped, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%); 6/222 objects misplaced (2.703%); 1024 KiB/s, 0 objects/s recovering 2023-12-09T02:38:41.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:41 smithi088 ceph-mon[193406]: osdmap e80: 6 total, 5 up, 6 in 2023-12-09T02:38:41.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:41 smithi088 ceph-mon[193406]: failed to encode map e80 with expected crc 2023-12-09T02:38:41.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:41 smithi088 ceph-mon[193406]: failed to encode map e80 with expected crc 2023-12-09T02:38:41.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:41 smithi161 ceph-mon[178840]: failed to encode map e79 with expected crc 2023-12-09T02:38:41.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:41 smithi161 ceph-mon[178840]: failed to encode map e79 with expected crc 2023-12-09T02:38:41.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:41 smithi161 ceph-mon[178840]: pgmap v94: 65 pgs: 1 remapped+peering, 17 active+undersized, 1 active+undersized+remapped, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%); 6/222 objects misplaced (2.703%); 1024 KiB/s, 0 objects/s recovering 2023-12-09T02:38:41.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:41 smithi161 ceph-mon[178840]: osdmap e80: 6 total, 5 up, 6 in 2023-12-09T02:38:41.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:41 smithi161 ceph-mon[178840]: failed to encode map e80 with expected crc 2023-12-09T02:38:41.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:41 smithi161 ceph-mon[178840]: failed to encode map e80 with expected crc 2023-12-09T02:38:42.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:42 smithi161 ceph-mon[178840]: failed to encode map e80 with expected crc 2023-12-09T02:38:42.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:42 smithi161 ceph-mon[178840]: failed to encode map e80 with expected crc 2023-12-09T02:38:42.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:42 smithi161 ceph-mon[178840]: failed to encode map e80 with expected crc 2023-12-09T02:38:42.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:42 smithi161 ceph-mon[178840]: failed to encode map e81 with expected crc 2023-12-09T02:38:42.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:42 smithi161 ceph-mon[178840]: osdmap e81: 6 total, 5 up, 6 in 2023-12-09T02:38:42.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:42 smithi161 ceph-mon[178840]: failed to encode map e81 with expected crc 2023-12-09T02:38:42.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:42.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:42 smithi088 ceph-mon[193406]: failed to encode map e80 with expected crc 2023-12-09T02:38:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:42 smithi088 ceph-mon[193406]: failed to encode map e80 with expected crc 2023-12-09T02:38:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:42 smithi088 ceph-mon[193406]: failed to encode map e80 with expected crc 2023-12-09T02:38:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:42 smithi088 ceph-mon[193406]: failed to encode map e81 with expected crc 2023-12-09T02:38:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:42 smithi088 ceph-mon[193406]: osdmap e81: 6 total, 5 up, 6 in 2023-12-09T02:38:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:42 smithi088 ceph-mon[193406]: failed to encode map e81 with expected crc 2023-12-09T02:38:42.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:42.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:43.225 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:42 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[216855]: 2023-12-09T02:38:42.971+0000 7f32bb838640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-09T02:38:43.476 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:43 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[216855]: 2023-12-09T02:38:43.463+0000 7f32bb838640 -1 osd.2 73 log_to_monitors true 2023-12-09T02:38:43.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:43 smithi088 ceph-mon[193406]: failed to encode map e81 with expected crc 2023-12-09T02:38:43.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:43 smithi088 ceph-mon[193406]: pgmap v97: 65 pgs: 2 active+clean+remapped, 1 remapped+peering, 17 active+undersized, 1 active+undersized+remapped, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%); 10/222 objects misplaced (4.505%); 3.0 MiB/s, 0 objects/s recovering 2023-12-09T02:38:43.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:43 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:43.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:43 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:43.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:43 smithi161 ceph-mon[178840]: failed to encode map e81 with expected crc 2023-12-09T02:38:43.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:43 smithi161 ceph-mon[178840]: pgmap v97: 65 pgs: 2 active+clean+remapped, 1 remapped+peering, 17 active+undersized, 1 active+undersized+remapped, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%); 10/222 objects misplaced (4.505%); 3.0 MiB/s, 0 objects/s recovering 2023-12-09T02:38:43.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:43 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:43.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:43 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:44.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:44 smithi088 ceph-mon[193406]: from='osd.2 [v2:172.21.15.88:6818/1930679366,v1:172.21.15.88:6819/1930679366]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-09T02:38:44.727 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:38:44 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[216855]: 2023-12-09T02:38:44.493+0000 7f32aa4a4700 -1 osd.2 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:38:44.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:44 smithi161 ceph-mon[178840]: from='osd.2 [v2:172.21.15.88:6818/1930679366,v1:172.21.15.88:6819/1930679366]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-09T02:38:45.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: pgmap v98: 65 pgs: 3 active+clean+remapped, 17 active+undersized, 13 active+undersized+degraded, 32 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%); 10/222 objects misplaced (4.505%); 3.4 MiB/s, 0 objects/s recovering 2023-12-09T02:38:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='osd.2 [v2:172.21.15.88:6818/1930679366,v1:172.21.15.88:6819/1930679366]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-09T02:38:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: osdmap e82: 6 total, 5 up, 6 in 2023-12-09T02:38:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='osd.2 [v2:172.21.15.88:6818/1930679366,v1:172.21.15.88:6819/1930679366]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:38:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: failed to encode map e82 with expected crc 2023-12-09T02:38:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: failed to encode map e82 with expected crc 2023-12-09T02:38:45.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: failed to encode map e82 with expected crc 2023-12-09T02:38:45.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:45.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:45.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:38:45.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:38:45.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:45.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:38:45.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:45.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:45.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:45.729 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:45 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-09T02:38:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: pgmap v98: 65 pgs: 3 active+clean+remapped, 17 active+undersized, 13 active+undersized+degraded, 32 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%); 10/222 objects misplaced (4.505%); 3.4 MiB/s, 0 objects/s recovering 2023-12-09T02:38:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='osd.2 [v2:172.21.15.88:6818/1930679366,v1:172.21.15.88:6819/1930679366]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-09T02:38:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: osdmap e82: 6 total, 5 up, 6 in 2023-12-09T02:38:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='osd.2 [v2:172.21.15.88:6818/1930679366,v1:172.21.15.88:6819/1930679366]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-12-09T02:38:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: failed to encode map e82 with expected crc 2023-12-09T02:38:45.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: failed to encode map e82 with expected crc 2023-12-09T02:38:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: failed to encode map e82 with expected crc 2023-12-09T02:38:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:38:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:38:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:38:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:45.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:45 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-09T02:38:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:46 smithi161 ceph-mon[178840]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-09T02:38:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:46 smithi161 ceph-mon[178840]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-12-09T02:38:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:46 smithi161 ceph-mon[178840]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:38:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:46 smithi161 ceph-mon[178840]: osd.2 [v2:172.21.15.88:6818/1930679366,v1:172.21.15.88:6819/1930679366] boot 2023-12-09T02:38:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:46 smithi161 ceph-mon[178840]: osdmap e83: 6 total, 6 up, 6 in 2023-12-09T02:38:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:46 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:38:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:46 smithi161 ceph-mon[178840]: failed to encode map e83 with expected crc 2023-12-09T02:38:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:46 smithi161 ceph-mon[178840]: failed to encode map e83 with expected crc 2023-12-09T02:38:46.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:46 smithi161 ceph-mon[178840]: failed to encode map e83 with expected crc 2023-12-09T02:38:46.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:46 smithi161 ceph-mon[178840]: failed to encode map e83 with expected crc 2023-12-09T02:38:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:46 smithi088 ceph-mon[193406]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-09T02:38:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:46 smithi088 ceph-mon[193406]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-12-09T02:38:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:46 smithi088 ceph-mon[193406]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:38:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:46 smithi088 ceph-mon[193406]: osd.2 [v2:172.21.15.88:6818/1930679366,v1:172.21.15.88:6819/1930679366] boot 2023-12-09T02:38:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:46 smithi088 ceph-mon[193406]: osdmap e83: 6 total, 6 up, 6 in 2023-12-09T02:38:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:46 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-09T02:38:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:46 smithi088 ceph-mon[193406]: failed to encode map e83 with expected crc 2023-12-09T02:38:46.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:46 smithi088 ceph-mon[193406]: failed to encode map e83 with expected crc 2023-12-09T02:38:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:46 smithi088 ceph-mon[193406]: failed to encode map e83 with expected crc 2023-12-09T02:38:46.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:46 smithi088 ceph-mon[193406]: failed to encode map e83 with expected crc 2023-12-09T02:38:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:47 smithi161 ceph-mon[178840]: pgmap v101: 65 pgs: 3 active+clean+remapped, 17 active+undersized, 13 active+undersized+degraded, 32 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%); 10/222 objects misplaced (4.505%); 2.0 MiB/s, 11 objects/s recovering 2023-12-09T02:38:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:47 smithi161 ceph-mon[178840]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:47 smithi161 ceph-mon[178840]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:47 smithi161 ceph-mon[178840]: osdmap e84: 6 total, 6 up, 6 in 2023-12-09T02:38:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:47 smithi161 ceph-mon[178840]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:47 smithi161 ceph-mon[178840]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:47 smithi161 ceph-mon[178840]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:47 smithi161 ceph-mon[178840]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:47 smithi161 ceph-mon[178840]: osdmap e85: 6 total, 6 up, 6 in 2023-12-09T02:38:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:47 smithi088 ceph-mon[193406]: pgmap v101: 65 pgs: 3 active+clean+remapped, 17 active+undersized, 13 active+undersized+degraded, 32 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%); 10/222 objects misplaced (4.505%); 2.0 MiB/s, 11 objects/s recovering 2023-12-09T02:38:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:47 smithi088 ceph-mon[193406]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:47 smithi088 ceph-mon[193406]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:47 smithi088 ceph-mon[193406]: osdmap e84: 6 total, 6 up, 6 in 2023-12-09T02:38:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:47 smithi088 ceph-mon[193406]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:47 smithi088 ceph-mon[193406]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:47 smithi088 ceph-mon[193406]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:47 smithi088 ceph-mon[193406]: failed to encode map e84 with expected crc 2023-12-09T02:38:47.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:47 smithi088 ceph-mon[193406]: osdmap e85: 6 total, 6 up, 6 in 2023-12-09T02:38:48.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:48 smithi161 ceph-mon[178840]: failed to encode map e85 with expected crc 2023-12-09T02:38:48.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:48 smithi161 ceph-mon[178840]: failed to encode map e85 with expected crc 2023-12-09T02:38:48.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:48 smithi161 ceph-mon[178840]: failed to encode map e85 with expected crc 2023-12-09T02:38:48.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:48 smithi161 ceph-mon[178840]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 13 pgs degraded (PG_DEGRADED) 2023-12-09T02:38:48.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:48 smithi161 ceph-mon[178840]: osdmap e86: 6 total, 6 up, 6 in 2023-12-09T02:38:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:48 smithi088 ceph-mon[193406]: failed to encode map e85 with expected crc 2023-12-09T02:38:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:48 smithi088 ceph-mon[193406]: failed to encode map e85 with expected crc 2023-12-09T02:38:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:48 smithi088 ceph-mon[193406]: failed to encode map e85 with expected crc 2023-12-09T02:38:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:48 smithi088 ceph-mon[193406]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 13 pgs degraded (PG_DEGRADED) 2023-12-09T02:38:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:48 smithi088 ceph-mon[193406]: osdmap e86: 6 total, 6 up, 6 in 2023-12-09T02:38:49.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:49 smithi161 ceph-mon[178840]: pgmap v104: 65 pgs: 2 remapped+peering, 1 active+clean+remapped, 11 active+undersized, 9 active+undersized+degraded, 42 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 20/222 objects degraded (9.009%); 6/222 objects misplaced (2.703%) 2023-12-09T02:38:49.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:49 smithi161 ceph-mon[178840]: failed to encode map e86 with expected crc 2023-12-09T02:38:49.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:49 smithi161 ceph-mon[178840]: failed to encode map e86 with expected crc 2023-12-09T02:38:49.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:49 smithi161 ceph-mon[178840]: osdmap e87: 6 total, 6 up, 6 in 2023-12-09T02:38:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:49 smithi088 ceph-mon[193406]: pgmap v104: 65 pgs: 2 remapped+peering, 1 active+clean+remapped, 11 active+undersized, 9 active+undersized+degraded, 42 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 20/222 objects degraded (9.009%); 6/222 objects misplaced (2.703%) 2023-12-09T02:38:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:49 smithi088 ceph-mon[193406]: failed to encode map e86 with expected crc 2023-12-09T02:38:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:49 smithi088 ceph-mon[193406]: failed to encode map e86 with expected crc 2023-12-09T02:38:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:49 smithi088 ceph-mon[193406]: osdmap e87: 6 total, 6 up, 6 in 2023-12-09T02:38:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:50 smithi161 ceph-mon[178840]: failed to encode map e87 with expected crc 2023-12-09T02:38:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:50 smithi161 ceph-mon[178840]: failed to encode map e87 with expected crc 2023-12-09T02:38:50.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:50 smithi161 ceph-mon[178840]: osdmap e88: 6 total, 6 up, 6 in 2023-12-09T02:38:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:50 smithi088 ceph-mon[193406]: failed to encode map e87 with expected crc 2023-12-09T02:38:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:50 smithi088 ceph-mon[193406]: failed to encode map e87 with expected crc 2023-12-09T02:38:50.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:50 smithi088 ceph-mon[193406]: osdmap e88: 6 total, 6 up, 6 in 2023-12-09T02:38:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:51 smithi161 ceph-mon[178840]: pgmap v107: 65 pgs: 2 remapped+peering, 63 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:38:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:51 smithi161 ceph-mon[178840]: failed to encode map e88 with expected crc 2023-12-09T02:38:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:51 smithi161 ceph-mon[178840]: failed to encode map e88 with expected crc 2023-12-09T02:38:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:51 smithi161 ceph-mon[178840]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/222 objects degraded (9.009%), 9 pgs degraded) 2023-12-09T02:38:51.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:51 smithi161 ceph-mon[178840]: Cluster is now healthy 2023-12-09T02:38:51.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:51 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:51.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:51 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:38:51.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:51 smithi088 ceph-mon[193406]: pgmap v107: 65 pgs: 2 remapped+peering, 63 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:38:51.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:51 smithi088 ceph-mon[193406]: failed to encode map e88 with expected crc 2023-12-09T02:38:51.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:51 smithi088 ceph-mon[193406]: failed to encode map e88 with expected crc 2023-12-09T02:38:51.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:51 smithi088 ceph-mon[193406]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/222 objects degraded (9.009%), 9 pgs degraded) 2023-12-09T02:38:51.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:51 smithi088 ceph-mon[193406]: Cluster is now healthy 2023-12-09T02:38:51.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:51 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:38:51.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:51 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:38:53.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:53 smithi161 ceph-mon[178840]: pgmap v109: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s, 153 objects/s recovering 2023-12-09T02:38:53.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:53 smithi088 ceph-mon[193406]: pgmap v109: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s, 153 objects/s recovering 2023-12-09T02:38:55.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:55 smithi161 ceph-mon[178840]: pgmap v110: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s, 123 objects/s recovering 2023-12-09T02:38:55.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:55 smithi088 ceph-mon[193406]: pgmap v110: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s, 123 objects/s recovering 2023-12-09T02:38:56.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.135+0000 7f9667327700 1 -- 172.21.15.88:0/3588034176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96600fd730 msgr2=0x7f96600ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.135+0000 7f9667327700 1 --2- 172.21.15.88:0/3588034176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96600fd730 0x7f96600ffb10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9650004940 tx=0x7f9650009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:56.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.135+0000 7f9667327700 1 -- 172.21.15.88:0/3588034176 shutdown_connections 2023-12-09T02:38:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.135+0000 7f9667327700 1 --2- 172.21.15.88:0/3588034176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9660100050 0x7f9660102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.135+0000 7f9667327700 1 --2- 172.21.15.88:0/3588034176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96600fd730 0x7f96600ffb10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.136+0000 7f9667327700 1 -- 172.21.15.88:0/3588034176 >> 172.21.15.88:0/3588034176 conn(0x7f96600f7190 msgr2=0x7f96600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.136+0000 7f9667327700 1 -- 172.21.15.88:0/3588034176 shutdown_connections 2023-12-09T02:38:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.136+0000 7f9667327700 1 -- 172.21.15.88:0/3588034176 wait complete. 2023-12-09T02:38:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.136+0000 7f9667327700 1 Processor -- start 2023-12-09T02:38:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.136+0000 7f9667327700 1 -- start start 2023-12-09T02:38:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.136+0000 7f9667327700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96600fd730 0x7f966010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.136+0000 7f9667327700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9660100050 0x7f966010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.136+0000 7f9667327700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966010e0c0 con 0x7f96600fd730 2023-12-09T02:38:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.136+0000 7f9667327700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966010e900 con 0x7f9660100050 2023-12-09T02:38:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.136+0000 7f96650c3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96600fd730 0x7f966010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f96650c3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96600fd730 0x7f966010d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52478/0 (socket says 172.21.15.88:52478) 2023-12-09T02:38:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f96650c3700 1 -- 172.21.15.88:0/1247364315 learned_addr learned my addr 172.21.15.88:0/1247364315 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f96648c2700 1 --2- 172.21.15.88:0/1247364315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9660100050 0x7f966010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f96650c3700 1 -- 172.21.15.88:0/1247364315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9660100050 msgr2=0x7f966010da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f96650c3700 1 --2- 172.21.15.88:0/1247364315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9660100050 0x7f966010da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f96650c3700 1 -- 172.21.15.88:0/1247364315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650005040 con 0x7f96600fd730 2023-12-09T02:38:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f96650c3700 1 --2- 172.21.15.88:0/1247364315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96600fd730 0x7f966010d4f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9650009380 tx=0x7f9650009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f965dffb700 1 -- 172.21.15.88:0/1247364315 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f965000e040 con 0x7f96600fd730 2023-12-09T02:38:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f965dffb700 1 -- 172.21.15.88:0/1247364315 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f965000bd20 con 0x7f96600fd730 2023-12-09T02:38:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f9667327700 1 -- 172.21.15.88:0/1247364315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966010eb80 con 0x7f96600fd730 2023-12-09T02:38:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f965dffb700 1 -- 172.21.15.88:0/1247364315 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f965001c630 con 0x7f96600fd730 2023-12-09T02:38:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.137+0000 7f9667327700 1 -- 172.21.15.88:0/1247364315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966010f0c0 con 0x7f96600fd730 2023-12-09T02:38:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.138+0000 7f9667327700 1 -- 172.21.15.88:0/1247364315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966004bb80 con 0x7f96600fd730 2023-12-09T02:38:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.139+0000 7f965dffb700 1 -- 172.21.15.88:0/1247364315 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f9650013420 con 0x7f96600fd730 2023-12-09T02:38:56.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.140+0000 7f965dffb700 1 --2- 172.21.15.88:0/1247364315 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f964806ce60 0x7f964806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:56.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.140+0000 7f96648c2700 1 --2- 172.21.15.88:0/1247364315 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f964806ce60 0x7f964806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:56.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.140+0000 7f965dffb700 1 -- 172.21.15.88:0/1247364315 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f965008e3a0 con 0x7f96600fd730 2023-12-09T02:38:56.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.140+0000 7f96648c2700 1 --2- 172.21.15.88:0/1247364315 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f964806ce60 0x7f964806f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9654009bf0 tx=0x7f96540091a0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.144+0000 7f965dffb700 1 -- 172.21.15.88:0/1247364315 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f965005bbe0 con 0x7f96600fd730 2023-12-09T02:38:56.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.353+0000 7f9667327700 1 -- 172.21.15.88:0/1247364315 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9660100cb0 con 0x7f964806ce60 2023-12-09T02:38:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.354+0000 7f965dffb700 1 -- 172.21.15.88:0/1247364315 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9660100cb0 con 0x7f964806ce60 2023-12-09T02:38:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.356+0000 7f9667327700 1 -- 172.21.15.88:0/1247364315 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f964806ce60 msgr2=0x7f964806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.356+0000 7f9667327700 1 --2- 172.21.15.88:0/1247364315 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f964806ce60 0x7f964806f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9654009bf0 tx=0x7f96540091a0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.356+0000 7f9667327700 1 -- 172.21.15.88:0/1247364315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96600fd730 msgr2=0x7f966010d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.356+0000 7f9667327700 1 --2- 172.21.15.88:0/1247364315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96600fd730 0x7f966010d4f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9650009380 tx=0x7f9650009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.356+0000 7f9667327700 1 -- 172.21.15.88:0/1247364315 shutdown_connections 2023-12-09T02:38:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.356+0000 7f9667327700 1 --2- 172.21.15.88:0/1247364315 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f964806ce60 0x7f964806f310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.356+0000 7f9667327700 1 --2- 172.21.15.88:0/1247364315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96600fd730 0x7f966010d4f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.356+0000 7f9667327700 1 --2- 172.21.15.88:0/1247364315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9660100050 0x7f966010da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.356+0000 7f9667327700 1 -- 172.21.15.88:0/1247364315 >> 172.21.15.88:0/1247364315 conn(0x7f96600f7190 msgr2=0x7f96600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.356+0000 7f9667327700 1 -- 172.21.15.88:0/1247364315 shutdown_connections 2023-12-09T02:38:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.356+0000 7f9667327700 1 -- 172.21.15.88:0/1247364315 wait complete. 2023-12-09T02:38:56.368 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:38:56.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 -- 172.21.15.88:0/2931850157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d880fcbf0 msgr2=0x7f0d880fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 --2- 172.21.15.88:0/2931850157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d880fcbf0 0x7f0d880fd000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d78004940 tx=0x7f0d78009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:56.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 -- 172.21.15.88:0/2931850157 shutdown_connections 2023-12-09T02:38:56.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 --2- 172.21.15.88:0/2931850157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d880fde00 0x7f0d880fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 --2- 172.21.15.88:0/2931850157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d880fcbf0 0x7f0d880fd000 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 -- 172.21.15.88:0/2931850157 >> 172.21.15.88:0/2931850157 conn(0x7f0d880f82d0 msgr2=0x7f0d880fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 -- 172.21.15.88:0/2931850157 shutdown_connections 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 -- 172.21.15.88:0/2931850157 wait complete. 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 Processor -- start 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 -- start start 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d880fcbf0 0x7f0d8810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d880fde00 0x7f0d8810dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8810e170 con 0x7f0d880fcbf0 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.458+0000 7f0d9008d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8810e9b0 con 0x7f0d880fde00 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d8de29700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d880fcbf0 0x7f0d8810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d8de29700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d880fcbf0 0x7f0d8810d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40952/0 (socket says 172.21.15.88:40952) 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d8de29700 1 -- 172.21.15.88:0/1666063490 learned_addr learned my addr 172.21.15.88:0/1666063490 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d8d628700 1 --2- 172.21.15.88:0/1666063490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d880fde00 0x7f0d8810dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d8de29700 1 -- 172.21.15.88:0/1666063490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d880fde00 msgr2=0x7f0d8810dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d8de29700 1 --2- 172.21.15.88:0/1666063490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d880fde00 0x7f0d8810dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d8de29700 1 -- 172.21.15.88:0/1666063490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d78005040 con 0x7f0d880fcbf0 2023-12-09T02:38:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d8de29700 1 --2- 172.21.15.88:0/1666063490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d880fcbf0 0x7f0d8810d5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009fd0 tx=0x7f0d78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d7e7fc700 1 -- 172.21.15.88:0/1666063490 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7800e040 con 0x7f0d880fcbf0 2023-12-09T02:38:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d9008d700 1 -- 172.21.15.88:0/1666063490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8810ec30 con 0x7f0d880fcbf0 2023-12-09T02:38:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d7e7fc700 1 -- 172.21.15.88:0/1666063490 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d78013420 con 0x7f0d880fcbf0 2023-12-09T02:38:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d7e7fc700 1 -- 172.21.15.88:0/1666063490 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7801c630 con 0x7f0d880fcbf0 2023-12-09T02:38:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.459+0000 7f0d9008d700 1 -- 172.21.15.88:0/1666063490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8810f170 con 0x7f0d880fcbf0 2023-12-09T02:38:56.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.460+0000 7f0d9008d700 1 -- 172.21.15.88:0/1666063490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8804bb80 con 0x7f0d880fcbf0 2023-12-09T02:38:56.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.461+0000 7f0d7e7fc700 1 -- 172.21.15.88:0/1666063490 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0d78013a00 con 0x7f0d880fcbf0 2023-12-09T02:38:56.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.461+0000 7f0d7e7fc700 1 --2- 172.21.15.88:0/1666063490 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0d7406ce60 0x7f0d7406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:56.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.461+0000 7f0d7e7fc700 1 -- 172.21.15.88:0/1666063490 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f0d7808d760 con 0x7f0d880fcbf0 2023-12-09T02:38:56.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.461+0000 7f0d8d628700 1 --2- 172.21.15.88:0/1666063490 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0d7406ce60 0x7f0d7406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:56.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.461+0000 7f0d8d628700 1 --2- 172.21.15.88:0/1666063490 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0d7406ce60 0x7f0d7406f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009bf0 tx=0x7f0d840091a0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:56.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.466+0000 7f0d7e7fc700 1 -- 172.21.15.88:0/1666063490 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0d7805afa0 con 0x7f0d880fcbf0 2023-12-09T02:38:56.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.670+0000 7f0d9008d700 1 -- 172.21.15.88:0/1666063490 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d8810f590 con 0x7f0d7406ce60 2023-12-09T02:38:56.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.671+0000 7f0d7e7fc700 1 -- 172.21.15.88:0/1666063490 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0d8810f590 con 0x7f0d7406ce60 2023-12-09T02:38:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.673+0000 7f0d9008d700 1 -- 172.21.15.88:0/1666063490 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0d7406ce60 msgr2=0x7f0d7406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.673+0000 7f0d9008d700 1 --2- 172.21.15.88:0/1666063490 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0d7406ce60 0x7f0d7406f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009bf0 tx=0x7f0d840091a0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.673+0000 7f0d9008d700 1 -- 172.21.15.88:0/1666063490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d880fcbf0 msgr2=0x7f0d8810d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.673+0000 7f0d9008d700 1 --2- 172.21.15.88:0/1666063490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d880fcbf0 0x7f0d8810d5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009fd0 tx=0x7f0d78009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.674+0000 7f0d9008d700 1 -- 172.21.15.88:0/1666063490 shutdown_connections 2023-12-09T02:38:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.674+0000 7f0d9008d700 1 --2- 172.21.15.88:0/1666063490 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0d7406ce60 0x7f0d7406f310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.674+0000 7f0d9008d700 1 --2- 172.21.15.88:0/1666063490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d880fcbf0 0x7f0d8810d5a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.674+0000 7f0d9008d700 1 --2- 172.21.15.88:0/1666063490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d880fde00 0x7f0d8810dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.674+0000 7f0d9008d700 1 -- 172.21.15.88:0/1666063490 >> 172.21.15.88:0/1666063490 conn(0x7f0d880f82d0 msgr2=0x7f0d88101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.674+0000 7f0d9008d700 1 -- 172.21.15.88:0/1666063490 shutdown_connections 2023-12-09T02:38:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.674+0000 7f0d9008d700 1 -- 172.21.15.88:0/1666063490 wait complete. 2023-12-09T02:38:56.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.774+0000 7f25013bc700 1 -- 172.21.15.88:0/777896915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0fcd00 msgr2=0x7f24fc0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.774+0000 7f25013bc700 1 --2- 172.21.15.88:0/777896915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0fcd00 0x7f24fc0fd150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f24e4004940 tx=0x7f24e4009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:56.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.774+0000 7f25013bc700 1 -- 172.21.15.88:0/777896915 shutdown_connections 2023-12-09T02:38:56.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.774+0000 7f25013bc700 1 --2- 172.21.15.88:0/777896915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0fcd00 0x7f24fc0fd150 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.774+0000 7f25013bc700 1 --2- 172.21.15.88:0/777896915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24fc0fbaf0 0x7f24fc0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.774+0000 7f25013bc700 1 -- 172.21.15.88:0/777896915 >> 172.21.15.88:0/777896915 conn(0x7f24fc0f7190 msgr2=0x7f24fc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:56.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.774+0000 7f25013bc700 1 -- 172.21.15.88:0/777896915 shutdown_connections 2023-12-09T02:38:56.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.774+0000 7f25013bc700 1 -- 172.21.15.88:0/777896915 wait complete. 2023-12-09T02:38:56.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.774+0000 7f25013bc700 1 Processor -- start 2023-12-09T02:38:56.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.774+0000 7f25013bc700 1 -- start start 2023-12-09T02:38:56.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f25013bc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24fc0fbaf0 0x7f24fc10c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:56.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f25013bc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0fcd00 0x7f24fc10c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:56.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f25013bc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc10cfb0 con 0x7f24fc0fcd00 2023-12-09T02:38:56.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f25013bc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc10d850 con 0x7f24fc0fbaf0 2023-12-09T02:38:56.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f24fa7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0fcd00 0x7f24fc10c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f24fa7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0fcd00 0x7f24fc10c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40976/0 (socket says 172.21.15.88:40976) 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f24fa7fc700 1 -- 172.21.15.88:0/628459966 learned_addr learned my addr 172.21.15.88:0/628459966 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f24faffd700 1 --2- 172.21.15.88:0/628459966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24fc0fbaf0 0x7f24fc10c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f24fa7fc700 1 -- 172.21.15.88:0/628459966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24fc0fbaf0 msgr2=0x7f24fc10c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f24fa7fc700 1 --2- 172.21.15.88:0/628459966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24fc0fbaf0 0x7f24fc10c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f24fa7fc700 1 -- 172.21.15.88:0/628459966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e4005040 con 0x7f24fc0fcd00 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f24fa7fc700 1 --2- 172.21.15.88:0/628459966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0fcd00 0x7f24fc10c9b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009fd0 tx=0x7f24e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f24f37fe700 1 -- 172.21.15.88:0/628459966 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e400e040 con 0x7f24fc0fcd00 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f24f37fe700 1 -- 172.21.15.88:0/628459966 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f24e4004290 con 0x7f24fc0fcd00 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f25013bc700 1 -- 172.21.15.88:0/628459966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc10dad0 con 0x7f24fc0fcd00 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f24f37fe700 1 -- 172.21.15.88:0/628459966 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e401c3f0 con 0x7f24fc0fcd00 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.775+0000 7f25013bc700 1 -- 172.21.15.88:0/628459966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc10e010 con 0x7f24fc0fcd00 2023-12-09T02:38:56.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.776+0000 7f25013bc700 1 -- 172.21.15.88:0/628459966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24fc04bb80 con 0x7f24fc0fcd00 2023-12-09T02:38:56.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.777+0000 7f24f37fe700 1 -- 172.21.15.88:0/628459966 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f24e4013420 con 0x7f24fc0fcd00 2023-12-09T02:38:56.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.777+0000 7f24f37fe700 1 --2- 172.21.15.88:0/628459966 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f24e806ce70 0x7f24e806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:56.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.777+0000 7f24f37fe700 1 -- 172.21.15.88:0/628459966 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f24e408d920 con 0x7f24fc0fcd00 2023-12-09T02:38:56.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.777+0000 7f24faffd700 1 --2- 172.21.15.88:0/628459966 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f24e806ce70 0x7f24e806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:56.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.778+0000 7f24faffd700 1 --2- 172.21.15.88:0/628459966 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f24e806ce70 0x7f24e806f320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0fcb60 tx=0x7f24ec00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:56.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.782+0000 7f24f37fe700 1 -- 172.21.15.88:0/628459966 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f24e405b0e0 con 0x7f24fc0fcd00 2023-12-09T02:38:56.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.980+0000 7f25013bc700 1 -- 172.21.15.88:0/628459966 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f24fc10e420 con 0x7f24e806ce70 2023-12-09T02:38:56.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.989+0000 7f24f37fe700 1 -- 172.21.15.88:0/628459966 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f24fc10e420 con 0x7f24e806ce70 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (3m) 15s ago 9m 28.5M - 0.25.0 c8568f914cd2 9dc2b8db0963 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (97s) 15s ago 10m 7470k - 19.0.0-44-g9dcc13bb f28f2b94f153 bf03eec19a86 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (93s) 90s ago 9m 7444k - 19.0.0-44-g9dcc13bb f28f2b94f153 890646e8cd90 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (3m) 15s ago 9m 92.5M - 9.4.7 954c08fa6188 ab4c3f64ce4d 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (6m) 15s ago 6m 14.8M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (6m) 15s ago 6m 16.1M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (6m) 90s ago 6m 10.1G - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (6m) 90s ago 6m 15.6M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:8443,9283,8765 running (3m) 15s ago 11m 512M - 19.0.0-44-g9dcc13bb f28f2b94f153 a939ff288750 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283,8765 running (2m) 90s ago 9m 448M - 19.0.0-44-g9dcc13bb f28f2b94f153 e2ee2a6eb30b 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (2m) 15s ago 11m 67.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 8e4b2ba7b37c 2023-12-09T02:38:56.991 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (2m) 90s ago 9m 42.0M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 4769966a784f 2023-12-09T02:38:56.992 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (3m) 15s ago 9m 18.1M - 1.5.0 0da6a335fe13 e2b7cc0b7527 2023-12-09T02:38:56.992 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (3m) 90s ago 9m 17.4M - 1.5.0 0da6a335fe13 0de833ab198e 2023-12-09T02:38:56.992 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (78s) 15s ago 8m 192M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 88f0691c638a 2023-12-09T02:38:56.992 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (49s) 15s ago 8m 131M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 8bb8d12931bb 2023-12-09T02:38:56.992 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (19s) 15s ago 7m 12.9M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 e623b21addf0 2023-12-09T02:38:56.992 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (7m) 90s ago 7m 1124M 2592M 17.2.7-119-ge2143d99 f761b6e42225 35d17866072a 2023-12-09T02:38:56.992 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (7m) 90s ago 7m 831M 2592M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:38:56.992 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (7m) 90s ago 7m 945M 2592M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:38:56.992 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (2m) 15s ago 9m 51.3M - 2.43.0 a07b618ecd1d ddb1fb2e1888 2023-12-09T02:38:56.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.991+0000 7f25013bc700 1 -- 172.21.15.88:0/628459966 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f24e806ce70 msgr2=0x7f24e806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.991+0000 7f25013bc700 1 --2- 172.21.15.88:0/628459966 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f24e806ce70 0x7f24e806f320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0fcb60 tx=0x7f24ec00b040 comp rx=0 tx=0).stop 2023-12-09T02:38:56.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.991+0000 7f25013bc700 1 -- 172.21.15.88:0/628459966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0fcd00 msgr2=0x7f24fc10c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:56.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.991+0000 7f25013bc700 1 --2- 172.21.15.88:0/628459966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0fcd00 0x7f24fc10c9b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009fd0 tx=0x7f24e4009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:56.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.991+0000 7f25013bc700 1 -- 172.21.15.88:0/628459966 shutdown_connections 2023-12-09T02:38:56.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.991+0000 7f25013bc700 1 --2- 172.21.15.88:0/628459966 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f24e806ce70 0x7f24e806f320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.991+0000 7f25013bc700 1 --2- 172.21.15.88:0/628459966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24fc0fbaf0 0x7f24fc10c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.991+0000 7f25013bc700 1 --2- 172.21.15.88:0/628459966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0fcd00 0x7f24fc10c9b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:56.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.991+0000 7f25013bc700 1 -- 172.21.15.88:0/628459966 >> 172.21.15.88:0/628459966 conn(0x7f24fc0f7190 msgr2=0x7f24fc0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:56.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.992+0000 7f25013bc700 1 -- 172.21.15.88:0/628459966 shutdown_connections 2023-12-09T02:38:56.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:56.992+0000 7f25013bc700 1 -- 172.21.15.88:0/628459966 wait complete. 2023-12-09T02:38:57.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.090+0000 7f5c05a8c700 1 -- 172.21.15.88:0/4178982923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c000fdf60 msgr2=0x7f5c000fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:57.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.090+0000 7f5c05a8c700 1 --2- 172.21.15.88:0/4178982923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c000fdf60 0x7f5c000fe3b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4004940 tx=0x7f5bf4009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:57.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.090+0000 7f5c05a8c700 1 -- 172.21.15.88:0/4178982923 shutdown_connections 2023-12-09T02:38:57.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.090+0000 7f5c05a8c700 1 --2- 172.21.15.88:0/4178982923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c000fdf60 0x7f5c000fe3b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.090+0000 7f5c05a8c700 1 --2- 172.21.15.88:0/4178982923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c000faed0 0x7f5c000fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.090+0000 7f5c05a8c700 1 -- 172.21.15.88:0/4178982923 >> 172.21.15.88:0/4178982923 conn(0x7f5c000f6950 msgr2=0x7f5c000f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.090+0000 7f5c05a8c700 1 -- 172.21.15.88:0/4178982923 shutdown_connections 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.090+0000 7f5c05a8c700 1 -- 172.21.15.88:0/4178982923 wait complete. 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.091+0000 7f5c05a8c700 1 Processor -- start 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.091+0000 7f5c05a8c700 1 -- start start 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.091+0000 7f5c05a8c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c000faed0 0x7f5c000fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.091+0000 7f5c05a8c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c000fdf60 0x7f5c000fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.091+0000 7f5c05a8c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000fc470 con 0x7f5c000fdf60 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.091+0000 7f5c05a8c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000fc5e0 con 0x7f5c000faed0 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.091+0000 7f5bfeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c000fdf60 0x7f5c000fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.091+0000 7f5bfeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c000fdf60 0x7f5c000fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41002/0 (socket says 172.21.15.88:41002) 2023-12-09T02:38:57.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.091+0000 7f5bfeffd700 1 -- 172.21.15.88:0/1754932206 learned_addr learned my addr 172.21.15.88:0/1754932206 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:57.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.092+0000 7f5bff7fe700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c000faed0 0x7f5c000fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:57.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.092+0000 7f5bfeffd700 1 -- 172.21.15.88:0/1754932206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c000faed0 msgr2=0x7f5c000fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:57.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.092+0000 7f5bfeffd700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c000faed0 0x7f5c000fd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.092+0000 7f5bfeffd700 1 -- 172.21.15.88:0/1754932206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf4005040 con 0x7f5c000fdf60 2023-12-09T02:38:57.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.092+0000 7f5bff7fe700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c000faed0 0x7f5c000fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:38:57.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.092+0000 7f5bfeffd700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c000fdf60 0x7f5c000fbe70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400b3b0 tx=0x7f5bf4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:57.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.092+0000 7f5be7fff700 1 -- 172.21.15.88:0/1754932206 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf400e040 con 0x7f5c000fdf60 2023-12-09T02:38:57.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.092+0000 7f5c05a8c700 1 -- 172.21.15.88:0/1754932206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c000fc860 con 0x7f5c000fdf60 2023-12-09T02:38:57.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.092+0000 7f5be7fff700 1 -- 172.21.15.88:0/1754932206 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5bf400bc50 con 0x7f5c000fdf60 2023-12-09T02:38:57.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.092+0000 7f5be7fff700 1 -- 172.21.15.88:0/1754932206 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf4013660 con 0x7f5c000fdf60 2023-12-09T02:38:57.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.092+0000 7f5c05a8c700 1 -- 172.21.15.88:0/1754932206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c001156a0 con 0x7f5c000fdf60 2023-12-09T02:38:57.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.093+0000 7f5c05a8c700 1 -- 172.21.15.88:0/1754932206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c001075f0 con 0x7f5c000fdf60 2023-12-09T02:38:57.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.093+0000 7f5be7fff700 1 -- 172.21.15.88:0/1754932206 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f5bf40138d0 con 0x7f5c000fdf60 2023-12-09T02:38:57.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.094+0000 7f5be7fff700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5be806ce60 0x7f5be806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:57.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.094+0000 7f5be7fff700 1 -- 172.21.15.88:0/1754932206 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f5bf408d200 con 0x7f5c000fdf60 2023-12-09T02:38:57.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.094+0000 7f5bff7fe700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5be806ce60 0x7f5be806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:57.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.094+0000 7f5bff7fe700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5be806ce60 0x7f5be806f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c000fd780 tx=0x7f5bf0009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:57.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.098+0000 7f5be7fff700 1 -- 172.21.15.88:0/1754932206 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5bf405aaf0 con 0x7f5c000fdf60 2023-12-09T02:38:57.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.368+0000 7f5c05a8c700 1 -- 172.21.15.88:0/1754932206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c0004bb80 con 0x7f5c000fdf60 2023-12-09T02:38:57.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.369+0000 7f5be7fff700 1 -- 172.21.15.88:0/1754932206 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f5bf405a680 con 0x7f5c000fdf60 2023-12-09T02:38:57.371 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:38:57.371 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:38:57.371 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:38:57.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:38:57.371 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:38:57.371 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:38:57.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:38:57.372 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:38:57.372 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 3, 2023-12-09T02:38:57.372 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 3 2023-12-09T02:38:57.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:38:57.372 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:38:57.372 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:38:57.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:38:57.373 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:38:57.373 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 7, 2023-12-09T02:38:57.373 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 7 2023-12-09T02:38:57.373 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:38:57.373 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:38:57.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.371+0000 7f5c05a8c700 1 -- 172.21.15.88:0/1754932206 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5be806ce60 msgr2=0x7f5be806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.371+0000 7f5c05a8c700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5be806ce60 0x7f5be806f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c000fd780 tx=0x7f5bf0009040 comp rx=0 tx=0).stop 2023-12-09T02:38:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.371+0000 7f5c05a8c700 1 -- 172.21.15.88:0/1754932206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c000fdf60 msgr2=0x7f5c000fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.371+0000 7f5c05a8c700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c000fdf60 0x7f5c000fbe70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400b3b0 tx=0x7f5bf4009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.371+0000 7f5c05a8c700 1 -- 172.21.15.88:0/1754932206 shutdown_connections 2023-12-09T02:38:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.371+0000 7f5c05a8c700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5be806ce60 0x7f5be806f310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.371+0000 7f5c05a8c700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c000faed0 0x7f5c000fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.371+0000 7f5c05a8c700 1 --2- 172.21.15.88:0/1754932206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c000fdf60 0x7f5c000fbe70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.371+0000 7f5c05a8c700 1 -- 172.21.15.88:0/1754932206 >> 172.21.15.88:0/1754932206 conn(0x7f5c000f6950 msgr2=0x7f5c000f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.371+0000 7f5c05a8c700 1 -- 172.21.15.88:0/1754932206 shutdown_connections 2023-12-09T02:38:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.371+0000 7f5c05a8c700 1 -- 172.21.15.88:0/1754932206 wait complete. 2023-12-09T02:38:57.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.471+0000 7f1d69b52700 1 -- 172.21.15.88:0/720855229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d640faf70 msgr2=0x7f1d640fb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:57.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.471+0000 7f1d69b52700 1 --2- 172.21.15.88:0/720855229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d640faf70 0x7f1d640fb380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1d54004940 tx=0x7f1d54009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:57.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.471+0000 7f1d69b52700 1 -- 172.21.15.88:0/720855229 shutdown_connections 2023-12-09T02:38:57.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.471+0000 7f1d69b52700 1 --2- 172.21.15.88:0/720855229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d640fb950 0x7f1d640fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.471+0000 7f1d69b52700 1 --2- 172.21.15.88:0/720855229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d640faf70 0x7f1d640fb380 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.471+0000 7f1d69b52700 1 -- 172.21.15.88:0/720855229 >> 172.21.15.88:0/720855229 conn(0x7f1d640f6950 msgr2=0x7f1d640f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:57.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.471+0000 7f1d69b52700 1 -- 172.21.15.88:0/720855229 shutdown_connections 2023-12-09T02:38:57.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.471+0000 7f1d69b52700 1 -- 172.21.15.88:0/720855229 wait complete. 2023-12-09T02:38:57.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.471+0000 7f1d69b52700 1 Processor -- start 2023-12-09T02:38:57.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d69b52700 1 -- start start 2023-12-09T02:38:57.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d69b52700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d640faf70 0x7f1d6410d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:57.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d69b52700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d6410dd50 0x7f1d6410ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:57.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d69b52700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6410e210 con 0x7f1d6410dd50 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d69b52700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6410e350 con 0x7f1d640faf70 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d62ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d6410dd50 0x7f1d6410ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d62ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d6410dd50 0x7f1d6410ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41024/0 (socket says 172.21.15.88:41024) 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d62ffd700 1 -- 172.21.15.88:0/66330460 learned_addr learned my addr 172.21.15.88:0/66330460 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d637fe700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d640faf70 0x7f1d6410d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d62ffd700 1 -- 172.21.15.88:0/66330460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d640faf70 msgr2=0x7f1d6410d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d62ffd700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d640faf70 0x7f1d6410d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d62ffd700 1 -- 172.21.15.88:0/66330460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d54005040 con 0x7f1d6410dd50 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d637fe700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d640faf70 0x7f1d6410d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d62ffd700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d6410dd50 0x7f1d6410ebf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00c830 tx=0x7f1d4c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d5bfff700 1 -- 172.21.15.88:0/66330460 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d4c00a760 con 0x7f1d6410dd50 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d69b52700 1 -- 172.21.15.88:0/66330460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6410f250 con 0x7f1d6410dd50 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d5bfff700 1 -- 172.21.15.88:0/66330460 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d4c00ad70 con 0x7f1d6410dd50 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.472+0000 7f1d5bfff700 1 -- 172.21.15.88:0/66330460 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d4c0113a0 con 0x7f1d6410dd50 2023-12-09T02:38:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.473+0000 7f1d69b52700 1 -- 172.21.15.88:0/66330460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6410f760 con 0x7f1d6410dd50 2023-12-09T02:38:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.473+0000 7f1d69b52700 1 -- 172.21.15.88:0/66330460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6410f9e0 con 0x7f1d6410dd50 2023-12-09T02:38:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.474+0000 7f1d5bfff700 1 -- 172.21.15.88:0/66330460 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f1d4c012400 con 0x7f1d6410dd50 2023-12-09T02:38:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.474+0000 7f1d5bfff700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1d5006ce60 0x7f1d5006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.474+0000 7f1d5bfff700 1 -- 172.21.15.88:0/66330460 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f1d4c08c4c0 con 0x7f1d6410dd50 2023-12-09T02:38:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.474+0000 7f1d637fe700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1d5006ce60 0x7f1d5006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:57.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.475+0000 7f1d637fe700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1d5006ce60 0x7f1d5006f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1d54004560 tx=0x7f1d54009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:57.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.479+0000 7f1d5bfff700 1 -- 172.21.15.88:0/66330460 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1d4c059d00 con 0x7f1d6410dd50 2023-12-09T02:38:57.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.711+0000 7f1d69b52700 1 -- 172.21.15.88:0/66330460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1d6404bb80 con 0x7f1d6410dd50 2023-12-09T02:38:57.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.712+0000 7f1d5bfff700 1 -- 172.21.15.88:0/66330460 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f1d4c059890 con 0x7f1d6410dd50 2023-12-09T02:38:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:38:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:38:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:38:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:38:57.713 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:38:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:38:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:38:57.716 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:38:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:38:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:38:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:38:57.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.714+0000 7f1d69b52700 1 -- 172.21.15.88:0/66330460 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1d5006ce60 msgr2=0x7f1d5006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:57.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.714+0000 7f1d69b52700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1d5006ce60 0x7f1d5006f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1d54004560 tx=0x7f1d54009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.714+0000 7f1d69b52700 1 -- 172.21.15.88:0/66330460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d6410dd50 msgr2=0x7f1d6410ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.714+0000 7f1d69b52700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d6410dd50 0x7f1d6410ebf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00c830 tx=0x7f1d4c004470 comp rx=0 tx=0).stop 2023-12-09T02:38:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.714+0000 7f1d69b52700 1 -- 172.21.15.88:0/66330460 shutdown_connections 2023-12-09T02:38:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.714+0000 7f1d69b52700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1d5006ce60 0x7f1d5006f310 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.714+0000 7f1d69b52700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d640faf70 0x7f1d6410d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.714+0000 7f1d69b52700 1 --2- 172.21.15.88:0/66330460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d6410dd50 0x7f1d6410ebf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.714+0000 7f1d69b52700 1 -- 172.21.15.88:0/66330460 >> 172.21.15.88:0/66330460 conn(0x7f1d640f6950 msgr2=0x7f1d641013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.714+0000 7f1d69b52700 1 -- 172.21.15.88:0/66330460 shutdown_connections 2023-12-09T02:38:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.714+0000 7f1d69b52700 1 -- 172.21.15.88:0/66330460 wait complete. 2023-12-09T02:38:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:38:57.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.817+0000 7f7ab5260700 1 -- 172.21.15.88:0/729216893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab00fbaf0 msgr2=0x7f7ab00fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:57.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.817+0000 7f7ab5260700 1 --2- 172.21.15.88:0/729216893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab00fbaf0 0x7f7ab00fbf00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a98004940 tx=0x7f7a98009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.817+0000 7f7ab5260700 1 -- 172.21.15.88:0/729216893 shutdown_connections 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.817+0000 7f7ab5260700 1 --2- 172.21.15.88:0/729216893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab00fcd00 0x7f7ab00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.817+0000 7f7ab5260700 1 --2- 172.21.15.88:0/729216893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab00fbaf0 0x7f7ab00fbf00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.817+0000 7f7ab5260700 1 -- 172.21.15.88:0/729216893 >> 172.21.15.88:0/729216893 conn(0x7f7ab00f7190 msgr2=0x7f7ab00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.817+0000 7f7ab5260700 1 -- 172.21.15.88:0/729216893 shutdown_connections 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.817+0000 7f7ab5260700 1 -- 172.21.15.88:0/729216893 wait complete. 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.817+0000 7f7ab5260700 1 Processor -- start 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.817+0000 7f7ab5260700 1 -- start start 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7ab5260700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab00fbaf0 0x7f7ab00ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7ab5260700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab00fcd00 0x7f7ab00fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7ab5260700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00fe640 con 0x7f7ab00fbaf0 2023-12-09T02:38:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7ab5260700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00fe7b0 con 0x7f7ab00fcd00 2023-12-09T02:38:57.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7aaed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab00fbaf0 0x7f7ab00ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:57.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7aaed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab00fbaf0 0x7f7ab00ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41052/0 (socket says 172.21.15.88:41052) 2023-12-09T02:38:57.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7aaed9d700 1 -- 172.21.15.88:0/2257534110 learned_addr learned my addr 172.21.15.88:0/2257534110 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:57.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7aae59c700 1 --2- 172.21.15.88:0/2257534110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab00fcd00 0x7f7ab00fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:57.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7aaed9d700 1 -- 172.21.15.88:0/2257534110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab00fcd00 msgr2=0x7f7ab00fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:57.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7aaed9d700 1 --2- 172.21.15.88:0/2257534110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab00fcd00 0x7f7ab00fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:57.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7aaed9d700 1 -- 172.21.15.88:0/2257534110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98005040 con 0x7f7ab00fbaf0 2023-12-09T02:38:57.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7aaed9d700 1 --2- 172.21.15.88:0/2257534110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab00fbaf0 0x7f7ab00ffbc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800b3b0 tx=0x7f7a98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:57.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7aa77fe700 1 -- 172.21.15.88:0/2257534110 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a9800e040 con 0x7f7ab00fbaf0 2023-12-09T02:38:57.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7ab5260700 1 -- 172.21.15.88:0/2257534110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab00fea30 con 0x7f7ab00fbaf0 2023-12-09T02:38:57.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7aa77fe700 1 -- 172.21.15.88:0/2257534110 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a98009af0 con 0x7f7ab00fbaf0 2023-12-09T02:38:57.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7aa77fe700 1 -- 172.21.15.88:0/2257534110 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a9801c630 con 0x7f7ab00fbaf0 2023-12-09T02:38:57.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.818+0000 7f7ab5260700 1 -- 172.21.15.88:0/2257534110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab01155c0 con 0x7f7ab00fbaf0 2023-12-09T02:38:57.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.819+0000 7f7ab5260700 1 -- 172.21.15.88:0/2257534110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab004bb80 con 0x7f7ab00fbaf0 2023-12-09T02:38:57.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.820+0000 7f7aa77fe700 1 -- 172.21.15.88:0/2257534110 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7a9800bcd0 con 0x7f7ab00fbaf0 2023-12-09T02:38:57.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.820+0000 7f7aa77fe700 1 --2- 172.21.15.88:0/2257534110 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a9c06ce60 0x7f7a9c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:57.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.820+0000 7f7aa77fe700 1 -- 172.21.15.88:0/2257534110 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f7a9808d890 con 0x7f7ab00fbaf0 2023-12-09T02:38:57.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.820+0000 7f7aae59c700 1 --2- 172.21.15.88:0/2257534110 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a9c06ce60 0x7f7a9c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:57.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.821+0000 7f7aae59c700 1 --2- 172.21.15.88:0/2257534110 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a9c06ce60 0x7f7a9c06f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0007fd0 tx=0x7f7aa0009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:57.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:57.825+0000 7f7aa77fe700 1 -- 172.21.15.88:0/2257534110 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7a9805b180 con 0x7f7ab00fbaf0 2023-12-09T02:38:57.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:57 smithi161 ceph-mon[178840]: pgmap v111: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s, 94 objects/s recovering 2023-12-09T02:38:57.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:57 smithi161 ceph-mon[178840]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:57.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:57 smithi161 ceph-mon[178840]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:57.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:57 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1754932206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:57.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:57 smithi088 ceph-mon[193406]: pgmap v111: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s, 94 objects/s recovering 2023-12-09T02:38:57.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:57 smithi088 ceph-mon[193406]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:57.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:57 smithi088 ceph-mon[193406]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:57.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:57 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1754932206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:38:58.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.033+0000 7f7ab5260700 1 -- 172.21.15.88:0/2257534110 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ab0065a80 con 0x7f7a9c06ce60 2023-12-09T02:38:58.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.034+0000 7f7aa77fe700 1 -- 172.21.15.88:0/2257534110 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7ab0065a80 con 0x7f7a9c06ce60 2023-12-09T02:38:58.035 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:38:58.035 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:38:58.036 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:38:58.036 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:38:58.036 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2023-12-09T02:38:58.036 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2023-12-09T02:38:58.036 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2023-12-09T02:38:58.036 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2023-12-09T02:38:58.036 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-12-09T02:38:58.036 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "9/21 daemons upgraded", 2023-12-09T02:38:58.036 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2023-12-09T02:38:58.036 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:38:58.036 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:38:58.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.036+0000 7f7ab5260700 1 -- 172.21.15.88:0/2257534110 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a9c06ce60 msgr2=0x7f7a9c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:58.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.036+0000 7f7ab5260700 1 --2- 172.21.15.88:0/2257534110 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a9c06ce60 0x7f7a9c06f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0007fd0 tx=0x7f7aa0009040 comp rx=0 tx=0).stop 2023-12-09T02:38:58.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.036+0000 7f7ab5260700 1 -- 172.21.15.88:0/2257534110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab00fbaf0 msgr2=0x7f7ab00ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:58.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.036+0000 7f7ab5260700 1 --2- 172.21.15.88:0/2257534110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab00fbaf0 0x7f7ab00ffbc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800b3b0 tx=0x7f7a98009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:58.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.036+0000 7f7ab5260700 1 -- 172.21.15.88:0/2257534110 shutdown_connections 2023-12-09T02:38:58.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.036+0000 7f7ab5260700 1 --2- 172.21.15.88:0/2257534110 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a9c06ce60 0x7f7a9c06f310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:58.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.036+0000 7f7ab5260700 1 --2- 172.21.15.88:0/2257534110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab00fbaf0 0x7f7ab00ffbc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:58.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.036+0000 7f7ab5260700 1 --2- 172.21.15.88:0/2257534110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab00fcd00 0x7f7ab00fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:58.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.036+0000 7f7ab5260700 1 -- 172.21.15.88:0/2257534110 >> 172.21.15.88:0/2257534110 conn(0x7f7ab00f7190 msgr2=0x7f7ab0065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:58.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.036+0000 7f7ab5260700 1 -- 172.21.15.88:0/2257534110 shutdown_connections 2023-12-09T02:38:58.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.036+0000 7f7ab5260700 1 -- 172.21.15.88:0/2257534110 wait complete. 2023-12-09T02:38:58.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.136+0000 7f1306cad700 1 -- 172.21.15.88:0/1416728324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13000fcbf0 msgr2=0x7f13000fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:58.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.136+0000 7f1306cad700 1 --2- 172.21.15.88:0/1416728324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13000fcbf0 0x7f13000fd000 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f12f4004940 tx=0x7f12f4009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:58.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.136+0000 7f1306cad700 1 -- 172.21.15.88:0/1416728324 shutdown_connections 2023-12-09T02:38:58.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.136+0000 7f1306cad700 1 --2- 172.21.15.88:0/1416728324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13000fde00 0x7f13000fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:58.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.136+0000 7f1306cad700 1 --2- 172.21.15.88:0/1416728324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13000fcbf0 0x7f13000fd000 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:58.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.136+0000 7f1306cad700 1 -- 172.21.15.88:0/1416728324 >> 172.21.15.88:0/1416728324 conn(0x7f13000f82d0 msgr2=0x7f13000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:58.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.136+0000 7f1306cad700 1 -- 172.21.15.88:0/1416728324 shutdown_connections 2023-12-09T02:38:58.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.136+0000 7f1306cad700 1 -- 172.21.15.88:0/1416728324 wait complete. 2023-12-09T02:38:58.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.136+0000 7f1306cad700 1 Processor -- start 2023-12-09T02:38:58.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.136+0000 7f1306cad700 1 -- start start 2023-12-09T02:38:58.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f1306cad700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13000fcbf0 0x7f1300071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:58.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f1306cad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13000fde00 0x7f130006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f1306cad700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1300070590 con 0x7f13000fde00 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f1306cad700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1300070700 con 0x7f13000fcbf0 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f12fffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13000fde00 0x7f130006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f12fffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13000fde00 0x7f130006ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41066/0 (socket says 172.21.15.88:41066) 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f12fffff700 1 -- 172.21.15.88:0/4167885262 learned_addr learned my addr 172.21.15.88:0/4167885262 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f1304a49700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13000fcbf0 0x7f1300071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f12fffff700 1 -- 172.21.15.88:0/4167885262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13000fcbf0 msgr2=0x7f1300071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f12fffff700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13000fcbf0 0x7f1300071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f12fffff700 1 -- 172.21.15.88:0/4167885262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4005040 con 0x7f13000fde00 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f1304a49700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13000fcbf0 0x7f1300071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f12fffff700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13000fde00 0x7f130006ff90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f12ec002a50 tx=0x7f12ec0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f12fd7fa700 1 -- 172.21.15.88:0/4167885262 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12ec007cc0 con 0x7f13000fde00 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f12fd7fa700 1 -- 172.21.15.88:0/4167885262 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f12ec00f040 con 0x7f13000fde00 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f1306cad700 1 -- 172.21.15.88:0/4167885262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13000709e0 con 0x7f13000fde00 2023-12-09T02:38:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f12fd7fa700 1 -- 172.21.15.88:0/4167885262 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12ec009540 con 0x7f13000fde00 2023-12-09T02:38:58.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.137+0000 7f1306cad700 1 -- 172.21.15.88:0/4167885262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1300115590 con 0x7f13000fde00 2023-12-09T02:38:58.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.138+0000 7f1306cad700 1 -- 172.21.15.88:0/4167885262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13001075d0 con 0x7f13000fde00 2023-12-09T02:38:58.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.139+0000 7f12fd7fa700 1 -- 172.21.15.88:0/4167885262 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f12ec0096a0 con 0x7f13000fde00 2023-12-09T02:38:58.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.139+0000 7f12fd7fa700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f12f006ce60 0x7f12f006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:38:58.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.140+0000 7f12fd7fa700 1 -- 172.21.15.88:0/4167885262 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f12ec08c990 con 0x7f13000fde00 2023-12-09T02:38:58.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.140+0000 7f1304a49700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f12f006ce60 0x7f12f006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:38:58.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.140+0000 7f1304a49700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f12f006ce60 0x7f12f006f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12f4004890 tx=0x7f12f4009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:38:58.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.143+0000 7f12fd7fa700 1 -- 172.21.15.88:0/4167885262 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f12ec05a150 con 0x7f13000fde00 2023-12-09T02:38:58.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.408+0000 7f1306cad700 1 -- 172.21.15.88:0/4167885262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f130004bb80 con 0x7f13000fde00 2023-12-09T02:38:58.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.408+0000 7f12fd7fa700 1 -- 172.21.15.88:0/4167885262 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f12ec059ce0 con 0x7f13000fde00 2023-12-09T02:38:58.410 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:38:58.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.410+0000 7f1306cad700 1 -- 172.21.15.88:0/4167885262 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f12f006ce60 msgr2=0x7f12f006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:58.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.410+0000 7f1306cad700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f12f006ce60 0x7f12f006f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12f4004890 tx=0x7f12f4009e30 comp rx=0 tx=0).stop 2023-12-09T02:38:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.410+0000 7f1306cad700 1 -- 172.21.15.88:0/4167885262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13000fde00 msgr2=0x7f130006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:38:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.410+0000 7f1306cad700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13000fde00 0x7f130006ff90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f12ec002a50 tx=0x7f12ec0046b0 comp rx=0 tx=0).stop 2023-12-09T02:38:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.410+0000 7f1306cad700 1 -- 172.21.15.88:0/4167885262 shutdown_connections 2023-12-09T02:38:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.410+0000 7f1306cad700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f12f006ce60 0x7f12f006f310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.410+0000 7f1306cad700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13000fcbf0 0x7f1300071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.410+0000 7f1306cad700 1 --2- 172.21.15.88:0/4167885262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13000fde00 0x7f130006ff90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:38:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.410+0000 7f1306cad700 1 -- 172.21.15.88:0/4167885262 >> 172.21.15.88:0/4167885262 conn(0x7f13000f82d0 msgr2=0x7f13000fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:38:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.410+0000 7f1306cad700 1 -- 172.21.15.88:0/4167885262 shutdown_connections 2023-12-09T02:38:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:38:58.410+0000 7f1306cad700 1 -- 172.21.15.88:0/4167885262 wait complete. 2023-12-09T02:38:58.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:58 smithi161 ceph-mon[178840]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:58.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:58 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/66330460' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:38:58.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:58 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/4167885262' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:38:58.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:58 smithi088 ceph-mon[193406]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:58.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:58 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/66330460' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:38:58.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:58 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/4167885262' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:38:59.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:59 smithi161 ceph-mon[178840]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:59.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:38:59 smithi161 ceph-mon[178840]: pgmap v112: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 924 KiB/s, 83 objects/s recovering 2023-12-09T02:38:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:59 smithi088 ceph-mon[193406]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:38:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:38:59 smithi088 ceph-mon[193406]: pgmap v112: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 924 KiB/s, 83 objects/s recovering 2023-12-09T02:39:00.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:00 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-09T02:39:00.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:00 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-09T02:39:01.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:01 smithi161 ceph-mon[178840]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-09T02:39:01.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:01 smithi161 ceph-mon[178840]: Upgrade: osd.3 is safe to restart 2023-12-09T02:39:01.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:01 smithi161 ceph-mon[178840]: pgmap v113: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s, 78 objects/s recovering 2023-12-09T02:39:01.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:01.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-09T02:39:01.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:39:01.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:01 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:01.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:01 smithi088 ceph-mon[193406]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-09T02:39:01.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:01 smithi088 ceph-mon[193406]: Upgrade: osd.3 is safe to restart 2023-12-09T02:39:01.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:01 smithi088 ceph-mon[193406]: pgmap v113: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s, 78 objects/s recovering 2023-12-09T02:39:01.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:01.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-09T02:39:01.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:39:01.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:01 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:02.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:02 smithi161 ceph-mon[178840]: Upgrade: Updating osd.3 2023-12-09T02:39:02.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:02 smithi161 ceph-mon[178840]: Deploying daemon osd.3 on smithi161 2023-12-09T02:39:02.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:02 smithi088 ceph-mon[193406]: Upgrade: Updating osd.3 2023-12-09T02:39:02.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:02 smithi088 ceph-mon[193406]: Deploying daemon osd.3 on smithi161 2023-12-09T02:39:03.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:03 smithi161 ceph-mon[178840]: pgmap v114: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s, 65 objects/s recovering 2023-12-09T02:39:03.920 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:03 smithi161 systemd[1]: Stopping Ceph osd.3 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:39:03.920 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:03 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[127528]: 2023-12-09T02:39:03.850+0000 7f7ce2c24700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:39:03.920 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:03 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[127528]: 2023-12-09T02:39:03.850+0000 7f7ce2c24700 -1 osd.3 88 *** Got signal Terminated *** 2023-12-09T02:39:03.920 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:03 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[127528]: 2023-12-09T02:39:03.850+0000 7f7ce2c24700 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:39:03.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:03 smithi088 ceph-mon[193406]: pgmap v114: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s, 65 objects/s recovering 2023-12-09T02:39:04.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:04 smithi161 ceph-mon[178840]: osd.3 marked itself down and dead 2023-12-09T02:39:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:04 smithi088 ceph-mon[193406]: osd.3 marked itself down and dead 2023-12-09T02:39:05.419 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:05 smithi161 bash[189812]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3 2023-12-09T02:39:05.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:05 smithi161 ceph-mon[178840]: pgmap v115: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:05.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:05 smithi161 ceph-mon[178840]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:39:05.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:05 smithi161 ceph-mon[178840]: osdmap e89: 6 total, 5 up, 6 in 2023-12-09T02:39:05.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:05 smithi161 ceph-mon[178840]: failed to encode map e89 with expected crc 2023-12-09T02:39:05.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:05 smithi161 ceph-mon[178840]: failed to encode map e89 with expected crc 2023-12-09T02:39:05.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:05 smithi161 ceph-mon[178840]: failed to encode map e89 with expected crc 2023-12-09T02:39:05.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:05 smithi161 ceph-mon[178840]: failed to encode map e89 with expected crc 2023-12-09T02:39:05.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:05 smithi161 ceph-mon[178840]: failed to encode map e89 with expected crc 2023-12-09T02:39:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:05 smithi088 ceph-mon[193406]: pgmap v115: 65 pgs: 65 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:05 smithi088 ceph-mon[193406]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:39:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:05 smithi088 ceph-mon[193406]: osdmap e89: 6 total, 5 up, 6 in 2023-12-09T02:39:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:05 smithi088 ceph-mon[193406]: failed to encode map e89 with expected crc 2023-12-09T02:39:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:05 smithi088 ceph-mon[193406]: failed to encode map e89 with expected crc 2023-12-09T02:39:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:05 smithi088 ceph-mon[193406]: failed to encode map e89 with expected crc 2023-12-09T02:39:05.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:05 smithi088 ceph-mon[193406]: failed to encode map e89 with expected crc 2023-12-09T02:39:05.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:05 smithi088 ceph-mon[193406]: failed to encode map e89 with expected crc 2023-12-09T02:39:06.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:06 smithi161 ceph-mon[178840]: failed to encode map e90 with expected crc 2023-12-09T02:39:06.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:06 smithi161 ceph-mon[178840]: osdmap e90: 6 total, 5 up, 6 in 2023-12-09T02:39:06.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:06 smithi161 ceph-mon[178840]: failed to encode map e90 with expected crc 2023-12-09T02:39:06.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:06 smithi161 ceph-mon[178840]: failed to encode map e90 with expected crc 2023-12-09T02:39:06.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:06 smithi161 ceph-mon[178840]: failed to encode map e90 with expected crc 2023-12-09T02:39:06.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:06.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:39:06.671 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:06 smithi161 systemd[1]: ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.3.service: Succeeded. 2023-12-09T02:39:06.671 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:06 smithi161 systemd[1]: Stopped Ceph osd.3 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:39:06.671 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:06 smithi161 systemd[1]: Starting Ceph osd.3 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:39:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:06 smithi088 ceph-mon[193406]: failed to encode map e90 with expected crc 2023-12-09T02:39:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:06 smithi088 ceph-mon[193406]: osdmap e90: 6 total, 5 up, 6 in 2023-12-09T02:39:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:06 smithi088 ceph-mon[193406]: failed to encode map e90 with expected crc 2023-12-09T02:39:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:06 smithi088 ceph-mon[193406]: failed to encode map e90 with expected crc 2023-12-09T02:39:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:06 smithi088 ceph-mon[193406]: failed to encode map e90 with expected crc 2023-12-09T02:39:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:06.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:39:07.549 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:07 smithi161 bash[190080]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-09T02:39:07.550 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:07 smithi161 bash[190080]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-09T02:39:07.550 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:07 smithi161 bash[190080]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-09T02:39:07.550 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:07 smithi161 bash[190080]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-09T02:39:07.550 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:07 smithi161 bash[190080]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-09T02:39:07.550 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:07 smithi161 bash[190080]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-09T02:39:07.550 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:07 smithi161 bash[190080]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-09T02:39:07.884 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:07 smithi161 ceph-mon[178840]: pgmap v118: 65 pgs: 15 stale+active+clean, 50 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:07.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:07 smithi088 ceph-mon[193406]: pgmap v118: 65 pgs: 15 stale+active+clean, 50 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:08.420 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:07 smithi161 ceph-osd[190371]: -- 172.21.15.161:0/2288732600 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e45d4fb1e0 con 0x55e45d4cac00 2023-12-09T02:39:08.420 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:07 smithi161 bash[190333]: 6cd16a89f8747b09a932bd5eea35f3ea7331ea9530a0314e35e94ce8ac6f818f 2023-12-09T02:39:08.420 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:07 smithi161 systemd[1]: Started Ceph osd.3 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:39:08.920 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:08 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[190348]: 2023-12-09T02:39:08.459+0000 7f44fc342640 -1 Falling back to public interface 2023-12-09T02:39:09.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:09 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:09.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:09 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:09.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:09 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:39:09.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:09 smithi161 ceph-mon[178840]: pgmap v119: 65 pgs: 9 active+undersized, 6 active+undersized+degraded, 6 stale+active+clean, 44 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2023-12-09T02:39:09.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:09 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:09.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:09 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:09.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:09 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:39:09.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:09 smithi088 ceph-mon[193406]: pgmap v119: 65 pgs: 9 active+undersized, 6 active+undersized+degraded, 6 stale+active+clean, 44 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2023-12-09T02:39:10.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:10 smithi161 ceph-mon[178840]: Health check failed: Degraded data redundancy: 23/222 objects degraded (10.360%), 6 pgs degraded (PG_DEGRADED) 2023-12-09T02:39:10.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:10 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:10.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:10 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:10.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:10 smithi088 ceph-mon[193406]: Health check failed: Degraded data redundancy: 23/222 objects degraded (10.360%), 6 pgs degraded (PG_DEGRADED) 2023-12-09T02:39:10.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:10 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:10.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:10 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:11.846 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:11 smithi161 ceph-mon[178840]: pgmap v120: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2023-12-09T02:39:11.846 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:11.847 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:11 smithi088 ceph-mon[193406]: pgmap v120: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2023-12-09T02:39:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:13.420 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[190348]: 2023-12-09T02:39:13.059+0000 7f44fc342640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-09T02:39:13.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: pgmap v121: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2023-12-09T02:39:13.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:13.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:13.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:39:13.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:39:13.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:13.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:39:13.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:13.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:13.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:13.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-09T02:39:13.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='osd.3 [v2:172.21.15.161:6800/231164100,v1:172.21.15.161:6801/231164100]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-09T02:39:13.727 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:13 smithi088 ceph-mon[193406]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-09T02:39:13.920 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[190348]: 2023-12-09T02:39:13.595+0000 7f44fc342640 -1 osd.3 88 log_to_monitors true 2023-12-09T02:39:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: pgmap v121: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2023-12-09T02:39:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:39:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:39:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:13.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:39:13.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:13.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:13.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:13.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-09T02:39:13.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='osd.3 [v2:172.21.15.161:6800/231164100,v1:172.21.15.161:6801/231164100]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-09T02:39:13.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:13 smithi161 ceph-mon[178840]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-09T02:39:14.920 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:39:14 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[190348]: 2023-12-09T02:39:14.492+0000 7f44ecfb2700 -1 osd.3 88 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:39:14.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:14 smithi161 ceph-mon[178840]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-09T02:39:14.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:14 smithi161 ceph-mon[178840]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2023-12-09T02:39:14.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:14 smithi161 ceph-mon[178840]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-09T02:39:14.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:14 smithi161 ceph-mon[178840]: osdmap e91: 6 total, 5 up, 6 in 2023-12-09T02:39:14.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:14 smithi161 ceph-mon[178840]: from='osd.3 [v2:172.21.15.161:6800/231164100,v1:172.21.15.161:6801/231164100]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:39:14.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:14 smithi161 ceph-mon[178840]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:39:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:14 smithi088 ceph-mon[193406]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-09T02:39:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:14 smithi088 ceph-mon[193406]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2023-12-09T02:39:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:14 smithi088 ceph-mon[193406]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-09T02:39:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:14 smithi088 ceph-mon[193406]: osdmap e91: 6 total, 5 up, 6 in 2023-12-09T02:39:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:14 smithi088 ceph-mon[193406]: from='osd.3 [v2:172.21.15.161:6800/231164100,v1:172.21.15.161:6801/231164100]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:39:14.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:14 smithi088 ceph-mon[193406]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:39:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:15 smithi161 ceph-mon[178840]: pgmap v122: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2023-12-09T02:39:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:15 smithi161 ceph-mon[178840]: failed to encode map e91 with expected crc 2023-12-09T02:39:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:15 smithi161 ceph-mon[178840]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:39:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:15 smithi161 ceph-mon[178840]: osd.3 [v2:172.21.15.161:6800/231164100,v1:172.21.15.161:6801/231164100] boot 2023-12-09T02:39:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:15 smithi161 ceph-mon[178840]: osdmap e92: 6 total, 6 up, 6 in 2023-12-09T02:39:15.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:15 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:39:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:15 smithi088 ceph-mon[193406]: pgmap v122: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2023-12-09T02:39:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:15 smithi088 ceph-mon[193406]: failed to encode map e91 with expected crc 2023-12-09T02:39:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:15 smithi088 ceph-mon[193406]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:39:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:15 smithi088 ceph-mon[193406]: osd.3 [v2:172.21.15.161:6800/231164100,v1:172.21.15.161:6801/231164100] boot 2023-12-09T02:39:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:15 smithi088 ceph-mon[193406]: osdmap e92: 6 total, 6 up, 6 in 2023-12-09T02:39:15.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:15 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-09T02:39:16.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:16 smithi161 ceph-mon[178840]: failed to encode map e92 with expected crc 2023-12-09T02:39:16.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:16 smithi161 ceph-mon[178840]: failed to encode map e91 with expected crc 2023-12-09T02:39:16.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:16 smithi161 ceph-mon[178840]: osdmap e93: 6 total, 6 up, 6 in 2023-12-09T02:39:16.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:16 smithi088 ceph-mon[193406]: failed to encode map e92 with expected crc 2023-12-09T02:39:16.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:16 smithi088 ceph-mon[193406]: failed to encode map e91 with expected crc 2023-12-09T02:39:16.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:16 smithi088 ceph-mon[193406]: osdmap e93: 6 total, 6 up, 6 in 2023-12-09T02:39:17.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:17 smithi161 ceph-mon[178840]: pgmap v125: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2023-12-09T02:39:17.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:17 smithi161 ceph-mon[178840]: failed to encode map e93 with expected crc 2023-12-09T02:39:17.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:17 smithi161 ceph-mon[178840]: failed to encode map e93 with expected crc 2023-12-09T02:39:17.921 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:17 smithi161 ceph-mon[178840]: failed to encode map e93 with expected crc 2023-12-09T02:39:17.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:17 smithi088 ceph-mon[193406]: pgmap v125: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2023-12-09T02:39:17.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:17 smithi088 ceph-mon[193406]: failed to encode map e93 with expected crc 2023-12-09T02:39:17.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:17 smithi088 ceph-mon[193406]: failed to encode map e93 with expected crc 2023-12-09T02:39:17.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:17 smithi088 ceph-mon[193406]: failed to encode map e93 with expected crc 2023-12-09T02:39:18.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:18 smithi161 ceph-mon[178840]: Health check update: Degraded data redundancy: 45/222 objects degraded (20.270%), 15 pgs degraded (PG_DEGRADED) 2023-12-09T02:39:18.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:18 smithi088 ceph-mon[193406]: Health check update: Degraded data redundancy: 45/222 objects degraded (20.270%), 15 pgs degraded (PG_DEGRADED) 2023-12-09T02:39:19.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:19 smithi161 ceph-mon[178840]: pgmap v127: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:39:19.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:19 smithi088 ceph-mon[193406]: pgmap v127: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:39:20.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:20 smithi088 ceph-mon[193406]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/222 objects degraded (17.117%), 13 pgs degraded) 2023-12-09T02:39:20.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:20 smithi088 ceph-mon[193406]: Cluster is now healthy 2023-12-09T02:39:21.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:20 smithi161 ceph-mon[178840]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/222 objects degraded (17.117%), 13 pgs degraded) 2023-12-09T02:39:21.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:20 smithi161 ceph-mon[178840]: Cluster is now healthy 2023-12-09T02:39:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:21 smithi088 ceph-mon[193406]: pgmap v128: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:21 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:21 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:39:22.169 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:21 smithi161 ceph-mon[178840]: pgmap v128: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:22.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:21 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:22.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:21 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:39:23.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:23 smithi088 ceph-mon[193406]: pgmap v129: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:24.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:23 smithi161 ceph-mon[178840]: pgmap v129: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:25.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:25 smithi088 ceph-mon[193406]: pgmap v130: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:26.169 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:25 smithi161 ceph-mon[178840]: pgmap v130: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:27.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:27 smithi088 ceph-mon[193406]: pgmap v131: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:27.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:27 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:27.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:27 smithi161 ceph-mon[178840]: pgmap v131: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:27.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:27 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:28.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.526+0000 7fcc2547e700 1 -- 172.21.15.88:0/2902678412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc200ffdb0 msgr2=0x7fcc201021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.526+0000 7fcc2547e700 1 --2- 172.21.15.88:0/2902678412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc200ffdb0 0x7fcc201021d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc10004940 tx=0x7fcc10009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.527+0000 7fcc2547e700 1 -- 172.21.15.88:0/2902678412 shutdown_connections 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.527+0000 7fcc2547e700 1 --2- 172.21.15.88:0/2902678412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc200ffdb0 0x7fcc201021d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.527+0000 7fcc2547e700 1 --2- 172.21.15.88:0/2902678412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc200668e0 0x7fcc200ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.527+0000 7fcc2547e700 1 -- 172.21.15.88:0/2902678412 >> 172.21.15.88:0/2902678412 conn(0x7fcc200f71d0 msgr2=0x7fcc200f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.527+0000 7fcc2547e700 1 -- 172.21.15.88:0/2902678412 shutdown_connections 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.527+0000 7fcc2547e700 1 -- 172.21.15.88:0/2902678412 wait complete. 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.527+0000 7fcc2547e700 1 Processor -- start 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.527+0000 7fcc2547e700 1 -- start start 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc2547e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc200668e0 0x7fcc2010d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc2547e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc200ffdb0 0x7fcc2010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc2547e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2010e000 con 0x7fcc200668e0 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc2547e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2010e8a0 con 0x7fcc200ffdb0 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc1effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc200668e0 0x7fcc2010d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc1effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc200668e0 0x7fcc2010d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35512/0 (socket says 172.21.15.88:35512) 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc1effd700 1 -- 172.21.15.88:0/3137498177 learned_addr learned my addr 172.21.15.88:0/3137498177 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc1e7fc700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc200ffdb0 0x7fcc2010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc1effd700 1 -- 172.21.15.88:0/3137498177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc200ffdb0 msgr2=0x7fcc2010da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc1effd700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc200ffdb0 0x7fcc2010da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc1effd700 1 -- 172.21.15.88:0/3137498177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10005040 con 0x7fcc200668e0 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc1e7fc700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc200ffdb0 0x7fcc2010da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc1effd700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc200668e0 0x7fcc2010d4c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcc14002a80 tx=0x7fcc140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc077fe700 1 -- 172.21.15.88:0/3137498177 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc14007cc0 con 0x7fcc200668e0 2023-12-09T02:39:28.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc2547e700 1 -- 172.21.15.88:0/3137498177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2010eb80 con 0x7fcc200668e0 2023-12-09T02:39:28.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc077fe700 1 -- 172.21.15.88:0/3137498177 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc1400f040 con 0x7fcc200668e0 2023-12-09T02:39:28.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc077fe700 1 -- 172.21.15.88:0/3137498177 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc14009640 con 0x7fcc200668e0 2023-12-09T02:39:28.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.528+0000 7fcc2547e700 1 -- 172.21.15.88:0/3137498177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2010f0c0 con 0x7fcc200668e0 2023-12-09T02:39:28.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.529+0000 7fcc2547e700 1 -- 172.21.15.88:0/3137498177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2004bb80 con 0x7fcc200668e0 2023-12-09T02:39:28.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.530+0000 7fcc077fe700 1 -- 172.21.15.88:0/3137498177 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fcc140097a0 con 0x7fcc200668e0 2023-12-09T02:39:28.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.530+0000 7fcc077fe700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcc0806ce60 0x7fcc0806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:28.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.530+0000 7fcc077fe700 1 -- 172.21.15.88:0/3137498177 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6848+0+0 (secure 0 0 0) 0x7fcc1408bce0 con 0x7fcc200668e0 2023-12-09T02:39:28.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.530+0000 7fcc1e7fc700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcc0806ce60 0x7fcc0806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:28.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.531+0000 7fcc1e7fc700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcc0806ce60 0x7fcc0806f310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000b3b0 tx=0x7fcc10009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:28.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.535+0000 7fcc077fe700 1 -- 172.21.15.88:0/3137498177 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcc14059420 con 0x7fcc200668e0 2023-12-09T02:39:28.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:28 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-09T02:39:28.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.745+0000 7fcc2547e700 1 -- 172.21.15.88:0/3137498177 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc20100a10 con 0x7fcc0806ce60 2023-12-09T02:39:28.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.746+0000 7fcc077fe700 1 -- 172.21.15.88:0/3137498177 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fcc20100a10 con 0x7fcc0806ce60 2023-12-09T02:39:28.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.748+0000 7fcc2547e700 1 -- 172.21.15.88:0/3137498177 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcc0806ce60 msgr2=0x7fcc0806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:28.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.748+0000 7fcc2547e700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcc0806ce60 0x7fcc0806f310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000b3b0 tx=0x7fcc10009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:28.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.748+0000 7fcc2547e700 1 -- 172.21.15.88:0/3137498177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc200668e0 msgr2=0x7fcc2010d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:28.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.748+0000 7fcc2547e700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc200668e0 0x7fcc2010d4c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcc14002a80 tx=0x7fcc140046b0 comp rx=0 tx=0).stop 2023-12-09T02:39:28.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.748+0000 7fcc2547e700 1 -- 172.21.15.88:0/3137498177 shutdown_connections 2023-12-09T02:39:28.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.748+0000 7fcc2547e700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fcc0806ce60 0x7fcc0806f310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:28.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.748+0000 7fcc2547e700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc200668e0 0x7fcc2010d4c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:28.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.748+0000 7fcc2547e700 1 --2- 172.21.15.88:0/3137498177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc200ffdb0 0x7fcc2010da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:28.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.748+0000 7fcc2547e700 1 -- 172.21.15.88:0/3137498177 >> 172.21.15.88:0/3137498177 conn(0x7fcc200f71d0 msgr2=0x7fcc200f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:28.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.749+0000 7fcc2547e700 1 -- 172.21.15.88:0/3137498177 shutdown_connections 2023-12-09T02:39:28.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.749+0000 7fcc2547e700 1 -- 172.21.15.88:0/3137498177 wait complete. 2023-12-09T02:39:28.761 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:39:28.816 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:28 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-09T02:39:28.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.850+0000 7f52638ff700 1 -- 172.21.15.88:0/2152150976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0feb80 msgr2=0x7f525c0facc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:28.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.850+0000 7f52638ff700 1 --2- 172.21.15.88:0/2152150976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0feb80 0x7f525c0facc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f524c004940 tx=0x7f524c009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:28.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.850+0000 7f52638ff700 1 -- 172.21.15.88:0/2152150976 shutdown_connections 2023-12-09T02:39:28.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.850+0000 7f52638ff700 1 --2- 172.21.15.88:0/2152150976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0feb80 0x7f525c0facc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:28.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f52638ff700 1 --2- 172.21.15.88:0/2152150976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f525c0fe230 0x7f525c0fe640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:28.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f52638ff700 1 -- 172.21.15.88:0/2152150976 >> 172.21.15.88:0/2152150976 conn(0x7f525c0f69d0 msgr2=0x7f525c0f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:28.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f52638ff700 1 -- 172.21.15.88:0/2152150976 shutdown_connections 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f52638ff700 1 -- 172.21.15.88:0/2152150976 wait complete. 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f52638ff700 1 Processor -- start 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f52638ff700 1 -- start start 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f52638ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0fe230 0x7f525c10d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f52638ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f525c0feb80 0x7f525c10dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f52638ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c10e2e0 con 0x7f525c0fe230 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f52638ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c10eb80 con 0x7f525c0feb80 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f526169b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0fe230 0x7f525c10d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f526169b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0fe230 0x7f525c10d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35526/0 (socket says 172.21.15.88:35526) 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f526169b700 1 -- 172.21.15.88:0/261186797 learned_addr learned my addr 172.21.15.88:0/261186797 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.851+0000 7f5260e9a700 1 --2- 172.21.15.88:0/261186797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f525c0feb80 0x7f525c10dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.852+0000 7f526169b700 1 -- 172.21.15.88:0/261186797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f525c0feb80 msgr2=0x7f525c10dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.852+0000 7f526169b700 1 --2- 172.21.15.88:0/261186797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f525c0feb80 0x7f525c10dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.852+0000 7f526169b700 1 -- 172.21.15.88:0/261186797 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c005040 con 0x7f525c0fe230 2023-12-09T02:39:28.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.852+0000 7f526169b700 1 --2- 172.21.15.88:0/261186797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0fe230 0x7f525c10d7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5258002a80 tx=0x7f52580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:28.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.852+0000 7f5251ffb700 1 -- 172.21.15.88:0/261186797 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5258007cc0 con 0x7f525c0fe230 2023-12-09T02:39:28.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.852+0000 7f5251ffb700 1 -- 172.21.15.88:0/261186797 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f525800f040 con 0x7f525c0fe230 2023-12-09T02:39:28.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.852+0000 7f52638ff700 1 -- 172.21.15.88:0/261186797 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c10ee60 con 0x7f525c0fe230 2023-12-09T02:39:28.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.852+0000 7f5251ffb700 1 -- 172.21.15.88:0/261186797 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f525800da60 con 0x7f525c0fe230 2023-12-09T02:39:28.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.852+0000 7f52638ff700 1 -- 172.21.15.88:0/261186797 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c10f3a0 con 0x7f525c0fe230 2023-12-09T02:39:28.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.853+0000 7f52638ff700 1 -- 172.21.15.88:0/261186797 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c1075e0 con 0x7f525c0fe230 2023-12-09T02:39:28.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.854+0000 7f5251ffb700 1 -- 172.21.15.88:0/261186797 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f525800dbc0 con 0x7f525c0fe230 2023-12-09T02:39:28.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.854+0000 7f5251ffb700 1 --2- 172.21.15.88:0/261186797 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524806ce60 0x7f524806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:28.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.854+0000 7f5251ffb700 1 -- 172.21.15.88:0/261186797 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f525808c0e0 con 0x7f525c0fe230 2023-12-09T02:39:28.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.854+0000 7f5260e9a700 1 --2- 172.21.15.88:0/261186797 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524806ce60 0x7f524806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:28.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.854+0000 7f5260e9a700 1 --2- 172.21.15.88:0/261186797 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524806ce60 0x7f524806f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f524c004890 tx=0x7f524c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:28.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:28.858+0000 7f5251ffb700 1 -- 172.21.15.88:0/261186797 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f52580598a0 con 0x7f525c0fe230 2023-12-09T02:39:29.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.066+0000 7f52638ff700 1 -- 172.21.15.88:0/261186797 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f525c105610 con 0x7f524806ce60 2023-12-09T02:39:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.067+0000 7f5251ffb700 1 -- 172.21.15.88:0/261186797 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f525c105610 con 0x7f524806ce60 2023-12-09T02:39:29.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.069+0000 7f52638ff700 1 -- 172.21.15.88:0/261186797 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524806ce60 msgr2=0x7f524806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.069+0000 7f52638ff700 1 --2- 172.21.15.88:0/261186797 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524806ce60 0x7f524806f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f524c004890 tx=0x7f524c009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:29.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.069+0000 7f52638ff700 1 -- 172.21.15.88:0/261186797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0fe230 msgr2=0x7f525c10d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.069+0000 7f52638ff700 1 --2- 172.21.15.88:0/261186797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0fe230 0x7f525c10d7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5258002a80 tx=0x7f52580046b0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.069+0000 7f52638ff700 1 -- 172.21.15.88:0/261186797 shutdown_connections 2023-12-09T02:39:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.069+0000 7f52638ff700 1 --2- 172.21.15.88:0/261186797 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f524806ce60 0x7f524806f310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.069+0000 7f52638ff700 1 --2- 172.21.15.88:0/261186797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f525c0fe230 0x7f525c10d7a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.069+0000 7f52638ff700 1 --2- 172.21.15.88:0/261186797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f525c0feb80 0x7f525c10dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.069+0000 7f52638ff700 1 -- 172.21.15.88:0/261186797 >> 172.21.15.88:0/261186797 conn(0x7f525c0f69d0 msgr2=0x7f525c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.069+0000 7f52638ff700 1 -- 172.21.15.88:0/261186797 shutdown_connections 2023-12-09T02:39:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.069+0000 7f52638ff700 1 -- 172.21.15.88:0/261186797 wait complete. 2023-12-09T02:39:29.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 -- 172.21.15.88:0/4053806355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34dc0ffdd0 msgr2=0x7f34dc1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 --2- 172.21.15.88:0/4053806355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34dc0ffdd0 0x7f34dc1021d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f34d8004940 tx=0x7f34d8009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:29.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 -- 172.21.15.88:0/4053806355 shutdown_connections 2023-12-09T02:39:29.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 --2- 172.21.15.88:0/4053806355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34dc0ffdd0 0x7f34dc1021d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 --2- 172.21.15.88:0/4053806355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34dc0668c0 0x7f34dc0ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 -- 172.21.15.88:0/4053806355 >> 172.21.15.88:0/4053806355 conn(0x7f34dc0f71b0 msgr2=0x7f34dc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 -- 172.21.15.88:0/4053806355 shutdown_connections 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 -- 172.21.15.88:0/4053806355 wait complete. 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 Processor -- start 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 -- start start 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34dc0668c0 0x7f34dc0fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34dc0ffdd0 0x7f34dc0fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0fbd00 con 0x7f34dc0ffdd0 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.170+0000 7f34e3cbd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0fbe70 con 0x7f34dc0668c0 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34e1258700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34dc0ffdd0 0x7f34dc0fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34e1258700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34dc0ffdd0 0x7f34dc0fb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35556/0 (socket says 172.21.15.88:35556) 2023-12-09T02:39:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34e1258700 1 -- 172.21.15.88:0/59860423 learned_addr learned my addr 172.21.15.88:0/59860423 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:39:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34e1a59700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34dc0668c0 0x7f34dc0fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34e1258700 1 -- 172.21.15.88:0/59860423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34dc0668c0 msgr2=0x7f34dc0fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34e1258700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34dc0668c0 0x7f34dc0fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34e1258700 1 -- 172.21.15.88:0/59860423 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d8005040 con 0x7f34dc0ffdd0 2023-12-09T02:39:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34e1a59700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34dc0668c0 0x7f34dc0fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:39:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34e1258700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34dc0ffdd0 0x7f34dc0fb700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f34d8004f90 tx=0x7f34d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34d27fc700 1 -- 172.21.15.88:0/59860423 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34d800e040 con 0x7f34dc0ffdd0 2023-12-09T02:39:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34d27fc700 1 -- 172.21.15.88:0/59860423 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34d800bcd0 con 0x7f34dc0ffdd0 2023-12-09T02:39:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34d27fc700 1 -- 172.21.15.88:0/59860423 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34d801c630 con 0x7f34dc0ffdd0 2023-12-09T02:39:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34e3cbd700 1 -- 172.21.15.88:0/59860423 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc0fc0f0 con 0x7f34dc0ffdd0 2023-12-09T02:39:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.171+0000 7f34e3cbd700 1 -- 172.21.15.88:0/59860423 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc115560 con 0x7f34dc0ffdd0 2023-12-09T02:39:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.172+0000 7f34e3cbd700 1 -- 172.21.15.88:0/59860423 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc1075c0 con 0x7f34dc0ffdd0 2023-12-09T02:39:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.173+0000 7f34d27fc700 1 -- 172.21.15.88:0/59860423 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f34d8013960 con 0x7f34dc0ffdd0 2023-12-09T02:39:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.173+0000 7f34d27fc700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f34c806ce60 0x7f34c806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.173+0000 7f34d27fc700 1 -- 172.21.15.88:0/59860423 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f34d808d960 con 0x7f34dc0ffdd0 2023-12-09T02:39:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.173+0000 7f34e1a59700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f34c806ce60 0x7f34c806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.173+0000 7f34e1a59700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f34c806ce60 0x7f34c806f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009fd0 tx=0x7f34cc009f00 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:29.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.177+0000 7f34d27fc700 1 -- 172.21.15.88:0/59860423 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f34d805b1a0 con 0x7f34dc0ffdd0 2023-12-09T02:39:29.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.374+0000 7f34e3cbd700 1 -- 172.21.15.88:0/59860423 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f34dc02b180 con 0x7f34c806ce60 2023-12-09T02:39:29.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.384+0000 7f34d27fc700 1 -- 172.21.15.88:0/59860423 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f34dc02b180 con 0x7f34c806ce60 2023-12-09T02:39:29.386 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:39:29.386 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (3m) 47s ago 10m 28.5M - 0.25.0 c8568f914cd2 9dc2b8db0963 2023-12-09T02:39:29.386 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (2m) 47s ago 10m 7470k - 19.0.0-44-g9dcc13bb f28f2b94f153 bf03eec19a86 2023-12-09T02:39:29.386 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (2m) 19s ago 9m 7453k - 19.0.0-44-g9dcc13bb f28f2b94f153 890646e8cd90 2023-12-09T02:39:29.386 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (3m) 47s ago 10m 92.5M - 9.4.7 954c08fa6188 ab4c3f64ce4d 2023-12-09T02:39:29.386 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (6m) 47s ago 6m 14.8M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (6m) 47s ago 6m 16.1M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (6m) 19s ago 6m 10.1G - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (6m) 19s ago 6m 16.1M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:8443,9283,8765 running (3m) 47s ago 11m 512M - 19.0.0-44-g9dcc13bb f28f2b94f153 a939ff288750 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283,8765 running (3m) 19s ago 9m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 e2ee2a6eb30b 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (3m) 47s ago 11m 67.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 8e4b2ba7b37c 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (2m) 19s ago 9m 55.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 4769966a784f 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (3m) 47s ago 10m 18.1M - 1.5.0 0da6a335fe13 e2b7cc0b7527 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (3m) 19s ago 9m 17.6M - 1.5.0 0da6a335fe13 0de833ab198e 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (111s) 47s ago 9m 192M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 88f0691c638a 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (81s) 47s ago 8m 131M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 8bb8d12931bb 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (51s) 47s ago 8m 12.9M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 e623b21addf0 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (21s) 19s ago 8m 11.7M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 6cd16a89f874 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (7m) 19s ago 7m 925M 2592M 17.2.7-119-ge2143d99 f761b6e42225 1e8bb8e15f97 2023-12-09T02:39:29.387 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (7m) 19s ago 7m 1157M 2592M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:39:29.388 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (3m) 47s ago 10m 51.3M - 2.43.0 a07b618ecd1d ddb1fb2e1888 2023-12-09T02:39:29.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.386+0000 7f34e3cbd700 1 -- 172.21.15.88:0/59860423 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f34c806ce60 msgr2=0x7f34c806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.386+0000 7f34e3cbd700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f34c806ce60 0x7f34c806f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009fd0 tx=0x7f34cc009f00 comp rx=0 tx=0).stop 2023-12-09T02:39:29.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.386+0000 7f34e3cbd700 1 -- 172.21.15.88:0/59860423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34dc0ffdd0 msgr2=0x7f34dc0fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.386+0000 7f34e3cbd700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34dc0ffdd0 0x7f34dc0fb700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f34d8004f90 tx=0x7f34d8009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:29.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.386+0000 7f34e3cbd700 1 -- 172.21.15.88:0/59860423 shutdown_connections 2023-12-09T02:39:29.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.386+0000 7f34e3cbd700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f34c806ce60 0x7f34c806f310 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.386+0000 7f34e3cbd700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34dc0668c0 0x7f34dc0fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.386+0000 7f34e3cbd700 1 --2- 172.21.15.88:0/59860423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34dc0ffdd0 0x7f34dc0fb700 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.386+0000 7f34e3cbd700 1 -- 172.21.15.88:0/59860423 >> 172.21.15.88:0/59860423 conn(0x7f34dc0f71b0 msgr2=0x7f34dc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:29.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.386+0000 7f34e3cbd700 1 -- 172.21.15.88:0/59860423 shutdown_connections 2023-12-09T02:39:29.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.386+0000 7f34e3cbd700 1 -- 172.21.15.88:0/59860423 wait complete. 2023-12-09T02:39:29.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.485+0000 7f84c5561700 1 -- 172.21.15.88:0/1179129280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c00668e0 msgr2=0x7f84c00ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.485+0000 7f84c5561700 1 --2- 172.21.15.88:0/1179129280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c00668e0 0x7f84c00ff7f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f84b0004940 tx=0x7f84b0009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:29.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.485+0000 7f84c5561700 1 -- 172.21.15.88:0/1179129280 shutdown_connections 2023-12-09T02:39:29.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.485+0000 7f84c5561700 1 --2- 172.21.15.88:0/1179129280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c00ffdc0 0x7f84c01021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.485+0000 7f84c5561700 1 --2- 172.21.15.88:0/1179129280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c00668e0 0x7f84c00ff7f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.485+0000 7f84c5561700 1 -- 172.21.15.88:0/1179129280 >> 172.21.15.88:0/1179129280 conn(0x7f84c00f71c0 msgr2=0x7f84c00f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:29.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.485+0000 7f84c5561700 1 -- 172.21.15.88:0/1179129280 shutdown_connections 2023-12-09T02:39:29.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.485+0000 7f84c5561700 1 -- 172.21.15.88:0/1179129280 wait complete. 2023-12-09T02:39:29.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84c5561700 1 Processor -- start 2023-12-09T02:39:29.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84c5561700 1 -- start start 2023-12-09T02:39:29.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84c5561700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c00668e0 0x7f84c010d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:29.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84c5561700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c00ffdc0 0x7f84c010da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:29.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84c5561700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c010e020 con 0x7f84c00668e0 2023-12-09T02:39:29.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84c5561700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c010e8c0 con 0x7f84c00ffdc0 2023-12-09T02:39:29.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84beffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c00668e0 0x7f84c010d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:29.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84beffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c00668e0 0x7f84c010d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35586/0 (socket says 172.21.15.88:35586) 2023-12-09T02:39:29.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84beffd700 1 -- 172.21.15.88:0/4274277615 learned_addr learned my addr 172.21.15.88:0/4274277615 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:39:29.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84be7fc700 1 --2- 172.21.15.88:0/4274277615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c00ffdc0 0x7f84c010da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:29.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84beffd700 1 -- 172.21.15.88:0/4274277615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c00ffdc0 msgr2=0x7f84c010da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84beffd700 1 --2- 172.21.15.88:0/4274277615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c00ffdc0 0x7f84c010da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84beffd700 1 -- 172.21.15.88:0/4274277615 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0005040 con 0x7f84c00668e0 2023-12-09T02:39:29.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.486+0000 7f84beffd700 1 --2- 172.21.15.88:0/4274277615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c00668e0 0x7f84c010d4e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f84b0000c00 tx=0x7f84b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:29.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.487+0000 7f84a77fe700 1 -- 172.21.15.88:0/4274277615 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b0021070 con 0x7f84c00668e0 2023-12-09T02:39:29.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.487+0000 7f84a77fe700 1 -- 172.21.15.88:0/4274277615 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f84b001c400 con 0x7f84c00668e0 2023-12-09T02:39:29.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.487+0000 7f84c5561700 1 -- 172.21.15.88:0/4274277615 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c010eb40 con 0x7f84c00668e0 2023-12-09T02:39:29.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.487+0000 7f84a77fe700 1 -- 172.21.15.88:0/4274277615 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b000e070 con 0x7f84c00668e0 2023-12-09T02:39:29.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.487+0000 7f84c5561700 1 -- 172.21.15.88:0/4274277615 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c010f020 con 0x7f84c00668e0 2023-12-09T02:39:29.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.488+0000 7f84c5561700 1 -- 172.21.15.88:0/4274277615 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c004bb80 con 0x7f84c00668e0 2023-12-09T02:39:29.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.488+0000 7f84a77fe700 1 -- 172.21.15.88:0/4274277615 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f84b001c9c0 con 0x7f84c00668e0 2023-12-09T02:39:29.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.489+0000 7f84a77fe700 1 --2- 172.21.15.88:0/4274277615 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f84a806ce60 0x7f84a806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:29.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.489+0000 7f84a77fe700 1 -- 172.21.15.88:0/4274277615 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f84b008d6d0 con 0x7f84c00668e0 2023-12-09T02:39:29.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.489+0000 7f84be7fc700 1 --2- 172.21.15.88:0/4274277615 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f84a806ce60 0x7f84a806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:29.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.489+0000 7f84be7fc700 1 --2- 172.21.15.88:0/4274277615 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f84a806ce60 0x7f84a806f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009b80 tx=0x7f84b400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:29.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.493+0000 7f84a77fe700 1 -- 172.21.15.88:0/4274277615 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f84b005af10 con 0x7f84c00668e0 2023-12-09T02:39:29.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:29 smithi161 ceph-mon[178840]: pgmap v132: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:29.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:29 smithi161 ceph-mon[178840]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-09T02:39:29.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:29 smithi161 ceph-mon[178840]: Upgrade: osd.4 is safe to restart 2023-12-09T02:39:29.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:29 smithi161 ceph-mon[178840]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:39:29.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:29 smithi088 ceph-mon[193406]: pgmap v132: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:29.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:29 smithi088 ceph-mon[193406]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-09T02:39:29.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:29 smithi088 ceph-mon[193406]: Upgrade: osd.4 is safe to restart 2023-12-09T02:39:29.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:29 smithi088 ceph-mon[193406]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:39:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.769+0000 7f84c5561700 1 -- 172.21.15.88:0/4274277615 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f84c010f710 con 0x7f84c00668e0 2023-12-09T02:39:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.770+0000 7f84a77fe700 1 -- 172.21.15.88:0/4274277615 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f84b005aaa0 con 0x7f84c00668e0 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2, 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 4 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:39:29.772 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:39:29.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:39:29.773 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:39:29.773 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6, 2023-12-09T02:39:29.773 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 8 2023-12-09T02:39:29.773 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:39:29.773 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:39:29.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.772+0000 7f84c5561700 1 -- 172.21.15.88:0/4274277615 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f84a806ce60 msgr2=0x7f84a806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.772+0000 7f84c5561700 1 --2- 172.21.15.88:0/4274277615 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f84a806ce60 0x7f84a806f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009b80 tx=0x7f84b400b040 comp rx=0 tx=0).stop 2023-12-09T02:39:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.772+0000 7f84c5561700 1 -- 172.21.15.88:0/4274277615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c00668e0 msgr2=0x7f84c010d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.772+0000 7f84c5561700 1 --2- 172.21.15.88:0/4274277615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c00668e0 0x7f84c010d4e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f84b0000c00 tx=0x7f84b0009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.772+0000 7f84c5561700 1 -- 172.21.15.88:0/4274277615 shutdown_connections 2023-12-09T02:39:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.772+0000 7f84c5561700 1 --2- 172.21.15.88:0/4274277615 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f84a806ce60 0x7f84a806f310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.772+0000 7f84c5561700 1 --2- 172.21.15.88:0/4274277615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c00668e0 0x7f84c010d4e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.772+0000 7f84c5561700 1 --2- 172.21.15.88:0/4274277615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c00ffdc0 0x7f84c010da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.772+0000 7f84c5561700 1 -- 172.21.15.88:0/4274277615 >> 172.21.15.88:0/4274277615 conn(0x7f84c00f71c0 msgr2=0x7f84c00f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.772+0000 7f84c5561700 1 -- 172.21.15.88:0/4274277615 shutdown_connections 2023-12-09T02:39:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.772+0000 7f84c5561700 1 -- 172.21.15.88:0/4274277615 wait complete. 2023-12-09T02:39:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.871+0000 7f76a3a9a700 1 -- 172.21.15.88:0/2622435752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769c0fcbf0 msgr2=0x7f769c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.871+0000 7f76a3a9a700 1 --2- 172.21.15.88:0/2622435752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769c0fcbf0 0x7f769c0fd000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f768c004940 tx=0x7f768c009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.871+0000 7f76a3a9a700 1 -- 172.21.15.88:0/2622435752 shutdown_connections 2023-12-09T02:39:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.871+0000 7f76a3a9a700 1 --2- 172.21.15.88:0/2622435752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f769c0fde00 0x7f769c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.871+0000 7f76a3a9a700 1 --2- 172.21.15.88:0/2622435752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769c0fcbf0 0x7f769c0fd000 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.871+0000 7f76a3a9a700 1 -- 172.21.15.88:0/2622435752 >> 172.21.15.88:0/2622435752 conn(0x7f769c0f82d0 msgr2=0x7f769c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a3a9a700 1 -- 172.21.15.88:0/2622435752 shutdown_connections 2023-12-09T02:39:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a3a9a700 1 -- 172.21.15.88:0/2622435752 wait complete. 2023-12-09T02:39:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a3a9a700 1 Processor -- start 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a3a9a700 1 -- start start 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a3a9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769c0fcbf0 0x7f769c10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a3a9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f769c0fde00 0x7f769c10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a3a9a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c10e0a0 con 0x7f769c0fcbf0 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a3a9a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c10e940 con 0x7f769c0fde00 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a1836700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769c0fcbf0 0x7f769c10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a1836700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769c0fcbf0 0x7f769c10d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35604/0 (socket says 172.21.15.88:35604) 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a1836700 1 -- 172.21.15.88:0/3752211732 learned_addr learned my addr 172.21.15.88:0/3752211732 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.872+0000 7f76a1035700 1 --2- 172.21.15.88:0/3752211732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f769c0fde00 0x7f769c10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.873+0000 7f76a1836700 1 -- 172.21.15.88:0/3752211732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f769c0fde00 msgr2=0x7f769c10daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.873+0000 7f76a1836700 1 --2- 172.21.15.88:0/3752211732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f769c0fde00 0x7f769c10daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.873+0000 7f76a1836700 1 -- 172.21.15.88:0/3752211732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c005040 con 0x7f769c0fcbf0 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.873+0000 7f76a1836700 1 --2- 172.21.15.88:0/3752211732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769c0fcbf0 0x7f769c10d560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f768c000c00 tx=0x7f768c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.873+0000 7f76927fc700 1 -- 172.21.15.88:0/3752211732 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f768c00e040 con 0x7f769c0fcbf0 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.873+0000 7f76927fc700 1 -- 172.21.15.88:0/3752211732 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f768c009af0 con 0x7f769c0fcbf0 2023-12-09T02:39:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.873+0000 7f76a3a9a700 1 -- 172.21.15.88:0/3752211732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c10ebc0 con 0x7f769c0fcbf0 2023-12-09T02:39:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.873+0000 7f76927fc700 1 -- 172.21.15.88:0/3752211732 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f768c01c630 con 0x7f769c0fcbf0 2023-12-09T02:39:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.873+0000 7f76a3a9a700 1 -- 172.21.15.88:0/3752211732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c10f100 con 0x7f769c0fcbf0 2023-12-09T02:39:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.874+0000 7f76a3a9a700 1 -- 172.21.15.88:0/3752211732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c1075d0 con 0x7f769c0fcbf0 2023-12-09T02:39:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.874+0000 7f76927fc700 1 -- 172.21.15.88:0/3752211732 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f768c00bc50 con 0x7f769c0fcbf0 2023-12-09T02:39:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.875+0000 7f76927fc700 1 --2- 172.21.15.88:0/3752211732 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f768806ce60 0x7f768806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:29.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.875+0000 7f76927fc700 1 -- 172.21.15.88:0/3752211732 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f768c08d860 con 0x7f769c0fcbf0 2023-12-09T02:39:29.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.875+0000 7f76a1035700 1 --2- 172.21.15.88:0/3752211732 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f768806ce60 0x7f768806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:29.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.875+0000 7f76a1035700 1 --2- 172.21.15.88:0/3752211732 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f768806ce60 0x7f768806f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7698004f40 tx=0x7f769800b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:29.879+0000 7f76927fc700 1 -- 172.21.15.88:0/3752211732 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f768c05b0a0 con 0x7f769c0fcbf0 2023-12-09T02:39:30.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.108+0000 7f76a3a9a700 1 -- 172.21.15.88:0/3752211732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f769c106ff0 con 0x7f769c0fcbf0 2023-12-09T02:39:30.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.108+0000 7f76927fc700 1 -- 172.21.15.88:0/3752211732 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f768c05ac30 con 0x7f769c0fcbf0 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:39:30.111 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:39:30.112 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:39:30.113 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:39:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.110+0000 7f76a3a9a700 1 -- 172.21.15.88:0/3752211732 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f768806ce60 msgr2=0x7f768806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.110+0000 7f76a3a9a700 1 --2- 172.21.15.88:0/3752211732 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f768806ce60 0x7f768806f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7698004f40 tx=0x7f769800b040 comp rx=0 tx=0).stop 2023-12-09T02:39:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.110+0000 7f76a3a9a700 1 -- 172.21.15.88:0/3752211732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769c0fcbf0 msgr2=0x7f769c10d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.110+0000 7f76a3a9a700 1 --2- 172.21.15.88:0/3752211732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769c0fcbf0 0x7f769c10d560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f768c000c00 tx=0x7f768c009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.110+0000 7f76a3a9a700 1 -- 172.21.15.88:0/3752211732 shutdown_connections 2023-12-09T02:39:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.110+0000 7f76a3a9a700 1 --2- 172.21.15.88:0/3752211732 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f768806ce60 0x7f768806f310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.110+0000 7f76a3a9a700 1 --2- 172.21.15.88:0/3752211732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769c0fcbf0 0x7f769c10d560 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.111+0000 7f76a3a9a700 1 --2- 172.21.15.88:0/3752211732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f769c0fde00 0x7f769c10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.111+0000 7f76a3a9a700 1 -- 172.21.15.88:0/3752211732 >> 172.21.15.88:0/3752211732 conn(0x7f769c0f82d0 msgr2=0x7f769c0fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.111+0000 7f76a3a9a700 1 -- 172.21.15.88:0/3752211732 shutdown_connections 2023-12-09T02:39:30.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.111+0000 7f76a3a9a700 1 -- 172.21.15.88:0/3752211732 wait complete. 2023-12-09T02:39:30.115 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:39:30.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.211+0000 7fc8c3448700 1 -- 172.21.15.88:0/4019292661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8bc0faed0 msgr2=0x7fc8bc0fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:30.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.211+0000 7fc8c3448700 1 --2- 172.21.15.88:0/4019292661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8bc0faed0 0x7fc8bc0fb2e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac004940 tx=0x7fc8ac009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:30.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.211+0000 7fc8c3448700 1 -- 172.21.15.88:0/4019292661 shutdown_connections 2023-12-09T02:39:30.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.211+0000 7fc8c3448700 1 --2- 172.21.15.88:0/4019292661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8bc0fdf60 0x7fc8bc0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.211+0000 7fc8c3448700 1 --2- 172.21.15.88:0/4019292661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8bc0faed0 0x7fc8bc0fb2e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.211+0000 7fc8c3448700 1 -- 172.21.15.88:0/4019292661 >> 172.21.15.88:0/4019292661 conn(0x7fc8bc0f6950 msgr2=0x7fc8bc0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.211+0000 7fc8c3448700 1 -- 172.21.15.88:0/4019292661 shutdown_connections 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.211+0000 7fc8c3448700 1 -- 172.21.15.88:0/4019292661 wait complete. 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c3448700 1 Processor -- start 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c3448700 1 -- start start 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c3448700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8bc0faed0 0x7fc8bc0fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c3448700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8bc0fdf60 0x7fc8bc0fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c3448700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0fc500 con 0x7fc8bc0fdf60 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c3448700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0fc670 con 0x7fc8bc0faed0 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c09e3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8bc0fdf60 0x7fc8bc0fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c09e3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8bc0fdf60 0x7fc8bc0fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35622/0 (socket says 172.21.15.88:35622) 2023-12-09T02:39:30.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c09e3700 1 -- 172.21.15.88:0/1716653161 learned_addr learned my addr 172.21.15.88:0/1716653161 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:39:30.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c11e4700 1 --2- 172.21.15.88:0/1716653161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8bc0faed0 0x7fc8bc0fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:30.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c09e3700 1 -- 172.21.15.88:0/1716653161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8bc0faed0 msgr2=0x7fc8bc0fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:30.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c09e3700 1 --2- 172.21.15.88:0/1716653161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8bc0faed0 0x7fc8bc0fd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c09e3700 1 -- 172.21.15.88:0/1716653161 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac005040 con 0x7fc8bc0fdf60 2023-12-09T02:39:30.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.212+0000 7fc8c09e3700 1 --2- 172.21.15.88:0/1716653161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8bc0fdf60 0x7fc8bc0fbe70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b790 tx=0x7fc8b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:30.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.213+0000 7fc8b1ffb700 1 -- 172.21.15.88:0/1716653161 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8b800f770 con 0x7fc8bc0fdf60 2023-12-09T02:39:30.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.213+0000 7fc8c3448700 1 -- 172.21.15.88:0/1716653161 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc0fc950 con 0x7fc8bc0fdf60 2023-12-09T02:39:30.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.213+0000 7fc8b1ffb700 1 -- 172.21.15.88:0/1716653161 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc8b800fd80 con 0x7fc8bc0fdf60 2023-12-09T02:39:30.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.213+0000 7fc8b1ffb700 1 -- 172.21.15.88:0/1716653161 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8b800d310 con 0x7fc8bc0fdf60 2023-12-09T02:39:30.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.213+0000 7fc8c3448700 1 -- 172.21.15.88:0/1716653161 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc0fccd0 con 0x7fc8bc0fdf60 2023-12-09T02:39:30.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.214+0000 7fc8c3448700 1 -- 172.21.15.88:0/1716653161 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc107670 con 0x7fc8bc0fdf60 2023-12-09T02:39:30.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.214+0000 7fc8b1ffb700 1 -- 172.21.15.88:0/1716653161 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fc8b8010420 con 0x7fc8bc0fdf60 2023-12-09T02:39:30.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.214+0000 7fc8b1ffb700 1 --2- 172.21.15.88:0/1716653161 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc8a806ce60 0x7fc8a806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:30.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.215+0000 7fc8b1ffb700 1 -- 172.21.15.88:0/1716653161 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6848+0+0 (secure 0 0 0) 0x7fc8b808c420 con 0x7fc8bc0fdf60 2023-12-09T02:39:30.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.215+0000 7fc8c11e4700 1 --2- 172.21.15.88:0/1716653161 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc8a806ce60 0x7fc8a806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:30.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.215+0000 7fc8c11e4700 1 --2- 172.21.15.88:0/1716653161 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc8a806ce60 0x7fc8a806f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00b3b0 tx=0x7fc8ac009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:30.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.219+0000 7fc8b1ffb700 1 -- 172.21.15.88:0/1716653161 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc8b8059c60 con 0x7fc8bc0fdf60 2023-12-09T02:39:30.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.425+0000 7fc8c3448700 1 -- 172.21.15.88:0/1716653161 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8bc02b150 con 0x7fc8a806ce60 2023-12-09T02:39:30.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.426+0000 7fc8b1ffb700 1 -- 172.21.15.88:0/1716653161 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc8bc02b150 con 0x7fc8a806ce60 2023-12-09T02:39:30.428 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:39:30.428 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:39:30.428 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:39:30.428 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:39:30.428 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2023-12-09T02:39:30.429 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2023-12-09T02:39:30.429 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2023-12-09T02:39:30.429 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2023-12-09T02:39:30.429 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-12-09T02:39:30.429 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "10/21 daemons upgraded", 2023-12-09T02:39:30.429 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2023-12-09T02:39:30.429 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:39:30.429 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:39:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.428+0000 7fc8c3448700 1 -- 172.21.15.88:0/1716653161 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc8a806ce60 msgr2=0x7fc8a806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.428+0000 7fc8c3448700 1 --2- 172.21.15.88:0/1716653161 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc8a806ce60 0x7fc8a806f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00b3b0 tx=0x7fc8ac009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.428+0000 7fc8c3448700 1 -- 172.21.15.88:0/1716653161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8bc0fdf60 msgr2=0x7fc8bc0fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.428+0000 7fc8c3448700 1 --2- 172.21.15.88:0/1716653161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8bc0fdf60 0x7fc8bc0fbe70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b790 tx=0x7fc8b8009250 comp rx=0 tx=0).stop 2023-12-09T02:39:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.428+0000 7fc8c3448700 1 -- 172.21.15.88:0/1716653161 shutdown_connections 2023-12-09T02:39:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.428+0000 7fc8c3448700 1 --2- 172.21.15.88:0/1716653161 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc8a806ce60 0x7fc8a806f310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.428+0000 7fc8c3448700 1 --2- 172.21.15.88:0/1716653161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8bc0faed0 0x7fc8bc0fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.428+0000 7fc8c3448700 1 --2- 172.21.15.88:0/1716653161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8bc0fdf60 0x7fc8bc0fbe70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.428+0000 7fc8c3448700 1 -- 172.21.15.88:0/1716653161 >> 172.21.15.88:0/1716653161 conn(0x7fc8bc0f6950 msgr2=0x7fc8bc0f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.428+0000 7fc8c3448700 1 -- 172.21.15.88:0/1716653161 shutdown_connections 2023-12-09T02:39:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.428+0000 7fc8c3448700 1 -- 172.21.15.88:0/1716653161 wait complete. 2023-12-09T02:39:30.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.528+0000 7f620ee42700 1 -- 172.21.15.88:0/3811681491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62080fe270 msgr2=0x7f62080fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:30.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.528+0000 7f620ee42700 1 --2- 172.21.15.88:0/3811681491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62080fe270 0x7f62080fe680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f61fc004940 tx=0x7f61fc009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:30.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.528+0000 7f620ee42700 1 -- 172.21.15.88:0/3811681491 shutdown_connections 2023-12-09T02:39:30.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.529+0000 7f620ee42700 1 --2- 172.21.15.88:0/3811681491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62080fec50 0x7f62080fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.529+0000 7f620ee42700 1 --2- 172.21.15.88:0/3811681491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62080fe270 0x7f62080fe680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.529+0000 7f620ee42700 1 -- 172.21.15.88:0/3811681491 >> 172.21.15.88:0/3811681491 conn(0x7f62080f6950 msgr2=0x7f62080f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:30.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.529+0000 7f620ee42700 1 -- 172.21.15.88:0/3811681491 shutdown_connections 2023-12-09T02:39:30.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.529+0000 7f620ee42700 1 -- 172.21.15.88:0/3811681491 wait complete. 2023-12-09T02:39:30.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.529+0000 7f620ee42700 1 Processor -- start 2023-12-09T02:39:30.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.529+0000 7f620ee42700 1 -- start start 2023-12-09T02:39:30.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.529+0000 7f620ee42700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62080fe270 0x7f620810d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:30.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.529+0000 7f620ee42700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f620810db40 0x7f620810e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:30.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.529+0000 7f620ee42700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620810e000 con 0x7f620810db40 2023-12-09T02:39:30.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.529+0000 7f620ee42700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620810e140 con 0x7f62080fe270 2023-12-09T02:39:30.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f6207fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f620810db40 0x7f620810e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:30.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f6207fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f620810db40 0x7f620810e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35650/0 (socket says 172.21.15.88:35650) 2023-12-09T02:39:30.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f6207fff700 1 -- 172.21.15.88:0/1718504677 learned_addr learned my addr 172.21.15.88:0/1718504677 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:39:30.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f620cbde700 1 --2- 172.21.15.88:0/1718504677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62080fe270 0x7f620810d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:30.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f6207fff700 1 -- 172.21.15.88:0/1718504677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62080fe270 msgr2=0x7f620810d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:30.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f6207fff700 1 --2- 172.21.15.88:0/1718504677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62080fe270 0x7f620810d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f6207fff700 1 -- 172.21.15.88:0/1718504677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61fc005040 con 0x7f620810db40 2023-12-09T02:39:30.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f6207fff700 1 --2- 172.21.15.88:0/1718504677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f620810db40 0x7f620810e9e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f61f4002a50 tx=0x7f61f40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:30.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f62057fa700 1 -- 172.21.15.88:0/1718504677 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61f4007cc0 con 0x7f620810db40 2023-12-09T02:39:30.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f620ee42700 1 -- 172.21.15.88:0/1718504677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620810f040 con 0x7f620810db40 2023-12-09T02:39:30.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f62057fa700 1 -- 172.21.15.88:0/1718504677 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61f400f040 con 0x7f620810db40 2023-12-09T02:39:30.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f62057fa700 1 -- 172.21.15.88:0/1718504677 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61f400da30 con 0x7f620810db40 2023-12-09T02:39:30.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.530+0000 7f620ee42700 1 -- 172.21.15.88:0/1718504677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620810f550 con 0x7f620810db40 2023-12-09T02:39:30.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.531+0000 7f620ee42700 1 -- 172.21.15.88:0/1718504677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620804bb80 con 0x7f620810db40 2023-12-09T02:39:30.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.532+0000 7f62057fa700 1 -- 172.21.15.88:0/1718504677 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f61f400dc30 con 0x7f620810db40 2023-12-09T02:39:30.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.532+0000 7f62057fa700 1 --2- 172.21.15.88:0/1718504677 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f61f806ce60 0x7f61f806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:39:30.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.532+0000 7f62057fa700 1 -- 172.21.15.88:0/1718504677 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f61f408c010 con 0x7f620810db40 2023-12-09T02:39:30.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.532+0000 7f620cbde700 1 --2- 172.21.15.88:0/1718504677 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f61f806ce60 0x7f61f806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:39:30.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.532+0000 7f620cbde700 1 --2- 172.21.15.88:0/1718504677 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f61f806ce60 0x7f61f806f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f61fc004f90 tx=0x7f61fc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:39:30.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.536+0000 7f62057fa700 1 -- 172.21.15.88:0/1718504677 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f61f4059850 con 0x7f620810db40 2023-12-09T02:39:30.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.801+0000 7f620ee42700 1 -- 172.21.15.88:0/1718504677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f620810f7c0 con 0x7f620810db40 2023-12-09T02:39:30.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.801+0000 7f62057fa700 1 -- 172.21.15.88:0/1718504677 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f61f40593e0 con 0x7f620810db40 2023-12-09T02:39:30.804 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2023-12-09T02:39:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.803+0000 7f620ee42700 1 -- 172.21.15.88:0/1718504677 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f61f806ce60 msgr2=0x7f61f806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.803+0000 7f620ee42700 1 --2- 172.21.15.88:0/1718504677 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f61f806ce60 0x7f61f806f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f61fc004f90 tx=0x7f61fc009e30 comp rx=0 tx=0).stop 2023-12-09T02:39:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.803+0000 7f620ee42700 1 -- 172.21.15.88:0/1718504677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f620810db40 msgr2=0x7f620810e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:39:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.803+0000 7f620ee42700 1 --2- 172.21.15.88:0/1718504677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f620810db40 0x7f620810e9e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f61f4002a50 tx=0x7f61f40046b0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.803+0000 7f620ee42700 1 -- 172.21.15.88:0/1718504677 shutdown_connections 2023-12-09T02:39:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.803+0000 7f620ee42700 1 --2- 172.21.15.88:0/1718504677 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f61f806ce60 0x7f61f806f310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.803+0000 7f620ee42700 1 --2- 172.21.15.88:0/1718504677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62080fe270 0x7f620810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.803+0000 7f620ee42700 1 --2- 172.21.15.88:0/1718504677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f620810db40 0x7f620810e9e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:39:30.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.803+0000 7f620ee42700 1 -- 172.21.15.88:0/1718504677 >> 172.21.15.88:0/1718504677 conn(0x7f62080f6950 msgr2=0x7f6208101250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:39:30.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.803+0000 7f620ee42700 1 -- 172.21.15.88:0/1718504677 shutdown_connections 2023-12-09T02:39:30.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:39:30.803+0000 7f620ee42700 1 -- 172.21.15.88:0/1718504677 wait complete. 2023-12-09T02:39:30.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:30 smithi161 ceph-mon[178840]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:39:30.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:30 smithi161 ceph-mon[178840]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:39:30.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:30 smithi161 ceph-mon[178840]: Upgrade: Updating osd.4 2023-12-09T02:39:30.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:30 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:30.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:30 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-09T02:39:30.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:30 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:39:30.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:30 smithi161 ceph-mon[178840]: Deploying daemon osd.4 on smithi161 2023-12-09T02:39:30.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:30 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/4274277615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:30.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:30 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/3752211732' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:39:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:30 smithi088 ceph-mon[193406]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:39:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:30 smithi088 ceph-mon[193406]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:39:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:30 smithi088 ceph-mon[193406]: Upgrade: Updating osd.4 2023-12-09T02:39:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:30 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:30 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-09T02:39:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:30 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:39:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:30 smithi088 ceph-mon[193406]: Deploying daemon osd.4 on smithi161 2023-12-09T02:39:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:30 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/4274277615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:30.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:30 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/3752211732' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:39:31.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:31 smithi161 ceph-mon[178840]: pgmap v133: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:31.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:31 smithi161 ceph-mon[178840]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:39:31.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:31 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1718504677' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:39:31.920 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:31 smithi161 systemd[1]: Stopping Ceph osd.4 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:39:31.920 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:31 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[136283]: 2023-12-09T02:39:31.863+0000 7f9705b26700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:39:31.920 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:31 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[136283]: 2023-12-09T02:39:31.863+0000 7f9705b26700 -1 osd.4 93 *** Got signal Terminated *** 2023-12-09T02:39:31.920 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:31 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[136283]: 2023-12-09T02:39:31.863+0000 7f9705b26700 -1 osd.4 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:39:31.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:31 smithi088 ceph-mon[193406]: pgmap v133: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:31.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:31 smithi088 ceph-mon[193406]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:39:31.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:31 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1718504677' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:39:32.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:32 smithi161 ceph-mon[178840]: osd.4 marked itself down and dead 2023-12-09T02:39:32.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:32 smithi088 ceph-mon[193406]: osd.4 marked itself down and dead 2023-12-09T02:39:33.669 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:33 smithi161 bash[196498]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4 2023-12-09T02:39:33.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:33 smithi161 ceph-mon[178840]: pgmap v134: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:33.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:33 smithi161 ceph-mon[178840]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:39:33.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:33 smithi161 ceph-mon[178840]: failed to encode map e94 with expected crc 2023-12-09T02:39:33.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:33 smithi161 ceph-mon[178840]: osdmap e94: 6 total, 5 up, 6 in 2023-12-09T02:39:33.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:33 smithi088 ceph-mon[193406]: pgmap v134: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:33.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:33 smithi088 ceph-mon[193406]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:39:33.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:33 smithi088 ceph-mon[193406]: failed to encode map e94 with expected crc 2023-12-09T02:39:33.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:33 smithi088 ceph-mon[193406]: osdmap e94: 6 total, 5 up, 6 in 2023-12-09T02:39:34.641 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:34 smithi161 ceph-mon[178840]: failed to encode map e95 with expected crc 2023-12-09T02:39:34.641 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:34 smithi161 ceph-mon[178840]: osdmap e95: 6 total, 5 up, 6 in 2023-12-09T02:39:34.642 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:34 smithi161 ceph-mon[178840]: failed to encode map e95 with expected crc 2023-12-09T02:39:34.642 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:34 smithi161 ceph-mon[178840]: failed to encode map e95 with expected crc 2023-12-09T02:39:34.642 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:34 smithi161 ceph-mon[178840]: failed to encode map e95 with expected crc 2023-12-09T02:39:34.920 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:34 smithi161 systemd[1]: ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.4.service: Succeeded. 2023-12-09T02:39:34.920 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:34 smithi161 systemd[1]: Stopped Ceph osd.4 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:39:34.920 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:34 smithi161 systemd[1]: Starting Ceph osd.4 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:39:34.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:34 smithi088 ceph-mon[193406]: failed to encode map e95 with expected crc 2023-12-09T02:39:34.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:34 smithi088 ceph-mon[193406]: osdmap e95: 6 total, 5 up, 6 in 2023-12-09T02:39:34.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:34 smithi088 ceph-mon[193406]: failed to encode map e95 with expected crc 2023-12-09T02:39:34.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:34 smithi088 ceph-mon[193406]: failed to encode map e95 with expected crc 2023-12-09T02:39:34.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:34 smithi088 ceph-mon[193406]: failed to encode map e95 with expected crc 2023-12-09T02:39:35.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:35 smithi161 ceph-mon[178840]: pgmap v137: 65 pgs: 2 active+undersized, 4 active+undersized+degraded, 4 stale+active+clean, 55 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2023-12-09T02:39:35.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:35 smithi161 ceph-mon[178840]: Health check failed: Degraded data redundancy: 6/222 objects degraded (2.703%), 4 pgs degraded (PG_DEGRADED) 2023-12-09T02:39:35.920 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:35 smithi161 bash[196767]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-09T02:39:35.921 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:35 smithi161 bash[196767]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-09T02:39:35.921 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:35 smithi161 bash[196767]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-09T02:39:35.921 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:35 smithi161 bash[196767]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-09T02:39:35.921 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:35 smithi161 bash[196767]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-09T02:39:35.921 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:35 smithi161 bash[196767]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-09T02:39:35.921 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:35 smithi161 bash[196767]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-09T02:39:35.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:35 smithi088 ceph-mon[193406]: pgmap v137: 65 pgs: 2 active+undersized, 4 active+undersized+degraded, 4 stale+active+clean, 55 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2023-12-09T02:39:35.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:35 smithi088 ceph-mon[193406]: Health check failed: Degraded data redundancy: 6/222 objects degraded (2.703%), 4 pgs degraded (PG_DEGRADED) 2023-12-09T02:39:36.669 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:36 smithi161 ceph-osd[197083]: -- 172.21.15.161:0/2366510344 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56125b0f91e0 con 0x56125b0c8c00 2023-12-09T02:39:36.669 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:36 smithi161 bash[197046]: 103a8409c9c834228181f2d71182fbd90b9877198923f1736b086d40f7a27756 2023-12-09T02:39:36.670 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:36 smithi161 systemd[1]: Started Ceph osd.4 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:39:37.170 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:36 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:39:36.735+0000 7fc6ea5e5640 -1 Falling back to public interface 2023-12-09T02:39:37.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:37.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:37.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:39:37.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:37 smithi161 ceph-mon[178840]: pgmap v138: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 1 stale+active+clean, 37 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/222 objects degraded (15.315%) 2023-12-09T02:39:37.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:37.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:39:37.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:37.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:37 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:39:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:37 smithi088 ceph-mon[193406]: pgmap v138: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 1 stale+active+clean, 37 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/222 objects degraded (15.315%) 2023-12-09T02:39:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:39:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:37.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:37 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:40.000 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:39 smithi161 ceph-mon[178840]: pgmap v139: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:39:40.000 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:39 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:40.000 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:39 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:40.000 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:39 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:40.000 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:39 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:40.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:39 smithi088 ceph-mon[193406]: pgmap v139: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:39:40.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:39 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:40.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:39 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:40.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:39 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:40.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:39 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:41.670 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:41 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:39:41.352+0000 7fc6ea5e5640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-09T02:39:42.073 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:41 smithi161 ceph-mon[178840]: pgmap v140: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:39:42.073 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:41 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:39:41.931+0000 7fc6ea5e5640 -1 osd.4 93 log_to_monitors true 2023-12-09T02:39:42.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:41 smithi088 ceph-mon[193406]: pgmap v140: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:39:43.170 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:39:42.760+0000 7fc6dba56700 -1 osd.4 93 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:39:43.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='osd.4 [v2:172.21.15.161:6808/2971260023,v1:172.21.15.161:6809/2971260023]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-09T02:39:43.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-09T02:39:43.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:43.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:43.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:39:43.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:39:43.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:43.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:39:43.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:43.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:43.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:43.171 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:42 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-09T02:39:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='osd.4 [v2:172.21.15.161:6808/2971260023,v1:172.21.15.161:6809/2971260023]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-09T02:39:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-09T02:39:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:39:43.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:39:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:39:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:39:43.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:42 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-09T02:39:44.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:43 smithi161 ceph-mon[178840]: pgmap v141: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:39:44.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:43 smithi161 ceph-mon[178840]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-09T02:39:44.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:43 smithi161 ceph-mon[178840]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-09T02:39:44.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:43 smithi161 ceph-mon[178840]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-09T02:39:44.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:43 smithi161 ceph-mon[178840]: osdmap e96: 6 total, 5 up, 6 in 2023-12-09T02:39:44.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:43 smithi161 ceph-mon[178840]: from='osd.4 [v2:172.21.15.161:6808/2971260023,v1:172.21.15.161:6809/2971260023]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:39:44.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:43 smithi161 ceph-mon[178840]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:39:44.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:43 smithi161 ceph-mon[178840]: Health check update: Degraded data redundancy: 38/222 objects degraded (17.117%), 15 pgs degraded (PG_DEGRADED) 2023-12-09T02:39:44.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:43 smithi088 ceph-mon[193406]: pgmap v141: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2023-12-09T02:39:44.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:43 smithi088 ceph-mon[193406]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-09T02:39:44.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:43 smithi088 ceph-mon[193406]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-09T02:39:44.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:43 smithi088 ceph-mon[193406]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-09T02:39:44.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:43 smithi088 ceph-mon[193406]: osdmap e96: 6 total, 5 up, 6 in 2023-12-09T02:39:44.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:43 smithi088 ceph-mon[193406]: from='osd.4 [v2:172.21.15.161:6808/2971260023,v1:172.21.15.161:6809/2971260023]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:39:44.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:43 smithi088 ceph-mon[193406]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:39:44.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:43 smithi088 ceph-mon[193406]: Health check update: Degraded data redundancy: 38/222 objects degraded (17.117%), 15 pgs degraded (PG_DEGRADED) 2023-12-09T02:39:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:44 smithi088 ceph-mon[193406]: failed to encode map e96 with expected crc 2023-12-09T02:39:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:44 smithi088 ceph-mon[193406]: failed to encode map e96 with expected crc 2023-12-09T02:39:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:44 smithi088 ceph-mon[193406]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:39:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:44 smithi088 ceph-mon[193406]: osd.4 [v2:172.21.15.161:6808/2971260023,v1:172.21.15.161:6809/2971260023] boot 2023-12-09T02:39:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:44 smithi088 ceph-mon[193406]: osdmap e97: 6 total, 6 up, 6 in 2023-12-09T02:39:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:44 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:39:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:44 smithi088 ceph-mon[193406]: failed to encode map e97 with expected crc 2023-12-09T02:39:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:44 smithi088 ceph-mon[193406]: failed to encode map e97 with expected crc 2023-12-09T02:39:44.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:44 smithi088 ceph-mon[193406]: osdmap e98: 6 total, 6 up, 6 in 2023-12-09T02:39:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:44 smithi161 ceph-mon[178840]: failed to encode map e96 with expected crc 2023-12-09T02:39:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:44 smithi161 ceph-mon[178840]: failed to encode map e96 with expected crc 2023-12-09T02:39:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:44 smithi161 ceph-mon[178840]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:39:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:44 smithi161 ceph-mon[178840]: osd.4 [v2:172.21.15.161:6808/2971260023,v1:172.21.15.161:6809/2971260023] boot 2023-12-09T02:39:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:44 smithi161 ceph-mon[178840]: osdmap e97: 6 total, 6 up, 6 in 2023-12-09T02:39:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:44 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-09T02:39:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:44 smithi161 ceph-mon[178840]: failed to encode map e97 with expected crc 2023-12-09T02:39:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:44 smithi161 ceph-mon[178840]: failed to encode map e97 with expected crc 2023-12-09T02:39:45.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:44 smithi161 ceph-mon[178840]: osdmap e98: 6 total, 6 up, 6 in 2023-12-09T02:39:46.169 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:45 smithi161 ceph-mon[178840]: pgmap v144: 65 pgs: 5 peering, 16 active+undersized, 11 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2023-12-09T02:39:46.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:45 smithi161 ceph-mon[178840]: failed to encode map e98 with expected crc 2023-12-09T02:39:46.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:45 smithi161 ceph-mon[178840]: failed to encode map e98 with expected crc 2023-12-09T02:39:46.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:45 smithi161 ceph-mon[178840]: failed to encode map e98 with expected crc 2023-12-09T02:39:46.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:45 smithi161 ceph-mon[178840]: failed to encode map e98 with expected crc 2023-12-09T02:39:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:45 smithi088 ceph-mon[193406]: pgmap v144: 65 pgs: 5 peering, 16 active+undersized, 11 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2023-12-09T02:39:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:45 smithi088 ceph-mon[193406]: failed to encode map e98 with expected crc 2023-12-09T02:39:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:45 smithi088 ceph-mon[193406]: failed to encode map e98 with expected crc 2023-12-09T02:39:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:45 smithi088 ceph-mon[193406]: failed to encode map e98 with expected crc 2023-12-09T02:39:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:45 smithi088 ceph-mon[193406]: failed to encode map e98 with expected crc 2023-12-09T02:39:47.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:47 smithi088 ceph-mon[193406]: pgmap v146: 65 pgs: 23 peering, 6 active+undersized, 3 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2023-12-09T02:39:47.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:47 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:47 smithi161 ceph-mon[178840]: pgmap v146: 65 pgs: 23 peering, 6 active+undersized, 3 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2023-12-09T02:39:47.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:47 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:48.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:48 smithi161 ceph-mon[178840]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded) 2023-12-09T02:39:48.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:48 smithi161 ceph-mon[178840]: Cluster is now healthy 2023-12-09T02:39:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:48 smithi088 ceph-mon[193406]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded) 2023-12-09T02:39:48.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:48 smithi088 ceph-mon[193406]: Cluster is now healthy 2023-12-09T02:39:49.922 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:49 smithi161 ceph-mon[178840]: pgmap v147: 65 pgs: 23 peering, 42 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:49 smithi088 ceph-mon[193406]: pgmap v147: 65 pgs: 23 peering, 42 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:51 smithi161 ceph-mon[178840]: pgmap v148: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:51 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:51 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:39:51.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:51 smithi088 ceph-mon[193406]: pgmap v148: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:51.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:51 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:51.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:51 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:39:53.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:53 smithi161 ceph-mon[178840]: pgmap v149: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:53.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:53 smithi088 ceph-mon[193406]: pgmap v149: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:55.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:55 smithi161 ceph-mon[178840]: pgmap v150: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:55.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:55 smithi088 ceph-mon[193406]: pgmap v150: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:57.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:57 smithi088 ceph-mon[193406]: pgmap v151: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:57.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:57 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:57.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:57 smithi161 ceph-mon[178840]: pgmap v151: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:57.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:57 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:58.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:58 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-09T02:39:58.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:58 smithi088 ceph-mon[193406]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-09T02:39:58.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:58 smithi088 ceph-mon[193406]: Upgrade: osd.5 is safe to restart 2023-12-09T02:39:58.816 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:58 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-09T02:39:58.816 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:58 smithi161 ceph-mon[178840]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-09T02:39:58.816 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:58 smithi161 ceph-mon[178840]: Upgrade: osd.5 is safe to restart 2023-12-09T02:39:59.596 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:59 smithi161 ceph-mon[178840]: pgmap v152: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:59.596 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:59 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:59.596 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:59 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-09T02:39:59.596 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:39:59 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:39:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:59 smithi088 ceph-mon[193406]: pgmap v152: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:39:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:59 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:39:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:59 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-09T02:39:59.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:39:59 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:40:00.640 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:00 smithi161 ceph-mon[178840]: Upgrade: Updating osd.5 2023-12-09T02:40:00.640 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:00 smithi161 ceph-mon[178840]: Deploying daemon osd.5 on smithi161 2023-12-09T02:40:00.640 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:00 smithi161 ceph-mon[178840]: overall HEALTH_OK 2023-12-09T02:40:00.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.916+0000 7f528dd7e700 1 -- 172.21.15.88:0/3386716199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52880fcd00 msgr2=0x7f52880fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:00.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.916+0000 7f528dd7e700 1 --2- 172.21.15.88:0/3386716199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52880fcd00 0x7f52880fd150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5278004940 tx=0x7f5278009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:00.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.916+0000 7f528dd7e700 1 -- 172.21.15.88:0/3386716199 shutdown_connections 2023-12-09T02:40:00.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.916+0000 7f528dd7e700 1 --2- 172.21.15.88:0/3386716199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52880fcd00 0x7f52880fd150 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.916+0000 7f528dd7e700 1 --2- 172.21.15.88:0/3386716199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52880fbaf0 0x7f52880fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.916+0000 7f528dd7e700 1 -- 172.21.15.88:0/3386716199 >> 172.21.15.88:0/3386716199 conn(0x7f52880f7190 msgr2=0x7f52880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.916+0000 7f528dd7e700 1 -- 172.21.15.88:0/3386716199 shutdown_connections 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.916+0000 7f528dd7e700 1 -- 172.21.15.88:0/3386716199 wait complete. 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.917+0000 7f528dd7e700 1 Processor -- start 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.917+0000 7f528dd7e700 1 -- start start 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.917+0000 7f528dd7e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52880fbaf0 0x7f5288110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.917+0000 7f528dd7e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52880fcd00 0x7f52881127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.917+0000 7f528dd7e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880661a0 con 0x7f52880fbaf0 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.917+0000 7f528dd7e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880662e0 con 0x7f52880fcd00 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.917+0000 7f52877fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52880fbaf0 0x7f5288110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.917+0000 7f52877fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52880fbaf0 0x7f5288110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35962/0 (socket says 172.21.15.88:35962) 2023-12-09T02:40:00.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.917+0000 7f52877fe700 1 -- 172.21.15.88:0/3042715310 learned_addr learned my addr 172.21.15.88:0/3042715310 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:00.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.918+0000 7f5286ffd700 1 --2- 172.21.15.88:0/3042715310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52880fcd00 0x7f52881127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:00.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.918+0000 7f52877fe700 1 -- 172.21.15.88:0/3042715310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52880fcd00 msgr2=0x7f52881127e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:00.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.918+0000 7f52877fe700 1 --2- 172.21.15.88:0/3042715310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52880fcd00 0x7f52881127e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:00.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.918+0000 7f52877fe700 1 -- 172.21.15.88:0/3042715310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278005040 con 0x7f52880fbaf0 2023-12-09T02:40:00.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.918+0000 7f52877fe700 1 --2- 172.21.15.88:0/3042715310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52880fbaf0 0x7f5288110290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f527c00b790 tx=0x7f527c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:00.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.918+0000 7f526ffff700 1 -- 172.21.15.88:0/3042715310 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f527c00f6f0 con 0x7f52880fbaf0 2023-12-09T02:40:00.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.918+0000 7f526ffff700 1 -- 172.21.15.88:0/3042715310 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f527c00fd00 con 0x7f52880fbaf0 2023-12-09T02:40:00.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.918+0000 7f526ffff700 1 -- 172.21.15.88:0/3042715310 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f527c011e30 con 0x7f52880fbaf0 2023-12-09T02:40:00.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.918+0000 7f528dd7e700 1 -- 172.21.15.88:0/3042715310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5288112e70 con 0x7f52880fbaf0 2023-12-09T02:40:00.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.918+0000 7f528dd7e700 1 -- 172.21.15.88:0/3042715310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52881132d0 con 0x7f52880fbaf0 2023-12-09T02:40:00.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.919+0000 7f528dd7e700 1 -- 172.21.15.88:0/3042715310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528804bb80 con 0x7f52880fbaf0 2023-12-09T02:40:00.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.920+0000 7f526ffff700 1 -- 172.21.15.88:0/3042715310 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f527c00f850 con 0x7f52880fbaf0 2023-12-09T02:40:00.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.920+0000 7f526ffff700 1 --2- 172.21.15.88:0/3042715310 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f527006ce60 0x7f527006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:00.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.920+0000 7f5286ffd700 1 --2- 172.21.15.88:0/3042715310 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f527006ce60 0x7f527006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:00.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.920+0000 7f526ffff700 1 -- 172.21.15.88:0/3042715310 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f527c08c260 con 0x7f52880fbaf0 2023-12-09T02:40:00.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.921+0000 7f5286ffd700 1 --2- 172.21.15.88:0/3042715310 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f527006ce60 0x7f527006f310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5278004890 tx=0x7f5278009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:00.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:00.925+0000 7f526ffff700 1 -- 172.21.15.88:0/3042715310 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f527c056010 con 0x7f52880fbaf0 2023-12-09T02:40:00.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:00 smithi088 ceph-mon[193406]: Upgrade: Updating osd.5 2023-12-09T02:40:00.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:00 smithi088 ceph-mon[193406]: Deploying daemon osd.5 on smithi161 2023-12-09T02:40:00.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:00 smithi088 ceph-mon[193406]: overall HEALTH_OK 2023-12-09T02:40:01.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.134+0000 7f528dd7e700 1 -- 172.21.15.88:0/3042715310 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5288101650 con 0x7f527006ce60 2023-12-09T02:40:01.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.135+0000 7f526ffff700 1 -- 172.21.15.88:0/3042715310 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5288101650 con 0x7f527006ce60 2023-12-09T02:40:01.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.137+0000 7f528dd7e700 1 -- 172.21.15.88:0/3042715310 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f527006ce60 msgr2=0x7f527006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.137+0000 7f528dd7e700 1 --2- 172.21.15.88:0/3042715310 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f527006ce60 0x7f527006f310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5278004890 tx=0x7f5278009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:01.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.137+0000 7f528dd7e700 1 -- 172.21.15.88:0/3042715310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52880fbaf0 msgr2=0x7f5288110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.137+0000 7f528dd7e700 1 --2- 172.21.15.88:0/3042715310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52880fbaf0 0x7f5288110290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f527c00b790 tx=0x7f527c009220 comp rx=0 tx=0).stop 2023-12-09T02:40:01.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.137+0000 7f528dd7e700 1 -- 172.21.15.88:0/3042715310 shutdown_connections 2023-12-09T02:40:01.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.137+0000 7f528dd7e700 1 --2- 172.21.15.88:0/3042715310 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f527006ce60 0x7f527006f310 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.137+0000 7f528dd7e700 1 --2- 172.21.15.88:0/3042715310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52880fbaf0 0x7f5288110290 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.137+0000 7f528dd7e700 1 --2- 172.21.15.88:0/3042715310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52880fcd00 0x7f52881127e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.137+0000 7f528dd7e700 1 -- 172.21.15.88:0/3042715310 >> 172.21.15.88:0/3042715310 conn(0x7f52880f7190 msgr2=0x7f52880fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:01.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.138+0000 7f528dd7e700 1 -- 172.21.15.88:0/3042715310 shutdown_connections 2023-12-09T02:40:01.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.138+0000 7f528dd7e700 1 -- 172.21.15.88:0/3042715310 wait complete. 2023-12-09T02:40:01.150 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:40:01.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.238+0000 7f9f19c1a700 1 -- 172.21.15.88:0/3185465672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f141020e0 msgr2=0x7f9f141044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.238+0000 7f9f19c1a700 1 --2- 172.21.15.88:0/3185465672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f141020e0 0x7f9f141044c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f08004940 tx=0x7f9f08009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:01.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.238+0000 7f9f19c1a700 1 -- 172.21.15.88:0/3185465672 shutdown_connections 2023-12-09T02:40:01.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.238+0000 7f9f19c1a700 1 --2- 172.21.15.88:0/3185465672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f141020e0 0x7f9f141044c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.238+0000 7f9f19c1a700 1 --2- 172.21.15.88:0/3185465672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f14066920 0x7f9f14101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.238+0000 7f9f19c1a700 1 -- 172.21.15.88:0/3185465672 >> 172.21.15.88:0/3185465672 conn(0x7f9f140f71b0 msgr2=0x7f9f140f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.238+0000 7f9f19c1a700 1 -- 172.21.15.88:0/3185465672 shutdown_connections 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.238+0000 7f9f19c1a700 1 -- 172.21.15.88:0/3185465672 wait complete. 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.239+0000 7f9f19c1a700 1 Processor -- start 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.239+0000 7f9f19c1a700 1 -- start start 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.239+0000 7f9f19c1a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f14066920 0x7f9f1410f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.239+0000 7f9f19c1a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f141020e0 0x7f9f1410fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.239+0000 7f9f19c1a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f141103b0 con 0x7f9f141020e0 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.239+0000 7f9f19c1a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f14110c50 con 0x7f9f14066920 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.239+0000 7f9f12ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f141020e0 0x7f9f1410fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.239+0000 7f9f12ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f141020e0 0x7f9f1410fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35992/0 (socket says 172.21.15.88:35992) 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.239+0000 7f9f12ffd700 1 -- 172.21.15.88:0/2455735136 learned_addr learned my addr 172.21.15.88:0/2455735136 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.239+0000 7f9f137fe700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f14066920 0x7f9f1410f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.240+0000 7f9f12ffd700 1 -- 172.21.15.88:0/2455735136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f14066920 msgr2=0x7f9f1410f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.240+0000 7f9f12ffd700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f14066920 0x7f9f1410f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.240+0000 7f9f12ffd700 1 -- 172.21.15.88:0/2455735136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f08005040 con 0x7f9f141020e0 2023-12-09T02:40:01.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.240+0000 7f9f137fe700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f14066920 0x7f9f1410f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:40:01.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.240+0000 7f9f12ffd700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f141020e0 0x7f9f1410fdb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f08000c00 tx=0x7f9f08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:01.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.240+0000 7f9efbfff700 1 -- 172.21.15.88:0/2455735136 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f0800e040 con 0x7f9f141020e0 2023-12-09T02:40:01.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.240+0000 7f9f19c1a700 1 -- 172.21.15.88:0/2455735136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f14110ed0 con 0x7f9f141020e0 2023-12-09T02:40:01.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.240+0000 7f9efbfff700 1 -- 172.21.15.88:0/2455735136 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9f08009af0 con 0x7f9f141020e0 2023-12-09T02:40:01.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.240+0000 7f9efbfff700 1 -- 172.21.15.88:0/2455735136 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f0801c630 con 0x7f9f141020e0 2023-12-09T02:40:01.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.240+0000 7f9f19c1a700 1 -- 172.21.15.88:0/2455735136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f14111410 con 0x7f9f141020e0 2023-12-09T02:40:01.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.241+0000 7f9f19c1a700 1 -- 172.21.15.88:0/2455735136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f141096f0 con 0x7f9f141020e0 2023-12-09T02:40:01.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.241+0000 7f9efbfff700 1 -- 172.21.15.88:0/2455735136 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f9f0800bcd0 con 0x7f9f141020e0 2023-12-09T02:40:01.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.242+0000 7f9efbfff700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f9efc06ce60 0x7f9efc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:01.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.242+0000 7f9efbfff700 1 -- 172.21.15.88:0/2455735136 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f9f0808d900 con 0x7f9f141020e0 2023-12-09T02:40:01.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.242+0000 7f9f137fe700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f9efc06ce60 0x7f9efc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:01.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.242+0000 7f9f137fe700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f9efc06ce60 0x7f9efc06f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009b80 tx=0x7f9f0400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:01.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.246+0000 7f9efbfff700 1 -- 172.21.15.88:0/2455735136 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9f0805b1f0 con 0x7f9f141020e0 2023-12-09T02:40:01.420 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:00 smithi161 systemd[1]: Stopping Ceph osd.5 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:40:01.420 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:01 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[144877]: 2023-12-09T02:40:01.158+0000 7fb3f7446700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:40:01.420 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:01 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[144877]: 2023-12-09T02:40:01.158+0000 7fb3f7446700 -1 osd.5 98 *** Got signal Terminated *** 2023-12-09T02:40:01.420 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:01 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[144877]: 2023-12-09T02:40:01.158+0000 7fb3f7446700 -1 osd.5 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:40:01.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.454+0000 7f9f19c1a700 1 -- 172.21.15.88:0/2455735136 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f14107940 con 0x7f9efc06ce60 2023-12-09T02:40:01.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.455+0000 7f9efbfff700 1 -- 172.21.15.88:0/2455735136 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9f14107940 con 0x7f9efc06ce60 2023-12-09T02:40:01.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.457+0000 7f9f19c1a700 1 -- 172.21.15.88:0/2455735136 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f9efc06ce60 msgr2=0x7f9efc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.457+0000 7f9f19c1a700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f9efc06ce60 0x7f9efc06f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009b80 tx=0x7f9f0400b040 comp rx=0 tx=0).stop 2023-12-09T02:40:01.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.457+0000 7f9f19c1a700 1 -- 172.21.15.88:0/2455735136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f141020e0 msgr2=0x7f9f1410fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.457+0000 7f9f19c1a700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f141020e0 0x7f9f1410fdb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f08000c00 tx=0x7f9f08009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:01.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.457+0000 7f9f19c1a700 1 -- 172.21.15.88:0/2455735136 shutdown_connections 2023-12-09T02:40:01.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.457+0000 7f9f19c1a700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f9efc06ce60 0x7f9efc06f310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.457+0000 7f9f19c1a700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f14066920 0x7f9f1410f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.457+0000 7f9f19c1a700 1 --2- 172.21.15.88:0/2455735136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f141020e0 0x7f9f1410fdb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.457+0000 7f9f19c1a700 1 -- 172.21.15.88:0/2455735136 >> 172.21.15.88:0/2455735136 conn(0x7f9f140f71b0 msgr2=0x7f9f140f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:01.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.457+0000 7f9f19c1a700 1 -- 172.21.15.88:0/2455735136 shutdown_connections 2023-12-09T02:40:01.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.457+0000 7f9f19c1a700 1 -- 172.21.15.88:0/2455735136 wait complete. 2023-12-09T02:40:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.566+0000 7f41d01fb700 1 -- 172.21.15.88:0/1430508689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c80fcd00 msgr2=0x7f41c80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.566+0000 7f41d01fb700 1 --2- 172.21.15.88:0/1430508689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c80fcd00 0x7f41c80fd150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41bc004940 tx=0x7f41bc009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.566+0000 7f41d01fb700 1 -- 172.21.15.88:0/1430508689 shutdown_connections 2023-12-09T02:40:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.566+0000 7f41d01fb700 1 --2- 172.21.15.88:0/1430508689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c80fcd00 0x7f41c80fd150 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.566+0000 7f41d01fb700 1 --2- 172.21.15.88:0/1430508689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41c80fbaf0 0x7f41c80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.566+0000 7f41d01fb700 1 -- 172.21.15.88:0/1430508689 >> 172.21.15.88:0/1430508689 conn(0x7f41c80f7190 msgr2=0x7f41c80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.566+0000 7f41d01fb700 1 -- 172.21.15.88:0/1430508689 shutdown_connections 2023-12-09T02:40:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.566+0000 7f41d01fb700 1 -- 172.21.15.88:0/1430508689 wait complete. 2023-12-09T02:40:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.566+0000 7f41d01fb700 1 Processor -- start 2023-12-09T02:40:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.566+0000 7f41d01fb700 1 -- start start 2023-12-09T02:40:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41d01fb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c80fbaf0 0x7f41c810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41d01fb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41c80fcd00 0x7f41c810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41d01fb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c810e130 con 0x7f41c80fbaf0 2023-12-09T02:40:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41d01fb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c810e970 con 0x7f41c80fcd00 2023-12-09T02:40:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41cdf97700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c80fbaf0 0x7f41c810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41cdf97700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c80fbaf0 0x7f41c810d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36006/0 (socket says 172.21.15.88:36006) 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41cdf97700 1 -- 172.21.15.88:0/593059992 learned_addr learned my addr 172.21.15.88:0/593059992 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41cd796700 1 --2- 172.21.15.88:0/593059992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41c80fcd00 0x7f41c810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41cdf97700 1 -- 172.21.15.88:0/593059992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41c80fcd00 msgr2=0x7f41c810daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41cdf97700 1 --2- 172.21.15.88:0/593059992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41c80fcd00 0x7f41c810daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41cdf97700 1 -- 172.21.15.88:0/593059992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc005040 con 0x7f41c80fbaf0 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41cdf97700 1 --2- 172.21.15.88:0/593059992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c80fbaf0 0x7f41c810d560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f41c400b790 tx=0x7f41c4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41ba7fc700 1 -- 172.21.15.88:0/593059992 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41c400f6f0 con 0x7f41c80fbaf0 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41ba7fc700 1 -- 172.21.15.88:0/593059992 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f41c400fd00 con 0x7f41c80fbaf0 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41d01fb700 1 -- 172.21.15.88:0/593059992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c810ec50 con 0x7f41c80fbaf0 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41ba7fc700 1 -- 172.21.15.88:0/593059992 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41c4011e90 con 0x7f41c80fbaf0 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.567+0000 7f41d01fb700 1 -- 172.21.15.88:0/593059992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c810f190 con 0x7f41c80fbaf0 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.569+0000 7f41d01fb700 1 -- 172.21.15.88:0/593059992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c804bb80 con 0x7f41c80fbaf0 2023-12-09T02:40:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.569+0000 7f41ba7fc700 1 -- 172.21.15.88:0/593059992 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f41c400f850 con 0x7f41c80fbaf0 2023-12-09T02:40:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.569+0000 7f41ba7fc700 1 --2- 172.21.15.88:0/593059992 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f41b406ce60 0x7f41b406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.569+0000 7f41ba7fc700 1 -- 172.21.15.88:0/593059992 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f41c408c1a0 con 0x7f41c80fbaf0 2023-12-09T02:40:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.569+0000 7f41cd796700 1 --2- 172.21.15.88:0/593059992 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f41b406ce60 0x7f41b406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.570+0000 7f41cd796700 1 --2- 172.21.15.88:0/593059992 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f41b406ce60 0x7f41b406f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41bc004890 tx=0x7f41bc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.574+0000 7f41ba7fc700 1 -- 172.21.15.88:0/593059992 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f41c4059aa0 con 0x7f41c80fbaf0 2023-12-09T02:40:01.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.773+0000 7f41d01fb700 1 -- 172.21.15.88:0/593059992 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f41c810f610 con 0x7f41b406ce60 2023-12-09T02:40:01.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.783+0000 7f41ba7fc700 1 -- 172.21.15.88:0/593059992 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f41c810f610 con 0x7f41b406ce60 2023-12-09T02:40:01.785 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:40:01.785 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (4m) 79s ago 10m 28.5M - 0.25.0 c8568f914cd2 9dc2b8db0963 2023-12-09T02:40:01.785 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (2m) 79s ago 11m 7470k - 19.0.0-44-g9dcc13bb f28f2b94f153 bf03eec19a86 2023-12-09T02:40:01.785 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (2m) 23s ago 10m 7453k - 19.0.0-44-g9dcc13bb f28f2b94f153 890646e8cd90 2023-12-09T02:40:01.786 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (4m) 79s ago 10m 92.5M - 9.4.7 954c08fa6188 ab4c3f64ce4d 2023-12-09T02:40:01.786 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (7m) 79s ago 7m 14.8M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:40:01.786 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (7m) 79s ago 7m 16.1M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:40:01.786 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (7m) 23s ago 7m 10.1G - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:40:01.786 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (7m) 23s ago 7m 16.2M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:40:01.786 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:8443,9283,8765 running (4m) 79s ago 12m 512M - 19.0.0-44-g9dcc13bb f28f2b94f153 a939ff288750 2023-12-09T02:40:01.786 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283,8765 running (3m) 23s ago 10m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 e2ee2a6eb30b 2023-12-09T02:40:01.787 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (3m) 79s ago 12m 67.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 8e4b2ba7b37c 2023-12-09T02:40:01.787 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (3m) 23s ago 10m 58.5M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 4769966a784f 2023-12-09T02:40:01.787 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (4m) 79s ago 11m 18.1M - 1.5.0 0da6a335fe13 e2b7cc0b7527 2023-12-09T02:40:01.787 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (4m) 23s ago 10m 17.7M - 1.5.0 0da6a335fe13 0de833ab198e 2023-12-09T02:40:01.787 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (2m) 79s ago 9m 192M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 88f0691c638a 2023-12-09T02:40:01.787 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (114s) 79s ago 9m 131M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 8bb8d12931bb 2023-12-09T02:40:01.787 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (83s) 79s ago 9m 12.9M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 e623b21addf0 2023-12-09T02:40:01.788 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (54s) 23s ago 8m 134M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 6cd16a89f874 2023-12-09T02:40:01.788 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (25s) 23s ago 8m 13.0M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 103a8409c9c8 2023-12-09T02:40:01.788 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (8m) 23s ago 8m 1163M 2592M 17.2.7-119-ge2143d99 f761b6e42225 17dd088b0804 2023-12-09T02:40:01.788 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (3m) 79s ago 10m 51.3M - 2.43.0 a07b618ecd1d ddb1fb2e1888 2023-12-09T02:40:01.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.785+0000 7f41d01fb700 1 -- 172.21.15.88:0/593059992 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f41b406ce60 msgr2=0x7f41b406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.785+0000 7f41d01fb700 1 --2- 172.21.15.88:0/593059992 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f41b406ce60 0x7f41b406f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41bc004890 tx=0x7f41bc009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:01.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.785+0000 7f41d01fb700 1 -- 172.21.15.88:0/593059992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c80fbaf0 msgr2=0x7f41c810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.785+0000 7f41d01fb700 1 --2- 172.21.15.88:0/593059992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c80fbaf0 0x7f41c810d560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f41c400b790 tx=0x7f41c4009220 comp rx=0 tx=0).stop 2023-12-09T02:40:01.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.785+0000 7f41d01fb700 1 -- 172.21.15.88:0/593059992 shutdown_connections 2023-12-09T02:40:01.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.785+0000 7f41d01fb700 1 --2- 172.21.15.88:0/593059992 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f41b406ce60 0x7f41b406f310 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.785+0000 7f41d01fb700 1 --2- 172.21.15.88:0/593059992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c80fbaf0 0x7f41c810d560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.785+0000 7f41d01fb700 1 --2- 172.21.15.88:0/593059992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41c80fcd00 0x7f41c810daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.785+0000 7f41d01fb700 1 -- 172.21.15.88:0/593059992 >> 172.21.15.88:0/593059992 conn(0x7f41c80f7190 msgr2=0x7f41c8065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:01.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.785+0000 7f41d01fb700 1 -- 172.21.15.88:0/593059992 shutdown_connections 2023-12-09T02:40:01.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.785+0000 7f41d01fb700 1 -- 172.21.15.88:0/593059992 wait complete. 2023-12-09T02:40:01.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.883+0000 7f1e2f187700 1 -- 172.21.15.88:0/2787397240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e280fbaf0 msgr2=0x7f1e280fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.883+0000 7f1e2f187700 1 --2- 172.21.15.88:0/2787397240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e280fbaf0 0x7f1e280fbf00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c004940 tx=0x7f1e1c009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:01.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.883+0000 7f1e2f187700 1 -- 172.21.15.88:0/2787397240 shutdown_connections 2023-12-09T02:40:01.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.883+0000 7f1e2f187700 1 --2- 172.21.15.88:0/2787397240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e280fcd00 0x7f1e280fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.883+0000 7f1e2f187700 1 --2- 172.21.15.88:0/2787397240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e280fbaf0 0x7f1e280fbf00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.883+0000 7f1e2f187700 1 -- 172.21.15.88:0/2787397240 >> 172.21.15.88:0/2787397240 conn(0x7f1e280f7190 msgr2=0x7f1e280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:01.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.883+0000 7f1e2f187700 1 -- 172.21.15.88:0/2787397240 shutdown_connections 2023-12-09T02:40:01.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.883+0000 7f1e2f187700 1 -- 172.21.15.88:0/2787397240 wait complete. 2023-12-09T02:40:01.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2f187700 1 Processor -- start 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2f187700 1 -- start start 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2f187700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e280fbaf0 0x7f1e281102a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2f187700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e280fcd00 0x7f1e281127f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2f187700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e28066130 con 0x7f1e280fbaf0 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2f187700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e28066270 con 0x7f1e280fcd00 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2cf23700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e280fbaf0 0x7f1e281102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2cf23700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e280fbaf0 0x7f1e281102a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36026/0 (socket says 172.21.15.88:36026) 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2cf23700 1 -- 172.21.15.88:0/80040695 learned_addr learned my addr 172.21.15.88:0/80040695 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e27fff700 1 --2- 172.21.15.88:0/80040695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e280fcd00 0x7f1e281127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2cf23700 1 -- 172.21.15.88:0/80040695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e280fcd00 msgr2=0x7f1e281127f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2cf23700 1 --2- 172.21.15.88:0/80040695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e280fcd00 0x7f1e281127f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.884+0000 7f1e2cf23700 1 -- 172.21.15.88:0/80040695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c005040 con 0x7f1e280fbaf0 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.885+0000 7f1e2cf23700 1 --2- 172.21.15.88:0/80040695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e280fbaf0 0x7f1e281102a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c000c00 tx=0x7f1e1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.885+0000 7f1e257fa700 1 -- 172.21.15.88:0/80040695 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e1c00e040 con 0x7f1e280fbaf0 2023-12-09T02:40:01.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.885+0000 7f1e2f187700 1 -- 172.21.15.88:0/80040695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e28112df0 con 0x7f1e280fbaf0 2023-12-09T02:40:01.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.885+0000 7f1e257fa700 1 -- 172.21.15.88:0/80040695 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e1c009af0 con 0x7f1e280fbaf0 2023-12-09T02:40:01.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.885+0000 7f1e257fa700 1 -- 172.21.15.88:0/80040695 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e1c01c630 con 0x7f1e280fbaf0 2023-12-09T02:40:01.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.885+0000 7f1e2f187700 1 -- 172.21.15.88:0/80040695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e28113250 con 0x7f1e280fbaf0 2023-12-09T02:40:01.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.886+0000 7f1e2f187700 1 -- 172.21.15.88:0/80040695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e281064f0 con 0x7f1e280fbaf0 2023-12-09T02:40:01.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.886+0000 7f1e257fa700 1 -- 172.21.15.88:0/80040695 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f1e1c00bc50 con 0x7f1e280fbaf0 2023-12-09T02:40:01.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.887+0000 7f1e257fa700 1 --2- 172.21.15.88:0/80040695 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1e1806ce60 0x7f1e1806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:01.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.887+0000 7f1e27fff700 1 --2- 172.21.15.88:0/80040695 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1e1806ce60 0x7f1e1806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:01.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.887+0000 7f1e257fa700 1 -- 172.21.15.88:0/80040695 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f1e1c08d830 con 0x7f1e280fbaf0 2023-12-09T02:40:01.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.887+0000 7f1e27fff700 1 --2- 172.21.15.88:0/80040695 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1e1806ce60 0x7f1e1806f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1e14004f60 tx=0x7f1e1400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:01.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:01.891+0000 7f1e257fa700 1 -- 172.21.15.88:0/80040695 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1e1c0575e0 con 0x7f1e280fbaf0 2023-12-09T02:40:01.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:01 smithi161 ceph-mon[178840]: pgmap v153: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:40:01.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:01 smithi161 ceph-mon[178840]: osd.5 marked itself down and dead 2023-12-09T02:40:01.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:01 smithi088 ceph-mon[193406]: pgmap v153: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:40:01.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:01 smithi088 ceph-mon[193406]: osd.5 marked itself down and dead 2023-12-09T02:40:02.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.159+0000 7f1e2f187700 1 -- 172.21.15.88:0/80040695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e2804bb80 con 0x7f1e280fbaf0 2023-12-09T02:40:02.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.159+0000 7f1e257fa700 1 -- 172.21.15.88:0/80040695 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+720 (secure 0 0 0) 0x7f1e1c05ac00 con 0x7f1e280fbaf0 2023-12-09T02:40:02.161 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 5 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:40:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:40:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4, 2023-12-09T02:40:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 9 2023-12-09T02:40:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:40:02.163 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:40:02.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.161+0000 7f1e2f187700 1 -- 172.21.15.88:0/80040695 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1e1806ce60 msgr2=0x7f1e1806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.161+0000 7f1e2f187700 1 --2- 172.21.15.88:0/80040695 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1e1806ce60 0x7f1e1806f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1e14004f60 tx=0x7f1e1400b040 comp rx=0 tx=0).stop 2023-12-09T02:40:02.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.161+0000 7f1e2f187700 1 -- 172.21.15.88:0/80040695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e280fbaf0 msgr2=0x7f1e281102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.161+0000 7f1e2f187700 1 --2- 172.21.15.88:0/80040695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e280fbaf0 0x7f1e281102a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c000c00 tx=0x7f1e1c009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:02.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.162+0000 7f1e2f187700 1 -- 172.21.15.88:0/80040695 shutdown_connections 2023-12-09T02:40:02.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.162+0000 7f1e2f187700 1 --2- 172.21.15.88:0/80040695 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f1e1806ce60 0x7f1e1806f310 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.162+0000 7f1e2f187700 1 --2- 172.21.15.88:0/80040695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e280fbaf0 0x7f1e281102a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.162+0000 7f1e2f187700 1 --2- 172.21.15.88:0/80040695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e280fcd00 0x7f1e281127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.162+0000 7f1e2f187700 1 -- 172.21.15.88:0/80040695 >> 172.21.15.88:0/80040695 conn(0x7f1e280f7190 msgr2=0x7f1e280f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:02.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.162+0000 7f1e2f187700 1 -- 172.21.15.88:0/80040695 shutdown_connections 2023-12-09T02:40:02.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.162+0000 7f1e2f187700 1 -- 172.21.15.88:0/80040695 wait complete. 2023-12-09T02:40:02.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.261+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/1064292677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24066920 msgr2=0x7f3e240ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.261+0000 7f3e2b3d2700 1 --2- 172.21.15.88:0/1064292677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24066920 0x7f3e240ff7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3e14004940 tx=0x7f3e14009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:02.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.261+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/1064292677 shutdown_connections 2023-12-09T02:40:02.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.261+0000 7f3e2b3d2700 1 --2- 172.21.15.88:0/1064292677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e240ffd70 0x7f3e241021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.261+0000 7f3e2b3d2700 1 --2- 172.21.15.88:0/1064292677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24066920 0x7f3e240ff7a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.261+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/1064292677 >> 172.21.15.88:0/1064292677 conn(0x7f3e240f71b0 msgr2=0x7f3e240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:02.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.261+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/1064292677 shutdown_connections 2023-12-09T02:40:02.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.261+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/1064292677 wait complete. 2023-12-09T02:40:02.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2b3d2700 1 Processor -- start 2023-12-09T02:40:02.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2b3d2700 1 -- start start 2023-12-09T02:40:02.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2b3d2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e24066920 0x7f3e2410d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:02.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2b3d2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e240ffd70 0x7f3e2410da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:02.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2b3d2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2410e090 con 0x7f3e240ffd70 2023-12-09T02:40:02.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2b3d2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2410e930 con 0x7f3e24066920 2023-12-09T02:40:02.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2896d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e240ffd70 0x7f3e2410da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:02.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2896d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e240ffd70 0x7f3e2410da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36036/0 (socket says 172.21.15.88:36036) 2023-12-09T02:40:02.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2896d700 1 -- 172.21.15.88:0/722355133 learned_addr learned my addr 172.21.15.88:0/722355133 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:02.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2916e700 1 --2- 172.21.15.88:0/722355133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e24066920 0x7f3e2410d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:02.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2896d700 1 -- 172.21.15.88:0/722355133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e24066920 msgr2=0x7f3e2410d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2896d700 1 --2- 172.21.15.88:0/722355133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e24066920 0x7f3e2410d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.262+0000 7f3e2896d700 1 -- 172.21.15.88:0/722355133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e14005040 con 0x7f3e240ffd70 2023-12-09T02:40:02.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.263+0000 7f3e2896d700 1 --2- 172.21.15.88:0/722355133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e240ffd70 0x7f3e2410da90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3e20002a50 tx=0x7f3e20004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:02.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.263+0000 7f3e19ffb700 1 -- 172.21.15.88:0/722355133 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e20007cc0 con 0x7f3e240ffd70 2023-12-09T02:40:02.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.263+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/722355133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2410ec10 con 0x7f3e240ffd70 2023-12-09T02:40:02.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.263+0000 7f3e19ffb700 1 -- 172.21.15.88:0/722355133 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3e2000f040 con 0x7f3e240ffd70 2023-12-09T02:40:02.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.263+0000 7f3e19ffb700 1 -- 172.21.15.88:0/722355133 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e2000d920 con 0x7f3e240ffd70 2023-12-09T02:40:02.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.263+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/722355133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2410f150 con 0x7f3e240ffd70 2023-12-09T02:40:02.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.264+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/722355133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e241075e0 con 0x7f3e240ffd70 2023-12-09T02:40:02.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.264+0000 7f3e19ffb700 1 -- 172.21.15.88:0/722355133 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f3e20009680 con 0x7f3e240ffd70 2023-12-09T02:40:02.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.264+0000 7f3e19ffb700 1 --2- 172.21.15.88:0/722355133 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3e1006ce70 0x7f3e1006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:02.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.265+0000 7f3e19ffb700 1 -- 172.21.15.88:0/722355133 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f3e2008c1d0 con 0x7f3e240ffd70 2023-12-09T02:40:02.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.265+0000 7f3e2916e700 1 --2- 172.21.15.88:0/722355133 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3e1006ce70 0x7f3e1006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:02.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.265+0000 7f3e2916e700 1 --2- 172.21.15.88:0/722355133 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3e1006ce70 0x7f3e1006f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e140043d0 tx=0x7f3e14009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:02.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.269+0000 7f3e19ffb700 1 -- 172.21.15.88:0/722355133 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3e20059990 con 0x7f3e240ffd70 2023-12-09T02:40:02.419 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:02 smithi161 bash[203472]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5 2023-12-09T02:40:02.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.516+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/722355133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3e2404bb80 con 0x7f3e240ffd70 2023-12-09T02:40:02.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.517+0000 7f3e19ffb700 1 -- 172.21.15.88:0/722355133 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f3e20059520 con 0x7f3e240ffd70 2023-12-09T02:40:02.522 INFO:teuthology.orchestra.run.smithi088.stdout:e14 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 14 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-09T02:32:49.115700+0000 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-12-09T02:33:01.255575+0000 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2023-12-09T02:40:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 46 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24251} 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2023-12-09T02:40:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2023-12-09T02:40:02.525 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2023-12-09T02:40:02.525 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2023-12-09T02:40:02.525 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2023-12-09T02:40:02.525 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.dhvdif{0:24251} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.161:6824/3342684425,v1:172.21.15.161:6825/3342684425] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:40:02.525 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:40:02.525 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:40:02.525 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2023-12-09T02:40:02.525 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:40:02.525 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.zfojux{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.88:6828/1027941625,v1:172.21.15.88:6829/1027941625] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:40:02.525 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.utskxh{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/130622055,v1:172.21.15.88:6827/130622055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:40:02.525 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi161.posrbq{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/1570309399,v1:172.21.15.161:6827/1570309399] compat {c=[1],r=[1],i=[7ff]}] 2023-12-09T02:40:02.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.521+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/722355133 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3e1006ce70 msgr2=0x7f3e1006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.521+0000 7f3e2b3d2700 1 --2- 172.21.15.88:0/722355133 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3e1006ce70 0x7f3e1006f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e140043d0 tx=0x7f3e14009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:02.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.521+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/722355133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e240ffd70 msgr2=0x7f3e2410da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.521+0000 7f3e2b3d2700 1 --2- 172.21.15.88:0/722355133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e240ffd70 0x7f3e2410da90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3e20002a50 tx=0x7f3e20004600 comp rx=0 tx=0).stop 2023-12-09T02:40:02.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.521+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/722355133 shutdown_connections 2023-12-09T02:40:02.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.521+0000 7f3e2b3d2700 1 --2- 172.21.15.88:0/722355133 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f3e1006ce70 0x7f3e1006f320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.521+0000 7f3e2b3d2700 1 --2- 172.21.15.88:0/722355133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e24066920 0x7f3e2410d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.521+0000 7f3e2b3d2700 1 --2- 172.21.15.88:0/722355133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e240ffd70 0x7f3e2410da90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.521+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/722355133 >> 172.21.15.88:0/722355133 conn(0x7f3e240f71b0 msgr2=0x7f3e240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:02.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.521+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/722355133 shutdown_connections 2023-12-09T02:40:02.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.521+0000 7f3e2b3d2700 1 -- 172.21.15.88:0/722355133 wait complete. 2023-12-09T02:40:02.527 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-12-09T02:40:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.622+0000 7fc05494b700 1 -- 172.21.15.88:0/2047797459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0500fb950 msgr2=0x7fc0500fe200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.622+0000 7fc05494b700 1 --2- 172.21.15.88:0/2047797459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0500fb950 0x7fc0500fe200 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc040004940 tx=0x7fc040009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.622+0000 7fc05494b700 1 -- 172.21.15.88:0/2047797459 shutdown_connections 2023-12-09T02:40:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.622+0000 7fc05494b700 1 --2- 172.21.15.88:0/2047797459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0500fb950 0x7fc0500fe200 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.622+0000 7fc05494b700 1 --2- 172.21.15.88:0/2047797459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0500faf70 0x7fc0500fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.622+0000 7fc05494b700 1 -- 172.21.15.88:0/2047797459 >> 172.21.15.88:0/2047797459 conn(0x7fc0500f6950 msgr2=0x7fc0500f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.622+0000 7fc05494b700 1 -- 172.21.15.88:0/2047797459 shutdown_connections 2023-12-09T02:40:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.622+0000 7fc05494b700 1 -- 172.21.15.88:0/2047797459 wait complete. 2023-12-09T02:40:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc05494b700 1 Processor -- start 2023-12-09T02:40:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc05494b700 1 -- start start 2023-12-09T02:40:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc05494b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0500faf70 0x7fc05010d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc05494b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05010dd50 0x7fc05010ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc05494b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05010e210 con 0x7fc0500faf70 2023-12-09T02:40:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc05494b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05010e350 con 0x7fc05010dd50 2023-12-09T02:40:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0500faf70 0x7fc05010d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0500faf70 0x7fc05010d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36054/0 (socket says 172.21.15.88:36054) 2023-12-09T02:40:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc04e59c700 1 -- 172.21.15.88:0/3287903515 learned_addr learned my addr 172.21.15.88:0/3287903515 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc04dd9b700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05010dd50 0x7fc05010ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc04e59c700 1 -- 172.21.15.88:0/3287903515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05010dd50 msgr2=0x7fc05010ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc04e59c700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05010dd50 0x7fc05010ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.623+0000 7fc04e59c700 1 -- 172.21.15.88:0/3287903515 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc040005040 con 0x7fc0500faf70 2023-12-09T02:40:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.624+0000 7fc04dd9b700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05010dd50 0x7fc05010ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:40:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.624+0000 7fc04e59c700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0500faf70 0x7fc05010d810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc04400c8c0 tx=0x7fc0440044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.624+0000 7fc03effd700 1 -- 172.21.15.88:0/3287903515 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc04400a980 con 0x7fc0500faf70 2023-12-09T02:40:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.624+0000 7fc03effd700 1 -- 172.21.15.88:0/3287903515 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc04400ce60 con 0x7fc0500faf70 2023-12-09T02:40:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.624+0000 7fc05494b700 1 -- 172.21.15.88:0/3287903515 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05010f250 con 0x7fc0500faf70 2023-12-09T02:40:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.624+0000 7fc03effd700 1 -- 172.21.15.88:0/3287903515 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0440113a0 con 0x7fc0500faf70 2023-12-09T02:40:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.624+0000 7fc05494b700 1 -- 172.21.15.88:0/3287903515 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05010f760 con 0x7fc0500faf70 2023-12-09T02:40:02.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.625+0000 7fc05494b700 1 -- 172.21.15.88:0/3287903515 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05010f9e0 con 0x7fc0500faf70 2023-12-09T02:40:02.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.625+0000 7fc03effd700 1 -- 172.21.15.88:0/3287903515 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fc044012400 con 0x7fc0500faf70 2023-12-09T02:40:02.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.626+0000 7fc03effd700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc03806ce70 0x7fc03806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:02.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.626+0000 7fc03effd700 1 -- 172.21.15.88:0/3287903515 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6848+0+0 (secure 0 0 0) 0x7fc04408c5d0 con 0x7fc0500faf70 2023-12-09T02:40:02.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.626+0000 7fc04dd9b700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc03806ce70 0x7fc03806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:02.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.626+0000 7fc04dd9b700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc03806ce70 0x7fc03806f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc04000b3b0 tx=0x7fc040009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:02.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.630+0000 7fc03effd700 1 -- 172.21.15.88:0/3287903515 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc044059dd0 con 0x7fc0500faf70 2023-12-09T02:40:02.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.837+0000 7fc05494b700 1 -- 172.21.15.88:0/3287903515 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc050105950 con 0x7fc03806ce70 2023-12-09T02:40:02.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.838+0000 7fc03effd700 1 -- 172.21.15.88:0/3287903515 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc050105950 con 0x7fc03806ce70 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "11/21 daemons upgraded", 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2023-12-09T02:40:02.841 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:40:02.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.840+0000 7fc05494b700 1 -- 172.21.15.88:0/3287903515 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc03806ce70 msgr2=0x7fc03806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.840+0000 7fc05494b700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc03806ce70 0x7fc03806f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc04000b3b0 tx=0x7fc040009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:02.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.840+0000 7fc05494b700 1 -- 172.21.15.88:0/3287903515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0500faf70 msgr2=0x7fc05010d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.840+0000 7fc05494b700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0500faf70 0x7fc05010d810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc04400c8c0 tx=0x7fc0440044c0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.840+0000 7fc05494b700 1 -- 172.21.15.88:0/3287903515 shutdown_connections 2023-12-09T02:40:02.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.840+0000 7fc05494b700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fc03806ce70 0x7fc03806f320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.840+0000 7fc05494b700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0500faf70 0x7fc05010d810 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.840+0000 7fc05494b700 1 --2- 172.21.15.88:0/3287903515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05010dd50 0x7fc05010ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.840+0000 7fc05494b700 1 -- 172.21.15.88:0/3287903515 >> 172.21.15.88:0/3287903515 conn(0x7fc0500f6950 msgr2=0x7fc0501013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:02.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.841+0000 7fc05494b700 1 -- 172.21.15.88:0/3287903515 shutdown_connections 2023-12-09T02:40:02.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.841+0000 7fc05494b700 1 -- 172.21.15.88:0/3287903515 wait complete. 2023-12-09T02:40:02.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:02 smithi161 ceph-mon[178840]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:02.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:02 smithi161 ceph-mon[178840]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:02.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:02 smithi161 ceph-mon[178840]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:40:02.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:02 smithi161 ceph-mon[178840]: osdmap e99: 6 total, 5 up, 6 in 2023-12-09T02:40:02.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:02 smithi161 ceph-mon[178840]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:02.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:02 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/80040695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.940+0000 7fa690f3f700 1 -- 172.21.15.88:0/2048029664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa68c0fbaf0 msgr2=0x7fa68c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.940+0000 7fa690f3f700 1 --2- 172.21.15.88:0/2048029664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa68c0fbaf0 0x7fa68c0fbf00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa67c004940 tx=0x7fa67c009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.940+0000 7fa690f3f700 1 -- 172.21.15.88:0/2048029664 shutdown_connections 2023-12-09T02:40:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.940+0000 7fa690f3f700 1 --2- 172.21.15.88:0/2048029664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c0fcd00 0x7fa68c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.940+0000 7fa690f3f700 1 --2- 172.21.15.88:0/2048029664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa68c0fbaf0 0x7fa68c0fbf00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.940+0000 7fa690f3f700 1 -- 172.21.15.88:0/2048029664 >> 172.21.15.88:0/2048029664 conn(0x7fa68c0f7190 msgr2=0x7fa68c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.940+0000 7fa690f3f700 1 -- 172.21.15.88:0/2048029664 shutdown_connections 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.940+0000 7fa690f3f700 1 -- 172.21.15.88:0/2048029664 wait complete. 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.941+0000 7fa690f3f700 1 Processor -- start 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.941+0000 7fa690f3f700 1 -- start start 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.941+0000 7fa690f3f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa68c0fbaf0 0x7fa68c0ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.941+0000 7fa690f3f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c0fcd00 0x7fa68c0fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.941+0000 7fa690f3f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0fe6d0 con 0x7fa68c0fbaf0 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.941+0000 7fa690f3f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0fe840 con 0x7fa68c0fcd00 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.941+0000 7fa68a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa68c0fbaf0 0x7fa68c0ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.941+0000 7fa68a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa68c0fbaf0 0x7fa68c0ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36076/0 (socket says 172.21.15.88:36076) 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.941+0000 7fa68a59c700 1 -- 172.21.15.88:0/1188054811 learned_addr learned my addr 172.21.15.88:0/1188054811 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.941+0000 7fa689d9b700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c0fcd00 0x7fa68c0fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.942+0000 7fa68a59c700 1 -- 172.21.15.88:0/1188054811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c0fcd00 msgr2=0x7fa68c0fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.942+0000 7fa68a59c700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c0fcd00 0x7fa68c0fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.942+0000 7fa68a59c700 1 -- 172.21.15.88:0/1188054811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c005040 con 0x7fa68c0fbaf0 2023-12-09T02:40:02.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.942+0000 7fa689d9b700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c0fcd00 0x7fa68c0fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:40:02.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.942+0000 7fa68a59c700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa68c0fbaf0 0x7fa68c0ffbc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa67c004f90 tx=0x7fa67c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:02.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.942+0000 7fa67affd700 1 -- 172.21.15.88:0/1188054811 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c00e040 con 0x7fa68c0fbaf0 2023-12-09T02:40:02.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.942+0000 7fa67affd700 1 -- 172.21.15.88:0/1188054811 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa67c00bcd0 con 0x7fa68c0fbaf0 2023-12-09T02:40:02.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.942+0000 7fa67affd700 1 -- 172.21.15.88:0/1188054811 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c01c630 con 0x7fa68c0fbaf0 2023-12-09T02:40:02.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.942+0000 7fa690f3f700 1 -- 172.21.15.88:0/1188054811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c0feac0 con 0x7fa68c0fbaf0 2023-12-09T02:40:02.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.942+0000 7fa690f3f700 1 -- 172.21.15.88:0/1188054811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c1155a0 con 0x7fa68c0fbaf0 2023-12-09T02:40:02.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.943+0000 7fa690f3f700 1 -- 172.21.15.88:0/1188054811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c04bb80 con 0x7fa68c0fbaf0 2023-12-09T02:40:02.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.943+0000 7fa67affd700 1 -- 172.21.15.88:0/1188054811 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fa67c013960 con 0x7fa68c0fbaf0 2023-12-09T02:40:02.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.944+0000 7fa67affd700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fa67406ce60 0x7fa67406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:02.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.944+0000 7fa689d9b700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fa67406ce60 0x7fa67406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:02.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.944+0000 7fa67affd700 1 -- 172.21.15.88:0/1188054811 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6848+0+0 (secure 0 0 0) 0x7fa67c08d860 con 0x7fa68c0fbaf0 2023-12-09T02:40:02.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.944+0000 7fa689d9b700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fa67406ce60 0x7fa67406f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa680006fd0 tx=0x7fa680008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:02.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:02.948+0000 7fa67affd700 1 -- 172.21.15.88:0/1188054811 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa67c05b160 con 0x7fa68c0fbaf0 2023-12-09T02:40:02.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:02 smithi088 ceph-mon[193406]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:02.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:02 smithi088 ceph-mon[193406]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:02.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:02 smithi088 ceph-mon[193406]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-09T02:40:02.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:02 smithi088 ceph-mon[193406]: osdmap e99: 6 total, 5 up, 6 in 2023-12-09T02:40:02.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:02 smithi088 ceph-mon[193406]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:02.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:02 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/80040695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:03.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.215+0000 7fa690f3f700 1 -- 172.21.15.88:0/1188054811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa68c104510 con 0x7fa68c0fbaf0 2023-12-09T02:40:03.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.216+0000 7fa67affd700 1 -- 172.21.15.88:0/1188054811 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7fa67c05acf0 con 0x7fa68c0fbaf0 2023-12-09T02:40:03.218 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 osds down 2023-12-09T02:40:03.218 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-09T02:40:03.218 INFO:teuthology.orchestra.run.smithi088.stdout: osd.5 (root=default,host=smithi161) is down 2023-12-09T02:40:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.218+0000 7fa690f3f700 1 -- 172.21.15.88:0/1188054811 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fa67406ce60 msgr2=0x7fa67406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.218+0000 7fa690f3f700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fa67406ce60 0x7fa67406f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa680006fd0 tx=0x7fa680008040 comp rx=0 tx=0).stop 2023-12-09T02:40:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.218+0000 7fa690f3f700 1 -- 172.21.15.88:0/1188054811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa68c0fbaf0 msgr2=0x7fa68c0ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.218+0000 7fa690f3f700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa68c0fbaf0 0x7fa68c0ffbc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa67c004f90 tx=0x7fa67c009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.218+0000 7fa690f3f700 1 -- 172.21.15.88:0/1188054811 shutdown_connections 2023-12-09T02:40:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.218+0000 7fa690f3f700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fa67406ce60 0x7fa67406f310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.218+0000 7fa690f3f700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa68c0fbaf0 0x7fa68c0ffbc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.218+0000 7fa690f3f700 1 --2- 172.21.15.88:0/1188054811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c0fcd00 0x7fa68c0fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.218+0000 7fa690f3f700 1 -- 172.21.15.88:0/1188054811 >> 172.21.15.88:0/1188054811 conn(0x7fa68c0f7190 msgr2=0x7fa68c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.218+0000 7fa690f3f700 1 -- 172.21.15.88:0/1188054811 shutdown_connections 2023-12-09T02:40:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:03.218+0000 7fa690f3f700 1 -- 172.21.15.88:0/1188054811 wait complete. 2023-12-09T02:40:03.638 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:03 smithi161 systemd[1]: ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.5.service: Succeeded. 2023-12-09T02:40:03.639 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:03 smithi161 systemd[1]: Stopped Ceph osd.5 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:40:03.639 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:03 smithi161 systemd[1]: Starting Ceph osd.5 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:40:03.639 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:03 smithi161 ceph-mon[178840]: pgmap v155: 65 pgs: 13 stale+active+clean, 52 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:40:03.639 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:03 smithi161 ceph-mon[178840]: osdmap e100: 6 total, 5 up, 6 in 2023-12-09T02:40:03.639 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:03 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/722355133' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:40:03.639 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:03 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1188054811' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:40:03.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:03 smithi088 ceph-mon[193406]: pgmap v155: 65 pgs: 13 stale+active+clean, 52 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-09T02:40:03.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:03 smithi088 ceph-mon[193406]: osdmap e100: 6 total, 5 up, 6 in 2023-12-09T02:40:03.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:03 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/722355133' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-09T02:40:03.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:03 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1188054811' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:40:04.420 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:04 smithi161 bash[203741]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-09T02:40:04.420 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:04 smithi161 bash[203741]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-09T02:40:04.420 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:04 smithi161 bash[203741]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-09T02:40:04.421 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:04 smithi161 bash[203741]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-09T02:40:04.421 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:04 smithi161 bash[203741]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-09T02:40:04.421 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:04 smithi161 bash[203741]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-09T02:40:04.421 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:04 smithi161 bash[203741]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-09T02:40:04.757 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:04 smithi161 ceph-mon[178840]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:04.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:04 smithi088 ceph-mon[193406]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:05.170 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:04 smithi161 ceph-osd[204053]: -- 172.21.15.161:0/2508353039 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b77c7bf1e0 con 0x55b77c78f000 2023-12-09T02:40:05.170 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:04 smithi161 bash[204015]: 9620770b68bdd596583de0c690c3d531131bc6b418888ae4aa50701ab7cf6a43 2023-12-09T02:40:05.170 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:04 smithi161 systemd[1]: Started Ceph osd.5 for 70b26980-963a-11ee-95a3-87774f69a715. 2023-12-09T02:40:05.637 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:05 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:40:05.383+0000 7fb8d0ab6640 -1 Falling back to public interface 2023-12-09T02:40:05.637 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:05 smithi161 ceph-mon[178840]: pgmap v157: 65 pgs: 5 active+undersized, 5 active+undersized+degraded, 8 stale+active+clean, 47 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2023-12-09T02:40:05.638 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:05 smithi161 ceph-mon[178840]: Health check failed: Degraded data redundancy: 8/222 objects degraded (3.604%), 5 pgs degraded (PG_DEGRADED) 2023-12-09T02:40:05.638 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:05 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:05.638 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:05 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:05.638 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:05 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:40:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:05 smithi088 ceph-mon[193406]: pgmap v157: 65 pgs: 5 active+undersized, 5 active+undersized+degraded, 8 stale+active+clean, 47 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2023-12-09T02:40:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:05 smithi088 ceph-mon[193406]: Health check failed: Degraded data redundancy: 8/222 objects degraded (3.604%), 5 pgs degraded (PG_DEGRADED) 2023-12-09T02:40:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:05 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:05 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:05.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:05 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:40:07.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:07 smithi161 ceph-mon[178840]: pgmap v158: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-09T02:40:07.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:07 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:07.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:07 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:40:07.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:07 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:07.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:07 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:07.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:07 smithi088 ceph-mon[193406]: pgmap v158: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-09T02:40:07.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:07 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:07.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:07 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:40:07.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:07 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:07.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:07 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:08.803 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:08 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:08.803 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:08 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:08.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:08 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:08.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:08 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:09.882 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:09 smithi161 ceph-mon[178840]: pgmap v159: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-09T02:40:09.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:09 smithi088 ceph-mon[193406]: pgmap v159: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-09T02:40:10.169 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:09 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:40:09.879+0000 7fb8d0ab6640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-09T02:40:10.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:10 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:40:10.420+0000 7fb8d0ab6640 -1 osd.5 98 log_to_monitors true 2023-12-09T02:40:11.419 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:40:11.363+0000 7fb8bf722700 -1 osd.5 98 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-09T02:40:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:40:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:40:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:40:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:11.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: Upgrade: Setting container_image for all osd 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-09T02:40:11.421 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: pgmap v160: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:40:11.422 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.423 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='osd.5 [v2:172.21.15.161:6816/4178294049,v1:172.21.15.161:6817/4178294049]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-09T02:40:11.423 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:11 smithi161 ceph-mon[178840]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-09T02:40:11.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:40:11.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:40:11.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:40:11.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: Upgrade: Setting container_image for all osd 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-09T02:40:11.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: pgmap v160: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='osd.5 [v2:172.21.15.161:6816/4178294049,v1:172.21.15.161:6817/4178294049]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-09T02:40:11.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-mon[193406]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-09T02:40:11.479 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:11 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi088[193384]: 2023-12-09T02:40:11.335+0000 7fc2a443c700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-09T02:40:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:12 smithi161 ceph-mon[178840]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-09T02:40:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:12 smithi161 ceph-mon[178840]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-09T02:40:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:12 smithi161 ceph-mon[178840]: osdmap e101: 6 total, 5 up, 6 in 2023-12-09T02:40:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:12 smithi161 ceph-mon[178840]: from='osd.5 [v2:172.21.15.161:6816/4178294049,v1:172.21.15.161:6817/4178294049]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:40:12.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:12 smithi161 ceph-mon[178840]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:40:12.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:12 smithi088 ceph-mon[193406]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-09T02:40:12.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:12 smithi088 ceph-mon[193406]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-09T02:40:12.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:12 smithi088 ceph-mon[193406]: osdmap e101: 6 total, 5 up, 6 in 2023-12-09T02:40:12.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:12 smithi088 ceph-mon[193406]: from='osd.5 [v2:172.21.15.161:6816/4178294049,v1:172.21.15.161:6817/4178294049]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:40:12.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:12 smithi088 ceph-mon[193406]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-12-09T02:40:13.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:13 smithi161 ceph-mon[178840]: pgmap v162: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-09T02:40:13.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:13 smithi161 ceph-mon[178840]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:40:13.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:13 smithi161 ceph-mon[178840]: osd.5 [v2:172.21.15.161:6816/4178294049,v1:172.21.15.161:6817/4178294049] boot 2023-12-09T02:40:13.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:13 smithi161 ceph-mon[178840]: osdmap e102: 6 total, 6 up, 6 in 2023-12-09T02:40:13.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:13 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:40:13.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:13 smithi088 ceph-mon[193406]: pgmap v162: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-09T02:40:13.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:13 smithi088 ceph-mon[193406]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-09T02:40:13.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:13 smithi088 ceph-mon[193406]: osd.5 [v2:172.21.15.161:6816/4178294049,v1:172.21.15.161:6817/4178294049] boot 2023-12-09T02:40:13.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:13 smithi088 ceph-mon[193406]: osdmap e102: 6 total, 6 up, 6 in 2023-12-09T02:40:13.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:13 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-09T02:40:14.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:14 smithi161 ceph-mon[178840]: osdmap e103: 6 total, 6 up, 6 in 2023-12-09T02:40:14.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:14 smithi161 ceph-mon[178840]: Health check update: Degraded data redundancy: 39/222 objects degraded (17.568%), 14 pgs degraded (PG_DEGRADED) 2023-12-09T02:40:14.694 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:14 smithi088 ceph-mon[193406]: osdmap e103: 6 total, 6 up, 6 in 2023-12-09T02:40:14.694 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:14 smithi088 ceph-mon[193406]: Health check update: Degraded data redundancy: 39/222 objects degraded (17.568%), 14 pgs degraded (PG_DEGRADED) 2023-12-09T02:40:15.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:15 smithi161 ceph-mon[178840]: pgmap v165: 65 pgs: 3 peering, 15 active+undersized, 11 active+undersized+degraded, 36 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2023-12-09T02:40:15.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:15 smithi088 ceph-mon[193406]: pgmap v165: 65 pgs: 3 peering, 15 active+undersized, 11 active+undersized+degraded, 36 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2023-12-09T02:40:17.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:17 smithi161 ceph-mon[178840]: pgmap v166: 65 pgs: 3 peering, 9 active+undersized, 4 active+undersized+degraded, 49 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 9/222 objects degraded (4.054%) 2023-12-09T02:40:17.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:17 smithi088 ceph-mon[193406]: pgmap v166: 65 pgs: 3 peering, 9 active+undersized, 4 active+undersized+degraded, 49 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 9/222 objects degraded (4.054%) 2023-12-09T02:40:18.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:18 smithi161 ceph-mon[178840]: Health check update: Degraded data redundancy: 9/222 objects degraded (4.054%), 4 pgs degraded (PG_DEGRADED) 2023-12-09T02:40:18.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:18 smithi088 ceph-mon[193406]: Health check update: Degraded data redundancy: 9/222 objects degraded (4.054%), 4 pgs degraded (PG_DEGRADED) 2023-12-09T02:40:19.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:19 smithi161 ceph-mon[178840]: pgmap v167: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:19.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:19 smithi161 ceph-mon[178840]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/222 objects degraded (4.054%), 4 pgs degraded) 2023-12-09T02:40:19.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:19 smithi088 ceph-mon[193406]: pgmap v167: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:19.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:19 smithi088 ceph-mon[193406]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/222 objects degraded (4.054%), 4 pgs degraded) 2023-12-09T02:40:21.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:21 smithi161 ceph-mon[178840]: pgmap v168: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:21.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:21 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:21.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:21 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:40:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:21 smithi088 ceph-mon[193406]: pgmap v168: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:21 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:21 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:40:23.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:23 smithi161 ceph-mon[178840]: pgmap v169: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:23.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:23 smithi088 ceph-mon[193406]: pgmap v169: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:25.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:25 smithi161 ceph-mon[178840]: pgmap v170: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:25.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:25 smithi088 ceph-mon[193406]: pgmap v170: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:27.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:27 smithi088 ceph-mon[193406]: pgmap v171: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:27.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:27 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:27.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:27 smithi161 ceph-mon[178840]: pgmap v171: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:27.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:27 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:40:29.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:29 smithi161 ceph-mon[178840]: pgmap v172: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:29.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:29 smithi088 ceph-mon[193406]: pgmap v172: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:31.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:31 smithi161 ceph-mon[178840]: pgmap v173: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:31.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:31 smithi088 ceph-mon[193406]: pgmap v173: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:33.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.334+0000 7fe9e648d700 1 -- 172.21.15.88:0/353415225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e00fbaf0 msgr2=0x7fe9e00fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.334+0000 7fe9e648d700 1 --2- 172.21.15.88:0/353415225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e00fbaf0 0x7fe9e00fbf00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0004940 tx=0x7fe9d0009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.334+0000 7fe9e648d700 1 -- 172.21.15.88:0/353415225 shutdown_connections 2023-12-09T02:40:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.334+0000 7fe9e648d700 1 --2- 172.21.15.88:0/353415225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e00fcd00 0x7fe9e00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.334+0000 7fe9e648d700 1 --2- 172.21.15.88:0/353415225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e00fbaf0 0x7fe9e00fbf00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.334+0000 7fe9e648d700 1 -- 172.21.15.88:0/353415225 >> 172.21.15.88:0/353415225 conn(0x7fe9e00f71b0 msgr2=0x7fe9e00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.334+0000 7fe9e648d700 1 -- 172.21.15.88:0/353415225 shutdown_connections 2023-12-09T02:40:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.334+0000 7fe9e648d700 1 -- 172.21.15.88:0/353415225 wait complete. 2023-12-09T02:40:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.335+0000 7fe9e648d700 1 Processor -- start 2023-12-09T02:40:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.335+0000 7fe9e648d700 1 -- start start 2023-12-09T02:40:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.335+0000 7fe9e648d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e00fbaf0 0x7fe9e010d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.335+0000 7fe9e648d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e00fcd00 0x7fe9e010da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.335+0000 7fe9e648d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e010e080 con 0x7fe9e00fbaf0 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.335+0000 7fe9e648d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e010e920 con 0x7fe9e00fcd00 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9dffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e00fbaf0 0x7fe9e010d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9dffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e00fbaf0 0x7fe9e010d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37762/0 (socket says 172.21.15.88:37762) 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9dffff700 1 -- 172.21.15.88:0/3576672470 learned_addr learned my addr 172.21.15.88:0/3576672470 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9df7fe700 1 --2- 172.21.15.88:0/3576672470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e00fcd00 0x7fe9e010da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9dffff700 1 -- 172.21.15.88:0/3576672470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e00fcd00 msgr2=0x7fe9e010da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9dffff700 1 --2- 172.21.15.88:0/3576672470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e00fcd00 0x7fe9e010da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9dffff700 1 -- 172.21.15.88:0/3576672470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0005040 con 0x7fe9e00fbaf0 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9dffff700 1 --2- 172.21.15.88:0/3576672470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e00fbaf0 0x7fe9e010d540 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0004f90 tx=0x7fe9d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9dcff9700 1 -- 172.21.15.88:0/3576672470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d000e040 con 0x7fe9e00fbaf0 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9e648d700 1 -- 172.21.15.88:0/3576672470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e010eba0 con 0x7fe9e00fbaf0 2023-12-09T02:40:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9dcff9700 1 -- 172.21.15.88:0/3576672470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe9d000bc50 con 0x7fe9e00fbaf0 2023-12-09T02:40:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9dcff9700 1 -- 172.21.15.88:0/3576672470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d001c630 con 0x7fe9e00fbaf0 2023-12-09T02:40:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.336+0000 7fe9e648d700 1 -- 172.21.15.88:0/3576672470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e010f0e0 con 0x7fe9e00fbaf0 2023-12-09T02:40:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.337+0000 7fe9e648d700 1 -- 172.21.15.88:0/3576672470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e004bb80 con 0x7fe9e00fbaf0 2023-12-09T02:40:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.338+0000 7fe9dcff9700 1 -- 172.21.15.88:0/3576672470 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe9d0013420 con 0x7fe9e00fbaf0 2023-12-09T02:40:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.338+0000 7fe9dcff9700 1 --2- 172.21.15.88:0/3576672470 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe9c806ce60 0x7fe9c806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.338+0000 7fe9dcff9700 1 -- 172.21.15.88:0/3576672470 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7fe9d008d860 con 0x7fe9e00fbaf0 2023-12-09T02:40:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.338+0000 7fe9df7fe700 1 --2- 172.21.15.88:0/3576672470 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe9c806ce60 0x7fe9c806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.339+0000 7fe9df7fe700 1 --2- 172.21.15.88:0/3576672470 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe9c806ce60 0x7fe9c806f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4004f40 tx=0x7fe9d400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:33.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.343+0000 7fe9dcff9700 1 -- 172.21.15.88:0/3576672470 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe9d005b0a0 con 0x7fe9e00fbaf0 2023-12-09T02:40:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.553+0000 7fe9e648d700 1 -- 172.21.15.88:0/3576672470 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9e010f500 con 0x7fe9c806ce60 2023-12-09T02:40:33.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.555+0000 7fe9dcff9700 1 -- 172.21.15.88:0/3576672470 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fe9e010f500 con 0x7fe9c806ce60 2023-12-09T02:40:33.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.557+0000 7fe9e648d700 1 -- 172.21.15.88:0/3576672470 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe9c806ce60 msgr2=0x7fe9c806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:33.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.557+0000 7fe9e648d700 1 --2- 172.21.15.88:0/3576672470 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe9c806ce60 0x7fe9c806f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4004f40 tx=0x7fe9d400b040 comp rx=0 tx=0).stop 2023-12-09T02:40:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.557+0000 7fe9e648d700 1 -- 172.21.15.88:0/3576672470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e00fbaf0 msgr2=0x7fe9e010d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.557+0000 7fe9e648d700 1 --2- 172.21.15.88:0/3576672470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e00fbaf0 0x7fe9e010d540 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0004f90 tx=0x7fe9d0009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.557+0000 7fe9e648d700 1 -- 172.21.15.88:0/3576672470 shutdown_connections 2023-12-09T02:40:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.557+0000 7fe9e648d700 1 --2- 172.21.15.88:0/3576672470 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe9c806ce60 0x7fe9c806f310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.557+0000 7fe9e648d700 1 --2- 172.21.15.88:0/3576672470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e00fbaf0 0x7fe9e010d540 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.557+0000 7fe9e648d700 1 --2- 172.21.15.88:0/3576672470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e00fcd00 0x7fe9e010da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.557+0000 7fe9e648d700 1 -- 172.21.15.88:0/3576672470 >> 172.21.15.88:0/3576672470 conn(0x7fe9e00f71b0 msgr2=0x7fe9e0065be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.557+0000 7fe9e648d700 1 -- 172.21.15.88:0/3576672470 shutdown_connections 2023-12-09T02:40:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.557+0000 7fe9e648d700 1 -- 172.21.15.88:0/3576672470 wait complete. 2023-12-09T02:40:33.568 INFO:teuthology.orchestra.run.smithi088.stdout:true 2023-12-09T02:40:33.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.657+0000 7f168c382700 1 -- 172.21.15.88:0/836716664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16840fcd00 msgr2=0x7f16840fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:33.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.657+0000 7f168c382700 1 --2- 172.21.15.88:0/836716664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16840fcd00 0x7f16840fd150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1680004940 tx=0x7f1680009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.657+0000 7f168c382700 1 -- 172.21.15.88:0/836716664 shutdown_connections 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.657+0000 7f168c382700 1 --2- 172.21.15.88:0/836716664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16840fcd00 0x7f16840fd150 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.657+0000 7f168c382700 1 --2- 172.21.15.88:0/836716664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16840fbaf0 0x7f16840fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.657+0000 7f168c382700 1 -- 172.21.15.88:0/836716664 >> 172.21.15.88:0/836716664 conn(0x7f16840f7190 msgr2=0x7f16840f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.657+0000 7f168c382700 1 -- 172.21.15.88:0/836716664 shutdown_connections 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.657+0000 7f168c382700 1 -- 172.21.15.88:0/836716664 wait complete. 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168c382700 1 Processor -- start 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168c382700 1 -- start start 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168c382700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16840fbaf0 0x7f168410d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168c382700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16840fcd00 0x7f168410daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168c382700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168410e130 con 0x7f16840fbaf0 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168c382700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168410e970 con 0x7f16840fcd00 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168a11e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16840fbaf0 0x7f168410d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168a11e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16840fbaf0 0x7f168410d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37778/0 (socket says 172.21.15.88:37778) 2023-12-09T02:40:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168a11e700 1 -- 172.21.15.88:0/92855021 learned_addr learned my addr 172.21.15.88:0/92855021 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168a11e700 1 -- 172.21.15.88:0/92855021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16840fcd00 msgr2=0x7f168410daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168a11e700 1 --2- 172.21.15.88:0/92855021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16840fcd00 0x7f168410daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168a11e700 1 -- 172.21.15.88:0/92855021 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1680005040 con 0x7f16840fbaf0 2023-12-09T02:40:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.658+0000 7f168a11e700 1 --2- 172.21.15.88:0/92855021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16840fbaf0 0x7f168410d560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f167800b790 tx=0x7f1678009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.659+0000 7f1676ffd700 1 -- 172.21.15.88:0/92855021 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f167800f6f0 con 0x7f16840fbaf0 2023-12-09T02:40:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.659+0000 7f1676ffd700 1 -- 172.21.15.88:0/92855021 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f167800fd00 con 0x7f16840fbaf0 2023-12-09T02:40:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.659+0000 7f168c382700 1 -- 172.21.15.88:0/92855021 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168410ec50 con 0x7f16840fbaf0 2023-12-09T02:40:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.659+0000 7f1676ffd700 1 -- 172.21.15.88:0/92855021 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16780103a0 con 0x7f16840fbaf0 2023-12-09T02:40:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.659+0000 7f168c382700 1 -- 172.21.15.88:0/92855021 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168410f190 con 0x7f16840fbaf0 2023-12-09T02:40:33.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.660+0000 7f168c382700 1 -- 172.21.15.88:0/92855021 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168404bb80 con 0x7f16840fbaf0 2023-12-09T02:40:33.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.660+0000 7f1676ffd700 1 -- 172.21.15.88:0/92855021 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f167800f850 con 0x7f16840fbaf0 2023-12-09T02:40:33.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.660+0000 7f1676ffd700 1 --2- 172.21.15.88:0/92855021 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f167006ce70 0x7f167006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:33.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.660+0000 7f1676ffd700 1 -- 172.21.15.88:0/92855021 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f167808c230 con 0x7f16840fbaf0 2023-12-09T02:40:33.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.661+0000 7f168991d700 1 --2- 172.21.15.88:0/92855021 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f167006ce70 0x7f167006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:33.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.661+0000 7f168991d700 1 --2- 172.21.15.88:0/92855021 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f167006ce70 0x7f167006f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1680000c00 tx=0x7f1680009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:33.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.665+0000 7f1676ffd700 1 -- 172.21.15.88:0/92855021 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1678059a70 con 0x7f16840fbaf0 2023-12-09T02:40:33.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.874+0000 7f168c382700 1 -- 172.21.15.88:0/92855021 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f168410f740 con 0x7f167006ce70 2023-12-09T02:40:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.875+0000 7f1676ffd700 1 -- 172.21.15.88:0/92855021 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f168410f740 con 0x7f167006ce70 2023-12-09T02:40:33.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.877+0000 7f168c382700 1 -- 172.21.15.88:0/92855021 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f167006ce70 msgr2=0x7f167006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.877+0000 7f168c382700 1 --2- 172.21.15.88:0/92855021 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f167006ce70 0x7f167006f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1680000c00 tx=0x7f1680009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.877+0000 7f168c382700 1 -- 172.21.15.88:0/92855021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16840fbaf0 msgr2=0x7f168410d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.877+0000 7f168c382700 1 --2- 172.21.15.88:0/92855021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16840fbaf0 0x7f168410d560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f167800b790 tx=0x7f1678009220 comp rx=0 tx=0).stop 2023-12-09T02:40:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.877+0000 7f168c382700 1 -- 172.21.15.88:0/92855021 shutdown_connections 2023-12-09T02:40:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.877+0000 7f168c382700 1 --2- 172.21.15.88:0/92855021 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f167006ce70 0x7f167006f320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.877+0000 7f168c382700 1 --2- 172.21.15.88:0/92855021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16840fbaf0 0x7f168410d560 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.877+0000 7f168c382700 1 --2- 172.21.15.88:0/92855021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16840fcd00 0x7f168410daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.877+0000 7f168c382700 1 -- 172.21.15.88:0/92855021 >> 172.21.15.88:0/92855021 conn(0x7f16840f7190 msgr2=0x7f1684065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.877+0000 7f168c382700 1 -- 172.21.15.88:0/92855021 shutdown_connections 2023-12-09T02:40:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:33.877+0000 7f168c382700 1 -- 172.21.15.88:0/92855021 wait complete. 2023-12-09T02:40:33.888 INFO:teuthology.orchestra.run.smithi088.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-09T02:40:33.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:33 smithi088 ceph-mon[193406]: pgmap v174: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:33.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:33 smithi161 ceph-mon[178840]: pgmap v174: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:34.291 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph orch ps' 2023-12-09T02:40:34.558 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:40:34.686 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:34 smithi088 ceph-mon[193406]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:34.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:34 smithi161 ceph-mon[178840]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:35.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.650+0000 7fe52ee28700 1 -- 172.21.15.88:0/808054476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe528101b60 msgr2=0x7fe528101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:35.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.650+0000 7fe52ee28700 1 --2- 172.21.15.88:0/808054476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe528101b60 0x7fe528101f30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe51c004940 tx=0x7fe51c009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:35.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 -- 172.21.15.88:0/808054476 shutdown_connections 2023-12-09T02:40:35.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 --2- 172.21.15.88:0/808054476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5280fbb00 0x7fe5280fbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:35.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 --2- 172.21.15.88:0/808054476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe528101b60 0x7fe528101f30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:35.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 -- 172.21.15.88:0/808054476 >> 172.21.15.88:0/808054476 conn(0x7fe5280f7680 msgr2=0x7fe5280f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:35.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 -- 172.21.15.88:0/808054476 shutdown_connections 2023-12-09T02:40:35.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 -- 172.21.15.88:0/808054476 wait complete. 2023-12-09T02:40:35.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 Processor -- start 2023-12-09T02:40:35.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 -- start start 2023-12-09T02:40:35.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5280fbb00 0x7fe52810e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:35.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe528101b60 0x7fe52810ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:35.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52810f240 con 0x7fe528101b60 2023-12-09T02:40:35.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.651+0000 7fe52ee28700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52810f380 con 0x7fe5280fbb00 2023-12-09T02:40:35.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe527fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe528101b60 0x7fe52810ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:35.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe527fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe528101b60 0x7fe52810ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37790/0 (socket says 172.21.15.88:37790) 2023-12-09T02:40:35.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe527fff700 1 -- 172.21.15.88:0/4055889757 learned_addr learned my addr 172.21.15.88:0/4055889757 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:35.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe52cbc4700 1 --2- 172.21.15.88:0/4055889757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5280fbb00 0x7fe52810e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:35.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe527fff700 1 -- 172.21.15.88:0/4055889757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5280fbb00 msgr2=0x7fe52810e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:35.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe527fff700 1 --2- 172.21.15.88:0/4055889757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5280fbb00 0x7fe52810e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:35.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe527fff700 1 -- 172.21.15.88:0/4055889757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c005040 con 0x7fe528101b60 2023-12-09T02:40:35.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe527fff700 1 --2- 172.21.15.88:0/4055889757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe528101b60 0x7fe52810ecb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe51400c8c0 tx=0x7fe5140044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:35.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe5257fa700 1 -- 172.21.15.88:0/4055889757 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe514011a80 con 0x7fe528101b60 2023-12-09T02:40:35.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe5257fa700 1 -- 172.21.15.88:0/4055889757 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe514011be0 con 0x7fe528101b60 2023-12-09T02:40:35.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe52ee28700 1 -- 172.21.15.88:0/4055889757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52810c400 con 0x7fe528101b60 2023-12-09T02:40:35.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe5257fa700 1 -- 172.21.15.88:0/4055889757 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe514018620 con 0x7fe528101b60 2023-12-09T02:40:35.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.652+0000 7fe52ee28700 1 -- 172.21.15.88:0/4055889757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52810c940 con 0x7fe528101b60 2023-12-09T02:40:35.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.653+0000 7fe52ee28700 1 -- 172.21.15.88:0/4055889757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe528103f40 con 0x7fe528101b60 2023-12-09T02:40:35.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.654+0000 7fe5257fa700 1 -- 172.21.15.88:0/4055889757 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe514017070 con 0x7fe528101b60 2023-12-09T02:40:35.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.654+0000 7fe5257fa700 1 --2- 172.21.15.88:0/4055889757 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe51806ce60 0x7fe51806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:35.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.654+0000 7fe5257fa700 1 -- 172.21.15.88:0/4055889757 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7fe5140902b0 con 0x7fe528101b60 2023-12-09T02:40:35.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.654+0000 7fe52cbc4700 1 --2- 172.21.15.88:0/4055889757 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe51806ce60 0x7fe51806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:35.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.655+0000 7fe52cbc4700 1 --2- 172.21.15.88:0/4055889757 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe51806ce60 0x7fe51806f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe51c004f90 tx=0x7fe51c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:35.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.659+0000 7fe5257fa700 1 -- 172.21.15.88:0/4055889757 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe51405a060 con 0x7fe528101b60 2023-12-09T02:40:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.857+0000 7fe52ee28700 1 -- 172.21.15.88:0/4055889757 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe52804bbf0 con 0x7fe51806ce60 2023-12-09T02:40:35.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.866+0000 7fe5257fa700 1 -- 172.21.15.88:0/4055889757 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe52804bbf0 con 0x7fe51806ce60 2023-12-09T02:40:35.867 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:40:35.867 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (4m) 114s ago 11m 28.5M - 0.25.0 c8568f914cd2 9dc2b8db0963 2023-12-09T02:40:35.867 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (3m) 114s ago 11m 7470k - 19.0.0-44-g9dcc13bb f28f2b94f153 bf03eec19a86 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (3m) 29s ago 10m 7448k - 19.0.0-44-g9dcc13bb f28f2b94f153 890646e8cd90 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (4m) 114s ago 11m 92.5M - 9.4.7 954c08fa6188 ab4c3f64ce4d 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (7m) 114s ago 7m 14.8M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (7m) 114s ago 7m 16.1M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (7m) 29s ago 7m 10.1G - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (7m) 29s ago 7m 16.3M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:8443,9283,8765 running (4m) 114s ago 12m 512M - 19.0.0-44-g9dcc13bb f28f2b94f153 a939ff288750 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283,8765 running (4m) 29s ago 10m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 e2ee2a6eb30b 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (4m) 114s ago 12m 67.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 8e4b2ba7b37c 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (3m) 29s ago 10m 61.2M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 4769966a784f 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (5m) 114s ago 11m 18.1M - 1.5.0 0da6a335fe13 e2b7cc0b7527 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (4m) 29s ago 10m 18.0M - 1.5.0 0da6a335fe13 0de833ab198e 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (2m) 114s ago 10m 192M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 88f0691c638a 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (2m) 114s ago 9m 131M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 8bb8d12931bb 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (117s) 114s ago 9m 12.9M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 e623b21addf0 2023-12-09T02:40:35.868 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (88s) 29s ago 9m 141M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 6cd16a89f874 2023-12-09T02:40:35.869 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (59s) 29s ago 8m 126M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 103a8409c9c8 2023-12-09T02:40:35.869 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (31s) 29s ago 8m 14.8M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 9620770b68bd 2023-12-09T02:40:35.869 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (4m) 114s ago 11m 51.3M - 2.43.0 a07b618ecd1d ddb1fb2e1888 2023-12-09T02:40:35.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.868+0000 7fe52ee28700 1 -- 172.21.15.88:0/4055889757 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe51806ce60 msgr2=0x7fe51806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:35.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.868+0000 7fe52ee28700 1 --2- 172.21.15.88:0/4055889757 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe51806ce60 0x7fe51806f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe51c004f90 tx=0x7fe51c009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:35.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.868+0000 7fe52ee28700 1 -- 172.21.15.88:0/4055889757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe528101b60 msgr2=0x7fe52810ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:35.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.868+0000 7fe52ee28700 1 --2- 172.21.15.88:0/4055889757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe528101b60 0x7fe52810ecb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe51400c8c0 tx=0x7fe5140044c0 comp rx=0 tx=0).stop 2023-12-09T02:40:35.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.868+0000 7fe52ee28700 1 -- 172.21.15.88:0/4055889757 shutdown_connections 2023-12-09T02:40:35.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.868+0000 7fe52ee28700 1 --2- 172.21.15.88:0/4055889757 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fe51806ce60 0x7fe51806f310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:35.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.868+0000 7fe52ee28700 1 --2- 172.21.15.88:0/4055889757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5280fbb00 0x7fe52810e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:35.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.868+0000 7fe52ee28700 1 --2- 172.21.15.88:0/4055889757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe528101b60 0x7fe52810ecb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:35.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.868+0000 7fe52ee28700 1 -- 172.21.15.88:0/4055889757 >> 172.21.15.88:0/4055889757 conn(0x7fe5280f7680 msgr2=0x7fe5280f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:35.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.868+0000 7fe52ee28700 1 -- 172.21.15.88:0/4055889757 shutdown_connections 2023-12-09T02:40:35.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:35.869+0000 7fe52ee28700 1 -- 172.21.15.88:0/4055889757 wait complete. 2023-12-09T02:40:35.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:35 smithi088 ceph-mon[193406]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:35.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:35 smithi088 ceph-mon[193406]: pgmap v175: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:35.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:35 smithi161 ceph-mon[178840]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:35.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:35 smithi161 ceph-mon[178840]: pgmap v175: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:36.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph orch upgrade status' 2023-12-09T02:40:36.537 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:40:36.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:40:36.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:40:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.610+0000 7ffbe61af700 1 -- 172.21.15.88:0/182259043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00fc5d0 msgr2=0x7ffbe00fc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.610+0000 7ffbe61af700 1 --2- 172.21.15.88:0/182259043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00fc5d0 0x7ffbe00fc9a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4004940 tx=0x7ffbd4009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.610+0000 7ffbe61af700 1 -- 172.21.15.88:0/182259043 shutdown_connections 2023-12-09T02:40:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.610+0000 7ffbe61af700 1 --2- 172.21.15.88:0/182259043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbe00fcee0 0x7ffbe0109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.610+0000 7ffbe61af700 1 --2- 172.21.15.88:0/182259043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00fc5d0 0x7ffbe00fc9a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.610+0000 7ffbe61af700 1 -- 172.21.15.88:0/182259043 >> 172.21.15.88:0/182259043 conn(0x7ffbe00719b0 msgr2=0x7ffbe0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.610+0000 7ffbe61af700 1 -- 172.21.15.88:0/182259043 shutdown_connections 2023-12-09T02:40:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.610+0000 7ffbe61af700 1 -- 172.21.15.88:0/182259043 wait complete. 2023-12-09T02:40:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.611+0000 7ffbe61af700 1 Processor -- start 2023-12-09T02:40:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.611+0000 7ffbe61af700 1 -- start start 2023-12-09T02:40:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.611+0000 7ffbe61af700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbe00fc5d0 0x7ffbe01158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.611+0000 7ffbe61af700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00fcee0 0x7ffbe0115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.611+0000 7ffbe61af700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe0116450 con 0x7ffbe00fcee0 2023-12-09T02:40:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.611+0000 7ffbe61af700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe010f780 con 0x7ffbe00fc5d0 2023-12-09T02:40:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.611+0000 7ffbdeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00fcee0 0x7ffbe0115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.611+0000 7ffbdeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00fcee0 0x7ffbe0115e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57422/0 (socket says 172.21.15.88:57422) 2023-12-09T02:40:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.611+0000 7ffbdeffd700 1 -- 172.21.15.88:0/3001672705 learned_addr learned my addr 172.21.15.88:0/3001672705 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.612+0000 7ffbdf7fe700 1 --2- 172.21.15.88:0/3001672705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbe00fc5d0 0x7ffbe01158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.612+0000 7ffbdeffd700 1 -- 172.21.15.88:0/3001672705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbe00fc5d0 msgr2=0x7ffbe01158c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.612+0000 7ffbdeffd700 1 --2- 172.21.15.88:0/3001672705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbe00fc5d0 0x7ffbe01158c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.612+0000 7ffbdeffd700 1 -- 172.21.15.88:0/3001672705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4005040 con 0x7ffbe00fcee0 2023-12-09T02:40:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.612+0000 7ffbdeffd700 1 --2- 172.21.15.88:0/3001672705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00fcee0 0x7ffbe0115e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0002a50 tx=0x7ffbd00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.612+0000 7ffbc7fff700 1 -- 172.21.15.88:0/3001672705 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd0007cc0 con 0x7ffbe00fcee0 2023-12-09T02:40:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.612+0000 7ffbc7fff700 1 -- 172.21.15.88:0/3001672705 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffbd000f040 con 0x7ffbe00fcee0 2023-12-09T02:40:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.612+0000 7ffbc7fff700 1 -- 172.21.15.88:0/3001672705 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd000d9c0 con 0x7ffbe00fcee0 2023-12-09T02:40:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.612+0000 7ffbe61af700 1 -- 172.21.15.88:0/3001672705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe010fa60 con 0x7ffbe00fcee0 2023-12-09T02:40:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.612+0000 7ffbe61af700 1 -- 172.21.15.88:0/3001672705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe010ffa0 con 0x7ffbe00fcee0 2023-12-09T02:40:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.613+0000 7ffbe61af700 1 -- 172.21.15.88:0/3001672705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe01068c0 con 0x7ffbe00fcee0 2023-12-09T02:40:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.613+0000 7ffbc7fff700 1 -- 172.21.15.88:0/3001672705 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ffbd000db20 con 0x7ffbe00fcee0 2023-12-09T02:40:37.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.614+0000 7ffbc7fff700 1 --2- 172.21.15.88:0/3001672705 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffbc806ce60 0x7ffbc806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:37.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.614+0000 7ffbc7fff700 1 -- 172.21.15.88:0/3001672705 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7ffbd008c1b0 con 0x7ffbe00fcee0 2023-12-09T02:40:37.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.614+0000 7ffbdf7fe700 1 --2- 172.21.15.88:0/3001672705 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffbc806ce60 0x7ffbc806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:37.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.614+0000 7ffbdf7fe700 1 --2- 172.21.15.88:0/3001672705 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffbc806ce60 0x7ffbc806f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4004f90 tx=0x7ffbd4009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:37.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.618+0000 7ffbc7fff700 1 -- 172.21.15.88:0/3001672705 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ffbd0059970 con 0x7ffbe00fcee0 2023-12-09T02:40:37.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.844+0000 7ffbe61af700 1 -- 172.21.15.88:0/3001672705 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbe0115590 con 0x7ffbc806ce60 2023-12-09T02:40:37.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.845+0000 7ffbc7fff700 1 -- 172.21.15.88:0/3001672705 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7ffbe0115590 con 0x7ffbc806ce60 2023-12-09T02:40:37.846 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:40:37.846 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-09T02:40:37.846 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2023-12-09T02:40:37.847 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-09T02:40:37.847 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2023-12-09T02:40:37.847 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2023-12-09T02:40:37.847 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2023-12-09T02:40:37.847 INFO:teuthology.orchestra.run.smithi088.stdout: "osd", 2023-12-09T02:40:37.847 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2023-12-09T02:40:37.847 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-12-09T02:40:37.847 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "12/21 daemons upgraded", 2023-12-09T02:40:37.847 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-09T02:40:37.848 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": true 2023-12-09T02:40:37.848 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:40:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.847+0000 7ffbe61af700 1 -- 172.21.15.88:0/3001672705 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffbc806ce60 msgr2=0x7ffbc806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.847+0000 7ffbe61af700 1 --2- 172.21.15.88:0/3001672705 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffbc806ce60 0x7ffbc806f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4004f90 tx=0x7ffbd4009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.847+0000 7ffbe61af700 1 -- 172.21.15.88:0/3001672705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00fcee0 msgr2=0x7ffbe0115e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.847+0000 7ffbe61af700 1 --2- 172.21.15.88:0/3001672705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00fcee0 0x7ffbe0115e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0002a50 tx=0x7ffbd00046b0 comp rx=0 tx=0).stop 2023-12-09T02:40:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.847+0000 7ffbe61af700 1 -- 172.21.15.88:0/3001672705 shutdown_connections 2023-12-09T02:40:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.847+0000 7ffbe61af700 1 --2- 172.21.15.88:0/3001672705 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffbc806ce60 0x7ffbc806f310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.847+0000 7ffbe61af700 1 --2- 172.21.15.88:0/3001672705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbe00fc5d0 0x7ffbe01158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.847+0000 7ffbe61af700 1 --2- 172.21.15.88:0/3001672705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00fcee0 0x7ffbe0115e00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:37.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.847+0000 7ffbe61af700 1 -- 172.21.15.88:0/3001672705 >> 172.21.15.88:0/3001672705 conn(0x7ffbe00719b0 msgr2=0x7ffbe00fa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:37.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.847+0000 7ffbe61af700 1 -- 172.21.15.88:0/3001672705 shutdown_connections 2023-12-09T02:40:37.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:37.847+0000 7ffbe61af700 1 -- 172.21.15.88:0/3001672705 wait complete. 2023-12-09T02:40:37.868 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:37 smithi088 ceph-mon[193406]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:37.868 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:37 smithi088 ceph-mon[193406]: pgmap v176: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:37.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:37 smithi161 ceph-mon[178840]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:37.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:37 smithi161 ceph-mon[178840]: pgmap v176: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:38.257 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph health detail' 2023-12-09T02:40:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:40:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.539+0000 7f65428f7700 1 -- 172.21.15.88:0/1261429225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c102c20 msgr2=0x7f653c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.539+0000 7f65428f7700 1 --2- 172.21.15.88:0/1261429225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c102c20 0x7f653c102ff0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6530004940 tx=0x7f6530009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.540+0000 7f65428f7700 1 -- 172.21.15.88:0/1261429225 shutdown_connections 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.540+0000 7f65428f7700 1 --2- 172.21.15.88:0/1261429225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c065390 0x7f653c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.540+0000 7f65428f7700 1 --2- 172.21.15.88:0/1261429225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c102c20 0x7f653c102ff0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.540+0000 7f65428f7700 1 -- 172.21.15.88:0/1261429225 >> 172.21.15.88:0/1261429225 conn(0x7f653c0719b0 msgr2=0x7f653c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.540+0000 7f65428f7700 1 -- 172.21.15.88:0/1261429225 shutdown_connections 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.540+0000 7f65428f7700 1 -- 172.21.15.88:0/1261429225 wait complete. 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.540+0000 7f65428f7700 1 Processor -- start 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.540+0000 7f65428f7700 1 -- start start 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f65428f7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c065390 0x7f653c113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f65428f7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c102c20 0x7f653c113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f65428f7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c10d540 con 0x7f653c065390 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f65428f7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c10d6b0 con 0x7f653c102c20 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f653bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c065390 0x7f653c113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f653bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c065390 0x7f653c113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57434/0 (socket says 172.21.15.88:57434) 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f653bfff700 1 -- 172.21.15.88:0/867329035 learned_addr learned my addr 172.21.15.88:0/867329035 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f653bfff700 1 -- 172.21.15.88:0/867329035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c102c20 msgr2=0x7f653c113c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f653b7fe700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c102c20 0x7f653c113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f653bfff700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c102c20 0x7f653c113c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f653bfff700 1 -- 172.21.15.88:0/867329035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6530005040 con 0x7f653c065390 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f653b7fe700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c102c20 0x7f653c113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f653bfff700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c065390 0x7f653c113680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f653000b3b0 tx=0x7f6530009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f6538ff9700 1 -- 172.21.15.88:0/867329035 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f653000e040 con 0x7f653c065390 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f6538ff9700 1 -- 172.21.15.88:0/867329035 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6530004290 con 0x7f653c065390 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f6538ff9700 1 -- 172.21.15.88:0/867329035 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f653001c3f0 con 0x7f653c065390 2023-12-09T02:40:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f65428f7700 1 -- 172.21.15.88:0/867329035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c10d930 con 0x7f653c065390 2023-12-09T02:40:39.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.541+0000 7f65428f7700 1 -- 172.21.15.88:0/867329035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c10de20 con 0x7f653c065390 2023-12-09T02:40:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.542+0000 7f65428f7700 1 -- 172.21.15.88:0/867329035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c0fff40 con 0x7f653c065390 2023-12-09T02:40:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.543+0000 7f6538ff9700 1 -- 172.21.15.88:0/867329035 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f653000bc50 con 0x7f653c065390 2023-12-09T02:40:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.543+0000 7f6538ff9700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f652406ce60 0x7f652406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.543+0000 7f6538ff9700 1 -- 172.21.15.88:0/867329035 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f653008d930 con 0x7f653c065390 2023-12-09T02:40:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.543+0000 7f653b7fe700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f652406ce60 0x7f652406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.544+0000 7f653b7fe700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f652406ce60 0x7f652406f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f652c006fd0 tx=0x7f652c008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:39.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.548+0000 7f6538ff9700 1 -- 172.21.15.88:0/867329035 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f653005b170 con 0x7f653c065390 2023-12-09T02:40:39.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:39 smithi088 ceph-mon[193406]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:39.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:39 smithi088 ceph-mon[193406]: pgmap v177: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.814+0000 7f65428f7700 1 -- 172.21.15.88:0/867329035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f653c04bb80 con 0x7f653c065390 2023-12-09T02:40:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.814+0000 7f6538ff9700 1 -- 172.21.15.88:0/867329035 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+261 (secure 0 0 0) 0x7f653005ad00 con 0x7f653c065390 2023-12-09T02:40:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_ERR Upgrade: failed due to an unexpected exception 2023-12-09T02:40:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-09T02:40:39.816 INFO:teuthology.orchestra.run.smithi088.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-09T02:40:39.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.816+0000 7f65428f7700 1 -- 172.21.15.88:0/867329035 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f652406ce60 msgr2=0x7f652406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:39.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.816+0000 7f65428f7700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f652406ce60 0x7f652406f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f652c006fd0 tx=0x7f652c008040 comp rx=0 tx=0).stop 2023-12-09T02:40:39.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.816+0000 7f65428f7700 1 -- 172.21.15.88:0/867329035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c065390 msgr2=0x7f653c113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.816+0000 7f65428f7700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c065390 0x7f653c113680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f653000b3b0 tx=0x7f6530009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.817+0000 7f65428f7700 1 -- 172.21.15.88:0/867329035 shutdown_connections 2023-12-09T02:40:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.817+0000 7f65428f7700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f652406ce60 0x7f652406f310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.817+0000 7f65428f7700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f653c065390 0x7f653c113680 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.817+0000 7f65428f7700 1 --2- 172.21.15.88:0/867329035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653c102c20 0x7f653c113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.817+0000 7f65428f7700 1 -- 172.21.15.88:0/867329035 >> 172.21.15.88:0/867329035 conn(0x7f653c0719b0 msgr2=0x7f653c0faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.817+0000 7f65428f7700 1 -- 172.21.15.88:0/867329035 shutdown_connections 2023-12-09T02:40:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:39.817+0000 7f65428f7700 1 -- 172.21.15.88:0/867329035 wait complete. 2023-12-09T02:40:39.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:39 smithi161 ceph-mon[178840]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:40:39.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:39 smithi161 ceph-mon[178840]: pgmap v177: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:40.197 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph versions' 2023-12-09T02:40:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:40:40.775 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:40 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/867329035' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:40:40.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:40 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/867329035' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-09T02:40:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.544+0000 7f102a3e6700 1 -- 172.21.15.88:0/1325492759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1024102c00 msgr2=0x7f1024102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.544+0000 7f102a3e6700 1 --2- 172.21.15.88:0/1325492759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1024102c00 0x7f1024102fd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1014004940 tx=0x7f1014009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.544+0000 7f102a3e6700 1 -- 172.21.15.88:0/1325492759 shutdown_connections 2023-12-09T02:40:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.544+0000 7f102a3e6700 1 --2- 172.21.15.88:0/1325492759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10241035a0 0x7f10240fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.544+0000 7f102a3e6700 1 --2- 172.21.15.88:0/1325492759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1024102c00 0x7f1024102fd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.544+0000 7f102a3e6700 1 -- 172.21.15.88:0/1325492759 >> 172.21.15.88:0/1325492759 conn(0x7f10240f8790 msgr2=0x7f10240faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.544+0000 7f102a3e6700 1 -- 172.21.15.88:0/1325492759 shutdown_connections 2023-12-09T02:40:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.544+0000 7f102a3e6700 1 -- 172.21.15.88:0/1325492759 wait complete. 2023-12-09T02:40:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f102a3e6700 1 Processor -- start 2023-12-09T02:40:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f102a3e6700 1 -- start start 2023-12-09T02:40:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f102a3e6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1024102c00 0x7f10241136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f102a3e6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10241035a0 0x7f1024113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f102a3e6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10241142d0 con 0x7f1024102c00 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f102a3e6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102410d590 con 0x7f10241035a0 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f1023fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1024102c00 0x7f10241136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f1023fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1024102c00 0x7f10241136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57454/0 (socket says 172.21.15.88:57454) 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f1023fff700 1 -- 172.21.15.88:0/1402100712 learned_addr learned my addr 172.21.15.88:0/1402100712 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f1023fff700 1 -- 172.21.15.88:0/1402100712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10241035a0 msgr2=0x7f1024113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f1023fff700 1 --2- 172.21.15.88:0/1402100712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10241035a0 0x7f1024113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.545+0000 7f1023fff700 1 -- 172.21.15.88:0/1402100712 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1014005040 con 0x7f1024102c00 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.546+0000 7f1023fff700 1 --2- 172.21.15.88:0/1402100712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1024102c00 0x7f10241136b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f101400b3b0 tx=0x7f1014009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.546+0000 7f1020ff9700 1 -- 172.21.15.88:0/1402100712 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f101400e040 con 0x7f1024102c00 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.546+0000 7f102a3e6700 1 -- 172.21.15.88:0/1402100712 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102410d810 con 0x7f1024102c00 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.546+0000 7f1020ff9700 1 -- 172.21.15.88:0/1402100712 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f101400bc50 con 0x7f1024102c00 2023-12-09T02:40:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.546+0000 7f1020ff9700 1 -- 172.21.15.88:0/1402100712 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1014013420 con 0x7f1024102c00 2023-12-09T02:40:41.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.546+0000 7f102a3e6700 1 -- 172.21.15.88:0/1402100712 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102410dd50 con 0x7f1024102c00 2023-12-09T02:40:41.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.547+0000 7f102a3e6700 1 -- 172.21.15.88:0/1402100712 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10240fff10 con 0x7f1024102c00 2023-12-09T02:40:41.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.547+0000 7f1020ff9700 1 -- 172.21.15.88:0/1402100712 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f101401c430 con 0x7f1024102c00 2023-12-09T02:40:41.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.548+0000 7f1020ff9700 1 --2- 172.21.15.88:0/1402100712 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f100c06ce60 0x7f100c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:40:41.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.548+0000 7f1020ff9700 1 -- 172.21.15.88:0/1402100712 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f101408d220 con 0x7f1024102c00 2023-12-09T02:40:41.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.548+0000 7f10237fe700 1 --2- 172.21.15.88:0/1402100712 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f100c06ce60 0x7f100c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:40:41.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.548+0000 7f10237fe700 1 --2- 172.21.15.88:0/1402100712 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f100c06ce60 0x7f100c06f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1018006fd0 tx=0x7f1018006db0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:40:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.552+0000 7f1020ff9700 1 -- 172.21.15.88:0/1402100712 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f101405ab10 con 0x7f1024102c00 2023-12-09T02:40:41.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.819+0000 7f102a3e6700 1 -- 172.21.15.88:0/1402100712 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f102404bb80 con 0x7f1024102c00 2023-12-09T02:40:41.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.820+0000 7f1020ff9700 1 -- 172.21.15.88:0/1402100712 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f101405a6a0 con 0x7f1024102c00 2023-12-09T02:40:41.821 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 6 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:40:41.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:40:41.823 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:40:41.823 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4, 2023-12-09T02:40:41.823 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 10 2023-12-09T02:40:41.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:40:41.823 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:40:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.822+0000 7f102a3e6700 1 -- 172.21.15.88:0/1402100712 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f100c06ce60 msgr2=0x7f100c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.822+0000 7f102a3e6700 1 --2- 172.21.15.88:0/1402100712 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f100c06ce60 0x7f100c06f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1018006fd0 tx=0x7f1018006db0 comp rx=0 tx=0).stop 2023-12-09T02:40:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.822+0000 7f102a3e6700 1 -- 172.21.15.88:0/1402100712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1024102c00 msgr2=0x7f10241136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:40:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.822+0000 7f102a3e6700 1 --2- 172.21.15.88:0/1402100712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1024102c00 0x7f10241136b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f101400b3b0 tx=0x7f1014009e30 comp rx=0 tx=0).stop 2023-12-09T02:40:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.822+0000 7f102a3e6700 1 -- 172.21.15.88:0/1402100712 shutdown_connections 2023-12-09T02:40:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.822+0000 7f102a3e6700 1 --2- 172.21.15.88:0/1402100712 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f100c06ce60 0x7f100c06f310 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.822+0000 7f102a3e6700 1 --2- 172.21.15.88:0/1402100712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1024102c00 0x7f10241136b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.822+0000 7f102a3e6700 1 --2- 172.21.15.88:0/1402100712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10241035a0 0x7f1024113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:40:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.822+0000 7f102a3e6700 1 -- 172.21.15.88:0/1402100712 >> 172.21.15.88:0/1402100712 conn(0x7f10240f8790 msgr2=0x7f10240fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:40:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.822+0000 7f102a3e6700 1 -- 172.21.15.88:0/1402100712 shutdown_connections 2023-12-09T02:40:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:40:41.822+0000 7f102a3e6700 1 -- 172.21.15.88:0/1402100712 wait complete. 2023-12-09T02:40:41.843 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:41 smithi088 ceph-mon[193406]: pgmap v178: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:41.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:41 smithi161 ceph-mon[178840]: pgmap v178: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:42.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-09T02:40:42.529 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:40:42.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:42 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1402100712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:42.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:42 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1402100712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:40:43.566 INFO:teuthology.orchestra.run.smithi088.stdout:wait for servicemap items w/ changing names to refresh 2023-12-09T02:40:43.851 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:43 smithi088 ceph-mon[193406]: pgmap v179: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:43.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:43 smithi161 ceph-mon[178840]: pgmap v179: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:44.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'sleep 60' 2023-12-09T02:40:44.293 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:40:45.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:45 smithi161 ceph-mon[178840]: pgmap v180: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:45.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:45 smithi088 ceph-mon[193406]: pgmap v180: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:47.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:47 smithi161 ceph-mon[178840]: pgmap v181: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:47.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:47 smithi088 ceph-mon[193406]: pgmap v181: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:49.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:49 smithi161 ceph-mon[178840]: pgmap v182: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:49.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:49 smithi088 ceph-mon[193406]: pgmap v182: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:51.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:51 smithi161 ceph-mon[178840]: pgmap v183: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:51 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:40:51.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:51 smithi088 ceph-mon[193406]: pgmap v183: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:51.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:51 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:40:53.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:53 smithi161 ceph-mon[178840]: pgmap v184: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:53.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:53 smithi088 ceph-mon[193406]: pgmap v184: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:55.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:55 smithi161 ceph-mon[178840]: pgmap v185: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:55.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:55 smithi088 ceph-mon[193406]: pgmap v185: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:57.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:57 smithi161 ceph-mon[178840]: pgmap v186: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:57.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:57 smithi088 ceph-mon[193406]: pgmap v186: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:59.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:40:59 smithi161 ceph-mon[178840]: pgmap v187: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:40:59.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:40:59 smithi088 ceph-mon[193406]: pgmap v187: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:01.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:01 smithi161 ceph-mon[178840]: pgmap v188: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:01.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:01 smithi088 ceph-mon[193406]: pgmap v188: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:03.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:03 smithi161 ceph-mon[178840]: pgmap v189: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:03.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:03 smithi088 ceph-mon[193406]: pgmap v189: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:05.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:05 smithi161 ceph-mon[178840]: pgmap v190: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:05.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:05 smithi088 ceph-mon[193406]: pgmap v190: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:06.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:06 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:41:06.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:06 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:41:07.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:07 smithi161 ceph-mon[178840]: pgmap v191: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:07.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:07 smithi088 ceph-mon[193406]: pgmap v191: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:09.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:09 smithi161 ceph-mon[178840]: pgmap v192: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:09.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:09 smithi088 ceph-mon[193406]: pgmap v192: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:10.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:10 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:41:10.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:10 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-09T02:41:11.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:11 smithi161 ceph-mon[178840]: pgmap v193: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:11.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:41:11.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:41:11.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:11 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:41:11.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:11 smithi088 ceph-mon[193406]: pgmap v193: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:11.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-09T02:41:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-09T02:41:11.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:11 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' 2023-12-09T02:41:13.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:13 smithi161 ceph-mon[178840]: pgmap v194: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:13.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:13 smithi088 ceph-mon[193406]: pgmap v194: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:15.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:15 smithi161 ceph-mon[178840]: pgmap v195: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:15.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:15 smithi088 ceph-mon[193406]: pgmap v195: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:17.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:17 smithi161 ceph-mon[178840]: pgmap v196: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:17.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:17 smithi088 ceph-mon[193406]: pgmap v196: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:19.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:19 smithi161 ceph-mon[178840]: pgmap v197: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:19.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:19 smithi088 ceph-mon[193406]: pgmap v197: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:21.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:21 smithi161 ceph-mon[178840]: pgmap v198: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:21.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:21 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:41:21.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:21 smithi088 ceph-mon[193406]: pgmap v198: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:21.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:21 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:41:23.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:23 smithi161 ceph-mon[178840]: pgmap v199: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:23.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:23 smithi088 ceph-mon[193406]: pgmap v199: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:25.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:25 smithi161 ceph-mon[178840]: pgmap v200: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:25.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:25 smithi088 ceph-mon[193406]: pgmap v200: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:27.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:27 smithi161 ceph-mon[178840]: pgmap v201: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:27.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:27 smithi088 ceph-mon[193406]: pgmap v201: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:29.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:29 smithi161 ceph-mon[178840]: pgmap v202: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:29.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:29 smithi088 ceph-mon[193406]: pgmap v202: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:31.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:31 smithi161 ceph-mon[178840]: pgmap v203: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:31.978 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:31 smithi088 ceph-mon[193406]: pgmap v203: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:33.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:33 smithi161 ceph-mon[178840]: pgmap v204: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:33.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:33 smithi088 ceph-mon[193406]: pgmap v204: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:35.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:35 smithi161 ceph-mon[178840]: pgmap v205: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:35.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:35 smithi088 ceph-mon[193406]: pgmap v205: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:36.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:36 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:41:36.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:36 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:41:37.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:37 smithi161 ceph-mon[178840]: pgmap v206: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:37.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:37 smithi088 ceph-mon[193406]: pgmap v206: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:39.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:39 smithi161 ceph-mon[178840]: pgmap v207: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:39.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:39 smithi088 ceph-mon[193406]: pgmap v207: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:41.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:41 smithi161 ceph-mon[178840]: pgmap v208: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:41.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:41 smithi088 ceph-mon[193406]: pgmap v208: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:43.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:43 smithi161 ceph-mon[178840]: pgmap v209: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:43.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:43 smithi088 ceph-mon[193406]: pgmap v209: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:45.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph orch ps' 2023-12-09T02:41:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:41:45.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:45 smithi161 ceph-mon[178840]: pgmap v210: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:45.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:45 smithi088 ceph-mon[193406]: pgmap v210: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:46.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.967+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/270418091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c101af0 msgr2=0x7ff19c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:46.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.967+0000 7ff1a2f0a700 1 --2- 172.21.15.88:0/270418091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c101af0 0x7ff19c101ec0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff190004940 tx=0x7ff190009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:46.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.967+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/270418091 shutdown_connections 2023-12-09T02:41:46.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.967+0000 7ff1a2f0a700 1 --2- 172.21.15.88:0/270418091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff19c0fbb30 0x7ff19c0fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:46.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.967+0000 7ff1a2f0a700 1 --2- 172.21.15.88:0/270418091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c101af0 0x7ff19c101ec0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:46.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.967+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/270418091 >> 172.21.15.88:0/270418091 conn(0x7ff19c0f7690 msgr2=0x7ff19c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:46.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.967+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/270418091 shutdown_connections 2023-12-09T02:41:46.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.967+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/270418091 wait complete. 2023-12-09T02:41:46.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.968+0000 7ff1a2f0a700 1 Processor -- start 2023-12-09T02:41:46.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.968+0000 7ff1a2f0a700 1 -- start start 2023-12-09T02:41:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.968+0000 7ff1a2f0a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff19c0fbb30 0x7ff19c112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.968+0000 7ff1a2f0a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c101af0 0x7ff19c112bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.968+0000 7ff1a2f0a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c113210 con 0x7ff19c101af0 2023-12-09T02:41:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.968+0000 7ff1a2f0a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c10c500 con 0x7ff19c0fbb30 2023-12-09T02:41:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff19bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c101af0 0x7ff19c112bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff19bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c101af0 0x7ff19c112bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47020/0 (socket says 172.21.15.88:47020) 2023-12-09T02:41:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff19bfff700 1 -- 172.21.15.88:0/2194332064 learned_addr learned my addr 172.21.15.88:0/2194332064 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff1a0ca6700 1 --2- 172.21.15.88:0/2194332064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff19c0fbb30 0x7ff19c112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff19bfff700 1 -- 172.21.15.88:0/2194332064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff19c0fbb30 msgr2=0x7ff19c112680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff19bfff700 1 --2- 172.21.15.88:0/2194332064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff19c0fbb30 0x7ff19c112680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff19bfff700 1 -- 172.21.15.88:0/2194332064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff190005040 con 0x7ff19c101af0 2023-12-09T02:41:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff19bfff700 1 --2- 172.21.15.88:0/2194332064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c101af0 0x7ff19c112bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff18800b790 tx=0x7ff188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff1997fa700 1 -- 172.21.15.88:0/2194332064 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff18800f770 con 0x7ff19c101af0 2023-12-09T02:41:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff1997fa700 1 -- 172.21.15.88:0/2194332064 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff18800fd80 con 0x7ff19c101af0 2023-12-09T02:41:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/2194332064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c10c7e0 con 0x7ff19c101af0 2023-12-09T02:41:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff1997fa700 1 -- 172.21.15.88:0/2194332064 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff18800d310 con 0x7ff19c101af0 2023-12-09T02:41:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.969+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/2194332064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c10cd20 con 0x7ff19c101af0 2023-12-09T02:41:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.970+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/2194332064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c103fa0 con 0x7ff19c101af0 2023-12-09T02:41:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.971+0000 7ff1997fa700 1 -- 172.21.15.88:0/2194332064 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ff188010420 con 0x7ff19c101af0 2023-12-09T02:41:46.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.971+0000 7ff1997fa700 1 --2- 172.21.15.88:0/2194332064 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff18c06ce60 0x7ff18c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:46.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.971+0000 7ff1997fa700 1 -- 172.21.15.88:0/2194332064 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7ff18808c310 con 0x7ff19c101af0 2023-12-09T02:41:46.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.971+0000 7ff1a0ca6700 1 --2- 172.21.15.88:0/2194332064 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff18c06ce60 0x7ff18c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:46.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.971+0000 7ff1a0ca6700 1 --2- 172.21.15.88:0/2194332064 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff18c06ce60 0x7ff18c06f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff190004f90 tx=0x7ff190009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:46.976+0000 7ff1997fa700 1 -- 172.21.15.88:0/2194332064 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff188059c10 con 0x7ff19c101af0 2023-12-09T02:41:47.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.171+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/2194332064 --> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff19c04bb80 con 0x7ff18c06ce60 2023-12-09T02:41:47.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.181+0000 7ff1997fa700 1 -- 172.21.15.88:0/2194332064 <== mgr.34100 v2:172.21.15.88:6800/1172550247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff19c04bb80 con 0x7ff18c06ce60 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (6m) 3m ago 12m 28.5M - 0.25.0 c8568f914cd2 9dc2b8db0963 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (4m) 3m ago 12m 7470k - 19.0.0-44-g9dcc13bb f28f2b94f153 bf03eec19a86 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi161 smithi161 running (4m) 100s ago 12m 7448k - 19.0.0-44-g9dcc13bb f28f2b94f153 890646e8cd90 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (6m) 3m ago 12m 92.5M - 9.4.7 954c08fa6188 ab4c3f64ce4d 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.utskxh smithi088 running (8m) 3m ago 8m 14.8M - 17.2.7-119-ge2143d99 f761b6e42225 d5b596e5fb61 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.zfojux smithi088 running (8m) 3m ago 8m 16.1M - 17.2.7-119-ge2143d99 f761b6e42225 233e6b60ad32 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.dhvdif smithi161 running (8m) 100s ago 8m 10.1G - 17.2.7-119-ge2143d99 f761b6e42225 df041637dfec 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi161.posrbq smithi161 running (8m) 100s ago 8m 16.3M - 17.2.7-119-ge2143d99 f761b6e42225 93e6f659b2d0 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.jwlofb smithi088 *:8443,9283,8765 running (5m) 3m ago 13m 512M - 19.0.0-44-g9dcc13bb f28f2b94f153 a939ff288750 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi161.qmxtmg smithi161 *:8443,9283,8765 running (5m) 100s ago 12m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 e2ee2a6eb30b 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (5m) 3m ago 13m 67.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 8e4b2ba7b37c 2023-12-09T02:41:47.183 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi161 smithi161 running (4m) 100s ago 11m 61.2M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 4769966a784f 2023-12-09T02:41:47.184 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (6m) 3m ago 12m 18.1M - 1.5.0 0da6a335fe13 e2b7cc0b7527 2023-12-09T02:41:47.184 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi161 smithi161 *:9100 running (6m) 100s ago 12m 18.0M - 1.5.0 0da6a335fe13 0de833ab198e 2023-12-09T02:41:47.184 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (4m) 3m ago 11m 192M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 88f0691c638a 2023-12-09T02:41:47.184 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (3m) 3m ago 11m 131M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 8bb8d12931bb 2023-12-09T02:41:47.184 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (3m) 3m ago 10m 12.9M 1568M 19.0.0-44-g9dcc13bb f28f2b94f153 e623b21addf0 2023-12-09T02:41:47.184 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi161 running (2m) 100s ago 10m 141M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 6cd16a89f874 2023-12-09T02:41:47.184 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi161 running (2m) 100s ago 10m 126M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 103a8409c9c8 2023-12-09T02:41:47.184 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi161 running (102s) 100s ago 9m 14.8M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 9620770b68bd 2023-12-09T02:41:47.184 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (5m) 3m ago 12m 51.3M - 2.43.0 a07b618ecd1d ddb1fb2e1888 2023-12-09T02:41:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.183+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/2194332064 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff18c06ce60 msgr2=0x7ff18c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.183+0000 7ff1a2f0a700 1 --2- 172.21.15.88:0/2194332064 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff18c06ce60 0x7ff18c06f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff190004f90 tx=0x7ff190009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.183+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/2194332064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c101af0 msgr2=0x7ff19c112bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.183+0000 7ff1a2f0a700 1 --2- 172.21.15.88:0/2194332064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c101af0 0x7ff19c112bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff18800b790 tx=0x7ff188009250 comp rx=0 tx=0).stop 2023-12-09T02:41:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.183+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/2194332064 shutdown_connections 2023-12-09T02:41:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.183+0000 7ff1a2f0a700 1 --2- 172.21.15.88:0/2194332064 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ff18c06ce60 0x7ff18c06f310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.183+0000 7ff1a2f0a700 1 --2- 172.21.15.88:0/2194332064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff19c0fbb30 0x7ff19c112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.183+0000 7ff1a2f0a700 1 --2- 172.21.15.88:0/2194332064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c101af0 0x7ff19c112bc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.183+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/2194332064 >> 172.21.15.88:0/2194332064 conn(0x7ff19c0f7690 msgr2=0x7ff19c0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.183+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/2194332064 shutdown_connections 2023-12-09T02:41:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:47.183+0000 7ff1a2f0a700 1 -- 172.21.15.88:0/2194332064 wait complete. 2023-12-09T02:41:47.534 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph versions' 2023-12-09T02:41:47.799 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:41:47.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:47 smithi088 ceph-mon[193406]: pgmap v211: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:47.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:47 smithi161 ceph-mon[178840]: pgmap v211: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:48.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.841+0000 7f0a42923700 1 -- 172.21.15.88:0/580117078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0fdc70 msgr2=0x7f0a3c0fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:48.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.841+0000 7f0a42923700 1 --2- 172.21.15.88:0/580117078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0fdc70 0x7f0a3c0fe040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0a30004940 tx=0x7f0a30009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:48.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.841+0000 7f0a42923700 1 -- 172.21.15.88:0/580117078 shutdown_connections 2023-12-09T02:41:48.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.841+0000 7f0a42923700 1 --2- 172.21.15.88:0/580117078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a3c0fe610 0x7f0a3c106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:48.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.841+0000 7f0a42923700 1 --2- 172.21.15.88:0/580117078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0fdc70 0x7f0a3c0fe040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:48.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.841+0000 7f0a42923700 1 -- 172.21.15.88:0/580117078 >> 172.21.15.88:0/580117078 conn(0x7f0a3c0f76c0 msgr2=0x7f0a3c0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:48.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.841+0000 7f0a42923700 1 -- 172.21.15.88:0/580117078 shutdown_connections 2023-12-09T02:41:48.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.841+0000 7f0a42923700 1 -- 172.21.15.88:0/580117078 wait complete. 2023-12-09T02:41:48.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a42923700 1 Processor -- start 2023-12-09T02:41:48.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a42923700 1 -- start start 2023-12-09T02:41:48.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a42923700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0fdc70 0x7f0a3c113600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:48.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a42923700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a3c0fe610 0x7f0a3c113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:48.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a42923700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c10d4c0 con 0x7f0a3c0fdc70 2023-12-09T02:41:48.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a42923700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c10d630 con 0x7f0a3c0fe610 2023-12-09T02:41:48.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0fdc70 0x7f0a3c113600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:48.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0fdc70 0x7f0a3c113600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47032/0 (socket says 172.21.15.88:47032) 2023-12-09T02:41:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a3bfff700 1 -- 172.21.15.88:0/126177619 learned_addr learned my addr 172.21.15.88:0/126177619 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a3bfff700 1 -- 172.21.15.88:0/126177619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a3c0fe610 msgr2=0x7f0a3c113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a3bfff700 1 --2- 172.21.15.88:0/126177619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a3c0fe610 0x7f0a3c113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.842+0000 7f0a3bfff700 1 -- 172.21.15.88:0/126177619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a30005040 con 0x7f0a3c0fdc70 2023-12-09T02:41:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.843+0000 7f0a3bfff700 1 --2- 172.21.15.88:0/126177619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0fdc70 0x7f0a3c113600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000b3b0 tx=0x7f0a30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.843+0000 7f0a38ff9700 1 -- 172.21.15.88:0/126177619 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a3000e040 con 0x7f0a3c0fdc70 2023-12-09T02:41:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.843+0000 7f0a38ff9700 1 -- 172.21.15.88:0/126177619 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a30004290 con 0x7f0a3c0fdc70 2023-12-09T02:41:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.843+0000 7f0a38ff9700 1 -- 172.21.15.88:0/126177619 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a3001c3f0 con 0x7f0a3c0fdc70 2023-12-09T02:41:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.843+0000 7f0a42923700 1 -- 172.21.15.88:0/126177619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c10d910 con 0x7f0a3c0fdc70 2023-12-09T02:41:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.843+0000 7f0a42923700 1 -- 172.21.15.88:0/126177619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c10de50 con 0x7f0a3c0fdc70 2023-12-09T02:41:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.844+0000 7f0a42923700 1 -- 172.21.15.88:0/126177619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c104260 con 0x7f0a3c0fdc70 2023-12-09T02:41:48.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.844+0000 7f0a38ff9700 1 -- 172.21.15.88:0/126177619 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0a3000bc50 con 0x7f0a3c0fdc70 2023-12-09T02:41:48.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.844+0000 7f0a38ff9700 1 --2- 172.21.15.88:0/126177619 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0a2406ce60 0x7f0a2406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:48.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.845+0000 7f0a38ff9700 1 -- 172.21.15.88:0/126177619 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f0a3008d8c0 con 0x7f0a3c0fdc70 2023-12-09T02:41:48.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.845+0000 7f0a3b7fe700 1 --2- 172.21.15.88:0/126177619 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0a2406ce60 0x7f0a2406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:48.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.845+0000 7f0a3b7fe700 1 --2- 172.21.15.88:0/126177619 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0a2406ce60 0x7f0a2406f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c006fd0 tx=0x7f0a2c006db0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:48.849+0000 7f0a38ff9700 1 -- 172.21.15.88:0/126177619 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0a3005b100 con 0x7f0a3c0fdc70 2023-12-09T02:41:48.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:48 smithi161 ceph-mon[178840]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:41:48.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:48 smithi088 ceph-mon[193406]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-09T02:41:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.120+0000 7f0a42923700 1 -- 172.21.15.88:0/126177619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0a3c04bb80 con 0x7f0a3c0fdc70 2023-12-09T02:41:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.121+0000 7f0a38ff9700 1 -- 172.21.15.88:0/126177619 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f0a3005ac90 con 0x7f0a3c0fdc70 2023-12-09T02:41:49.122 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 6 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-09T02:41:49.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-09T02:41:49.124 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-12-09T02:41:49.124 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4, 2023-12-09T02:41:49.124 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 10 2023-12-09T02:41:49.124 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-09T02:41:49.124 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-09T02:41:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.123+0000 7f0a42923700 1 -- 172.21.15.88:0/126177619 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0a2406ce60 msgr2=0x7f0a2406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.123+0000 7f0a42923700 1 --2- 172.21.15.88:0/126177619 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0a2406ce60 0x7f0a2406f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c006fd0 tx=0x7f0a2c006db0 comp rx=0 tx=0).stop 2023-12-09T02:41:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.123+0000 7f0a42923700 1 -- 172.21.15.88:0/126177619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0fdc70 msgr2=0x7f0a3c113600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.123+0000 7f0a42923700 1 --2- 172.21.15.88:0/126177619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0fdc70 0x7f0a3c113600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000b3b0 tx=0x7f0a30009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.123+0000 7f0a42923700 1 -- 172.21.15.88:0/126177619 shutdown_connections 2023-12-09T02:41:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.123+0000 7f0a42923700 1 --2- 172.21.15.88:0/126177619 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f0a2406ce60 0x7f0a2406f310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.123+0000 7f0a42923700 1 --2- 172.21.15.88:0/126177619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0fdc70 0x7f0a3c113600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.123+0000 7f0a42923700 1 --2- 172.21.15.88:0/126177619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a3c0fe610 0x7f0a3c113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.123+0000 7f0a42923700 1 -- 172.21.15.88:0/126177619 >> 172.21.15.88:0/126177619 conn(0x7f0a3c0f76c0 msgr2=0x7f0a3c1013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.123+0000 7f0a42923700 1 -- 172.21.15.88:0/126177619 shutdown_connections 2023-12-09T02:41:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:49.123+0000 7f0a42923700 1 -- 172.21.15.88:0/126177619 wait complete. 2023-12-09T02:41:49.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-09T02:41:49.818 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/mon.smithi088/config 2023-12-09T02:41:49.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:49 smithi161 ceph-mon[178840]: pgmap v212: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:49.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:49 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/126177619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:41:49.943 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:49 smithi088 ceph-mon[193406]: pgmap v212: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:49.943 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:49 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/126177619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:41:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.799+0000 7f8b353a0700 1 -- 172.21.15.88:0/365760930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b300fdc20 msgr2=0x7f8b300fdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.799+0000 7f8b353a0700 1 --2- 172.21.15.88:0/365760930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b300fdc20 0x7f8b300fdff0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b20004970 tx=0x7f8b20009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.799+0000 7f8b353a0700 1 -- 172.21.15.88:0/365760930 shutdown_connections 2023-12-09T02:41:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.799+0000 7f8b353a0700 1 --2- 172.21.15.88:0/365760930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b300fe5c0 0x7f8b30106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.799+0000 7f8b353a0700 1 --2- 172.21.15.88:0/365760930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b300fdc20 0x7f8b300fdff0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.799+0000 7f8b353a0700 1 -- 172.21.15.88:0/365760930 >> 172.21.15.88:0/365760930 conn(0x7f8b300f76c0 msgr2=0x7f8b300f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.799+0000 7f8b353a0700 1 -- 172.21.15.88:0/365760930 shutdown_connections 2023-12-09T02:41:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.799+0000 7f8b353a0700 1 -- 172.21.15.88:0/365760930 wait complete. 2023-12-09T02:41:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.799+0000 7f8b353a0700 1 Processor -- start 2023-12-09T02:41:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.799+0000 7f8b353a0700 1 -- start start 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b353a0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b300fdc20 0x7f8b30113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b353a0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b300fe5c0 0x7f8b30113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b353a0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b30114200 con 0x7f8b300fdc20 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b353a0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3010d4f0 con 0x7f8b300fe5c0 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b2effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b300fdc20 0x7f8b30113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b2effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b300fdc20 0x7f8b30113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47050/0 (socket says 172.21.15.88:47050) 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b2effd700 1 -- 172.21.15.88:0/1295790934 learned_addr learned my addr 172.21.15.88:0/1295790934 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b2e7fc700 1 --2- 172.21.15.88:0/1295790934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b300fe5c0 0x7f8b30113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b2effd700 1 -- 172.21.15.88:0/1295790934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b300fe5c0 msgr2=0x7f8b30113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b2effd700 1 --2- 172.21.15.88:0/1295790934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b300fe5c0 0x7f8b30113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b2effd700 1 -- 172.21.15.88:0/1295790934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20005040 con 0x7f8b300fdc20 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b2effd700 1 --2- 172.21.15.88:0/1295790934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b300fdc20 0x7f8b30113630 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8b20004f50 tx=0x7f8b20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b177fe700 1 -- 172.21.15.88:0/1295790934 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b2000e040 con 0x7f8b300fdc20 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b177fe700 1 -- 172.21.15.88:0/1295790934 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b20013420 con 0x7f8b300fdc20 2023-12-09T02:41:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b353a0700 1 -- 172.21.15.88:0/1295790934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3010d720 con 0x7f8b300fdc20 2023-12-09T02:41:50.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b177fe700 1 -- 172.21.15.88:0/1295790934 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b2001c630 con 0x7f8b300fdc20 2023-12-09T02:41:50.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.800+0000 7f8b353a0700 1 -- 172.21.15.88:0/1295790934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3010dc60 con 0x7f8b300fdc20 2023-12-09T02:41:50.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.802+0000 7f8b177fe700 1 -- 172.21.15.88:0/1295790934 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f8b20013a00 con 0x7f8b300fdc20 2023-12-09T02:41:50.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.802+0000 7f8b353a0700 1 -- 172.21.15.88:0/1295790934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b30104350 con 0x7f8b300fdc20 2023-12-09T02:41:50.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.802+0000 7f8b177fe700 1 --2- 172.21.15.88:0/1295790934 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8b1806ce70 0x7f8b1806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:50.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.802+0000 7f8b177fe700 1 -- 172.21.15.88:0/1295790934 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f8b2008d770 con 0x7f8b300fdc20 2023-12-09T02:41:50.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.802+0000 7f8b2e7fc700 1 --2- 172.21.15.88:0/1295790934 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8b1806ce70 0x7f8b1806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:50.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.803+0000 7f8b2e7fc700 1 --2- 172.21.15.88:0/1295790934 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8b1806ce70 0x7f8b1806f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8b3010eed0 tx=0x7f8b240043c0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:50.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:50.807+0000 7f8b177fe700 1 -- 172.21.15.88:0/1295790934 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8b2005afb0 con 0x7f8b300fdc20 2023-12-09T02:41:51.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.076+0000 7f8b353a0700 1 -- 172.21.15.88:0/1295790934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8b3004bb80 con 0x7f8b300fdc20 2023-12-09T02:41:51.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.076+0000 7f8b177fe700 1 -- 172.21.15.88:0/1295790934 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f8b2005ab40 con 0x7f8b300fdc20 2023-12-09T02:41:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.078+0000 7f8b353a0700 1 -- 172.21.15.88:0/1295790934 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8b1806ce70 msgr2=0x7f8b1806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.078+0000 7f8b353a0700 1 --2- 172.21.15.88:0/1295790934 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8b1806ce70 0x7f8b1806f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8b3010eed0 tx=0x7f8b240043c0 comp rx=0 tx=0).stop 2023-12-09T02:41:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.078+0000 7f8b353a0700 1 -- 172.21.15.88:0/1295790934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b300fdc20 msgr2=0x7f8b30113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.078+0000 7f8b353a0700 1 --2- 172.21.15.88:0/1295790934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b300fdc20 0x7f8b30113630 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8b20004f50 tx=0x7f8b20009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.078+0000 7f8b353a0700 1 -- 172.21.15.88:0/1295790934 shutdown_connections 2023-12-09T02:41:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.078+0000 7f8b353a0700 1 --2- 172.21.15.88:0/1295790934 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f8b1806ce70 0x7f8b1806f320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.078+0000 7f8b353a0700 1 --2- 172.21.15.88:0/1295790934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b300fdc20 0x7f8b30113630 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.078+0000 7f8b353a0700 1 --2- 172.21.15.88:0/1295790934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b300fe5c0 0x7f8b30113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.078+0000 7f8b353a0700 1 -- 172.21.15.88:0/1295790934 >> 172.21.15.88:0/1295790934 conn(0x7f8b300f76c0 msgr2=0x7f8b301014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.079+0000 7f8b353a0700 1 -- 172.21.15.88:0/1295790934 shutdown_connections 2023-12-09T02:41:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.079+0000 7f8b353a0700 1 -- 172.21.15.88:0/1295790934 wait complete. 2023-12-09T02:41:51.090 INFO:teuthology.orchestra.run.smithi088.stdout:false 2023-12-09T02:41:51.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-09T02:41:51.473 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-09T02:41:51.552 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9e4316aee6a24a8a89d8cd5a7854348e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-09T02:41:51.556 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-09T02:41:51.570 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-09T02:41:51.570 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:41:51.570 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-09T02:41:51.596 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-09T02:41:51.597 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-09T02:41:51.656 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-09T02:41:51.722 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:51 smithi088 ceph-mon[193406]: pgmap v213: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:51.722 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:51 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1295790934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:41:51.723 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:51 smithi088 ceph-mon[193406]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:41:51.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.816+0000 7fda61c07700 1 -- 172.21.15.88:0/281560835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda5c0fb970 msgr2=0x7fda5c0fbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:51.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.816+0000 7fda61c07700 1 --2- 172.21.15.88:0/281560835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda5c0fb970 0x7fda5c0fbde0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda50004940 tx=0x7fda50009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:51.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.816+0000 7fda61c07700 1 -- 172.21.15.88:0/281560835 shutdown_connections 2023-12-09T02:41:51.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.816+0000 7fda61c07700 1 --2- 172.21.15.88:0/281560835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda5c0fb970 0x7fda5c0fbde0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:51.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.816+0000 7fda61c07700 1 --2- 172.21.15.88:0/281560835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c1019b0 0x7fda5c101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:51.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.816+0000 7fda61c07700 1 -- 172.21.15.88:0/281560835 >> 172.21.15.88:0/281560835 conn(0x7fda5c0756d0 msgr2=0x7fda5c0f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:51.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.816+0000 7fda61c07700 1 -- 172.21.15.88:0/281560835 shutdown_connections 2023-12-09T02:41:51.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.816+0000 7fda61c07700 1 -- 172.21.15.88:0/281560835 wait complete. 2023-12-09T02:41:51.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.816+0000 7fda61c07700 1 Processor -- start 2023-12-09T02:41:51.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.816+0000 7fda61c07700 1 -- start start 2023-12-09T02:41:51.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda61c07700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda5c0fb970 0x7fda5c112160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:51.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda61c07700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c1019b0 0x7fda5c1126a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:51.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda61c07700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c112cf0 con 0x7fda5c0fb970 2023-12-09T02:41:51.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda61c07700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c10c250 con 0x7fda5c1019b0 2023-12-09T02:41:51.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda5b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda5c0fb970 0x7fda5c112160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:51.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda5b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda5c0fb970 0x7fda5c112160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47072/0 (socket says 172.21.15.88:47072) 2023-12-09T02:41:51.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda5b7fe700 1 -- 172.21.15.88:0/1962898100 learned_addr learned my addr 172.21.15.88:0/1962898100 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:51.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda5affd700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c1019b0 0x7fda5c1126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:51.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda5b7fe700 1 -- 172.21.15.88:0/1962898100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c1019b0 msgr2=0x7fda5c1126a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:51.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda5b7fe700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c1019b0 0x7fda5c1126a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:51.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda5b7fe700 1 -- 172.21.15.88:0/1962898100 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50005040 con 0x7fda5c0fb970 2023-12-09T02:41:51.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda5affd700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c1019b0 0x7fda5c1126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-09T02:41:51.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda5b7fe700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda5c0fb970 0x7fda5c112160 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00fce0 tx=0x7fda4c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:51.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda43fff700 1 -- 172.21.15.88:0/1962898100 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda4c00fe90 con 0x7fda5c0fb970 2023-12-09T02:41:51.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda43fff700 1 -- 172.21.15.88:0/1962898100 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda4c0090d0 con 0x7fda5c0fb970 2023-12-09T02:41:51.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda61c07700 1 -- 172.21.15.88:0/1962898100 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c10c4d0 con 0x7fda5c0fb970 2023-12-09T02:41:51.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda43fff700 1 -- 172.21.15.88:0/1962898100 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda4c0126a0 con 0x7fda5c0fb970 2023-12-09T02:41:51.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.817+0000 7fda61c07700 1 -- 172.21.15.88:0/1962898100 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c10ca10 con 0x7fda5c0fb970 2023-12-09T02:41:51.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.818+0000 7fda61c07700 1 -- 172.21.15.88:0/1962898100 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c064730 con 0x7fda5c0fb970 2023-12-09T02:41:51.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.819+0000 7fda43fff700 1 -- 172.21.15.88:0/1962898100 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fda4c009240 con 0x7fda5c0fb970 2023-12-09T02:41:51.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.819+0000 7fda43fff700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fda4406ce60 0x7fda4406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:51.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.819+0000 7fda43fff700 1 -- 172.21.15.88:0/1962898100 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7fda4c08ed90 con 0x7fda5c0fb970 2023-12-09T02:41:51.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.819+0000 7fda5affd700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fda4406ce60 0x7fda4406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:51.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.820+0000 7fda5affd700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fda4406ce60 0x7fda4406f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda50009fd0 tx=0x7fda50009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:51.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:51.823+0000 7fda43fff700 1 -- 172.21.15.88:0/1962898100 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fda4c058ac0 con 0x7fda5c0fb970 2023-12-09T02:41:51.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:51 smithi161 ceph-mon[178840]: pgmap v213: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:51.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:51 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1295790934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-09T02:41:51.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:51 smithi161 ceph-mon[178840]: from='mgr.34100 172.21.15.88:0/623782077' entity='mgr.smithi088.jwlofb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-09T02:41:52.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.017+0000 7fda61c07700 1 -- 172.21.15.88:0/1962898100 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda5c108930 con 0x7fda5c0fb970 2023-12-09T02:41:52.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.019+0000 7fda43fff700 1 -- 172.21.15.88:0/1962898100 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+17062 (secure 0 0 0) 0x7fda5c108930 con 0x7fda5c0fb970 2023-12-09T02:41:52.020 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:41:52.021 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":103,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","created":"2023-12-09T02:27:49.802100+0000","modified":"2023-12-09T02:40:13.346264+0000","last_up_change":"2023-12-09T02:40:12.344421+0000","last_in_change":"2023-12-09T02:31:45.877281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-09T02:31:07.797033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-09T02:32:47.454661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-09T02:32:48.330279+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94c4c8ad-f87e-4abd-aff2-ea13d8630f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":61,"up_thru":102,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1860691891},{"type":"v1","addr":"172.21.15.88:6803","nonce":1860691891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1860691891},{"type":"v1","addr":"172.21.15.88:6805","nonce":1860691891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1860691891},{"type":"v1","addr":"172.21.15.88:6809","nonce":1860691891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1860691891},{"type":"v1","addr":"172.21.15.88:6807","nonce":1860691891}]},"public_addr":"172.21.15.88:6803/1860691891","cluster_addr":"172.21.15.88:6805/1860691891","heartbeat_back_addr":"172.21.15.88:6809/1860691891","heartbeat_front_addr":"172.21.15.88:6807/1860691891","state":["exists","up"]},{"osd":1,"uuid":"1b6c3137-e616-4979-a9cb-89665a8a2919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":68,"up_from":72,"up_thru":102,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3596877492},{"type":"v1","addr":"172.21.15.88:6811","nonce":3596877492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3596877492},{"type":"v1","addr":"172.21.15.88:6813","nonce":3596877492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3596877492},{"type":"v1","addr":"172.21.15.88:6817","nonce":3596877492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3596877492},{"type":"v1","addr":"172.21.15.88:6815","nonce":3596877492}]},"public_addr":"172.21.15.88:6811/3596877492","cluster_addr":"172.21.15.88:6813/3596877492","heartbeat_back_addr":"172.21.15.88:6817/3596877492","heartbeat_front_addr":"172.21.15.88:6815/3596877492","state":["exists","up"]},{"osd":2,"uuid":"c5d0b176-113f-450a-8737-2dcf542f1f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":73,"up_from":83,"up_thru":102,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1930679366},{"type":"v1","addr":"172.21.15.88:6819","nonce":1930679366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1930679366},{"type":"v1","addr":"172.21.15.88:6821","nonce":1930679366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1930679366},{"type":"v1","addr":"172.21.15.88:6825","nonce":1930679366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1930679366},{"type":"v1","addr":"172.21.15.88:6823","nonce":1930679366}]},"public_addr":"172.21.15.88:6819/1930679366","cluster_addr":"172.21.15.88:6821/1930679366","heartbeat_back_addr":"172.21.15.88:6825/1930679366","heartbeat_front_addr":"172.21.15.88:6823/1930679366","state":["exists","up"]},{"osd":3,"uuid":"6584d86c-84e6-4f9e-a481-d297f6892df8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":88,"up_from":92,"up_thru":102,"down_at":89,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":231164100},{"type":"v1","addr":"172.21.15.161:6801","nonce":231164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":231164100},{"type":"v1","addr":"172.21.15.161:6803","nonce":231164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":231164100},{"type":"v1","addr":"172.21.15.161:6807","nonce":231164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":231164100},{"type":"v1","addr":"172.21.15.161:6805","nonce":231164100}]},"public_addr":"172.21.15.161:6801/231164100","cluster_addr":"172.21.15.161:6803/231164100","heartbeat_back_addr":"172.21.15.161:6807/231164100","heartbeat_front_addr":"172.21.15.161:6805/231164100","state":["exists","up"]},{"osd":4,"uuid":"729b6d7a-8045-40d4-b07d-aa8d8912a357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":93,"up_from":97,"up_thru":102,"down_at":94,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2971260023},{"type":"v1","addr":"172.21.15.161:6809","nonce":2971260023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2971260023},{"type":"v1","addr":"172.21.15.161:6811","nonce":2971260023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2971260023},{"type":"v1","addr":"172.21.15.161:6815","nonce":2971260023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2971260023},{"type":"v1","addr":"172.21.15.161:6813","nonce":2971260023}]},"public_addr":"172.21.15.161:6809/2971260023","cluster_addr":"172.21.15.161:6811/2971260023","heartbeat_back_addr":"172.21.15.161:6815/2971260023","heartbeat_front_addr":"172.21.15.161:6813/2971260023","state":["exists","up"]},{"osd":5,"uuid":"973d7656-a340-4dc0-a2df-7cd3c96df604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":98,"up_from":102,"up_thru":102,"down_at":99,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4178294049},{"type":"v1","addr":"172.21.15.161:6817","nonce":4178294049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4178294049},{"type":"v1","addr":"172.21.15.161:6819","nonce":4178294049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4178294049},{"type":"v1","addr":"172.21.15.161:6823","nonce":4178294049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4178294049},{"type":"v1","addr":"172.21.15.161:6821","nonce":4178294049}]},"public_addr":"172.21.15.161:6817/4178294049","cluster_addr":"172.21.15.161:6819/4178294049","heartbeat_back_addr":"172.21.15.161:6823/4178294049","heartbeat_front_addr":"172.21.15.161:6821/4178294049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:24.723561+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:44.412595+0000","dead_epoch":68},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:04.087324+0000","dead_epoch":73},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:22.198894+0000","dead_epoch":88},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:41.741094+0000","dead_epoch":93},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:32:00.865763+0000","dead_epoch":98}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":0,"to":5}]},{"pgid":"2.5","mappings":[{"from":0,"to":2}]},{"pgid":"2.10","mappings":[{"from":0,"to":5}]},{"pgid":"2.1d","mappings":[{"from":3,"to":2}]},{"pgid":"2.1f","mappings":[{"from":3,"to":2}]},{"pgid":"3.3","mappings":[{"from":4,"to":2}]},{"pgid":"3.5","mappings":[{"from":3,"to":0}]},{"pgid":"3.7","mappings":[{"from":1,"to":0}]},{"pgid":"3.b","mappings":[{"from":4,"to":2}]},{"pgid":"3.c","mappings":[{"from":0,"to":2}]},{"pgid":"3.19","mappings":[{"from":1,"to":0}]},{"pgid":"3.1f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:0/3260767994":"2023-12-10T02:36:36.291035+0000","172.21.15.88:0/307195856":"2023-12-10T02:36:36.291035+0000","172.21.15.88:6801/3655200437":"2023-12-10T02:36:36.291035+0000","172.21.15.161:0/4018114664":"2023-12-10T02:35:55.111651+0000","172.21.15.88:0/2387855456":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/3827350097":"2023-12-10T02:35:12.863137+0000","172.21.15.88:6827/2247714894":"2023-12-10T02:32:57.231230+0000","172.21.15.88:0/712942340":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/1442782127":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6800/3655200437":"2023-12-10T02:36:36.291035+0000","172.21.15.88:6826/2247714894":"2023-12-10T02:32:57.231230+0000","172.21.15.88:6800/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.161:0/4135986178":"2023-12-10T02:35:55.111651+0000","172.21.15.161:0/3275540059":"2023-12-10T02:35:55.111651+0000","172.21.15.88:0/1114065717":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/2169163782":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6801/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/3370851904":"2023-12-10T02:36:36.291035+0000","172.21.15.88:6801/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/2588418845":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/3122789176":"2023-12-10T02:36:36.291035+0000","172.21.15.88:6800/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/2622749836":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/774779438":"2023-12-10T02:36:36.291035+0000","172.21.15.161:0/1948870359":"2023-12-10T02:35:55.111651+0000","172.21.15.88:6800/563213166":"2023-12-10T02:35:12.863137+0000","172.21.15.161:0/1603623708":"2023-12-10T02:35:55.111651+0000","172.21.15.88:0/2723285069":"2023-12-10T02:35:12.863137+0000","172.21.15.88:6801/563213166":"2023-12-10T02:35:12.863137+0000","172.21.15.88:0/3372513144":"2023-12-10T02:28:42.918100+0000","172.21.15.88:6800/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.161:6828/1447919242":"2023-12-10T02:35:55.111651+0000","172.21.15.88:0/663304531":"2023-12-10T02:36:36.291035+0000","172.21.15.161:6829/1447919242":"2023-12-10T02:35:55.111651+0000","172.21.15.88:0/1149962254":"2023-12-10T02:35:12.863137+0000","172.21.15.88:6801/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/521564869":"2023-12-10T02:35:12.863137+0000","172.21.15.88:0/2691791328":"2023-12-10T02:29:31.504500+0000","172.21.15.161:0/1861090042":"2023-12-10T02:35:55.111651+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-09T02:41:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.021+0000 7fda61c07700 1 -- 172.21.15.88:0/1962898100 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fda4406ce60 msgr2=0x7fda4406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.021+0000 7fda61c07700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fda4406ce60 0x7fda4406f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda50009fd0 tx=0x7fda50009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.021+0000 7fda61c07700 1 -- 172.21.15.88:0/1962898100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda5c0fb970 msgr2=0x7fda5c112160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.021+0000 7fda61c07700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda5c0fb970 0x7fda5c112160 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00fce0 tx=0x7fda4c0046b0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.021+0000 7fda61c07700 1 -- 172.21.15.88:0/1962898100 shutdown_connections 2023-12-09T02:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.021+0000 7fda61c07700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7fda4406ce60 0x7fda4406f310 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.021+0000 7fda61c07700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda5c0fb970 0x7fda5c112160 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.021+0000 7fda61c07700 1 --2- 172.21.15.88:0/1962898100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c1019b0 0x7fda5c1126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.021+0000 7fda61c07700 1 -- 172.21.15.88:0/1962898100 >> 172.21.15.88:0/1962898100 conn(0x7fda5c0756d0 msgr2=0x7fda5c0729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.021+0000 7fda61c07700 1 -- 172.21.15.88:0/1962898100 shutdown_connections 2023-12-09T02:41:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.021+0000 7fda61c07700 1 -- 172.21.15.88:0/1962898100 wait complete. 2023-12-09T02:41:52.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-09T02:31:07.797033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-09T02:32:47.454661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-09T02:32:48.330279+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-09T02:41:52.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-09T02:41:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.193+0000 7f6831cc0700 1 -- 172.21.15.88:0/3242023862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f682c1023d0 msgr2=0x7f682c0fba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.193+0000 7f6831cc0700 1 --2- 172.21.15.88:0/3242023862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f682c1023d0 0x7f682c0fba60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6820004940 tx=0x7f6820009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.193+0000 7f6831cc0700 1 -- 172.21.15.88:0/3242023862 shutdown_connections 2023-12-09T02:41:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.193+0000 7f6831cc0700 1 --2- 172.21.15.88:0/3242023862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f682c1023d0 0x7f682c0fba60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.193+0000 7f6831cc0700 1 --2- 172.21.15.88:0/3242023862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c101ac0 0x7f682c101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.193+0000 7f6831cc0700 1 -- 172.21.15.88:0/3242023862 >> 172.21.15.88:0/3242023862 conn(0x7f682c071970 msgr2=0x7f682c071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.193+0000 7f6831cc0700 1 -- 172.21.15.88:0/3242023862 shutdown_connections 2023-12-09T02:41:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.193+0000 7f6831cc0700 1 -- 172.21.15.88:0/3242023862 wait complete. 2023-12-09T02:41:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.194+0000 7f6831cc0700 1 Processor -- start 2023-12-09T02:41:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.194+0000 7f6831cc0700 1 -- start start 2023-12-09T02:41:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.194+0000 7f6831cc0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f682c101ac0 0x7f682c10e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.194+0000 7f6831cc0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c1023d0 0x7f682c10e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.194+0000 7f6831cc0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c10ef40 con 0x7f682c101ac0 2023-12-09T02:41:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.194+0000 7f6831cc0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c10f080 con 0x7f682c1023d0 2023-12-09T02:41:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.194+0000 7f682b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f682c101ac0 0x7f682c10e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.194+0000 7f682b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f682c101ac0 0x7f682c10e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47084/0 (socket says 172.21.15.88:47084) 2023-12-09T02:41:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.194+0000 7f682b7fe700 1 -- 172.21.15.88:0/498262232 learned_addr learned my addr 172.21.15.88:0/498262232 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.194+0000 7f682b7fe700 1 -- 172.21.15.88:0/498262232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c1023d0 msgr2=0x7f682c10e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.194+0000 7f682b7fe700 1 --2- 172.21.15.88:0/498262232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c1023d0 0x7f682c10e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.195+0000 7f682b7fe700 1 -- 172.21.15.88:0/498262232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6820005040 con 0x7f682c101ac0 2023-12-09T02:41:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.195+0000 7f682b7fe700 1 --2- 172.21.15.88:0/498262232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f682c101ac0 0x7f682c10e430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f681c00b790 tx=0x7f681c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.195+0000 7f6813fff700 1 -- 172.21.15.88:0/498262232 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f681c00f770 con 0x7f682c101ac0 2023-12-09T02:41:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.195+0000 7f6831cc0700 1 -- 172.21.15.88:0/498262232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c1174a0 con 0x7f682c101ac0 2023-12-09T02:41:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.195+0000 7f6813fff700 1 -- 172.21.15.88:0/498262232 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f681c00fd80 con 0x7f682c101ac0 2023-12-09T02:41:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.195+0000 7f6813fff700 1 -- 172.21.15.88:0/498262232 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f681c00d310 con 0x7f682c101ac0 2023-12-09T02:41:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.195+0000 7f6831cc0700 1 -- 172.21.15.88:0/498262232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c117980 con 0x7f682c101ac0 2023-12-09T02:41:52.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.196+0000 7f6831cc0700 1 -- 172.21.15.88:0/498262232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c064730 con 0x7f682c101ac0 2023-12-09T02:41:52.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.196+0000 7f6813fff700 1 -- 172.21.15.88:0/498262232 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f681c010420 con 0x7f682c101ac0 2023-12-09T02:41:52.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.197+0000 7f6813fff700 1 --2- 172.21.15.88:0/498262232 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f681406ce60 0x7f681406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:52.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.197+0000 7f6813fff700 1 -- 172.21.15.88:0/498262232 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f681c08c420 con 0x7f682c101ac0 2023-12-09T02:41:52.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.197+0000 7f682affd700 1 --2- 172.21.15.88:0/498262232 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f681406ce60 0x7f681406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:52.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.197+0000 7f682affd700 1 --2- 172.21.15.88:0/498262232 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f681406ce60 0x7f681406f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6820004f90 tx=0x7f6820009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:52.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.201+0000 7f6813fff700 1 -- 172.21.15.88:0/498262232 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f681c0561d0 con 0x7f682c101ac0 2023-12-09T02:41:52.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.392+0000 7f6831cc0700 1 -- 172.21.15.88:0/498262232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f682c117c00 con 0x7f682c101ac0 2023-12-09T02:41:52.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.393+0000 7f6813fff700 1 -- 172.21.15.88:0/498262232 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7f681c0597f0 con 0x7f682c101ac0 2023-12-09T02:41:52.394 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-09T02:41:52.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.395+0000 7f6831cc0700 1 -- 172.21.15.88:0/498262232 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f681406ce60 msgr2=0x7f681406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.395+0000 7f6831cc0700 1 --2- 172.21.15.88:0/498262232 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f681406ce60 0x7f681406f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6820004f90 tx=0x7f6820009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:52.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.395+0000 7f6831cc0700 1 -- 172.21.15.88:0/498262232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f682c101ac0 msgr2=0x7f682c10e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.395+0000 7f6831cc0700 1 --2- 172.21.15.88:0/498262232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f682c101ac0 0x7f682c10e430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f681c00b790 tx=0x7f681c009250 comp rx=0 tx=0).stop 2023-12-09T02:41:52.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.395+0000 7f6831cc0700 1 -- 172.21.15.88:0/498262232 shutdown_connections 2023-12-09T02:41:52.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.395+0000 7f6831cc0700 1 --2- 172.21.15.88:0/498262232 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f681406ce60 0x7f681406f310 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.395+0000 7f6831cc0700 1 --2- 172.21.15.88:0/498262232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f682c101ac0 0x7f682c10e430 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.395+0000 7f6831cc0700 1 --2- 172.21.15.88:0/498262232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c1023d0 0x7f682c10e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.395+0000 7f6831cc0700 1 -- 172.21.15.88:0/498262232 >> 172.21.15.88:0/498262232 conn(0x7f682c071970 msgr2=0x7f682c0fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:52.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.395+0000 7f6831cc0700 1 -- 172.21.15.88:0/498262232 shutdown_connections 2023-12-09T02:41:52.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.395+0000 7f6831cc0700 1 -- 172.21.15.88:0/498262232 wait complete. 2023-12-09T02:41:52.408 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-09T02:41:52.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.527+0000 7ffb9d992700 1 -- 172.21.15.88:0/1566985149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb980fba60 msgr2=0x7ffb980fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.527+0000 7ffb9d992700 1 --2- 172.21.15.88:0/1566985149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb980fba60 0x7ffb980fbed0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffb88004940 tx=0x7ffb88009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:52.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.527+0000 7ffb9d992700 1 -- 172.21.15.88:0/1566985149 shutdown_connections 2023-12-09T02:41:52.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.527+0000 7ffb9d992700 1 --2- 172.21.15.88:0/1566985149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb980fba60 0x7ffb980fbed0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.527+0000 7ffb9d992700 1 --2- 172.21.15.88:0/1566985149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb98101aa0 0x7ffb98101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.527+0000 7ffb9d992700 1 -- 172.21.15.88:0/1566985149 >> 172.21.15.88:0/1566985149 conn(0x7ffb980f7600 msgr2=0x7ffb980f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:52.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.527+0000 7ffb9d992700 1 -- 172.21.15.88:0/1566985149 shutdown_connections 2023-12-09T02:41:52.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.527+0000 7ffb9d992700 1 -- 172.21.15.88:0/1566985149 wait complete. 2023-12-09T02:41:52.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.527+0000 7ffb9d992700 1 Processor -- start 2023-12-09T02:41:52.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.527+0000 7ffb9d992700 1 -- start start 2023-12-09T02:41:52.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb9d992700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb980fba60 0x7ffb981132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:52.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb9d992700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb98101aa0 0x7ffb98113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:52.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb9d992700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb98113e70 con 0x7ffb98101aa0 2023-12-09T02:41:52.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb9d992700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9810d390 con 0x7ffb980fba60 2023-12-09T02:41:52.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb967fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb98101aa0 0x7ffb98113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:52.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb967fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb98101aa0 0x7ffb98113820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47106/0 (socket says 172.21.15.88:47106) 2023-12-09T02:41:52.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb967fc700 1 -- 172.21.15.88:0/1789051216 learned_addr learned my addr 172.21.15.88:0/1789051216 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:52.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb96ffd700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb980fba60 0x7ffb981132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:52.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb967fc700 1 -- 172.21.15.88:0/1789051216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb980fba60 msgr2=0x7ffb981132e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb967fc700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb980fba60 0x7ffb981132e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb967fc700 1 -- 172.21.15.88:0/1789051216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb88005040 con 0x7ffb98101aa0 2023-12-09T02:41:52.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb96ffd700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb980fba60 0x7ffb981132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:41:52.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb967fc700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb98101aa0 0x7ffb98113820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800b3b0 tx=0x7ffb88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:52.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb7f7fe700 1 -- 172.21.15.88:0/1789051216 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb8800e040 con 0x7ffb98101aa0 2023-12-09T02:41:52.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb9d992700 1 -- 172.21.15.88:0/1789051216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9810d610 con 0x7ffb98101aa0 2023-12-09T02:41:52.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb7f7fe700 1 -- 172.21.15.88:0/1789051216 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb8800bc50 con 0x7ffb98101aa0 2023-12-09T02:41:52.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb7f7fe700 1 -- 172.21.15.88:0/1789051216 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb88013420 con 0x7ffb98101aa0 2023-12-09T02:41:52.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.528+0000 7ffb9d992700 1 -- 172.21.15.88:0/1789051216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9810dbd0 con 0x7ffb98101aa0 2023-12-09T02:41:52.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.529+0000 7ffb9d992700 1 -- 172.21.15.88:0/1789051216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb98063ea0 con 0x7ffb98101aa0 2023-12-09T02:41:52.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.530+0000 7ffb7f7fe700 1 -- 172.21.15.88:0/1789051216 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ffb8801c430 con 0x7ffb98101aa0 2023-12-09T02:41:52.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.530+0000 7ffb7f7fe700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffb8006ce60 0x7ffb8006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:52.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.530+0000 7ffb7f7fe700 1 -- 172.21.15.88:0/1789051216 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7ffb8808d220 con 0x7ffb98101aa0 2023-12-09T02:41:52.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.530+0000 7ffb96ffd700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffb8006ce60 0x7ffb8006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:52.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.531+0000 7ffb96ffd700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffb8006ce60 0x7ffb8006f310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009fd0 tx=0x7ffb8c009ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:52.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.535+0000 7ffb7f7fe700 1 -- 172.21.15.88:0/1789051216 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ffb8805ab10 con 0x7ffb98101aa0 2023-12-09T02:41:52.725 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:52 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1962898100' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:41:52.725 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:52 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/498262232' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-09T02:41:52.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.727+0000 7ffb9d992700 1 -- 172.21.15.88:0/1789051216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7ffb98108a20 con 0x7ffb98101aa0 2023-12-09T02:41:52.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.728+0000 7ffb7f7fe700 1 -- 172.21.15.88:0/1789051216 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v103) v1 ==== 107+0+11 (secure 0 0 0) 0x7ffb8805a6a0 con 0x7ffb98101aa0 2023-12-09T02:41:52.729 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-09T02:41:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.730+0000 7ffb9d992700 1 -- 172.21.15.88:0/1789051216 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffb8006ce60 msgr2=0x7ffb8006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.730+0000 7ffb9d992700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffb8006ce60 0x7ffb8006f310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009fd0 tx=0x7ffb8c009ee0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.730+0000 7ffb9d992700 1 -- 172.21.15.88:0/1789051216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb98101aa0 msgr2=0x7ffb98113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.730+0000 7ffb9d992700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb98101aa0 0x7ffb98113820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800b3b0 tx=0x7ffb88009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.730+0000 7ffb9d992700 1 -- 172.21.15.88:0/1789051216 shutdown_connections 2023-12-09T02:41:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.730+0000 7ffb9d992700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7ffb8006ce60 0x7ffb8006f310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.730+0000 7ffb9d992700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb980fba60 0x7ffb981132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.730+0000 7ffb9d992700 1 --2- 172.21.15.88:0/1789051216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb98101aa0 0x7ffb98113820 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.730+0000 7ffb9d992700 1 -- 172.21.15.88:0/1789051216 >> 172.21.15.88:0/1789051216 conn(0x7ffb980f7600 msgr2=0x7ffb98065950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:52.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.730+0000 7ffb9d992700 1 -- 172.21.15.88:0/1789051216 shutdown_connections 2023-12-09T02:41:52.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.730+0000 7ffb9d992700 1 -- 172.21.15.88:0/1789051216 wait complete. 2023-12-09T02:41:52.743 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-09T02:41:52.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.864+0000 7f2b9fd67700 1 -- 172.21.15.88:0/3880732549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b981023d0 msgr2=0x7f2b980fba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.864+0000 7f2b9fd67700 1 --2- 172.21.15.88:0/3880732549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b981023d0 0x7f2b980fba60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2b94004940 tx=0x7f2b94009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.864+0000 7f2b9fd67700 1 -- 172.21.15.88:0/3880732549 shutdown_connections 2023-12-09T02:41:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.864+0000 7f2b9fd67700 1 --2- 172.21.15.88:0/3880732549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b981023d0 0x7f2b980fba60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.864+0000 7f2b9fd67700 1 --2- 172.21.15.88:0/3880732549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b98101ac0 0x7f2b98101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.864+0000 7f2b9fd67700 1 -- 172.21.15.88:0/3880732549 >> 172.21.15.88:0/3880732549 conn(0x7f2b98071970 msgr2=0x7f2b98071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.864+0000 7f2b9fd67700 1 -- 172.21.15.88:0/3880732549 shutdown_connections 2023-12-09T02:41:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.864+0000 7f2b9fd67700 1 -- 172.21.15.88:0/3880732549 wait complete. 2023-12-09T02:41:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9fd67700 1 Processor -- start 2023-12-09T02:41:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9fd67700 1 -- start start 2023-12-09T02:41:52.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9fd67700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b98101ac0 0x7f2b98112260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:52.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9fd67700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b981023d0 0x7f2b981127a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:52.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9fd67700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98112e80 con 0x7f2b981023d0 2023-12-09T02:41:52.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9fd67700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9810c310 con 0x7f2b98101ac0 2023-12-09T02:41:52.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9d302700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b981023d0 0x7f2b981127a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:52.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9d302700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b981023d0 0x7f2b981127a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47134/0 (socket says 172.21.15.88:47134) 2023-12-09T02:41:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9d302700 1 -- 172.21.15.88:0/2185013692 learned_addr learned my addr 172.21.15.88:0/2185013692 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9d302700 1 -- 172.21.15.88:0/2185013692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b98101ac0 msgr2=0x7f2b98112260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9d302700 1 --2- 172.21.15.88:0/2185013692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b98101ac0 0x7f2b98112260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9d302700 1 -- 172.21.15.88:0/2185013692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94005040 con 0x7f2b981023d0 2023-12-09T02:41:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.865+0000 7f2b9d302700 1 --2- 172.21.15.88:0/2185013692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b981023d0 0x7f2b981127a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009fd0 tx=0x7f2b94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.866+0000 7f2b8a7fc700 1 -- 172.21.15.88:0/2185013692 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b9400e040 con 0x7f2b981023d0 2023-12-09T02:41:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.866+0000 7f2b8a7fc700 1 -- 172.21.15.88:0/2185013692 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b9400bd20 con 0x7f2b981023d0 2023-12-09T02:41:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.866+0000 7f2b8a7fc700 1 -- 172.21.15.88:0/2185013692 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b9401c630 con 0x7f2b981023d0 2023-12-09T02:41:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.866+0000 7f2b9fd67700 1 -- 172.21.15.88:0/2185013692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9810c530 con 0x7f2b981023d0 2023-12-09T02:41:52.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.866+0000 7f2b9fd67700 1 -- 172.21.15.88:0/2185013692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9810caf0 con 0x7f2b981023d0 2023-12-09T02:41:52.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.866+0000 7f2b9fd67700 1 -- 172.21.15.88:0/2185013692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b98064730 con 0x7f2b981023d0 2023-12-09T02:41:52.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.867+0000 7f2b8a7fc700 1 -- 172.21.15.88:0/2185013692 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f2b94013420 con 0x7f2b981023d0 2023-12-09T02:41:52.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.867+0000 7f2b8a7fc700 1 --2- 172.21.15.88:0/2185013692 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2b8406ce60 0x7f2b8406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:52.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.868+0000 7f2b8a7fc700 1 -- 172.21.15.88:0/2185013692 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f2b9408d830 con 0x7f2b981023d0 2023-12-09T02:41:52.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.868+0000 7f2b9db03700 1 --2- 172.21.15.88:0/2185013692 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2b8406ce60 0x7f2b8406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:52.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.868+0000 7f2b9db03700 1 --2- 172.21.15.88:0/2185013692 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2b8406ce60 0x7f2b8406f310 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c006fd0 tx=0x7f2b8c006db0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:52.872+0000 7f2b8a7fc700 1 -- 172.21.15.88:0/2185013692 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2b9405b070 con 0x7f2b981023d0 2023-12-09T02:41:52.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:52 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1962898100' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:41:52.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:52 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/498262232' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-09T02:41:53.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.062+0000 7f2b9fd67700 1 -- 172.21.15.88:0/2185013692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f2b98108a70 con 0x7f2b981023d0 2023-12-09T02:41:53.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.062+0000 7f2b8a7fc700 1 -- 172.21.15.88:0/2185013692 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v103) v1 ==== 107+0+11 (secure 0 0 0) 0x7f2b9405ac00 con 0x7f2b981023d0 2023-12-09T02:41:53.064 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-09T02:41:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.064+0000 7f2b9fd67700 1 -- 172.21.15.88:0/2185013692 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2b8406ce60 msgr2=0x7f2b8406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.064+0000 7f2b9fd67700 1 --2- 172.21.15.88:0/2185013692 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2b8406ce60 0x7f2b8406f310 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c006fd0 tx=0x7f2b8c006db0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.064+0000 7f2b9fd67700 1 -- 172.21.15.88:0/2185013692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b981023d0 msgr2=0x7f2b981127a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.064+0000 7f2b9fd67700 1 --2- 172.21.15.88:0/2185013692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b981023d0 0x7f2b981127a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009fd0 tx=0x7f2b94009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.064+0000 7f2b9fd67700 1 -- 172.21.15.88:0/2185013692 shutdown_connections 2023-12-09T02:41:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.064+0000 7f2b9fd67700 1 --2- 172.21.15.88:0/2185013692 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f2b8406ce60 0x7f2b8406f310 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.064+0000 7f2b9fd67700 1 --2- 172.21.15.88:0/2185013692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b98101ac0 0x7f2b98112260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.064+0000 7f2b9fd67700 1 --2- 172.21.15.88:0/2185013692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b981023d0 0x7f2b981127a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.064+0000 7f2b9fd67700 1 -- 172.21.15.88:0/2185013692 >> 172.21.15.88:0/2185013692 conn(0x7f2b98071970 msgr2=0x7f2b980fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.064+0000 7f2b9fd67700 1 -- 172.21.15.88:0/2185013692 shutdown_connections 2023-12-09T02:41:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.064+0000 7f2b9fd67700 1 -- 172.21.15.88:0/2185013692 wait complete. 2023-12-09T02:41:53.078 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-09T02:41:53.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.194+0000 7f5f3451d700 1 -- 172.21.15.88:0/237990381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f2c0fb200 msgr2=0x7f5f2c0fb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:53.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.194+0000 7f5f3451d700 1 --2- 172.21.15.88:0/237990381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f2c0fb200 0x7f5f2c0fb670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5f28004940 tx=0x7f5f28009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:53.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.194+0000 7f5f3451d700 1 -- 172.21.15.88:0/237990381 shutdown_connections 2023-12-09T02:41:53.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.194+0000 7f5f3451d700 1 --2- 172.21.15.88:0/237990381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f2c0fb200 0x7f5f2c0fb670 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.194+0000 7f5f3451d700 1 --2- 172.21.15.88:0/237990381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f2c101250 0x7f5f2c101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.194+0000 7f5f3451d700 1 -- 172.21.15.88:0/237990381 >> 172.21.15.88:0/237990381 conn(0x7f5f2c071140 msgr2=0x7f5f2c071540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.194+0000 7f5f3451d700 1 -- 172.21.15.88:0/237990381 shutdown_connections 2023-12-09T02:41:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.194+0000 7f5f3451d700 1 -- 172.21.15.88:0/237990381 wait complete. 2023-12-09T02:41:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f3451d700 1 Processor -- start 2023-12-09T02:41:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f3451d700 1 -- start start 2023-12-09T02:41:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f3451d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f2c0fb200 0x7f5f2c112240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f3451d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f2c101250 0x7f5f2c112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f3451d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c112e60 con 0x7f5f2c101250 2023-12-09T02:41:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f3451d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c10c2f0 con 0x7f5f2c0fb200 2023-12-09T02:41:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f31ab8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f2c101250 0x7f5f2c112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:53.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f31ab8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f2c101250 0x7f5f2c112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47142/0 (socket says 172.21.15.88:47142) 2023-12-09T02:41:53.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f31ab8700 1 -- 172.21.15.88:0/1630409096 learned_addr learned my addr 172.21.15.88:0/1630409096 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:53.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f322b9700 1 --2- 172.21.15.88:0/1630409096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f2c0fb200 0x7f5f2c112240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:53.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f31ab8700 1 -- 172.21.15.88:0/1630409096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f2c0fb200 msgr2=0x7f5f2c112240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:53.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f31ab8700 1 --2- 172.21.15.88:0/1630409096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f2c0fb200 0x7f5f2c112240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f31ab8700 1 -- 172.21.15.88:0/1630409096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28005040 con 0x7f5f2c101250 2023-12-09T02:41:53.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f31ab8700 1 --2- 172.21.15.88:0/1630409096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f2c101250 0x7f5f2c112780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800b3b0 tx=0x7f5f28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:53.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.195+0000 7f5f22ffd700 1 -- 172.21.15.88:0/1630409096 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f2800e040 con 0x7f5f2c101250 2023-12-09T02:41:53.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.196+0000 7f5f22ffd700 1 -- 172.21.15.88:0/1630409096 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f2800bc50 con 0x7f5f2c101250 2023-12-09T02:41:53.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.196+0000 7f5f3451d700 1 -- 172.21.15.88:0/1630409096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c10c510 con 0x7f5f2c101250 2023-12-09T02:41:53.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.196+0000 7f5f22ffd700 1 -- 172.21.15.88:0/1630409096 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f2801c3f0 con 0x7f5f2c101250 2023-12-09T02:41:53.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.196+0000 7f5f3451d700 1 -- 172.21.15.88:0/1630409096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c10ca50 con 0x7f5f2c101250 2023-12-09T02:41:53.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.197+0000 7f5f3451d700 1 -- 172.21.15.88:0/1630409096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c104b10 con 0x7f5f2c101250 2023-12-09T02:41:53.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.197+0000 7f5f22ffd700 1 -- 172.21.15.88:0/1630409096 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f5f28013420 con 0x7f5f2c101250 2023-12-09T02:41:53.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.197+0000 7f5f22ffd700 1 --2- 172.21.15.88:0/1630409096 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5f1806ce60 0x7f5f1806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:53.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.197+0000 7f5f22ffd700 1 -- 172.21.15.88:0/1630409096 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f5f2808d9a0 con 0x7f5f2c101250 2023-12-09T02:41:53.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.197+0000 7f5f322b9700 1 --2- 172.21.15.88:0/1630409096 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5f1806ce60 0x7f5f1806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:53.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.198+0000 7f5f322b9700 1 --2- 172.21.15.88:0/1630409096 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5f1806ce60 0x7f5f1806f310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006fd0 tx=0x7f5f1c008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:53.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.202+0000 7f5f22ffd700 1 -- 172.21.15.88:0/1630409096 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5f2805b1e0 con 0x7f5f2c101250 2023-12-09T02:41:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.406+0000 7f5f3451d700 1 -- 172.21.15.88:0/1630409096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5f2c063ea0 con 0x7f5f2c101250 2023-12-09T02:41:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.407+0000 7f5f22ffd700 1 -- 172.21.15.88:0/1630409096 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v103) v1 ==== 81+0+2305 (secure 0 0 0) 0x7f5f2805ad70 con 0x7f5f2c101250 2023-12-09T02:41:53.408 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3260767994 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:53.409 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/307195856 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:53.409 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/3655200437 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:53.409 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/4018114664 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:53.409 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2387855456 2023-12-10T02:28:19.326045+0000 2023-12-09T02:41:53.409 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3827350097 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:53.409 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6827/2247714894 2023-12-10T02:32:57.231230+0000 2023-12-09T02:41:53.409 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/712942340 2023-12-10T02:28:42.918100+0000 2023-12-09T02:41:53.409 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1442782127 2023-12-10T02:28:19.326045+0000 2023-12-09T02:41:53.410 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/3655200437 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:53.410 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6826/2247714894 2023-12-10T02:32:57.231230+0000 2023-12-09T02:41:53.410 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/2611357961 2023-12-10T02:28:42.918100+0000 2023-12-09T02:41:53.410 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/4135986178 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:53.410 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/3275540059 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:53.410 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1114065717 2023-12-10T02:29:31.504500+0000 2023-12-09T02:41:53.410 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2169163782 2023-12-10T02:28:19.326045+0000 2023-12-09T02:41:53.410 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/2611357961 2023-12-10T02:28:42.918100+0000 2023-12-09T02:41:53.411 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3370851904 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:53.411 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/3992950126 2023-12-10T02:28:19.326045+0000 2023-12-09T02:41:53.411 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2588418845 2023-12-10T02:28:42.918100+0000 2023-12-09T02:41:53.411 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3122789176 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:53.411 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/3992950126 2023-12-10T02:28:19.326045+0000 2023-12-09T02:41:53.411 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2622749836 2023-12-10T02:29:31.504500+0000 2023-12-09T02:41:53.411 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/774779438 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:53.412 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/1948870359 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:53.412 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/563213166 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:53.412 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/1603623708 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:53.412 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2723285069 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:53.412 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/563213166 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:53.412 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3372513144 2023-12-10T02:28:42.918100+0000 2023-12-09T02:41:53.412 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/2389651586 2023-12-10T02:29:31.504500+0000 2023-12-09T02:41:53.412 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:6828/1447919242 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:53.412 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/663304531 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:53.413 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:6829/1447919242 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:53.413 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1149962254 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:53.413 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/2389651586 2023-12-10T02:29:31.504500+0000 2023-12-09T02:41:53.413 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/521564869 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:53.413 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2691791328 2023-12-10T02:29:31.504500+0000 2023-12-09T02:41:53.413 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/1861090042 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.409+0000 7f5f3451d700 1 -- 172.21.15.88:0/1630409096 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5f1806ce60 msgr2=0x7f5f1806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.409+0000 7f5f3451d700 1 --2- 172.21.15.88:0/1630409096 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5f1806ce60 0x7f5f1806f310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006fd0 tx=0x7f5f1c008040 comp rx=0 tx=0).stop 2023-12-09T02:41:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.409+0000 7f5f3451d700 1 -- 172.21.15.88:0/1630409096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f2c101250 msgr2=0x7f5f2c112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.409+0000 7f5f3451d700 1 --2- 172.21.15.88:0/1630409096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f2c101250 0x7f5f2c112780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800b3b0 tx=0x7f5f28009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.409+0000 7f5f3451d700 1 -- 172.21.15.88:0/1630409096 shutdown_connections 2023-12-09T02:41:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.409+0000 7f5f3451d700 1 --2- 172.21.15.88:0/1630409096 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5f1806ce60 0x7f5f1806f310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.409+0000 7f5f3451d700 1 --2- 172.21.15.88:0/1630409096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f2c0fb200 0x7f5f2c112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.409+0000 7f5f3451d700 1 --2- 172.21.15.88:0/1630409096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f2c101250 0x7f5f2c112780 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.409+0000 7f5f3451d700 1 -- 172.21.15.88:0/1630409096 >> 172.21.15.88:0/1630409096 conn(0x7f5f2c071140 msgr2=0x7f5f2c064430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.409+0000 7f5f3451d700 1 -- 172.21.15.88:0/1630409096 shutdown_connections 2023-12-09T02:41:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.409+0000 7f5f3451d700 1 -- 172.21.15.88:0/1630409096 wait complete. 2023-12-09T02:41:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:listed 39 entries 2023-12-09T02:41:53.425 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-09T02:41:53.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:41:53.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-09T02:41:53.462 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:41:53.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:41:53.463 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-09T02:41:53.562 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:41:53.562 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-09T02:41:53.655 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-12-09T02:41:53.655 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-09T02:41:53.678 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-09T02:41:53.703 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:53 smithi088 ceph-mon[193406]: pgmap v214: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:53.703 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:53 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1789051216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-09T02:41:53.704 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:53 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/2185013692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-09T02:41:53.704 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:53 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1630409096' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-09T02:41:53.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.795+0000 7f5ce71cc700 1 -- 172.21.15.88:0/1567364152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00fbac0 msgr2=0x7f5ce00fbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:53.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.795+0000 7f5ce71cc700 1 --2- 172.21.15.88:0/1567364152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00fbac0 0x7f5ce00fbf30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc004940 tx=0x7f5ccc009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:53.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.795+0000 7f5ce71cc700 1 -- 172.21.15.88:0/1567364152 shutdown_connections 2023-12-09T02:41:53.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.795+0000 7f5ce71cc700 1 --2- 172.21.15.88:0/1567364152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00fbac0 0x7f5ce00fbf30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.795+0000 7f5ce71cc700 1 --2- 172.21.15.88:0/1567364152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ce0101b00 0x7f5ce0101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.795+0000 7f5ce71cc700 1 -- 172.21.15.88:0/1567364152 >> 172.21.15.88:0/1567364152 conn(0x7f5ce00f7660 msgr2=0x7f5ce00f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:53.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.795+0000 7f5ce71cc700 1 -- 172.21.15.88:0/1567364152 shutdown_connections 2023-12-09T02:41:53.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.795+0000 7f5ce71cc700 1 -- 172.21.15.88:0/1567364152 wait complete. 2023-12-09T02:41:53.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.796+0000 7f5ce71cc700 1 Processor -- start 2023-12-09T02:41:53.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.796+0000 7f5ce71cc700 1 -- start start 2023-12-09T02:41:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.796+0000 7f5ce71cc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00fbac0 0x7f5ce0112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.796+0000 7f5ce71cc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ce0101b00 0x7f5ce0112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.796+0000 7f5ce71cc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0112c90 con 0x7f5ce00fbac0 2023-12-09T02:41:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.796+0000 7f5ce71cc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce010c1b0 con 0x7f5ce0101b00 2023-12-09T02:41:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.796+0000 7f5ce4f68700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00fbac0 0x7f5ce0112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.796+0000 7f5ce4f68700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00fbac0 0x7f5ce0112100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47164/0 (socket says 172.21.15.88:47164) 2023-12-09T02:41:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.796+0000 7f5ce4f68700 1 -- 172.21.15.88:0/2675841606 learned_addr learned my addr 172.21.15.88:0/2675841606 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.796+0000 7f5cdffff700 1 --2- 172.21.15.88:0/2675841606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ce0101b00 0x7f5ce0112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.797+0000 7f5ce4f68700 1 -- 172.21.15.88:0/2675841606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ce0101b00 msgr2=0x7f5ce0112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.797+0000 7f5ce4f68700 1 --2- 172.21.15.88:0/2675841606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ce0101b00 0x7f5ce0112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.797+0000 7f5ce4f68700 1 -- 172.21.15.88:0/2675841606 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc005040 con 0x7f5ce00fbac0 2023-12-09T02:41:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.797+0000 7f5ce4f68700 1 --2- 172.21.15.88:0/2675841606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00fbac0 0x7f5ce0112100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4002a50 tx=0x7f5cd40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.797+0000 7f5cdd7fa700 1 -- 172.21.15.88:0/2675841606 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd4007cc0 con 0x7f5ce00fbac0 2023-12-09T02:41:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.797+0000 7f5cdd7fa700 1 -- 172.21.15.88:0/2675841606 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5cd400f040 con 0x7f5ce00fbac0 2023-12-09T02:41:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.797+0000 7f5cdd7fa700 1 -- 172.21.15.88:0/2675841606 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd400d9c0 con 0x7f5ce00fbac0 2023-12-09T02:41:53.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.797+0000 7f5ce71cc700 1 -- 172.21.15.88:0/2675841606 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce010c490 con 0x7f5ce00fbac0 2023-12-09T02:41:53.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.797+0000 7f5ce71cc700 1 -- 172.21.15.88:0/2675841606 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce010ca50 con 0x7f5ce00fbac0 2023-12-09T02:41:53.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.798+0000 7f5ce71cc700 1 -- 172.21.15.88:0/2675841606 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce0063ea0 con 0x7f5ce00fbac0 2023-12-09T02:41:53.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.799+0000 7f5cdd7fa700 1 -- 172.21.15.88:0/2675841606 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f5cd400db20 con 0x7f5ce00fbac0 2023-12-09T02:41:53.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.799+0000 7f5cdd7fa700 1 --2- 172.21.15.88:0/2675841606 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5cd006ce60 0x7f5cd006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:53.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.799+0000 7f5cdd7fa700 1 -- 172.21.15.88:0/2675841606 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f5cd408c1b0 con 0x7f5ce00fbac0 2023-12-09T02:41:53.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.799+0000 7f5cdffff700 1 --2- 172.21.15.88:0/2675841606 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5cd006ce60 0x7f5cd006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:53.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.799+0000 7f5cdffff700 1 --2- 172.21.15.88:0/2675841606 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5cd006ce60 0x7f5cd006f310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5ce010d9a0 tx=0x7f5ccc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:53.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.804+0000 7f5cdd7fa700 1 -- 172.21.15.88:0/2675841606 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5cd4059970 con 0x7f5ce00fbac0 2023-12-09T02:41:53.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:53 smithi161 ceph-mon[178840]: pgmap v214: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail 2023-12-09T02:41:53.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:53 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1789051216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-09T02:41:53.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:53 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/2185013692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-09T02:41:53.920 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:53 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1630409096' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-09T02:41:53.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.996+0000 7f5ce71cc700 1 -- 172.21.15.88:0/2675841606 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ce010cc70 con 0x7f5ce00fbac0 2023-12-09T02:41:53.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.997+0000 7f5cdd7fa700 1 -- 172.21.15.88:0/2675841606 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+17062 (secure 0 0 0) 0x7f5cd4059500 con 0x7f5ce00fbac0 2023-12-09T02:41:53.999 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-09T02:41:53.999 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":103,"fsid":"70b26980-963a-11ee-95a3-87774f69a715","created":"2023-12-09T02:27:49.802100+0000","modified":"2023-12-09T02:40:13.346264+0000","last_up_change":"2023-12-09T02:40:12.344421+0000","last_in_change":"2023-12-09T02:31:45.877281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-09T02:31:07.797033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-09T02:32:47.454661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-09T02:32:48.330279+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94c4c8ad-f87e-4abd-aff2-ea13d8630f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":61,"up_thru":102,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1860691891},{"type":"v1","addr":"172.21.15.88:6803","nonce":1860691891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1860691891},{"type":"v1","addr":"172.21.15.88:6805","nonce":1860691891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1860691891},{"type":"v1","addr":"172.21.15.88:6809","nonce":1860691891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1860691891},{"type":"v1","addr":"172.21.15.88:6807","nonce":1860691891}]},"public_addr":"172.21.15.88:6803/1860691891","cluster_addr":"172.21.15.88:6805/1860691891","heartbeat_back_addr":"172.21.15.88:6809/1860691891","heartbeat_front_addr":"172.21.15.88:6807/1860691891","state":["exists","up"]},{"osd":1,"uuid":"1b6c3137-e616-4979-a9cb-89665a8a2919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":68,"up_from":72,"up_thru":102,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3596877492},{"type":"v1","addr":"172.21.15.88:6811","nonce":3596877492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3596877492},{"type":"v1","addr":"172.21.15.88:6813","nonce":3596877492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3596877492},{"type":"v1","addr":"172.21.15.88:6817","nonce":3596877492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3596877492},{"type":"v1","addr":"172.21.15.88:6815","nonce":3596877492}]},"public_addr":"172.21.15.88:6811/3596877492","cluster_addr":"172.21.15.88:6813/3596877492","heartbeat_back_addr":"172.21.15.88:6817/3596877492","heartbeat_front_addr":"172.21.15.88:6815/3596877492","state":["exists","up"]},{"osd":2,"uuid":"c5d0b176-113f-450a-8737-2dcf542f1f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":73,"up_from":83,"up_thru":102,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1930679366},{"type":"v1","addr":"172.21.15.88:6819","nonce":1930679366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1930679366},{"type":"v1","addr":"172.21.15.88:6821","nonce":1930679366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1930679366},{"type":"v1","addr":"172.21.15.88:6825","nonce":1930679366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1930679366},{"type":"v1","addr":"172.21.15.88:6823","nonce":1930679366}]},"public_addr":"172.21.15.88:6819/1930679366","cluster_addr":"172.21.15.88:6821/1930679366","heartbeat_back_addr":"172.21.15.88:6825/1930679366","heartbeat_front_addr":"172.21.15.88:6823/1930679366","state":["exists","up"]},{"osd":3,"uuid":"6584d86c-84e6-4f9e-a481-d297f6892df8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":88,"up_from":92,"up_thru":102,"down_at":89,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":231164100},{"type":"v1","addr":"172.21.15.161:6801","nonce":231164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":231164100},{"type":"v1","addr":"172.21.15.161:6803","nonce":231164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":231164100},{"type":"v1","addr":"172.21.15.161:6807","nonce":231164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":231164100},{"type":"v1","addr":"172.21.15.161:6805","nonce":231164100}]},"public_addr":"172.21.15.161:6801/231164100","cluster_addr":"172.21.15.161:6803/231164100","heartbeat_back_addr":"172.21.15.161:6807/231164100","heartbeat_front_addr":"172.21.15.161:6805/231164100","state":["exists","up"]},{"osd":4,"uuid":"729b6d7a-8045-40d4-b07d-aa8d8912a357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":93,"up_from":97,"up_thru":102,"down_at":94,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2971260023},{"type":"v1","addr":"172.21.15.161:6809","nonce":2971260023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2971260023},{"type":"v1","addr":"172.21.15.161:6811","nonce":2971260023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2971260023},{"type":"v1","addr":"172.21.15.161:6815","nonce":2971260023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2971260023},{"type":"v1","addr":"172.21.15.161:6813","nonce":2971260023}]},"public_addr":"172.21.15.161:6809/2971260023","cluster_addr":"172.21.15.161:6811/2971260023","heartbeat_back_addr":"172.21.15.161:6815/2971260023","heartbeat_front_addr":"172.21.15.161:6813/2971260023","state":["exists","up"]},{"osd":5,"uuid":"973d7656-a340-4dc0-a2df-7cd3c96df604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":98,"up_from":102,"up_thru":102,"down_at":99,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4178294049},{"type":"v1","addr":"172.21.15.161:6817","nonce":4178294049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4178294049},{"type":"v1","addr":"172.21.15.161:6819","nonce":4178294049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4178294049},{"type":"v1","addr":"172.21.15.161:6823","nonce":4178294049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4178294049},{"type":"v1","addr":"172.21.15.161:6821","nonce":4178294049}]},"public_addr":"172.21.15.161:6817/4178294049","cluster_addr":"172.21.15.161:6819/4178294049","heartbeat_back_addr":"172.21.15.161:6823/4178294049","heartbeat_front_addr":"172.21.15.161:6821/4178294049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:24.723561+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:30:44.412595+0000","dead_epoch":68},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:04.087324+0000","dead_epoch":73},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:22.198894+0000","dead_epoch":88},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:31:41.741094+0000","dead_epoch":93},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-09T02:32:00.865763+0000","dead_epoch":98}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":0,"to":5}]},{"pgid":"2.5","mappings":[{"from":0,"to":2}]},{"pgid":"2.10","mappings":[{"from":0,"to":5}]},{"pgid":"2.1d","mappings":[{"from":3,"to":2}]},{"pgid":"2.1f","mappings":[{"from":3,"to":2}]},{"pgid":"3.3","mappings":[{"from":4,"to":2}]},{"pgid":"3.5","mappings":[{"from":3,"to":0}]},{"pgid":"3.7","mappings":[{"from":1,"to":0}]},{"pgid":"3.b","mappings":[{"from":4,"to":2}]},{"pgid":"3.c","mappings":[{"from":0,"to":2}]},{"pgid":"3.19","mappings":[{"from":1,"to":0}]},{"pgid":"3.1f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:0/3260767994":"2023-12-10T02:36:36.291035+0000","172.21.15.88:0/307195856":"2023-12-10T02:36:36.291035+0000","172.21.15.88:6801/3655200437":"2023-12-10T02:36:36.291035+0000","172.21.15.161:0/4018114664":"2023-12-10T02:35:55.111651+0000","172.21.15.88:0/2387855456":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/3827350097":"2023-12-10T02:35:12.863137+0000","172.21.15.88:6827/2247714894":"2023-12-10T02:32:57.231230+0000","172.21.15.88:0/712942340":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/1442782127":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6800/3655200437":"2023-12-10T02:36:36.291035+0000","172.21.15.88:6826/2247714894":"2023-12-10T02:32:57.231230+0000","172.21.15.88:6800/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.161:0/4135986178":"2023-12-10T02:35:55.111651+0000","172.21.15.161:0/3275540059":"2023-12-10T02:35:55.111651+0000","172.21.15.88:0/1114065717":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/2169163782":"2023-12-10T02:28:19.326045+0000","172.21.15.88:6801/2611357961":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/3370851904":"2023-12-10T02:36:36.291035+0000","172.21.15.88:6801/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/2588418845":"2023-12-10T02:28:42.918100+0000","172.21.15.88:0/3122789176":"2023-12-10T02:36:36.291035+0000","172.21.15.88:6800/3992950126":"2023-12-10T02:28:19.326045+0000","172.21.15.88:0/2622749836":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/774779438":"2023-12-10T02:36:36.291035+0000","172.21.15.161:0/1948870359":"2023-12-10T02:35:55.111651+0000","172.21.15.88:6800/563213166":"2023-12-10T02:35:12.863137+0000","172.21.15.161:0/1603623708":"2023-12-10T02:35:55.111651+0000","172.21.15.88:0/2723285069":"2023-12-10T02:35:12.863137+0000","172.21.15.88:6801/563213166":"2023-12-10T02:35:12.863137+0000","172.21.15.88:0/3372513144":"2023-12-10T02:28:42.918100+0000","172.21.15.88:6800/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.161:6828/1447919242":"2023-12-10T02:35:55.111651+0000","172.21.15.88:0/663304531":"2023-12-10T02:36:36.291035+0000","172.21.15.161:6829/1447919242":"2023-12-10T02:35:55.111651+0000","172.21.15.88:0/1149962254":"2023-12-10T02:35:12.863137+0000","172.21.15.88:6801/2389651586":"2023-12-10T02:29:31.504500+0000","172.21.15.88:0/521564869":"2023-12-10T02:35:12.863137+0000","172.21.15.88:0/2691791328":"2023-12-10T02:29:31.504500+0000","172.21.15.161:0/1861090042":"2023-12-10T02:35:55.111651+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-09T02:41:54.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.999+0000 7f5ce71cc700 1 -- 172.21.15.88:0/2675841606 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5cd006ce60 msgr2=0x7f5cd006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.999+0000 7f5ce71cc700 1 --2- 172.21.15.88:0/2675841606 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5cd006ce60 0x7f5cd006f310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5ce010d9a0 tx=0x7f5ccc009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:54.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.999+0000 7f5ce71cc700 1 -- 172.21.15.88:0/2675841606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00fbac0 msgr2=0x7f5ce0112100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.999+0000 7f5ce71cc700 1 --2- 172.21.15.88:0/2675841606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00fbac0 0x7f5ce0112100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4002a50 tx=0x7f5cd40046b0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.999+0000 7f5ce71cc700 1 -- 172.21.15.88:0/2675841606 shutdown_connections 2023-12-09T02:41:54.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.999+0000 7f5ce71cc700 1 --2- 172.21.15.88:0/2675841606 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f5cd006ce60 0x7f5cd006f310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.999+0000 7f5ce71cc700 1 --2- 172.21.15.88:0/2675841606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00fbac0 0x7f5ce0112100 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.999+0000 7f5ce71cc700 1 --2- 172.21.15.88:0/2675841606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ce0101b00 0x7f5ce0112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.999+0000 7f5ce71cc700 1 -- 172.21.15.88:0/2675841606 >> 172.21.15.88:0/2675841606 conn(0x7f5ce00f7660 msgr2=0x7f5ce00f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:54.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.999+0000 7f5ce71cc700 1 -- 172.21.15.88:0/2675841606 shutdown_connections 2023-12-09T02:41:54.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:53.999+0000 7f5ce71cc700 1 -- 172.21.15.88:0/2675841606 wait complete. 2023-12-09T02:41:54.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-09T02:31:07.797033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-09T02:32:47.454661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-09T02:32:48.330279+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-09T02:41:54.016 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-09T02:41:54.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.173+0000 7f1a0230b700 1 -- 172.21.15.88:0/3828697403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19fc0fdb50 msgr2=0x7f19fc0fdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.173+0000 7f1a0230b700 1 --2- 172.21.15.88:0/3828697403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19fc0fdb50 0x7f19fc0fdf20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f19ec004940 tx=0x7f19ec009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:54.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.173+0000 7f1a0230b700 1 -- 172.21.15.88:0/3828697403 shutdown_connections 2023-12-09T02:41:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.173+0000 7f1a0230b700 1 --2- 172.21.15.88:0/3828697403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19fc0fe4f0 0x7f19fc106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.173+0000 7f1a0230b700 1 --2- 172.21.15.88:0/3828697403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19fc0fdb50 0x7f19fc0fdf20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.173+0000 7f1a0230b700 1 -- 172.21.15.88:0/3828697403 >> 172.21.15.88:0/3828697403 conn(0x7f19fc0f7600 msgr2=0x7f19fc0f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.173+0000 7f1a0230b700 1 -- 172.21.15.88:0/3828697403 shutdown_connections 2023-12-09T02:41:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.173+0000 7f1a0230b700 1 -- 172.21.15.88:0/3828697403 wait complete. 2023-12-09T02:41:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.173+0000 7f1a0230b700 1 Processor -- start 2023-12-09T02:41:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.173+0000 7f1a0230b700 1 -- start start 2023-12-09T02:41:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f1a0230b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19fc0fdb50 0x7f19fc113300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f1a0230b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19fc0fe4f0 0x7f19fc113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f1a0230b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc113e90 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f1a0230b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc10d3b0 con 0x7f19fc0fdb50 2023-12-09T02:41:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f19f3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19fc0fe4f0 0x7f19fc113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f19f3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19fc0fe4f0 0x7f19fc113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47174/0 (socket says 172.21.15.88:47174) 2023-12-09T02:41:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f19f3fff700 1 -- 172.21.15.88:0/1008122099 learned_addr learned my addr 172.21.15.88:0/1008122099 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f19fbfff700 1 --2- 172.21.15.88:0/1008122099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19fc0fdb50 0x7f19fc113300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f19f3fff700 1 -- 172.21.15.88:0/1008122099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19fc0fdb50 msgr2=0x7f19fc113300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f19f3fff700 1 --2- 172.21.15.88:0/1008122099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19fc0fdb50 0x7f19fc113300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f19f3fff700 1 -- 172.21.15.88:0/1008122099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec005040 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f19f3fff700 1 --2- 172.21.15.88:0/1008122099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19fc0fe4f0 0x7f19fc113840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f19e400c830 tx=0x7f19e4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f19f97fa700 1 -- 172.21.15.88:0/1008122099 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19e400a760 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f19f97fa700 1 -- 172.21.15.88:0/1008122099 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19e400ad70 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f1a0230b700 1 -- 172.21.15.88:0/1008122099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19fc10d690 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f19f97fa700 1 -- 172.21.15.88:0/1008122099 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19e40113a0 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.174+0000 7f1a0230b700 1 -- 172.21.15.88:0/1008122099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19fc10dbd0 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.175+0000 7f1a0230b700 1 -- 172.21.15.88:0/1008122099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19fc104140 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.176+0000 7f19f97fa700 1 -- 172.21.15.88:0/1008122099 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f19e4012400 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.176+0000 7f19f97fa700 1 --2- 172.21.15.88:0/1008122099 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f19e806ce60 0x7f19e806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:54.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.176+0000 7f19f97fa700 1 -- 172.21.15.88:0/1008122099 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f19e408c4c0 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.176+0000 7f19fbfff700 1 --2- 172.21.15.88:0/1008122099 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f19e806ce60 0x7f19e806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:54.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.176+0000 7f19fbfff700 1 --2- 172.21.15.88:0/1008122099 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f19e806ce60 0x7f19e806f310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19ec004f90 tx=0x7f19ec009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.180+0000 7f19f97fa700 1 -- 172.21.15.88:0/1008122099 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f19e4059d00 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.370+0000 7f1a0230b700 1 -- 172.21.15.88:0/1008122099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19fc10e8e0 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.371+0000 7f19f97fa700 1 -- 172.21.15.88:0/1008122099 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19e4059890 con 0x7f19fc0fe4f0 2023-12-09T02:41:54.373 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-09T02:41:54.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.373+0000 7f1a0230b700 1 -- 172.21.15.88:0/1008122099 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f19e806ce60 msgr2=0x7f19e806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.373+0000 7f1a0230b700 1 --2- 172.21.15.88:0/1008122099 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f19e806ce60 0x7f19e806f310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19ec004f90 tx=0x7f19ec009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:54.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.373+0000 7f1a0230b700 1 -- 172.21.15.88:0/1008122099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19fc0fe4f0 msgr2=0x7f19fc113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.373+0000 7f1a0230b700 1 --2- 172.21.15.88:0/1008122099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19fc0fe4f0 0x7f19fc113840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f19e400c830 tx=0x7f19e4004470 comp rx=0 tx=0).stop 2023-12-09T02:41:54.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.373+0000 7f1a0230b700 1 -- 172.21.15.88:0/1008122099 shutdown_connections 2023-12-09T02:41:54.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.373+0000 7f1a0230b700 1 --2- 172.21.15.88:0/1008122099 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f19e806ce60 0x7f19e806f310 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.373+0000 7f1a0230b700 1 --2- 172.21.15.88:0/1008122099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19fc0fdb50 0x7f19fc113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.373+0000 7f1a0230b700 1 --2- 172.21.15.88:0/1008122099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19fc0fe4f0 0x7f19fc113840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.373+0000 7f1a0230b700 1 -- 172.21.15.88:0/1008122099 >> 172.21.15.88:0/1008122099 conn(0x7f19fc0f7600 msgr2=0x7f19fc1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:54.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.373+0000 7f1a0230b700 1 -- 172.21.15.88:0/1008122099 shutdown_connections 2023-12-09T02:41:54.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.373+0000 7f1a0230b700 1 -- 172.21.15.88:0/1008122099 wait complete. 2023-12-09T02:41:54.387 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-09T02:41:54.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.505+0000 7f7a662ba700 1 -- 172.21.15.88:0/801873576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a600fb9e0 msgr2=0x7f7a600fbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.505+0000 7f7a662ba700 1 --2- 172.21.15.88:0/801873576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a600fb9e0 0x7f7a600fbe50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7a48004940 tx=0x7f7a48009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:54.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.505+0000 7f7a662ba700 1 -- 172.21.15.88:0/801873576 shutdown_connections 2023-12-09T02:41:54.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.505+0000 7f7a662ba700 1 --2- 172.21.15.88:0/801873576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a600fb9e0 0x7f7a600fbe50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.505+0000 7f7a662ba700 1 --2- 172.21.15.88:0/801873576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a60101a20 0x7f7a60101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.505+0000 7f7a662ba700 1 -- 172.21.15.88:0/801873576 >> 172.21.15.88:0/801873576 conn(0x7f7a600f75a0 msgr2=0x7f7a600f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:54.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.505+0000 7f7a662ba700 1 -- 172.21.15.88:0/801873576 shutdown_connections 2023-12-09T02:41:54.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.505+0000 7f7a662ba700 1 -- 172.21.15.88:0/801873576 wait complete. 2023-12-09T02:41:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a662ba700 1 Processor -- start 2023-12-09T02:41:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a662ba700 1 -- start start 2023-12-09T02:41:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a662ba700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a600fb9e0 0x7f7a6010e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a662ba700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a60101a20 0x7f7a6010e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a662ba700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6010ee00 con 0x7f7a60101a20 2023-12-09T02:41:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a662ba700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6010ef40 con 0x7f7a600fb9e0 2023-12-09T02:41:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a57fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a60101a20 0x7f7a6010e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a57fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a60101a20 0x7f7a6010e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47186/0 (socket says 172.21.15.88:47186) 2023-12-09T02:41:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a57fff700 1 -- 172.21.15.88:0/1661728539 learned_addr learned my addr 172.21.15.88:0/1661728539 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a5ffff700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a600fb9e0 0x7f7a6010e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a57fff700 1 -- 172.21.15.88:0/1661728539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a600fb9e0 msgr2=0x7f7a6010e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a57fff700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a600fb9e0 0x7f7a6010e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a57fff700 1 -- 172.21.15.88:0/1661728539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a48005040 con 0x7f7a60101a20 2023-12-09T02:41:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a5ffff700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a600fb9e0 0x7f7a6010e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-09T02:41:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.506+0000 7f7a57fff700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a60101a20 0x7f7a6010e8c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800b3b0 tx=0x7f7a48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.507+0000 7f7a5d7fa700 1 -- 172.21.15.88:0/1661728539 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4800e040 con 0x7f7a60101a20 2023-12-09T02:41:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.507+0000 7f7a5d7fa700 1 -- 172.21.15.88:0/1661728539 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a4800bc50 con 0x7f7a60101a20 2023-12-09T02:41:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.507+0000 7f7a662ba700 1 -- 172.21.15.88:0/1661728539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6010f1c0 con 0x7f7a60101a20 2023-12-09T02:41:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.507+0000 7f7a5d7fa700 1 -- 172.21.15.88:0/1661728539 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a48013420 con 0x7f7a60101a20 2023-12-09T02:41:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.507+0000 7f7a662ba700 1 -- 172.21.15.88:0/1661728539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a601177f0 con 0x7f7a60101a20 2023-12-09T02:41:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.507+0000 7f7a662ba700 1 -- 172.21.15.88:0/1661728539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a60103ea0 con 0x7f7a60101a20 2023-12-09T02:41:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.508+0000 7f7a5d7fa700 1 -- 172.21.15.88:0/1661728539 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7a4801c430 con 0x7f7a60101a20 2023-12-09T02:41:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.508+0000 7f7a5d7fa700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a4c06ce60 0x7f7a4c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.508+0000 7f7a5d7fa700 1 -- 172.21.15.88:0/1661728539 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f7a4808d250 con 0x7f7a60101a20 2023-12-09T02:41:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.508+0000 7f7a5ffff700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a4c06ce60 0x7f7a4c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.509+0000 7f7a5ffff700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a4c06ce60 0x7f7a4c06f310 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009fd0 tx=0x7f7a50009ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:54.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.513+0000 7f7a5d7fa700 1 -- 172.21.15.88:0/1661728539 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7a480570b0 con 0x7f7a60101a20 2023-12-09T02:41:54.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.707+0000 7f7a662ba700 1 -- 172.21.15.88:0/1661728539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f7a60065ed0 con 0x7f7a60101a20 2023-12-09T02:41:54.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.708+0000 7f7a5d7fa700 1 -- 172.21.15.88:0/1661728539 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v103) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7a4805a6d0 con 0x7f7a60101a20 2023-12-09T02:41:54.709 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-09T02:41:54.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.710+0000 7f7a662ba700 1 -- 172.21.15.88:0/1661728539 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a4c06ce60 msgr2=0x7f7a4c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.710+0000 7f7a662ba700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a4c06ce60 0x7f7a4c06f310 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009fd0 tx=0x7f7a50009ee0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.710+0000 7f7a662ba700 1 -- 172.21.15.88:0/1661728539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a60101a20 msgr2=0x7f7a6010e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.710+0000 7f7a662ba700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a60101a20 0x7f7a6010e8c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800b3b0 tx=0x7f7a48009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:54.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.710+0000 7f7a662ba700 1 -- 172.21.15.88:0/1661728539 shutdown_connections 2023-12-09T02:41:54.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.710+0000 7f7a662ba700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f7a4c06ce60 0x7f7a4c06f310 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.710+0000 7f7a662ba700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a600fb9e0 0x7f7a6010e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.710+0000 7f7a662ba700 1 --2- 172.21.15.88:0/1661728539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a60101a20 0x7f7a6010e8c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.710+0000 7f7a662ba700 1 -- 172.21.15.88:0/1661728539 >> 172.21.15.88:0/1661728539 conn(0x7f7a600f75a0 msgr2=0x7f7a600f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:54.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.710+0000 7f7a662ba700 1 -- 172.21.15.88:0/1661728539 shutdown_connections 2023-12-09T02:41:54.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.710+0000 7f7a662ba700 1 -- 172.21.15.88:0/1661728539 wait complete. 2023-12-09T02:41:54.724 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-09T02:41:54.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.842+0000 7f3635529700 1 -- 172.21.15.88:0/3662194294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300fc210 msgr2=0x7f3630108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.842+0000 7f3635529700 1 --2- 172.21.15.88:0/3662194294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300fc210 0x7f3630108f70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3620004940 tx=0x7f3620009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:54.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.842+0000 7f3635529700 1 -- 172.21.15.88:0/3662194294 shutdown_connections 2023-12-09T02:41:54.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.842+0000 7f3635529700 1 --2- 172.21.15.88:0/3662194294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300fc210 0x7f3630108f70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.842+0000 7f3635529700 1 --2- 172.21.15.88:0/3662194294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36300fb900 0x7f36300fbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.842+0000 7f3635529700 1 -- 172.21.15.88:0/3662194294 >> 172.21.15.88:0/3662194294 conn(0x7f36300f75f0 msgr2=0x7f36300f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:54.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.842+0000 7f3635529700 1 -- 172.21.15.88:0/3662194294 shutdown_connections 2023-12-09T02:41:54.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.842+0000 7f3635529700 1 -- 172.21.15.88:0/3662194294 wait complete. 2023-12-09T02:41:54.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.842+0000 7f3635529700 1 Processor -- start 2023-12-09T02:41:54.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.842+0000 7f3635529700 1 -- start start 2023-12-09T02:41:54.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f3635529700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300fb900 0x7f3630115420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:54.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f3635529700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36300fc210 0x7f3630115960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:54.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f3635529700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630115fb0 con 0x7f36300fb900 2023-12-09T02:41:54.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f3635529700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363010f510 con 0x7f36300fc210 2023-12-09T02:41:54.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f362effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300fb900 0x7f3630115420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:54.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f362effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300fb900 0x7f3630115420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47204/0 (socket says 172.21.15.88:47204) 2023-12-09T02:41:54.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f362effd700 1 -- 172.21.15.88:0/840564566 learned_addr learned my addr 172.21.15.88:0/840564566 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:54.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f362effd700 1 -- 172.21.15.88:0/840564566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36300fc210 msgr2=0x7f3630115960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:54.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f362effd700 1 --2- 172.21.15.88:0/840564566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36300fc210 0x7f3630115960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:54.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f362effd700 1 -- 172.21.15.88:0/840564566 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620005040 con 0x7f36300fb900 2023-12-09T02:41:54.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f362effd700 1 --2- 172.21.15.88:0/840564566 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300fb900 0x7f3630115420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3624002a50 tx=0x7f36240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:54.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f36177fe700 1 -- 172.21.15.88:0/840564566 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3624007cc0 con 0x7f36300fb900 2023-12-09T02:41:54.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f36177fe700 1 -- 172.21.15.88:0/840564566 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f362400f040 con 0x7f36300fb900 2023-12-09T02:41:54.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f3635529700 1 -- 172.21.15.88:0/840564566 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363010f7f0 con 0x7f36300fb900 2023-12-09T02:41:54.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f36177fe700 1 -- 172.21.15.88:0/840564566 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3624009540 con 0x7f36300fb900 2023-12-09T02:41:54.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.843+0000 7f3635529700 1 -- 172.21.15.88:0/840564566 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363010fdb0 con 0x7f36300fb900 2023-12-09T02:41:54.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.844+0000 7f3635529700 1 -- 172.21.15.88:0/840564566 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36301066a0 con 0x7f36300fb900 2023-12-09T02:41:54.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.845+0000 7f36177fe700 1 -- 172.21.15.88:0/840564566 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f36240096a0 con 0x7f36300fb900 2023-12-09T02:41:54.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.845+0000 7f36177fe700 1 --2- 172.21.15.88:0/840564566 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f361806ce70 0x7f361806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:54.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.845+0000 7f36177fe700 1 -- 172.21.15.88:0/840564566 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f362408c2a0 con 0x7f36300fb900 2023-12-09T02:41:54.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.845+0000 7f362e7fc700 1 --2- 172.21.15.88:0/840564566 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f361806ce70 0x7f361806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:54.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.845+0000 7f362e7fc700 1 --2- 172.21.15.88:0/840564566 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f361806ce70 0x7f361806f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3620004f90 tx=0x7f3620009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:54.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:54.849+0000 7f36177fe700 1 -- 172.21.15.88:0/840564566 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3624055fd0 con 0x7f36300fb900 2023-12-09T02:41:54.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:54 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/2675841606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:41:54.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:54 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1008122099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-09T02:41:54.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:54 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/2675841606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-09T02:41:54.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:54 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1008122099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-09T02:41:55.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.037+0000 7f3635529700 1 -- 172.21.15.88:0/840564566 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f3630063ea0 con 0x7f36300fb900 2023-12-09T02:41:55.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.037+0000 7f36177fe700 1 -- 172.21.15.88:0/840564566 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v103) v1 ==== 107+0+11 (secure 0 0 0) 0x7f36240595f0 con 0x7f36300fb900 2023-12-09T02:41:55.039 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-09T02:41:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.039+0000 7f3635529700 1 -- 172.21.15.88:0/840564566 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f361806ce70 msgr2=0x7f361806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.039+0000 7f3635529700 1 --2- 172.21.15.88:0/840564566 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f361806ce70 0x7f361806f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3620004f90 tx=0x7f3620009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.039+0000 7f3635529700 1 -- 172.21.15.88:0/840564566 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300fb900 msgr2=0x7f3630115420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.039+0000 7f3635529700 1 --2- 172.21.15.88:0/840564566 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300fb900 0x7f3630115420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3624002a50 tx=0x7f36240046b0 comp rx=0 tx=0).stop 2023-12-09T02:41:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.039+0000 7f3635529700 1 -- 172.21.15.88:0/840564566 shutdown_connections 2023-12-09T02:41:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.039+0000 7f3635529700 1 --2- 172.21.15.88:0/840564566 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f361806ce70 0x7f361806f320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.039+0000 7f3635529700 1 --2- 172.21.15.88:0/840564566 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300fb900 0x7f3630115420 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.039+0000 7f3635529700 1 --2- 172.21.15.88:0/840564566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36300fc210 0x7f3630115960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.039+0000 7f3635529700 1 -- 172.21.15.88:0/840564566 >> 172.21.15.88:0/840564566 conn(0x7f36300f75f0 msgr2=0x7f36300f8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.039+0000 7f3635529700 1 -- 172.21.15.88:0/840564566 shutdown_connections 2023-12-09T02:41:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.039+0000 7f3635529700 1 -- 172.21.15.88:0/840564566 wait complete. 2023-12-09T02:41:55.053 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-09T02:41:55.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.170+0000 7f751fbd6700 1 -- 172.21.15.88:0/2482654421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7518101ac0 msgr2=0x7f7518101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:55.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.170+0000 7f751fbd6700 1 --2- 172.21.15.88:0/2482654421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7518101ac0 0x7f7518101e90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7508004940 tx=0x7f7508009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:55.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.170+0000 7f751fbd6700 1 -- 172.21.15.88:0/2482654421 shutdown_connections 2023-12-09T02:41:55.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.170+0000 7f751fbd6700 1 --2- 172.21.15.88:0/2482654421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75181023d0 0x7f75180fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:55.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.170+0000 7f751fbd6700 1 --2- 172.21.15.88:0/2482654421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7518101ac0 0x7f7518101e90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:55.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.170+0000 7f751fbd6700 1 -- 172.21.15.88:0/2482654421 >> 172.21.15.88:0/2482654421 conn(0x7f7518071970 msgr2=0x7f7518071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:55.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.170+0000 7f751fbd6700 1 -- 172.21.15.88:0/2482654421 shutdown_connections 2023-12-09T02:41:55.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.170+0000 7f751fbd6700 1 -- 172.21.15.88:0/2482654421 wait complete. 2023-12-09T02:41:55.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.171+0000 7f751fbd6700 1 Processor -- start 2023-12-09T02:41:55.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.171+0000 7f751fbd6700 1 -- start start 2023-12-09T02:41:55.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.171+0000 7f751fbd6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7518101ac0 0x7f7518112230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:55.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.171+0000 7f751fbd6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75181023d0 0x7f7518112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:55.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.171+0000 7f751fbd6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7518112e50 con 0x7f75181023d0 2023-12-09T02:41:55.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.171+0000 7f751fbd6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751810c2e0 con 0x7f7518101ac0 2023-12-09T02:41:55.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.171+0000 7f751d171700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75181023d0 0x7f7518112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:55.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.171+0000 7f751d171700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75181023d0 0x7f7518112770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47234/0 (socket says 172.21.15.88:47234) 2023-12-09T02:41:55.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.171+0000 7f751d171700 1 -- 172.21.15.88:0/788062345 learned_addr learned my addr 172.21.15.88:0/788062345 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-09T02:41:55.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.171+0000 7f751d972700 1 --2- 172.21.15.88:0/788062345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7518101ac0 0x7f7518112230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:55.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.172+0000 7f751d171700 1 -- 172.21.15.88:0/788062345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7518101ac0 msgr2=0x7f7518112230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:55.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.172+0000 7f751d171700 1 --2- 172.21.15.88:0/788062345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7518101ac0 0x7f7518112230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:55.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.172+0000 7f751d171700 1 -- 172.21.15.88:0/788062345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508005040 con 0x7f75181023d0 2023-12-09T02:41:55.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.172+0000 7f751d171700 1 --2- 172.21.15.88:0/788062345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75181023d0 0x7f7518112770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f751400daf0 tx=0x7f751400b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:55.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.172+0000 7f750e7fc700 1 -- 172.21.15.88:0/788062345 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f751400ecf0 con 0x7f75181023d0 2023-12-09T02:41:55.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.172+0000 7f751fbd6700 1 -- 172.21.15.88:0/788062345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751810c560 con 0x7f75181023d0 2023-12-09T02:41:55.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.172+0000 7f750e7fc700 1 -- 172.21.15.88:0/788062345 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f751400ee50 con 0x7f75181023d0 2023-12-09T02:41:55.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.172+0000 7f750e7fc700 1 -- 172.21.15.88:0/788062345 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7514016840 con 0x7f75181023d0 2023-12-09T02:41:55.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.172+0000 7f751fbd6700 1 -- 172.21.15.88:0/788062345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751810cb20 con 0x7f75181023d0 2023-12-09T02:41:55.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.173+0000 7f751fbd6700 1 -- 172.21.15.88:0/788062345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7518064730 con 0x7f75181023d0 2023-12-09T02:41:55.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.173+0000 7f750e7fc700 1 -- 172.21.15.88:0/788062345 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7514014070 con 0x7f75181023d0 2023-12-09T02:41:55.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.174+0000 7f750e7fc700 1 --2- 172.21.15.88:0/788062345 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f750406ce60 0x7f750406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-09T02:41:55.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.174+0000 7f750e7fc700 1 -- 172.21.15.88:0/788062345 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f751408e530 con 0x7f75181023d0 2023-12-09T02:41:55.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.174+0000 7f751d972700 1 --2- 172.21.15.88:0/788062345 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f750406ce60 0x7f750406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-09T02:41:55.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.174+0000 7f751d972700 1 --2- 172.21.15.88:0/788062345 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f750406ce60 0x7f750406f310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7508004560 tx=0x7f7508009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-09T02:41:55.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.178+0000 7f750e7fc700 1 -- 172.21.15.88:0/788062345 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f751405bd70 con 0x7f75181023d0 2023-12-09T02:41:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.383+0000 7f751fbd6700 1 -- 172.21.15.88:0/788062345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7518108a90 con 0x7f75181023d0 2023-12-09T02:41:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.384+0000 7f750e7fc700 1 -- 172.21.15.88:0/788062345 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v103) v1 ==== 81+0+2305 (secure 0 0 0) 0x7f751405b900 con 0x7f75181023d0 2023-12-09T02:41:55.386 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3260767994 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:55.386 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/307195856 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:55.386 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/3655200437 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:55.386 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/4018114664 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:55.386 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2387855456 2023-12-10T02:28:19.326045+0000 2023-12-09T02:41:55.386 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3827350097 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:55.387 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6827/2247714894 2023-12-10T02:32:57.231230+0000 2023-12-09T02:41:55.387 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/712942340 2023-12-10T02:28:42.918100+0000 2023-12-09T02:41:55.387 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1442782127 2023-12-10T02:28:19.326045+0000 2023-12-09T02:41:55.387 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/3655200437 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:55.387 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6826/2247714894 2023-12-10T02:32:57.231230+0000 2023-12-09T02:41:55.387 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/2611357961 2023-12-10T02:28:42.918100+0000 2023-12-09T02:41:55.387 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/4135986178 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:55.387 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/3275540059 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:55.387 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1114065717 2023-12-10T02:29:31.504500+0000 2023-12-09T02:41:55.388 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2169163782 2023-12-10T02:28:19.326045+0000 2023-12-09T02:41:55.388 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/2611357961 2023-12-10T02:28:42.918100+0000 2023-12-09T02:41:55.388 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3370851904 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:55.388 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/3992950126 2023-12-10T02:28:19.326045+0000 2023-12-09T02:41:55.388 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2588418845 2023-12-10T02:28:42.918100+0000 2023-12-09T02:41:55.388 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3122789176 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:55.388 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/3992950126 2023-12-10T02:28:19.326045+0000 2023-12-09T02:41:55.388 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2622749836 2023-12-10T02:29:31.504500+0000 2023-12-09T02:41:55.388 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/774779438 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:55.388 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/1948870359 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:55.389 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/563213166 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:55.389 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/1603623708 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:55.389 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2723285069 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:55.389 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/563213166 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:55.389 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3372513144 2023-12-10T02:28:42.918100+0000 2023-12-09T02:41:55.389 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/2389651586 2023-12-10T02:29:31.504500+0000 2023-12-09T02:41:55.389 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:6828/1447919242 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:55.389 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/663304531 2023-12-10T02:36:36.291035+0000 2023-12-09T02:41:55.389 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:6829/1447919242 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:55.390 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1149962254 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:55.390 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/2389651586 2023-12-10T02:29:31.504500+0000 2023-12-09T02:41:55.390 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/521564869 2023-12-10T02:35:12.863137+0000 2023-12-09T02:41:55.390 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2691791328 2023-12-10T02:29:31.504500+0000 2023-12-09T02:41:55.390 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.161:0/1861090042 2023-12-10T02:35:55.111651+0000 2023-12-09T02:41:55.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.386+0000 7f751fbd6700 1 -- 172.21.15.88:0/788062345 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f750406ce60 msgr2=0x7f750406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:55.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.386+0000 7f751fbd6700 1 --2- 172.21.15.88:0/788062345 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f750406ce60 0x7f750406f310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7508004560 tx=0x7f7508009e30 comp rx=0 tx=0).stop 2023-12-09T02:41:55.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.386+0000 7f751fbd6700 1 -- 172.21.15.88:0/788062345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75181023d0 msgr2=0x7f7518112770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-09T02:41:55.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.386+0000 7f751fbd6700 1 --2- 172.21.15.88:0/788062345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75181023d0 0x7f7518112770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f751400daf0 tx=0x7f751400b4c0 comp rx=0 tx=0).stop 2023-12-09T02:41:55.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.386+0000 7f751fbd6700 1 -- 172.21.15.88:0/788062345 shutdown_connections 2023-12-09T02:41:55.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.386+0000 7f751fbd6700 1 --2- 172.21.15.88:0/788062345 >> [v2:172.21.15.88:6800/1172550247,v1:172.21.15.88:6801/1172550247] conn(0x7f750406ce60 0x7f750406f310 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:55.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.386+0000 7f751fbd6700 1 --2- 172.21.15.88:0/788062345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7518101ac0 0x7f7518112230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:55.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.386+0000 7f751fbd6700 1 --2- 172.21.15.88:0/788062345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75181023d0 0x7f7518112770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-09T02:41:55.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.386+0000 7f751fbd6700 1 -- 172.21.15.88:0/788062345 >> 172.21.15.88:0/788062345 conn(0x7f7518071970 msgr2=0x7f75180fae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-09T02:41:55.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.386+0000 7f751fbd6700 1 -- 172.21.15.88:0/788062345 shutdown_connections 2023-12-09T02:41:55.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-09T02:41:55.386+0000 7f751fbd6700 1 -- 172.21.15.88:0/788062345 wait complete. 2023-12-09T02:41:55.392 INFO:teuthology.orchestra.run.smithi088.stderr:listed 39 entries 2023-12-09T02:41:55.400 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-09T02:41:55.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:41:55.400 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-09T02:41:55.449 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-12-09T02:41:55.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:41:55.449 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-09T02:41:55.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:41:55.542 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-09T02:41:55.614 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-09T02:41:55.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:41:55.614 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-09T02:41:55.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:41:55.675 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-12-09T02:41:55.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:41:55.744 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-12-09T02:41:55.763 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-09T02:41:55.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:41:55.764 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-09T02:41:55.829 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:55 smithi161 ceph-mon[178840]: pgmap v215: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-09T02:41:55.829 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:55 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/1661728539' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-09T02:41:55.829 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:55 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/840564566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-09T02:41:55.830 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:55 smithi161 ceph-mon[178840]: from='client.? 172.21.15.88:0/788062345' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-09T02:41:55.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-09T02:41:55.856 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-12-09T02:41:55.963 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-09T02:41:55.975 INFO:tasks.cephadm:Teardown begin 2023-12-09T02:41:55.976 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-09T02:41:55.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:55 smithi088 ceph-mon[193406]: pgmap v215: 65 pgs: 65 active+clean; 199 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-09T02:41:55.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:55 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/1661728539' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-09T02:41:55.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:55 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/840564566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-09T02:41:55.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:55 smithi088 ceph-mon[193406]: from='client.? 172.21.15.88:0/788062345' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-09T02:41:56.005 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-09T02:41:56.034 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-09T02:41:56.035 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-09T02:41:56.063 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-09T02:41:56.093 INFO:tasks.cephadm:Stopping all daemons... 2023-12-09T02:41:56.093 INFO:tasks.cephadm.mon.smithi088:Stopping mon.smithi088... 2023-12-09T02:41:56.093 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi088 2023-12-09T02:41:56.309 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:56 smithi088 systemd[1]: Stopping Ceph mon.smithi088 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:41:56.634 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:56 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi088[193384]: 2023-12-09T02:41:56.307+0000 7fc2a7442700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi088 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:41:56.635 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:56 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi088[193384]: 2023-12-09T02:41:56.307+0000 7fc2a7442700 -1 mon.smithi088@0(leader) e3 *** Got Signal Terminated *** 2023-12-09T02:41:56.936 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Dec 09 02:41:56 smithi088 bash[226850]: ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi088 2023-12-09T02:41:56.942 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi088.service' 2023-12-09T02:41:56.989 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-09T02:41:56.990 INFO:tasks.cephadm.mon.smithi088:Stopped mon.smithi088 2023-12-09T02:41:56.990 INFO:tasks.cephadm.mon.smithi161:Stopping mon.smithi161... 2023-12-09T02:41:56.990 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi161 2023-12-09T02:41:57.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:57 smithi161 systemd[1]: Stopping Ceph mon.smithi161 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:41:57.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:57 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi161[178817]: 2023-12-09T02:41:57.204+0000 7fab43f5d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi161 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:41:57.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:57 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi161[178817]: 2023-12-09T02:41:57.204+0000 7fab43f5d700 -1 mon.smithi161@1(peon) e3 *** Got Signal Terminated *** 2023-12-09T02:41:57.759 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Dec 09 02:41:57 smithi161 bash[209561]: ceph-70b26980-963a-11ee-95a3-87774f69a715-mon-smithi161 2023-12-09T02:41:57.766 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@mon.smithi161.service' 2023-12-09T02:41:57.822 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-09T02:41:57.822 INFO:tasks.cephadm.mon.smithi161:Stopped mon.smithi161 2023-12-09T02:41:57.822 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-09T02:41:57.823 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.0 2023-12-09T02:41:58.225 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:41:57 smithi088 systemd[1]: Stopping Ceph osd.0 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:41:58.225 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:41:58 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[203477]: 2023-12-09T02:41:58.027+0000 7f5db1beb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:41:58.226 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:41:58 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[203477]: 2023-12-09T02:41:58.027+0000 7f5db1beb700 -1 osd.0 103 *** Got signal Terminated *** 2023-12-09T02:41:58.226 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:41:58 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0[203477]: 2023-12-09T02:41:58.027+0000 7f5db1beb700 -1 osd.0 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:42:03.976 INFO:journalctl@ceph.osd.0.smithi088.stdout:Dec 09 02:42:03 smithi088 bash[227008]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-0 2023-12-09T02:42:04.766 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.0.service' 2023-12-09T02:42:04.807 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-09T02:42:04.807 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-09T02:42:04.808 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-09T02:42:04.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.1 2023-12-09T02:42:04.975 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:42:04 smithi088 systemd[1]: Stopping Ceph osd.1 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:42:05.475 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:42:05 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[210075]: 2023-12-09T02:42:05.054+0000 7f25bff1d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:42:05.476 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:42:05 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[210075]: 2023-12-09T02:42:05.054+0000 7f25bff1d700 -1 osd.1 103 *** Got signal Terminated *** 2023-12-09T02:42:05.476 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:42:05 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1[210075]: 2023-12-09T02:42:05.054+0000 7f25bff1d700 -1 osd.1 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:42:11.226 INFO:journalctl@ceph.osd.1.smithi088.stdout:Dec 09 02:42:11 smithi088 bash[227273]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-1 2023-12-09T02:42:12.148 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.1.service' 2023-12-09T02:42:12.190 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-09T02:42:12.190 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-09T02:42:12.191 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-09T02:42:12.191 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.2 2023-12-09T02:42:12.452 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:42:12 smithi088 systemd[1]: Stopping Ceph osd.2 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:42:12.725 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:42:12 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[216855]: 2023-12-09T02:42:12.451+0000 7f32b16b0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:42:12.725 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:42:12 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[216855]: 2023-12-09T02:42:12.451+0000 7f32b16b0700 -1 osd.2 103 *** Got signal Terminated *** 2023-12-09T02:42:12.726 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:42:12 smithi088 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2[216855]: 2023-12-09T02:42:12.451+0000 7f32b16b0700 -1 osd.2 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:42:18.226 INFO:journalctl@ceph.osd.2.smithi088.stdout:Dec 09 02:42:17 smithi088 bash[227531]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-2 2023-12-09T02:42:19.155 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.2.service' 2023-12-09T02:42:19.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-09T02:42:19.195 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-09T02:42:19.196 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-09T02:42:19.196 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.3 2023-12-09T02:42:19.669 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:42:19 smithi161 systemd[1]: Stopping Ceph osd.3 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:42:19.819 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:42:19 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[190348]: 2023-12-09T02:42:19.436+0000 7f44f21ba700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:42:19.819 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:42:19 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[190348]: 2023-12-09T02:42:19.436+0000 7f44f21ba700 -1 osd.3 103 *** Got signal Terminated *** 2023-12-09T02:42:19.819 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:42:19 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3[190348]: 2023-12-09T02:42:19.436+0000 7f44f21ba700 -1 osd.3 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:42:25.419 INFO:journalctl@ceph.osd.3.smithi161.stdout:Dec 09 02:42:25 smithi161 bash[209708]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-3 2023-12-09T02:42:26.355 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.3.service' 2023-12-09T02:42:26.396 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-09T02:42:26.397 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-09T02:42:26.397 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-09T02:42:26.397 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.4 2023-12-09T02:42:26.642 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:26 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:26.488+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:26.643 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:42:26 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:42:26.313+0000 7fc6dd259700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:41:59.554136+0000 front 2023-12-09T02:41:59.554044+0000 (oldest deadline 2023-12-09T02:42:25.453818+0000) 2023-12-09T02:42:26.643 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:42:26 smithi161 systemd[1]: Stopping Ceph osd.4 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:42:26.643 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:42:26 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:42:26.640+0000 7fc6e045d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:42:26.643 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:42:26 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:42:26.640+0000 7fc6e045d700 -1 osd.4 103 *** Got signal Terminated *** 2023-12-09T02:42:26.919 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:42:26 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:42:26.640+0000 7fc6e045d700 -1 osd.4 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:42:27.529 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:42:27 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:42:27.265+0000 7fc6dd259700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:41:59.554136+0000 front 2023-12-09T02:41:59.554044+0000 (oldest deadline 2023-12-09T02:42:25.453818+0000) 2023-12-09T02:42:27.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:27 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:27.527+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:28.669 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:42:28 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:42:28.298+0000 7fc6dd259700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:41:59.554136+0000 front 2023-12-09T02:41:59.554044+0000 (oldest deadline 2023-12-09T02:42:25.453818+0000) 2023-12-09T02:42:28.669 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:28 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:28.513+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:29.669 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:42:29 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:42:29.274+0000 7fc6dd259700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:41:59.554136+0000 front 2023-12-09T02:41:59.554044+0000 (oldest deadline 2023-12-09T02:42:25.453818+0000) 2023-12-09T02:42:29.669 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:29 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:29.521+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:30.669 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:42:30 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:42:30.272+0000 7fc6dd259700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:41:59.554136+0000 front 2023-12-09T02:41:59.554044+0000 (oldest deadline 2023-12-09T02:42:25.453818+0000) 2023-12-09T02:42:30.670 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:30 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:30.494+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:31.669 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:42:31 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4[197060]: 2023-12-09T02:42:31.286+0000 7fc6dd259700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:41:59.554136+0000 front 2023-12-09T02:41:59.554044+0000 (oldest deadline 2023-12-09T02:42:25.453818+0000) 2023-12-09T02:42:31.670 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:31 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:31.458+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:31.670 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:31 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:31.458+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2023-12-09T02:42:06.137796+0000 front 2023-12-09T02:42:06.137846+0000 (oldest deadline 2023-12-09T02:42:30.837757+0000) 2023-12-09T02:42:32.669 INFO:journalctl@ceph.osd.4.smithi161.stdout:Dec 09 02:42:32 smithi161 bash[209976]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-4 2023-12-09T02:42:32.670 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:32 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:32.462+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:32.670 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:32 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:32.462+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2023-12-09T02:42:06.137796+0000 front 2023-12-09T02:42:06.137846+0000 (oldest deadline 2023-12-09T02:42:30.837757+0000) 2023-12-09T02:42:33.804 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:33 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:33.481+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:33.805 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:33 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:33.481+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2023-12-09T02:42:06.137796+0000 front 2023-12-09T02:42:06.137846+0000 (oldest deadline 2023-12-09T02:42:30.837757+0000) 2023-12-09T02:42:33.812 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.4.service' 2023-12-09T02:42:33.852 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-09T02:42:33.853 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-09T02:42:33.853 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-09T02:42:33.853 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.5 2023-12-09T02:42:34.074 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:33 smithi161 systemd[1]: Stopping Ceph osd.5 for 70b26980-963a-11ee-95a3-87774f69a715... 2023-12-09T02:42:34.419 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:34 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:34.072+0000 7fb8c692e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-09T02:42:34.419 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:34 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:34.072+0000 7fb8c692e700 -1 osd.5 103 *** Got signal Terminated *** 2023-12-09T02:42:34.419 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:34 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:34.073+0000 7fb8c692e700 -1 osd.5 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-09T02:42:34.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:34 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:34.524+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:34.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:34 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:34.524+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2023-12-09T02:42:06.137796+0000 front 2023-12-09T02:42:06.137846+0000 (oldest deadline 2023-12-09T02:42:30.837757+0000) 2023-12-09T02:42:35.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:35 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:35.515+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:35.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:35 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:35.515+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2023-12-09T02:42:06.137796+0000 front 2023-12-09T02:42:06.137846+0000 (oldest deadline 2023-12-09T02:42:30.837757+0000) 2023-12-09T02:42:36.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:36 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:36.520+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:36.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:36 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:36.520+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2023-12-09T02:42:06.137796+0000 front 2023-12-09T02:42:06.137846+0000 (oldest deadline 2023-12-09T02:42:30.837757+0000) 2023-12-09T02:42:37.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:37 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:37.500+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:37.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:37 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:37.500+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2023-12-09T02:42:06.137796+0000 front 2023-12-09T02:42:06.137846+0000 (oldest deadline 2023-12-09T02:42:30.837757+0000) 2023-12-09T02:42:38.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:38 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:38.518+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2023-12-09T02:42:00.237598+0000 front 2023-12-09T02:42:00.237556+0000 (oldest deadline 2023-12-09T02:42:26.137365+0000) 2023-12-09T02:42:38.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:38 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:38.518+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2023-12-09T02:42:06.137796+0000 front 2023-12-09T02:42:06.137846+0000 (oldest deadline 2023-12-09T02:42:30.837757+0000) 2023-12-09T02:42:38.920 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:38 smithi161 ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5[204030]: 2023-12-09T02:42:38.518+0000 7fb8c0f25700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2023-12-09T02:42:16.138441+0000 front 2023-12-09T02:42:16.138455+0000 (oldest deadline 2023-12-09T02:42:37.838373+0000) 2023-12-09T02:42:39.919 INFO:journalctl@ceph.osd.5.smithi161.stdout:Dec 09 02:42:39 smithi161 bash[210238]: ceph-70b26980-963a-11ee-95a3-87774f69a715-osd-5 2023-12-09T02:42:40.861 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70b26980-963a-11ee-95a3-87774f69a715@osd.5.service' 2023-12-09T02:42:40.901 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-09T02:42:40.901 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-09T02:42:40.902 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 70b26980-963a-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-09T02:42:51.878 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 70b26980-963a-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-09T02:43:09.683 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-09T02:43:09.722 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-09T02:43:09.753 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-09T02:43:09.755 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628/remote/smithi088/crash 2023-12-09T02:43:09.756 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/crash -- . 2023-12-09T02:43:09.793 INFO:teuthology.orchestra.run.smithi088.stderr:tar: /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-09T02:43:09.793 INFO:teuthology.orchestra.run.smithi088.stderr:tar: Error is not recoverable: exiting now 2023-12-09T02:43:09.795 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628/remote/smithi161/crash 2023-12-09T02:43:09.796 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/crash -- . 2023-12-09T02:43:09.822 INFO:teuthology.orchestra.run.smithi161.stderr:tar: /var/lib/ceph/70b26980-963a-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-09T02:43:09.822 INFO:teuthology.orchestra.run.smithi161.stderr:tar: Error is not recoverable: exiting now 2023-12-09T02:43:09.823 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-09T02:43:09.823 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-09T02:43:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:grep: /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph.log: No such file or directory 2023-12-09T02:43:09.867 INFO:tasks.cephadm:Compressing logs... 2023-12-09T02:43:09.867 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-09T02:43:09.910 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-09T02:43:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-09T02:43:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:: No such file or directory 2023-12-09T02:43:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi088.utskxh.log 2023-12-09T02:43:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mon.smithi088.log 2023-12-09T02:43:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-09T02:43:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi088.utskxh.log: /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mon.smithi088.log: gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.2.log 2023-12-09T02:43:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.0.log 2023-12-09T02:43:09.940 INFO:teuthology.orchestra.run.smithi161.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-09T02:43:09.940 INFO:teuthology.orchestra.run.smithi161.stderr:: No such file or directory 2023-12-09T02:43:09.940 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi161.dhvdif.log 2023-12-09T02:43:09.940 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mon.smithi161.log 2023-12-09T02:43:09.941 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi161.dhvdif.log: gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-09T02:43:09.941 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mon.smithi161.log: gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.3.log 2023-12-09T02:43:09.941 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi161.posrbq.log 2023-12-09T02:43:09.941 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.3.log: /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi161.posrbq.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-09T02:43:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.2.log: /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi088.zfojux.log 2023-12-09T02:43:09.942 INFO:teuthology.orchestra.run.smithi161.stderr: 94.2% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi161.posrbq.log.gz 2023-12-09T02:43:09.942 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.4.log 2023-12-09T02:43:09.943 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.5.log 2023-12-09T02:43:09.943 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mgr.smithi161.qmxtmg.log 2023-12-09T02:43:09.945 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi088.zfojux.log: 94.1% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi088.zfojux.log.gz 2023-12-09T02:43:09.945 INFO:teuthology.orchestra.run.smithi088.stderr: 91.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-09T02:43:09.945 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mgr.smithi088.jwlofb.log 2023-12-09T02:43:09.945 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.1.log 2023-12-09T02:43:09.946 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mgr.smithi088.jwlofb.log: /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.1.log: 91.4% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi088.utskxh.log.gz 2023-12-09T02:43:09.947 INFO:teuthology.orchestra.run.smithi088.stderr: 90.7% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-09T02:43:09.951 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.5.log: /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mgr.smithi161.qmxtmg.log: 90.9% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-09T02:43:09.974 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mgr.smithi161.qmxtmg.log.gz 2023-12-09T02:43:10.149 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mgr.smithi088.jwlofb.log.gz 2023-12-09T02:43:10.210 INFO:teuthology.orchestra.run.smithi161.stderr: 92.5% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mon.smithi161.log.gz 2023-12-09T02:43:10.521 INFO:teuthology.orchestra.run.smithi088.stderr: 90.8% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mon.smithi088.log.gz 2023-12-09T02:43:14.642 INFO:teuthology.orchestra.run.smithi161.stderr: 93.2% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.4.log.gz 2023-12-09T02:43:15.029 INFO:teuthology.orchestra.run.smithi088.stderr: 93.5% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.0.log.gz 2023-12-09T02:43:15.174 INFO:teuthology.orchestra.run.smithi088.stderr: 93.1% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.2.log.gz 2023-12-09T02:43:15.564 INFO:teuthology.orchestra.run.smithi088.stderr: 93.3% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.1.log.gz 2023-12-09T02:43:15.566 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-12-09T02:43:15.566 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m5.641s 2023-12-09T02:43:15.566 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m16.133s 2023-12-09T02:43:15.566 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m0.636s 2023-12-09T02:43:16.462 INFO:teuthology.orchestra.run.smithi161.stderr: 93.1% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.5.log.gz 2023-12-09T02:43:16.651 INFO:teuthology.orchestra.run.smithi161.stderr: 93.4% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-osd.3.log.gz 2023-12-09T02:44:31.911 INFO:teuthology.orchestra.run.smithi161.stderr: 92.6% -- replaced with /var/log/ceph/70b26980-963a-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi161.dhvdif.log.gz 2023-12-09T02:44:31.913 INFO:teuthology.orchestra.run.smithi161.stderr: 2023-12-09T02:44:31.913 INFO:teuthology.orchestra.run.smithi161.stderr:real 1m21.985s 2023-12-09T02:44:31.913 INFO:teuthology.orchestra.run.smithi161.stderr:user 1m36.850s 2023-12-09T02:44:31.913 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m3.209s 2023-12-09T02:44:31.913 INFO:tasks.cephadm:Archiving logs... 2023-12-09T02:44:31.914 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628/remote/smithi088/log 2023-12-09T02:44:31.915 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-09T02:44:34.345 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628/remote/smithi161/log 2023-12-09T02:44:34.346 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-09T02:44:57.197 INFO:tasks.cephadm:Removing cluster... 2023-12-09T02:44:57.198 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 70b26980-963a-11ee-95a3-87774f69a715 --force 2023-12-09T02:44:57.672 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 70b26980-963a-11ee-95a3-87774f69a715 --force 2023-12-09T02:44:58.265 INFO:tasks.cephadm:Removing cephadm ... 2023-12-09T02:44:58.265 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-09T02:44:58.286 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-09T02:44:58.304 INFO:tasks.cephadm:Teardown complete 2023-12-09T02:44:58.305 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-09T02:44:58.315 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-09T02:44:58.316 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-09T02:44:58.329 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-09T02:44:58.422 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-09T02:44:58.433 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-09T02:44:58.433 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-09T02:44:58.436 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-09T02:44:58.452 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-12-09T02:44:58.453 INFO:teuthology.orchestra.run.smithi161.stderr:bash: ntpq: command not found 2023-12-09T02:44:58.456 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-09T02:44:58.456 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2023-12-09T02:44:58.456 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 24 +638us[ +638us] +/- 82ms 2023-12-09T02:44:58.457 INFO:teuthology.orchestra.run.smithi161.stdout:^* hv02.front.sepia.ceph.com 3 6 377 24 -170us[ -160us] +/- 53ms 2023-12-09T02:44:58.457 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 -267us[ -256us] +/- 63ms 2023-12-09T02:44:58.457 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-09T02:44:58.458 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-09T02:44:58.458 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-12-09T02:44:58.458 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 86 +629us[ +629us] +/- 81ms 2023-12-09T02:44:58.459 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv02.front.sepia.ceph.com 3 7 377 89 -192us[ -189us] +/- 52ms 2023-12-09T02:44:58.459 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 -309us[ -309us] +/- 63ms 2023-12-09T02:44:58.459 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-09T02:44:58.459 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-09T02:44:58.474 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-09T02:44:58.475 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-09T02:44:58.491 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-09T02:44:58.597 DEBUG:teuthology.orchestra.run.smithi161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-09T02:44:58.692 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-09T02:44:58.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-09T02:44:58.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-09T02:44:58.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-09T02:44:58.758 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-09T02:44:58.770 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-09T02:44:58.781 INFO:teuthology.task.internal:Duration was 2035.787854 seconds 2023-12-09T02:44:58.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-09T02:44:58.793 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-09T02:44:58.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-09T02:44:58.795 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-09T02:44:58.839 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-09T02:44:58.844 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-09T02:44:58.987 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-09T02:44:58.987 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2023-12-09T02:44:58.987 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-09T02:44:59.009 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2023-12-09T02:44:59.009 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-09T02:44:59.032 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-09T02:44:59.032 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-09T02:44:59.052 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-09T02:44:59.122 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-09T02:44:59.123 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-09T02:44:59.125 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-09T02:44:59.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-09T02:44:59.249 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-09T02:44:59.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-09T02:44:59.277 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-09T02:44:59.305 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-09T02:44:59.316 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-09T02:44:59.320 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-09T02:44:59.344 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2023-12-09T02:44:59.371 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2023-12-09T02:44:59.385 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-09T02:44:59.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-09T02:44:59.415 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-09T02:44:59.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-09T02:44:59.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-09T02:44:59.453 INFO:teuthology.task.internal:Transferring archived files... 2023-12-09T02:44:59.454 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628/remote/smithi088 2023-12-09T02:44:59.454 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-09T02:44:59.503 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628/remote/smithi161 2023-12-09T02:44:59.503 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-09T02:44:59.545 INFO:teuthology.task.internal:Removing archive directory... 2023-12-09T02:44:59.546 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-09T02:44:59.548 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-09T02:44:59.596 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-09T02:44:59.610 INFO:teuthology.task.internal:Not uploading archives. 2023-12-09T02:44:59.610 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-09T02:44:59.622 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-09T02:44:59.622 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-09T02:44:59.627 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-09T02:44:59.642 INFO:teuthology.orchestra.run.smithi088.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 9 02:44 /home/ubuntu/cephtest 2023-12-09T02:44:59.654 INFO:teuthology.orchestra.run.smithi161.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 9 02:44 /home/ubuntu/cephtest 2023-12-09T02:44:59.655 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-09T02:44:59.669 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-09T02:44:59.695 INFO:teuthology.nuke:Checking targets against current locks 2023-12-09T02:44:59.719 DEBUG:teuthology.nuke:shortname: smithi088 2023-12-09T02:44:59.720 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-09T02:44:59.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-09 01:56:50.197482', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDLGmGNt+qqtG2i30m5b9ZVtYO4pf+PODCH3Q3LztTY8SlVAkOd0CeWvl6gev6QzHc5oTapLT3Y1MSXeHEsETPQ='} 2023-12-09T02:44:59.750 DEBUG:teuthology.nuke:shortname: smithi161 2023-12-09T02:44:59.750 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-09T02:44:59.771 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:38:02-orch-main-distro-default-smithi/7484628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-09 01:56:50.195488', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJZIcCbBer9WMUzjbLfMjTcxr/tmFJMpy4poE6Cu6CzgE8eJmUq1pAU0VBWUPDzdP3sD77pN6ka2seyU8orCjI='} 2023-12-09T02:44:59.798 INFO:teuthology.orchestra.console.smithi088:Power off 2023-12-09T02:44:59.798 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-09T02:44:59.822 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-12-09T02:44:59.823 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T02:44:59.843 INFO:teuthology.orchestra.console.smithi161:Power off 2023-12-09T02:44:59.843 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-09T02:44:59.859 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-09T02:44:59.870 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-12-09T02:44:59.870 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T02:44:59.893 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-09T02:45:03.861 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T02:45:03.895 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T02:45:03.971 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-09T02:45:04.006 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-09T02:45:07.974 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T02:45:08.006 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T02:45:08.084 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-09T02:45:08.117 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-09T02:45:08.186 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-12-09T02:45:12.122 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T02:45:12.232 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-09T02:45:12.333 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-12-09T02:45:12.438 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2035.7878539562225 failure_reason: 'Command failed on smithi088 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70b26980-963a-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9e4316aee6a24a8a89d8cd5a7854348e status: fail success: false 2023-12-09T02:45:12.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:45:12.516 INFO:teuthology.run:FAIL